Making multirater feedback systems work

Quality Progress

Volumn 31, Issue 4, 1998, Pages 81-89

  Church, Allan H ^a,b,c   Waclawski, Janine ^a,b  

^a W Warner Burke Associates   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c American Society for Quality   (India)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0002448360     PISSN: 0033524X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (57)

1. S.M. Hronec, Vital Signs: Using Quality, Time, and Cost Performance Measurements to Chart Your Company's Future (New York, NY: AMACOM, 1993).
2. . D.W. Bracken, "Multisource (360-degree) Feedback: Surveys for Individual and Organizational Development," in A.I. Kraut, editor, Organizational Surveys: Tools for Assessment and Change (San Francisco, CA: Jossey-Bass, 1996); A.H. Church, M. Javitch, and W.W. Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go," Managing Service Quality, Vol. 5, No. 3, 1995, p. 29; M. London and R.W. Beatty, "360-degree Feedback as a Competitive Advantage," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 353; F. Shipper and C.P. Neck, "Subordinates' Observations: Feedback for Management Development," Human Resource Development Quarterly, Vol. 1, 1990, p. 371.
3. . D.W. Bracken, "Multisource (360-degree) Feedback: Surveys for Individual and Organizational Development," in A.I. Kraut, editor, Organizational Surveys: Tools for Assessment and Change (San Francisco, CA: Jossey-Bass, 1996); A.H. Church, M. Javitch, and W.W. Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go," Managing Service Quality, Vol. 5, No. 3, 1995, p. 29; M. London and R.W. Beatty, "360-degree Feedback as a Competitive Advantage," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 353; F. Shipper and C.P. Neck, "Subordinates' Observations: Feedback for Management Development," Human Resource Development Quarterly, Vol. 1, 1990, p. 371.
4. . D.W. Bracken, "Multisource (360-degree) Feedback: Surveys for Individual and Organizational Development," in A.I. Kraut, editor, Organizational Surveys: Tools for Assessment and Change (San Francisco, CA: Jossey-Bass, 1996); A.H. Church, M. Javitch, and W.W. Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go," Managing Service Quality, Vol. 5, No. 3, 1995, p. 29; M. London and R.W. Beatty, "360-degree Feedback as a Competitive Advantage," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 353; F. Shipper and C.P. Neck, "Subordinates' Observations: Feedback for Management Development," Human Resource Development Quarterly, Vol. 1, 1990, p. 371.
5. . D.W. Bracken, "Multisource (360-degree) Feedback: Surveys for Individual and Organizational Development," in A.I. Kraut, editor, Organizational Surveys: Tools for Assessment and Change (San Francisco, CA: Jossey-Bass, 1996); A.H. Church, M. Javitch, and W.W. Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go," Managing Service Quality, Vol. 5, No. 3, 1995, p. 29; M. London and R.W. Beatty, "360-degree Feedback as a Competitive Advantage," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 353; F. Shipper and C.P. Neck, "Subordinates' Observations: Feedback for Management Development," Human Resource Development Quarterly, Vol. 1, 1990, p. 371.
6. B. O'Reilly, "360° Feedback Can Change Your Life," FORTUNE, Vol. 130, No. 8, 1994, p. 93.
7. K. Melymuka, "I'm OK, You're OK?" Computerworld, Vol. 28, No. 45, 1994, p. 89.
8. D. Bracken, "Straight Talk About Multirater Feedback," Training & Development, Vol. 48, No. 9, 1994, p. 44; A. Church, "First-Rate Multirater Feedback," Training & Development, Vol. 49. No. 8, 1995, p. 42.
9. D. Bracken, "Straight Talk About Multirater Feedback," Training & Development, Vol. 48, No. 9, 1994, p. 44; A. Church, "First-Rate Multirater Feedback," Training & Development, Vol. 49. No. 8, 1995, p. 42.
10. J.F. Hazucha, S.A. Hezlett, and RJ. Schneider, "The Impact of 360-Degree Feedback on Management Skills Development," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 325; London and Beatty, "360-Degree Feedback as a Competitive Advantage."
11. J.F. Hazucha, S.A. Hezlett, and RJ. Schneider, "The Impact of 360-Degree Feedback on Management Skills Development," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 325; London and Beatty, "360-Degree Feedback as a Competitive Advantage."
12. K.M. Nowack, "Self-Assessment and Rater-Assessment as a Dimension of Management Development," Human Resource Development Quarterly, Vol. 3, 1992, p. 155; Shipper and Neck, "Subordinates' Observations: Feedback for Management Development."
13. K.M. Nowack, "Self-Assessment and Rater-Assessment as a Dimension of Management Development," Human Resource Development Quarterly, Vol. 3, 1992, p. 155; Shipper and Neck, "Subordinates' Observations: Feedback for Management Development."
14. Three special issues focused on multirater feedback currently exist or are in preparation: Human Resource Management, Vol. 32, Nos. 2 and 3, 1993, edited by W.W. Tornow; Group & Organization Management, Vol. 22, No. 2, edited by A. Church and D. Bracken, 1997; and a forthcoming 1998 issue of Leadership Quarterly.
15. Three special issues focused on multirater feedback currently exist or are in preparation: Human Resource Management, Vol. 32, Nos. 2 and 3, 1993, edited by W.W. Tornow; Group & Organization Management, Vol. 22, No. 2, edited by A. Church and D. Bracken, 1997; and a forthcoming 1998 issue of Leadership Quarterly.
16. D. Goleman, Emotional Intelligence (New York, NY: Bantam, 1995).
17. C. Garfield, Peak Performers: The New Heroes of American Business (New York: Avon Books, 1986).
18. S.R. Covey, The 7 Habits of Highly Effective People (New York, NY: Simon & Schuster, 1989).
19. P.M. Senge, The Fifth Discipline: The Art and Practice of the Learning Organization (New York, NY: Doubleday, 1990).
20. L.E. Atwater and F.J. Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?" Personnel Psychology, Vol. 45, 1992, p. 141; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Dissertation Abstracts International, 55-05B, 2028 (University Microfilms No. AAI9427924, 1994); Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Journal of Applied Psychology, Vol. 82, No. 2, 1997, p. 281; A. Furnham and P. Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation," Journal of Occupational and Organizational Psychology, Vol. 67, 1994, p. 57; E. Van Velsor, S. Taylor, and J.B. Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 249.
21. L.E. Atwater and F.J. Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?" Personnel Psychology, Vol. 45, 1992, p. 141; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Dissertation Abstracts International, 55-05B, 2028 (University Microfilms No. AAI9427924, 1994); Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Journal of Applied Psychology, Vol. 82, No. 2, 1997, p. 281; A. Furnham and P. Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation," Journal of Occupational and Organizational Psychology, Vol. 67, 1994, p. 57; E. Van Velsor, S. Taylor, and J.B. Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 249.
22. L.E. Atwater and F.J. Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?" Personnel Psychology, Vol. 45, 1992, p. 141; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Dissertation Abstracts International, 55-05B, 2028 (University Microfilms No. AAI9427924, 1994); Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Journal of Applied Psychology, Vol. 82, No. 2, 1997, p. 281; A. Furnham and P. Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation," Journal of Occupational and Organizational Psychology, Vol. 67, 1994, p. 57; E. Van Velsor, S. Taylor, and J.B. Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 249.
23. L.E. Atwater and F.J. Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?" Personnel Psychology, Vol. 45, 1992, p. 141; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Dissertation Abstracts International, 55-05B, 2028 (University Microfilms No. AAI9427924, 1994); Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Journal of Applied Psychology, Vol. 82, No. 2, 1997, p. 281; A. Furnham and P. Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation," Journal of Occupational and Organizational Psychology, Vol. 67, 1994, p. 57; E. Van Velsor, S. Taylor, and J.B. Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 249.
24. L.E. Atwater and F.J. Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?" Personnel Psychology, Vol. 45, 1992, p. 141; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Dissertation Abstracts International, 55-05B, 2028 (University Microfilms No. AAI9427924, 1994); Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations," Journal of Applied Psychology, Vol. 82, No. 2, 1997, p. 281; A. Furnham and P. Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation," Journal of Occupational and Organizational Psychology, Vol. 67, 1994, p. 57; E. Van Velsor, S. Taylor, and J.B. Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 249.
25. Bracken, "Straight Talk About Multirater Feedback," Church, "First-Rate Multirater Feedback; O'Reilly, 360° Feedback Can Change Your Life; W. Tornow, "Introduction to Special Issue of 360-Degree Feedback," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 211.
26. Bracken, "Straight Talk About Multirater Feedback," Church, "First-Rate Multirater Feedback; O'Reilly, 360° Feedback Can Change Your Life; W. Tornow, "Introduction to Special Issue of 360-Degree Feedback," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 211.
27. Bracken, "Straight Talk About Multirater Feedback," Church, "First-Rate Multirater Feedback; O'Reilly, 360° Feedback Can Change Your Life; W. Tornow, "Introduction to Special Issue of 360-Degree Feedback," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 211.
28. Bracken, "Straight Talk About Multirater Feedback," Church, "First-Rate Multirater Feedback; O'Reilly, 360° Feedback Can Change Your Life; W. Tornow, "Introduction to Special Issue of 360-Degree Feedback," Human Resource Management, Vol. 32, Nos. 2-3, 1993, p. 211.
29. A. Church and D. Bracken, "Advancing the State of the Art of 360-Degree Feedback," editors' comments on the research and practice of multirater assessments methods,Group & Organization Management, Vol. 22, No. 2, p. 149, 1997; Tornow, "Introduction to Special Issue of 360-Degree Feedback."
30. A. Church and D. Bracken, "Advancing the State of the Art of 360-Degree Feedback," editors' comments on the research and practice of multirater assessments methods,Group & Organization Management, Vol. 22, No. 2, p. 149, 1997; Tornow, "Introduction to Special Issue of 360-Degree Feedback."
31. Bracken, "Multisource (360-Degree) Feedback: Surveys for Individual and Organizational Development"; Hazucha, Hezlett, and Schneider, "The Impact of 360-Degree Feedback on Management Skills Development"; London and Beatty, "360-Degree Feedback as a Competitive Advantage."
32. Bracken, "Multisource (360-Degree) Feedback: Surveys for Individual and Organizational Development"; Hazucha, Hezlett, and Schneider, "The Impact of 360-Degree Feedback on Management Skills Development"; London and Beatty, "360-Degree Feedback as a Competitive Advantage."
33. Bracken, "Multisource (360-Degree) Feedback: Surveys for Individual and Organizational Development"; Hazucha, Hezlett, and Schneider, "The Impact of 360-Degree Feedback on Management Skills Development"; London and Beatty, "360-Degree Feedback as a Competitive Advantage."
34. Church, Javitch, and Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go."
35. D.H. Maister, Managing the Professional Service Firm (New York, NY: The Free Press, 1993).
36. Bracken, "Straight Talk About Multirater Feedback"; Church, Javitch, and Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go"; D.A. Nadler, Feedback and Organization Development: Using Data-Based Methods (Reading, MA.: Addison-Wesley, 1977); London and Beatty, "360-Degree Feedback as a Competitive Advantage."
37. Bracken, "Straight Talk About Multirater Feedback"; Church, Javitch, and Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go"; D.A. Nadler, Feedback and Organization Development: Using Data-Based Methods (Reading, MA.: Addison-Wesley, 1977); London and Beatty, "360-Degree Feedback as a Competitive Advantage."
38. Bracken, "Straight Talk About Multirater Feedback"; Church, Javitch, and Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go"; D.A. Nadler, Feedback and Organization Development: Using Data-Based Methods (Reading, MA.: Addison-Wesley, 1977); London and Beatty, "360-Degree Feedback as a Competitive Advantage."
39. Bracken, "Straight Talk About Multirater Feedback"; Church, Javitch, and Burke, "Enhancing Professional Service Quality: Feedback Is the Way to Go"; D.A. Nadler, Feedback and Organization Development: Using Data-Based Methods (Reading, MA.: Addison-Wesley, 1977); London and Beatty, "360-Degree Feedback as a Competitive Advantage."
40. J.P. Kotter and J.L. Hesket, Corporate Culture and Performance (New York, NY: Free Press, 1992).
41. S.J. Ashford and A.S. Tsui, "Self-Regulation for Managerial Effectiveness: The Role of Active Feedback Seeking," Academy of Management Journal, Vol. 34, 1991, p. 251; J. Farh and J.D Werbel, "Effects of Purpose of the Appraisal and Expectation of Validation on Self-Appraisal Leniency, Journal of Applied Psychology, Vol. 71, 1986, p. 527; P. Lewicki, "Self-Image Bias in Person Perception," Journal of Personality and Social Psychology, Vol. 45, 1983, p. 374; G.C. Thornton III, "Psychometric Properties of Self-Appraisal of Job Performance," Personnel Psychology, Vol. 33, 1980, p. 263.
42. S.J. Ashford and A.S. Tsui, "Self-Regulation for Managerial Effectiveness: The Role of Active Feedback Seeking," Academy of Management Journal, Vol. 34, 1991, p. 251; J. Farh and J.D Werbel, "Effects of Purpose of the Appraisal and Expectation of Validation on Self-Appraisal Leniency, Journal of Applied Psychology, Vol. 71, 1986, p. 527; P. Lewicki, "Self-Image Bias in Person Perception," Journal of Personality and Social Psychology, Vol. 45, 1983, p. 374; G.C. Thornton III, "Psychometric Properties of Self-Appraisal of Job Performance," Personnel Psychology, Vol. 33, 1980, p. 263.
43. S.J. Ashford and A.S. Tsui, "Self-Regulation for Managerial Effectiveness: The Role of Active Feedback Seeking," Academy of Management Journal, Vol. 34, 1991, p. 251; J. Farh and J.D Werbel, "Effects of Purpose of the Appraisal and Expectation of Validation on Self-Appraisal Leniency, Journal of Applied Psychology, Vol. 71, 1986, p. 527; P. Lewicki, "Self-Image Bias in Person Perception," Journal of Personality and Social Psychology, Vol. 45, 1983, p. 374; G.C. Thornton III, "Psychometric Properties of Self-Appraisal of Job Performance," Personnel Psychology, Vol. 33, 1980, p. 263.
44. S.J. Ashford and A.S. Tsui, "Self-Regulation for Managerial Effectiveness: The Role of Active Feedback Seeking," Academy of Management Journal, Vol. 34, 1991, p. 251; J. Farh and J.D Werbel, "Effects of Purpose of the Appraisal and Expectation of Validation on Self-Appraisal Leniency, Journal of Applied Psychology, Vol. 71, 1986, p. 527; P. Lewicki, "Self-Image Bias in Person Perception," Journal of Personality and Social Psychology, Vol. 45, 1983, p. 374; G.C. Thornton III, "Psychometric Properties of Self-Appraisal of Job Performance," Personnel Psychology, Vol. 33, 1980, p. 263.
45. W.W. Burke and P. Jackson, "Making the SmithKline Beecham Merger Work," Human Resource Management, Vol. 30, 1991, p. 69.
46. W. Woods, "Can Home Depot Fix Its Sagging Stock?" FORTUNE, Vol. 133, No. 4, 1996, p. 139.
47. D.A. Gioia and C.O. Longenecker, "Delving Into the Dark Side: The Politics of Executive Appraisal," Organizational Dynamics, Vol. 22, No. 3, 1994, p. 47; M.M. Harris, "Rater Motivation in the Performance Appraisal Context: A Theoretical Framework," Journal of Management, Vol. 20, No. 4, 1994, p. 737.
48. D.A. Gioia and C.O. Longenecker, "Delving Into the Dark Side: The Politics of Executive Appraisal," Organizational Dynamics, Vol. 22, No. 3, 1994, p. 47; M.M. Harris, "Rater Motivation in the Performance Appraisal Context: A Theoretical Framework," Journal of Management, Vol. 20, No. 4, 1994, p. 737.
49. W. Burke and G.H. Litwin, "A Causal Model of Organizational Performance and Change," Journal of Management, Vol. 18, 1992, p. 523.
50. F. Landy and J. Farr, "Performance Rating," Psychological Bulletin, Vol. 87, 1980, p. 72.
51. W. Burke, E.A. Richley, and L. DeAngelis, "Changing Leadership and Planning Processes at the Lewis Research Center, National Aeronautics and Space Administration," Human Resource Management, Vol. 24, 1985, p. 81; Church, Javitch, and Burke, Enhancing Professional Service Quality: Feedback Is the Way to Go"; Van Velsor, Taylor, and Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness."
52. W. Burke, E.A. Richley, and L. DeAngelis, "Changing Leadership and Planning Processes at the Lewis Research Center, National Aeronautics and Space Administration," Human Resource Management, Vol. 24, 1985, p. 81; Church, Javitch, and Burke, Enhancing Professional Service Quality: Feedback Is the Way to Go"; Van Velsor, Taylor, and Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness."
53. W. Burke, E.A. Richley, and L. DeAngelis, "Changing Leadership and Planning Processes at the Lewis Research Center, National Aeronautics and Space Administration," Human Resource Management, Vol. 24, 1985, p. 81; Church, Javitch, and Burke, Enhancing Professional Service Quality: Feedback Is the Way to Go"; Van Velsor, Taylor, and Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness."
54. Atwater and Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?"; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations"; Furnham and Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation"; Van Velsor, Taylor, and Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness."
55. Atwater and Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?"; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations"; Furnham and Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation"; Van Velsor, Taylor, and Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness."
56. Atwater and Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?"; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations"; Furnham and Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation"; Van Velsor, Taylor, and Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness."
57. Atwater and Yammarino, "Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?"; Church, "Managerial Self-Awareness in High-Performing Individuals in Organizations"; Furnham and Stringfield, "Congruence of Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation"; Van Velsor, Taylor, and Leslie, "An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness."