Participant Input into Rater Selection: Potential Effects on the Quality and Acceptance of Ratings in the Context of 360-Degree Feedback

Public Personnel Management

Volumn 33, Issue 1, 2004, Pages 23-32

  Bret Becton, J ^a   Schraeder, Mike ^b  

^a AUBURN UNIVERSITY   (United States)

^b TROY UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 1842481263     PISSN: 00910260     EISSN: None     Source Type: Journal    
DOI: 10.1177/009102600403300102     Document Type: Article

References (60)

1. Mohrman, A.M., Jr., Resnick-West, S.M., & Lawler, E.E.III (1989). Designing performance appraisal systems: Aligning appraisals and organizational realities. San Francisco: Jossey-Bass.
2. Wohlers, A.J., & London, M. (1989). Ratings of managerial characteristics: Evaluation difficulty, co-worker agreement, and self-awareness. Personnel Psychology, 42, 235-261.
3. Atwater, L.E., Roush, P., & Fischthal, A. (199). The influence of upward feedback on self- and follower ratings of leadership. Personnel Psychology, 48(1), 35-60. See also Daw, R.W., & Gage, N.L. (1967). Effect of feedback from teachers to principals. Journal of Educational Psychology, 58(3), 181-188 and Smither, J.W., London, M., Vasilopoulous, N.L., Reilly, R.R., Millsap, R.E., & Salvemini, N. (1995). A field study of reactions to normative versus individualized upward feedback. Group and Organizational Management, 20(1), 61-89.
4. Atwater, L.E., Roush, P., & Fischthal, A. (199). The influence of upward feedback on self- and follower ratings of leadership. Personnel Psychology, 48(1), 35-60. See also Daw, R.W., & Gage, N.L. (1967). Effect of feedback from teachers to principals. Journal of Educational Psychology, 58(3), 181-188 and Smither, J.W., London, M., Vasilopoulous, N.L., Reilly, R.R., Millsap, R.E., & Salvemini, N. (1995). A field study of reactions to normative versus individualized upward feedback. Group and Organizational Management, 20(1), 61-89.
5. Atwater, L.E., Roush, P., & Fischthal, A. (199). The influence of upward feedback on self- and follower ratings of leadership. Personnel Psychology, 48(1), 35-60. See also Daw, R.W., & Gage, N.L. (1967). Effect of feedback from teachers to principals. Journal of Educational Psychology, 58(3), 181-188 and Smither, J.W., London, M., Vasilopoulous, N.L., Reilly, R.R., Millsap, R.E., & Salvemini, N. (1995). A field study of reactions to normative versus individualized upward feedback. Group and Organizational Management, 20(1), 61-89.
6. Brutus, S., Fleenor, J.W., & London, M. (1998). Elements of effective 360-degree feedback. In W.W. Tornow, M. London, & CCL Associates (Eds.), Maximizing the value of 360-degree feedback: A process for successful individual and organizational development (pp. 11-27). San Francisco: Jossey-Bass.
7. London, M., & Smither, J.W. (1995). Can multi-source feedback change self-evaluations, skill development, and performance? Theory-based applications and directions for research. Personnel Psychology, 48, 803-839.
8. Brutus, S., Fleenor, J.W., & London, M. (1998). Elements of effective 360-degree feedback. In W.W. Tornow, M. London, & CCL Associates (Eds.), Maximizing the value of 360-degree feedback: A process for successful individual and organizational development (pp. 11-27). San Francisco: Jossey-Bass.
9. Yukl, G., & Lepsinger, R. (1995). How to get the most out of 360-degree feedback. Training, 32, 45-50.
10. London, M., & Smither, J.W. (1995) op.cit. See also Romano, C. (1994). Conquering the fear of feedback. HR Focus, 71(3), 9-19, Timmreck, C.W., & Bracken, D.W. (1996, April). Multisource assessment: Reinforcing the preferred "means" to the end. In W.W. Tornow (Chair), 360-degree feedback systems: Another look at their uses and impact. Symposium conducted at the Eleventh Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA, and Van Velsor, E., & Wall, S.J. (1992, March). How to choose a feedback instrument. Training, 47-52.
11. London, M., & Smither, J.W. (1995) op.cit. See also Romano, C. (1994). Conquering the fear of feedback. HR Focus, 71(3), 9-19, Timmreck, C.W., & Bracken, D.W. (1996, April). Multisource assessment: Reinforcing the preferred "means" to the end. In W.W. Tornow (Chair), 360-degree feedback systems: Another look at their uses and impact. Symposium conducted at the Eleventh Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA, and Van Velsor, E., & Wall, S.J. (1992, March). How to choose a feedback instrument. Training, 47-52.
12. London, M., & Smither, J.W. (1995) op.cit. See also Romano, C. (1994). Conquering the fear of feedback. HR Focus, 71(3), 9-19, Timmreck, C.W., & Bracken, D.W. (1996, April). Multisource assessment: Reinforcing the preferred "means" to the end. In W.W. Tornow (Chair), 360-degree feedback systems: Another look at their uses and impact. Symposium conducted at the Eleventh Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA, and Van Velsor, E., & Wall, S.J. (1992, March). How to choose a feedback instrument. Training, 47-52.
13. London, M., & Smither, J.W. (1995) op.cit. See also Romano, C. (1994). Conquering the fear of feedback. HR Focus, 71(3), 9-19, Timmreck, C.W., & Bracken, D.W. (1996, April). Multisource assessment: Reinforcing the preferred "means" to the end. In W.W. Tornow (Chair), 360-degree feedback systems: Another look at their uses and impact. Symposium conducted at the Eleventh Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA, and Van Velsor, E., & Wall, S.J. (1992, March). How to choose a feedback instrument. Training, 47-52.
14. Bracken, D.W. (1996). Multisource (360-degree) feedback: Surveys for individual and organizational development. In A.I. Kraut (Ed.), Organizational surveys: Tools for assessment and change (pp. 117-143). San Francisco: Jossey-Bass.
15. Waldman, D.A., Atwater, L.E., & Antonioni, D. (1998). Has 360-degree feedback gone amok? The Academy of Management Executive, 12(2), 86-95.
16. London, M., & Beatty, R.W. (1993). 360-degree feedback as a competitive advantage. Human Resource Management, 32, 353-372.
17. London, M., & Smither, J.W. (1995) op.cit.
18. London, M., & Wohlers, A.J. (1991). Agreement between subordinate and self-ratings in upward feedback. Personnel Psychology, 44, 375-390. See also Tsui, A.S., & Ohlott, P. (1988). Multiple assessment of managerial effectiveness: Interrater agreement and consensus in effectiveness models. Personnel Psychology, 41, 779-803, McEvoy, G.M., & Beatty, R.W. (1989). Assessment centers and subordinate appraisals of managers: A seven-year examination of predictive validity. Personnel Psychology, 42, 37-52, and Wohlers, A.J., & London, M. (1989). Ratings of managerial characteristics: Evaluation difficulty, co-worker agreement, and self-awareness. Personnel Psychology, 42, 235-261.
19. London, M., & Wohlers, A.J. (1991). Agreement between subordinate and self-ratings in upward feedback. Personnel Psychology, 44, 375-390. See also Tsui, A.S., & Ohlott, P. (1988). Multiple assessment of managerial effectiveness: Interrater agreement and consensus in effectiveness models. Personnel Psychology, 41, 779-803, McEvoy, G.M., & Beatty, R.W. (1989). Assessment centers and subordinate appraisals of managers: A seven-year examination of predictive validity. Personnel Psychology, 42, 37-52, and Wohlers, A.J., & London, M. (1989). Ratings of managerial characteristics: Evaluation difficulty, co-worker agreement, and self-awareness. Personnel Psychology, 42, 235-261.
20. London, M., & Wohlers, A.J. (1991). Agreement between subordinate and self-ratings in upward feedback. Personnel Psychology, 44, 375-390. See also Tsui, A.S., & Ohlott, P. (1988). Multiple assessment of managerial effectiveness: Interrater agreement and consensus in effectiveness models. Personnel Psychology, 41, 779-803, McEvoy, G.M., & Beatty, R.W. (1989). Assessment centers and subordinate appraisals of managers: A seven-year examination of predictive validity. Personnel Psychology, 42, 37-52, and Wohlers, A.J., & London, M. (1989). Ratings of managerial characteristics: Evaluation difficulty, co-worker agreement, and self-awareness. Personnel Psychology, 42, 235-261.
21. London, M., & Wohlers, A.J. (1991). Agreement between subordinate and self-ratings in upward feedback. Personnel Psychology, 44, 375-390. See also Tsui, A.S., & Ohlott, P. (1988). Multiple assessment of managerial effectiveness: Interrater agreement and consensus in effectiveness models. Personnel Psychology, 41, 779-803, McEvoy, G.M., & Beatty, R.W. (1989). Assessment centers and subordinate appraisals of managers: A seven-year examination of predictive validity. Personnel Psychology, 42, 37-52, and Wohlers, A.J., & London, M. (1989). Ratings of managerial characteristics: Evaluation difficulty, co-worker agreement, and self-awareness. Personnel Psychology, 42, 235-261.
22. Antonioni, D. (1994). The effects of feedback accountability on upward appraisal ratings. Personnel Psychology, 47, 349-356. See also London, M., & Wohlers, A.J. (1991) op. cit.
23. Antonioni, D. (1994). The effects of feedback accountability on upward appraisal ratings. Personnel Psychology, 47, 349-356. See also London, M., & Wohlers, A.J. (1991) op. cit.
24. Murphy, K.R., & Cleveland, J.N. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives, Thousand Oaks, CA: Sage. See also London, M., & Wohlers, A.J. (1991) op. cit.
25. Murphy, K.R., & Cleveland, J.N. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives, Thousand Oaks, CA: Sage. See also London, M., & Wohlers, A.J. (1991) op. cit.
26. Bernardin, H.J., Dahmus, S.A., & Redmon, G. (1993). Attitudes of first-line supervisors toward sub-ordinate appraisals. Human Resources Management, 32, 315-324. See also Conway, J.M., & Huffcut, A.I. (1996, April). Testing assumptions of 360-degree feedback: A meta-anafysis of supervisor, peer, subordinate, and self ratings. Paper presented at the Eleventh Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
27. Bernardin, H.J., Dahmus, S.A., & Redmon, G. (1993). Attitudes of first-line supervisors toward sub-ordinate appraisals. Human Resources Management, 32, 315-324. See also Conway, J.M., & Huffcut, A.I. (1996, April). Testing assumptions of 360-degree feedback: A meta-anafysis of supervisor, peer, subordinate, and self ratings. Paper presented at the Eleventh Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
28. Dalessio AT. (1998). Using multi-source feedback for employee development and personnel decisions. In Smither JW (Ed.), Performance appraisal: State-of-the-art in practice. San Francisco, CA: Jossey-Bass.
29. Van Velsor, E., & Wall, S.J. (1992, March) op. cit. See also Dalessio AT. (1998) op.cit.
30. Van Velsor, E., & Wall, S.J. (1992, March) op. cit. See also Dalessio AT. (1998) op.cit.
31. Podsakoff, P.M., & Farh, J. (1989). Effects of feedback sign and credibility on goal setting and task performance. Organizational Behavior and Human Decision Processes, 44, 45-67.
32. Van Velsor, E. (1998). Designing 360-degree feedback to enhance involvement, self-determination, and commitment. In W.W. Tornow, M. London, & CCL Associates (Eds.), Maximizing the value of 360-degree feedback: A process for successful individual and organizational development (pp. 149-195). San Francisco: Jossey-Bass.
33. Dalessio AT. (1998) op. cit.
34. Van Velsor, E. (1998) op. cit.
35. Bracken, D.W. (1996) op. cit.
36. Greenberg, J. (1990). Organizational justice: Yesterday, today, and tomorrow. Journal of Management, 16, 399-432. See also Lind, E.A., Kanfer, R., & Earley, P.C. (1990). Voice, control, and procedural justice: Instrumental and noninstrumental concerns in fairness judgments. Journal of Personality and Social Psychology, 59, 952-959, Lind, E.A., & Tyler, T. (1988). The social psychology of procedural justice. New York: Plenum, and Tyler, T.R. (1989). The psychology of procedural justice: A test of group-value model. Journal of Personality and Social Psychology, 57, 830-838.
37. Greenberg, J. (1990). Organizational justice: Yesterday, today, and tomorrow. Journal of Management, 16, 399-432. See also Lind, E.A., Kanfer, R., & Earley, P.C. (1990). Voice, control, and procedural justice: Instrumental and noninstrumental concerns in fairness judgments. Journal of Personality and Social Psychology, 59, 952-959, Lind, E.A., & Tyler, T. (1988). The social psychology of procedural justice. New York: Plenum, and Tyler, T.R. (1989). The psychology of procedural justice: A test of group-value model. Journal of Personality and Social Psychology, 57, 830-838.
38. Greenberg, J. (1990). Organizational justice: Yesterday, today, and tomorrow. Journal of Management, 16, 399-432. See also Lind, E.A., Kanfer, R., & Earley, P.C. (1990). Voice, control, and procedural justice: Instrumental and noninstrumental concerns in fairness judgments. Journal of Personality and Social Psychology, 59, 952-959, Lind, E.A., & Tyler, T. (1988). The social psychology of procedural justice. New York: Plenum, and Tyler, T.R. (1989). The psychology of procedural justice: A test of group-value model. Journal of Personality and Social Psychology, 57, 830-838.
39. Greenberg, J. (1990). Organizational justice: Yesterday, today, and tomorrow. Journal of Management, 16, 399-432. See also Lind, E.A., Kanfer, R., & Earley, P.C. (1990). Voice, control, and procedural justice: Instrumental and noninstrumental concerns in fairness judgments. Journal of Personality and Social Psychology, 59, 952-959, Lind, E.A., & Tyler, T. (1988). The social psychology of procedural justice. New York: Plenum, and Tyler, T.R. (1989). The psychology of procedural justice: A test of group-value model. Journal of Personality and Social Psychology, 57, 830-838.
40. Folger, R., Rosenfield, D., Grove, J., & Cokran, L. (1979). Effects of voice and peer opinions on responses to inequity, Journal of Personality and Social Psychology, 37, 2253-2261.
41. Giacobbe-Miller, J. (1995). A test of the group-values and control models of procedural justice from the competing perspectives of labor and management. Personnel Psychology, 48, 115-142. See also Kanfer, R., Sawyer, J., Earley, P.C., & Lind, E.A. (1987). Participation in task evaluation procedures: The effects of influential opinion expression and knowledge of evaluative criteria on attitudes and performance. Social Justice Research, 1, 235-249, Lind, E.A., Lissak, R.I., & Conlon, D.E. (1983). Decision control and process control effects on procedural fairness judgments. Journal of Applied Psychology, 13, 338-350, and Tyler, T.R., Rasinski, K., & Spodick, N. (1985). The influence of voice on satisfaction with leaders: Exploring the meaning of process control. Journal of Applied Social Psychology, 15, 700-725.
42. Giacobbe-Miller, J. (1995). A test of the group-values and control models of procedural justice from the competing perspectives of labor and management. Personnel Psychology, 48, 115-142. See also Kanfer, R., Sawyer, J., Earley, P.C., & Lind, E.A. (1987). Participation in task evaluation procedures: The effects of influential opinion expression and knowledge of evaluative criteria on attitudes and performance. Social Justice Research, 1, 235-249, Lind, E.A., Lissak, R.I., & Conlon, D.E. (1983). Decision control and process control effects on procedural fairness judgments. Journal of Applied Psychology, 13, 338-350, and Tyler, T.R., Rasinski, K., & Spodick, N. (1985). The influence of voice on satisfaction with leaders: Exploring the meaning of process control. Journal of Applied Social Psychology, 15, 700-725.
43. Giacobbe-Miller, J. (1995). A test of the group-values and control models of procedural justice from the competing perspectives of labor and management. Personnel Psychology, 48, 115-142. See also Kanfer, R., Sawyer, J., Earley, P.C., & Lind, E.A. (1987). Participation in task evaluation procedures: The effects of influential opinion expression and knowledge of evaluative criteria on attitudes and performance. Social Justice Research, 1, 235-249, Lind, E.A., Lissak, R.I., & Conlon, D.E. (1983). Decision control and process control effects on procedural fairness judgments. Journal of Applied Psychology, 13, 338-350, and Tyler, T.R., Rasinski, K., & Spodick, N. (1985). The influence of voice on satisfaction with leaders: Exploring the meaning of process control. Journal of Applied Social Psychology, 15, 700-725.
44. Giacobbe-Miller, J. (1995). A test of the group-values and control models of procedural justice from the competing perspectives of labor and management. Personnel Psychology, 48, 115-142. See also Kanfer, R., Sawyer, J., Earley, P.C., & Lind, E.A. (1987). Participation in task evaluation procedures: The effects of influential opinion expression and knowledge of evaluative criteria on attitudes and performance. Social Justice Research, 1, 235-249, Lind, E.A., Lissak, R.I., & Conlon, D.E. (1983). Decision control and process control effects on procedural fairness judgments. Journal of Applied Psychology, 13, 338-350, and Tyler, T.R., Rasinski, K., & Spodick, N. (1985). The influence of voice on satisfaction with leaders: Exploring the meaning of process control. Journal of Applied Social Psychology, 15, 700-725.
45. Ashford, S.J. & Cummings, L.L. (1983). Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance, 32, 370-398. See also Ilgen, D.R., Fisher, C.D., & Taylor, M.S. (1979). Consequences of individual feedback on behavior In organizations. Journal of Applied Psychology, 64, 349-371 and Taylor, M.S., Fisher, C.D., & Ilgen, D.R. (1984). Individual's reactions to performance feedback in organizations: A control theory perspective. In K Rowland & G. Ferris (Eds.) Research in Personnel Human Resource Management, Vol. 2. Greenwich, CT: JAI Press.
46. Ashford, S.J. & Cummings, L.L. (1983). Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance, 32, 370-398. See also Ilgen, D.R., Fisher, C.D., & Taylor, M.S. (1979). Consequences of individual feedback on behavior In organizations. Journal of Applied Psychology, 64, 349-371 and Taylor, M.S., Fisher, C.D., & Ilgen, D.R. (1984). Individual's reactions to performance feedback in organizations: A control theory perspective. In K Rowland & G. Ferris (Eds.) Research in Personnel Human Resource Management, Vol. 2. Greenwich, CT: JAI Press.
47. Ashford, S.J. & Cummings, L.L. (1983). Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance, 32, 370-398. See also Ilgen, D.R., Fisher, C.D., & Taylor, M.S. (1979). Consequences of individual feedback on behavior In organizations. Journal of Applied Psychology, 64, 349-371 and Taylor, M.S., Fisher, C.D., & Ilgen, D.R. (1984). Individual's reactions to performance feedback in organizations: A control theory perspective. In K Rowland & G. Ferris (Eds.) Research in Personnel Human Resource Management, Vol. 2. Greenwich, CT: JAI Press.
48. Greller, M.M., & Herold, P.M. (1975). Sources of feedback: A preliminary investigation. Organizational Behavior and Human Performance, 13(2), 244-256. See also Herold, D.M., & Greller, M.M. (1977). Feedback: The definition of a construct. Academy of Management Journal, 20(1), 142-147.
49. Greller, M.M., & Herold, P.M. (1975). Sources of feedback: A preliminary investigation. Organizational Behavior and Human Performance, 13(2), 244-256. See also Herold, D.M., & Greller, M.M. (1977). Feedback: The definition of a construct. Academy of Management Journal, 20(1), 142-147.
50. Herold, D.M., & Parsons, C.K. (1985). Assessing the feedback environment in work organizations: Development of the feedback survey. Journal of Applied Psychology, 70(2), 290-305.
51. Landy, F.J., & Farr, J.L. (1983). The measurement of work performance: Methods, theory, and applications. New York: Academic Press.
52. Ilgen, D.R., Fisher, C.D., & Taylor, M.S. (1979) op. cit.
53. Camp, R.R., Blanchard, P.N., & Huszczp, G.E. (1986). Towards a more organizationally effective training strategy and practice. Englewood Cliffs: Prentice Hall.
54. Ilgen, D.R., Fisher, C.D., & Taylor, M.S. (1979) op. cit.
55. Noe, R.A. (1986). Trainees' attributes and attitudes: Neglected influences on training effectiveness. Academy of Management Review, 11(4), 736-749.
56. Ilgen, D.R., Fisher, C.D., & Taylor, M.S. (1979) op. cit.
57. Bannister, B.D. (1986). Performance outcome feedback and attributional feedback: Interactive effects on recipient responses. Journal of Applied Psychology, 71(2), 203-210.
58. Podsakoff, P.M., & Farh, J. (1989). Effects of feedback sign and credibility on goal setting and task performance. Organizational Behavior and Human Decision Processes, 44, 45-67.
59. I b i d.
60. Locke, E.A., Shaw, K.N., Saari, L.M., & Latham, G.P. (1981). Goal setting and task performance. Psychological Bulletin, 90, 125-152.