Incongruity in 360-Degree Feedback Ratings and Competing Managerial Values: Evidence from a Public Agency Setting

International Public Management Journal

Volumn 12, Issue 4, 2009, Pages 421-449

  Hassan, Shahidul ^a   Rohrbaugh, John ^a  

^a STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85009585715     PISSN: 10967494     EISSN: None     Source Type: Journal    
DOI: 10.1080/10967490903103375     Document Type: Article

References (83)

1. Ashford, S. 1989. ''Self-Assessments in Organizations: A Literature Review and Integrated Model.'' Research in Organizational Behavior 11: 133-174.
2. Ashford, S. and A. Tsui. 1991. ''Self-Regulation for Managerial Effectiveness: The Role of Active Feedback Seeking.'' Academy of Management Journal 34: 251-280.
3. Atkins, P. W. and R. E. Wood. 2002. ''Self-Versus-Others' Ratings as Predictors of Assessment Center Ratings: Validation Evidence for 360-degree Feedback Programs.'' Personnel Psychology 55: 871-904.
4. Atwater, L. E., C. Ostroff, F. J. Yammarino, and J. W. Fleenor. 1998. ''Self-Other Agreement: Does It Really Matter?'' Personnel Psychology 51: 577-598.
5. Atwater, L. E., P. Roush, and A. Fischthal. 1995. ''Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?'' Personnel Psychology 45: 141-164.
6. Atwater, L. E., D. A. Waldman, C. Robie, C. Ostroff, and J. Johnson. 2005. ''Self-Other Agreement: Comparing Its Relationship with Performance in U.S. and Europe.'' International Journal of Selection and Assessment 13: 25-40.
7. Atwater, L. E. and F. J. Yammarino. 1992. ''Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions?'' Personnel Psychology 45: 141-164.
8. Atwater, L. E. and F. J. Yammarino. 1997. ''Self-Other Rating Agreement: A Review of the Model.'' Research in Personnel and Human Resource Management 15: 121-174.
9. Bailey, C. and C. Fletcher. 2002. ''The Impact of Multiple Source Feedback on Management Development: Findings from a Longitudinal Study.'' Journal of Organizational Behavior 23: 853-867.
10. Bales, R. F. 1950. Interaction Process Analysis: A Method for the Study of Small Groups. Chicago: University of Chicago Press.
11. Bass, B. and F. J. Yammarino. 1991. ''Congruence of Self and Others' Leadership Ratings of Naval Officers for Understanding Successful Performance.'' Applied Psychology: An International Review 40: 437-454.
12. Borman, W. C. 1997. ''360 Degree Ratings: An Analysis of Assumptions and a Research Agenda for Evaluating their Validity.'' Human Resource Management Review 7: 299-315.
13. Boyne, G. A. 2002. ''Public and Private Management: What's the Difference?'' Journal of Management Studies 39: 97-122.
14. Bozeman, B., P. Reed, and P. Scott. 1992. ''Red Tape and Task Delays in Public and Private Organizations.'' Administration and Society 24: 290-322.
15. Bozeman, D. 1997. ''Interrater Agreement in Multi-Source Performance Appraisal: A Commentary.'' Journal of Organizational Behavior 18: 213-316.
16. Bracken, D., C. W. Timmreck, and A. H. Church. 2001. The Handbook of Multisource Feedback: The Comprehensive Resource for Designing and Implementing MSF Processes. San Francisco: Jossey-Bass.
17. Burson, K. A., R. P. Larrick, and J. Klayman. 2006. ''Skilled or Unskilled, but Still Unaware of It: How Perceptions of Difficulty Drive Miscalibration in Relative Comparisons.'' Journal of Personal and Social Psychology 90: 60-77.
18. Child, J. 1972. ''Organization Structure, Environment, and Performance: The Role of Strategic Choice.'' Sociology 6: 1-22.
19. Church, A. H. 1997. ''Do You See What I See? An Exploration of Congruence in Ratings from Multiple Perspectives.'' Journal of Applied Social Psychology 27: 883.
20. Conway, J. M. and A. E. Huffcutt. 1997. ''Psychometric Properties of Multi-Source Feedback Ratings: A Meta-Analysis of Subordinate, Supervisor, Peer and Self-Ratings.'' Human Performance 10: 331-360.
21. Dalton, M. 1997. ''When the Purpose of Using Multi-Rater Feedback Is Behavior Change.'' Pp. 1-6 in D. Bracken, M. Dalton, R. Jako, C. McCarthy, and V. Pollman, eds., Should 360-Feedback Be Used Only for Development Purposes? Greensboro, NC: Center for Creative Leadership.
22. deLeon, L. and A. J. Ewen. 1997. ''Multi-Source Performance Appraisals.'' Review of Public Personnel Administration 17: 22-36.
23. DeNisi, A. and K. Williams. 2000. ''Feedback Effectiveness: Can 360-Degree Appraisals Be Improved?'' Academy of Management Executive 14: 129-139.
24. Denison, D. R., R. Hooijberg, and R. E. Quinn. 1995. ''Paradox and Performance: Toward a Theory of Behavioral Complexity in Managerial Leadership.'' Organization Science 6: 520-540.
25. DeVader, C. L., A. G. Bateson, and R. G. Lord. 1986. ''Attribution Theory: A Meta-Analysis of Attributional Hypothesis.'' Pp. 63-81 in E. Locke, ed., Generalizing from Laboratory to Field Settings. Lexington, MA: Lexington Books.
26. DiMaggio, P. J. and W. W. Powell. 1983. ''The Iron Cage Revisited: Institutional Isomorphism and Collective Rationality in Organizational Fields.'' American Sociological Review 48: 147-160.
27. Eden, C. F. and J. Rohrbaugh. 1990. ''Using the Competing Values Approach to Explore 'Ways of Working.''' Pp. 40-47 in C. F. Eden and J. Radford, eds., Tackling Strategic Problems: The Role of Group Decision Support. Newbury Park, CA: Sage.
28. Edwards, J. R. 1993a. ''On the Use of Polynomial Regression Equations as an Alternative to Difference Scores in Organizational Research.'' Academy of Management Journal 36: 1577-1613.
29. Edwards, J. R. 1993b. ''Problems with the Use of Profile Similarity Indices in the Study of Congruence in Organizational Research.'' Personnel Psychology 46: 641-665.
30. Edwards, J. R. 1994. ''The Study of Congruence in Organizational Behavior Research: Critique and Proposed Alternative.'' Organizational Behavior and Human Decision Processes 58: 683-689.
31. Fahr, J. and G. Dobbins. 1989. ''Effects of Self-Esteem on Leniency Bias in Self-Reports of Performance: A Structural Equation Model Analysis.'' Personnel Psychology 42: 835-850.
32. Fayol, H. 1916. Administration Industrielle et Générale. Paris: Dunod.
33. Feinberg, B., C. Ostroff, and W. Burke. 2005. ''The Role of Within-Group Agreement in Understanding Transformational Leadership.'' Journal of Occupational and Organizational Psychology 78: 471-488.
34. Fox, S. and Y. Dinur. 1988. ''Validity of Self-Assessment: A Field Evaluation.'' Personnel Psychology 41: 581-592.
35. Furnham, A. and P. Stringfield. 1994. ''Congruence in Self and Subordinate Ratings of Managerial Practices as a Correlate of Supervisor Evaluation.'' Journal of Occupational and Organizational Psychology 67: 57-67.
36. Golembiewski, R.T. 1995. Practical Public Management, Public Administration and Public Policy. New York: M. Dekker.
37. Gulick, L. 1937. ''Notes on the Theory of Organizations. With Special Reference to Government.'' Pp. 1-46 in L. Gulick and L. Urwick, eds., Papers on the Science of Administration. New York: Institute of Public Administration, Columbia University.
38. Harris, M. and J. Schaubroeck. 1988. ''A Meta-Analysis of Self-Supervisor, Self-Peer, and Peer-Supervisor Ratings.'' Personnel Psychology 41: 43-61.
39. Hooft, E. A., F. Henk, and M. R. Minne. 2006. ''Construct Validity of Multi-Source Performance Ratings: An Examination of the Relationship of Self-Supervisor, and Peer-Ratings with Cognitive and Personality Measures.'' International Journal of Selection and Assessment 14: 67-81.
40. Hooijberg, R. and J. Choi. 2000. ''Which Leadership Roles Matter to Whom? An Examination of Rater Effects on Perceptions of Effectiveness.'' Leadership Quarterly 11: 341-364.
41. Johnson, J. and K. Ferstl. 1999. ''The Effects of Interrater and Self-Other Agreement on Performance Improvement Following Upward Feedback.'' Personnel Psychology 52: 271-303.
42. Kellough, J. E. and S. C. Selden. 1997. ''Pay-for-Performance Systems in State Government: Perception of State Agency Personnel Managers.'' Review of Public Personnel Administration 17: 5-21.
43. Krugar, J. and D. Dunning. 1999. ''Unskilled and Unaware of It: How Difficulties in Recognizing Ones' Own Incompetence Lead to Inflated Self-Assessments.'' Journal of Personality and Social Psychology 77: 1121-1134.
44. Krugar, J. and D. Dunning. 2002. ''Unskilled and Unaware-But Why? A Reply to Krueger and Mueller.'' Journal of Personality and Social Psychology 82: 189-192.
45. Kurland, N. and T. Egan. 1999. ''Public v. Private Perceptions of Formalization, Outcomes, and Justice.'' Journal of Public Administration Research and Theory 9: 437-458.
46. Locke, E. A. 1968. ''The Effects of Knowledge of Results, Feedback in Relation to Standards, and Goals on Reaction Time Performance.'' American Journal of Psychology 81: 566-574.
47. Locke, E. A. and G. P. Latham. 1990. A Theory of Goal Setting and Task Performance. Englewood Cliffs, NJ: Prentice Hall.
48. McCartt, A. T. and J. Rohrbaugh. 1995. ''Managerial Openness to Change and the Introduction of GDSS: Explaining Initial Success and Failure in Decision Conferencing.'' Organization Science 6: 569-584.
49. Mersman, J. and S. Donaldson. 2000. ''Factors Affecting the Convergence of Self-Peer Ratings in Contextual and Task Performance.'' Human Performance 13: 299-322.
50. Miller, J. S. and R. L. Cardy. 2002. ''Self-Monitoring and Performance Appraisal: Rating Outcomes in Project Teams.'' Journal of Organizational Behavior 21: 609-626.
51. Mintzberg, H. 1973. The Nature of Managerial Work. New York: Harper & Row.
52. Mount, M. K., T. A. Judge, S. E. Scullen, M. R. Sytsma, and S. R. Hezlett. 1998. ''Trait, Rater and Level Effects in 360-Degree Performance Ratings.'' Personnel Psychology 51: 557-576.
53. Murphy, K. R., and J. N. Cleveland. 1995. Understanding Performance Appraisal: Social, Organizational, and Goal-Based Perspectives. Thousand Oaks, CA: Sage.
54. Pandey, S. K. and B. E. Wright. 2006. ''Connecting the Dots in Public Management: Political Environment, Organizational Goal Ambiguity, and the Public Manager's Role Ambiguity.'' Journal of Public Administration Research and Theory 16: 511-532.
55. Parson, T. 1959. ''General Theory in Sociology.'' Pp. 3-38 in R. Merton, L. Broom, and L. S. Cottrell, Jr., eds., Sociology Today: Problems and Prospects. New York: Basic Books.
56. Perry, J. L. and H. G. Rainey. 1988. ''The Public-Private Distinction in Organization Theory: A Critique and Research Strategy.'' Academy of Management Review 13: 182-201.
57. Podsakoff, P. M. and D. W. Organ. 1986. ''Self-Reports in Organizational Research: Problems and Prospects.'' Journal of Management 12: 531-544.
58. Pollack, D. and L. Pollack. 1996. ''Using 360-Degree Feedback in Performance Appraisal.'' Public Personnel Management, 25: 507-528.
59. Pollman, V. 1997. ''Some Faulty Assumptions That Support Using Multi-Rater Feedback for Performance Appraisal.'' Pp. 7-9 in D. Bracken, M. Dalton, R. Jako, C. McCarthy, and V. Pollman, eds., Should 360-Feedback Be Used Only for Development Purposes? Greensboro, NC: Center for Creative Leadership.
60. Pulakos, E. D., N. Schmitt, and D. Chan. 1996. ''Models of Job Performance Ratings: An Examination of Ratee Race, Ratee Gender, and Rater Level Effects.'' Human Performance 9: 103-119.
61. Pynes, J. E. 1997. Human Resource Management in for Public and Nonprofit Organizations. San Francisco: Jossey-Bass.
62. Quinn, R. E. and J. Rohrbaugh. 1983. ''A Spatial Model of Effectiveness Criteria: Towards a Competing Values Approach to Organizational Analysis.'' Management Science 29: 363-377.
63. Rainey, H. G. 1983. ''Public Agencies and Private Firms: Incentive Structures, Goals, and Individual Roles.'' Administration and Society 15: 65-105.
64. Rainey, H. G. 1989. ''Public Management: Recent Research on the Political Context and Managerial Roles, Structures, and Behaviors.'' Journal of Management 15: 229-50.
65. Rainey, H. G. 1997. Understanding and Managing Public Organizations. San Francisco: Jossey-Bass.
66. Rainey, H. G. and B. Bozeman. 2000. ''Comparing Public and Private Organizations: Empirical Research and the Power of the A Priori.'' Journal of Public Administration Research and Theory 10: 447-469.
67. Rainey, H. G., S. Pandey, and B. Bozeman. 1995. ''Research Note: Public and Private Managers' Perceptions of Red Tape.'' Public Administration Review 55: 567-574.
68. Rohrbaugh, J. 1983. ''The Competing Values Approach: Innovation and Effectiveness in the Job Service.'' Pp. 165-280 in R. H. Hall and R. E. Quinn, eds., Organization Theory and Public Policy. Beverly Hills: Sage.
69. Rohrbaugh, J. 2005. ''Competing Values: Assessing the Effectiveness of Group Facilitation.'' Pp. 449-456 in S. Schuman, ed., The IAF Group Facilitation Handbook. San Francisco: Jossey-Bass.
70. Salam, S., J. Cox, and H. Sims. 1997. ''In the Eye of the Beholder: How Leadership Relates to 360-Degree Performance Ratings.'' Group and Organization Management 22: 185-209.
71. Selden, S. C., P. I. Ingraham, and W. Jacobson. 2001. ''Human Resource Practices in State Government: Findings from a National Survey.'' Public Administration Review 61: 598-607.
72. Smither, J. W., M. London, N. L. Vasilopoulas, R. R. Reilly, R. E. Millsap, and N. Salvemini. 1995. ''An Estimation of the Effects of Upward Feedback Program over Time.'' Personnel Psychology 48: 1-34.
73. Thompson, J. D. 1967. Organizations in Action. New York: McGraw-Hill.
74. Toegel, G. and J. A. Conger. 2003. ''360-Degree Assessment: Time for Reinvention.'' Academy of Management Learning and Education 2: 297-311.
75. Tornow, W. W. 1993. ''Perceptions or Reality: Is Multi-perspective Measurement a Means or an End?'' Human Resource Management 32: 221-229.
76. Vandenberg, R. J., C. E. Lance, and S. C. Taylor. 1997. ''A Latent Variable Approach to Rating Sources Equivalence: Who Should Provide Ratings on Organizational Citizenship Behavior Dimensions?'' Academy of Management Annual Conference, Boston, MA, August 11-14.
77. Van Velsor, E., S. Taylor, and J. Leslie. 1993. ''An Examination of the Relationships Among Self-Perception Accuracy, Self-Awareness, Gender, and Leader Effectiveness.'' Human Resource Management 32: 249-264.
78. Waldman, D. A., L. E. Atwater, and D. Antonioni. 1998. ''Has 360-Feedback Gone Amok?'' Academy of Management Executive 12: 86-94.
79. Warr, P. and A. Bourne. 1999. ''Factors Influencing Two Types of Congruence in Multi-Rater Judgments.'' Human Performance 12: 183-210.
80. Wohlers, A. J., M. J. Hall, and M. London. 1993. ''Subordinates Rating Managers: Organizational and Demographic Correlates of Self/Subordinate Agreement.'' Journal of Occupational and Organizational Psychology 66: 263-275.
81. Wohlers, A. J. and M. London. 1989. ''Ratings of Managerial Characteristics: Evaluation Difficulty, Co-Worker Agreement, and Self-Awareness.'' Personnel Psychology 42: 235-261.
82. Yammarino, F. J. and L. E. Atwater. 1993. ''Understanding Self-Perception Accuracy: Implications for Human Resource Management.'' Human Resource Management 32: 231-247.
83. Yammarino, F. J. and L. E. Atwater. 1997. ''Do Managers See Themselves as Others See Them? Implications of Self-Other Rating Agreement for Human Resources Management.'' Organizational Dynamics 25(4): 35-44.