Agreement in self-other ratings of leader effectiveness: The role of demographics and personality

International Journal of Selection and Assessment

Volumn 17, Issue 2, 2009, Pages 165-179

  Vecchio, Robert P ^a   Anderson, Robert J ^b  

^a UNIVERSITY OF NOTRE DAME   (United States)

^b The Leadership Circle ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 65549092265     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2009.00460.x     Document Type: Article

References (82)

1. Anderson, R.J. (2006) The Leadership Assessment Circle Profile. Industrial & Commercial Training, 38, 175 184.
2. Arnold, J. Davey, K.M. (1992) Self-Ratings and Supervisor Ratings of Graduate Employees' Competences During Early Career. Journal of Occupational and Organizational Psychology, 65, 235 250.
3. Ashford, S.J. (1989) Self-Assessments in Organizations: A literature review and integrative model. Research in Organizational Behavior, 11, 133 174.
4. Atwater, L.E. Brett, J.F. (2005) Antecedents and Consequences of Reactions to Developmental 360 Degree Feedback. Journal of Vocational Behavior, 66, 532 548. (Pubitemid 40317476)
5. Atwater, L.E., Brett, J.F. Charles, A.T. (2007) Multisource Feedback: Lessons learned and implications for practice. Human Resource Management, 46, 285 307.
6. Atwater, L.E., Ostroff, C., Yammarino, F.J. Fleenor, J.W. (1998) Self-Other Agreement: Does it really matter? Personnel Psychology, 51, 577 598. (Pubitemid 128135539)
7. Atwater, L.E., Waldman, D., Atwater, D. Cartier, P. (2000) An Upward Feedback Field Experiment: Supervisors' cynicism, follow-up and commitment to subordinates. Personnel Psychology, 53, 275 297.
8. Atwater, L.E., Waldman, D., Ostroff, C., Robie, C. Johnson, K.M. (2005) Self-Other Agreement: Comparing its relationship with performance in the U.S. and Europe. International Journal of Selection and Assessment, 13, 25 40. (Pubitemid 40405752)
9. Atwater, L.E. Yammarino, F.J. (1997a) Self-Other Rating Agreement: A review and model. In : Ferris, G. (ed.), Research in Personnel and Human Resources Management, Vol. 15. Greenwich, CT : JAI Press, pp. 121 174.
10. Atwater, L.E. Yammarino, F.J. (1997b) Does Self-Other Agreement on Leadership Perceptions Moderate the Validity of Leadership and Performance Predictions? Personnel Psychology, 45, 141 164.
11. Bailey, C. Fletcher, C. (2002) The Impact of Multiple Source Feedback on Management Development: Findings from a longitudinal study. Journal of Organizational Behavior, 22, 775 788. (Pubitemid 37282908)
12. Barrick, M. Mount, M. (1991) The 'Big-Five' Personality Dimensions and Job Performance. Personnel Psychology, 44, 1 26.
13. Bliese, P.D. Hanges, P.J. (2004) Being too Liberal and too Conservative: The perils of treating grouped data as though they were independent. Organizational Research Methods, 7, 400 417. (Pubitemid 39332696)
14. Bracken, D.W., Timmreck, C.W. Church, A.H. (2001) The Handbook of Multisource Feedback: The comprehensive resource for designing and implementing MSF processes. San Francisco, CA : Jossey-Bass.
15. Brett, J.F. Atwater, L. (2001) 360-Degree Feedback: Accuracy, reactions, and perceptions of usefulness. Journal of Applied Psychology, 86, 930 942. (Pubitemid 33342331)
16. Brutus, S., Fleenor, J.W. McCauley, C.D. (1999) Demographic and Personality Predictors of Congruence in Multi-Source Ratings. Journal of Management Development, 18, 417 435. (Pubitemid 30117059)
17. Carless, S.A. Roberts-Thompson, G.F. (2001) Self-Ratings in Training Programs: An examination of level of performance and the effects of feedback. International Journal of Selection and Assessment, 9, 217 225. (Pubitemid 33357612)
18. Church, A.H. (2000) Do higher Performing Managers Actually Receive Better Ratings? A Validation of Multirater Assessment Methodology. Consulting Psychology Journal: Practice and Research, 52, 99 116.
19. Church, A.H. Waclawski, J. (2001) Hold the line: An examination of line vs. staff differences. Human Resource Management, 40, 21 34. (Pubitemid 33245950)
20. Cloninger, C.R. (1994) The Temperament and Character Inventory (TCI): A guide to its development and use. Washington University, St. Louis, MO : Center for the Psychology of Personality.
21. Conway, J.M. Huffcutt, A.I. (1997) Psychometric Properties of Multisource Performance Ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. Human Performance, 10, 331 360. (Pubitemid 127127270)
22. Costa, P.T. McCrae, R.R. (1992) Revised NEO Personality Inventory (NEO PI-R) and NEO Five-Factor Inventory (NEO-FFI) Professional Manual. Odessa, FL : Psychological Assessment Resources.
23. Darr, W. Catano, V.M. (2008) Multisource Assessments of Behavioral Competence and Selection Interview Performance. International Journal of Selection and Assessment, 16, 68 72.
24. DeNisi, A. Kluger, A. (2000) Feedback Effectiveness: Can 360-degree appraisals be improved? Academy of Management Executive, 14, 129 139.
25. Dunning, D., Heath, C. Suls, J.M. (2004) Flawed Self-Assessment: Implications for health, education, and the workplace. Psychological Science in the Public Interest, 5, 69 106. (Pubitemid 41239773)
26. Edwards, J.R. (1994) Regression Analysis as an Alternative to Difference Scores. Journal of Management, 20, 683 689.
27. Edwards, J.R. (1995) Alternatives to Difference Scores. Organizational Behavior and Human Decision Processes, 64, 307 324.
28. Edwards, J.R. (2001) Ten Difference Score Myths. Organizational Research Methods, 4, 265 287. (Pubitemid 33674908)
29. Edwards, J.R. (2002) Alternatives to Difference Scores: Polynomial regression analysis and response surface methodology. In : Drasgow, F. Schmitt, N. (eds.), Measuring and Analyzing Behavior in Organizations: Advances in measurement and data analysis. Francisco, CA : Jossey-Bass.
30. Edwards, J.R. Parry, M.E. (1993) On the Use of Polynomial Regression Equations as an Alternative to Difference Scores in Organizational Research. Academy of Management Journal, 36, 1577 1613. (Pubitemid 24753968)
31. Fletcher, C. Baldry, C. (2000) A Study of Individual Differences and Self-Awareness in the Context of Multisource Feedback. Journal of Occupational and Organizational Psychology, 73, 303 319.
32. Fornell, C. Larcker, D.F. (1981) Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research, 18, 39 50.
33. Funderberg, S. Levy, P.E. (1997) The Influence of Individual and Contextual Variables on 360-Degree Feedback System Attitudes. Group and Organizational Studies, 22, 210 230. (Pubitemid 127508129)
34. Goldberg, L.R., Johnson, J.A., Eber, H.W., Hogan, R., Ashton, M.C., Cloninger, C.R. Gough, H.G. (2006) The International Personality Item Pool and the Future of Public-Domain Personality Measures. Journal of Research in Personality, 40, 84 96.
35. Goldsmith, M., Lyons, L. Freas, A. (2000) Coaching for Leadership. San Francisco, CA : Jossey-Bass.
36. Gough, H.G. Bradley, P. (1997) CPI Manual (3rd edn). Palo Alto, CA : Consulting Psychologists Press.
37. Gove, W.R., Ortega, S.T. Style, C.B. (1989) The Maturational and Role Perspectives on Aging and Self Through the Adult Years: An empirical evaluation. American Journal of Sociology, 94, 1117 1145.
38. Hall, J.A. Schmid-Mast, M. (2008) Are Women Always more Interpersonally Sensitive than Men? Impact of Goals and Content Domain. Personality and Social Psychology Bulletin, 34, 144 155.
39. Hannum, K. (2007) Measurement Equivalence of 360-Degree Assessment Data: Are different raters rating the same constructs? International Journal of Selection and Placement, 9, 293 301.
40. Harris, M.M. Schaubroeck, J. (1988) A Meta-Analysis of Self-Supervisor, Self-Peer, and Peer-Supervisor Ratings. Personnel Psychology, 41, 43 62.
41. Hedge, J.W., Borman, W.C. Birkeland, S.A. (2001) History and Development of Multisource Feedback as a Methodology. In : Bracken, J.W., Timmereck, C.W. Church, A.H. (eds.), The Handbook of Multisource Feedback. San Francisco, CA : Jossey Bass, pp. 15 32.
42. Jackson, D.N. (1994) Jackson Personality Inventory - Revised Manual. Port Huron, MI : Sigma Assessment Systems.
43. Judge, T.A., Piccolo, R.F. Ilies, R. (2004) The Forgotten Ones? The Validity of Consideration and Initiating Structure in Leadership Research. Journal of Applied Psychology, 89, 36 51. (Pubitemid 38213812)
44. Kelly, L., Whatley, A. Worthley, R. (1990) Self-Appraisal, Life Goals, and National Culture: An Asian-Western comparison. Asia Pacific Journal of Management, 7, 41 58.
45. Kluger, A. DeNisi, A. (1996) The Effects of Feedback Interventions on Performance: A historical review, a meta-analysis, and a preliminary feedback theory. Psychological Bulletin, 119, 254 284. (Pubitemid 126042646)
46. Lall, R., Jain, V.K. Johnson, W.B. (1996) Contemporary Norms for the Coopersmith Self-Esteem Inventory- Adult Form. Perceptual and Motor Skills, 82, 1136 1138. (Pubitemid 126728768)
47. London, M. Wohlers, A.J. (1991) Agreement Between Subordinate and Self-Ratings in Upward Feedback. Personnel Psychology, 44, 375 390.
48. Mabe, P. West, J. (1982) Validity of Self-Evaluation of Ability: A review and meta-analysis. Journal of Applied Psychology, 67, 280 296.
49. Maurer, T.J. Palmer, J.K. (1999) Management Development Intentions Following Feedback: Role of perceived outcomes, social pressures, and control. Journal of Management Development, 18, 733 751.
50. McCarthy, A.M. Garavan, T.N. (2007) Understanding Acceptance of Multisource Feedback for Management Development. Personnel Review, 36, 903 917.
51. Moskowitz, D.S. (1993) Dominance and Friendliness: On the interaction of gender and situation. Journal of Personality, 61, 387 409.
52. Mount, M.K., Judge, T.A., Scullen, S.E., Stysma, M.R. Hezlett, S.A. (1998) Trait, Rater, and Level Effects in 360-Degree Performance Ratings. Personnel Psychology, 51, 557 576. (Pubitemid 128135538)
53. Murphy, K.R. Cleveland, J.N. (1991) Performance Appraisal. Needham Heights : Allyn & Bacon.
54. Murphy, K.R. Cleveland, J.N. (1995) Understanding Performance Appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA : Sage Publication.
55. Neppl, T.K. Murray, A.D. (1997) Social Dominance and Play Patterns Among Preschoolers: Gender comparisons. Sex Roles: A Journal of Research, 36, 381 393. (Pubitemid 127359686)
56. Nilsen, D. Campbell, D.P. (1993) Self-Observer Rating Discrepancies: Once an overrater, always an overrater? Human Resource Management, 32, 265 281. (Pubitemid 127156773)
57. Ostroff, C., Atwater, L.E. Feinberg, B.J. (2004) Understanding Self-Other Agreement: A look at rater and ratee characteristics, context, and outcomes. Personnel Psychology, 57, 333 376. (Pubitemid 38882233)
58. Pazy, A. (1986) The Persistence of Pro-Male Bias Despite Identical Information Regarding Causes of Success. Organizational Behavior and Human Decision Processes, 38, 366 377.
59. Philips, A.S. Bedeian, A.G. (1994) Leader-Follower Exchange Quality: The role of personal and interpersonal attributes. Academy of Management Journal, 37, 990 1001.
60. Podsakoff, P.M. Organ, D.W. (1986) Self-Reports in Organizational Research: Problems and prospects. Journal of Management, 12, 531 544.
61. Raghunathan, T. (2003) An Approximate Test of Homogeneity of Correlated Correlation Coefficients. Quality and Quantity, 37, 99 110. (Pubitemid 36309727)
62. Ratliff, E.S. Conley, J. (1981) The Structure of Masculinity-Femininity: Multidimensionality and gender differences. Social Behavior and Personality: An International Journal, 9, 41 47.
63. Roberson, L. Block, C.J. (2001) Racioethnicity and Job Performance: A review and critique of theoretical perspectives on the causes of group differences. Research in Organizational Behavior, 23, 247 325. (Pubitemid 33804894)
64. Robins, R.W., Trzesniewski, K.H., Gosling, S.D., Tracy, J.L. Potter, J. (2002) Global Self Esteem Across the Life Span. Psychology and Aging, 17, 423 434.
65. Rosenbaum, M. (1986) The Repulsion Hypothesis: On the nondevelopment of relationships. Journal of Personality and Social Psychology, 51, 1156 1166.
66. Schmid-Mast, M. Hall, J.A. (2006) Women's Advantage at Remembering Others' Appearance: A systematic look at the why and when of a gender difference. Personality and Social Psychology Bulletin, 32, 353 364.
67. Scullen, S.E., Mount, M.K. Goff, M. (2000) Understanding the Latent Structure of Job Performance Ratings. Journal of Applied Psychology, 85, 956 970.
68. Sidanius, J., Pratto, F. Rabinowitz, J.L. (1994) Gender, Ethnic Status, and Ideological Symmetry: A social dominance interpretation. Journal of Cross-Cultural Psychology, 25, 194 216. (Pubitemid 24799704)
69. Smith, C.S. Tisak, J. (1993) Discrepancy Measures of Role Stress Revisited: New perspectives on old issues. Organizational Behavior and Human Decision Processes, 56, 285 307.
70. Smither, J.W., London, M. Reilly, R.R. (2005) Does Performance Appraisal Improve Following Multisource Feedback? A Theoretical Model, Meta-Analysis, and Review of Empirical Findings. Personnel Psychology, 58, 33 66. (Pubitemid 40622796)
71. Tisak, J. Smith, C.S. (1994a) Rejoinder to Edwards' Comments. Journal of Management, 20, 691 694.
72. Tisak, J. Smith, C.S. (1994b) Defending and Extending Difference Score Methods. Journal of Management, 20, 675 682.
73. van der Heijden, B. (2001) Age and Assessments of Professional Expertise: The relationship between higher level employees' age and self-assessments or supervisor ratings of professional expertise. International Journal of Selection and Assessment, 9, 309 324.
74. Varela, O.E. Premeaux, S.F. (2008) Do Cross-Cultural Values Affect Multisource Feedback Dynamics? The Case of High Power Distance and Collectivism in Two Latin-American Countries. International Journal of Selection and Assessment, 16, 134 142.
75. Viswesvaran, C., Schmidt, F.L. Ones, D.S. (2002) The Moderating Influence of Job Performance Dimensions on Convergence of Supervisory and Peer Ratings of Job Performance: Unconfounding construct-level convergence and rating difficulty. Journal of Applied Psychology, 87, 345 354.
76. Wagner, R. Harter, J. (2006) 12: The Elements of Great Managing. Princeton, NJ : Gallup Press.
77. Wilson, M.S. Liu, J.H. (2003) Social Dominance Orientation and Gender: The moderating role of gender identity. British Journal of Social Psychology, 42, 187 198. (Pubitemid 37189295)
78. Wohlers, A.J., Hall, M.J. London, M. (1993) Subordinates Rating Managers: Organization and biographic correlates of self/subordinate agreement. Journal of Occupational and Organizational Psychology, 66, 263 275.
79. Wohlers, A.J. London, M. (1989) Ratings of Managerial Characteristics: Evaluation difficulty, co-worker agreement, and self-awareness. Personnel Psychology, 42, 235 261.
80. Yammarino, F.J. Atwater, L.E. (1993) Understanding Self-Perception Accuracy: Implications for human resource management. Human Resource Management, 32, 231 247. (Pubitemid 127156771)
81. Yammarino, F.J. Atwater, L.E. (1997) Do Managers see Themselves as Others see them? Implications of Self-Other Rating Agreement for Human Resources Management. Organizational Dynamics, 25, 35 44.
82. Zimmerman, R.D., Mount, M.K. Goff, M. (2008) Feedback and Leaders' Goal Performance: Moderating effects of rating purpose, rater perspective, and performance dimension. International Journal of Selection and Assessment, 16, 122 133.