Self-other rating agreement in leadership: A review

Leadership Quarterly

Volumn 21, Issue 6, 2010, Pages 1005-1034

  Fleenor, John W ^a   Smither, James W ^b   Atwater, Leanne E ^c   Braddy, Phillip W ^a   Sturm, Rachel E ^c  

^a CENTER FOR CREATIVE LEADERSHIP   (United States)

^b LA SALLE UNIVERSITY   (United States)

^c University of Houston   (United States)

Author keywords

360 degree feedback; Leadership; Literature review; Multi rater feedback; Multisource feedback; Rating congruence; Self other rating agreement

Indexed keywords

EID: 78649905753     PISSN: 10489843     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.leaqua.2010.10.006     Document Type: Review

References (230)

1. Allport G.W. Personality: A psychological interpretation 1937, Holt, New York.
2. Antonioni D. Predictors of upward appraisal ratings. Journal of Managerial Issues 1999, 11:26-36.
3. Antonioni D., Park H. The effects of personality similarity on peer ratings of contextual work behaviors. Personnel Psychology 2001, 54:331-360.
4. Antonioni D., Park H. The relationship between rater affect and three sources of 360-degree feedback ratings. Journal of Management 2001, 27:479-495.
5. Ashford S.J. Self-assessments in organizations: A literature review and integrative model. Research in organizational behavior 1989, 11:133-174. JAI Press, Greenwich, CT.
6. Atkins P.W., Wood R.E. Self-versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. Personnel Psychology 2002, 55:871-904.
7. Atwater L.E., Ostroff C., Yammarino F.J., Fleenor J.W. Self-other agreement: Does it really matter?. Personnel Psychology 1998, 51:577-598.
8. Atwater L.E., Roush P., Fischthal A. The influence of upward feedback on self- and follower ratings of leadership. Personnel Psychology 1995, 48:35-59.
9. Atwater L.E., Waldman D., Ostroff C., Robie C., Johnson K.M. Self-other agreement: Comparing its relationship with performance in the U.S. and Europe. International Journal of Selection and Assessment 2005, 13:25-40.
10. Atwater L.E., Wang M., Smither J.W., Fleenor J.W. Are cultural characteristics associated with the relationship between self and others' ratings of leadership?. Journal of Applied Psychology 2009, 94:876-886.
11. Atwater L.E., Yammarino F.J. Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions?. Personnel Psychology 1992, 45:141-164.
12. Atwater L.E., Yammarino F.J. Self-other rating agreement. Research in personnel and human resources management 1997, 15:121-174. JAI Press. G.R. Ferris (Ed.).
13. Aycan Z., Kanungo R.N. Cross-cultural industrial and organizational psychology: A critical appraisal of the field and future directions. Personnel psychology 2001, 1:385-408. Sage, London. N. Anderson, D.S. Ones, H.K. Sinangil, C. Viswesvaran (Eds.).
14. Bagby R.M., Rector N.A., Bindseil K., Dickens S.E., Levitan R.D., Kennedy S.H. Self-report ratings and informants' ratings of personalities of depressed outpatients. American Journal of Psychiatry 1998, 155:437-438.
15. Bailey C., Fletcher C. The impact of multiple source feedback on management development: Findings from a longitudinal study. Journal of Organizational Behavior 2002, 23:853-867.
16. Barr M.A., Raju N.S. IRT-based assessments of rater effects in multiple-source feedback instruments. Organizational Research Methods 2003, 6:15-43.
17. Baskett G.D. Interview decisions as determined by competency and attitude similarity. Journal of Applied Psychology 1973, 57:343-345.
18. Bass B., Yammarino F.J. Congruence of self and others' leadership ratings of naval officers for understanding successful performance. Applied Psychology: An International Review 1991, 40:437-454.
19. Baumeister R.F., Bratslavsky E., Finkenauer C., Vohs K.D. Bad is stronger than good. Review of General Psychology 2001, 5:323-370.
20. Bayroff A.G., Haggerty H.R., Rundquist E.A. Validity of ratings as related to rating techniques and conditions. Personnel Psychology 1954, 7:93-112.
21. Bazerman M.H., Beekun R.I., Schoorman F.D. Performance evaluation in a dynamic context: A laboratory study of the impact of a prior commitment to the ratee. Journal of Applied Psychology 1982, 67:873-876.
22. Bazigos M.N. The relationship of upward feedback disparities to leader performance: Understanding "overestimation". Dissertation Abstracts International: Section B: The Sciences and Engineering 1999, 60(5-B):2395.
23. Beehr T.A., Ivanitskaya L., Hansen C.P., Erofeev D., Gudanowski D.M. Evaluation of 360-degree feedback ratings: Relationships with each other and with performance and selection predictors. Journal of Organizational Behavior 2001, 22:775-788.
24. Bell S.T., Arthur W. Feedback acceptance in developmental assessment centers: The role of feedback message, participant personality, and affective response to the feedback session. Journal of Organizational Behavior 2008, 29:681-703.
25. Bernardin H.J., Buckley M.R. Strategies in rater training. Academy of Management Review 1981, 6:205-212.
26. Bernardin H.J., Cardy R.L. Appraisal accuracy: The ability and motivation to remember the past. Public Personnel Management 1982, 11:352-357.
27. Bernardin H.J., Cardy R.L., Carlyle J.J. Cognitive complexity and appraisal effectiveness: Back to the drawing board?. Journal of Applied Psychology 1982, 67:151-160.
28. Bernardin H.J., Orban J.A. Leniency effect as a function of rating format, purpose of appraisal, and rater individual differences. Journal of Business and Psychology 1990, 5:197-211.
29. Bernardin H.J., Pence E.C. Effects of rater error training: Creating new response sets and decreasing accuracy. Journal of Applied Psychology 1980, 65:60-66.
30. Berscheid E., Walster E. Interpersonal attraction 1969, Addison-Wesley, Reading, MA.
31. Berson Y., Sosik J.J. The relationship between self-other rating agreement and influence tactics and organizational processes. Group & Organization Management 2007, 32:675-698.
32. Blakely G.L., Andrews M.C., Fuller J. Are chameleons good citizens? A longitudinal study of the relationship between self-monitoring and organizational citizenship behavior. Journal of Business and Psychology 2003, 18:131-144.
33. Borman W.C. Individual differences correlates of accuracy in evaluating others' performance effectiveness. Applied Psychological Measurement 1979, 3:103-115.
34. Borman W.C. 360 ratings: An analysis of assumptions and a research agenda for evaluating their validity. Human Resource Management Review 1997, 7:299-315.
35. Bracken D., Timmreck C., Church A. The handbook of multisource feedback 2001, Jossey-Bass, San Francisco.
36. Bravo I.M., Kravitz D.A. Context effects in performance appraisals: Influence of target value, context polarity, and individual differences. Journal of Applied Social Psychology 1996, 26:1681-1701.
37. Brutus S., Fleenor J.W., McCauley C.D. Demographic and personality predictors of congruence in multi-source ratings. The Journal of Management Development 1999, 18:417-435.
38. Brutus S., Fleenor J.W., Tisak J. Exploring the link between rating congruence and managerial effectiveness. Canadian Journal of Administrative Sciences 1999, 16:308-322.
39. Byrne D. The attraction paradigm 1971, Academic Press, New York.
40. Caligiuri P.M., Day D.V. Effects of self-monitoring on technical, contextual, and assignment-specific performance. Group and Organization Management 2000, 25:154-174.
41. Cardy R.L., Kehoe J.F. Rater selective attention ability and appraisal effectiveness: The effect of a cognitive style on the accuracy of differentiation among ratees. Journal of Applied Psychology 1984, 69:589-594.
42. Cascio W.F., Valenzi E.R. Behaviorally anchored rating scales: Effects of education and job experience of raters and ratees. Journal of Applied Psychology 1977, 62:278-282.
43. Cellar D.F., Durr M.L., Halsell S., Doverspike D. The effect of field independence, job analysis format, and sex of rater on the accuracy of job evaluation ratings. Journal of Applied Social Psychology 1989, 19:363-376.
44. Cheung G.W. Multifaceted conceptions of self-others' ratings disagreement. Personnel Psychology 1999, 52:1-36.
45. Conway J.M. Understanding method variance in multitrait-multirater performance appraisal matrices: Examples using general impressions and interpersonal affect as measured method factors. Human Performance 1998, 11:29-55.
46. Conway J.M., Huffcutt A.I. Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. Human Performance 1997, 10:331-360.
47. Dansereau F., Yammarino F.J. Within and between analysis: The variant paradigm as an underlying approach to theory building and testing. Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions 2000, 425-466. Jossey-Bass, San Francisco. K.J. Klein, S.W.J. Kozlowski (Eds.).
48. Davis D.D. International performance measurement and management. Performance appraisal: State-of-the-art in practice 1998, 95-131. Jossey-Bass, San Francisco. J.W. Smither (Ed.).
49. Day D.D., Greguras G.J. Performance management in multi-national companies. Performance management: Putting research into practice 2009, Jossey-Bass, San Francisco. J.W. Smither, M. London (Eds.).
50. De Los Reyes A., Kazdin A.E. Measuring informant discrepancies in clinical child research. Psychological Assessment 2004, 16:330-334.
51. DeCotiis T.A., Petit A. The performance appraisal process: A model and some testable hypotheses. Academy of Management Review 1978, 21:635-646.
52. DeNisi A.S. Cognitive approach to performance appraisal: A program of research 1996, Routledge, New York.
53. DeNisi A.S., Cafferty T.P., Meglino B.M. A cognitive view of the performance appraisal process: A model and research propositions. Organizational Behavior and Human Performance 1984, 33:360-396.
54. Dindia K., Allen M. Sex differences in self-disclosure: A meta-analysis. Psychological Bulletin 1992, 112:106-124.
55. Dipboye R.L. A critical review of Korman's self-consistency theory of work motivation and occupational choice. Organizational Behavior & Human Performance 1977, 18:108-126.
56. Dubin S.S., Burke L.K., Katz A., Chesler D.J. Characteristics of raters whose ratings reflect halo. US Army Personnel Research Branch Note 1954, 37:5.
57. Dubin S.S., Burke L.K., Katz A., Chesler D.J. Characteristics of raters whose ratings agree with consensus ratings. US Army Personnel Research Branch Note 1954, 35:8.
58. Dunnette M. My hammer or your hammer?. Human Resource Management 1993, 32:373-384.
59. Edwards J.R. Problems with the use of profile similarity indices in the study of congruence in organizational research. Personnel Psychology 1993, 46:641-665.
60. Edwards J.R. The study of congruence in organizational behavior research: Critique and a proposed alternative. Organizational Behavior and Human Processes 1994, 58:51-100.
61. Edwards J.R. Alternatives to difference scores as dependent variables in the study of congruence in organizational research. Organizational Behavior and Human Decision Processes 1995, 64:307-324.
62. Edwards J.R. Alternatives to difference scores: Polynomial regression analysis and response surface methodology. Measuring and analyzing behavior in organizations: Advances in measurement and data analysis 2002, 350-400. Jossey-Bass, Inc, San Francisco, CA. F. Drasgow, N. Schmitt (Eds.).
63. Edwards J.R., Parry M.E. On the use of polynomial regression equations as an alternative to difference scores in organizational research. Academy of Management Journal 1993, 6:1577-1633.
64. Facteau J.D., Craig S.B. Are performance appraisal ratings from different rating sources comparable?. Journal of Applied Psychology 2001, 86:215-227.
65. Farh J.-L., Cheng B.-S. Modesty bias in self-rating in Taiwan: Impact of item wording, modesty value, and self-esteem. Chinese Journal of Psychology 1997, 39:103-118.
66. Farh J.-L., Dobbins G.H., Cheng B.-S. Cultural relativity in action: A comparison of self-rating made by Chinese and U.S. workers. Personnel Psychology 1991, 44:129-147.
67. Feldman J.M. Beyond attribution theory: Cognitive processes in performance appraisal. Journal of Applied Psychology 1981, 66:127-148.
68. Ferris G.R., Fedor D.B., Chachere J.G., Pondy L.R. Myths and politics in organizational contexts. Group & Organization Studies 1989, 14:83-103.
69. Ferris G.R., Judge T.A., Rowland K.M., Fitzgibbons D.E. Subordinate influence and the performance evaluation process: Test of a model. Organizational Behavior and Human Decision Processes 1994, 58:101-135.
70. Festinger L. A theory of social comparison processes. Human Relations 1954, 7:117-140.
71. Fleenor J.W., McCauley C.D., Brutus S. Self-other rating agreement and leader effectiveness. Leadership Quarterly 1996, 7:487-506.
72. Fleenor J.W., Taylor S., Chappelow C. Leveraging the impact of 360-degree feedback 2008, Pfeiffer, San Francisco.
73. Fletcher C. The implication of research on gender differences in self-assessment and 360 degree appraisal. Human Resource Management Journal 1999, 9:39-46.
74. Fletcher C., Perry E.L. Performance appraisal and feedback: A consideration of national culture and a review of contemporary research and future trends. Personnel psychology 2001, 1:127-144. Sage, London. N. Anderson, D.S. Ones, H.K. Sinangil, C. Viswesvaran (Eds.).
75. Forsyth D.R., Heiney M.M., Wright S.S. Biases in appraisals of women leaders. Group Dynamics: Theory, Research, and Practice 1997, 1:98-103.
76. Fox S., Ben-Nahum Z., Yinon Y. Perceived similarity and accuracy of peer ratings. Journal of Applied Psychology 1989, 74:781-786.
77. Freeberg N.E. Relevance of rater-ratee acquaintance in the validity and reliability of ratings. Journal of Applied Psychology 1969, 53:518-524.
78. Fried Y., Levi A.S., Ben-David H.A., Tiegs R.B., Avital N. Rater positive and negative mood predispositions as predictors of performance ratings of ratees in simulated and real organizational settings: Evidence from US and Israeli samples. Journal of Occupational and Organizational Psychology 2000, 73:373-378.
79. Furnham A., Moutafi J., Chamorro-Premuzic T. Personality and intelligence: Gender, the Big Five, self-estimated and psychometric intelligence. International Journal of Selection and Assessment 2005, 13:11-24.
80. Furnham A., Stringfield P. Congruence of self and subordinate ratings of managerial practices as a correlate of supervisor evaluation. Journal of Occupational and Organizational Psychology 1994, 67:57-67.
81. Gentry W.A., Braddy P.W., Fleenor J.W., Howard P.J. Self-observer rating discrepancies on the derailment behaviors of Hispanic managers. The Business Journal of Hispanic Research 2008, 2:76-87.
82. Gentry W.A., Braddy P.W., Weber T., Thompson L.F. Predictive utility of peer versus direct-report ratings of derailment tendencies. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, San Francisco 2008, Apr.
83. Gentry W.A., Hannum K.M., Ekelund B.Z., de Jong A. A study of the discrepancy between self- and observer-ratings on managerial derailment characteristics of European managers. European Journal of Work and Organizational Psychology 2007, 16:295-325.
84. Gentry W.A., Yip J., Hannum K.M. Self-observer rating discrepancies of managers in Asia: A study of derailment characteristics and behaviors in Southern and Confucian Asia. International Journal of Selection and Assessment 2010, 18:237-250.
85. Gerstner C.R., Day D.V. Meta-analytic review of leader-member exchange theory: Correlates and construct issues. Journal of Applied Psychology 1997, 82:827-844.
86. Gioia D.A., Longenecker C.O. Delving into the dark side: The politics of executive appraisal. Organizational Dynamics 1994, 22:47-58.
87. Gioia D.A., Sims H.P. On avoiding the influence of implicit leadership theories in leader behavior descriptions. Educational and Psychological Measurement 1985, 45:217-232.
88. Goffin R.D., Anderson D.W. The self-rater's personality and self-other disagreement in multi-source performance ratings: Is disagreement healthy?. Journal of Managerial Psychology 2007, 22:271-289.
89. Gorman C.A., Rentsch J.R. Evaluating frame-of-reference rater training effectiveness using performance schema accuracy. Journal of Applied Psychology 2009, 94:1336-1344.
90. Grey R.J., Kipnis D. Untangling the performance appraisal dilemma: The influence of perceived organizational context on evaluative processes. Journal of Applied Psychology 1976, 61:329-335.
91. Guion R.M. Assessment, measurement, and prediction for personnel decisions 1998, Lawrence Erlbaum, Mahwah, NJ.
92. Haaland S., Christiansen N.D. Implications of trait-activation theory for evaluating the construct validity of assessment center ratings. Personnel Psychology 2002, 55:137-163.
93. Halverson S.K., Tonidandel S., Barlow C.B., Dipboye R.L. Self-other agreement on a 360-degree leadership evaluation. Multi-source performance assessment: Perspective and Insights 2005, 125-144. ICFAI University Press, Hyderabad, India. S. Reddy (Ed.).
94. Harris M.M. Rater motivation in the performance appraisal context: A theoretical framework. Journal of Management 1994, 20:737-756.
95. Harris M.M., Schaubroeck J. A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology 1988, 41:43-62.
96. Härtel C.E. Rating format research revisited: Format effectiveness and acceptability depend on rater characteristics. Journal of Applied Psychology 1993, 78:212-217.
97. Hauenstein N.M.A. Training raters to increase the accuracy of appraisals and the usefulness of feedback. Performance appraisal: State of the art in practice 1998, 404-442. Jossey-Bass, San Francisco. J.W. Smither (Ed.).
98. Hauenstein N.M., Alexander R.A. Rating ability in performance judgments: The joint influence of implicit theories and intelligence. Organizational Behavior and Human Decision Processes 1991, 50:300-323.
99. Heger D.K. Factors affecting agreement in multi-rater performance appraisal: Observability and opportunity-to-observe. Dissertation Abstracts International: Section B: The Sciences and Engineering 2007, 68(5-B):3436.
100. Heidemeier H., Moser K. Self-other agreement in job performance ratings: A meta-analytic test of a process model. Journal of Applied Psychology 2009, 94:353-370.
101. Heslin P.A., Latham G.P., VandeWalle D. The effect of implicit person theory on performance appraisals. Journal of Applied Psychology 2005, 90:842-856.
102. Heslin P.A., VandeWalle D. Managers' implicit assumptions about personnel. Current Directions in Psychological Science 2008, 17:219-223.
103. Higgins E.T., Lurie L. Context, categorization, and recall: The "change-of-standard" effect. Cognitive Psychology 1983, 15:525-547.
104. Hough L., Keyes M., Dunnette M. An evaluation of three "alternative" selection procedures. Personnel Psychology 1983, 36:261-275.
105. House R.J., Hanges P.J., Javidan M., Dorfman P., Gupta V. Culture, leadership and organizations 1999, Sage, Thousand Oaks, CA.
106. Ilgen D.R., Feldman J.M. Performance appraisal: A process focus. Research in Organizational Behavior 1983, 5:141-197.
107. Jackson D.J.R., Stillman J.A., Burke S., Englert P. Self versus assessor ratings and their classification in assessment centers: Profiling the self-rater. New Zealand Journal of Psychology 2007, 36:93-99.
108. James L.R., Demaree R.G., Wolf G. Estimating within-group reliability with and without response bias. Journal of Applied Psychology 1984, 69:85-98.
109. WG: An assessment of within-group interrater agreement. Journal of Applied Psychology 1993, 78:306-309.
110. Jawahar I.M. Attitudes, self-monitoring, and appraisal behaviors. Journal of Applied Psychology 2001, 86:875-883.
111. Jawahar I.M., Williams C.R. Where all the children are above average: The performance appraisal purpose effect. Personnel Psychology 1997, 50:905-925.
112. Jeffcoat K.A. Multi-source feedback, source credibility, and performance discrepancy: The dynamics of fairness and usefulness perceptions. Dissertation Abstracts International: Section B: The Sciences and Engineering 2000, 61(4-B):2256.
113. Johnson J.W., Ferstl K.L. The effects of interrater and self-other agreement on performance improvement following upward feedback. Personnel Psychology 1999, 52:272-303.
114. Jones L., Fletcher C. Self-assessment in a selection situation: An evaluation of different measurement approaches. Journal of Occupational & Organizational Psychology 2002, 75:145-161.
115. Judge T.A., LePine J.A., Rich B.L. Loving yourself abundantly: Relationship of the narcissistic personality to self- and other perceptions of workplace deviance, leadership, and task and contextual performance. Journal of Applied Psychology 2006, 91:762-776.
116. Kallejian V., Brown P., Weschler I.R. The impact of interpersonal relations on ratings of performance. Public Personnel Review 1953, 14:166-170.
117. Kenny D.A. Interpersonal perception: A social relations analysis 1994, Guilford Press, New York.
118. Kenny D.A., La Voie L. The social relations model. Advances in experimental social psychology 1984, Vol. 18:142-182. Academic Press, Orlando, FL. L. Berkowitz (Ed.).
119. Kierein N.M., Gold M.A. Pygmalion in work organizations: A meta-analysis. Journal of Organizational Behavior 2000, 21:913-928.
120. Kingston P.W., Hubbard R., Lapp B., Schroeder P., Wilson J. Why education matters. Sociology of Education 2003, 76:53-70.
121. Kingstrom P.O., Mainstone L.E. An investigation of the rater-ratee acquaintance and rater bias. Academy of Management Journal 1985, 28:641-653.
122. Kirchner W.K., Reisberg D.J. Differences between better and less-effective supervisors in appraisal of subordinates. Personnel Psychology 1962, 15:295-302.
123. Korman A.K. Hypothesis of work behavior revisited and an extension. Academy of Management Review 1976, 1:50-63.
124. Korsgaard M.A., Meglino B.M., Lester S.W. The effect of other orientation on self-supervisor rating agreement. Journal of Organizational Behavior 2004, 25:873-891.
125. Kozlowski S.W.J., Chao G.T., Morrison R.F. Games raters play: Politics, strategies, and impression management in performance appraisal. Performance appraisal: State-of-the-art in practice 1998, Jossey-Bass, San Francisco. J.W. Smither (Ed.).
126. Kraiger K., Ford J.K. A meta-analysis of ratee race effects in performance ratings. Journal of Applied Psychology 1985, 70:56-65.
127. Kravitz D.A., Balzer W.K. Context effects in performance appraisal: A methodological critique and empirical study. Journal of Applied Psychology 1992, 77:24-31.
128. Kruger J., Dunning D. Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology 1999, 77:1121-1134.
129. Kwan V.S.Y., John O.P., Kenny D.A., Bond M.H., Robins R.W. Reconceptualizing individual differences in self-enhancement bias: An interpersonal approach. Psychological Review 2004, 111:94-110.
130. Kwan V.S.Y., John O.P., Robins R.W., Kuang L.L. Conceptualizing and assessing self-enhancement bias: A componential approach. Journal of Personality and Social Psychology 2008, 94:1062-1077.
131. Lance C.E., Baxter D., Mahan R. Evaluation of alternative perspectives on source effects in multisource performance measures. Performance measurement: Current perspectives and future challenges 2006, 49-76. Lawrence Erlbaum, Mahwah, NJ. W. Bennett, C.E. Lance, D.J. Woehr (Eds.).
132. Lance C.E., Bennett W. Rater source differences in cognitive representations of performance dimensions. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, St. Louis, MO. 1997, April.
133. Lance C.E., Hoffman B.J., Gentry W.A., Baranik L.E. Rater source factors represent important subcomponents of the criterion construct space, not rater bias. Human Resource Management Review 2008, 18:223-232.
134. Landy F.J., Farr J.L. Performance rating. Psychological Bulletin 1980, 87:72-107.
135. LeBreton J.M., Burgess J.R., Kaiser R.B., Atchley R.B., James L.R. The restriction of variance hypothesis and interrater reliability and agreement. Are ratings from multiple sources really dissimilar?. Organizational Research Methods 2003, 6:80-128.
136. LeBreton J.M., Senter J.L. Answers to 20 questions about interrater reliability and agreement. Organizational Research Methods 2008, 11:815-852.
137. Levy P.E. Self-appraisal and attributions: A test of a model. Journal of Management 1993, 19:51-62.
138. Liden R.C., Mitchell T.R. The effects of group interdependence on supervisor performance evaluations. Personnel Psychology 1983, 36:289-299.
139. Lin T., Dobbins G.H., Farh J. A field study of race and age similarity effects on interview ratings in conventional and situational interviews. Journal of Applied Psychology 1992, 77:363-371.
140. Lindeman M., Sundvik L., Rouhiainen P. Under- or overestimation of self? Person variables and self-assessment accuracy in work settings. Journal of Social Behavior & Personality 1995, 10:123-134.
141. Linville P.W., Jones E.E. Polarized appraisals of out-group members. Journal of Personality and Social Psychology 1980, 38:689-703.
142. London M. Self and interpersonal insight: How people learn about themselves and others in organizations 1995, Oxford University Press, New York.
143. London M., Smither J.W. Can multi-source feedback change perceptions of goal accomplishment, self-evaluations, and performance-related outcomes? Theory-based applications and directions for research. Personnel Psychology 1995, 48:803-839.
144. Longenecker C.O., Sims H.P., Gioia D.A. Behind the mask: The politics of employee appraisal. Academy of Management Executive 1987, 1:183-193.
145. Lord R.G., Foti R.J., de Vader C.L. A test of leadership categorization theory: Internal structure, information processing, and leadership perceptions. Organizational Behavior & Human Performance 1984, 34:343-378.
146. Mabe P., West J. Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology 1982, 67:280-296.
147. Martell R.F., Leavitt K.N. Reducing the performance-cue bias in work behavior ratings: Can groups help?. Journal of Applied Psychology 2002, 87:1032-1041.
148. Maurer T., Raju N.S., Collins W.C. Peer and subordinate performance appraisal measurement equivalence. Journal of Applied Psychology 1998, 83:693-703.
149. McCall M., Lombardo M. Off the track: Why and how successful executives get derailed 1983, Center for Creative Leadership, Greensboro, NC.
150. McNatt D.B. Ancient Pygmalion joins contemporary management: A meta-analysis of the result. Journal of Applied Psychology 2000, 85:314-322.
151. Meade A.W., Lautenschlager G.J. A comparison of item response theory and confirmatory factor analytic methodologies for establishing measurement equivalence/invariance. Organizational Research Methods 2004, 7:361-388.
152. Mero N.P., Guidice R.M., Brownlee A.L. Accountability in a performance appraisal context: The effect of audience and form of accounting on rater response and behavior. Journal of Management 2007, 33:223-252.
153. Mero N.P., Motowidlo S.J. Effects of rater accountability on the accuracy and the favorability of performance ratings. Journal of Applied Psychology 1995, 80:517-524.
154. Miller J.S., Cardy R.L. Self-monitoring and performance appraisal: Rating outcomes in project teams. Journal of Organizational Behavior 2000, 21(6):609-626.
155. Mischel W. Toward a cognitive social learning reconceptualization of personality. Psychological Review 1973, 80:252-253.
156. Mischel W. The interaction of person and situation. Personality at the crossroads: Current issues in interactional psychology 1977, Erlbaum, Hillsdale, NJ. D. Magnussen, N. Endler (Eds.).
157. Mitchell T.R., Liden R.C. The effects of the social context on performance evaluations. Organizational Behavior & Human Performance 1982, 29:241-256.
158. Moser K., Schuler H., Funke U. The moderating effect of raters' opportunities to observe ratees' job performance on the validity of an assessment centre. International Journal of Selection and Assessment 1999, 7:133-141.
159. Moshavi D., Brown F.W., Dodd N.G. Leader self-awareness and its relationship to subordinate attitudes and performance. Leadership and Organizational Development Journal 2003, 24:407-418.
160. Murphy K.R. Explaining the weak relationship between job performance and ratings of job performance. Industrial and Organizational Psychology: Perspectives on Science and Practice 2008, 1:148-160.
161. Murphy K.R., Cleveland J.N. Performance appraisal: An organizational perspective 1991, Allyn & Bacon, Boston.
162. Murphy K.R., Cleveland J.N. Understanding performance appraisal: Social, organizational, and goal-based perspectives 1995, Sage, Thousand Oaks, CA.
163. Murtha T.C., Kanfer R., Ackerman P.L. Toward an interactionist taxonomy of personality and situations: An integrative situational-dispositional representation of personality traits. Journal of Personality and Social Psychology 1996, 71:193-207.
164. Nilsen D., Campbell D.P. Self-observer rating discrepancies: Once an overrater, always and overrater?. Human Resource Management 1993, 32:265-282.
165. Ostroff C., Atwater L.E., Feinberg B.J. Understanding self-other agreement: A look at rater and ratee characteristics, context, and outcomes. Personnel Psychology 2004, 57:333-375.
166. Patiar A., Mia L. The effect of subordinates' gender on the difference between self-ratings, and superiors' ratings, of subordinates' performance in hotels. International Journal of Hospitality Management 2008, 27:53-64.
167. Penny J.A. Exploring differential item functioning in a 360-degree assessment: Rater source and method of delivery. Organizational Research Methods 2003, 6:61-79.
168. Peterson C., Seligman M.E.P. Character strengths and virtues: A handbook and classification 2004, Oxford/American Psychological Association, New York.
169. Podsakoff P., Organ D. Self-reports in organizational research: Problems and prospects. Journal of Management 1986, 12:531-544.
170. Poon J.M.L. Effects of performance appraisal politics on job satisfaction and turnover intention. Personnel Review 2004, 33:322-334.
171. Pulakos E.D., Wexley K.N. The relationship among perceptual similarity, sex, and performance ratings in manager-subordinate dyads. Academy of Management Journal 1983, 26:129-139.
172. Rand T.M., Wexley K.N. Demonstration of the effect, "similar to me", in simulated employment interviews. Psychological Reports 1975, 36:535-544.
173. Robins R.W., John O.P. Effects of visual perspective and narcissism on self-perception: Is seeing believing?. Psychological Science 1997, 8:37-42.
174. Rosenbaum M.E. The repulsion hypothesis: On the nondevelopment of relationships. Journal of Personality and Social Psychology 1986, 51:1156-1166.
175. Rothermund K., Bak P.M., Brandtstädter J. Biases in self-evaluation: Moderating effects of attribute controllability. European Journal of Social Psychology 2005, 35:281-290.
176. Rothstein H.R. Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology 1990, 75:322-327.
177. Roush P., Atwater L.E. Using the MBTI to understand transformational leadership and self-perception accuracy. Military Psychology 1992, 4:17-34.
178. Rush M.C., Phillips J.S., Lord R.G. Effects of a temporal delay in rating on leader behavior descriptions: A laboratory investigation. Journal of Applied Psychology 1981, 66:442-450.
179. Sackett P.R., DuBois C.L. Rater-ratee race effects on performance evaluation: Challenging meta-analytic conclusions. Journal of Applied Psychology 1991, 76:873-877.
180. Sackett P.R., DuBois C.L., Noe A.W. Tokenism in performance evaluation: The effects of work group representation on male-female and White-Black differences in performance ratings. Journal of Applied Psychology 1991, 76:263-267.
181. Sala F. Executive blind spots: Discrepancies between self- and others' ratings. Consulting Psychology Journal: Practice and Research 2003, 55:222-229.
182. Salvemini N.J., Reilly R.R., Smither J.W. The influence of rater motivation on assimilation effects and accuracy in performance ratings. Organizational Behavior and Human Decision Processes 1993, 55:41-60.
183. Schneider D.E., Bayroff A.G. The relationship between rater characteristics and validity of ratings. Journal of Applied Psychology 1953, 37:278-280.
184. Sears G.J., Rowe P.M. A personality-based similar-to-me effect in the employment interview: Conscientiousness, affect-versus competence-mediated interpretations, and the role of job relevance. Canadian Journal of Behavioural Science/Revue Canadienne Des Sciences Du Comportement 2003, 35:13-24.
185. Shore T.H., Adams J.S., Tashchian A. Effects of self-appraisal information, appraisal purpose, and feedback target on performance appraisal ratings. Journal of Business and Psychology 1998, 12:283-298.
186. Smith A.F.R., Fortunato V.J. Factors influencing employee intentions to provide honest upward feedback ratings. Journal of Business and Psychology 2008, 22:191-207.
187. Smither J.W., Collins H., Buda R. When ratee satisfaction influences performance evaluations: A case of illusory correlation. Journal of Applied Psychology 1989, 74:599-605.
188. Smither J.W., London M., Vasilopoulos N., Reilly R., Millsap R., Salvemini N. An examination of the effects of an upward feedback program over time. Personnel Psychology 1995, 48:1-33.
189. Smither J.W., Reilly R.R. True intercorrelation among job components, time delay in rating, and rater intelligence as determinants of accuracy in performance ratings. Organizational Behavior and Human Decision Processes 1987, 40:369-391.
190. Smither J.W., Reilly R.R., Buda R. Effect of prior performance information on ratings of present performance: Contrast versus assimilation revisited. Journal of Applied Psychology 1988, 73:487-496.
191. Snyder M., Copeland J. Self-monitoring processes in organizational settings 1989, Lawrence Erlbaum & Associates, Hillsdale, NJ.
192. Sosik J.J., Megerian L.E. Understanding leader emotional intelligence and performance: The role of self-other agreement on transformational leadership perceptions. Group & Organization Management 1999, 24:367-390.
193. Steiner D.D., Rain J.S. Immediate and delayed primacy and recency effects in performance evaluation. Journal of Applied Psychology 1989, 74:136-142.
194. Szarota P., Zawadzki B., Strelau J. Big five domain and gender as determinants of rater agreement: A comparison based on self- and peer-rating on the Polish Adjective List. Personality and Individual Differences 2002, 33:1265-1277.
195. Szell S., Henderson R. The impact of self-supervisor/subordinate performance rating agreement on subordinates' job satisfaction and organisational commitment. Journal of Applied Social Behaviour 1997, 3:25-37.
196. Taft R. The ability to judge people. Psychological Bulletin 1955, 52:1-23.
197. Tett R.P., Guterman H.A. Situation trait relevance, trait expression, and cross-situational consistency: Testing a principle of trait-activation. Journal of Research in Personality 2000, 34:397-423.
198. Tornow W. Perceptions or reality: Is multi-perspective measurement a means or an end?. Human Resource Management 1993, 32:221-230.
199. Tsui A.S., Ashford S.J. Adaptive self-regulation: A process view of managerial effectiveness. Journal of Management 1994, 20:93-121.
200. Tsui A.S., Barry B. Interpersonal affect and rating errors. Academy of Management Journal 1986, 29:586-599.
201. Tsui A.S., Ohlott P. Multiple assessment of managerial effectiveness: Interrater agreement and consensus in effectiveness models. Personnel Psychology 1988, 41:799-803.
202. Tsui A.S., O'Reilly C.A. Beyond simple demographic effects: The importance of relational demography in superior-subordinate dyads. Academy of Management Journal 1989, 32:402-423.
203. Tziner A., Latham G.P., Price B.S., Haccoun R. Development and validation of a questionnaire for measuring perceived political considerations in performance appraisal. Journal of Organizational Behavior 1996, 17:179-190.
204. Tziner A., Murphy K.R. Additional evidence of attitudinal influences in performance appraisal. Journal of Business and Psychology 1999, 13:407-419.
205. Tziner A., Murphy K.R., Cleveland J.N. Contextual and rater factors affecting rating behavior. Group & Organization Management 2005, 30:89-98.
206. Tziner A., Murphy K.R., Cleveland J., Beaudin G., Marchand S. Impact of rater beliefs regarding performance appraisal and its organizational contexts on appraisal quality. Journal of Business and Psychology 1998, 12:457-467.
207. Uleman J.S. Leadership ratings: Toward focusing more on specific behaviors. Leadership Quarterly 1991, 2:175-187.
208. Van Scotter J.R., Moustafa K., Burnett J.R., Michael P.G. Influence of prior acquaintance with the ratee on rater accuracy and halo. Journal of Management Development 2007, 26:790-803.
209. Van Velsor E., Taylor S., Leslie J. An examination of the relationships among self-perception accuracy, self-awareness, gender, and leader effectiveness. Human Resource Management 1993, 32:249-264.
210. Vance R.J., Winne P.S., Wright E.S. A longitudinal examination of rater and ratee effects in performance ratings. Personnel Psychology 1983, 36:609-620.
211. Vandenberg R.J., Lance C.E. A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods 2000, 3:4-69.
212. Vecchio R.P., Anderson R.J. Agreement in self-others' ratings of leader effectiveness: The role of demographics and personality. International Journal of Selection and Assessment 2009, 17:165-179.
213. Vecchio R.P., Gobdel B.C. The vertical dyad linkage model of leadership: Problems and prospects. Organizational Behavior & Human Performance 1984, 34:5-20.
214. Villanova P., Bernardin J., Dahmus S.A., Sims R.L. Rater leniency and performance appraisal discomfort. Educational and Psychological Measurement 1993, 53:789-799.
215. Visser B.A., Ashton M.C., Vernon P.A. What makes you think you're so smart? Measured abilities, personality, and sex differences in relation to self-estimates of multiple intelligences. Journal of Individual Differences 2008, 29:35-44.
216. Wayne S.J., Ferris G.R. Influence tactics, affect, and exchange quality in supervisor-subordinate interactions: A laboratory experiment and field study. Journal of Applied Psychology 1990, 75:487-499.
217. Wayne S.J., Kacmar K.M. The effects of impression management on the performance appraisal process. Organizational Behavior and Human Decision Processes 1991, 48:70-88.
218. Wexley K.N., Youtz M.A. Rater beliefs about others: Their effects on rating errors and rater accuracy. Journal of Occupational Psychology 1985, 58:265-275.
219. Whetten D.A., Cameron K.S. Developing management skills 2007, Prentice Hall, Upper Saddle River, NJ.
220. Woehr D.J., Huffcutt A.I. Rater training for performance appraisal: A quantitative review. Journal of Occupational and Organizational Psychology 1994, 67:189-205.
221. Woehr D.J., Roch S.G. Context effects in performance evaluation: The impact of ratee sex and performance level on performance ratings and behavioral recall. Organizational Behavior and Human Decision Processes 1996, 66:31-41.
222. Woehr D.J., Sheehan M.K., Bennett W. Assessing measurement equivalence across rating sources: a multitrait-multirater approach. Journal of Applied Psychology 2005, 3:592-600.
223. Xie J.L., Roy J.-P., Chen Z. Cultural and individual differences in self-rating behavior: An extension and refinement of the cultural relativity hypothesis. Journal of Organizational Behavior 2006, 27:341-364.
224. Yammarino F.J. Multivariate aspects of the variant/WABA approach: A discussion and illustration. Leadership Quarterly 1998, 9:203-227.
225. Yammarino F.J. Modern data analytic techniques for multisource feedback. Organizational Research Methods 2003, 6:6-14.
226. Yammarino F.J., Atwater L.E. Understanding self-perception accuracy: Implications for human resource management. Human Resource Management 1993, 32:231-247.
227. Yammarino F.J., Atwater L.E. Understanding agreement in multisource feedback. The handbook of multisource feedback 2001, 204-220. Jossey-Bass, San Francisco. D. Bracken, C. Timmreck, A. Church (Eds.).
228. Yammarino F.J., Markham S.E. On the application of within and between analysis: Are absence and affect really group-based phenomena?. Journal of Applied Psychology 1992, 77:168-176.
229. Yik M.S.M., Bond M.H., Paulhus D.L. Do Chinese self-enhance or self-efface? It's a matter of domain. Personality and Social Psychology Bulletin 1998, 24:399-406.
230. Yun G.J., Donahue L.M., Dudley N.M., McFarland L.A. Rater personality, rating format, and social context: Implications for performance appraisal ratings. International Journal of Selection and Assessment 2005, 13:97-107.