Self-Other Agreement in Job Performance Ratings: A Meta-Analytic Test of a Process Model

Journal of Applied Psychology

Volumn 94, Issue 2, 2009, Pages 353-370

  Heidemeier, Heike ^a   Moser, Klaus ^b  

^a JACOBS UNIVERSITY BREMEN   (Germany)

^b UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

correlational rater agreement; job performance; leniency in self ratings; meta analysis; self ratings

Indexed keywords

ARTICLE; ASSOCIATION; CLINICAL TRIAL; HUMAN; INTERPERSONAL COMMUNICATION; MULTICENTER STUDY; OBSERVER VARIATION; ORGANIZATION; PERSONNEL MANAGEMENT; SELF CONCEPT; STATISTICAL MODEL; STATISTICS;

COMMUNICATION; CUES; EMPLOYEE PERFORMANCE APPRAISAL; HUMANS; MODELS, STATISTICAL; OBSERVER VARIATION; ORGANIZATIONAL OBJECTIVES; PERSONNEL MANAGEMENT; SELF CONCEPT;

EID: 63149191316     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.94.2.353     Document Type: Article

References (173)

1. Aitkenhead M. Impression-management and consistency effects in the processing of feedback. British Journal of Social Psychology 23 (1984) 213-222
2. Amy H.M., Abramson L.Y., Hyde J.S., and Hankin B.L. Is there a universal positivity bias in attributions? A meta-analytic review of individual, developmental, and cultural differences in the self-serving attributional bias. Psychological Bulletin 130 (2004) 711-747
3. Arnold J., and Davey K.M. Self-ratings and supervisor ratings of graduate employees' competences during early career. Journal of Occupational and Organizational Psychology 65 (1992) 235-250
4. Atkins P.W.B., and Wood R.E. Self- versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. Personnel Psychology 55 (2002) 871-904
5. Atwater L.E., Ostroff C., Yammarino F.J., and Fleenor J.W. Self-other agreement: Does it really matter?. Personnel Psychology 51 (1998) 577-598
6. Atwater L.E., and Yammarino F.J. Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions?. Personnel Psychology 45 (1992) 141-164
7. Aycan Z., and Kanungo R.N. Cross-cultural industrial and organizational psychology: A critical appraisal of the field and future directions. In: Anderson N., and Ones D.S. (Eds). Handbook of industrial, work and organizational psychology, Volume 1: Personnel psychology (2002), Sage, London 385-408
8. Baird L.S. Self and superior ratings of performance: As related to self-esteem and satisfaction with supervision. Academy of Management Journal 20 (1977) 291-300
9. Baltes B.B., and Parker C.P. Reducing the effects of performance expectations on behavioral ratings. Organizational Behavior and Human Decision Processes 82 (2000) 237-267
10. Bandura A. Social foundations of thought and action: A social cognitive theory (1986), Prentice-Hall, Upper Saddle River, NJ
11. Bass B., and Yammarino F.J. Congruence of self and others' leadership ratings of naval officers for understanding successful performance. Applied Psychology: An International Review 40 (1991) 437-454
12. Baumeister R.F., and Jones E.E. When self-presentation is constrained by the target's knowledge: Consistency and compensation. Journal of Personality and Social Psychology 36 (1978) 608-618
13. Becker T.E., and Klimoski R.J. A field study of the relationship between the organizational feedback environment and performance. Personnel Psychology 42 (1989) 343-358
14. Becker T.E., and Vance R.J. Construct validity of three types of organizational citizenship behavior: An illustration of the direct product model with refinements. Journal of Management 19 (1993) 633-682
15. Beehr T.A., Ivanitskaya L., Hansen C.P., Erofeev D., and Gudanowski D.M. Evaluation of 360-degree feedback ratings: Relationships with each other and with performance and selection predictors. Journal of Organizational Behavior 22 (2001) 775-788
16. Blackburn R.T., and Clark M.J. An assessment of faculty performance: Some correlates between administrator, colleague, student, and self-ratings. Sociology of Education 48 (1975) 242-256
17. Blank W., Weitzel J.R., and Green S.G. A test of the situational leadership theory. Personnel Psychology 43 (1990) 579-597
18. Blanton H., and Christie C. Deviance: A theory of action and identity. Review of General Psychology 7 (2003) 115-149
19. Borman W.C., and Motowidlo S.J. Expanding the criterion domain to include elements of contextual performance. In: Schmitt N., and Borman W.C. (Eds). Personnel selection in organizations (1993), Jossey-Bass, San Francisco 71-98
20. Brett J.F., and Atwater L.E. 360° feedback: Accuracy, reactions, and perceptions of usefulness. Journal of Applied Psychology 86 (2001) 930-942
21. Brief A.P., Aldag R.J., and Van Sell M. Moderators of the relationship between self and superior evaluations of job performance. Journal of Occupational Psychology 50 (1977) 129-134
22. Brutus S., Fleenor J.W., and London M. Does 360-degree feedback work in different industries? A between-industry comparison of the reliability and validity of multi-source performance ratings. Journal of Management Development 17 (1998) 177-190
23. Campbell D.J., and Lee C. Self-appraisal in performance evaluation: Development versus evaluation. Academy of Management Review 13 (1988) 302-314
24. Carless S.A., Mann L., and Wearing A.J. Leadership, managerial performance and 360-degree feedback. Applied Psychology: An International Review 47 (1998) 481-496
25. Cervone D., Mor N., Orom H., Shadel W.G., and Scott W.D. Self-efficacy beliefs and the architecture of personality: On knowledge, appraisal, and self-regulation. In: Baumeister R.F., and Vohs K.D. (Eds). Handbook of self-regulation: Research, and applications (2004), Guilford Press, New York 188-210
26. Cheung G.W. Multifaceted conceptions of self-other ratings disagreement. Personnel Psychology 52 (1999) 1-36
27. Church A.H. Do you see what I see? An exploration of congruence in ratings from multiple perspectives. Journal of Applied Social Psychology 27 (1997) 983-1020
28. Church A.H., Rogelberg S.G., and Waclawski J. Since when is no news good news? The relationship between performance and response rates in multirater feedback. Personnel Psychology 53 (2000) 435-451
29. Cleveland J.N., and Shore L.M. Self- and supervisory perspectives on age and work attitudes and performance. Journal of Applied Psychology 77 (1992) 469-484
30. Conway J.M. Distinguishing contextual performance from task performance for managerial jobs. Journal of Applied Psychology 84 (1999) 3-13
31. Conway J.M., and Huffcutt A.I. Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. Human Performance 10 (1997) 331-360
32. Cooper H. Synthesizing research: A guide for literature reviews (1998), Sage, Thousand Oaks, CA
33. Costigan R.D., Insinga R.C., Kranas G., Ilter S.S., Berman J.J., and Kureshov V.A. Self-ratings of workplace behaviour: Contrasting Russia and Poland with the United States. International Journal of Management 22 (2005) 341-350
34. DeCotiis T.A., and Petit A. The performance appraisal process: A model and some testable hypotheses. Academy of Management Review 21 (1978) 635-646
35. DeNisi A.S., Cafferty T.P., and Meglino B.M. A cognitive view of the performance appraisal process: A model and research propositions. Organizational Behavior and Human Performance 33 (1984) 360-396
36. Diefendorff J.M., Silverman S.B., and Greguras G.J. Measurement equivalence and multisource ratings for non-managerial positions: Recommendations for research and practice. Journal of Business and Psychology 19 (2005) 399-425
37. Drucker P.F. The practice of management (1954), Harper & Row, New York
38. Ekpo-Ufot A. Self-perceived task-relevant abilities, rated job performance, and complaining behavior of junior employees in a government ministry. Journal of Applied Psychology 64 (1979) 429-434
39. Farh J., and Dobbins G.H. Effects of self-esteem on leniency bias in self-reports of performance: A structural equation model analysis. Personnel Psychology 42 (1989) 835-850
40. Farh J.L., Dobbins G.H., and Cheng B.S. Cultural relativity in action: A comparison of self-ratings made by Chinese and U.S. workers. Personnel Psychology 44 (1991) 129-147
41. Farh J.L., and Werbel J.D. Effects of purpose of the appraisal and expectation of validation on self-appraisal leniency. Journal of Applied Psychology 71 (1986) 527-529
42. Farh J.L., Werbel J.D., and Bedeian A.G. An empirical investigation of self-appraisal-based performance evaluation. Personnel Psychology 41 (1988) 141-156
43. Feldman J.M. Beyond attribution theory: Cognitive processes in performance appraisal. Journal of Applied Psychology 66 (1981) 127-148
44. Ferris G.R., Yates V.L., Gilmore D.C., and Rowland K.M. The influence of subordinate age on performance ratings and causal attributions. Personnel Psychology 38 (1985) 545-557
45. Fletcher C., and Baldry C. A study of individual differences and self-awareness in the context of multi-source feedback. Journal of Occupational and Organizational Psychology 73 (2000) 303-319
46. Fletcher C., Baldry C., and Cunningham-Snell N. The psychometric properties of 360 degree feedback: An empirical study and a cautionary tale. International Journal of Selection and Assessment 6 (1998) 19-34
47. Fletcher C., and Perry E.L. Performance appraisal and feedback: A consideration of national culture and a review of contemporary research and future trends. In: Anderson N., and Ones D.S. (Eds). Handbook of industrial, work and organizational psychology, Volume 1: Personnel psychology (2002), Sage, London 127-144
48. Fox S., Caspy T., and Reisler A. Variables affecting leniency, halo and validity of self-appraisal. Journal of Occupational and Organizational Psychology 67 (1994) 45-56
49. Fox S., and Dinur Y. Validity of self-assessment: A field evaluation. Personnel Psychology 41 (1988) 581-592
50. Frayne C.A., and Geringer J. Self-management training for improving job performance: A field experiment involving salespeople. Journal of Applied Psychology 85 (2000) 361-372
51. Furnham A., and Stringfield P. Congruence of self and subordinate ratings of managerial practices as a correlate of supervisor evaluation. Journal of Occupational and Organizational Psychology 67 (1994) 57-67
52. Furnham A., and Stringfield P. Congruence in job-performance ratings: A study of 360 degree feedback examining self, manager, peers, and consultant ratings. Human Relations 51 (1998) 517-530
53. Gardner D.G., Dunham R.B., Cummings L.L., and Pierce J.L. Focus of attention at work: Construct definition and empirical validation. Journal of Occupational Psychology 62 (1989) 61-77
54. Gentry W.A., Hannum K.M., Ekelund B.Z., and de Jong A. A study of the discrepancy between self- and observer-ratings on managerial derailment characteristics of European managers. European Journal of Work and Organizational Psychology 16 (2007) 295-325
55. Gerhart B. Sources of variance in incumbent perceptions of job complexity. Journal of Applied Psychology 7 (1988) 154-162
56. Goffin R.D., and Anderson D.W. The self-rater's personality and self-other disagreement in multi-source performance ratings: Is disagreement healthy?. Journal of Managerial Psychology 22 (2007) 271-289
57. Goldstein W.M. Social judgment theory: Applying and extending Brunswik's probabilistic functionalism. In: Koehler D.J., and Harvey N. (Eds). Blackwell handbook of judgment and decision making (2004), Blackwell Publishing, Oxford, MA 37-61
58. Halperin K., Snyder C., Shekel R., and Houston B. Effects of source status and message favorability on acceptance of feedback. Journal of Applied Psychology 61 (1976) 142-147
59. Hamori-Ota V.E. Gender differences in leadership style: Predictors of level of agreement between leader self-ratings and supervisory ratings, peer ratings, and ratings by direct reports. Dissertation Abstracts International Section A: The Humanities and Social Sciences 68 2-A (2007) 487
60. Harris M.M., and Schaubroeck J. A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology 41 (1988) 43-62
61. Harris M.M., Smith D.E., and Champagne D. A field study of performance appraisal purpose: Research- versus administrative-based ratings. Personnel Psychology 48 (1995) 151-160
62. Hauenstein N.M.A. An information-processing approach to leniency in performance judgments. Journal of Applied Psychology 77 (1992) 485-493
63. Hedges L. Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics 6 (1981) 107-128
64. Hedges L., and Olkin I. Statistical methods for meta-analysis (1985), Academic Press, Orlando, FL
65. Heine S.J., Lehman D.R., Markus H.R., and Kitayama S. Is there a universal need for positive self-regard?. Psychological Review 106 (1999) 766-794
66. Heneman H.G.I. Comparisons of self- and superior ratings of managerial performance. Journal of Applied Psychology 59 (1974) 638-642
67. Hilario F.L. Effects of 360-degree feedback on managerial effectiveness ratings: A longitudinal field study. Dissertation Abstracts International Section B: The Physical Sciences and Engineering 59 5-B (1998) 2466
68. Hoffman C.C., Nathan B.R., and Holden L.M. A comparison of validation criteria: Objective versus subjective performance measures and self- versus supervisor ratings. Personnel Psychology 44 (1991) 601-619
69. Holzbach R.L. Rater bias in performance ratings: Superior, self-, and peer ratings. Journal of Applied Psychology 63 (1978) 579-588
70. Hoyt W.T. Rater bias in psychological research: When is it a problem and what can we do about it?. Psychological Methods 5 (2000) 64-86
71. Hoyt W.T., and Kerns M.D. Magnitude and moderators of bias in observer ratings: A meta-analysis. Psychological Methods 4 (1999) 403-424
72. Hunter J.E., and Schmidt F.L. Methods of meta-analysis: Correcting error and bias in research findings (1990), Sage, Newbury Park, CA
73. Jawahar I.M., and Williams C.R. Where all the children are above average: The performance appraisal purpose effect. Personnel Psychology 50 (1997) 905-925
74. Jellema F., Visscher A., and Scheerens J. Measuring change in work behavior by means of multisource feedback. International Journal of Training and Development 10 (2006) 121-139
75. Jones E. Interpersonal perception (1990), Freeman, New York
76. Jones E.E., and Pittman T.S. Toward a general theory of strategic self-presentation. In: Suls J. (Ed). Psychological perspectives on the self 1 (1982), Erlbaum, Hillsdale, NJ 231-262
77. Kacmar, K. M., Carlson, D. S., Wright, P. M., & McMahan, G. C. (1996). Assessing the factors influencing differences between supervisor and subordinate performance ratings: A multiple sample study. Unpublished manuscript.
78. Keller R.T., and Holland W.E. The measurement of performance among research and development professional employees: A longitudinal analysis. IEEE Transactions on Engineering, EM-29 (1982) 54-58
79. Kenny D.A. A general model of consensus and accuracy in interpersonal perception. Psychological Review 98 (1991) 155-163
80. Khalid S.A., and Ali H. Self- and supervisor ratings of organizational citizenship behavior: Are there differences in the source of ratings?. Problems and Perspectives in Management (2005) 147-153
81. Kim K.I., Park H.-J., and Suzuki N. Reward allocations in the United States, Japan, and Korea: A comparison of individualistic and collectivistic cultures. Academy of Management Journal 33 (1990) 188-198
82. Kirchner W.K. Relationships between supervisory and subordinate ratings for technical personnel. Journal of Industrial Psychology 3 (1965) 57-60
83. Klimoski R.J., and London M. Role of the rater in performance appraisal. Journal of Applied Psychology 59 (1974) 445-451
84. Korsgaard M., Meglino B.M., and Lester S.W. The effect of other orientation on self-supervisor rating agreement. Journal of Organizational Behavior 25 (2004) 873-891
85. Kwan V.S.Y., John O.P., Kenny D.A., Bond M.H., and Robins R.W. Reconceptualizing individual differences in self-enhancement bias: An interpersonal approach. Psychological Review 111 (2004) 94-110
86. Landy F.J., and Farr J.L. Performance rating. Psychological Bulletin 87 (1980) 72-104
87. Landy F.J., and Farr J.L. The measurement of work performance: Methods, theory and applications (1983), Academic Press, New York
88. Lane J., and Herriot P. Self-ratings, supervisor ratings, positions and performance. Journal of Occupational and Organizational Psychology 63 (1990) 77-88
89. Lawler E.E.I. The multitrait-multimethod approach to measuring managerial performance. Journal of Applied Psychology 51 (1967) 369-381
90. Lawler E.E.I. A correlational analysis of the relationship between expectancy attitudes and job performance. Journal of Applied Psychology 52 (1968) 462-468
91. LeBreton J.M., Burgess J.R., Kaiser R.B., Atchley E., and James L.R. The restriction of variance hypothesis and interrater reliability and agreement: Are ratings from multiple sources really dissimilar?. Organizational Research Methods 6 (2003) 80-128
92. Leslie J.B., and Fleenor J.W. Feedback to managers: A review and comparison of multi-rater instruments for management development. 3rd ed. (1998), Center for Creative Leadership, Greensboro, NC
93. Levine E.L., Flory A., and Ash R.A. Self-assessment in personnel selection. Journal of Applied Psychology 62 (1977) 428-435
94. Lipsey M.W., and Wilson D.B. Practical meta-analysis (2001), Sage, Thousand Oaks, CA
95. Lohmann M.C. The development of a multirater instrument for assessing employee problem-solving skill. Human Resource Development Quarterly 15 (2004) 303-321
96. London M., and Smither J.W. Can multi-source feedback change perceptions of goal accomplishment, self-evaluations, and performance-related outcomes? Theory-based applications and directions for research. Personnel Psychology 48 (1995) 803-839
97. London M., Smither J.W., and Adsit D.J. Accountability: The Achilles' heel of multisource feedback. Group and Organization Management 22 (1997) 162-184
98. Mabe P.A., and West S.G. Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology 67 (1982) 280-296
99. Malka S. Application of the multitrait-multirater approach to performance appraisal in social service organizations. Evaluation and Program Planning 13 (1990) 243-250
100. Martell R.F., Guzzo R.A., and Willis C.E. A methodological and substantive note on the performance-cue effect in ratings of work-group behavior. Journal of Applied Psychology 80 (1995) 191-195
101. Martell R.F., and Leavitt K.N. Reducing the performance-cue bias in work behavior ratings: Can groups help?. Journal of Applied Psychology 87 (2002) 1032-1041
102. Maurer T.J., Mitchell D.R.D., and Barbeite F.G. Predictors of attitudes toward a 360-degree feedback management development activity. Journal of Occupational and Organizational Psychology 75 (2002) 87-107
103. McEnery J., and McEnery J.M. Self-rating in management training needs assessment: A neglected opportunity?. Journal of Occupational Psychology 60 (1987) 49-60
104. McFarlane Shore L., and Thornton G.C.I. Effects of gender on self- and supervisory ratings. Academy of Management Journal 29 (1986) 115-129
105. Mohyeldin A., and Suliman T. Self and supervisor ratings of performance: Evidence from an individualistic culture. Employee Relations 25 (2003) 371-388
106. Morgan R.B. Self- and co-worker perceptions of ethics and their relationships to leadership and salary. Academy of Management Journal 36 (1993) 200-214
107. Moser K., Donat M., Schuler H., Funke U., and Roloff K. Validität der Selbstbeurteilung beruflicher Leistung: Eine Untersuchung im Bereich industrieller Forschung und Entwicklung [Validity of self-assessment of work performance: A study in industrial research and development]. Zeitschrift für experimentelle und angewandte Psychologie XLI (1994) 473-499
108. Motowidlo S.J. Relationship between self-rated performance and pay satisfaction among sales representatives. Journal of Applied Psychology 67 (1982) 209-213
109. Motowidlo S.J., and Van Scotter J.R. Evidence that task performance should be distinguished from contextual performance. Journal of Applied Psychology 79 (1994) 475-480
110. Mount M.K. Psychometric properties of subordinate ratings of managerial performance. Personnel Psychology 37 (1984) 687-702
111. Mount M.K., Judge T.A., Scullen S.E., Sytsma M.R., and Hezlett S.A. Trait, rater and level effects in 360-degree performance ratings. Personnel Psychology 51 (1998) 557-576
112. Murphy K.R., and Cleveland J.N. Understanding performance appraisal. Social, organizational, and goal-based perspectives (1995), Sage, Thousand Oaks, CA
113. Murphy K.R., and Davidshofer C.O. Psychological testing: Principles and applications (2005), Prentice-Hall, Upper Saddle River, NJ
114. Murphy K.R., and DeShon R. Interrater correlations do not estimate the reliability of job performance ratings. Personnel Psychology 53 (2000) 873-900
115. Nealey S.M., and Owen T.W. A multitrait-multimethod analysis of predictors and criteria for nursing performance. Organizational Behavior and Human Performance 5 (1970) 348-365
116. Ostroff C. Training effectiveness measures and scoring schemas: A comparison. Personnel Psychology 44 (1991) 353-374
117. Ostroff C., Atwater L.E., and Feinberg B.J. Understanding self-other agreement: A look at rater and ratee characteristics, context, and outcomes. Personnel Psychology 57 (2004) 333-375
118. Parker J.W., Taylor E.K., Barrett R.S., and Martens L. Rating scale content: III. Relationship between supervisory- and self-ratings. Personnel Psychology 12 (1959) 49-63
119. Piercy F.P. Relationships among counselor effectiveness self-ratings, peer ratings, supervisor ratings, and client ratings (1974) (ERIC Document Reproduction Service No. ED 130188)
120. Porter L.W., and Lawler E.E.I. Managerial attitudes and performance (1968), Irwin, Homewood, IL
121. Prien E.P., and Liske R.E. Assessment of higher-level personnel: III. Rating criteria: A comparative analysis of supervisor ratings and incumbent self-ratings of job performance. Personnel Psychology 15 (1962) 187-194
122. Pritchard R.D., and Sanders M.S. The influence of valence, instrumentality, and expectancy on effort and performance. Journal of Applied Psychology 57 (1973) 55-66
123. Pym D.L.A., and Auld H.D. The self-rating as a measure of employee satisfactoriness. Occupational Psychology 39 (1965) 103-113
124. Ramamoorthy N., and Carroll S.J. Individualism/collectivism orientations and reactions toward alternative human resource management practices. Human Relations 51 (1998) 571-588
125. Randall R., Ferguson E., and Patterson F. Self-assessment accuracy and assessment centre decisions. Journal of Occupational and Organizational Psychology 73 (2000) 443-459
126. Rosse J.G., and Kraut A.I. Reconsidering the vertical dyad linkage model of leadership. Journal of Occupational Psychology 56 (1983) 63-71
127. Rothstein H.R. Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology 75 (1990) 322-327
128. Schlenker B.R. Impression management: The self-concept, social identity, and interpersonal relations (1980), Brooks/Cole, Belmont, CA
129. Schmidt F.L., Viswesvaran C., and Ones D.S. Reliability is not validity and validity is not reliability. Personnel Psychology 53 (2000) 901-912
130. Schmitt N., Noe R.A., and Gottschalk R. Using the lens model to magnify raters' consistency, matching, and shared bias. Academy of Management Journal 29 (1986) 130-139
131. Schrader B.W., and Steiner D.D. Common comparison standards: An approach to improving agreement between self and supervisory performance ratings. Journal of Applied Psychology 81 (1996) 813-821
132. Schuler H., Hell B., Muck P., Becker K., and Diemand A. Konzeption und Prüfung eines multidimensionalen Systems der Leistungsbeurteilung: Individualmodul [Development and evaluation of a multi-dimensional performance appraisal system: Individual level]. Zeitschrift für Personalpsychologie 1 (2003) 29-39
133. Scullen S.E., Mount M.K., and Goff M. Understanding the latent structure of job performance ratings. Journal of Applied Psychology 85 (2000) 956-970
134. Seike M., and Takata T. Cultural views of self and self-assessment behavior: Empirical findings in Japanese culture. Japanese Journal of Social Psychology 13 (1997) 23-32
135. Shapiro G.L., and Dessler G. Are self-appraisals more realistic among professionals or nonprofessionals in health care?. Public Personnel Management 14 (1985) 285-291
136. Small E.E., and Diefendorff J.M. The impact of contextual self-ratings and observer ratings of personality on the personality-performance relationship. Journal of Applied Social Psychology 36 (2006) 297-320
137. Smith P.C., and Kendall L.M. Retranslations of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology 47 (1963) 149-155
138. Smither J.W., London M., and Reilly R.R. Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings. Personnel Psychology 58 (2005) 33-66
139. Smither J.W., London M., Vasilopoulos N.L., Reilly R.R., Millsap R.E., and Salvemini N. An examination of the effects of an upward feedback program over time. Personnel Psychology 48 (1995) 1-34
140. Somers M.J., and Birnbaum D. Assessing self-appraisal of job performance as an evaluation device: Are the poor results a function of method or methodology?. Human Relations 44 (1991) 1081-1091
141. Staw B.M. Attribution of the "causes" of performance: A general alternative interpretation of cross-sectional research on organizations. Organizational Behavior and Human Performance 13 (1975) 414-432
142. Steel R.P., and Ovalle N.K.I. Self-appraisal based upon supervisory feedback. Personnel Psychology 37 (1984) 667-685
143. Strauss J.P. Multi-source perspectives of self-esteem, performance ratings, and source agreement. Journal of Managerial Psychology 20 (2005) 464-482
144. Sturman M.C., Cheramie R.A., and Cashen L.H. The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings. Journal of Applied Psychology 90 (2005) 269-283
145. Sundstrom E., Town J.P., Rice R.W., Osborn D.P., and Brill M. Office noise, satisfaction, and performance. Environment and Behavior 26 (1994) 195-222
146. Sundvik L., and Lindenman M. Acquaintanceship and the discrepancy between supervisor and self-assessments. Journal of Social Behavior and Personality 13 (1998) 117-126
147. Tetlock P.E., and Manstead A.S.R. Impression management versus intrapsychic explanations in social psychology: A useful dichotomy?. Psychological Review 92 (1985) 59-77
148. Thornton G.C. The relationship between supervisory- and self-appraisals of executive performance. Personnel Psychology 21 (1968) 441-455
149. U. S. Department of Labor. O*NET online (2008). http://online.onetcenter.org Retrieved June 2008, from http://online.onetcenter.org
150. van der Heijden B. Age and assessments of professional expertise: The relationship between higher level employees' age and self-assessments or supervisor ratings of professional expertise. International Journal of Selection and Assessment 9 (2001) 309-324
151. van der Heijden B.I., and Nijhof A.H. The value of subjectivity: Problems and prospects for 360-degree appraisal systems. International Journal of Human Resource Management 15 (2004) 493-511
152. Van Dyne L., and LePine J.A. Helping and voice extra-role behaviors: Evidence of construct and predictive validity. Academy of Management Journal 41 (1998) 108-119
153. van Hooft E.A., van der Flier H., and Minne M.R. Construct validity of multi-source performance ratings: An examination of the relationship of self-, supervisor-, and peer-ratings with cognitive and personality measures. International Journal of Selection and Assessment 14 (2006) 67-81
154. Viswesvaran C., Ones D.C., and Schmidt F.L. Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology 81 (1996) 557-574
155. Viswesvaran C., Schmidt F.L., and Ones D.C. The moderating influence of job performance dimensions on convergence of supervisory and peer ratings of job performance: Unconfounding construct-level convergence and rating difficulty. Journal of Applied Psychology 87 (2002) 345-354
156. Waldman D.A., Yammarino F.J., and Avolio B.J. A multiple level investigation of personnel ratings. Personnel Psychology 43 (1990) 811-835
157. Warr P. Logical and judgmental moderators of the criterion-related validity of personality scales. Journal of Occupational and Organizational Psychology 72 (1999) 187-204
158. Warr P., and Bourne A. Factors influencing two types of congruence in multirater judgments. Human Performance 12 (1999) 183-210
159. Warr P., and Bourne A. Associations between rating content and self-other agreement in multi-source feedback. European Journal of Work and Organizational Psychology 9 (2000) 321-334
160. Webb W.B., and Nolan C.Y. Student, supervisor, and self-ratings of instructional proficiency. Journal of Educational Psychology 46 (1955) 42-46
161. Wheeler A.E., and Knoop H.R. Self, teacher and faculty assessment of student teaching performance. Journal of Educational Research 75 (1982) 178-181
162. Wherry R.J., and Bartlett C.J. The control of bias in ratings: A theory of rating. Personnel Psychology 35 (1982) 521-551
163. Williams J.R., and Johnson M.A. Self-supervisor agreement: The influence of feedback seeking on the relationship between self and supervisor ratings of performance. Journal of Applied Social Psychology 30 (2000) 275-292
164. Williams J.R., and Levy P.E. The effects of perceived system knowledge and the agreement between self-ratings and supervisor ratings. Personnel Psychology 45 (1992) 835-847
165. Williams W.E., and Seiler D.A. Relationship between measures of effort and job performance. Journal of Applied Psychology 57 (1973) 49-54
166. Wilson A.E., and Ross M. From chump to champ: People's appraisals of their earlier and present selves. Journal of Personality and Social Psychology 80 (2001) 572-584
167. Woehr D.J., Sheehan M., and Bennett Jr. W. Assessing measurement equivalence across rating sources: A multitrait-multirater approach. Journal of Applied Psychology 90 (2005) 592-600
168. Wohlers A.J. Ratings of managerial characteristics: Evaluation difficulty, co-worker agreement, and self-awareness. Personnel Psychology 42 (1989) 235-261
169. Wohlers A.J., Hall M.J., and London M. Subordinates rating managers: Organizational and demographic correlates of self/subordinate agreement. Journal of Occupational and Organizational Psychology 66 (1993) 263-275
170. Yammarino F.J., Dubinsky A.J., and Hartley S.W. An approach for assessing individual versus group effects in performance evaluations. Journal of Occupational Psychology 60 (1987) 157-167
171. Yammarino F.J., and Waldman D.A. Performance in relation to job skill importance: A consideration of rater source. Journal of Applied Psychology 78 (1993) 242-249
172. Yu J., and Murphy K.R. Modesty bias in self-ratings of performance: A test of the cultural relativity hypothesis. Personnel Psychology 46 (1993) 357-363
173. Zempel J., and Moser K. Feedback als Moderator der Validitaet von Selbstbeurteilungen [Feedback as a moderator of the validity of self-ratings]. Zeitschrift fuer Personalpsychologie 4 (2005) 19-27