Understanding self-other agreement: A look at rater and ratee characteristics, context, and outcomes

Personnel Psychology

Volumn 57, Issue 2, 2004, Pages 333-375

  Ostroff, Cheri ^a   Atwater, Leanne E ^b   Feinberg, Barbara J ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b ARIZONA STATE UNIVERSITY WEST   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 3042734111     PISSN: 00315826     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2004.tb02494.x     Document Type: Article

References (90)

1. Ashford SJ. (1986). The role of information seeking in individual adaptation: A resource perspective. Academy of Management Journal, 29, 465-487.
2. Ashford SJ. (1989). Self-assessments in organizations: A literature review and integrative model. In Cummings LL, Staw BM (Eds.), Research in organizational behavior (Vol. 11, pp. 133-174). Greenwich, CT: JAI Press.
3. Ashford SE. (1993). The feedback environment: An exploratory study of cue use. Journal of Organizational Behavior, 14, 201-224.
4. Ashforth BE, Mael FA. (1989). Social identity theory and the organization. Academy of Management Review, 14, 20-39.
5. Atwater LE, Ostroff C, Yammarino FJ, Fleenor JW. (1998). Self-other rating agreement: Does it really matter? PERSONNEL PSYCHOLOGY, 51, 577-597.
6. Atwater LE, Roush P, Fischthal A. (1995). The influence of upward feedback on self- and follower ratings of leadership. PERSONNEL PSYCHOLOGY, 48, 35-59.
7. Atwater LE, Yammarino FJ. (1997). Self-other rating agreement: A review and model. Research in Personnel and Human Resources Management, 15, 141-164.
8. Bass BM, Yammarino FJ. (1991). Congruence of self and others' leadership ratings of naval officers for understanding successful performance. Applied Psychology: An International Review, 40, 437-454.
9. Berger J, Fisek M, Norman R. (1998). The evolution of status expectations: A theoretical extension. In Berger J, Zelditch M Jr (Eds.), Status, power and legitimacy: Strategies and theories (pp. 175-205). New Brunswick, NJ: Transaction.
10. Borman WC, White LA, Dorsey DW. (1995). Effects of ratee task performance and interpersonal factors on supervisor and peer performance ratings. Journal of Applied Psychology, 80, 168-177.
11. Bracken D, Paul K. (1993, April). The effects of scale type and demographics on upward feed-back. Paper presented at the 14th Annual Conference of the Society for Industrial and Organizational Psychology, San Francisco.
12. Bracken D, Timmreck C, Church A. (2001). Handbook of multisource feedback. San Francisco: Jossey-Bass.
13. Brutus S, Fleenor JW, London M. (1998). Does 360-degree feedback work in different industries? A between-industry comparison of the reliability and validity of multi-source performance ratings. Journal of Management Development, 17, 177-190.
14. Brutus S, Fleenor JW, McCauley CD. (1999). Demographic and personality predictors of congruence in multisource ratings. Journal of Management Development, 18, 417-435.
15. Business: Be a man. (2003, June). The Economist, 367, 8330, 90.
16. Butler D, Geis FL. (1990). Nonverbal affect responses to male and female leaders: Implications for leadership evaluations. Journal of Personality and Social Psychology, 58, 48-59.
17. Byrne D, Clore GL, Smeaton G. (1986). The attraction hypothesis: Do similar attitudes affect anything? Journal of Personality and Social Psychology, 51, 1167-1170.
18. Church AH. (1997). Managerial self-awareness in high-performing individuals in organizations. Journal of Applied Psychology, 82, 281-292.
19. Church AH, Rogelberg SG, Waclawski J. (2000). Since when is no news good news? The relationship between performance and response rates in multirater feedback. PERSONNEL PSYCHOLOGY, 53, 435-451.
20. Church AH, Waclawski J. (2001). Hold the line: An examination of line vs. staff differences. Human Resource Management, 40, 21-34.
21. Coleman LM, Jussim L, Isaak JL. (1991). Black students' reactions to feedback conveyed by White and Black teachers. Journal of Applied Social Psychology, 21, 460-481.
22. Crosby F, Clayton S. (1990). Affirmative action and the issue of expectancies. Journal of Social Issues, 46, 61-79.
23. Eagly AH, Karau SJ, Makhijani MG. (1995). Gender and the effectiveness of leaders: A meta-analysis. Psychological Bulletin 117, 125-145.
24. Edwards JR. (1994). The study of congruence in organizational behavior research: Critique and proposed alternative. Organizational Behavior and Human Decision Processes, 58, 51-100.
25. Edwards JR. (1995). Alternatives to difference scores as dependent variables in the study of congruence in organizational research. Organizational Behavior and Human Decision Processes, 64, 307-324.
26. Edwards JR, Parry ME. (1993). On the use of polynomial regression equations as an alternative to difference scores in organizational research. Academy of Management Journal, 36, 1577-1613.
27. Erkut S. (1983). Exploring sex differences in expectancy attribution and academic achievement. Sex Roles, 9, 217-231.
28. Ferris GR, Judge TA, Rowland KM, Fitzgibbons DE. (1994). Subordinate influence and the performance evaluation process: Test of a model. Organizational Behavior and Human Decision Processes, 58, 101-135.
29. Ferris GR, Yates VL, Gilmore DC, Rowland KM. (1985). The influence of subordinate age on performance ratings and causal attributions. PERSONNEL PSYCHOLOGY, 38, 545-557.
30. Fleenor JW, McCauley CD, Brutus S. (1996). Self-other rating agreement and leader effectiveness. Leadership Quarterly, 7, 487-506.
31. Fletcher C. (1997). Self-awareness - A neglected attribute in selection and assessment. International Journal of Selection and Assessment, 5(3), 183-187.
32. Fletcher C, Baldry C. (2000). A study of individual differences and self-awareness in the context of multisource feedback. Journal of Occupational and Organizational Psychology, 73, 303-319.
33. Fletcher C, Kerslake C. (1992). The impact of assessment centers and their outcomes on participants' self-assessments. Human Relations, 45, 281-289.
34. Furnham A, Stringfield P. (1994). Congruence of self and subordinate ratings of managerial practices as a correlate of supervisor evaluation. Journal of Occupational and Organizational Psychology, 67, 57-67.
35. Gallup Report. (2001, April). Who's the preferred boss? Sales and Marketing Management, 70, Bill Communications, Inc.
36. Harris MM, Schaubroeck J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. PERSONNEL PSYCHOLOGY, 41, 43-61.
37. Harrison DA, Price KH, Bell MP. (1998). Beyond relational demography: Time and effects of surface- and deep-level diversity on work group cohesion. Academy of Management Journal, 41, 96-107.
38. Heilman ME, Block CJ, Martell RF, Simon MC. (1989). Has anything changed? Current characterizations of men, women, and managers. Journal of Applied Psychology, 74, 935-942.
39. R technical summary. Minneapolis, MM: Personnel Decisions International.
40. Ilgen DR, Youtz M. (1986). Factors affecting the evaluation and development of minorities in organizations. In Rowland KM, Ferris GR (Eds.), Research in personnel and human resources management (Vol. 4, pp. 307-337). Greenwich, CT: JAI Press.
41. Jackson SE, Brett JF, Sessa V, Cooper D, Julin J, Peyronnin K. (1991). Some differences make a difference: Individual dissimilarity and group heterogeneity as correlates of recruitment, promotions and turnover. Journal of Applied Psychology, 76, 675-689.
42. Johnson JW, Ferstl KL. (1999). The effects of interrater and self-other agreement on performance improvement following upward feedback. PERSONNEL PSYCHOLOGY, 52, 271-303.
43. Kaplan R, Drath W, Kofodimos J. (1985). High hurdles: The challenge of executive self-development. Academy of Management Executive, 3, 195-205.
44. Kingston PW, Hubbard R, Lapp B, Schroeder P, Wilson J. (2003). Why education matters. Sociology of Education, 76, 53-70.
45. Kraiger K, Ford JK. (1985). A meta-analysis of ratee race effects in performance ratings. Journal of Applied Psychology, 70, 56-65.
46. Lawrence BS. (1988). New wrinkles in the theory of age: Demography, norms, and performance ratings. Academy of Management Journal, 31, 309-337.
47. Lindeman M, Sundvik L, Rouhiainen P. (1995). Under or overestimation of self? Person variables and self-assessment accuracy in work settings. Journal of Social Behavior and Personality, 10, 123-134.
48. London M, Smither JW. (1995). Can multisource feedback change perceptions of goal accomplishment, self-evaluations, and performance-related outcomes? Theory-based applications and directions for research. PERSONNEL PSYCHOLOGY, 48, 803-839.
49. London M, Wohlers AJ. (1991). Agreement between subordinate and self-ratings in upward feedback. PERSONNEL PSYCHOLOGY, 44, 375-389.
50. Mabe PA, West SG. (1982). Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology, 67, 280-296.
51. McCall M, Lombardo M. (1983). Off the track: Why and how successful executives get derailed (Technical Report No. 21). Greensboro, NC: Center for Creative Leadership.
52. Nydegger R. (1975). Developmental changes in moral reasoning. Dissertation Abstracts International, 32, 4109A. (University Microfilms No. 72-03, 831)
53. Ostroff C, Atwater LE. (2003). Does who you associate with matter? Effects of referent group gender and age composition on managers' compensation. Journal of Applied Psychology, 88, 725-740.
54. Pazy A. (1986). The persistence of pro-male bias despite identical information regarding causes of success. Organizational Behavior and Human Decision Processes, 38, 366-377.
55. Perry EL. (1997). A cognitive approach to understanding discrimination: A closer look at applicant gender and age. Research in Personnel and Human Resources Management, 15, 175-240.
56. Perry EL, Kulik CT, Zhou J. (1999). A closer look at the effects of subordinate-supervisor age differences. Journal of Organizational Behavior, 20, 341-357.
57. Powell GN, Butterfield DA. (2002). Exploring the influence of decision makers' race and gender on actual promotions to top management. PERSONNEL PSYCHOLOGY, 55, 397-428.
58. Quinones MA, Ford JK, Teachout MS. (1995). The relationship between work experience and job performance: A conceptual and meta-analytic review. PERSONNEL PSYCHOLOGY, 48, 887-910.
59. Riordin CM. (2001). Relational demography within groups: Past developments, contradictions, and new directions. In Ferris G (Ed.), Research in Personnel and Human Resource Management. Greenwich, CT: JAI Press.
60. Riordin CM, Shore LM. (1997). Demographic diversity and employee attitudes: An empirical examination of relational demography within work units. Journal of Applied Psychology, 82, 342-358.
61. Roberson L, Block CJ. (2001). Racioethnicity and job performance: A review and critique of theoretical perspectives on the causes of group differences. Research in Organizational Behavior, 23, 247-325.
62. Roberts TA, Nolen-Hoeksema S. (1989). Sex differences in reactions to evaluative feed-back. Sex Roles, 21, 725-747.
63. Roberts TA, Nolen-Hoeksema S. (1994). Gender comparisons in responsiveness to others' evaluations in achievement settings. Psychology of Women Quarterly, 18, 221-240.
64. Rosen B, Jerdee TH. (1988). Managing older workers' careers. Research in Personnel and Human Resources Management, 6, 37-74.
65. Rosenbaum ME. (1986). The repulsion hypothesis: On the nondevelopment of relationships. Journal of Personality and Social Psychology, 51, 1156-1166.
66. Roush P, Atwater L. (1992). Using the MBTI to understand transformational leadership and self-perception accuracy. Military Psychology, 4, 17-34.
67. Ruble DN, Flett GL. (1988). Conflicting goals in self-evaluative information seeking: Developmental ability level analysis. Child Development, 59, 97-106.
68. Ryan AM, Brutus S, Greguras GJ, Hakel MD. (2000). Receptivity to assessment-based feedback for management development. Journal of Management Development, 194, 252-276.
69. Ryan AM, Ployhart RE. (2003). Customer service behavior. In Borman WC, Ilgen DR, Klimoski RJ (Eds.), Handbook of Psychology, (Vol. 12, pp. 377-397). NY: Wiley.
70. Sackett PR, DuBois CLZ. (1991). Rater-ratee race effects on performance evaluation: Challenging meta analytic conclusions. Journal of Applied Psychology, 76(6), 873-877.
71. Sackett PR, DuBois CLZ, Noe AW (1991). Tokenism in performance evaluation: The effects of work group representation on male-female and White-Black differences in performance ratings. Journal of Applied Psychology, 76, 263-267.
72. Shrauger JS, Schoeneman TJ. (1979). Symbolic interactionist view of self-concept: Through the looking glass darkly. Psychological Bulletin, 86, 549-573.
73. Scullen SE. (1997). When ratings from one source have been averaged, but ratings from another source have not: Problems and solutions. Journal of Applied Psychology, 82, 880-888.
74. Shimanoff S, Jenkins M. (1991). Leadership and gender: Challenging assumptions and recognizing resources. In Cathcart RS, Samovar L (Eds.), Small group communication: A reader (6th ed., pp. 504-522), Dubuque, IA: William C. Brown.
75. Smither JW, London M, Vasilopoulos ML, Reilly RR, Millsap RE, Salvemini N. (1995). An examination of the effects of an upward feedback program over time. PERSONNEL PSYCHOLOGY, 48, 1-34.
76. Tajfel H, Turner J. (1986). The social identity theory of intergroup behavior. In Worchel S, Austin WG (Eds.), Psychology of intergroup relations, 2nd ed. (pp. 7-24). Chicago: Nelson-Hall.
77. Taylor SE, Brown JD. (1988). Illusion and well-being: A social psychological perspective on mental health. Psychological Bulletin, 103, 193-210.
78. Tsui AS, Egan TD, O'Reilly CA. (1992). Being different: Relational demography and organizational attachment. Administrative Science Quarterly, 37, 549-579.
79. Tsui AS, Gutek BA. (1999). Demographic difference in organizations: Current research and future directions. Lanham, MD: Lexington Books.
80. Tsui AS, Ohlott PJ. (1988). Multiple assessment of managerial effectiveness: Interrater agreement and consensus in effectiveness models. PERSONNEL PSYCHOLOGY, 41, 779-803.
81. Tsui AS, O'Reilly CA. (1989). Beyond simple demographic effects: The importance of relational demography in superior-subordinate dyads. Academy of Management Journal, 32, 402-423.
82. Twenge JM, Crocker J. (2002). Race and self-esteem: Meta-analyses comparing Whites, Blacks, Hispanics, Asians, and American Indians and comment on Gray-Little and Hafdahl. Psychological Bulletin, 128, 371-408.
83. U.S. Federal Glass Ceiling Commission. (1995), A solid investment: Making full use of the nation's human capital. Washington, D.C.
84. Van Velsor E, Ruderman M, Philips A. (1991, April). Enhancing self-objectivity and performance on the job: The developmental impact of feedback. Paper presented at the 6th Annual Conference of the Society for Industrial and Organizational Psychology, St. Louis, MO.
85. Van Velsor E, Taylor S, Leslie JB. (1993). An examination of the relationships between self-perception accuracy, self-awareness, gender and leader effectiveness. Human Resource Management, 32, 249-264.
86. Varma A, Stroh LK. (2001). The impact of same-sex LMX dyads on performance evaluations. Human Resource Management, 40(4), 309-320.
87. Vollmer F. (1986). Why do men have higher expectancy than women? Sex Roles, 14, 351-362.
88. Walker AG, Smither JW. (1999). A five-year study of upward feedback: What managers do with their results matters. PERSONNEL PSYCHOLOGY, 52, 393-423.
89. Wohlers AJ, Hall MJ, London M. (1993). Subordinates rating managers: Organizational and biographic correlates of self/subordinate agreement. Journal of Occupational and Organizational Psychology, 66, 263-275.
90. Wohlers AJ, London M. (1989) Ratings of managerial characteristics: Evaluation difficulty, coworker agreement, and self-awareness. PERSONNEL PSYCHOLOGY, 42, 235-261.