An analysis of bias in supervisor narrative comments in performance appraisal

Human Relations

Volumn 63, Issue 12, 2010, Pages 1903-1933

  Wilson, Kathlyn Y ^a  

^a DELAWARE STATE UNIVERSITY   (United States)

Author keywords

cross cultural management; ethnicity; feedback; implicit theories; performance appraisals; performance ratings; race; rating bias; stereotypes

Indexed keywords

EID: 78650298534     PISSN: 00187267     EISSN: 1741282X     Source Type: Journal    
DOI: 10.1177/0018726710369396     Document Type: Article

References (76)

1. Atwater LE, Yammarino FJ (2001) Understanding agreement in multisource feedback. In: Bracken DW, Timmreck CW, Church A (eds) The Handbook of Multisource Feedback. San Francisco, CA: Jossey-Bass, 204-220.
2. Austin JT, Villanova P. (1992) The criterion problem. Journal of Applied Psychology 77(6): 836-874.
3. Barnes-Farrell JL (2001) Performance appraisal: Person perception processes and challenges. In: London M (ed.) How People Evaluate Others in Organizations. Mahwah: NJ: LEA, 135-153.
4. Baron RA (2006) Opportunity recognition as pattern recognition: How entrepreneurs 'connect the dots' to identify new business opportunities. Academy of Management Perspectives 20(1): 104-119.
5. Bass AR, Turner, JN (1973) Ethnic group differences in relationships among criteria of job performance. Journal of Applied Psychology 57(2): 101-109.
6. Bates R. (2002) Liking and similarity as predictors of multi-source ratings. Personnel Review 31(5): 540-552.
7. Beatty RW (1973) Blacks as supervisors: A study of training, job performance, and employers' expectations. Academy of Management Journal 16(2): 196-207.
8. Bell MP, Harrison DA, and McLaughlin ME (1997) Asian American attitudes toward affirmative action in employment: Implications for the model minority myth. Journal of Applied Behavioral Science 33(3): 356-377.
9. Beugre CD (2009) Exploring the neural basis of fairness: A model of neuro-organizational justice. Organizational Behavior and Human Decision Processes 110(2): 129-139.
10. Borman WC (1983) Implications of personality theory and research for the rating of work performance in organizations. In: Landy F, Zedeck S, Cleveland J (eds) Performance Measurement and Theory. Hillsdale, NJ: LEA, 127-165.
11. Borman WC (1987) Personal constructs, performance schemata, and 'folk theories' of subordinate effectiveness: Explorations in an army officer sample. Organizational Behavior and Human Decision Processes 40(3): 307-322.
12. Brewer MB, Brown RJ (1998) Intergroup relations. In: Gilbert DT, Fiske ST, Lindzey G (eds) Handbook of Social Psychology, Vol. 2. New York: McGraw-Hill, 554-594.
13. Cardy RL, Dobbins GH (1994) Performance appraisal: The influence of liking on cognition. In: Stubbart C, Meindel JR, Porac JF (eds) Advances in Managerial Cognition and Organizational Information Processing. London: JAI Press.
14. Cascio WF, Valenzi ER (1978) Relations among criteria of police performance. Journal of Applied Psychology 63(1): 22-28.
15. Cheng C. (1997) Are Asian American employees a model minority or just a minority? Journal of Applied Behavioral Science 33(3): 277-290.
16. Coleman VI, Borman WC (2000) Investigating the underlying structure of the citizenship performance domain. Human Resources Management Review 10(1): 25-44.
17. Crocker J., Major B. (1989) Social stigma and self-esteem: The self-protective properties of stigma. Psychological Review 96(4): 608-630.
18. Davidson MJ (1995) Living in a bicultural world - The role conflicts racing the black ethnic minority woman manager. International Review of Women and Leadership 1(1): 22-36.
19. Devine PG, Elliot AJ (1995) Are racial stereotypes really fading? The Princeton trilogy revisited. Personality and Social Psychology Bulletin 21(11): 1139-1150.
20. Dewberry C. (2001) Performance disparities between whites and ethnic minorities: Real differences or assessment bias? Journal of Occupational and Organizational Psychology 74(5): 659-673.
21. Dipboye RL (1985) Some neglected variables in research on discrimination in appraisals. Academy of Management Review 10(1): 116-127.
22. Ensher EA, Murphy SE (1997) Effects of race, gender, perceived similarity, and contact on mentor relationships. Journal of Vocational Behavior 50(3): 460-481.
23. Feild HS, Bayley GA, and Bayley SM (1977) Employment test validation for minority and nonminority production workers. Personnel Psychology 30: 37-46.
24. Feldman JM (1981) Beyond attribution theory: Cognitive processes in performance appraisal. Journal of Applied Psychology 66(2): 127-148.
25. Ferris GR, Judge TA, Rowland KM, and Fitzgibbons DE (1994) Subordinate influence and the performance evaluation process: Test of a model. Organizational Behavior and Human Decision Processes 58(1): 101-135.
26. Ford JK, Schechtman SL, and Kraiger K. (1986) Study of race effects in objective indices and subjective evaluations of performance: A meta-analysis of performance criteria. Psychological Bulletin 99(3): 330-337.
27. Geddes D., Konrad AM (2003) Demographic differences and reactions to performance feedback. Human Relations 56(12): 1485-1513.
28. Guion RM (1983) Comments on Hunter. In: Landy F, Zedeck S, and Cleveland J (eds) Performance Measurement and Theory. Hillsdale, NJ: Erlbaum, 267-275.
29. Harrison DA, Price KH, and Bell MP (1998) Beyond relational demography: Time and the effect of surface-versus deep-level diversity on group cohesiveness. Academy of Management Journal 41: 96-107.
30. Hattrup K., O'Connell MS, and Wingate PH (1998) Prediction of multidimensional criteria: Distinguishing task and contextual performance. Human Performance 11(4): 305-319.
31. Hauenstein NMA (1998) Training raters to increase the accuracy of appraisals and the usefulness of feedback. In: Smither JW (ed.) Performance Appraisal: State of the Art in Practice. San Francisco, CA: Jossey-Bass, 404-442.
32. Hauenstein NMA, Sinclair AL, Robson V., Quintella Y., and Donovan JJ (2002) Ratee race effects in performance: Task performance versus contextual performance. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, Toronto, Canada.
33. Heath A., Cheung S. (2006) Ethnic penalties in the labour market: Employers and discrimination. Research Report No. 341, Department for Work and Pensions, London.
34. Hickman, C. (1997) The devil and the one drop rule: Racial categories, African Americans, and the U.S. census. Michigan Law Review 95(5): 1161-1265.
35. Hunter JE (1983) A causal analysis of cognitive ability, job knowledge, job performance and supervisor ratings. In: Landy FJ, Zedeck S, Cleveland J (eds) Performance Measurement and Theory. Hillsdale, NJ: Erlbaum, 257-266.
36. Jackson SE, Brett JF, Sessa VI, Cooper DM, Julin JA, and Peyronnin K. (1991) Some differences make a difference: Individual dissimilarity and group heterogeneity as correlates of recruitment, promotions, and turnover. Journal of Applied Psychology 76(5): 675-689.
37. Jenkins R. (1988) Discrimination and equal opportunity in employment: Ethnicity and 'race' in the United Kingdom. In: Gallie D (ed.) Employment in Britain. Oxford: Basil Blackwell, 310-344.
38. Johnson JW (2001) The relative importance of task and contextual performance dimensions to supervisor judgments of overall performance. Journal of Applied Psychology 86(5): 984-996.
39. Jones T. (1993) Britain's Ethnic Minorities: An Analysis of the Labour Force Survey. London: Policy Studies Institute.
40. Klimoski RJ, Donahue L. (2001) Person perception in organizations: An overview of the field. In: London M (ed.) How People Evaluate Others in Organizations. Mahwah: NJ: LEA, 5-43.
41. Kolodinsky RW, Treadway DC, and Ferris GR (2007) Political skills and influence effectiveness: testing portions of an expanded Ferris and Judge (1991) model. Human Relations 60(12): 1747-1777.
42. Kraiger K., Ford JK (1985) A meta-analysis of ratee race effects in performance ratings. Journal of Applied Psychology 70(1): 56-65.
43. Kraiger K., Ford JK (1990) The relation of job knowledge, job performance, and supervisory ratings as a function of ratee race. Human Performance 3(4): 269-279.
44. Krippendorff K. (1980) Content Analysis: An Introduction to its Methodology. Newbury Park, CA: SAGE.
45. Lefkowitz J. (2000) The role of interpersonal affective regard in supervisory performance ratings: A literature review and proposed causal model. Journal of Occupational and Organizational Psychology 73(1): 67-85.
46. Lefkowitz J., Batista M. (1995) Potential sources of criterion bias in supervisor ratings used for test validation. Journal of Business and Psychology 9(4): 389-414.
47. Lieberman MD (2007) Social cognitive neuroscience: A review of core processes. Annual Review of Psychology 58(1): 259-289.
48. McKay PF, McDaniel MA (2006) A re-examination of black-white mean differences in work performance: More data, more moderators. Journal of Applied Psychology 91(3): 538-554.
49. Mount MK, Scullen SE (2001) Multisource feedback ratings: What do they actually measure? In: London M (ed.) How People Evaluate Others in Organizations. Mahwah, NJ: Lawrence Erlbaum Associates, 155-176.
50. Murphy KR, Cleveland JN (1995) Understanding Performance Appraisal: Social, Organizational, and Goal-Based Perspectives. Thousand Oaks, CA: SAGE.
51. Myers JL, Well AD (2003) Research Design and Statistical Analysis. Mahwah, NJ: Lawrence Erlbaum Associates.
52. Nkomo SM (1992) The emperor has no clothes - rewriting race in organizations. Academy Of Management Review 17(3): 487-513.
53. Noon M. (1999) Racial discrimination in speculative applications: Evidence from the UK's top 100 firms. Human Resource Management Journal 3(4): 35-47.
54. Ogbonna E., Harris LC (2006) The dynamics of employee relationships in an ethnically diverse workforce. Human Relations 59(3): 379-407.
55. Olson CL (1976) On choosing a test statistic in multivariate analysis of variance. Psychological Bulletin 83(4): 579-586.
56. Oppler SH, Campbell JP, Pulakos ED, and Borman WC (1992) Three approaches to the investigation of subgroup bias in performance measurement: Review, results, and conclusions. Journal of Applied Psychology 77(2): 201-217.
57. Oyserman D., Sakamoto I. (1997) Being Asian American: Identity, cultural constructs, and stereotype perception. Journal of Applied Behavioral Science 33(4): 435-453.
58. Pettigrew TF (1979) The ultimate attribution error: Extending Allport's cognitive analysis of prejudice. Personality and Social Psychology Bulletin 5(4): 461-476.
59. Pulakos ED, White LA, Oppler SH, and Borman WC (1989) Examination of race and sex effects on performance ratings. Journal of Applied Psychology 74(5): 770-780.
60. Ree MJ, Earles JA (1991) Predicting training success: Not much more than g. Personnel Psychology 44: 321-332.
61. Roth PL, Huffcutt AI, and Bobko P. (2003) Ethnic group differences in measures of job performance: A new meta-analysis. Journal of Applied Psychology 88(4): 694-706.
62. Ryan GW, Bernard HR (2000) Data management and analysis methods. In: Denzin NK, Lincoln YS (eds) Handbook of Qualitative Research. Thousand Oaks, CA: SAGE, 769-802.
63. Sackett PR, DuBois CLZ (1991) Rater-ratee race effects on performance evaluation: Challenging meta-analytic conclusions. Journal of Applied Psychology 76(6): 873-877.
64. Sackett PR, DuBois CLZ, and Noe, AW (1991) Tokenism in performance evaluation: The effects of work group representation on male-female and white-black differences in performance ratings. Journal of Applied Psychology 76(2): 263-267.
65. Schmidt FL (2002) The role of general cognitive ability and job performance: Why there cannot be a debate. Human Performance 15(1/2): 187-210.
66. Schmidt FL, Hunter JE (1981) Employment testing: Old theories and new research. American Psychologist 36(10): 1128-1137.
67. Schmidt FL, Hunter JE (1992) Development of a causal model of processes determining job performance. Current Directions in Psychological Science 1: 89-92.
68. Schmitt N., Noe R. (1986) Personnel selection and equal employment opportunity. In: Cooper CL, Robertson I (eds) International Review of Industrial and Organizational Psychology. New York: Wiley, 71-115.
69. Stauffer JM, Buckley MR (2005) The existence and nature of racial bias in supervisory ratings. Journal of Applied Psychology 90(3): 586-591.
70. Tajfel H., Turner JC (1985) The social identity theory of intergroup behavior. In: Worchel S, Austin WG (eds) Handbook of Industrial and Organizational Psychology. Palo Alto, CA: Consulting Psychologists Press, 769-827.
71. Taylor SE (1982) The availability bias in social perception and interaction. In: Kahneman D, Slovic P, Tversky A (eds) Judgment Under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press, 190-200.
72. Taylor SE, Fiske ST (1978) Salience, attention, and attribution: Top of the head phenomena. In: Berkowitz L (ed.) Advances in Experimental Social Psychology. New York: Academic Press, 250-289.
73. Tsui AS, O'Reilly CA (1989) Beyond simple demographic effects: The importance of relational demography in superior-subordinate dyads. Academy of Management Journal 32(2): 402-423. Turner JC (1987) Rediscovering the Social Group: A Self-Categorization Theory. Oxford: Blackwell.
74. Waldman DA, Avolio BJ (1991) Race effects in performance evaluations: Controlling for ability, education, and experience. Journal of Applied Psychology 76(6): 897-901.
75. Williams K., O'Reilly C. (1998) Demography and diversity in organizations: A review of 40 years of research. In: Staw B, Cummings L (eds) Research in Organizational Behavior, vol. 20. Greenwich, CT: JAI Press, 77-140.
76. Yammarino FJ, Atwater LE (1997) Do managers see themselves as others see them? Implications for self-other rating agreement for human resource management. Organizational Dynamics 25(4): 35-44.