The Roles of Rater Goals and Ratee Performance Levels in the Distortion of Performance Ratings

Journal of Applied Psychology

Volumn 95, Issue 3, 2010, Pages 546-561

  Wang, Xiaoye May ^a   Wong, Kin Fai Ellick ^a   Kwong, Jessica Y Y ^b  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Leniency; Performance appraisal; Performance evaluation; Performance level; Rater goals

Indexed keywords

ADULT; ARTICLE; FEMALE; HUMAN; MALE; MOTIVATION; PERSONNEL MANAGEMENT; QUESTIONNAIRE;

EMPLOYEE PERFORMANCE APPRAISAL; FEMALE; GOALS; HUMANS; MALE; QUESTIONNAIRES; YOUNG ADULT;

EID: 77954787267     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0018866     Document Type: Article

References (48)

1. Adams J.S. Inequity in social exchange. Advances in experimental social psychology 1965, 2:267-299. Academic Press, New York, NY. L. Berkowitz (Ed.).
2. Ambady N., Rosenthal R. Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. Journal of Personality and Social Psychology 1993, 64:431-441.
3. Bandura A. Self-efficacy: The exercise of control 1997, Freeman and Company, New York, NY.
4. Bandura A., Locke E.A. Negative self-efficacy and goal effects revisited. Journal of Applied Psychology 2003, 88:87-99.
5. Brockner J., Wiesenfeld B.M., Martin C.L. Decision frame, procedural justice, and survivors' reactions to job layoffs. Organizational Behavior and Human Decision Processes 1995, 63:59-68.
6. Bryk A.S., Raudenbush S.W. Hierarchical linear models: Applications and data analysis methods 1992, Sage, Thousand Oaks, CA.
7. Burke M.J., Dunlap W.P. Estimating interrater agreement with the average deviation index: A user's guide. Organizational Research Methods 2002, 5:159-172.
8. Burke M.J., Finkelstein L.M., Dusig M.S. On average deviation indices for estimating interrater agreement. Organizational Research Methods 1999, 2:49-68.
9. Cardy R.L., Dobbins G.H. Affect and appraisal accuracy: Liking as an integral dimension in evaluating performance. Journal of Applied Psychology 1986, 71:672-678.
10. Cardy R.L., Kehoe J.F. Rater selective attention ability and appraisal effectiveness: The effect of a cognitive style on the accuracy of differentiation among ratees. Journal of Applied Psychology 1984, 69:589-594.
11. Carver C.S., Scheier M.F. On the self-regulation of behavior 1998, Cambridge University Press, New York, NY.
12. Cleveland J.N., Murphy K.R. Analyzing performance appraisal as goal-directed behavior. Research in Personnel and Human Resources Management 1992, 10:121-185.
13. Cohen J., Cohen P., West L.S., Aiken S.G. Applied multiple regression/correlation analysis for the behavioral sciences 2003, Erlbaum, Mahwah, NJ. 3rd ed.
14. Cronbach L.J. Processes affecting scores on understanding of others and assumed similarity. Psychological Bulletin 1955, 52:177-193.
15. DeNisi A.S. A cognitive approach to performance appraisal: A program of research 1996, Routledge, New York, NY.
16. Deutsch M. Equity, equality, and need: What determines which value will be used as the basis of distributive justice. Journal of Social Issues 1975, 31:137-149.
17. Deutsch M. Distributive justice: A social-psychological perspective 1985, Yale University Press, New Haven, CT.
18. Fiske S.T., Neuberg S.L. A continuum of impression formation, from category-based to individuating processes: Influences of information and motivation on attention and interpretation. Advances in Experimental Social Psychology 1990, 23:1-74.
19. Gaugler B.B., Rudolph A.S. The influence of assessee performance variation on assessor's judgments. Personnel Psychology 1992, 45:77-98.
20. Härtel C.E.J. Rating format research revisited: Format effectiveness and acceptability depend on rater characteristics. Journal of Applied Psychology 1993, 78:212-217.
21. Highhouse S. Context-dependent selection: The effects of decoy and phantom job candidates. Organizational Behavior and Human Decision Processes 1996, 65:68-76.
22. Hofmann D.A., Gavin M.B. Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management 1998, 24:623-641.
23. Kluger A.N., DeNisi A. The effects of feedback interventions of performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin 1996, 119:254-284.
24. Kruglanski A.W. The psychology of being " right": The problem of accuracy in social perception and cognition. Psychological Review 1989, 106:395-409.
25. Lance C.E., LaPointe J.A., Stewart A.M. A test of the context dependency of three causal models of halo rater error. Journal of Applied Psychology 1994, 79:332-340.
26. Leventhal G.S., Michaels J.W., Sanford C. Inequity and interpersonal conflict: Reward allocation and secrecy about reward as methods of preventing conflict. Journal of Personality and Social Psychology 1972, 23:88-102.
27. Marin G. Perceiving justice across cultures: Equity vs. equality in Colombia and in the United States. International Journal of Psychology 1981, 16:153-159.
28. Maurer T.J., Alexander R.A. Contrast effects in behavioral measurement: An investigation of alternative process explanations. Journal of Applied Psychology 1991, 76:3-10.
29. Meindl J.R. Managing to be fair: An exploration of values, motives, and leadership. Administrative Science Quarterly 1989, 34:252-276.
30. Molm L.D., Takahashi N., Peterson G. In the eye of the beholder: Procedural justice in social exchange. American Sociological Review 2003, 68:128-152.
31. Murphy K.R. Rating accuracy. Blackwell Encyclopedic Dictionary of Human Resource Management 2005, 9:1-310.
32. Murphy K.R., Balzer W.K. Systematic distortions in memory-based behavior ratings and performance evaluations: Consequences for rating accuracy. Journal of Applied Psychology 1986, 71:39-44.
33. Murphy K.R., Cleveland J.N. Performance appraisal: An organization perspective 1991, Allyn & Bacon, Boston, MA.
34. Murphy K.R., Cleveland J.N. Understanding performance appraisal: Social, organizational, and goal-based perspectives 1995, Sage, Thousand Oaks, CA.
35. Murphy K., Cleveland J., Skattebo A., Kinney T. Raters who pursue different goals give different ratings. Journal of Applied Psychology 2004, 89:158-164.
36. Ng S. Intergroup allocation bias before and after group discussion. The Journal of Social Psychology 1984, 124:95-103.
37. Powers W.T. Behavior: The control of perception 1973, Aldine, Chicago, IL.
38. Raudenbush S.W., Bryk A.S. Hierarchical linear models: Applications and data analysis methods 2002, Sage, Thousand Oaks, CA.
39. Seligman M.E.P. Helplessness: On depression development and death 1975, Freeman, San Francisco, CA.
40. Simonson I., Kramer T., Young M.J. Effect propensity. Organizational Behavior and Human Decision Processes 2004, 95:156-174.
41. Slaughter J.E., Sinar E.F., Highhouse S. Decoy effects and attribute-level inferences. Journal of Applied Psychology 1999, 84:823-828.
42. Vancouver J.B., Thompson C.M., Tischner E.C., Putka D.J. Two studies examining the negative effect of self-efficacy on performance. Journal of Applied Psychology 2002, 87:506-516.
43. Vroom V.H. Work and motivation 1964, Wiley, New York, NY.
44. Wexley K.N. Importance of contrast effects in employment interviews. Journal of Applied Psychology 1972, 56:45-48.
45. Wexley K.N., Sanders R.E., Yukl G.A. Training interviewers to eliminate contrast effects in employment interviews. Journal of Applied Psychology 1973, 57:233-236.
46. Wexley K.N., Yukl G.A., Kovacs S.Z., Sanders R.E. Importance of contrast effects in employment interviews. Journal of Applied Psychology 1972, 56:45-48.
47. Wong K.F.E., Kwong J.Y.Y. Between-individual comparisons in performance evaluation: A perspective from prospect theory. Journal of Applied Psychology 2005, 90:284-294.
48. Wong K.F.E., Kwong J.Y.Y. Effects of rater goal on rating patterns: Evidence from an experimental field study. Journal of Applied Psychology 2007, 92:577-585.