Rating level and accuracy as a function of rater personality

International Journal of Selection and Assessment

Volumn 17, Issue 3, 2009, Pages 300-310

  Bernardin, H John ^a   Tyler, Catherine L ^b   Villanova, Peter ^c  

^a FLORIDA ATLANTIC UNIVERSITY   (United States)

^b OAKLAND UNIVERSITY   (United States)

^c APPALACHIAN STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 68949136567     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2009.00472.x     Document Type: Article

References (51)

1. Barrick, M.R., Mount, M.K. Judge, T.A. (2001) Personality and Performance at the Beginning of the New Millennium: What do we know and where do we need to go next? International Journal of Selection and Assessment, 9, 9 30.
2. Benson, M.J. Campbell, J.P. (2007) To Be, or Not to Be, Linear: An expanded representation of personality and its relationship to leadership performance. International Journal of Selection and Assessment, 15, 232 249.
3. Bernardin, H.J. (2007) Human Resource Management: An experiential approach. New York : McGraw-Hill.
4. Bernardin, H.J. Villanova, P. (2005) Research Streams in Rater Self-Efficacy. Group & Organization Management, 30, 61 88.
5. Bernardin, H.J., Villanova, P. Cooke, D. (2000) Conscientiousness and Agreeableness as Predictors of Rating Leniency. Journal of Applied Psychology, 85, 232 236.
6. Bobko, P. (1986) A Solution to Some Dilemmas When Testing Hypotheses About Ordinal Interactions. Journal of Applied Psychology, 71, 323 326.
7. Borman, W.C. (1977) Consistency of Rating Accuracy and Rating Errors in the Judgement of Human Performance. Organizational Behavior and Human Performance, 20, 238 252.
8. Borman, W.C. Hallam, G.L. (1991) Observation Accuracy for Assessors of Work-Sample Performance: Consistency across task and individual-differences correlates. Journal of Applied Psychology, 76, 11 18.
9. Cascio, W.F. Aguinis, H. (2005) Applied Psychology in Human Resource Management. Upper Saddle River, NJ : Prentice Hall.
10. Chapman, B.P. (2007) Bandwidth and Fidelity on the NEO-Five Factor Inventory: Replicability and reliability of Saucier's (1998) item cluster subcomponents. Journal of Personality Assessment, 88, 220 234.
11. Costa, P.T. McCrae, R.R. (1992) Revised NEO Personality Inventory and the NEO Five-Factor Inventory. Odessa, FL : Psychological Assessment Resources.
12. Dudley, N.M., Orvis, K.A., Lebiecki, J.E. Cortina, J.M. (2006) A Meta-Analytic Investigation of Conscientiousness in the Prediction of Job Performance: Examining the intercorrelations and the incremental validity of narrow traits. Journal of Applied Psychology, 91, 40 57.
13. Frink, D. Ferris, G. (1999) The Moderating Effect of Accountability on the Conscientiousness-Performance Relationship. Journal of Business and Psychology, 13, 515 524.
14. Frink, D. Klimoski, R. (1998) Toward a Theory of Accountability in Organizations and Human Resources Management. Research in Personnel and Human Resources Management, 16, 1 51.
15. Guilford, J.P. (1954) Psychometric Methods. New York : McGraw-Hill.
16. Harris, M.M. (1994) Rater Motivation in the Performance Appraisal Context: A theoretical framework. Journal of Management, 20, 737 756.
17. Hauenstein, N.M.A. (1992) An Information Processing Approach to Leniency in Performance Judgments. Journal of Applied Psychology, 77, 485 493.
18. Hoyt, W.T. (2000) Rater Bias in Psychological Research: When is it a problem and what can we do about it? Psychological Methods, 5, 64 86.
19. Jawahar, I.M. (2001) Attitudes, Self-Monitoring, and Appraisal Behaviors. Journal of Applied Psychology, 86, 875 883.
20. Jawahar, I.M. Williams, C.R. (1997) Where All the Children are Above Average: The performance appraisal purpose effect. Personnel Psychology, 50, 905 925.
21. Jensen-Campbell, L.A., Knack, J.M., Waldrip, A.M. Campbell, S.D. (2007) Do Big Five Personality Traits Associated with Self-Control Influence the Regulation of Anger and Aggression? Journal of Research in Personality, 41, 403 424.
22. Kane, J.S., Bernardin, H.J., Villanova, P. Peyrefitte, J. (1995) The Stability of Rater Leniency: Three studies. Academy of Management Journal, 38, 1036 1051.
23. Kneeland, N. (1929) That Lenient Tendency in Rating. Personnel Journal, 7, 356 366.
24. LaHuis, D.M Avis, J.M. (2007) Using Multilevel Random Coefficient Modeling to Investigate Rater Effects in Performance Ratings. Organizational Research Methods, 10, 97 107.
25. Lerner, J.S. Tetlock, P.E. (1999) Accounting for the Effects of Accountability. Psychological Bulletin, 125, 255 275.
26. Levy, P.E. Williams, J.R. (2004) The Social Context of Performance Appraisal: A review and framework for the future. Journal of Management, 30, 881 905.
27. Meier, B.P., Robinson, M.D. Wilkowski, B.M. (2006) Turning the Other Cheek: Agreeableness and the regulation of aggression-related primes. Psychological Science, 17, 136 142.
28. Mero, N.P., Guidice, R.M. Anna, A.L. (2006) The Interacting Effects of Accountability and Individual Differences on Rater Response to a Performance-Rating Task. Journal of Applied Social Psychology, 36, 795 819.
29. Mero, N.P., Guidice, R.M. Brownlee, A.L. (2007) Accountability in a Performance Appraisal Context: The effect of audience and form of accounting on rater response and behavior. Journal of Management, 33, 223 252.
30. Mero, N.P. Motowidlo, S.J. (1995) Effects of Rater Accountability on the Accuracy and the Favorability of Performance Ratings. Journal of Applied Psychology, 80, 517 524.
31. Mero, N.P., Motowidlo, S.J. Anna, A. (2003) Effects of Rater Accountability on Rating Behavior and Rater Accuracy. Journal of Applied Social Psychology, 33, 2493 2514.
32. Murphy, K.R. Cleveland, J.N. (1995) Understanding Performance Evaluation: Social, organizational, and goal-based perspectives. Thousand Oaks, CA : Sage Publications.
33. Paunonen, S.V. Ashton, M.C. (2001) Big Five Factors and Facets and the Prediction of Behavior. Journal of Personality and Social Psychology, 81, 524 539.
34. Roch, S.G., Ayman, R., Newhouse, N. Harris, M. (2006) Effect of Identifiability, Rating Audience, and Conscientiousness on Rating Level. International Journal of Selection and Assessment, 13, 53 62.
35. Sackett, P. Lievens, F. (2008) Personnel Selection. Annual Review of Psychology, 59, 419 450.
36. Saucier, G. (1998) Replicable Item-Cluster Subcomponents in the NEO Five-Factor Inventory. Journal of Personality Assessment, 70, 263 276.
37. Saucier, G. Ostendorf, F. (1999) Hierarchical Subcomponents of the Big Five Personality Factors: A cross-language replication. Journal of Personality and Social Psychology, 76, 613 627.
38. Schlenker, B.R., Britt, T.W., Pennington, J., Murphy, R. Doherty, K. (1994) The Triangle Model of Responsibility. Psychological Review, 101, 632 652.
39. Stauffer, J.M. Buckley, M.R. (2005) Evaluating the Existence and Nature of Racial Bias in Supervisory Ratings. Journal of Applied Psychology, 90, 586 591.
40. Tetlock, P.E. (1992) The Impact of Accountability on Judgment and Choice: Toward a social contingency model. In : Zanna, M.P. (ed.), Advances in Experimental Social Psychology, Vol. 25 (pp. 331 377). San Diego, CA : Academic Press.
41. Tetlock, P.E., Skitka, L. Boettger, R. (1989) Social and Cognitive Strategies for Coping with Accountability: Conformity, complexity, and bolstering. Journal of Personality and Social Psychology, 57, 632 640.
42. Tziner, A., Murphy, K.R. Cleveland, J. (2002) Does Conscientiousness Moderate the Relationship Between Attitudes and Beliefs Regarding Performance Appraisal and Rating Behavior? International Journal of Selection and Assessment, 10, 218 224.
43. Tziner, A., Murphy, K.R. Cleveland, J.N. (2003) Personality Moderates the Relationship Between Context Factors and Rating Behavior. In : Shohov, S.P. (ed.), Advances in Research Psychology, Vol. 22. New York : Nova, pp. 107 120.
44. Tziner, A., Murphy, K.R. Cleveland, J.N. (2005) Contextual and Rater Factors Affecting Rating Behavior. Group & Organization Management, 30, 89 98.
45. Villanova, P., Bernardin, H.J., Dahmus, S.A. Sims, R.L. (1993) Rater Leniency and Performance Appraisal Discomfort. Educational and Psychological Measurement, 53, 789 799.
46. Waung, M. Highhouse, S. (1997) Fear of Conflict and Empathic Buffering: Two explanations for the inflation of performance feedback. Organizational Behavior and Human Decision Processes, 71, 37 54.
47. Wilkowski, B.M., Robinson, M.D. Meier, B.P. (2006) Agreeableness and the Prolonged Spatial Processing of Antisocial and Prosocial Information. Journal of Research in Personality, 40, 1152 1168.
48. Witt, L.A., Burke, L.A., Barrick, M.R. Mount, M.K. (2002) The Interactive Effects of Conscientiousness and Agreeableness on Job Performance. Journal of Applied Psychology, 87, 164 169.
49. Witt, L.A. Ferris, G.R. (2003) Social Skill as Moderator of the Conscientiousness-Performance Relationship: Convergent results across four studies. Journal of Applied Psychology, 88, 809 820.
50. Wright, J.C. Mischel, W. (1987) A Conditional Approach to Dispositional Constructs: The local predictability of social behavior. Journal of Personality and Social Psychology, 53, 1159 1277.
51. Yun, G.J., Donahue, L.M., Dudley, N.M. McFarland, L.A. (2005) Rater Personality, Rating Format, and Social Context: Implications for performance appraisal ratings. International Journal of Selection and Assessment, 13, 97 107.