Incentives and alternative rating approaches: Roads to greater accuracy in job performance assessment?

Journal of Personnel Psychology

Volumn 11, Issue 4, 2012, Pages 159-168

  Jelley, R Blake ^a   Goffin, Richard D ^b   Powell, Deborah M ^c   Heneman, Robert L ^d  

^a UNIVERSITY OF PRINCE EDWARD ISLAND   (Canada)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

^c UNIVERSITY OF GUELPH   (Canada)

^d OHIO STATE UNIVERSITY   (United States)

Author keywords

Incentive; Motivation; Performance appraisal; Personnel evaluation; Rating

Indexed keywords

EID: 84871788489     PISSN: 18665888     EISSN: 21905150     Source Type: Journal    
DOI: 10.1027/1866-5888/a000068     Document Type: Article

References (42)

1. Alba, J. W., & Hasher, L. (1983). Is memory schematic? Psychological Bulletin, 93, 203-231.
2. Benson, P. G. Buckley, M. R., & Hall, S. (1988). The impact of rating scale format on rater accuracy: An evaluation of the mixed standard scale. Journal of Management, 14, 415-423.
3. Bommer, W. H., Johnson, J. L., Rich, G. A., Podsakoff, P. M., & MacKenzie, S. B. (1995). On the interchangeability of objective and subjective measures of employee performance: A meta-analysis. Personnel Psychology, 48, 587-605.
4. Borman, W. C. (1977). Consistency of rating accuracy and rating errors in the judgment of human performance. Organizational Behavior and Human Performance, 20, 238-252.
5. Brtek, M. D., & Motowidlo, S. J. (2002). Effects of procedure and outcome accountability on interview validity. Journal of Applied Psychology, 87, 185-191.
6. Buunk, A. P., & Gibbons, F. X. (2007). Social comparison: The end of a theory and the emergence of a field. Organizational Behavior and Human Decision Processes, 102, 3-21.
7. Cardy, R. L., & Dobbins, G. H. (1994). Performance appraisal: Alternative perspectives. Cincinnati, OH: South-Western.
8. Cronbach, L. J. (1955). Processes affecting scores on "understanding of others" and "assumed similarity". Psychological Bulletin, 52, 177-193.
9. DeNisi, A. S. (1996). A cognitive approach to performance appraisal: A program of research. New York, NY: Routledge.
10. DeNisi, A. S., & Gonzalez, J. A. (2000). Design performance appraisal systems to improve performance. In E. A. Locke (Ed.), Blackwell Handbook of Principles of Organizational Behavior (pp. 60-72). Oxford, UK: Blackwell.
11. DeNisi, A. S., & Peters, L. H. (1996). Organization of information in memory and the performance appraisal process: Evidence from the field. Journal of Applied Psychology, 81, 717-737.
12. DeNisi, A. S. Robbins, T., & Cafferty, T. P. (1989). Organization of information used for performance appraisals: Role of diary-keeping. Journal of Applied Psychology, 74, 124-129.
13. Dominick, P. G. (2009). Forced rankings: Pros, cons, and practices. In J. W. Smither & M. London (Eds.), Performance management: Putting research into action (pp. 411-443). San Francisco, CA: Jossey-Bass.
14. Farr, J. L., & Jacobs, R. (2006). Trust us: New perspectives on performance appraisal. In W. Bennett Jr., C. E. Lance, & D. J. Woehr (Eds.), Performance measurement: Current perspectives and future challenges (pp. 321-337). Mahwah, NJ: Erlbaum.
15. Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). GPower 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175-191.
16. Goffin, R. D., Gellatly, I. R., Paunonen, S. V., Jackson, D. N., & Meyer, J. P. (1996). Criterion validation of two approaches to performance appraisal: The behavioral observation scale and the relative percentile method. Journal of Business and Psychology, 11, 23-33.
17. Goffin, R. D., Jelley, R. B., Powell, D. M., & Johnston, N. G. (2009). Taking advantage of social comparisons in performance appraisal: The Relative Percentile Method. Human Resource Management, 48, 251-268.
18. Goffin, R. D., & Olson, J. M. (2011). Is it all relative? Comparative judgments and the possible improvement of self-ratings and ratings of others. Perspectives in Psychological Science, 6, 48-60.
19. Harris, M. M., Ispas, D., & Schmidt, G. F. (2008). Inaccurate performance ratings are a reflection of larger organizational issues. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 190-193.
20. Hastie, R., & Park, B. (1986). The relationship between memory and judgment depends on whether the judgment task is memory-based or on-line. Psychological Review, 93, 258-268.
21. Heneman, R. L. (1986). The relationship between supervisory ratings and results-oriented measures of performance: A meta-analysis. Personnel Psychology, 39, 811-826.
22. Jelley, R. B., & Goffin, R. D. (2001). Can performance-feedback accuracy be improved? Effects of rater priming and rating- scale format on rating accuracy. Journal of Applied Psychology, 86, 134-144.
23. Jenkins, G. D. Jr., Mitra, A., Gupta, N., & Shaw, J. D. (1998). Are financial incentives related to performance? A meta-analytic review of empirical research. Journal of Applied Psychology, 83, 777-787.
24. Kane, J. S., & Woehr, D. J. (2006). Performance measurement reconsidered: An examination of frequency estimation as a basis for performance assessment. In W. Bennett Jr., C. E. Lance, & D. J. Woehr (Eds.), Performance measurement: Current perspectives and future challenges (pp. 77-110). Mahwah, NJ: Erlbaum.
25. Landy, F. J., & Farr, J. L. (1980). Performance rating. Psychological Bulletin, 87, 72-107.
26. Latham, G. P., & Wexley, K. N. (1977). Behavioral observation scales for performance appraisal purposes. Personnel Psychology, 30, 255-268.
27. Latham, G. P., & Wexley, K. N. (1994). Increasing productivity through performance appraisal (2nd ed.). Reading, MA: Addison-Wesley.
28. Lord, R. G., & Mäher, K. J. (1991). Cognitive theory in industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 1-62). Palo Alto, CA: Consulting Psychologists Press.
29. McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46.
30. Melchers, K. G., Henggeier, C., & Kleinmann, M. (2007). Do within-dimension ratings in assessment centers really lead to improved construct validity? A meta-analytic reassessment. Zeitschrift für Personalpsychologie, 6, 141-149.
31. Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: Sage.
32. Murray, H. G. (1991). Effective teaching behaviors in the college classroom. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 7, pp. 135-172). New York, NY: Agathon.
33. Nathan, B. R., & Alexander, R. A. (1988). A comparison of criteria for test validation: A meta-analytic investigation. Personnel Psychology, 41, 517-535.
34. Roch, S. G., Sternburgh, A. M., & Caputo, P. M. (2007). Absolute vs relative performance rating formats: Implications for fairness and organizational justice. International Journal of Selection and Assessment, 15, 302-316.
35. Salvemini, N. J., Reilly, R. R., & Smither, J. W. (1993). The influence of rater motivation on assimilation effects and accuracy in performance ratings. Organizational Behavior and Human Decision Processes, 55, 41-60.
36. Sanchez, J. I., & De La Torre, P. (1996). A second look at the relationship between rating and behavioral accuracy in performance appraisal. Journal of Applied Psychology, 81, 3-10.
37. Smither, J. W., Bany, S. R., & Reilly, R. R. (1989). An investigation of the validity of expert true score estimates in appraisal research. Journal of Applied Psychology, 74, 143-151.
38. Sulsky, L. M., & Balzer, W. K. (1988). Meaning and measurement of performance rating accuracy: Some methodological and theoretical concerns. Journal of Applied Psychology, 73, 497-506.
39. Wagner, S. H., & Goffin, R. D. (1997). Differences in accuracy of absolute and comparative performance appraisal methods. Organizational Behavior and Human Decision Processes, 70, 95-103.
40. Wiersma, U., & Latham, G. P. (1986). The practicality of behavioral observation scales, behavioral expectation scales, and trait scales. Personnel Psychology, 39, 619-628.
41. Williams, K. J., Cafferty, T. P., & DeNisi, A. S. (1990). The effect of performance appraisal salience on recall and ratings. Organizational Behavior and Human Decision Processes, 46, 217-239.
42. Woehr, D. J., & Feldman, J. (1993). Processing objective and question order effects on the causal relation between memory and judgment in performance appraisal: The tip of the iceberg. Journal of Applied Psychology, 78, 232-241.