Frame of reference rater training issues: recall, time and behavior observation training

International Journal of Training and Development

Volumn 7, Issue 2, 2003, Pages 93-107

  Roch, Sylvia G ^a   O'Sullivan, Brian J ^b  

^a STATE UNIVERSITY OF NEW YORK   (United States)

^b ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 65349165581     PISSN: 13603736     EISSN: 14682419     Source Type: Journal    
DOI: 10.1111/1468-2419.00174     Document Type: Article

References (59)

1. Athey, T. R. and McIntyre, R. M. (1987), ‘Effect of Rater Training on Rater Accuracy: Levels-of-Processing Theory and Social Facilitation Theory Perspectives’, Journal of Applied Psychology, 72, 567–572.
2. Bernardin, H. J. and Buckley, R. M. (1981), ‘Strategies in Rater Training’, Academy of Management Review, 6, 205–212.
3. Bernardin, H. J. and Pence, E. C. (1980), ‘Effects of Rater Training: Creating New Response Sets and Decreasing Accuracy’, Journal of Applied Psychology, 65, 60–66.
4. Brewer, M. B. (1988), ‘A Dual Process Model of Impression Formation’. In R. S. Wyer and T. K. Scrull (eds), Advances in Social Cognition (Hillsdale, NJ: Erlbaum), pp. 1–36.
5. Cantor, N. and Mischel, W. (1977), ‘Traits as Prototypes: Effects on Recognition Memory’, Journal of Personality and Social Psychology, 35, 38–48.
6. Cleveland, J. N., Murphy, K. R. and Williams, R. E. (1989), ‘Multiple Uses of Performance Appraisal: Prevalence and Correlates’, Journal of Applied Psychology, 74, 1, 130–135.
7. Cohen, J. (1988), Statistical Power Analysis for the Behavioral Sciences, 2nd edn (Hillsdale, NJ: Lawrence Erlbaum Associates).
8. Cronbach, L. (1955), ‘Processes Affecting Scores on “Understanding of Others” and “Assumed Similarity” ’, Psychological Bulletin, 52, 177–193.
9. Day, D. V. and Sulsky, L. M. (1995), ‘Effects of Frame-of-reference Training and Information Configuration on Memory Organization and Rating Accuracy’, Journal of Applied Psychology, 80, 158–169.
10. Dipboye, R. L. (1990), ‘Laboratory vs. Field Research in Industrial and Organizational Psychology’, in C. L. Cooper and I. T. Robertson (eds), International Review of Industrial and Organizational Psychology 5 (John Wiley), pp. 1–34.
11. Feldman, J. M. (1981), ‘Beyond Attribution Theory: Cognitive Processes in Performance Appraisal’, Journal of Applied Psychology, 66, 127–148.
12. Fiske, S. T. (1995), Social Cognition, in A. Tesser (ed.), Advanced Social Psychology (New York, NY: McGraw-Hill), pp. 149–194.
13. Fiske, S. T. and Neuberg, S. L. (1990), ‘A Continuum of Impression Formation, from Category-based to Individuating Process: Influences of Information and Motivation on Attention and Interpretation’, Advances in Experimental Social Psychology, 23, 1–73.
14. Fiske, S. T. and Taylor, S. E. (1984), Social Cognition (Reading, MA: Addison-Wesley).
15. Folger, R. and Konovsky, M. A. (1989), ‘Effects of Procedural and Distributive Justice on Reactions to Pay Raise Decisions’, Academy of Management Journal, 32, 1, 115–130.
16. Hamiliton, D. L. and Trolier, T. K. (1986), ‘Stereotypes and Stereotyping: An Overview of the Cognitive Approach’, in J. F. Dovidio and S. L. Gaertner (eds), Prejudice, Discrimination and Racism (Orlando, FL: Academic), pp. 127–163.
17. Hastie, R. and Kumar, P. (1979), ‘Person Memory: Personality Traits as Organizing Principles in Memory for Behaviors’, Journal of Personality and Social Psychology, 37, 25–38.
18. Hauenstein, N. M. A. and Foti, R. J. (1989), ‘From Laboratory to Practice: Neglected Issues in Implementing Frame-of-reference Training’, Personnel Psychology, 42, 359–378.
19. Hedge, J. W. and Kavanagh, M. J. (1988), ‘Improving the Accuracy of Performance Evaluations: Comparison of Three Methods of Performance Appraiser Training’, Journal of Applied Psychology, 73, 1, 68–73.
20. Heneman, R. L. (1988), ‘Traits, Behaviours, and Rater Training: Some Unexpected Results’, Human Performance, 1, 85–98.
21. Heneman, R. L. and Wexley, K. N. (1983), ‘The Effects of Time Delay in Rating and Amount of Information Observed on Performance Rating Accuracy’, Academy of Management Journal, 26, 677–686.
22. Ilgen, D. R. and Feldman, J. M. (1983), ‘Performance Appraisal: A Process Focus’, Research in Organizational Behavior, 5, 141–197.
23. Ivancevich, J. M. (1979), ‘Longitudinal Study of the Effects of Rater Training on Psychometric Errors in Rating’, Journal of Applied Psychology, 64, 502–508.
24. Latham, G. P. and Wexley, K. N. (1994), Increasing Productivity through Performance Appraisal, 2nd edn (Menlo Park, CA: Addison-Wesley).
25. Longenecker, C. O., Sims, H. P. and Gioia, D. A. (1987), ‘Behind the Mask: The Politics of Employee Appraisal’, Academy of Management Executive, 1, 3, 183–193.
26. Lord, R. G. (1985), ‘An Information Processing Approach to Social Perception, Leadership and Behavioral Measurement in Organizations’, in B. Staw and L. Cummings (eds), Research in Organizational Behavior, vol. 7 (Greenwich, CT: JAI Press).
27. McCauley, D. P., Jago, I. A., Gore, B., Lance, C. E., Quarles, F. K., Sledge, L., Pate, J. L., Logan, A. L. and Guest, F. D. (1990), ‘The Development of More Ecologically Valid Videotapes for Use in Performance Appraisal Research’, paper presented at the annual meeting of the Southeastern Psychological Association, Atlanta, GA.
28. McFarlin, D. B. and Sweeney, P. D. (1992), ‘Distributive and Procedural Justice as Predictors of Satisfaction with Personal and Organizational Outcomes’, Academy of Management Journal, 35, 3, 626–63.
29. McIntyre, R. M., Smith, D. and Hassett, C. E. (1984), ‘Accuracy of Performance Ratings as Affected by Rater Training and Perceived Purpose of Ratings’, Journal of Applied Psychology, 69, 147–156.
30. Moorman, R. H. (1991), ‘Relationship between Organizational Justice and Organizational Citizenship Behaviors: Do Fairness Perceptions Influence Employee Citizenship?’ Journal of Applied Psychology, 76, 845–855.
31. Murphy, K. R. (1991), ‘Criterion Issues in Performance Appraisal Research: Behavioral Accuracy versus Classification Accuracy’, Organizational Behavior and Human Decision Processes, 50, 45– 50.
32. Murphy, K. R. and Cleveland, J. N. (1995), Understanding Performance Appraisal: Social, Organizational, and Goal-based Perspectives (Thousand Oaks, CA: Sage).
33. Murphy, K. R., Philbin, T. A. and Adams, S. R. (1989), ‘Effect of Purpose of Observation on Accuracy of Immediate and Delayed Performance Ratings’, Organizational Behavior and Human Decision Processes, 43, 336–354.
34. Nathan, B. R. and Lord, R. G. (1983), ‘Cognitive Categorization and Dimensional Schemata: A Process Approach to the Study of Halo in Performance Ratings’, Journal of Applied Psychology, 68, 102–114.
35. Niehoff, B. P. and Moorman, R. H. (1993), ‘Justice as a Mediator of the Relationship between Methods of Monitoring and Organizational Citizenship Behavior’, Academy of Management Journal, 36, 527–556.
36. Noble, S. A. (1997), ‘Effect of a Time Delay on Frame-of-reference Training’, paper presented at the 12th annual conference for the Society of Industrial and Organizational Psychology, St. Louis, MO.
37. Noonan, L. E. and Sulsky, L. M. (2001), ‘Impact of Frame-of-reference and Behavioral Observation Training on Alternative Training Effectiveness Criteria in a Canadian Military Sample’, Human Performance, 14, 1, 3–26.
38. Pelly, D. A. and Doessett, D. L. (1991), ‘The Effects of Rater Training Strategies on Rating Accuracy’, paper presented at the 6th annual meeting of the Society for Industrial and Organizational Psychology, St. Louis, MO.
39. Pulakos, E. D. (1986), ‘The Development of Training Programs to Increase Accuracy with Different Rating Tasks’, Organizational Behavior and Human Decision Processes, 38, 76–91.
40. Rosch, E. (1978), ‘Principles of Categorization’, in E. Rosch and B. B. Lloyd (eds), Cognition and Categorization (Hillsdale, NJ: Erlbaum), pp. 27–48.
41. Sanchez, J. I. and De La Torre, P. (1996), ‘A Second Look at the Relationship Between Rating and Behavioral Accuracy in Performance Appraisal’, Journal of Applied Psychology, 81, 1, 3–10.
42. Schleicher, D. J. and Day, D. V. (1998), ‘A Cognitive Evaluation of Frame-of-reference Rater Training: Content and Process Issues’, Organizational Behavior and Human Decision Processes, 73, 1, 76–101.pmid/9705795
43. Schleicher, D. J., Mayes, B. T., Day, D. V. and Riggio, R. E. (2002), ‘A New Frame for Frame-of-reference Training: Enhancing the Construct Validity of Assessment Centers’, Journal of Applied Psychology, 87, 4, 735–746.pmid/12184577
44. Smither, J. W. and Reilly, R. R. (1987), ‘True Intercorrelations Among Job Components, Time Delay in Rating, and Rater Intelligence as Determinants of Accuracy in Performance Ratings’, Organizational Behavior and Human Decision Processes, 40, 369–391.
45. Spool, M. D. (1978), ‘Training Programs for Observers of Behavior: a Review’, Personnel Psychology, 31, 853–887.
46. Spychalski, A. C., Quinones, M. A., Gaugler, B. B. and Pohley, K. (1997), ‘A Survey of Assessment Center Practices in Organizations in the United States’, Personnel Psychology, 50, 1, 71–90.
47. Stamoulis, D. T. and Hauenstein, N. M. A. (1993), ‘Rater Training and Rating Accuracy: Training for Dimensional Accuracy versus Training for Ratee Differentiation’, Journal of Applied Psychology, 78, 994–1003.
48. Sulsky, L. M. and Balzer, W. K. (1988), ‘Meaning and Measurement of Performance Rating Accuracy: Some Methodological and Theoretical Concerns’, Journal of Applied Psychology, 73, 497–506.
49. Sulsky, L. M. and Day, D. V. (1992), ‘Frame-of-reference Training and Cognitive Categorization: An Empirical Investigation of Rater Memory Issues’, Journal of Applied Psychology, 77, 501–510.pmid/1512184
50. Sulsky, L. M. and Day, D. V. (1994), ‘Effects of Frame-of-reference Training on Rater Accuracy under Alternative Time Delays’, Journal of Applied Psychology, 79, 535–543.
51. Tang, T. L. and Sarsfield-Baldwin, L. J. (1996), ‘Distributive and Procedural Justice as Related to Satisfaction and Commitment’, S.A.M. Advanced Management Journal, 61, 3, 25–32.
52. Task Force on Assessment Center Guidelines (1989), ‘Guidelines and Ethical Considerations for Assessment Center Operations’, Public Personnel Management, 18, 457–470.pmid/11652914
53. Thornton, G. C. and Zorich, S. (1980), ‘Training to Improve Observer Accuracy’, Journal of Applied Psychology, 65, 351–354.
54. Werner, J. M. and Bolino, M. C. (1997), ‘Explaining U.S. Courts of Appeals Decisions Involving Performance Appraisal: Accuracy, Fairness, and Validation’, Personnel Psychology, 50, 1, 1–24.
55. Woehr, D. J. (1994), ‘Understanding Frame-of-reference Training: The Impact of Training on the Recall of Performance Information’, Journal of Applied Psychology, 79, 525–534.
56. Woehr, D. J. and Feldman, J. M. (1993), ‘Processing Objective and Question Order Effects on the Casual Relation Between Memory and Judgment in Performance Appraisal: the Tip of the Iceberg’, Journal of Applied Psychology, 78, 232–241.
57. Woehr, D. J. and Huffcutt, A. I. (1994), ‘Rater Training for Performance Appraisal: a Quantitative Review’, Journal of Occupational and Organizational Psychology, 67, 189–205.
58. Wyer, R. S., Jr. and Scrull, T. K. (1986), ‘Category Accessibility: Some Theoretical and Empirical Issues Concerning the Processing of Social Stimulus Information’, in E. T. Higgins, C. P. Herman and M. P. Zanna (eds), Social cognition: the Ontario Symposium on Personality and Social Psychology (Hillsdale, NJ: Lawrence Erlbaum).
59. Zuckerman, H., Hodgins, H. S., Zuckerman, A. and Rosenthal, R. (1993), ‘Contemporary Issues in the Analysis of Data: A Survey of 551 Psychologists’, Psychological Science, 4, 1, 49–53.