Accuracy and Its Determinants in Distributional Assessment

Human Performance

Volumn 13, Issue 1, 2000, Pages 47-84

  Kane, Jeffrey S ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034388338     PISSN: 08959285     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15327043HUP1301_3     Document Type: Article

References (52)

1. Alba, J. W., Chromiak, W., Hasher, L., & Attig, M. S. (1980). Automatic encoding of category size information. Journal of Experimental Psychology: Human Learning and Memory, 6, 370-378.
2. Anderson, N. H. (1981). Foundations of information integration theory. New York: Academic.
3. Beach, L. R., & Scopp, T. S. (1968). Intuitive statistical inferences about variances. Organizational Behavior and Human Performance, 3, 109-123.
4. Bernardin, H. J., & Buckley, M. R. (1984). Strategies in rater training. Academy of Management Review, 6, 205-215.
5. Birnbaum, I. M., Taylor, T. H., Johnson, M. K., & Raye, C. L. (1987). Is event frequency encoded automatically? The case of alcohol intoxication. Journal of Experimental Psychology: Learning, Memory, and Cognition, 13, 251-258.
6. Borman, W. C. (1977). Consistency of rating accuracy and rating errors in the judgment of human performance. Organizational Behavior and Human Performance, 20, 238-252.
7. Borman, W. C. (1983). Implications of personality theory and research for the rating of work performance in organizations. In F. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory (pp. 127-165). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
8. Brooks, J. E. (1985). Judgment of category frequency. American Journal of Psychology, 98, 363-372.
9. Budescu, D. V., & Wallsten, T. S. (1985). Consistency in interpretation of probabilistic phrases. Organizational Behavior and Human Decision Processes, 36, 391-405.
10. Carroll, J. B. (1971). Measurement properties of subjective magnitude estimates of word frequency. Journal of Verbal Learning and Verbal Behavior, 10, 722-729.
11. Cohen, J. (1988). Statistical power for the behavioral sciences (2nd. ed.). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
12. Cronbach, L. J. (1955). Processes affecting scores on "understanding of others" and "assumed similarity." Psychological Bulletin, 52, 177-193.
13. Deadrick, D. L., & Gardner, D. G. (1997). Distributional ratings of performance levels and variability. Group & Organization Management, 22, 317-342.
14. Flexser, A. J., & Bower, G. H. (1975). Further evidence regarding instructional effects on frequency judgments. Bulletin of the Psychonomic Society, 6, 321-324.
15. Freund, J. S., & Hasher, L. (1989). Judgments of category size: Now you have them, now you don't. American Journal of Psychology, 102, 333-352.
16. Greene, R. L. (1986). Effects of intentionality and strategy on memory for frequency. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12, 489-495.
17. Greene, R. L. (1988). Generation effects of frequency judgment. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 298-304.
18. Hakel, M. D. (1968). How often is often? American Psychologist, 23, 533-534.
19. Hasher, L., & Zacks, R. T. (1984). Automatic processing of fundamental information: The case of frequency of occurrence. American Psychologist, 12, 1372-1388.
20. Hastie, R., & Park, B. (1986). The relationship between memory and judgment depends on whether the judgment task is memory-based or on-line. Psychological Review, 93, 258-268.
21. Hauenstein, N. M. A., & Foti, R. J. (1989). From laboratory to practice: Neglected issues in implementing Frame-of-Reference rater training. Personnel Psychology, 42, 359-378.
22. Hintzman, D. L. (1976). Repetition and memory. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 10, pp. 47-91). San Francisco: Academic.
23. Hintzman, D. L., & Stern, L. D. (1978). Contextual variability and memory for frequency. Journal of Experimental Psychology: Human Learning and Memory, 4, 539-549.
24. Howell, W. C. (1973). Storage of events and event frequencies: A comparison of two paradigms in memory. Journal of Experimental Psychology, 98, 260-263.
25. Jako, R. A., & Murphy, K. R. (1990). Distributional ratings, judgmental decomposition, and their impact on interrater agreement and rating accuracy. Journal of Applied Psychology, 75, 500-505.
26. Jonides, J., & Jones, C. (1992). Direct coding for frequency of occurrence. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 368-378.
27. Jonides, J., & Naveh-Benjamin, M. (1987). Estimating frequency of occurrence. Journal of Experimental Psychology, 13, 230-240.
28. Kane, J. S. (1986). Performance distribution assessment. In R. A. Berk (Ed.), Performance assessment: Methods and applications (pp. 237-273). Baltimore: Johns Hopkins University Press.
29. Kane, J. S. (1996). The conceptualization and representation of total performance effectiveness. Human Resource Management Review, 6, 123-145.
30. Kane, J. S. (1997). Assessment of the situational and individual components of job performance. Human Performance, 10, 193-226.
31. Kane, J. S., & Woehr, D. J. (in press). Performance measurement reconsidered: An examination of frequency estimation as a basis for assessment. In D. J. Woehr, W. Bennett, & C. Vance (Eds.), Performance measurement: Current perspectives and future challenges. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
32. Lathrop, R. G. (1967). Perceived variability. Journal of Experimental Psychology, 73, 498-502.
33. Levin, I. P. (1976). Processing of deviant information in inference and descriptive tasks with simultaneous and serial presentation. Organized Behavior and Human Performance, 15, 195-211.
34. Lichtenstein, S., Slovic, P., Fischoff, B., Layman, M., & Combs, B. (1978). Judged frequency of lethal events. Journal of Experimental Psychology: Human Learning and Memory, 4, 551-578.
35. Lovie, P. (1978). Teaching intuitive statistics II: Aiding the estimation of standard deviations. International Journal of Mathematical, Educational, and Scientific Technology, 9, 213-219.
36. Lovie, P., & Lovie, A. D. (1976). Teaching intuitive statistics I: Estimating means and variances. International Journal of Mathematical, Educational, and Scientific Technology, 7, 29-39.
37. Manis, M., Shedler, J., Jonides, J., & Nelson, T. E. (1993). Availability heuristic in judgments of set size and frequency of occurrence. Journal of Personality and Social Psychology, 65, 448-457.
38. Murphy, K. R., Balzer, W. K., Kellam, K. L., & Armstrong, J. G. (1984). Effects of the purpose of rating on accuracy in observing teacher behavior and evaluating teaching performance. Journal of Educational Psychology, 76, 45-54.
39. Murphy, K. R., Martin, C., & Garcia, M. (1982). Do behavioral observation scales measure observation? Journal of Applied Psychology, 65, 562-567.
40. Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
41. Pepper, S., & Prytulak, L. S. (1974). Sometimes frequently means seldom: Context effects in the interpretation of quantitative expressions. Journal of Research in Personality, 8, 95-101.
42. Reichardt, C. S., Shaughnessy, J. J., & Zimmerman, J. (1973). On the independence of judged frequencies for items presented in successive lists. Memory & Cognition, 1, 149-156.
43. Rose, E. J., & Rowe, R. J. (1976). Effects of orienting task, spacing or repetitions, and list context on judgments of frequency. Memory and Cognition, 5, 505-512.
44. Sackett, P. R., Zedeck, S., & Fogli, L. (1988). Relations between measures of typical and maximum performance. Journal of Applied Psychology, 73, 482-486.
45. Slamecka, N. J., & Graf, P. (1978). The generation effect: Delineation of a phenomenon. Journal of Experimental Psychology: Human Learning & Memory, 4, 592-604.
46. Smith, D. E. (1986). Training programs for performance appraisal. Academy of Management Review, 11, 22-40.
47. Steiner, D. D., Rain, J. S., & Smalley, M. M. (1993). Distributional ratings of performance: Further examination of a new rating format. Journal of Applied Psychology, 78, 438-442.
48. Sulsky, L. M., & Balzer, W. K. (1988). Meaning and measurement of performance rating accuracy: Some methodological and theoretical concerns. Journal of Applied Psychology, 73, 497-506.
49. Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131.
50. Underwood, B. J. (1969). Attributes of memory. Psychological Review, 76, 559-573.
51. Woehr, D. J., & Miller, M. J. (1997). Distributional ratings of performance: More evidence for a new rating format. Journal of Management, 23, 705-720.
52. Zuroff, D. C. (1989). Judgments of frequency of social stimuli: How schematic is person memory? Journal of Personality and Social Psychology, 56, 890-898.