Interrater reliability and agreement of performance ratings: A methodological comparison

Journal of Business and Psychology

Volumn 10, Issue 3, 1996, Pages 367-380

  Fleenor, John W ^a,d   Fleenor, Julie B ^b   Grossnickle, William F ^c  

^a Center for Creative Leadership

^b Learning Services Corp

^c EAST CAROLINA UNIVERSITY   (United States)

^d CENTER FOR CREATIVE LEADERSHIP   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 21344466673     PISSN: 08893268     EISSN: None     Source Type: Journal    
DOI: 10.1007/BF02249609     Document Type: Article

References (19)

1. Berry, K., & Mielke, P. (1988). A generalization of Cohen's kappa agreement measure to interval measurement and multiple raters. Educational and Psychological Measurement, 48, 921-933.
2. Berry, K., & Mielke, P. (1990). A generalized agreement measure. Educational and Psychological Measurement, 50, 123-125.
3. Campion, M., & Pursell, E. (1981). Plymouth Fiber Extraboard Validation Report. New Bern, NC: Weyerhaeuser Co.
4. Campion, M., Pursell, E., & Brown, B. (1988). Structured interviewing: Raising the psychometric properties of the employment interview. Personnel Psychology, 41, 25-42.
5. Cronbach, L. Gleser, G., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York: Wiley.
6. Ghiselli, E., Campbell, J., & Zedeck, S. (1981). Measurement theory for the behavioral sciences. San Francisco: W. H. Freeman.
7. Guilford, J., & Fruchter, B. (1978). Fundamental statistics in psychology and education. New York: McGraw Hill.
8. James, L., Demaree, R., & Wolf, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 322-327.
9. Hayes, W. (1988). Statistics. Fort Worth, TX: Holt, Rinehart and Winston.
10. Kozlowski, S., & Hattrup, K. (1992). A disagreement about within group agreement: Disentangling issues of consistency versus consensus. Journal of Applied Psychology, 77, 161-167.
11. Lawlis, F., & Lu, E. (1972). Judgment of counseling process: Reliability, agreement, and error. Psychological Bulletin, 78, 17-20.
12. Rothstein, H. (1990). Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 85-98.
13. Saal, F, Downey, R., & Lahey, M. (1980). Rating the ratings: Assessing the psychometric quality of rating data. Psychological Bulletin, 88, 413-428.
14. SAS. (1990). SAS/STAT user's guide. Vol. 2. Gary, NC: SAS Institute.
15. Schneider, B., & Schmitt, N. (1986). Staffing organizations. Glen View, II: Scott, Foresman.
16. Shrout, P., & Fleiss, J. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
17. Tinsley, H., & Weiss, D. (1975). Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358-376.
18. Tornow, W. (1993). Perceptions or reality: Is multi-perspective measurement a means or an end? Human Resource Management, 32, 221-229.
19. Winer, B. (1971). Statistical principles in experimental design (2nd ed.). New York: McGraw-Hill.