Measuring interrater agreement for ratings of a single target

Applied Psychological Measurement

Volumn 21, Issue 3, 1997, Pages 271-278

  Lindell, Michael K ^a   Brandt, Christina J ^b  

^a TEXAS A AND M UNIVERSITY   (United States)

^b NONE

Author keywords

Aggregation; Cross level analysis; Interrater agreement

Indexed keywords

EID: 0031496083     PISSN: 01466216     EISSN: None     Source Type: Journal    
DOI: 10.1177/01466216970213006     Document Type: Article

References (10)

1. Birnbaum, M. (1973). The devil rides again: Correlation as an index of fit. Psychological Bulletin, 79, 239-242.
2. Carroll, J. B. (1961). The nature of the data, or how to choose a correlation coefficient. Psychometrika, 26, 347-372.
3. Finn, R. H. (1970). A note on estimating the reliability of categorical data. Educational and Psychological Measurement, 30, 71-76.
4. James, L. R., Demaree, R. G., & Wolfe, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98.
5. James, L. R., Demaree, R. G., & Wolfe, G. (1993). rwg: An assessment of within-group interrater agreement. Journal of Applied Psychology, 78, 306-309.
6. James, L. R., & Jones, A. (1976). Organizational structure: A review of structural dimensions and their conceptual relationship with individual attitudes and behavior. Organizational Behavior and Human Performance, 16, 74-113.
7. Kozlowski, S. W. J., & Hattrup, K. (1992). A disagreement about within-group agreement: Disentangling issues of consistency versus consensus. Journal of Applied Psychology, 77, 161-167.
8. 2 index in regression models of judgment. Educational and Psychological Measurement, 38, 69-74.
9. Schmidt, F. L., & Hunter, J. E. (1989). Interrater reliability coefficients cannot be computed when only one stimulus is rated. Journal of Applied Psychology, 74, 368-370.
10. Tinsley, H. E. A., & Weiss, D. J. (1975). Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358-376.