Creating comparability among reliability coefficients: The case of Cronbach alpha and Cohen kappa

Psychological Reports

Volumn 87, Issue 3 PART 2, 2000, Pages 1171-1182

  Becker, Gilbert ^a  

^a UNIVERSITY OF WINNIPEG   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; MATHEMATICAL COMPUTING; PSYCHOLOGIC TEST; PSYCHOMETRY; REPRODUCIBILITY; STATISTICS;

HUMANS; MATHEMATICAL COMPUTING; PSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 0034568541     PISSN: 00332941     EISSN: 1558691X     Source Type: Journal    
DOI: 10.2466/pr0.87.7.1171-1182     Document Type: Article

References (24)

1. ALLEN, M. J. & YEN, W. M. (1979) Introduction to measurement theory. Monterey, CA: Brooks/ Cole.
2. AMERICAN PSYCHOLOGICAL ASSOCIATION. (1994) Publication manual of the American Psychological Association. (4th ed.) Washington, DC: Author.
3. BECKER, G. (2000) How important is transient error in estimating reliability? Going beyond simulation studies. Psychological Methods, 5, 370-379.
4. BERRY, K. J., & MIELKE, P. W. (1988) A generalization of Cohen's kappa agreement measure to interval measurement and multiple raters. Educational and Psychological Measurement, 48, 921-933.
5. BYRNE, B. M., & SHAVELSON, R. J. (1986) On the structure of the adolescent self-concept. Journal of Educational Psychology, 78, 474-481.
6. COHEN, J. (1960) A coefficient of agreement for nominal data. Educational and Psychological Measurement, 20, 37-46.
7. COHEN, J. (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213-220.
8. CRONBACH, L. J. (1951) Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
9. CURETON, E. E. (1965) Reliability and validity: basic assumptions and experimental designs. Educational and Psychological Measurement, 25, 327-346.
10. DUNN, G. (1989) Design and analysis of reliability studies. New York: Oxford.
11. EBEL, R. L. (1951) Estimation of the reliability of ratings. Psycbometrika, 16, 407-424.
12. FAN, X., & CHEN, M. (2000) Published studies of interrater reliability often overestimate reliability: computing the correct coefficient. Educational and Psychological Measurement, 60, 532-542.
13. FLEISS, J. L., & COHEN, J. (1973) The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33, 613-619.
14. FLEISS, J. L., COHEN, J., & EVERITT, B. S. (1969) Large sample standard errors of kappa and weighted kappa. Psychological Bulletin, 12, 323-327.
15. GRAY-LITTLE, B., WILLIAMS, V. S. L., & HANCOCK, T. D. (1997) An item response theory analysis of the Rosenberg Self-esteem Scale. Personality and Social Psychology Bulletin, 23, 443-451.
16. GUILFORD, J. P. (1954) Psychometric methods. New York: McGraw-Hill.
17. GUTTMAN, L. (1945) A basis for analyzing test-retest reliability. Psychometrika, 10, 255-282.
18. HOYT, C. (1941) Test reliability estimated by analysis of variance. Psychometrika, 6, 153-160.
19. JACKSON, R. W. B. (1939) Reliability of mental tests. British Journal of Psychology, 29, 267-287.
20. LORD, F. M., & NOVICK, M. R. (1968) Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
21. MCGRAW, K. O., & WONG, S. P. (1996) Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46.
22. O'BRIEN, E. J. (1985) Global self-esteem scales: unidimensional or multidimensional? Psychological Reports, 57, 383-389.
23. ROSENBERG, M. (1965) Society and the adolescent self-image. Princeton, NJ: Princeton Univer. Press.
24. ROSENTHAL, R. (1973) Estimating effective reliability in studies that employ judges' ratings. Journal of Clinical Psychology, 29, 342-345.