An Alternative to Cohen's κ

European Psychologist

Volumn 11, Issue 1, 2006, Pages 12-24

  Von Eye, Alexander ^a  

^a MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

Agreement; Chance model; Covariates; Disagreement; Kappa; Kappa alternative

Indexed keywords

EID: 33644879249     PISSN: 10169040     EISSN: None     Source Type: Journal    
DOI: 10.1027/1016-9040.11.1.12     Document Type: Review

References (37)

1. Agresti, A. (2002). Categorical data analysis (2nd ed.). Hoboken, NJ: Wiley.
2. Banerjee, M., Capozzoli, M., McSweeney, L., & Sinha, D. (1999). Beyond κ: A review of rater agreement measures. The Canadian Journal of Statistics, 27, 3-23.
3. Barlow, W. (1996). Measurement of iterrater agreement with adjustment for covariates. Biometrics, 52, 695-702.
4. Barnhart, H.X., & Williamson, J.M. (2002). Weighted least-squares approach for comparing correlated κ. Biometrics, 58, 1012-1019.
5. Brennan, R.L., & Prediger, D.J. (1981). Coefficient κ: Some uses, misuses, and alternatives. Educational and Psychological Measurement, 41, 687-699.
6. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
7. Darlington, R.B., & Hayes, A.F. (2000). Combining independent p values: Extensions of the Stouffer and binomial methods. Psychological Methods, 5, 496-515.
8. Donner, A., & Klar, N. (1996). The statistical analysis of κ statistics in multiple samples. Journal of Clinical Epidemiology, 49, 1053-1058.
9. Donner, A., & Zhou, G. (2002). Interval estimation for a difference between intraclass κ statistics. Biometrics, 58, 209-215.
10. Feinstein, A.R., & Cicchetti, D.V. (1990). High agreement but low κ I: The problems of two paradoxes. Journal of Clinical Epidemiology, 43, 543-549.
11. Fleiss, J.L. (1975). Measuring agreement between two judges in the presence or absence of a trait. Biometrics, 31, 651-659.
12. Fleiss, J.L (1981). Statistical methods for rates and proportions (2nd ed.). New York: Wiley.
13. Fleiss, J.L., Cohen, J., & Everitt, B.S. (1969). Large sample standard errors of κ and weighted κ. Psychological Bulletin, 72, 323-327.
14. Fleiss, J.L., Levin, B., & Paik, M.C. (2003). Statistical methods for rates and proportions (3rd ed.). New York: Wiley.
15. Goodman, L.A. (1965). On simultaneous confidence intervals for multinomial proportions. Technometrics, 7, 247-254.
16. Goodman, L.A. (1979). Simple models for the analysis of association in cross-classifications having ordered categories. Journal of the American Statistical Association, 74, 537-552.
17. Goodman, L.A., & Kruskal, W.H. (1954). Measures of association for cross-classifications. Journal of the American Statistical Association, 49, 732-764.
18. Guggenmoos-Holzmann, I. (1995). Modeling covariate effects in observer agreement studies: The case of nominal scale agreement (letter to the editor). Statistics in Medicine, 14, 2285-2286.
19. Hildebrand, D.K., Laing, J.D., & Rosenthal, H. (1977). Prediction analysis of cross-classifications. New York: Wiley.
20. Keselman, H.J., Cribbie, R., & Holland, B. (1999). The pairwise multiple comparison multiplicity problem: An alternative approach to familywise and comparisonwise Type I error control. Psychological Methods, 4, 58-69.
21. Klar, N., Lipsitz, S.R., & Ibrahim, J. (2000). An estimating equation for modeling κ. Biometrical Journal, 42, 45-58.
22. Landis, J.R., & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
23. Microsoft Corporation. (1995). Microsoft® Fortran PowerStation. Version 4.0.
24. Park, S.K., & Miller, K.W. (1988). Random number generators: Good ones are hard to find. Communications of the Association for Computing Machinery, 31, 1192-1201.
25. Press, W.H., Flannery, B.P., Teukolsky, S.A., & Vetterling, W.T. (1989). Numerical recipes. The art of scientific computing (FORTRAN version). Cambridge: Cambridge University Press.
26. Schuster, C., & Smith, D.A. (2002). Indexing systematic rater agreement with a latent class model. Psychological Methods, 7, 384-395.
27. Schuster, C., & von Eye, A. (2001). Models for ordinal agreement data. Biometrical Journal, 43, 795-808.
28. Stouffer, S.A., Suchman, E.A., DeVinney, L.C., Star, S.A., & Williams, R.M. Jr. (1949). The American soldier: Adjustment during Army life (vol. 1). Princeton, NJ: Princeton University Press.
29. Tanner, M.A., & Young, M.A. (1985). Modeling agreement among raters. Journal of the American Statistical Association, 80, 175-180.
30. Uebersax, J.S. (1993). Statistical modeling of expert ratings on medical treatment appropriateness. Journal of the American Statistical Association, 88, 421-421.
31. von Eye, A. (2002). Configural Frequency Analysis - Methods, models, applications. Mahwah, NJ: Erlbaum.
32. von Eye, A., & Brandtstädter, J. (1988). Application of prediction analysis to cross-classifications of ordinal data. Biometrical Journal, 30, 651-655.
33. von Eye, A., Jacobson, L.P., & Wills, S.D. (1990, July). Proverbs: Imagery, interpretation, and memory. 12th West Virginia University Conference on Life-Span Developmental Psychology, Morgantown, WV.
34. von Eye, A., & Mun, E.Y. (2005). Analyzing rater agreement -Manifest variable models. Mahwah, NJ: Erlbaum.
35. von Eye, A., & Schuster, C. (2000). Log-linear models for rater agreement. Multiciência, 4, 38-56.
36. von Eye, A., & Sörensen, S. (1991). Models of chance when mea suring interrater agreement with κ. Biometrical Journal, 33, 781-787.
37. Wickens, T. (1989). Multiway contingency tables analysis for the social sciences. Hillsdale, NJ: Erlbaum.