Weighted kappa is higher than Cohen's kappa for tridiagonal agreement tables

Statistical Methodology

Volumn 8, Issue 2, 2011, Pages 268-272

  Warrens, Matthijs J ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Cohen's kappa; Cohen's weighted kappa; Linear weights; Nominal agreement; Ordinal agreement; Quadratic weights

Indexed keywords

EID: 78751703928     PISSN: 15723127     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.stamet.2010.09.004     Document Type: Article

References (23)

1. Brennan R.L., Prediger D.J. Coefficient kappa: some uses, misuses, and alternatives. Educational and Psychological Measurement 1981, 41:687-699.
2. Brenner H., Kliebsch U. Dependence of weighted kappa coefficients on the number of categories. Epidemiology 1996, 7:199-202.
3. Cai J.-M., Hatsukami T.S., Ferguson M.S., Small R., Polissar N.L., Yuan C. Classification of human carotid atherosclerotic lesions with in vivo multicontrast magnetic resonance imaging. Circulation 2002, 106:1368-1373.
4. Cicchetti D., Allison T. A new procedure for assessing reliability of scoring EEG sleep recordings. The American Journal of EEG Technology 1971, 11:101-109.
5. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960, 20:37-46.
6. Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin 1968, 70:213-220.
7. Dirksen M.S., Bax J.J., De Roos A., Jukema J.W., Van der Geest R.J., Geleijns K., Boersma E., Van der Wall E.E., Lamb H.J. Usefulness of dynamic multislice computed tomography of left ventricular function in unstable angina pectoris and comparison with echocardiography. The American Journal of Cardiology 2002, 90:1157-1160.
8. Eaton W.W., Neufeld K., Chen L.-S., Cai G. A comparison of self-report and clinical diagnostic interviews for depression. Archives of General Psychiatry 2000, 57:217-222.
9. Fleiss J.L., Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement 1973, 33:613-619.
10. Fleiss J.L., Cohen J., Everitt B.S. Large sample standard errors of kappa and weighted kappa. Psychological Bulletin 1969, 72:323-327.
11. Jakobsson U., Westergren A. Statistical methods for assessing agreement for ordinal data. Scandinavian Journal of Caring Sciences 2005, 19:427-431.
12. Krippendorff K. Reliability in content analysis: some common misconceptions and recommendations. Human Communication Research 2004, 30:411-433.
13. Kundel H.L., Polansky M. Measurement of observer agreement. Radiology 2003, 288:303-308.
14. Mielke P.W., Berry K.J. A note on Cohen's weighted kappa coefficient of agreement with linear weights. Statistical Methodology 2009, 6:439-446.
15. Schuster C. A note on the interpretation of weighted kappa and its relations to other rater agreement statistics for metric scales. Educational and Psychological Measurement 2004, 64:243-253.
16. Seddon J.M., Sahagian C.R., Glynn R.J., Sperduto R.D., Gragoudas E.S. Evaluation of an iris color classification system. Investigative Ophthalmology & Visual Science 1990, 31:1592-1598. The Eye Disorders Case-Control Study Group.
17. Vanbelle S., Albert A. A note on the linearly weighted kappa coefficient for ordinal scales. Statistical Methodology 2009, 6:157-163.
18. Van Swieten J.C., Koudstaal P.J., Visser M.C., Schouten H.J.A., Van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke 1987, 19:604-607.
19. Visser H., De Nijs T. The map comparison kit. Environmental Modelling & Software 2006, 21:346-358.
20. Warrens M.J. On the equivalence of Cohen's kappa and the Hubert-Arabie adjusted rand index. Journal of Classification 2008, 25:177-183.
21. Warrens M.J. Inequalities between kappa and kappa-like statistics for k⊗k tables. Psychometrika 2010, 75:176-185.
22. Warrens M.J. Cohen's kappa can always be increased and decreased by combining categories. Statistical Methodology 2010, 7:673-677.
23. Zwick R. Another look at interrater agreement. Psychological Bulletin 1988, 103:374-378.