A note on the kappa statistic for clustered dichotomous data

Statistics in Medicine

Volumn 33, Issue 14, 2014, Pages 2425-2448

  Zhou, Ming ^a   Yang, Zhao ^b  

^a BRISTOL MYERS SQUIBB   (United States)

^b UCB PHARMA   (Belgium)

Author keywords

Agreement; Clustered dichotomous data; Confidence interval; Coverage probability; Kappa statistic; Physician patients

Indexed keywords

BOOTSTRAPPING; CASE REPORT; CONFIDENCE INTERVAL; COVARIANCE; HUMAN; KAPPA STATISTICS; MONTE CARLO METHOD; PHYSICIAN; PROBABILITY; SAMPLING; CLUSTER ANALYSIS; COMPUTER SIMULATION; PSYCHIATRY; STATISTICAL ANALYSIS;

CLUSTER ANALYSIS; COMPUTER SIMULATION; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; HUMANS; MONTE CARLO METHOD; PHYSICIANS; PSYCHIATRY;

EID: 84893193215     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.6098     Document Type: Article

References (34)

1. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 20(1):37-46.
2. Jakobsson U, Westergren A. Statistical methods for assessing agreement for ordinal data. Scandinavian Journal of Caring Sciences 2005; 19(4):427-431.
3. Kundel HL, Polansky M. Measurement of observer agreement. Radiology 2003; 228(2):303-308.
4. Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin 1968; 70(4):213-220.
5. Conger AJ. Integration and generalization of kappas for multiple raters. Psychological Bulletin 1980; 88(2):322-328.
6. Fleiss JL. Measuring nominal scale agreement among many raters. Psychological Bulletin 1971; 76(5):378-382.
7. Warrens MJ. Inequalities between multi-rater kappas. Advances in Data Analysis and Classification 2010; 4(4):271-286.
8. Barlow W, Lai MY, Azen SP. A comparison of methods for calculating a stratified kappa. Statistics in Medicine 1991; 10(9):1465-1472.
9. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33(1):159-174.
10. Kraemer HC. Extension of the kappa coefficient. Biometrics 1980; 36(2):207-216.
11. Vanbelle S, Albert A. Agreement between an isolated rater and a group of raters. Statistica Neerlandica 2009; 63(1):82-100.
12. Vanbelle S, Albert A. Agreement between two independent groups of raters. Psychometrika 2009; 74(3):477-491.
13. Lin HM, Kim HY, Williamson JM, Lesser VM. Estimating agreement coefficients from sample survey data. Survey Methodology 2012; 38(1):63-72.
14. Ma Y, Tang W, Feng C, Tu XM. Inference for kappas for longitudinal study data: applications to sexual health research. Biometrics 2008; 64(3):781-789.
15. Vanbelle S, Mutsvari T, Declerck D, Lesaffre E. Hierarchical modeling of agreement. Statistics in Medicine 2012; 31(28):3667-3680.
16. Barnhart HX, Williamson JM. Weighted least-squares approach for comparing correlated kappa. Biometrics 2002; 58(4):1012-1019.
17. Donner A, Shoukri MM, Klar N, Bartfay E. Testing the equality of two dependent kappa statistics. Statistics in Medicine 2000; 19(3):373-387.
18. Gonin R, Lipsitz SR, Fitzmaurice GM, Molenberghs G. Regression modelling of weighted κ by using generalized estimating equations. Journal of the Royal Statistical Society: Series C (Applied Statistics) 2000; 49(1):1-18.
19. Klar N, Lipsitz SR, Ibrahim JG. An estimating equations approach for modelling kappa. Biometrical Journal 2000; 42(1):45-58.
20. McKenzie DP, Mackinnon AJ, Péladeau N, Onghena P, Bruce PC, Clarke DM, Harrigan S, McGorry PD. Comparing correlated kappas by resampling: is one level of agreement significantly different from another? Journal of Psychiatric Research 1996; 30(6):483-492.
21. Vanbelle S, Albert A. A bootstrap method for comparing correlated kappa coefficients. Journal of Statistical Computation and Simulation 2008; 78(11):1009-1015.
22. Williamson JM, Lipsitz SR, Manatunga AK. Modeling kappa for measuring dependent categorical agreement data. Biostatistics 2000; 1(2):191-202.
23. Oden NL. Estimating kappa from binocular data. Statistics in Medicine 1991; 10(8):1303-1311.
24. Schouten HJ. Estimating kappa from binocular data and comparing marginal probabilities. Statistics in Medicine 1993; 12(23):2207-2217.
25. Dixon SN, Donner A, Shoukri MM. Adjusted inference procedures for the interobserver agreement in twin studies. Statistical Methods in Medical Research 2013, DOI: 10.1177/0962280213476771.
26. Kang C, Qaqish B, Monaco J, Sheridan SL, Cai J. Kappa statistic for clustered dichotomous responses from physicians and patients. Statistics in Medicine 2013; 32(21):3700-3719.
27. Yang Z, Zhou M. Kappa statistic for clustered matched-pair data. Statistics in Medicine, in press. DOI: 10.1002/sim.6113.
28. Agresti A. Categorical Data Analysis. John Wiley & Sons: New Jersey, 2002.
29. Athreya KB, Lahiri SSN. Measure Theory and Probability Theory. Springer: New York, 2006.
30. Zou G, Donner A. Confidence interval estimation of the intraclass correlation coefficient for binary outcome data. Biometrics 2004; 60(3):807-811.
31. Efron B, Tibshirani R. An Introduction to the Bootstrap. CRC Press: New York, 1993.
32. Donner A, Petryshen P. The statistical analysis of matched data in psychiatric research. Psychiatry Research 1989; 28(1):41-46.
33. Yang Z, Sun X, Hardin JW. Confidence intervals for the difference of marginal probabilities in clustered matched-pair binary data. Pharmaceutical Statistics 2012; 11(5):386-393.
34. Shao J. Mathematical Statistics, 2nded. Springer-Verlag New York Inc: New York, 2003.