Kappa statistic for clustered dichotomous responses from physicians and patients

Statistics in Medicine

Volumn 32, Issue 21, 2013, Pages 3700-3719

  Kang, Chaeryon ^a   Qaqish, Bahjat ^b   Monaco, Jane ^b   Sheridan, Stacey L ^c,d   Cai, Jianwen ^b  

^a Fred Hutchinson Cancer Research Center   (United States)

^b IL   (United States)

^c UNIVERSITY OF NORTH CAROLINA SCHOOL OF MEDICINE   (United States)

^d UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

Cluster bootstrap resampling; Clustered dichotomous responses; Kappa statistic

Indexed keywords

ARTICLE; ASYMPTOMATIC STANDARD ERROR; BOOTSTRAPPING; CELL COUNT; CLUSTER ANALYSIS; CLUSTERED DICHOTOMOUS RESPONSE; COMPARATIVE STUDY; CONTROLLED STUDY; CORRELATIONAL STUDY; DOCTOR PATIENT RELATION; ERROR; ISCHEMIC HEART DISEASE; KAPPA STATISTICS; LIFESTYLE MODIFICATION; MONTE CARLO METHOD; PROPHYLAXIS; STATISTICAL PARAMETERS;

CLUSTER BOOTSTRAP RESAMPLING; CLUSTERED DICHOTOMOUS RESPONSES; KAPPA STATISTIC;

CLUSTER ANALYSIS; COMPUTER SIMULATION; CORONARY DISEASE; HUMANS; OBSERVER VARIATION; PATIENT EDUCATION AS TOPIC; PATIENTS; PHYSICIANS; STATISTICS AS TOPIC;

EID: 84883134445     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.5796     Document Type: Article

References (35)

1. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 20(1):37-46.
2. Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin 1968; 70(4):213-220.
3. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33(1):159-174.
4. Fleiss JL. Measuring nominal scale agreement among many raters. Psychological Bulletin 1971; 76(5):378-382.
5. Barlow W, Lai MY, Azen SP. A comparison of methods for calculating a stratified kappa. Statistics in Medicine 1991; 10(9):1465-1472.
6. Kraemer HC. Extension of the kappa coefficient. Biometrics 1980; 36(2):207-216.
7. McKenzie DP, Mackinnon AJ, Péladeau N, Onghena P, Bruce PC, Clarke DM, Harrigan S, McGorry PD. Comparing correlated kappas by resampling: is one level of agreement significantly different from another? Journal of Psychiatric Research 1996; 30(6):483-492.
8. Vanbelle S, Albert A. A bootstrap method for comparing correlated kappa coefficients. Journal of Statistical Computation and Simulation 2008; 78(11):1009-1015.
9. Donner A, Shoukri MM, Klar N, Bartfay E. Testing the equality of two dependent kappa statistics. Statistics in Medicine 2000; 19(3):373-387.
10. Klar N, Lipsitz SR, Ibrahim JG. An estimating equations approach for modelling kappa. Biometrical Journal 2000; 42(1):45-58.
11. Williamson JM, Manatunga AK, Lipsitz SR. Modeling kappa for measuring dependent categorical agreement data. Biostatistics 2000; 1(2):191-202.
12. Gonin R, Lipsitz SR, Fitzmaurice GM, Molenberghs G. Regression modelling of weighted κ by using generalized estimating equations. Journal of the Royal Statistical Society: Series C (Applied Statistics) 2000; 49(1):1-18.
13. Barnhart HX, Williamson JM. Weighted least-squares approach for comparing correlated kappa. Biometrics 2002; 58(4):1012-1019.
14. Behrend L, Maymani H, Diehl M, Gizlice Z, Cai J, Sheridan SL. Patient-physician agreement on the content of CHD prevention discussions. Health Expectations 2010; 14(1):58-72.
15. Eliasziw M, Donner A. Application of the McNemar test to non-independent matched pair data. Statistics in Medicine 1991; 10(12):1981-1991.
16. Donald A, Donner A. Adjustments to the Mantel-Haenszel chi-square statistic and odds ratio variance estimator when the data are clustered. Statistics in Medicine 1987; 6(4):491-499.
17. Donald A, Donner A. A simulation study of the analysis of sets of 2×2 contingency tables under cluster sampling: estimation of a common odds ratio. Journal of the American Statistical Association 1990; 85(410):537-543.
18. Oden NL. Estimating kappa from binocular data. Statistics in Medicine 1991; 10(8):1303-1311.
19. Schouten HJA. Estimating kappa from binocular data and comparing marginal probabilities. Statistics in Medicine 1993; 12(23):2207-2217.
20. Klar N, Lipsitz SR, Parzen M, Leong T. An exact bootstrap confidence interval for κ in small samples. Journal of the Royal Statistical Society: Series D (The Statistician) 2002; 51(4):467-478.
21. Cunningham M. More than just the kappa coefficient: a program to fully characterize inter-rater reliability between two raters. Statistics and Data Analysis, SAS Global Forum, Washington, D.C., 2009. Paper 242-2009.
22. Fleiss JL, Levin BA, Paik MC, Wiley J. Statistical Methods for Rates and Proportions, 3rd Edition. John Wiley & Sons, Inc.: Hoboken, New Jersey, 2003.
23. Efron B, Tibshirani RJ. An Introduction to the Bootstrap. Chapman & Hall/CRC: Florida, the United States of America, 1993.
24. Davison AC, Hinkley DV. Bootstrap Methods and Their Application. Cambridge Univ Pr: Florida, the United States of America, 1997.
25. Field CA, Welsh AH. Bootstrapping clustered data. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 2007; 69(3):369-390.
26. Monaco J, Cai J, Grizzle J. Bootstrap analysis of multivariate failure time data. Statistics in medicine 2005; 24(22):3387-3400.
27. Efron B, Tibshirani R. Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical Science 1986; 1(1):54-75.
28. DiCiccio TJ, Efron B. Bootstrap confidence intervals. Statistical Science 1996; 11:189-212.
29. Qaqish BF. A family of multivariate binary distributions for simulating correlated binary variables with specified marginal means and correlations. Biometrika 2003; 90(2):455-463.
30. By K, Qaqish BF. binarysimclf: simulates correlated binary data, 2009. http://CRAN.R-project.org/package=binarySimCLF, R package version 1.0.
31. Burton A, Altman DG, Royston P, Holder RL. The design of simulation studies in medical statistics. Statistics in Medicine 2006; 25(24):4279-4292.
32. Sheridan SL, Behrend L, Pignone MP, Keyserling T, Rimer B, Simpson RJ, Bangdiwala K, Cai J, Gizlice Z. A randomized trial of an intervention to improve adherence to effective heart disease prevention medications. BMC Health Services Research 2011; 11(331):1-10.
33. Fleiss JL, Nee JC, Landis JR. Large sample variance of kappa in the case of different sets of raters. Psychological Bulletin 1979; 86(5):974-977.
34. Gross ST. The kappa coefficient of agreement for multiple observers when the number of subjects is small. Biometrics 1986; 42(4):883-893.
35. Feder M. Variance estimation of the survey-weighted kappa measure of agreement. Asa Section on Survey Research Methods, The Joint Statistical Meetings, Seattle, WA, August 2006.