Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa

BMC Medical Research Methodology

Volumn 9, Issue 1, 2009, Pages

  Chen, Guanmin ^a   Faris, Peter ^b   Hemmelgarn, Brenda ^a,c   Walker, Robin L ^a   Quan, Hude ^a  

^a UNIVERSITY OF CALGARY   (Canada)

^b Alberta Bone and Joint Health Institute   (Canada)

^c UNIVERSITY OF CALGARY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CANADA; EPIDEMIOLOGY; HUMAN; HYPERTENSION; MEDICAL RECORD; PREVALENCE; RANDOMIZATION; STATISTICAL ANALYSIS;

ALBERTA; CANADA; DATA INTERPRETATION, STATISTICAL; HOSPITAL RECORDS; HUMANS; HYPERTENSION; MEDICAL RECORDS; PREVALENCE; RANDOM ALLOCATION; SAMPLING STUDIES;

EID: 62549155284     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-9-5     Document Type: Article

References (33)

1. Reliability of content analysis: The case of nominal scale coding. WA Scott, Public Opinion Quart 1955 19 321 353 10.1086/266577
2. A coefficients of agreement for nominal scales. J Cohen, Edu and Psych Meas 1960 20 37 46 10.1177/001316446002000104
3. High agreement but low kappa: II. Resolving the paradoxes. DV Cicchetti AR Feinstein, J Clin Epidemiol 1990 43 6 551 558 10.1016/0895-4356(90)90159-M 2189948
4. High agreement but low kappa: I. The problems of two paradoxes. AR Feinstein DV Cicchetti, J Clin Epidemiol 1990 43 6 543 549 10.1016/0895-4356(90) 90158-L 2348207
5. 2 × 2 kappa coefficients: measures of agreement or association. DA Bloch HC Kraemer, Biometrics 1989 45 1 269 287 10.2307/2532052 2655731
6. Bias and prevalence effects on kappa viewed in terms of sensitivity and specificity. FK Hoehler, J Clin Epidemiol 2000 53 5 499 503 10.1016/S0895- 4356(99)00174-2 10812322
7. Behavior and interpretation of the kappa statistic: resolution of the two paradoxes. CA Lantz E Nebenzahl, J Clin Epidemiol 1996 49 4 431 434 10.1016/0895-4356(95)00571-4 8621993
8. Issues in the use of kappa to estimate reliability. KL Soeken PA Prescott, Med Care 1986 24 8 733 741 10.1097/00005650-198608000-00008 3736144
9. Bias, prevalence and kappa. T Byrt J Bishop JB Carlin, J Clin Epidemiol 1993 46 5 423 429 10.1016/0895-4356(93)90018-V 8501467
10. Prevalence-adjusted Bias-adjusted {kappa} Values as Additional Indicators to Measure Observer Agreement [letter]. HKF Mak KKW Yau BPL Chan, Radiology 2004 232 1 302-a 303 10.1148/radiol.2321031974
11. Hypodensity of > 1/3 Middle Cerebral Artery Territory Versus Alberta Stroke Programme Early CT Score (ASPECTS): Comparison of Two Methods of Quantitative Evaluation of Early CT Changes in Hyperacute Ischemic Stroke in the Community Setting. HKF Mak KKW Yau P-L Khong ASC Ching P-W Cheng PKM Au-Yeung PKM Pang KCW Wong BPL Chan, Stroke 2003 34 5 1194 1196 10.1161/01.STR. 0000069162.64966.71 12690213
12. Comparison of serological methods for the diagnosis of Neospora caninum infection in cattle. W Wapenaar HW Barkema JA VanLeeuwen JT McClure RM O'Handley OCH Kwok P Thulliez JP Dubey MC Jenkins, Veterinary Parasitology 2007 143 2 166 173 10.1016/j.vetpar.2006.08.007 16989951
13. Patterns of agreement on breast cancer screening knowledge and practices among women in Dominican and Mexican families in New York City. S Garbers MA Chiasson, Med Sci Monit 2004 10 11 CR628 634 15507855
14. Intra- and inter-observer agreement of a protocol for clinical examination of dairy cows. PT Thomsen NP Baadsgaard, Preventive Veterinary Medicine 2006 75 1-2 133 139 10.1016/j.prevetmed.2006.02.004 16621073
15. Reliability of the knee examination in osteoarthritis: Effect of standardization. J Cibere N Bellamy A Thorne JM Esdaile KJ McGorm A Chalmers S Huang P Peloso K Shojania J Singer, Arthritis & Rheumatism 2004 50 2 458 468 10.1002/art.20025
16. Evaluation of four serological techniques to determine the seroprevalence of Neospora caninum in foxes (Vulpes vulpes) and coyotes (Canis latrans) on Prince Edward Island, Canada. W Wapenaar HW Barkema G Schares K Rouvinen-Watt L Zeijlemaker B Poorter RM O'Handley OCH Kwok JP Dubey, Veterinary Parasitology 2007 145 1-2 51 58 10.1016/j.vetpar.2006.12.002 17223270
17. Evaluation of agreement between conventional and liquid-based cytology in cervical cancer early detection based on analysis of 2,091 smears: Experience at the Brazilian National Cancer Institute. LCST Vania Reis Girianelli, Diagnostic Cytopathology 2007 35 9 545 549 10.1002/dc.20699 17703446
18. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. H Quan V Sundararajan P Halfon A Fong B Burnand JC Luthi LD Saunders CA Beck TE Feasby WA Ghali, Med Care 2005 43 11 1130 1139 10.1097/01.mlr.0000182534.19832.83 16224307
19. Epidemiology of Crohn's disease and ulcerative colitis in a central Canadian province: a population-based study. CN Bernstein JF Blanchard P Rawsthorne A Wajda, Am J Epidemiol 1999 149 10 916 924 10342800
20. Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? KH Humphries JM Rankin RG Carere CE Buller FM Kiely JJ Spinelli, J Clin Epidemiol 2000 53 4 343 349 10.1016/S0895-4356(99)00188-2 10785564
21. Coding of stroke and stroke risk factors using international classification of diseases, revisions 9 and 10. RA Kokotailo MD Hill, Stroke 2005 36 8 1776 1781 10.1161/01.STR.0000174293.17959.a1 16020772
22. The dependence of Cohen's kappa on the prevalence does not matter. W Vach, J Clin Epidemiol 2005 58 7 655 661 10.1016/j.jclinepi.2004.02.021 15939215
23. Interrater agreement for journal manuscript reviews. JA Whiteburst, Am Psychologist 1984 39 22 28 10.1037/0003-066X.39.1.22
24. Raking Kappa: Describing Potential Impact of Marginal Distributions on Measures of Agreement. A Agresti A Ghosh, Biometrical Journal 1995 37 7 811 820 10.1002/bimj.4710370705
25. Canadian Coding Standards for ICD-10-CA and CCI for 2007. CIHI, Ottawa: Canadian Institute of Health Information 2007
26. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. J Sim CC Wright, Phys Ther 2005 85 3 257 268 15733050
27. Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. J Cohen, Psych Bull 1968 70 213 220 10.1037/h0026256
28. Large sample standard errors of kappa and weighted kappa. JL Fleiss J Cohen M Davies, Psych Bull 1969 72 323 327 10.1037/h0028106
29. The measurement of observer agreement for categorical data. RJ Landis GG Koch, Biometrics 1977 33 159 174 10.2307/2529310 843571
30. Measuring nominal scale agreement among many raters. JL Fleiss, Psych Bull 1971 76 378 382 10.1037/h0031619
31. A one-way components of variance model for categorical data. RJ Landis GG Koch, Biometrics 1977 33 671 679 10.2307/2529465
32. Measurement of interrater agreement with adjustment for covariates. W Barlow, Biometrics 1996 52 2 695 702 10.2307/2532907 10766505
33. Validity of procedure codes in International Classification of Diseases, 9th revision, clinical modification administrative data. H Quan GA Parsons WA Ghali, Med Care 2004 42 8 801 809 10.1097/01.mlr.0000132391.59713.0d 15258482