Weighted 2 × 2 kappa coefficients: recommended indices of diagnostic accuracy for evidence-based practice

Journal of Clinical Epidemiology

Volumn 62, Issue 10, 2009, Pages 1045-1053

  Gilchrist, James M ^a  

^a UNIVERSITY OF BRADFORD   (United Kingdom)

Author keywords

Diagnostic accuracy; Evidence based practice; Kappa coefficients; Predictive values; Sensitivity; Specificity

Indexed keywords

ARTICLE; CLINICAL ASSESSMENT TOOL; DIAGNOSTIC ACCURACY; EVIDENCE BASED PRACTICE; GOLD STANDARD; KAPPA STATISTICS; MATHEMATICAL AND STATISTICAL PROCEDURES; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MEDICAL DECISION MAKING; PREDICTION AND FORECASTING; PRIORITY JOURNAL; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; STATISTICAL MODEL; DIAGNOSTIC ERROR; DIAGNOSTIC TEST; EVIDENCE BASED MEDICINE; HUMAN; METHODOLOGY; PREVALENCE; STANDARD;

DATA INTERPRETATION, STATISTICAL; DIAGNOSTIC ERRORS; DIAGNOSTIC TESTS, ROUTINE; EVIDENCE-BASED MEDICINE; HUMANS; PREDICTIVE VALUE OF TESTS; PREVALENCE;

EID: 69749083737     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2008.11.012     Document Type: Article

References (39)

1. Sackett D.L., Rosenberg W.M.C., Gray J.A.M., Haynes R.B., and Richardson W.S. Evidence-based medicine: what it is and what it isn't. BMJ 312 (1996) 71-72
2. Bossuyt P.M., Reitsma J.B., Bruns D.E., Gatsonis C.A., Glasziou P.P., Irwig L.M., et al. Towards complete and accurate reporting of studies of diagnostic accuracy. Lancet 361 (2003) 1-4
3. Knottnerus J.A., and Tugwell P. The standards for reporting diagnostic accuracy. J Clin Epidemiol 56 (2003) 1029
4. Knottnerus J.A., and Muris J.W.M. Assessment of the accuracy of diagnostic tests: the cross-sectional study. J Clin Epidemiol 56 (2003) 1118-1128
5. Johnson K.M. The 2 × 2 diagram: a graphical truth table. J Clin Epidemiol 52 (1999) 1073-1082
6. Deeks J.J. Systematic reviews of evaluations of diagnostic and screening tests. BMJ 323 (2001) 157-162
7. Knottnerus J.A., van Weel C., and Muris J.W.M. Evaluation of diagnostic procedures. BMJ 324 (2002) 477-480
8. Sackett D.L., and Haynes R.B. The architecture of diagnostic research. BMJ 324 (2002) 539-541
9. Kleinbaum D.G., Kupper L.L., and Morgenstern H. Epidemiologic research: principles and quantitative methods (1982), Wiley, New York
10. Rothman K.J., and Greenland S. Modern epidemiology (1998), Lippincott, Williams & Wilkins, Philadelphia
11. Guggenmoos-Holzmann I., and van Houwelingen H.C. The (In)Validity of sensitivity and specificity. Stat Med 19 (2000) 1783-1792
12. Grimes D.A., and Schulz K.F. Uses and abuses of screening tests. Lancet 359 (2002) 881-884
13. Foy R., and Warner P. About time: diagnostic guidelines that help clinicians. Qual Saf Health Care 12 (2003) 205-209
14. Moons K.G.M., and Harrell F.E. Sensitivity and specificity should be de-emphasized in diagnostic accuracy studies. Acad Radiol 10 (2003) 670-672
15. Sackett D.L., Haynes R.B., Guyatt G.H., and Tugwell P. Clinical epidemiology-a basic science for clinical medicine (1991), Little Brown, London
16. Jaeschke R., Guyatt G.H., Sackett D.L., and for the Evidence-based Medicine Working Group. Users' guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients?. JAMA 271 (1994) 703-707
17. Blume J.D. Likelihood methods for measuring statistical evidence. Stat Med 21 (2002) 2563-2599
18. Grimes D.A., and Schulz K.F. Refining clinical diagnosis with likelihood ratios. Lancet 365 (2005) 1500-1505
19. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 20 (1960) 37-46
20. Daly L.E., and Bourke G.J. Interpretation and uses of medical statistics. 5th edition (2000), Blackwell Science Ltd., Oxford
21. Fleiss J.L. Statistical methods for rates and proportions. 2nd edition (1981), Wiley, New York
22. Woolson R.F. Statistical methods for the analysis of biomedical data (1987), Wiley, New York
23. Everitt B.S. Statistical methods for medical investigations. 2nd edition (1994), Arnold, London
24. Armitage P., Berry G., and Matthews J.N.S. Statistical methods in medical research. 4th edition (2002), Blackwell Science Ltd., Oxford
25. Kirkwood B.R., and Sterne J.A.C. Essential medical statistics. 2nd edition (2003), Blackwell, Oxford
26. Bloch D.A., and Kraemer H.C. 2 × 2 Kappa coefficients: measures of agreement or association. Biometrics 45 (1989) 269-287
27. Kraemer H.C., Periyakoil V.S., and Noda A. Kappa coefficients in medical research. Stat Med 21 (2002) 2109-2129
28. McNeil B.J., Keeler E., and Adelstein S.J. Primer on certain elements of medical decision making. N Engl J Med 293 (1975) 211-215
29. Kraemer H.C. Evaluating medical tests: objective and quantitative guidelines (1992), Sage Publications, Newbury Park, CA.
30. Kraemer H.C., Kazdin A.E., Offord D.R., Kessler R.C., Jensen P.S., and Kupfer D.J. Measuring the potency of risk factors for clinical or policy significance. Psychol Methods 4 (1999) 257-271
31. Kraemer H.C. Reconsidering the odds ratio as a measure of 2 × 2 association in a population. Stat Med 23 (2004) 257-270
32. Kraemer H.C. Correlation coefficients in medical research: from product moment correlation to the odds ratio. Stat Methods Med Res 15 (2006) 525-545
33. Landis J.R., and Koch G.C. The measurement of observer agreement for categorical data. Biometrics 33 (1977) 159-174
34. Thompson W.D., and Walter S.D. A reappraisal of the kappa coefficient. J Clin Epidemiol 41 (1988) 949-958
35. Feinstein A.R., and Chicchetti D.V. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43 (1990) 543-549
36. Hoehler F.K. Bias and prevalence effects on kappa viewed in terms of sensitivity and specificity. J Clin Epidemiol 53 (2000) 499-503
37. Kraemer H.C., and Bloch D.A. Kappa coefficients in epidemiology: an appraisal of a reappraisal. J Clin Epidemiol 41 (1988) 959-968
38. Vach W. The dependence of Cohen's kappa on the prevalence does not matter. J Clin Epidemiol 58 (2005) 655-661
39. Swets J.A., and Pickett R.M. Evaluation of diagnostic systems: methods from signal detection theory (1982), Academic Press, New York