Interpreting diagnostic accuracy studies for patient care

BMJ (Online)

Volumn 345, Issue 7871, 2012, Pages

  Mallett, Susan ^a   Halligan, Steve ^b   Matthew Thompson, G P ^a,d   Collins, Gary S ^c   Altman, Douglas G ^c  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF OXFORD   (United Kingdom)

^d Oxford Centre for Monitoring and Diagnosis   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AREA UNDER THE CURVE; DATA ANALYSIS; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST; FALSE NEGATIVE RESULT; FALSE POSITIVE RESULT; HUMAN; INFORMATION PROCESSING; INTERMETHOD COMPARISON; MEDICAL DECISION MAKING; PATIENT CARE; PREDICTIVE VALUE; PREVALENCE; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; REVIEW; SENSITIVITY AND SPECIFICITY; ARTICLE; DIAGNOSTIC PROCEDURE; LABORATORY DIAGNOSIS; METHODOLOGY; STANDARD; STATISTICAL ANALYSIS; STATISTICS;

AREA UNDER CURVE; DATA INTERPRETATION, STATISTICAL; DIAGNOSTIC TECHNIQUES AND PROCEDURES; FALSE NEGATIVE REACTIONS; FALSE POSITIVE REACTIONS; HUMANS; PATIENT CARE; PREVALENCE; RESEARCH DESIGN; SENSITIVITY AND SPECIFICITY;

EID: 84865323381     PISSN: None     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.e3999     Document Type: Review

References (31)

1. Gigerenzer G, Gaissmaier W, Kurz-Mileke E, Schwartz LM, Woloshin S. Helping doctors and patients make sense of health statistics. Psychol Sci Public Interest 2008;8:53-96.
2. Leisenring W, Alonzo T, Pepe MS. Comparisons of predictive values of binary medical diagnostic tests for paired designs. Biometrics 2000;56:345-51. (Pubitemid 30422620)
3. D'Orsi CJ, Mendelson EB, Ikeda DM. Breast imaging reporting and data system: ACR BI-RADS-Breast Imaging Atlas. In: D'Orsi CJ, Bassett LW, Berg WA, eds. BI-RADS: Mammography. American College of Radiology, 2003.
4. Wagner RF, Metz CE, Campbell G. Assessment of medical imaging systems and computer aids: a tutorial review. Acad Radiol 2007;14:723-48. (Pubitemid 46898203)
5. Greenland S. The need for reorientation toward cost-effective prediction: comments on 'Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond' by Pencina MJ, et al. Statistics in Medicine (doi:10.1002/sim.2929). Stat Med 2008;27:199-206.
6. Schwartz LM, Woloshin S, Sox HC, Fischhoff B, Welch HG. US women's attitudes to false-positive mammography results and detection of ductal carcinoma in situ: cross-sectional survey. West J Med 2000;173:307-12.
7. Speigelhalter D. Understanding uncertainty. 2011. http:// understandinguncertainty.org/view/animations.
8. Pepe MS, Feng Z, Gu JW. Comments on 'Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond' by Pencina MJ, et al. Statistics in Medicine (doi:10.1002/sim.2929). Stat Med 2008;27:173-81.
9. Haglund C, Lundin J, Kuusela P, Roberts PJ. CA 242, a new tumour marker for pancreatic cancer: a comparison with CA 19-9, CA 50 and CEA. Br J Cancer 1994;70:487-92. (Pubitemid 24268552)
10. Adams NM, Hand DJ. Comparing classifers when the misallocation costs are uncertain. Pattern Recognition 1999;32:1139-47.
11. DeNeef P, Kent DL. Using treatment-tradeoff preferences to select diagnostic strategies: linking the ROC curve to threshold analysis. Med Decis Making 1993;13:126-32. (Pubitemid 23113449)
12. Lusted LB. Decision-making studies in patient management. N Engl J Med 1971;284:416-24.
13. Moons KG, Stijnen T, Michel BC, Buller HR, Van Es GA, Grobbee DE, et al. Application of treatment thresholds to diagnostic-test evaluation: an alternative to the comparison of areas under receiver operating characteristic curves. Med Decis Making 1997;17:447-54. (Pubitemid 27444316)
14. Pencina MJ, D'Agostino RB Sr, D'Agostino RB Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 2008;27:157-72. (Pubitemid 351193639)
15. Vergouwe Y, Steyerberg EW, Eijkemans MJ, Habbema JD. Validity of prognostic models: when is a model clinically useful? Semin Urol Oncol 2002;20:96-107. (Pubitemid 34522547)
16. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making 2006;26:565-74. (Pubitemid 44728772)
17. Wagner RF, Beam CA, Beiden SV. Reader variability in mammography and its implications for expected utility over the population of readers and cases. Med Decis Making 2004;24:561-72. (Pubitemid 39525176)
18. Peirce CS. The numerical measure of the success of predictions. Science 1884;IV:453-4.
19. Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak 2008;8:53.
20. Wagner RF, Beiden SV, Campbell G, Metz CE, Sacks WM. Assessment of medical imaging and computer-assist systems: lessons from recent experience. Acad Radiol 2002;9:1264-77. (Pubitemid 35265398)
21. Hand DJ. Evaluating diagnostic tests: the area under the ROC curve and the balance of errors. Stat Med 2010;29:1502-10.
22. Hilden J. The area under the ROC curve and its competitors. Med Decis Making 1991;11:95-101.
23. Gallas BD, Chan HP, D'Orsi CJ, Dodd LE, Giger ML, Gur D,et al. Evaluating imaging and computer-aided detection and diagnosis devices at the FDA. Acad Radiol 2012;19:463-77.
24. Thompson ML, Zucchini W. On the statistical analysis of ROC curves. Stat Med 1989;8:1277-90. (Pubitemid 19255875)
25. Baker SG. The central role of receiver operating characteristic (ROC) curves in evaluating tests for the early detection of cancer. J Natl Cancer Inst 2003;95:511-5. (Pubitemid 36511621)
26. Walter SD. The partial area under the summary ROC curve. Stat Med 2005;24:2025-40. (Pubitemid 40895557)
27. Hand D.J. Measuring classifier performance: a coherent alternative to the area under the ROC curve. Mach Learn 2009;77:103-23.
28. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol 2003;56:1129-35. (Pubitemid 37386338)
29. Niederau C, Grendell JH. Diagnosis of pancreatic carcinoma. Imaging techniques and tumor markers. Pancreas 1992;7:66-86.
30. Bandos AI, Rockette HE, Gur D. Incorporating utility-weights when comparing two diagnostic systems: a preliminary assessment. Acad Radiol 2005;12:1293-300. (Pubitemid 41354255)
31. Wieand S, Gail MH, James BR, James KL. A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data. Biometrika 1989;76:585-92.