Summary ROC curve based on a weighted Youden index for selecting an optimal cutpoint in meta-analysis of diagnostic accuracy

Statistics in Medicine

Volumn 29, Issue 30, 2010, Pages 3069-3078

  Rucker, Gerta ^a   Schumacher, Martin ^a  

^a UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Diagnostic accuracy; Meta analysis; Summary ROC curve; Youden index

Indexed keywords

ARTICLE; CORRELATION ANALYSIS; DIAGNOSTIC ACCURACY; MATHEMATICAL ANALYSIS; RECEIVER OPERATING CHARACTERISTIC; SENSITIVITY AND SPECIFICITY; VARIANCE; YOUDEN INDEX;

DIAGNOSTIC TECHNIQUES AND PROCEDURES; HUMANS; LYMPHOGRAPHY; META-ANALYSIS AS TOPIC; MODELS, STATISTICAL; REPRODUCIBILITY OF RESULTS; ROC CURVE; SENSITIVITY AND SPECIFICITY;

EID: 78650232470     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.3937     Document Type: Article

References (32)

1. Reitsma J, Glas A, Rutjes A, Scholten R, Bossuyt P, Zwinderman A. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. Journal of Clinical Epidemiology 2005; 58(10):982-990.
2. Arends LR, Hamza TH, van Houwelingen J, Heijenbrok-Kal M, Hunink M, Stijnen T. Bivariate random effects meta-analysis of ROC curves. Medical Decision Making 2008; 28(5):621-638.
3. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Statistics in Medicine 2001; 20:2865-2884.
4. Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics 2007; 8:239-251.
5. Chu H, Guo H. Letter to the editor. Biostatistics 2009; 10(1):201-203.
6. Rücker G, Schumacher M. Letter to the editor. Biostatistics 2009; 10(4):806-807.
7. Arends LR, Stijnen T. Summary ROC curves in meta-analysis of diagnostic data: Does it make sense? 2008. Available from:, ISCB Conference, Copenhagen, Poster P01.03.
8. Scheidler J, Hricak H, Yu K, Subak L, Segal M. Radiological evaluation of lymph node metastases in patients with cervical cancer. A meta-analysis. Journal of the American Medical Association 1997; 278(13):1096-1101.
9. Moses L, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Statistics in Medicine 1993; 12(14):1293-1316.
10. Youden WJ. Index for rating diagnostic tests. Cancer 1950; 3(1):32-35.
11. Hilden J, Glasziou P. Regret graphs, diagnostic uncertainty and Youden's index. Statistics in Medicine 1996; 15(10):969-986.
12. Perkins NJ, Schisterman EF. The Youden index and the optimal cut-point corrected for measurement error. Biometrical Journal 2005; 47(4):428-441.
13. Fluss R, Faraggi D, Reiser B. Estimation of the Youden index and its associated cutoff point. Biometrical Journal 2005; 47(4):458-472.
14. Gerds TA, Cai T, Schumacher M. The performance of risk prediction models. Biometrical Journal 2008; 50(4):457-479.
15. Kraemer HC. Reconsidering the odds ratio as a measure of 2 × 2 association in a population. Statistics in Medicine 2004; 23(2):257-270.
16. Gail MH, Green SB. A generalization of the one-sided two-sample Kolmogorov-Smirnov statistic for evaluating diagnostic tests. Biometrics 1976; 32(3):561-570.
17. Baker SG, Kramer BS. Peirce, Youden, and receiver operating characteristic curves. The American Statistician 2007; 61(4):343-346.
18. Peirce C. The numerical measure of the success of predictions. Science 1884; 4:453-454.
19. Metz CE. Basic principles of ROC analysis. Seminars in Nuclear Medicine 1978; 8(4):283-298.
20. Hand DJ. Measuring classifier performance: a coherent alternative to the area under the roc curve. Machine Learning 2009; 77(1):103-123.
21. Hand DJ. Evaluating diagnostic tests: the area under the ROC curve and the balance of errors. Statistics in Medicine 2010; DOI: 10.1002/sim.3859.
22. Holling H, Böhning D, Böhning W. Meta-analysis of binary data based upon dichotomized criteria. Journal of Psychology 2007; 215(2):122-131.
23. Böhning D, Böhning W, Holling H. Revisiting Youden's index as a useful measure of the misclassification error in meta-analysis of diagnostic studies. Statistical Methods in Medical Research 2008; 17:543-554.
24. Walter SD. Properties of the summary receiver operating characteristic (ROC) curve for diagnostic test data. Statistics in Medicine 2002; 21:1237-1256.
25. Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters 2006; 27:861-874.
26. Zwinderman AH, Bossuyt PM. We should not pool diagnostic likelihood ratios in systematic reviews. Statistics in Medicine 2008; 27:687-697.
27. Cleophas TJ, Zwinderman AH. Meta-analyses of diagnostic studies. Clinical Chemistry and Labor Medicine 2009; 47(11):1351-1354.
28. Macaskill P. Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis. Journal of Clinical Epidemiology 2004; 57(9):925-932.
29. Chappell F, Raab G, Wardlaw J. When are summary ROC curves appropriate for diagnostic meta-analyses? Statistics in Medicine 2009; 28(21):2653-2668.
30. Klotsche J, Ferger D, Pieper L, Rehm J, Wittchen H. A novel nonparametric approach for estimating cut-offs in continuous risk indicators with application to diabetes epidemiology. BMC Medical Research Methodology 2009; 9:63. Available from: .
31. Leeflang MMG, Moons KGM, Reitsma JB, Zwinderman AH. Bias in sensitivity and specificity caused by data-driven selection of optimal cutoff values: mechanisms, magnitude, and solutions. Clinical Chemistry 2008; 54(4):729-737.
32. R Development Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria, 2008. Available from: ISBN 3-900051-07-0.