On ROC analysis with nonbinary reference standard

Biometrical Journal

Volumn 54, Issue 4, 2012, Pages 457-480

  Shiu, Shang Ying ^a   Gatsonis, Constantine ^b  

^a NATIONAL TAIPEI UNIVERSITY   (Taiwan)

^b BROWN UNIVERSITY   (United States)

Author keywords

Diagnostic test; Reference standard; ROC analysis

Indexed keywords

ACCURACY OF DIAGNOSTIC TESTS; DIAGNOSTIC TESTS; ISOTONIC REGRESSION; NON-BINARY; ORDER RESTRICTION; REFERENCE STANDARD; ROC ANALYSIS; ROC CURVES; SEMI-PARAMETRIC MODELING; THRESHOLD-VALUE;

DIAGNOSIS;

EID: 84863538213     PISSN: 03233847     EISSN: 15214036     Source Type: Journal    
DOI: 10.1002/bimj.201100206     Document Type: Article

References (39)

1. Alonzo, T. A., Nakas, C. T., Yiannoutsos, C. T., and Bucher, S. (2009). A comparison of tests for restricted orderings in the three-class case. Statistics in Medicine 28, 1144-1158.
2. Avril N., Bense, S., Ziegler, S. I., Dose, J., Weber, W., Laubenbacher, C., Römer, W., Jänicke, F., and Schwaiger, M. (1997). Breast imaging with fluorine-18-FDG PET: quantitative image analysis. The Journal of Nuclear Medicine 38, 1186-1191.
3. Barlow, R. E., Bartholomew, R. J., Bremner, J. M., and Brunk, H. D. (1972). Statistical Inference under Order Restrictions. John Willey & Sons, New York.
4. Bowman, A. W., Jones, M. C., and Gijbels, I. (1998). Testing monotonicity of regression. Journal of Computational and Graphical Statistics 7, 489-500.
5. Carlin, B. P., and Louis, T. A. (2009). Bayesian Methods for Data Analysis. Chapman and Hall, Boca Raton, FL.
6. Cramer, E., and Appelbaum, M. (1978). The validity of polynomial regression in the random regression model. Review of Educational Research 48, 511-515.
7. Denison, D., Mallick, B. K., and Smith, A. (1998). Automatic Bayesian curve fitting. Journal of the Royal Statistical Society, Series B 60, 333-350.
8. Dorfman, D., and Alf, E. (1968). Maximum likelihood estimation of parameters of signal detection theory¡XA direct solution. Psychometrika 33, 117-124.
9. Doveh, E., Shapiro, A., and Feigin, P. D. (2002). Testing of monotonicity in parametric regression models. Journal of Statistical Planning and Inference 107, 289-306.
10. Dreiseitl, S., Ohno-Machado, S., and Binder, M. (2000). Comparing three-class diagnostic tests by three-way ROC analysis. Medical Decision Making 20, 323-331.
11. Hand, D. J., and Till, R. J. (2001). A simple generalization of the area under the ROC curve for multiple class classification problems. Machine Learning 45, 171-186.
12. Harrell, F. E. Jr., Califf, R. M., Pryor, D. B., Lee, K. L., and Rosati, R. A. (2001). Evaluating the yield of medical tests. Journal of the American Medical Association 247, 2543-2546.
13. Hastie, T. and Tibshirani, R. (1990). Generalized Additive Models. Chapman and Hall, London.
14. Heckerling, P. S. (2001). Parametric three-way receiver operating characteristic surface analysis using Mathematica. Medical Decision Making 247, 409-417.
15. Holmes, C. C., and Malick B. K., (2001). Bayesian regression with multivariate linear splines. Journal of the Royal Statistical Society, Series B 63, 3-17.
16. Johnson, C. D., Chen, M., Toledano, A. Y., Heiken, J. P., Dachman, A., Kuo, M. D., Menias, C. O., Siewert, B., Cheema, J. I., Robregon, R. G., Fidler, J. L., Zimmerman, P., Horton, K. M., Coakley, K., Iyer, R. B., Hara, A. K., Halvorsen, R. A. Jr., Casola, G., Yee, J., Herman, B. A., Burgart, L. J., and Limburg, P. J. (2008). Accuracy of CT colonography for detection of large adenomas and cancers. New England Journal of Medicine 359, 1207-1217.
17. Li, J., and Fine, J. P. (2008). ROC analysis with multiple tests and multiple classes: methodology and applications in microarray studies. Biostatistics 9, 566-576.
18. Li, J., and Fine, J. P. (2010). Weighted area under the receiver operating characteristic curve and its applicatino to gene selection. Applied Statistics 59, 673-692.
19. Li, J., and Zhou, X. (2009). Nonparametric and semiparametric estimation of the three way receiver operating characteristic surface. Journal of Statistical Planning and Inference 139, 4133-4142.
20. Morrin, M. M., and Lamont, J. T. (2003). Screening virtual colonscopy-ready for prime time?New England Journal of Medicine349, 2261-2264.
21. Mossman, D. (1999). Three-way ROCs. Medical Decision Making 19, 78-89.
22. Nakas, C. T., and Alonzo, T. A. (2007). ROC graphs for assessing the ability of a diagnostic marker to detect three disease classes with an umbrella ordering. Biometrics 63, 603-609.
23. Nakas, C. T., and Yiannoutsos, C. T. (2004). Ordered multiple-class ROC analysis with continuous measurements. Statistics in Medicine 23, 3437-3449.
24. Neelon, B., and Dunson, D. B. (2004). Bayesian isotonic regression and trend analysis. Biometrics 60, 398-406.
25. Obuchowski, N. A. (2005). Estimating and comparing diagnostic tests¡| accuracy when the gold standard is not binary. Academic Radiology 12, 1198-1204.
26. Obuchowski, N. A. (2006). An ROC-type measure of diagnostic accuracy when the gold standard is continuous-scale. Statistics in Medicine 25, 481-493.
27. Pewsner, D., Jüni, P., Egger, M., Battaglia, M., Sundström, J., and Bachmann, L. M. (2007). Accuracy of electrocardiography in diagnosis of left ventricular hypertrophy in arterial hypertension: systematic review. British Medical Journal 335, 711-719.
28. Ramsay, J. O. (1998). Estimating smooth monotone functions. Journal of the Royal Statistical Society, Series B 60, 365-375.
29. Rigby, R. A., and Stasinopoulos, D. M. (1996). A Semi-parametric additive model for variance heterogeneity. Statistics and Computing 6, 57-65.
30. Silverman, B. W. (1985). Some aspects of the spline smoothing approach to non-parametric regression curve fitting. Journal of the Royal Statistical Society, Series B 47, 1-52.
31. Teicher, H. (1960). On the mixtures of distributions. Annals of Mathematical Statistics 31, 55-73.
32. Titterington, D. M., Smith, A. F. M., and Makov, U. E. (1985). Statistical Analysis of Finite Mixture Distributions. Wiley Series in Probability and Statistics, New York, pp. 38-39.
33. Tosteson, A. N., and Begg, C. B. (1988). A General Regression Methodology for ROC Curve Estimation. Medical Decision Making 8, 204-215.
34. Venables, W. N., and Ripley, B. D. (1995). Modern Applied Statistics with S-Plus. Springer-Verlag.
35. Wahl, R. L., Siegel, B. A., Coleman, R. E. and Gatsonis, C. G. (2004). Prospective multicenter study of axillary nodal staging by positron emission tomography in breast cancer: a report of the staging breast cancer with PET study group. Journal of Clinical Oncology 22, 277-285.
36. Xiong, C., van Belle, G., Miller, J. P., and Morris, J. C. (2006). Measuring and estimating diagnostic accuracy when there are three ordinal diagnostic groups. Statistics in Medicine 25, 1251-1273.
37. Xiong, C., van Belle, G., Miller, J. P., Yan, Y., Gao, F., Yu, K., and Morris, J. C. (2007). A parametric comparison of diagnostic accuracy with three ordinal diagnostic groups. Biometrical Journal 49, 682-693.
38. Zhang, Y., and Li, J. (2011). Combining multiple markers for multi-category classification: an ROC surface approach. Australian and New Zealand Journal of Statistics 53, 63-78.
39. Zhou, X. (1996). Empirical Bayes combination of estimated areas under ROC curves using estimating equations. Medical Decision Making 16, 24-28.