Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data

Statistics in Medicine

Volumn 17, Issue 9, 1998, Pages 1033-1053

  Metz, Charles E ^a   Herman, Benjamin A ^a   Shen, Jong Her ^b  

^a UNIVERSITY OF CHICAGO MEDICAL CENTER   (United States)

^b NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; DATA ANALYSIS; EPIDEMIOLOGICAL DATA; HUMAN; RECEIVER OPERATING CHARACTERISTIC;

ALGORITHMS; HUMANS; LIKELIHOOD FUNCTIONS; NORMAL DISTRIBUTION; ROC CURVE;

EID: 0032525017     PISSN: 02776715     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1097-0258(19980515)17:9<1033::AID-SIM784>3.0.CO;2-Z     Document Type: Article

References (44)

1. Wald, A. Statistical Decision Functions, Wiley, New York, 1950.
2. Van Meter, D. and Middleton, D. 'Modern statistical approaches to reception in communication theory', IRE Transactions, PGIT-4, 119-141 (1954).
3. Peterson, W. W., Birdsall, T. G. and Fox W. C. 'The theory of signal detectability', IRE Transactions, PGIT-4, 171-212 (1954).
4. Tanner, W. P. Jr. and Swets, J. A. 'A decision-making theory of visual detection', Psychological Review, 61, 401-409 (1954).
5. Swets, J. A., Tanner, W. P. Jr. and Birdsall, T. G. 'Decision processes in perception', Psychological Review, 68, 301-340 (1961).
6. Swets, J. A. (ed.). Signal Detection and Recognition by Human Observers: Contemporary Readings, Wiley, New York, 1964.
7. Green, D. M. and Swets, J. A. Signal Detection Theory and Psychophysics, Wiley, New York, 1966. (Reprinted with corrections and updated topical bibliographies by Krieger, Huntington, NY, 1974 and by Peninsula Publishing, Los Altos, CA, 1988.)
8. Swets, J. A. 'The relative operating characteristic in psychology', Science, 182, 990-1000 (1973).
9. Lusted, L. B. 'Logical analysis in Roentgen diagnosis', Radiology, 74, 178-193 (1960).
10. Lusted, L. B. Introduction to Medical Decision Making, Thomas Springfield, IL, 1968.
11. Lusted, L. B. 'Decision-making studies in patient management', New England Journal of Medicine, 284, 416-424 (1971).
12. Lusted, L. B. 'Signal detectability and medical decision-making', Science, 171, 1217-1219 (1971).
13. Swets, J. A. 'Signal detection in medical diagnosis', in Jacquez, J. A. (ed.), Computer Diagnosis and Diagnostic Methods, Thomas Springfield, IL, 1972, pp. 8-28.
14. McNeil, B. J., Keeler, E. and Adelstein, S. J. 'Primer on certain elements of medical decision making', New England Journal of Medicine, 293, 211-215 (1975).
15. McNeil, B. J. and Adelstein, S. J. 'Determining the value of diagnostic and screening tests', Journal of Nuclear Medicine, 17, 439-448 (1976).
16. Weinstein, M. C. and Fineberg, H. V. Clinical Decision Analysis, Saunders, Philadelphia, 1980.
17. Griner, P. F., Mayewski, R. J., Mushlin, A. I. and Greenland, P. 'Selection and interpretation of diagnostic tests and procedures: principles and applications', Annals of Internal Medicine, 94, 553-592 (1981).
18. Robertson, E. A., Zweig, M. H. and Van Steirtghem, A. C. 'Evaluating the clinical efficacy of laboratory tests', American Journal of Clinical Pathology, 79, 78-86 (1983).
19. Swets, J. A. 'Measuring the accuracy of diagnostic systems', Science, 240, 1285-1293 (1988).
20. Zweig, M. H. and Campbell, G. 'Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine', Clinical Chemistry, 39, 561-177 (1993). [Erratum published in Clinical Chemistry, 39, 1589 (1993).]
21. Goodenough, D. J., Rossmann, K. and Lusted, L. B. 'Radiographic applications of signal detection theory', Radiology, 105, 199-200 (1972).
22. Goodenough, D. J., Rossmann, K. and Lusted, L. B. 'Radiographic applications of receiver operating characteristic (ROC) analysis', Radiology, 110, 89-95 (1974).
23. Metz, C. E. 'Basic principles of ROC analysis', Seminars in Nuclear Medicine, 8, 283-298 (1978).
24. Swets, J. A. 'ROC analysis applied to the evaluation of medical imaging techniques', Investigative Radiology, 14, 109-121 (1979).
25. Swets, J. A. and Pickett, R. M. Evaluation of Diagnostic Systems: Methods from Signal Detection Theory, Academic Press, New York, 1982.
26. Metz, C. E. 'ROC methodology in radiologic imaging', Investigative Radiology, 21, 720-733 (1986).
27. Metz, C. E. 'Some practical issues of experimental design and data analysis in radiological ROC studies', Investigative Radiology, 24, 234-245 (1989).
28. Hanley, J. A. 'Receiver operating characteristic (ROC) methodology: the state of art', CRC Critical Reviews in Diagnostic Imaging, 29, 307-335 (1989).
29. Dorfman, D. D. and Alf, E. 'Maximum likelihood estimation of parameters of signal detection theory and determination of confidence intervals - rating method data', Journal of Mathematical Psychology, 6, 487-496 (1969).
30. Grey, D. R. and Morgan, B. J. T. 'Some aspects of ROC curve-fitting: normal and logistic models', Journal of Mathematical Psychology, 9, 128-139 (1972).
31. Kendall, M. and Stuart, A. The Advanced Theory of Statistics, Volume 2, 4th edn, MacMillan, New York, 1979, pp. 52-56.
32. Metz, C. E. 'Statistical analysis of ROC data in evaluating diagnostic performance', in Herbert, D. and Myers, R. (eds), Multiple Regression Analysis: Applications in the Health Sciences, American Institute of Physics, New York, 1986, pp. 365-384.
33. Rockette, H. E., Gur, D. and Metz, C. E. 'The use of continuous and discrete confidence judgements in receiver operating characteristic studies of diagnostic imaging techniques', Investigative Radiology, 27, 169-172 (1992).
34. Egan, J. P. Signal Detection Theory and ROC Analysis, Academic Press, New York, 1975.
35. Goddard, M. J. and Hinberg, I. 'Receiver operating characteristic (ROC) curves and non-normal data: an empirical study', Statistics in Medicine, 9, 325-337 (1990).
36. Swets, J. A. 'Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance', Psychological Bulletin, 99, 181-198 (1986).
37. Hanley, J. A. 'The robustness of the "binormal" assumptions used in fitting ROC curves', Medical Decision Making, 8, 197-203 (1988).
38. Hanley, J. A. 'The use of the "binormal" model for parametric ROC analysis of quantitative diagnostic tests', Statistics in Medicine, 15, 1575-1585 (1996).
39. Hajian-Tilaki, K. O., Hanley, J. A., Joseph, L. and Collet, J.-P. 'A comparison of parametric and nonparametric approaches to ROC analysis of quantitative diagnostic tests', Medical Decision Making, 17, 94-102 (1997).
40. Kendall, M. and Stuart, A. The Advanced Theory of Statistics, Volume 2, 4th edn, MacMillan, New York, 1979, p. 41.
41. McNeil, B. J. and Hanley, J. A. 'Statistical approaches to the analysis of receiver operating characteristic (ROC) curves', Medical Decision Making, 4, 137-150 (1984).
42. Bamber, D. 'The area above the ordinal dominance graph and the area below the receiver operating graph', Journal of Mathematical Psychology, 12, 387-415 (1975).
43. Hsieh, F. and Turnbull, B. W. 'Nonparametric and semiparametric estimation of the receiver operating characteristic curve', Annals of Statistics, 24, 25-40 (1996).
44. Zou, K. H. and Hall, W. J. 'Semiparametric and parametric transformation models for estimating a receiver operating characteristic (ROC) curve from continuous diagnostic test data', Technical Report 97/01, Department of Biostatistics, University of Rochester, 1997. Presented at the 1997 ENAR Spring Meeting, Memphis, TN, 1997.