Visualizing the operating range of a classification system

Journal of the American Medical Informatics Association

Volumn 19, Issue 4, 2012, Pages 529-532

  Hripcsak, George ^a  

^a NewYork Presbyterian Hospital   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ARTICLE; CLASSIFICATION; COMPARATIVE STUDY; MATHEMATICAL ANALYSIS; PREVALENCE; RECEIVER OPERATING CHARACTERISTIC; SENSITIVITY AND SPECIFICITY;

AUDIOVISUAL AIDS; CLASSIFICATION; COST-BENEFIT ANALYSIS; DATA MINING; HUMANS; INFORMATION SYSTEMS; MODELS, THEORETICAL; PREVALENCE; ROC CURVE; SENSITIVITY AND SPECIFICITY; TECHNOLOGY ASSESSMENT, BIOMEDICAL;

EID: 84865166886     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1136/amiajnl-2011-000633     Document Type: Article

References (18)

1. Metz CE. Basic principles of ROC analysis. Semin Nucl Med 1978;8:283-98.
2. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982;143:29-36.
3. Swets JA. ROC analysis applied to the evaluation of medical imaging techniques. Invest Radiol 1979;14:109-21.
4. Hand DJ. Measuring classifier performance: a coherent alternative to the area under the ROC curve. Mach Learn 2009;77:103-23.
5. van Rijsbergen CJ. Information Retrieval. 2nd edn. London: Butterworths, 1979.
6. Chinchor N, Hirschman L, Lewis DD. Evaluating message understanding systems: an analysis of the Third Message Understanding Conference (MUC-3). Comput Ling 1993;19:409-49. http://www.ldc.upenn.edu/acl/J/J93/J93-3001.pdf (accessed 10 Jan 2012).
7. Hripcsak G, Rothschild AS. Agreement, the F-measure, and reliability in information retrieval. J Am Med Inform Assoc 2005;12:296-8.
8. Fleiss JL. Measuring agreement between two judges on the presence or absence of a trait. Biometrics 1975;31:651-9.
9. Hripcsak G, Heitjan D. Measuring agreement in medical informatics reliability studies. J Biomed Inform 2002;35:99-110.
10. Melton GB, Hripcsak G. Automated detection of adverse events using natural language processing in discharge summaries. J Am Med Inform Assoc 2005;12:448-57.
11. Murff HJ, FitzHenry F, Matheny ME, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA 2011;306:848-55.
12. Sox HC, Blatt MA, Higgins MC, et al. Medical Decision Making. Boston: Butterworths, 1988.
13. Botsis T, Nguyen MD, Woo EJ, et al. Text mining for the vaccine adverse event reporting system: medical text classification using informative feature selection. J Am Med Inform Assoc 2011;18:631-8.
14. van de Glind EM, van Munster BC, Spijker R, et al. Search filters to identify geriatric medicine in Medline. J Am Med Inform Assoc 2012;19:468-72.
15. Wei W, Visweswaran S, Cooper GF. The application of naive Bayes' model averaging to predict Alzheimer's disease from genome-wide data. J Am Med Inform Assoc 2011;18:370-5.
16. Pollack I, Norman DA. A non-parametric analysis of recognition experiements. Psychon Sci 1964;1:125-6.
17. Norman DA. A comparison of data obtained with different false-alarm rates. Psychol Rev 1964;71:243-6.
18. 18. Martin A, Doddington G, Kamm T, et al. The DET curve in assessment of detection task performance. In: Kokkinakis G, Fakotakis N, Dermatas E, eds. European Speech Communication Association (ESCA) 5th European Conference on Speech Communication and Technology: EUROSPEECH '97. 22-25 September 1997. Rhodes, Greece: 1997;4:1899-903.