Accuracy and cut-off point selection in three-class classification problems using a generalization of the Youden index

Statistics in Medicine

Volumn 29, Issue 28, 2010, Pages 2946-2955

  Nakas, Christos T ^a   Alonzo, Todd A ^b   Yiannoutsos, Constantin T ^c  

^a UNIVERSITY OF THESSALY   (Greece)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c INDIANA UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Accuracy; Cut off selection; Maximally selected statistics; Random walks; ROC analysis; True class rate; Youden index

Indexed keywords

CREATININE; N ACETYLASPARTIC ACID;

ARTICLE; CLASSIFICATION ALGORITHM; CONTROLLED STUDY; DATA ANALYSIS; DIAGNOSTIC ACCURACY; DISCRIMINANT ANALYSIS; DISEASE CLASSIFICATION; HUMAN; HUMAN IMMUNODEFICIENCY VIRUS INFECTION; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NONPARAMETRIC TEST; NUCLEAR MAGNETIC RESONANCE SPECTROSCOPY; PARAMETRIC TEST; RECEIVER OPERATING CHARACTERISTIC; SAMPLE SIZE; SENSITIVITY AND SPECIFICITY; SIMULATION; VALIDITY; YOUDEN INDEX;

AIDS DEMENTIA COMPLEX; ASPARTIC ACID; BIAS (EPIDEMIOLOGY); BIOLOGICAL MARKERS; BIOSTATISTICS; CLASSIFICATION; COMPUTER SIMULATION; CREATINE; DATA INTERPRETATION, STATISTICAL; DIAGNOSTIC TESTS, ROUTINE; HUMANS; MAGNETIC RESONANCE SPECTROSCOPY; MODELS, STATISTICAL; ROC CURVE; STATISTICS, NONPARAMETRIC;

EID: 78649575097     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.4044     Document Type: Article

References (29)

1. Nadler JV, Cooper JR. N-acetyl-aspartic acid content of human neural tumors and bovine peripheral nervous tissue. Journal of Neurochemistry 1972; 19:313-319.
2. López-Villegas D, Lenkinski RE, Frank I. Biochemical changes in the frontal lobe of HIV-infected individuals detected by magnetic resonance spectroscopy. Proceedings of the National Academy of Sciences of the United States of America 1997; 94:9854-9859.
3. Pepe MS. The Statistical Evaluation of Medical Tests for Classification and Prediction. Oxford University Press: Oxford, 2003.
4. Greiner M, Pfeiffer D, Smith RD. Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Preventive Veterinary Medicine 2000; 45:23-41.
5. Schäfer H. Constructing a cut-off point for a quantitative diagnostic test. Statistics in Medicine 1989; 8:1381-1391.
6. Miller R, Siegmund D. Maximally selected chi square statistics. Biometrics 1982; 38:1011-1016.
7. Lausen B, Schumacher M. Maximally selected rank statistics. Biometrics 1992; 48:73-85.
8. Lausen B, Schumacher M. Evaluating the effect of optimized cutoff values in the assessment of prognostic factors. Computational Statistics and Data Analysis 1996; 21:307-326.
9. 2 statistics for k × 2 tables. Biometrics 1999; 55:317-320.
10. Hothorn T, Zeileis A. Generalized maximally selected statistics. Biometrics 2008; 64:1263-1269.
11. Gail MH, Green SB. A generalization of the one-sided two-sample Kolmogorov-Smirnov statistic for evaluating diagnostic tests. Biometrics 1976; 32:561-570.
12. Youden WJ. Index for rating diagnostic tests. Cancer 1950; 3:32-35.
13. Perkins NJ, Schisterman EF. The inconsistency of 'optimal' cut-points using two roc based criteria. American Journal of Epidemiology 2006; 163:670-675.
14. Fluss R, Faraggi D, Reiser B. Estimation of the Youden index and its associated cutoff point. Biometrical Journal 2005; 47:458-472.
15. Scurfield BK. Multiple-event forced-choice tasks in the theory of signal detectability. Journal of Mathematical Psychology 1996; 40:253-269.
16. Mossman D. Three-way ROCs. Medical Decision Making 1999; 19:78-89.
17. Nakas CT, Yiannoutsos CT. Ordered multiple-class ROC analysis with continuous measurements. Statistics in Medicine 2004; 23:3437-3449.
18. Nakas CT, Alonzo TA. ROC graphs for assessing the ability of a diagnostic marker to detect three disease classes with an umbrella ordering. Biometrics 2007; 63:603-609.
19. He X, Frey EC. Three-class roc analysis-the equal error utility assumption and the optimality of three-class roc surface using the ideal observer. IEEE Transactions on Medical Imaging 2006; 25:979-986.
20. Le CT. Evaluation of confounding effects in roc studies. Biometrics 1997; 53:998-1007.
21. Box GEP, Cox DR. An analysis of transformations. Journal of the Royal Statistical Society, Series B 1964; 26:211-246.
22. Burton A, Altman DG, Royston P, Holder RL. The design of simulation studies in medical statistics. Statistics in Medicine 2006; 25:4279-4292.
23. Edgington E, Onghena P. Randomization Tests (4th edn). Chapman & Hall/CRC: London/Boca Raton, FL, 2007.
24. Navia BA, Jordan BD, Price RW. The aids dementia complex: I. Clinical features. Annals of Neurology 1986; 19:517-524.
25. Navia BA, Cho ES, Petito CK, Price RW. The aids dementia complex: Ii. Neuropathology. Annals of Neurology 1986; 19:525-535.
26. 1H magnetic resonance spectroscopic imaging. Neurology 1993; 43:509-515.
27. 1H-MRSI in cognitively impaired HIV-seropositive individuals. Magnetic Resonance Imaging 1994; 12:653-659.
28. Chang L, Lee PL, Yiannoutsos CT, Ernst T, Marra CM, Richards T, Kolson D, Schifitto G, Jarvik JG, Miller EN, Lenkinski R, Gonzalez G, Navia BA. A multicenter in vivo proton-MRS study of HIV-associated dementia and its relationship to age. NeuroImage 2004; 23:1336-1347.
29. Antinori A, Arendt G, Becker J, Brew B, Byrd D, Cherner M, Clifford D, Cinque P, Epstein L, Goodkin K, Gisslen M, Grant I, Heaton R, Joseph J, Marder K, Marra C, McArthur J, Nunn M, Price R, Pulliam L, Robertson K, Sacktor N, Valcour V, Wojna V. Updated research nosology for HIV-associated neurocognitive disorders. Neurology 2007; 69:1789-1799.