Performance of error estimators for classification

Current Bioinformatics

Volumn 5, Issue 1, 2010, Pages 53-67

  Dougherty, Edward R ^a,b,c   Sima, Chao ^b   Hua, Jianping ^b   Hanczar, Blaise ^d   Braga Neto, Ulisses M ^a  

^a Texas A and M University   (United States)

^b TRANSLATIONAL GENOMICS RESEARCH INSTITUTE   (United States)

^c UNIVERSITY OF TEXAS MD ANDERSON CANCER CENTER   (United States)

^d Université Paris Cité   (France)

Author keywords

Classification; Epistemology; Error estimation; Validity

Indexed keywords

ERROR ANALYSIS; STATISTICAL METHODS;

CLASSIFIER DESIGN; EPISTEMOLOGY; ERROR ESTIMATORS; ESTIMATION PERFORMANCE; PERFORMANCE; RESUBSTITUTION; SAMPLE ERROR; SMALL SAMPLES; TRUE ERROR; VALIDITY;

CLASSIFICATION (OF INFORMATION);

ANALYTICAL ERROR; BOOTSTRAPPING; CLASSIFICATION ALGORITHM; EPISTEMOLOGY; LINEAR REGRESSION ANALYSIS; LUNG CANCER; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; REVIEW; SAMPLE SIZE; SAMPLING ERROR;

EID: 77950126816     PISSN: 15748936     EISSN: None     Source Type: Journal    
DOI: 10.2174/157489310790596385     Document Type: Review

References (35)

1. Dougherty ER, Braga-Neto UM. Epistemology of computational biology: Mathematical models and experimental prediction as the basis of their validity. Biol Syst 2006; 14: 65-90.
2. Braga-Neto UM, Dougherty ER. Bolstered error estimation. Pattern Recognit 2004; 37: 1267-81.
3. Braga-Neto UM, Dougherty ER. Is cross-validation valid for smallsample microarray classification. Bioinformatics 2004; 20: 374-80.
4. Efron B. Bootstrap methods: another look at the jacknife. Ann Stat 1979; 7: 1-26.
5. Efron B. Estimating the error rate of a prediction rule: Improvement on cross-validation. J Am Stat Soc 1983; 78: 316-31.
6. Sima C, Dougherty ER. Optimal convex error estimators for classification. Pattern Recognit 2006; 39: 1763-80.
7. Efron B, Tibshirani R. Improvements on cross-validation: The 632+ bootstrap method. J Am Stat Assoc 1997; 92: 548-60.
8. Pudil P, Novovicova J, Kittler J. Floating search methods in feature selection. Pattern Recognit Lett 1994; 15: 1119-25.
9. Molinaro AM, Simon R, Pfeiffer RM. Prediction error estimation: A comparison of resampling methods. Bioinformatics 2005; 21: 3301-07.
10. Xiao Y, Hua J, Dougherty ER. Quantification of the impact of feature selection on cross-validation error estimation precision. EURASIP J Bioinform Syst Biol 2007; Article ID 16354, 11 pages, 2007.
11. Xu Q, Hua J, Braga-Neto UM, Xiong Z, Suh E, Dougherty ER. Confidence intervals for the true classification error conditioned on the estimated error. Tech Cancer Res Treat 2006; 5: 579-90.
12. Hanczar B, Hua J, Dougherty ER. Decorrelation of the true and estimated classifier errors in high-dimensional settings. EURASIP J Bioinform Syst Biol 2007; Article ID 38473, 12 pages, doi:10.1155/2007/38473, 2007.
13. Sima C, Braga-Neto UM, Dougherty ER. Superior feature-set ranking for small samples using bolstered error estimation. Bioinformatics 2005; 21: 1046-54.
14. Sima C, Attoor S, Braga-Neto UM, Lowey J, Suh E, Dougherty ER. Impact of error estimation on feature-selection algorithms. Pattern Recognit 2005; 38: 2472-82.
15. van de Vijver MJ, He YD, van'tVeer LJ, et al. A gene expression signature as a predictor of survival in breast cancer. Eng J Med 2002; 347: 1999-2009.
16. Bhattacharjee A, Richards WG, Staunton J, et al. Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses. Proc Natl Acad Sci USA 2001; 96: 6745-50.
17. Nutt CL, Mani DR, Betensky RA, et al. Gene expression-based classification of malignant gliomas correlates better with survival than histological classification. Cancer Res 2003; 63: 1602-07.
18. Armstrong SA, Staunton JE, Silverman LB, et al. MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia. Nat Gene 2002; 30: 41-7.
19. Moriya Y, Iyoda A, Kasai Y, et al. Prediction of lymph node metastasis by gene expression profiling in patients with primary resected lung cancer. Lung Cancer 2009; 64: 86-91.
20. Watanabe H, Mogushi K, Miura M, et al. Prediction of lymphatic metastasis based on gene expression profile analysis after brachytherapy for early-stage oral tongue carcinoma. Radiat Oncol 2008; 87: 237-42.
21. Watanabe T, Kobunai T, Toda E, et al. Gene expression signature and the prediction of ulcerative colitis-associated colorectal cancer by DNA microarray. Clin Cancer Res 2007; 13: 415-20.
22. Barrier A, Boelle PY, Roser F, et al. Stage II colon cancer prognosis prediction by tumor gene expression profiling. J Clin Oncol 2006; 24: 4685-91.
23. Kim S, Dougherty ER, Shmulevich I, et al. Identification of combination gene sets for glioma classification. Mol Cancer Therap 2002; 1: 1229-36.
24. - diffuse large B-cell lymphoma and mantle cell lymphoma. Cancer Res 2003; 63: 60-66.
25. Zhao C, Ivanov I, Dougherty ER, et al. Non-invasive detection of candidate molecular biomarkers in subjects with a history of insulin resistance and colorectal adenomas. Cancer Prev Res 2009; 2: 590-97.
26. Braga-Neto UM, Dougherty ER. Exact correlation between actual and estimated errors in discrete classification 2010; in press.
27. Dougherty ER. Small-sample issues for microarray-based classification. Comp Funct Genomics 2001; 2: 28-34.
28. Potter JD. At the interfaces of epidemiology, genetics and genomics. Nat Rev/Gene 2001; 2: 142-47.
29. Mehta T, Murat T, Allison DB. Towards sound epistemological foundations of statistical methods for high-dimensional biology. Nat Gene 2004; 36: 943-47.
30. Michiels S, Koscielny S, Hill C. Prediction of cancer outcome with microarrays; A multiple random validation strategy. Lancet 2005; 365: 482-88.
31. Dougherty ER, Hua J, Bittner ML. Validation of computational methods in genomics. Curr Genomics 2007; 8: 1-19.
32. Dupuy A, Simon RM. Critical review of published microarray studies for cancer outcome and guidelines on statistical analysis and reporting. J Nat Cancer Ins 2007; 99: 147-57.
33. Braga-Neto UM. Fads and fallacies in the name of small-sample microarray classification. IEEE Signal Proc Mag 2007; 24: 91-99.
34. Dougherty ER. On the epistemological crisis in genomics. Curr Genomics 2008; 9: 69-79.
35. Wolkenhauer O. Why systems biology Is (Not) called systems biology. Bioforum Eur 2007; 4: 2-3.