Estimating misclassification error: A closer look at cross-validation based methods

BMC Research Notes

Volumn 5, Issue , 2012, Pages

  Ounpraseuth, Songthip ^a   Lensing, Shelly Y ^a   Spencer, Horace J ^a   Kodell, Ralph L ^a  

^a UNIVERSITY OF ARKANSAS FOR MEDICAL SCIENCES   (United States)

Author keywords

Bootstrap Cross validation; Classification Error Estimation; Cross validation; Mean Squared Error

Indexed keywords

BOVINE CORONAVIRUS;

ALGORITHM; ARTICLE; BREAST TUMOR; COMPUTER SIMULATION; DNA MICROARRAY; FEMALE; GENE EXPRESSION; GENE EXPRESSION PROFILING; GENETICS; HUMAN; METHODOLOGY; MONTE CARLO METHOD; PREDICTIVE VALUE; PROGNOSIS;

ALGORITHMS; BREAST NEOPLASMS; COMPUTER SIMULATION; FEMALE; GENE EXPRESSION; GENE EXPRESSION PROFILING; HUMANS; MONTE CARLO METHOD; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; PREDICTIVE VALUE OF TESTS; PROGNOSIS; RESEARCH DESIGN;

MLCS; MLOWN;

EID: 84870053438     PISSN: None     EISSN: 17560500     Source Type: Journal    
DOI: 10.1186/1756-0500-5-656     Document Type: Article

References (19)

1. Ensemble methods for classification of patients for personalized medicine with high-dimensional data. Moon H, Ahn H, Kodell RL, Baek S, Lin C-J, Chen JJ, Artif Intell Med 2007 41 197 207 10.1016/j.artmed.2007.07.003 17719213
2. Hastie T, Tibshirani R, Friedman J, The Elements of Statistical Learning: Data Mining, Inference and Prediction Springer, New York 2001
3. Selection bias in gene extraction on the basis of microarray gene-expression data. Ambroise C, McLachlan GJ, Proc Natl Acad Sci 2002 99 6562 6566 10.1073/pnas.102102699 11983868
4. An evaluation of resampling methods for assessment of survival risk prediction in high-dimensional settings. Subramanian J, Simon R, Stat Med 2011 30 642 653 10.1002/sim.4106 21337359
5. Evolutionary ensembles with negative correlation learning. Liu Y, Yao X, Higuchi T, IEEE Trans Evol Comput 2000 4 380 387 10.1109/4235.887237
6. The utility of structure-activity relationship (SAR) models for prediction and covariate selection in developmental toxicity: comparative analysis of logistic regression and decision tree models. Arena VC, Sussman NB, Mazumdar S, Yu S, Macina OT, SAR QSAR Environ Res 2004 15 1 18 10.1080/1062936032000169633 15113065
7. Prediction error estimation: a comparison of resampling methods. Molinaro AM, Simon R, Pfeiffer RM, Bioinformatics 2005 21 3301 3307 10.1093/ bioinformatics/bti499 15905277
8. Estimating the error rate of a prediction rule: improvement on cross-validation. Efron B, J Amer Stat Assoc 1983 78 316 331 10.1080/01621459.1983.10477973
9. Improvements on cross-validation: the.632+ Bootstrap method. Efron B, Tibshirani R, J Amer Stat Assoc 1997 92 548 560
10. Estimating misclassification error with small samples via bootstrap cross-validation. Fu WJ, Carroll RJ, Wang S, Bioinformatics 2005 21 1979 1986 10.1093/bioinformatics/bti294 15691862
11. Estimating classification error rate: repeated cross-validation, repeated hold-out and bootstrap. Kim J-H, Comput Stat Data Anal 2009 53 3735 3745 10.1016/j.csda.2009.04.009
12. Regularized discriminant analysis. Friedman J, J Amer Stat Assoc 1989 84 165 175 10.1080/01621459.1989.10478752
13. R Core Development Team, R: A Language and Environment for Statistical Computing R Foundation for Statistical Computing, Vienna, Austria 2007 http://www.R-project.org, accessed November 2, 2007
14. SAS, SAS/IML 9.1 User's Guide SAS Institute, Inc, Cary, North Carolina 2004
15. On the bias and variability of bootstrap and cross-validation estimates of error rate in discrimination problems. Davison AC, Hall P, Biometrika 1992 79 2 279 284 10.1093/biomet/79.2.279
16. Efron B, Tibshirani R, An Introduction to the Bootstrap Chapman & Hall/CRC, Boca Raton, Florida 1993
17. Gene expression profiling predicts clinical outcome of breast cancer. Van't Veer LJ, Dai H, Van de Vijver MJ, He YD, Hart AA, Mao M, et al. Nature 2002 415 530 536 10.1038/415530a 11823860
18. A gene-expression signature as a predictor of survival in breast cancer. Van de Vijver MJ, He YD, et al. N Engl J Med 2002 347 1999 2009 10.1056/NEJMoa021967 12490681
19. Tumor classification by partial least squares using microarray gene expression data. Nguyen VD, Rocke MD, Bioinformatics 2002 18 39 50 10.1093/bioinformatics/18.1.39 11836210