Classification by ensembles from random partitions of high-dimensional data

Computational Statistics and Data Analysis

Volumn 51, Issue 12, 2007, Pages 6166-6179

  Ahn, Hongshik ^a   Moon, Hojin ^b   Fazzari, Melissa J ^a   Lim, Noha ^a   Chen, James J ^b   Kodell, Ralph L ^c  

^a Stony Brook University   (United States)

^b NATIONAL CENTER FOR TOXICOLOGICAL RESEARCH   (United States)

^c UNIVERSITY OF ARKANSAS FOR MEDICAL SCIENCES   (United States)

Author keywords

Class prediction; Classification tree; Cross validation; Logistic regression; Majority voting; Risk profiling

Indexed keywords

CLASSIFICATION (OF INFORMATION); PROBLEM SOLVING; RANDOM PROCESSES; SENSITIVITY ANALYSIS; TREES (MATHEMATICS);

CLASS PREDICTION; CLASSIFICATION TREE; CROSS VALIDATION; LOGISTIC REGRESSION; MAJORITY VOTING; OPTIMAL SINGLE CLASSIFIERS; RISK PROFILING;

DATA REDUCTION;

EID: 34547187749     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2006.12.043     Document Type: Article

References (43)

1. Ahn H., and Chen J.J. Tree-structured logistic model for over-dispersed binomial data with application to modeling developmental effects. Biometrics 53 (1997) 435-455
2. Akaike H. A new look at the statistical identification model. IEEE Trans. Automat. Control 19 (1974) 716-723
3. Alon U., Barkai N., Notterman D.A., Gish K., Ybarra S., Mack D., and Levine A.J. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Nat. Acad. Sci. 96 (1999) 6745-6750
4. Ambroise C., and McLachlan G.J. Selection bias in gene extraction on the basis of microarray gene-expression data. Proc. Nat. Acad. Sci. 99 (2002) 6562-6566
5. Blair R., Fang H., Branham W.S., Hass B., Dial S.L., Moland C.L., Tong W., Shi L., Perkins R., and Sheehan D.M. Estrogen receptor relative binding affinities of 188 natural and xenochemicals: structural diversity of ligands. Toxicological Sci. 54 (2000) 138-153
6. Branham W.S., Dial S.L., Moland C.L., Hass B.S., Blair R.M., Fang H., Shi L., Tong W., Perkins R., and Sheehan D.M. Phytoestrogens and mycoestrogens bind to the rat uterine estrogen receptor. J. Nutrition 132 (2002) 658-664
7. Breiman L. Bagging predictors. Mach. Learning 24 (1996) 123-140
8. Breiman L. Arcing classifiers. Ann. Statist. 26 (1998) 801-849
9. Breiman L. Random forest. Mach. Learning 45 (2001) 5-32
10. Breiman L., Friedman J.H., Olshen R.A., and Stone C.J. Classification and Regression Trees (1984), Wadsworth, Belmont, CA
11. Burnham K.P., and Anderson D.R. Model Selection and Multinomial Inference: A Practical Information-Theoretic Approach. second ed (2002), Springer, New York
12. Chen, C., Liaw, A., Breiman, L., 2004. Using random forest to learn imbalanced data. Technical Report #666, Department of Statistics, University of California, Berkeley.
13. Chen J.J., Tsai C.A., Young J.F., and Kodell R.L. Classification ensembles for unbalanced class sizes in predictive toxicology. SAR and QSAR Environmental Res. 16 (2005) 517-529
14. Dettling M., and Buhlman P. Boosting for tumor classification with gene expression data. Bioinformatics 19 (2003) 1061-1069
15. Domingos P. Metacost: a general method for making classifiers cost-sensitive. Proceedings of the 5th SIGKDD International Conference on Knowledge Discovery and Data Mining (1999), ACM Press, San Diego, CA 155-164
16. Dudoit S., and Fridlyand J. Classification in microarray experiments. In: Speed T.P. (Ed). Statistical Analysis of Gene Expression Microarray Data (2003), Chapman & Hall, CRC Press, Boca Raton, FL (Chapter 3)
17. Dudoit S., Fridlyand J., and Speed T.P. Comparison of discrimination methods for the classification of tumors using gene expression data. J. Amer. Statist. Assoc. 97 (2002) 77-87
18. Duin R.P.W., and Tax D.M.J. Experiments with classifier combining rules. In: Kittler J., and Roli F. (Eds). Lecture Notes in Computer Science vol. 1857 (2000), Springer, Berlin 16-29
19. Freund Y., and Schapire R. Experiments with a new boosting algorithm. Machine Learning: Proceedings of the Thirteenth International Conference (1996) 148-156
20. Freund Y., and Schapire R. A decision-theoretic generalization of online learning and an application to boosting. J. Comput. System Sci. 55 (1997) 119-139
21. Golub T.R., Slonim D.K., Tamayo P., Huard C., Gaasenbeek M., Mesirov J.P., Coller H., Loh M.L., Downing J.R., Caligiuri M.A., Bloomfield C.D., and Lander E.S. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286 5439 (1999) 531-537
22. Greally J.M. Short interspersed transposable elements (SINEs) are excluded from imprinted regions in the human genome. Proc. Nat. Acad. Sci. 99 (2002) 327-332
23. Hansen L.K., and Salamon P. Neural network ensembles. IEEE Trans. Pattern Anal. Mach. Intelligence 12 (1990) 993-1001
24. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2001), Springer, New York
25. Hileman B. Hormone disrupter research expands. Chem. Eng. News 75 (1997) 24-25
26. Ho T.K. The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intelligence 20 (1998) 832-844
27. Kuncheva L.I., Whitaker C.J., Shipp C.A., and Duin R.P.W. Limits on the majority vote accuracy in classifier fusion. Pattern Anal. Appl. 6 (2003) 22-31
28. Lam L., and Suen C.Y. Application of majority voting to pattern recognition: an analysis of its behavior and performance. IEEE Trans. Systems Man Cybernet. 27 (1997) 553-568
29. Loh W.-Y., and Shih Y.S. Split selection methods for classification trees. Statist. Sinica 7 (1997) 815-840
30. Michiels S., Koscielny S., and Hill C. Prediction of cancer outcome with microarrays: a multiple random validation strategy. Lancet 365 9458 (2005) 488-492
31. Miller A. Subset Selection in Regression. second ed (2002), Chapman & Hall, CRC, Los Angeles, CA
32. Molinaro A.M., Simon R., and Pfeiffer R.M. Prediction error estimation: a comparison of resampling methods. Bioinformatics 21 (2005) 3301-3307
33. Pazzani, M., Merz, C., Murphy, P., Ali, K., Hume, T., Brunk, C., 1994. Reducing misclassification costs: knowledge-intensive approaches to learning from noisy data. In: Proceedings of the 11th International Conference on Machine Learning, New Brunswick, NJ, ML-94, pp. 217-225.
34. Prentice R.L. Binary regression using an extended beta-binomial distribution, with discussion of correlation induced by covariate measurement errors. J. Amer. Statist. Assoc. 81 (1986) 321-327
35. Reik W., and Walter J. Genomic imprinting: parental influence on the genome. Natur. Rev. Genetics 2 1 (2001) 21-32
36. Schapire R.E. The strength of weak learnability. Mach. Learning 5 (1990) 197-227
37. Segal, M.R., 2004. Center for bioinformatics and molecular biostatistics. Technical Report, University of California, San Francisco.
38. Sparano J.A., Fazzari M.J., and Childs G. Clinical application of molecular profiling in breast cancer. Future Oncology 1 (2005) 485-496
39. Therneau, T.M., Atkinson, E.J., 1997. An introduction to recursive partitioning using the RPART routines. Technical Report, Mayo Foundation.
40. Tibshirani R., Hastie T., Narasimhan B., and Chu G. Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc. Nat. Acad. Sci. 99 (2002) 6567-6572
41. Tsai C.A., Chen C.H., Lee T.C., Ho I.C., Yang U.C., and Chen J.J. Gene selection for sample classifications in microarray experiments. DNA Cell Biology 23 (2004) 607-614
42. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer, New York
43. Williams D.A. The analysis of binary responses from toxicological experiments involving reproduction and teratogenicity. Biometrics 31 (1975) 949-952