Boosting for high-dimensional two-class prediction

BMC Bioinformatics

Volumn 16, Issue 1, 2015, Pages

  Blagus, Rok ^a   Lusa, Lara ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

AdaBoost.M1; Boosting; Class prediction; Gradient boosting; LogitBoost; Stochastic Gradient boosting

Indexed keywords

ADAPTIVE BOOSTING; ALGORITHMS; CLUSTERING ALGORITHMS; DATA MINING; FORECASTING; GENE EXPRESSION; SHRINKAGE; STOCHASTIC SYSTEMS;

ADABOOST.M1; BOOSTING; CLASS PREDICTION; GRADIENT BOOSTING; LOGITBOOST; STOCHASTIC GRADIENT BOOSTING;

CLASSIFICATION (OF INFORMATION);

ALGORITHM; CLASSIFICATION; COMPUTER SIMULATION; DNA MICROARRAY; FACTUAL DATABASE; GENE EXPRESSION PROFILING; GENETICS; HUMAN; NEOPLASM; PROCEDURES;

ALGORITHMS; COMPUTER SIMULATION; DATABASES, FACTUAL; GENE EXPRESSION PROFILING; HUMANS; NEOPLASMS; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS;

EID: 84942019335     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/s12859-015-0723-9     Document Type: Article

References (51)

1. Bishop CM. Pattern recognition and machine learning (Information science and statistics). New York: Springer; 2007.
2. Datta S. Classification of breast cancer versus normal samples from mass spectrometry profiles using linear discriminant analysis of important features selected by random forest. Stat Appl Genet Mol Biol. 2008;7.
3. Aaroe J, Lindahl T, Dumeaux V, Sabo S, Tobin D, Hagen N, et al. Gene expression profiling of peripheral blood cells for early detection of breast cancer. Breast Cancer Res. 2010;12:R7.
4. Collins G, Mallett S, Omar O, Yu LM. Developing risk prediction models for type 2 diabetes: a systematic review of methodology and reporting. BMC Med. 2011; 9:103.
5. Sorace JM, Zhan M. A data review and re-assessment of ovarian cancer serum proteomic profiling. BMC Bioinforma. 2003; 4:24.
6. Leung F, Musrap N, Diamandis EP, Kulasingam V. Advances in mass spectrometry-based technologies to direct personalized medicine in ovarian cancer. Adv Integr Med. 2013; 1:74-86.
7. Majewski IJ, Bernards R. Taming the dragon: genomic biomarkers to individualize the treatment of cancer. Nat Med. 2011;304-12.
8. Simon R, Roychowdhury S. Implementing personalized cancer genomics in clinical trials. Nat Rev Drug Discov. 2013; 12(5):358-69.
9. Ramaswamy S, Ross KN, Lander ES, Golub TR. A molecular signature of metastasis in primary solid tumors. Nat Genet. 2003; 33:49-54.
10. Shipp MA, Ross KN, Tamayo P, Weng AP, Kutok JL, Aguiar RC, et al. Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nat Med. 2002; 8:68.
11. Iizuka N, Oka M, Yamada-Okabe H, Nishida M, Maeda Y, Mori N, et al. Oligonucleotide microarray for prediction of early intrahepatic recurrence of hepatocellular carcinoma after curative resection. The Lancet. 2003; 361(9361):923-9.
12. Gottesman O, Kuivaniemi H, Tromp G, Faucett WA, Li R, Manolio TA, et al. The electronic medical records and genomics (eMERGE) network: past, present, and future. Genet Med. 2013; 15(10):761-71.
13. Ibrahim-Verbaas CA, Fornage M, Bis JC, Choi SH, Psaty BM, Meigs JB, et al. Predicting stroke through genetic risk functions The CHARGE risk score project. Stroke. 2014; 45(2):403-12.
14. J HD. Breast cancer diagnosis from proteomic mass spectrometry data: a comparative evaluation. Stat Appl Genet Mol Biol. 2008; 7(2):1-23.
15. Schrodi SJ, Mukherjee S, Shan Y, Tromp G, Sninsky JJ, Callear AP, et al. Genetic-based prediction of disease traits: prediction is very difficult, especially about the future. Front Genet.2014;5.
16. Datta S, Pihur V, Datta S. An adaptive optimal ensemble classifier via bagging and rank aggregation with applications to high dimensional data. BMC Bioinforma. 2010; 11:427.
17. Milton JN, Steinberg MH, Sebastiani P. Evaluation of an ensemble of genetic models for prediction of a quantitative trait. Front Genet. 2014;5.
18. Breiman L. Bagging predictors. Mach Learn. 1996; 24:123-40.
19. Freund Y, Schapire RE. Experiments with a new boosting algorithm. In: Proceedings of the thirteenth international conference on machine learning. Burlington, Massachusetts: Morgan Kaufmann: 1996. p. 148-156.
20. Hastie T, Tibshirani R, Friedman J. The elements of statistical learning data mining, inference, and prediction. New York: Springer; 2003.
21. Galar M, Fernandez A, Barrenechea E, Bustince H, Herrera F. A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches. Systems, Man, and Cybernetics, Part C Appl Rev IEEE Trans. 2012; 42(4):463-84.
22. Ben-Dor A, Bruhn L, Laboratories A, Friedman N, Schummer M, Nachman I, et al. Tissue classification with gene expression profiles. J Comput Biol. 2000; 7:559-84.
23. Dudoit S, Fridlyand J, Speed TP. Comparison of discrimination methods for the classification of tumors using gene expression data. J Am Stat Assoc. 2002; 97(457):77 - 87.
24. Schapire R. The boosting approach to machine learning: An overview. In: MSRI workshop on nonlinear estimation and classification. CA: Berkley: 2001.
25. Stollhoff R, Sauerbrei W, Schumacher M. An experimental evaluation of boosting methods for classification. Methods Inform Med. 2010; 49(3):219-29.
26. Eickholt J, Cheng J. DNdisorder: predicting protein disorder using boosting and deep networks. BMC Bioinforma. 2013; 14:88.
27. Goodswen S, Kennedy P, Ellis J. A novel strategy for classifying the output from an in silico vaccine discovery pipeline for eukaryotic pathogens using machine learning algorithms. BMC Bioinforma. 2013; 14:315.
28. Jimeno-Yepes A, Plaza L, Mork J, Aronson A, Diaz A. MeSH indexing based on automatically generated summaries. BMC Bioinforma. 2013; 14:208.
29. Dettling M, Buhlmann P. Boosting for tumor classification with gene expression data. Bioinformatics. 2003; 19(9):1061-9.
30. Friedman J, Hastie T, Tibshirani R. Additive logistic regression: a statistical view of boosting. Ann Stat. 2000;38(2):337-407.
31. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. Pacific Grove, California: Wadsworth and Brooks; 1984.
32. Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Stat. 2000; 29:1189-232.
33. Friedman JH. Stochastic gradient boosting. Comput Stat Data Anal. 1999; 38:367-78.
34. Tutz G, Binder H. Boosting ridge regression. Comput Stat Data Anal. 2007; 51(12):6044-59.
35. Mayr A, Fenske N, Hofner B, Kneib T, Schmid M. Generalized additive models for location, scale and shape for high dimensional data-a flexible approach based on boosting. J R Stat Soc Series C (Appl Stat). 2012; 61(3):403-27.
36. Guo Y, Hastie T, Tibshirani R. Regularized linear discriminant analysis and its application in microarrays. Biostatistics. 2007; 8:86-100.
37. Pang H, Tong T, Zhao H. Shrinkage-based diagonal discriminant analysis and its applications in high-dimensional data. Biometrics. 2009; 65(4):1021-9.
38. Sotiriou C, Neo SY, McShane LM, Korn EL, Long PM, Jazaeri A, et al. Breast cancer classification and prognosis based on gene expression profiles from a population-based study. Proc Nat Acad Sci USA. 2003; 100(18):10393-8.
39. Wang Y, Klijn JGM, Zhang Y, Sieuwerts AM, Look MP, Yang F, et al. Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. The Lancet. 2005; 365(9460):671-9.
40. Ivshina AV, George J, Senko O, Mow B, Putti TC, Smeds J, et al. Genetic reclassification of histologic grade delineates new clinical subtypes of breast cancer. Cancer Res. 2006; 66(21):10292-301.
41. He H, Garcia EA. Learning from imbalanced data. IEEE Trans Knowl Data Eng. 2009; 21(9):1263-84.
42. Blagus R, Lusa L. Class prediction for high-dimensional class-imbalanced data. BMC Bioinforma. 2010; 11:523.
43. Fawcett T. An introduction to ROC analysis. Pattern Recognit Lett. 2006; 27(8):861-74.
44. Holm S. A simple sequentially rejective multiple test procedure. Scand J Stat. 1979; 6:65-70.
45. R Development Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2008. [ http://www.R-project.org ]. [ISBN 3-900051-07-0].
46. Breiman L. Population theory for boosting ensembles. Ann Stat. 2004; 32:1-11.
47. Mease D, Wyner AJ, Buja A. Boosted classification trees and class probability/quantile estimation. J Mach Learn Res. 2007; 8:409-39.
48. Chang YCI, Huang Y, Huang YP. Early stopping in Boosting. Comput Stat Data Anal. 2010; 54(10):2203-13.
49. Mayr A, Hofner B, Schmid M. The importance of knowing when to stop. A sequential stopping rule for component-wise gradient boosting. Methods Inform Med. 2012; 51(2):178-86.
50. Buja A, Mease D, Wyner AJ. Comment: Boosting algorithms Regularization, prediction and model fitting. Statist Sci. 2007; 22(4):506-12.
51. Mease D, Wyner A. Evidence contrary to the statistical view of boosting. J Mach Learn Res. 2008; 9:131-56.