A systematic evaluation of high-dimensional, ensemble-based regression for exploring large model spaces in microbiome analyses

BMC Bioinformatics

Volumn 16, Issue 1, 2015, Pages

  Shankar, Jyoti ^a   Szpakowski, Sebastian ^a   Solis, Norma V ^b   Mounaud, Stephanie ^a   Liu, Hong ^b   Losada, Liliana ^a   Nierman, William C ^a   Filler, Scott G ^b,c  

^a J CRAIG VENTER INSTITUTE   (United States)

^b UCLA MEDICAL CENTER   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bayesian model averaging; Evaluation; Microbiome analysis; Simulation design; Sparse ensemble based regression; Stability selection

Indexed keywords

BAYESIAN NETWORKS; STABILITY;

BAYESIAN MODEL AVERAGING; EVALUATION; MICROBIOME; SIMULATION DESIGN; SPARSE ENSEMBLE-BASED REGRESSION; STABILITY SELECTIONS;

REGRESSION ANALYSIS;

ANTIINFECTIVE AGENT;

BAYES THEOREM; CANDIDA ALBICANS; CANDIDIASIS; COMPUTER SIMULATION; DRUG EFFECTS; EVALUATION STUDY; GROWTH, DEVELOPMENT AND AGING; METHODOLOGY; MICROBIOLOGY; MICROFLORA; STATISTICAL MODEL;

ANTI-BACTERIAL AGENTS; BAYES THEOREM; CANDIDA ALBICANS; CANDIDIASIS; COMPUTER SIMULATION; MICROBIOTA; MODELS, STATISTICAL; RESEARCH DESIGN;

EID: 84923930979     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/s12859-015-0467-6     Document Type: Article

References (60)

1. The NIH HMP Working Group, Peterson J, Garges S, Giovanni M, McInnes P, Wang L, et al.The NIH human microbiome project. Genome Res. 2009; 19(12):2317-23. doi:10.1101/gr.096651.109.
2. Hood L. Tackling the microbiome. Science. 2012; 336(6086):1209. doi:10.1126/science.1225475.
3. Gilbert JA, Bailey M, Field D, Fierer N, Fuhrman JA, Hu B, et al.The Earth Microbiome Project: The Meeting Report for the 1st International Earth Microbiome Project Conference, Shenzhen, China, June 13th-15th 2011. Standards Genomic Sci. 2011; 5(2):243-7. doi:10.4056/sigs.2134923.
4. Chen J, Li H. Variable selection for sparse dirichlet-multinomial regression with an application to microbiome data analysis. Ann Appl Stat. 2013; 7(1):418-42. doi:10.1214/12-aoas592.
5. Xia F, Chen J, Fung WK, Li H. A logistic normal multinomial regression model for microbiome compositional data analysis. Biometrics. 2013; 69(4):1053-63. doi:10.1111/biom.12079.
6. White JR, Nagarajan N, Pop M. Statistical methods for detecting differentially abundant features in clinical metagenomic samples. PLoS Comput Biol. 2009; 5(4):1000352. doi:10.1371/journal.pcbi.1000352.
7. Paulson JN, Stine OC, Bravo HC, Pop M. Differential abundance analysis for microbial marker-gene surveys. Nat Methods. 2013; 10(12):1200-2. doi:10.1038/nmeth.2658.
8. Segata N, Izard J, Waldron L, Gevers D, Miropolsky L, Garrett W, et al.Metagenomic biomarker discovery and explanation. Genome Biol. 2011; 12(6):60. doi:10.1186/gb-2011-12-6-r60.
9. Taur Y, Xavier JB, Lipuma L, Ubeda C, Goldberg J, Gobourne A, et al.Intestinal domination and the risk of bacteremia in patients undergoing allogeneic hematopoietic stem cell transplantation. Clin Infectious Diseases. 2012; 55(7):905-14. doi:10.1093/cid/cis580.
10. Lozupone C, Knight R. UniFrac: a new phylogenetic method for comparing microbial communities. Appl Environ Microbiol. 2005; 71(12):8228-35. doi:10.1128/aem.71.12.8228-8235.2005.
11. Chen J, Bittinger K, Charlson ES, Hoffmann C, Lewis J, Wu GD, et al.Associating microbiome composition with environmental covariates using generalized UniFrac distances. Bioinformatics. 2012; 28(16):2106-13. doi:10.1093/bioinformatics/bts342.
12. Beck D, Foster JA. Machine learning techniques accurately classify microbial communities by bacterial vaginosis characteristics. PLoS One. 2014; 9(2):87830. doi:10.1371/journal.pone.0087830.
13. Knights D, Costello EK, Knight R. Supervised classification of human microbiota. FEMS Microbiol Rev. 2011; 35(2):343-59. doi:10.1111/j.1574-6976.2010.00251.x.
14. Statnikov A, Henaff M, Narendra V, Konganti K, Li Z, Yang L, et al.A comprehensive evaluation of multicategory classification methods for microbiomic data. Microbiome. 2013; 1(11). doi:10.1186/2049-2618-1-11.
15. Waldron L, Pintilie M, Tsao M-SS, Shepherd FA, Huttenhower C, Jurisica I. Optimized application of penalized regression methods to diverse genomic data. Bioinformatics. 2011; 27(24):3399-406. doi:10.1093/bioinformatics/btr591.
16. Garcia TP, Müller S, Carroll RJ, Walzem RL. Identification of important regressor groups, subgroups and individuals via regularization methods: application to gut microbiome data. Bioinformatics. 2014; 30(6):831-7. doi:10.1093/bioinformatics/btt608.
17. Lin W, Shi P, Feng R, Li H. Variable selection in regression with compositional covariates. Biometrika. 2014; 101(4):785-797. doi:10.1093/biomet/asu031.
18. Johnstone IM, Titterington DM. Statistical challenges of high-dimensional data. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences. 2009; 367(1906):4237-53. doi:10.1098/rsta.2009.0159.
19. James G, Witten D, Hastie T, Tibshirani R. An Introduction to Statistical Learning: with Applications in R, 1st edn. New York, NY, USA: Springer Series in Statistics, Springer; 2013. doi:10.1007/978-1-4614-7138-7.
20. Breiman L. Statistical modeling: The two cultures (with comments and a rejoinder by the author). Stat Sci. 2001; 16(3):199-231. doi:10.1214/ss/1009213726.
21. Yu B. Stability. Bernoulli: official journal of the Bernoulli Society for Mathematical Statistics and Probability. 2013; 19(4):1484-1500. doi:10.3150/13-bejsp14.
22. Meinshausen N, Bühlmann P. Stability selection. J R Stat Soc Ser B, Stat Methodology. 2010; 72(4):417-73. doi:10.1111/j.1467-9868.2010.00740.x.
23. Hoeting JA, Madigan D, Raftery AE, Volinsky CT. Bayesian model averaging: A tutorial. Stat Sci. 1999; 14(4):382-417. doi:10.1214/ss/1009212814.
24. George EI, McCulloch RE. Approaches for bayesian variable selection. Statistica Sinica. 1997; 7:339-73.
25. Breiman L. Random forests. Machine Learning. 2001; 45(1):5-32. doi:10.1023/A:1010933404324.
26. Mosteller F, Tukey JW. Data Analysis and Regression - A Second Course in Statistics, Student. edn. Reading, MA: Addison-Wesley Publishing Company; 1977.
27. Bühlmann P, van de Geer S. Statistics for High-Dimensional Data: Methods, Theory and Applications, 1st edn. Springer, Heidelberg, Germany: Springer Series in Statistics; 2011. doi:10.1007/978-3-642-20192-9.
28. Zou H, Hastie T. Regularization and variable selection via the elastic net. J R Stat Soc Ser B, Stat Methodology. 2005; 67(2):301-20. doi:10.1111/j.1467-9868.2005.00503.x.
29. R Development Core Team. R: A Language and Environment for Statistical Computing. 2014. http://www.R-project.org/. Accessed on 07 February, 2015.
30. Shankar J. regeval: A systematic evaluation of high-dimensional, ensemble based regression for exploring large model spaces in microbiome analyses. GitHub. 2014. http://github.com/openpencil/regeval. Accessed on 07 February, 2015.
31. Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd edn. Springer, New York, NY, USA: Springer Series in Statistics; 2013. doi:10.1007/978-0-387-84858-7.
32. Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Software. 2010; 33(1):1-22.
33. Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc Ser B, Stat Methodology. 1996; 58(1):267-88. doi:10.2307/2346178.
34. Efron B, Hastie T, Johnstone I, Tibshirani R. Least angle regression. Ann Stat. 2004; 32(2):407-99. doi:10.1214/009053604000000067.
35. Grandvalet Y, Chiquet J, Ambroise C. Sparsity by Worst-Case Quadratic Penalties. arXiv preprint. 2012. http://arxiv.org/abs/1210.2077 Accessed on 07 February, 2015. arXiv:1210.2077 Code: http://r-forge.r-project.org/projects/quadrupen/ Accessed on 07 February, 2015.
36. Mason DM, Newton MA. A rank statistics approach to the consistency of a general bootstrap. Ann Stat. 1992; 20(3):1611-24. doi:10.1214/aos/1176348787.
37. Praestgaard J, Wellner JA. Exchangeably weighted bootstraps of the general empirical process. Ann Probability. 1993; 21(4):2053-86. doi:10.1214/aop/1176989011.
38. Freedman D. A remark on the difference between sampling with and without replacement. J Am Stat Assoc. 1977; 72(359):681-1. doi:10.1080/01621459.1977.10480637.
39. Bühlmann P, Yu B. Analyzing bagging. Ann Stat. 2002; 30(4):927-61. doi:10.1214/aos/1031689014.
40. Friedman JH, Hall P. On bagging and nonlinear estimation. J Stat Planning Inference. 2007; 137(3):669-83. doi:10.1016/j.jspi.2006.06.002.
41. Dümbgen L, Samworth RJ, Schuhmacher D. Stochastic search for semiparametric linear regression models. In: Banerjee M, Bunea F, Huang J, Koltchinskii V, Maathuis MH, (eds.) From Probability to Statistics and Back: High-Dimensional Models and Processes - A Festschrift in Honor of Jon A. Wellner. Beachwood, Ohio, USA: Institute of Mathematical Statistics: 2013. p. 78-90. doi:10.1214/12-IMSCOLL907.
42. Bach FR. Bolasso: model consistent lasso estimation through the bootstrap. In: Proceedings of the 25th International Conference on Machine Learning. ICML '08. New York, New York, USA: ACM Press: 2008. p. 33-40. doi:10.1145/1390156.1390161.
43. Scott SL. BoomSpikeSlab: MCMC for spike and slab regression. R package version 0.5.2 CRAN. 2014. http://CRAN.R-project.org/package=BoomSpikeSlab Accessed on 07 February, 2015.
44. Scott SL, Varian HR. Predicting the present with bayesian structural time series. Int J Math Modell Numer Optimisation. 2014; 5(1/2):4. doi:10.1504/ijmmno.2014.059942.
45. Brodersen KH, Gallusser F, Koehler J, Remy N, Scott SL. Inferring causal impact using Bayesian structural time-series models. Ann Appl Stat. 2014. In press. http://www.e-publications.org/ims/submission/AOAS/user/submissionFile/17112?confirm=ef7e4bee. Accessed on 07 February, 2015.
46. Liang F, Paulo R, Molina G, Clyde MA, Berger JO. Mixtures of g priors for bayesian variable selection. J Am Stat Assoc. 2008; 103(481):410-23. doi:10.1198/016214507000001337.
47. Cortes C, Mohri M. AUC optimization vs. error rate minimization. In: Thrun S, Saul LK, Schölkopf B, Thrun S (eds.) Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press: 2004. p. 313-20.
48. Das I, Nightingale P, Patel M, Jumaa P. Epidemiology, clinical characteristics, and outcome of candidemia: experience in a tertiary referral center in the UK. Int J Infectious Dis. 2011; 15(11):e759-63. doi:10.1016/j.ijid.2011.06.006.
49. Smeekens SP, van de Veerdonk FL, Kullberg BJ, Netea MG. Genetic susceptibility to candida infections. EMBO Mol Med. 2013; 5(6):805-13. doi:10.1002/emmm.201201678.
50. Giri S, Kindo AJ. A review of candida species causing blood stream infection. Indian J Med Microbiol. 2012; 30(3):270-8. doi:10.4103/0255-0857.99484.
51. Eggimann P, Bille J, Marchetti O. Diagnosis of invasive candidiasis in the ICU. Ann Intensive Care. 2011; 1(1):37. doi:10.1186/2110-5820-1-37.
52. Woo PCY, Lau SKP, Teng JLL, Tse H, Yuen K. Then and now: use of 16S rDNA gene sequencing for bacterial identification and discovery of novel bacteria in clinical microbiology laboratories. Clin Microbiol Infection. 2008; 14(10):908-34. doi:10.1111/j.1469-0691.2008.02070.x.
53. Schoch CL, Seifert KA, Huhndorf S, Robert V, Spouge JL, Levesque CA, et al.Fungal Barcoding Consortium, Fungal Barcoding Consortium Author List: Nuclear ribosomal internal transcribed spacer (ITS) region as a universal DNA barcode marker for fungi. Proc Nat Acad Sci USA. 2012; 109(16):6241-6. doi:10.1073/pnas.1117018109.
54. Szpakowski S. YAP: A Computationally Efficient Workflow for Taxonomic Analyses of Bacterial 16S and Fungal ITS Sequences. GitHub. 2013. http://github.com/shpakoo/YAP. Accessed on 07 February, 2015.
55. Scott JG, Berger JO. Bayes and empirical-bayes multiplicity adjustment in the variable-selection problem. Ann Stat. 2010; 38(5):2587-619. doi:10.1214/10-AOS792.
56. May A, Abeln S, Crielaard W, Heringa J, Brandt BW. Unraveling the outcome of 16S rDNA-based taxonomy analysis through mock data and simulations. Bioinformatics. 2014; 30(11):1530-8. doi:10.1093/bioinformatics/btu085.
57. Shah RD. Modelling interactions in high-dimensional data with Backtracking. arXiv preprint. 2013. http://arxiv.org/abs/1208.1174. Accessed on 07 February, 2015.
58. Shah RD, Meinshausen N. Random intersection trees. J Machine Learning Res. 2014; 15(1):629-54.
59. Witten DM, Shojaie A, Zhang F. The cluster elastic net for High-Dimensional regression with unknown variable grouping. Technometrics. 2013; 56(1):112-22. doi:10.1080/00401706.2013.810174.
60. Prosser JI. Replicate or lie: The need for replication. Environ Microbiol. 2010; 12(7):1806-10. doi:10.1111/j.1462-2920.2010.02201.x.