Variable selection for bart: An application to gene regulation

Annals of Applied Statistics

Volumn 8, Issue 3, 2014, Pages 1750-1781

  Bleich, Justin ^a   Kapelner, Adam ^a   George, Edward I ^a   Jensen, Shane T ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Bayesian learning; Decision trees; Gene regulatory network; Machine learning; Nonparametric regression; Permutation testing; Variable selection

Indexed keywords

EID: 84908274658     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/14-AOAS755     Document Type: Article

References (36)

1. BLEICH, J., KAPELNER, A., GEORGE, E. and Jensen S. (2014). Supplement to “Variable selection for BART: An application to gene regulation.” DOI:10.1214/14-AOAS755SUPP.
2. BOTTOLO, L. and RICHARDSON, S. (2010). Evolutionary stochastic search for Bayesian model exploration. Bayesian Anal. 5 583-618. MR2719668
3. BREIMAN, L. (2001). Random forests. Machine Learning 45 5-32.
4. BREIMAN, L. and CUTLER, A. (2013). Online manual for random forests. Available at www.stat.berkeley.edu/∼breiman/RandomForests/cc_home.htm.
5. CHIPMAN, H. A., GEORGE, E. I. and MCCULLOCH, R. E. (1998). Bayesian CART model search. J. Amer. Statist. Assoc. 93 935-948.
6. CHIPMAN, H. A., GEORGE, E. I. and MCCULLOCH, R. E. (2010). BART: Bayesian additive regression trees. Ann. Appl. Stat. 4 266-298. MR2758172
7. DENG, H. and RUNGER, G. (2012). Feature selection via regularized trees. In The 2012 International Joint Conference on Neural Networks (IJCNN).
8. Díaz-uriarte, R. And Alvarez De Andrés, S. (2006). Gene selection and classification of microarray data using random forest. BMC Bioinformatics 7 1-13.
9. FRIEDMAN, J. H. (1991). Multivariate adaptive regression splines. Ann. Statist. 19 1-141. With discussion and a rejoinder by the author. MR1091842
10. FRIEDMAN, J. H. (2002). Stochastic gradient boosting. Comput. Statist. Data Anal. 38 367-378. MR1884869
11. FRIEDMAN, J. H., HASTIE, T. and TIBSHIRANI, R. (2010). Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33 1-22.
12. GEMAN, S. and GEMAN, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6 721-741.
13. GEORGE, E. I. and MCCULLOCH, R. E. (1993). Variable selection via Gibbs sampling. J. Amer. Statist. Assoc. 88 881-889.
14. GRAMACY, R. B., TADDY, M. and WILD, S. M. (2013). Variable selection and sensitivity analysis using dynamic trees, with an application to computer code performance tuning. Ann. Appl. Stat. 7 51-80. MR3086410
15. GUANG, C., JENSEN, S. T. and STOECKERT, C. J. (2007). Clustering of genes into regulons using integrated modeling—COGRIM. Genome Biol. 8 R4.
16. HANS, C. (2009). Bayesian lasso regression. Biometrika 96 835-845. MR2564494
17. HANS, C., DOBRA, A. and WEST, M. (2007). Shotgun stochastic search for “large p” regression. J. Amer. Statist. Assoc. 102 507-516. MR2370849
18. HASTINGS, H. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57 97-109.
19. HOCKING, R. R. (1976). The analysis and selection of variables in linear regression. Biometrics 32 1-49. MR0398008
20. ISHWARAN, H. and RAO, J. S. (2005). Spike and slab variable selection: Frequentist and Bayesian strategies. Ann. Statist. 33 730-773. MR2163158
21. ISHWARAN, H. and RAO, J S. (2010). Generalized ridge regression: Geometry and computational solutions when p is larger than n. Technical report.
22. ISHWARAN, H., RAO, J. S. and KOGALUR, U. B. (2013). Spikeslab: Prediction and variable selection using spike and slab regression. Available at http://cran.r-project.org/web/packages/spikeslab/. R package version 1.1.5.
23. JENSEN, S. T., CHEN, G. and STOECKERT, C. J., JR. (2007). Bayesian variable selection and data integration for biological regulatory networks. Ann. Appl. Stat. 1 612-633. MR2415749
24. KAPELNER, A. and BLEICH, J. (2014). bartMachine: Machine learning with Bayesian additive regression trees. Available at arXiv:1312.2171.
25. Lee, T. I., Rinaldi, N. J., Robert, F., odom, D. T., Bar-Joseph, Z., Gerber, G. K., Hannett, N. M., Harbison, C. T., Thompson, C. M., Simon, I., Zeitlinger, J., Jennings, E. G., Murray, H. L., Gordon, D. B., Ren, B., Wyrick, J. J., Tagne, J. B., Volkert, T. L., Fraenkel, E., Gifford, D. K. And Young, R. A. (2002). Transcriptional regulatory networks in Saccharomyces cerevisiae. Science 298 763-764.
26. LI, F. and ZHANG, N. R. (2010). Bayesian variable selection in structured high-dimensional covariate spaces with applications in genomics. J. Amer. Statist. Assoc. 105 1202-1214. MR2752615
27. LIAW, A. and WIENER, M. (2002). Classification and regression by random forest. R news 2 18-22
28. MILLER, A. J. (2002). Subset Selection in Regression, 2nd ed. Chapman & Hall, London. MR1072361
29. MITCHELL, T. J. and BEAUCHAMP, J. J. (1988). Bayesian variable selection in linear regression. J. Amer. Statist. Assoc. 83 1023-1036. MR0997578
30. PARK, T. and CASELLA, G. (2008). The Bayesian lasso. J. Amer. Statist. Assoc. 103 681-686. MR2524001
31. ROCKOVA, V. and GEORGE, E. I. (2014). EMVS: The EM approach to Bayesian variable selection. J. Amer. Statist. Assoc. 109 828-846.
32. STINGO, F. and VANNUCCI, M. (2011). Variable selection for discriminant analysis with Markov random field priors for the analysis of microarray data. Bioinformatics 27 495-501
33. TADDY, M. A., GRAMACY, R. B. and POLSON, N. G. (2011). Dynamic trees for learning and design. J. Amer. Statist. Assoc. 106 109-123. MR2816706
34. TIBSHIRANI, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58267-288. MR1379242
35. VAN RIJSBERGEN, C. J. (1979). Information Retrieval, 2nd ed. Butterworth, Stoneham.
36. ZOU, H. and HASTIE, T. (2005). Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B Stat. Methodol. 67 301-320. MR2137327