Prediction with missing data via Bayesian Additive Regression Trees

Canadian Journal of Statistics

Volumn 43, Issue 2, 2015, Pages 224-239

  Kapelner, Adam ^a   Bleich, Justin ^b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

BART; Bayesian; Missing data; Statistical learning; Tree based learning

Indexed keywords

EID: 84929605936     PISSN: 03195724     EISSN: 1708945X     Source Type: Journal    
DOI: 10.1002/cjs.11248     Document Type: Article

References (21)

1. Albert, J. H. & Chib, S. (1993). Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association, 88(422), 669-679.
2. Bleich, J., Kapelner, A., Jensen, S. T., & George, E. I. (2014). Variable selection for BART: An application to gene regulation. Annals of Applied Statistics, 8(3), 1750-1781.
3. Breiman, L. (2001a). Random forests. Machine Learning, 45(1), 5-32.
4. Breiman, L. (2001b). Statistical modeling: The two cultures. Statistical Science, 16(3), 199-231.
5. Chipman, H. A., George, E. I., & McCulloch, R. E. (2010). BART: Bayesian additive regressive trees. The Annals of Applied Statistics, 4(1), 266-298.
6. Ding, Y. & Simonoff, J. S. (2010). An investigation of missing data methods for classification trees applied to binary response data. The Journal of Machine Learning Research, 11, 131-170.
7. Friedman, J. H. (2002). Stochastic gradient boosting. Computational Statistics & Data Analysis, 38(4), 367-378.
8. Geman, S. & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transaction on Pattern Analysis and Machine Intelligence, 6, 721-741.
9. Hastings, W. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57(1), 97-109.
10. Kapelner, A. & Bleich, J. (2015). bartMachine: Machine learning with Bayesian Additive Regression Trees. Journal of Statistical Software, in press.
11. Liaw, A. & Wiener, M. (2002). Classification and regression by randomforest. R News, 2(3), 18-22.
12. Little, R. J. A. (1993). Pattern-mixture models for multivariate incomplete data. Journal of the American Statistical Association, 88(421), 125-134.
13. Little, R. J. A. & Rubin, D. B. (2002). Statistical Analysis with Missing Data, 2nd ed., Wiley, Hoboken, NJ, USA.
14. Rubin, D. B. (1978). Multiple imputations in sample surveys-A phenomenological Bayesian approach to nonresponse. Technical report, Proceedings of the Survey Research Methods Section, ASA.
15. Rubin, D. B. (1981). The Bayesian bootstrap. The Annals of Statistics, 9(1), 130-134.
16. Schafer, J. L. (1997). Analysis of Incomplete Multivariate Data, Chapman & Hall/CRC, Boca Raton, FL, USA.
17. Stekhoven, D. J. & Bühlmann, P. (2012). MissForest-non-parametric missing value imputation for mixed-type data. Bioinformatics, 28, 112-118.
18. Therneau, T. M. & Atkinson, E. J. (1997). An introduction to recursive partitioning using the RPART routines. Technical report, Mayo Foundation.
19. Troyanskaya, O., Cantor, M., & Sherlock, G. (2001). Missing value estimation methods for DNA microarrays. Bioinformatics, 17(6), 520-525.
20. Twala, B. (2009). An empirical comparison of techniques for handling incomplete data using decision trees. Applied Artificial Intelligence, 23(5), 1-35.
21. Twala, B., Jones, M., & Hand, D. J. (2008). Good methods for coping with missing data in decision trees. Pattern Recognition Letters, 29(7), 950-956.