Parallel Bayesian Additive Regression Trees

Journal of Computational and Graphical Statistics

Volumn 23, Issue 3, 2014, Pages 830-852

  Pratola, Matthew T ^a   Chipman, Hugh A ^b   Gattiker, James R ^c   Higdon, David M ^c   McCulloch, Robert ^d   Rust, William N ^c  

^a OHIO STATE UNIVERSITY   (United States)

^b ACADIA UNIVERSITY   (Canada)

^c LOS ALAMOS NATIONAL LABORATORY   (United States)

^d UNIVERSITY OF CHICAGO   (United States)

Author keywords

Big Data; Markov chain Monte Carlo; Nonlinear; Scalable; Statistical computing

Indexed keywords

EID: 84896367852     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.2013.841584     Document Type: Article

References (28)

1. Abrevaya, J., McCulloch, R. (2013), Reversal of Fortune: A Statistical Analysis of Penalty Calls in the National Hockey League, Technical Report, The University of Chicago, Booth School of Business. Available at http://www.rob-mcculloch.org.
2. Agarwal, D., Agrawal, R., Khanna, R., Kota, N. (2010), Estimating Rates of Rare Events With Multiple Hierarchies Through Scalable Log-Linear Models, Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 213–222.
3. Chipman, H., George, E., McCulloch, R. (1998), Bayesian CART Model Search, Journal of the American Statistical Association, 93, 935–960.
4. Chipman, H., George, E., McCulloch, R. (2010), BART: Bayesian Additive Regression Trees, The Annals of Applied Statistics, 4, 266–298.
5. Chu, C., Kim, S., Lin, Y., Yu, Y., Bradski, G., Ng, A., Olukotun, K. (2007), Map-Reduce for Machine Learning on Multicore, Advances in Neural Information Processing Systems, 19, 281–289.
6. Cox, D.C. (1982), An Analytical Method for Uncertainty Analysis of Nonlinear Output Functions, With Applications to Fault-Tree Analysis, IEEE Transactions in Reliability, 31, 265–268.
7. Dean, J., Ghemawat, S. (2008), MapReduce: Simplified Data Processing on Large Clusters, Commmunications of The ACM, 51, 107–113.
8. Doshi-Velez, F., Knowles, D., Mohamed, S., Ghahramani, Z. (2010), Large Scale Nonparametric Bayesian Inference: Data Parallelization in the Indian Buffet Process, Advances in Neural Information Processing Systems, 22, 1294–1302.
9. Ekanayake, J., Li, H., Zhang, B., Gunarathne, T., Bae, S., Qiu, J., and Fox, G. (2010), “Twister: A Runtime for Iterative MapReduce,” in Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, ACM, pp. 810–818.
10. Friedman, J. (2001), Greedy Function Approximation: A Gradient Boosting Machine, The Annals of Statistics, 29, 1189–1232.
11. Gramacy, R.B., Taddy, M., Wild, S.M. (2013), Variable Selection and Sensitivity Analysis Using Dynamic Trees, With an Application to Computer Code Performance Tuning, The Annals of Applied Statistics, 7, 51–80.
12. Haaland, B., Qian, P.Z. (2011), Accurate Emulators for Large-Scale Computer Experiments, The Annals of Statistics, 39, 2974–3002.
13. Higdon, D., Gattiker, J., Williams, B., Rightley, M. (2008), Computer Model Calibration Using High-Dimensional Output, Journal of the American Statistical Association, 103, 570–583.
14. Hijmans, R., Cameron, S., Parra, J., Jones, P., Jarvis, A. (2005), Very High Resolution Interpolated Climate Surfaces for Global Land Areas, International Journal of Climatology, 25, 1965–1978.
15. Kleiner, A., Talwalkar, A., Sarkar, P., Jordan, M. (2012), A Scalable Bootstrap for Massive Data,. Technical Report, UC Berkeley.
16. Pratola, M. T. (submitted). “Efficient Metropolis-Hastings Proposal Mechanisms for Bayesian Regression. Tree Models.”. Available at http://arxiv.org/abs/1312.1895.
17. Pratola, M.T., Sain, S.R., Bingham, D., Wiltberger, M., Rigler, J. (2013), Fast Sequential Computer Model Calibration of Complex Spatial-Temporal Processes, Technometrics, 55, 232–242.
18. R Core Team, (2012), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing.
19. Ranjan, P., Bingham, D., Michailidis, G. (2008), Sequential Experiment Design for Contour Estimation From Complex Computer Codes, Technometrics, 50, 527–541.
20. Rosenthal, J. (2000), Parallel Computing and Monte Carlo Algorithms, Far East Journal of Theoretical Statistics, 4, 207–236.
21. Sacks, J., Welch, W.J., Mitchell, T.J., Wynn, H.P. (1989), “Design and Analysis of Computer Experiments” (with discussion), Statistical Science, 4, 409–423.
22. Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., and Tarantola, S. (2008), Global Sensitivity Analysis: The Primer, New York: Wiley.
23. Sang, H., Huang, J. (2012), A Full Scale Approximation of Covariance Functions for Large Spatial Data Sets, Journal of the Royal Statistical Society, Series B, 74, 111–132.
24. Sinha, A., Hripcsak, G., Markatou, M. (2009), Large Datasets in Biomedicine: A Discussion of Salient Analytic Issues, Journal of the American Medical Informatics Association, 16, 759–768.
25. Sobol’, I.M. (1993), Sensitivity Analysis for Non-Linear Mathematical Models, Mathematical Modelling and Computational Experiment, 1, 407–414.
26. Taddy, M., Gramacy, R., Polson, N. (2011), Dynamic Trees for Learning and Design, Journal of the American Statistical Association, 106, 493.
27. Wilkinson, D. (2005), “Parallel Bayesian Computation,” in Handbook of Parallel Computing and Statistics, eds. E.J. Kontoghiorghes, Boca Raton, FL: Dekker/CRC Press.
28. Yero, E. J.H., Henriques, M. A.A. (2007), Speedup and Scalability Analysis of Master-Slave Applications on Large Heterogeneous Clusters, Journal of Parallel and Distributed Computing, 67, 1155–1167.