Asymptotically exact, embarrassingly parallel MCMC

Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014

Volumn , Issue , 2014, Pages 623-632

  Neiswanger, Willie ^a   Wang, Chong ^b   Xing, Eric P ^a  

^a Machine Learning Department Carnegie Mellon University ^*  (United States)

^b Voleon Capital Management ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING ALGORITHMS; LEARNING SYSTEMS; MARKOV PROCESSES;

COMMUNICATION COST; DATA SUBSETS; GIBBS SAMPLING; MARKOV CHAIN MONTE CARLO ALGORITHMS; MCMC METHOD; MULTIPLE MACHINE; PARALLEL MACHINE; POSTERIOR DISTRIBUTIONS;

ALGORITHMS;

EID: 84923300910     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Alekh Agarwal and John C Duchi, Distributed delayed stochastic optimization, Decision and Control (CDC), 2012 IEEE 51st Annual Conference on, IEEE, 2012, pp. 5451-5452.
2. Sungjin Ahn, Anoop Korattikara, and Max Welling, Bayesian posterior sampling via stochastic gradient fisher scoring, Proceedings of the 29th International Conference on Machine Learning, 2012, pp. 1591-1598.
3. David M Blei, Andrew Y Ng, and Michael I Jordan, Latent dirichlet allocation, The Journal of Machine Learning Research 3 (2003), 993-1022.
4. Jeffrey Dean and Sanjay Ghemawat, Mapreduce: simplified data processing on large clusters, Communications of the ACM 51 (2008), no. 1, 107-113.
5. Samuel J Gershman and David M Blei, A tutorial on bayesian nonparametric models, Journal of Mathematical Psychology 56 (2012), no. 1, 1-12.
6. Nils Lid Hjort and Ingrid K Glad, Nonparametric density estimation with a parametric start, The Annals of Statistics (1995), 882-904.
7. Qirong Ho, James Cipar, Henggang Cui, Seunghak Lee, Jin Kyu Kim, Phillip B. Gibbons, Gregory R. Ganger, Garth Gibson, and Eric P. Xing, More effective distributed ml via a stale synchronous parallel parameter server, Advances in Neural Information Processing Systems, 2013.
8. Matthew D Hoffman and Andrew Gelman, The no-uturn sampler: Adaptively setting path lengths in hamiltonian monte carlo, arXiv preprint arXiv:1111.4246 (2011).
9. Anoop Korattikara, Yutian Chen, and Max Welling, Austerity in MCMC land: Cutting the Metropolis-Hastings budget, arXiv preprint arXiv:1304.5299 (2013).
10. John Langford, Alex J Smola, and Martin Zinkevich, Slow learners are fast, Advances in Neural Information Processing Systems, 2009.
11. Kathryn Blackmond Laskey and James W Myers, Population Markov chain Monte Carlo, Machine Learning 50 (2003), no. 1-2, 175-196.
12. Lucien Le Cam, Asymptotic methods in statistical decision theory, New York (1986).
13. Lawrence Murray, Distributed Markov chain Monte Carlo, Proceedings of Neural Information Processing Systems Workshop on Learning on Cores, Clusters and Clouds, vol. 11, 2010.
14. David Newman, Arthur Asuncion, Padhraic Smyth, and Max Welling, Distributed algorithms for topic models, The Journal of Machine Learning Research 10 (2009), 1801-1828.
15. Junier Oliva, Barnabás Póczos, and Jeff Schneider, Distribution to distribution regression, Proceedings of The 30th International Conference on Machine Learning, 2013, pp. 1049-1057.
16. Sam Patterson and Yee Whye Teh, Stochastic gradient riemannian langevin dynamics on the probability simplex, Advances in Neural Information Processing Systems, 2013.
17. Steven L. Scott, Alexander W. Blocker, and Fernando V. Bonassi, Bayes and big data: The consensus monte carlo algorithm, Bayes 250, 2013.
18. Alexander Smola and Shravan Narayanamurthy, An architecture for parallel topic models, Proceedings of the VLDB Endowment 3 (2010), no. 1-2, 703-710.
19. Max Welling and Yee W Teh, Bayesian learning via stochastic gradient Langevin dynamics, Proceedings of the 28th International Conference on Machine Learning, 2011, pp. 681-688.
20. Darren J Wilkinson, Parallel Bayesian computation, Statistics Textbooks and Monographs 184 (2006), 477.
21. Sinead Williamson, Avinava Dubey, and Eric P Xing, Parallel Markov chain Monte Carlo for nonparametric mixture models, Proceedings of the 30th International Conference on Machine Learning, 2013, pp. 98-106.