Distributed stochastic gradient MCMC

31st International Conference on Machine Learning, ICML 2014

Volumn 3, Issue , 2014, Pages 2735-2745

  Ahn, Sungjin ^a   Shahbaba, Babak ^b   Welling, Max ^c  

^a Irvine   (United States)

^b Ringgold Standard Institution Informatics   (United States)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BIG DATA; CHAINS; COMMUNICATION CHANNELS (INFORMATION THEORY); INFERENCE ENGINES; LEARNING SYSTEMS; NETWORK MANAGEMENT;

ADAPTIVE LOAD BALANCING; COMMUNICATION OVERHEADS; DISTRIBUTED INFERENCE; MCMC ALGORITHMS; PROBABILISTIC INFERENCE; STATE OF THE ART; STOCHASTIC GRADIENT; WIKIPEDIA;

STOCHASTIC SYSTEMS;

EID: 84919919193     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Ahmed, A., Aly, A., Gonzalez, J., Narayanamurthy, S., and Smola, A. Scalable inference in latent variable models. In International conference on Web search and data mining, 2012.
2. Ahn, S., Korattikara, A., and Welling, M. Bayesian posterior sampling via stochastic gradient fisher scoring. In International Conference on Machine Learning, 2012.
3. Ahn, S., Chen, Y., and Welling, M. Distributed and adaptive darting monte carlo through regenerations. International Conference on Artificial Intelligence and Statistics, 2013.
4. Andrieu, C. and Thorns, J. A tutorial on adaptive mcmc. Statistics and Computing, 18:343-373, 2008.
5. Bardenet, R., Doucet, A., and Holmes, C. Towards scaling up markov chain monte carlo: an adaptive sub sampling approach. In International Conference on Machine Learning, 2014.
6. Ho, Q., Cipar, J., Cui, H., Kim, J. K., Lee, S., Gibbons, P. B., Gibson, G., Ganger, G. R., and Xing, E. P. More effective distributed ml via a stale synchronous parallel parameter server. In Advances in Neural Information Processing Systems, 2013.
7. Hoffman, M., Bach, F., and Blei, D. Online learning for latent dirichlet allocation. In Advances in Neural Information Processing Systems, pp. 856-864, 2010.
8. Korattikara, A., Chen, Y., and Welling, M. Austerity in mcmc land: Cutting the metropolis-hastings budget. In International Conference on Machine Learning, 2014.
9. Laskey, K. B. and Myers, J. W. Population markov chain monte carlo. Machine Learning, 50:175-196, 2003.
10. Newman, D., Smyth, P., Welling, M., and Asuncion, A. Distributed inference for latent dirichlet allocation. In Advances in Neural Information Processing Systems, pp. 1081-1088, 2007.
11. Patterson, S and Teh, Y. W. Stochastic gradient riemannian langevin dynamics on the probability simplex. In Advances in Neural Information Processing Systems, 2013.
12. Smola, A. and Narayanamurthy, S. An architecture for parallel topic models. VLDB, 2010.
13. Welling, M. and Teh, Y. W. Bayesian learning via stochastic gradient langevin dynamics. In International Conference on Machine Learning (ICML), 2011.
14. Wilkinson, D. J. Parallel bayesian computation. Statistics Textbooks and Monographs, 184:477, 2006.