Bayesian learning via stochastic gradient langevin dynamics

Proceedings of the 28th International Conference on Machine Learning, ICML 2011

Volumn , Issue , 2011, Pages 681-688

  Welling, Max ^a   Teh, Yee Whye ^b  

^a University of California   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN LEARNING; ITERATIVE LEARNING; LANGEVIN DYNAMICS; LARGE-SCALE DATASETS; LOGISTIC REGRESSIONS; MIXTURE OF GAUSSIANS; MONTE CARLO ESTIMATES; NATURAL GRADIENT; OVERFITTING; POSTERIOR DISTRIBUTIONS; PRACTICAL METHOD; SEAMLESS TRANSITION; STEPSIZE; STOCHASTIC GRADIENT; THREE MODELS;

LEARNING SYSTEMS; MONTE CARLO METHODS; OPTIMIZATION; SAMPLING;

STOCHASTIC SYSTEMS;

EID: 80053452150     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Amari, S., Cichocki, A., and Yang, H.H. A new algorithm for blind signal separation. In Neural Information Processing Systems, volume 8, pp. 757-763, 1996.
2. Andrieu, C., De Freitas, N., and Doucet, A. Sequential MCMC for Bayesian model selection. In Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics, pp. 130-134, 1999.
3. Bottou, L. and Bousquet, O. The tradeoffs of large scale learning. In Advances in Neural Information Processing Systems, volume 20, pp. 161-168, 2008.
4. Girolami, M. and Calderhead, B. Riemann manifold Langevin and Hamiltonian Monte Carlo methods. Journal of the Royal Statistical Society B, 73:1-37, 2011.
5. Hyvarinen, A. Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3):626-634, 1999.
6. Lin, C.-J., Weng, R. C., and Keerthi, S. S. Trust region Newton method for large-scale logistic regression. Journal of Machine Learning Research, 9:627-650, 2008.
7. Neal, R. M. MCMC using Hamiltonian dynamics. In Brooks, S., Gelman, A., Jones, G., and Meng, X.-L. (eds.), Handbook of Markov Chain Monte Carlo. Chapman & Hall / CRC Press, 2010.
8. Robbins, H. and Monro, S. A stochastic approximation method. Annals of Mathematical Statistics, 22(3):400-407, 1951.
9. Robert, C. P. and Casella, G. Monte Carlo statistical methods. Springer Verlag, 2004.
10. Roberts, G. O. and Stramer, O. Langevin diffusions and metropolis-hastings algorithms. Methodology and Computing in Applied Probability, 4:337-357, 2002. (Pubitemid 36551128)