Reparameterization gradients through acceptance-rejection sampling algorithms

Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, AISTATS 2017

Volumn , Issue , 2017, Pages

  Naesseth, Christian A ^a,b   Ruiz, Francisco J R ^b,c   Linderman, Scott W ^b   Blei, David M ^b  

^a LINKÖPING UNIVERSITY   (Sweden)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; INFERENCE ENGINES; LEARNING ALGORITHMS; OPTIMIZATION; RANDOM VARIABLES;

APPROXIMATE BAYESIAN INFERENCE; AUXILIARY RANDOM VARIABLE; DETERMINISTIC FUNCTIONS; PROBABILISTIC MODELS; STATE-OF-THE-ART METHODS; STOCHASTIC GRADIENT; STOCHASTIC OPTIMIZATIONS; VARIATIONAL INFERENCE;

STOCHASTIC MODELS;

EID: 85083936643     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. D. M. Blei, A. Kucukelbir, and J. D. McAuliffe. Variational inference: A review for statisticians. arXiv:1601.00670, 2016.
2. G. Bonnet. Transformations des signaux aléatoires a travers les systemes non linéaires sans mémoire. Annals of Telecommunications, 19(9):203–220, 1964.
3. G. Casella and C. P. Robert. Rao-Blackwellisation of sampling schemes. Biometrika, 83(1):81–94, 1996.
4. L. Devroye. Non-Uniform Random Variate Generation. Springer-Verlag, 1986.
5. J. Duchi, E. Hazan, and Y. Singer. Adaptive subgra-dient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12:2121–2159, jul 2011.
6. K. Fan, Z. Wang, J. Beck, J. Kwok, and K. A. Heller. Fast second order stochastic backpropagation for variational inference. In Advances in Neural Information Processing Systems, 2015.
7. P. W. Glynn. Likelihood ratio gradient estimation for stochastic systems. Communications of the ACM, 33(10):75–84, oct 1990.
8. G. E. Hinton and D. van Camp. Keeping the neural networks simple by minimizing the description length of the weights. In Proceedings of the Sixth Annual Conference on Computational Learning Theory, pages 5–13, New York, NY, USA, 1993. ACM.
9. M. D. Hoffman, D. M. Blei, C. Wang, and J. Paisley. Stochastic variational inference. Journal of Machine Learning Research, 14:1303–1347, May 2013.
10. E. Jang, S. Gu, and B. Poole. Categorical reparameterization using gumbel-softmax. In International Conference on Learning Representations, 2017. (accepted for publication).
11. M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. K. Saul. An introduction to variational methods for graphical models. Machine Learning, 37(2): 183–233, Nov. 1999.
12. D. P. Kingma and M. Welling. Auto-encoding variational Bayes. In International Conference on Learning Representations, 2014.
13. D. A. Knowles. Stochastic gradient variational Bayes for Gamma approximating distributions. arXiv:1509.01631v1, 2015.
14. A. Kucukelbir, R. Ranganath, A. Gelman, and D. M. Blei. Automatic variational inference in Stan. In Advances in Neural Information Processing Systems, 2015.
15. A. Kucukelbir, D. Tran, R. Ranganath, A. Gelman, and D. M. Blei. Automatic differentiation variational inference. arXiv:1603.00788, 2016.
16. L. Maaløe, C. K. Sønderby, S. K. Sønderby, and O. Winther. Auxiliary deep generative models. In International Conference on Machine Learning, 2016.
17. D. Maclaurin, D. Duvenaud, M. Johnson, and R. P. Adams. Autograd: Reverse-mode differentiation of native Python, 2015. URL http://github.com/HIPS/autograd.
18. C. J. Maddison, A. Mnih, and Y. W. Teh. The concrete distribution: A continuous relaxation of discrete random variables. In International Conference on Learning Representations, 2017. (accepted for publication).
19. G. Marsaglia and W. W. Tsang. A simple method for generating gamma variables. ACM Transactions on Mathematical Software, 26(3):363–372, Sept. 2000.
20. A. Mnih and K. Gregor. Neural variational inference and learning in belief networks. In International Conference on Machine Learning, 2014.
21. J. W. Paisley, D. M. Blei, and M. I. Jordan. Variational Bayesian inference with stochastic search. In International Conference on Machine Learning, 2012.
22. O. Papaspiliopoulos, G. O. Roberts, and M. Sköld. Non-centered parameterisations for hierarchical models and data augmentation. In Bayesian Statistics 7: Proceedings of the Seventh Valencia International Meeting, page 307. Oxford University Press, USA, 2003.
23. R. Price. A useful theorem for nonlinear devices having Gaussian inputs. IRE Transactions on Information Theory, 4(2):69–72, 1958.
24. R. Ranganath, S. Gerrish, and D. M. Blei. Black box variational inference. In Artificial Intelligence and Statistics, 2014.
25. R. Ranganath, L. Tang, L. Charlin, and D. M. Blei. Deep exponential families. In Artificial Intelligence and Statistics, 2015.
26. R. Ranganath, D. Tran, and D. M. Blei. Hierarchical variational models. In International Conference on Machine Learning, 2016.
27. D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic backpropagation and approximate inference in deep generative models. In International Conference on Machine Learning, 2014.
28. C. Robert and G. Casella. Monte Carlo statistical methods. Springer Science & Business Media, 2004.
29. F. J. R. Ruiz, M. K. Titsias, and D. M. Blei. The generalized reparameterization gradient. In Advances in Neural Information Processing Systems, 2016.
30. T. Salimans and D. A. Knowles. Fixed-form variational posterior approximation through stochastic linear regression. Bayesian Analysis, 8(4):837–882, 2013.
31. T. Salimans, D. P. Kingma, and M. Welling. Markov chain Monte Carlo and variational inference: Bridging the gap. In International Conference on Machine Learning, 2015.
32. J. Schulman, N. Heess, T. Weber, and P. Abbeel. Gradient estimation using stochastic computation graphs. In Advances in Neural Information Processing Systems, 2015.
33. A. Stuart. Gamma-distributed products of independent random variables. Biometrika, 49:64–65, 1962.
34. T. Tieleman and G. Hinton. Lecture 6.5-RMSPROP: Divide the gradient by a running average of its recent magnitude. Coursera: Neural Networks for Machine Learning, 4, 2012.
35. M. K. Titsias and M. Lázaro-Gredilla. Doubly stochastic variational Bayes for non-conjugate inference. In International Conference on Machine Learning, 2014.
36. D. Tran, R. Ranganath, and D. M. Blei. The variational Gaussian process. In International Conference on Learning Representations, 2016.
37. J. von Neumann. Various Techniques Used in Connection with Random Digits. Journal of Research of the National Bureau of Standards, 12:36–38, 1951.
38. S. Waterhouse, D. Mackay, and T. Robinson. Bayesian methods for mixtures of experts. In Advances in Neural Information Processing Systems, pages 351–357. MIT Press, 1996.
39. R. J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8(3–4):229–256, 1992.