VAE learning via Stein variational gradient descent

Advances in Neural Information Processing Systems

Volumn 2017-December, Issue , 2017, Pages 4237-4246

  Pu, Yunchen ^a   Gan, Zhe ^a   Henao, Ricardo ^a   Li, Chunyuan ^a   Han, Shaobo ^a   Carin, Lawrence ^a  

^a Duke University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SIGNAL ENCODING;

AUTOENCODERS; GRADIENT DESCENT; LARGE DATASETS; SEMI-SUPERVISED;

IMPORTANCE SAMPLING;

EID: 85046994842     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Y. Burda, R. Grosse, and R. Salakhutdinov. Importance weighted autoencoders. In ICLR, 2016.
2. L. Chen, S. Dai, Y. Pu, C. Li, and Q. Su Lawrence Carin. Symmetric variational autoencoder and connections to adversarial learning. In arXiv, 2017.
3. Y. Feng, D. Wang, and Q. Liu. Learning to draw samples with amortized stein variational gradient descent. In UAI, 2017.
4. Z. Gan, C. Chen, R. Henao, D. Carlson, and L. Carin. Scalable deep poisson factor analysis for topic modeling. In ICML, 2015.
5. K. Gregor, I. Danihelka, A. Graves, and D. Wierstra. Draw: A recurrent neural network for image generation. In ICML, 2015.
6. J. Han and Q. Liu. Stein variational adaptive importance sampling. In UAI, 2017.
7. S. Han, X. Liao, D.B. Dunson, and L. Carin. Variational gaussian copula inference. In AISTATS, 2016.
8. K. He, X. Zhang, S. Ren, and Sun J. Deep residual learning for image recognition. In CVPR, 2016.
9. D. Kingma and J. Ba. Adam: A method for stochastic optimization. In ICLR, 2015.
10. D. P. Kingma, T. Salimans, R. Jozefowicz, X.i. Chen, I. Sutskever, and M. Welling. Improving variational inference with inverse autoregressive flow. In NIPS, 2016.
11. D. P. Kingma and M. Welling. Auto-encoding variational Bayes. In ICLR, 2014.
12. D.P. Kingma, D.J. Rezende, S. Mohamed, and M. Welling. Semi-supervised learning with deep generative models. In NIPS, 2014.
13. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
14. H. Larochelle and S. Laulyi. A neural autoregressive topic model. In NIPS, 2012.
15. Q. Liu and D. Wang. Stein variational gradient descent: A general purpose bayesian inference algorithm. In NIPS, 2016.
16. A. L. Maas, A. Y. Hannun, and A. Y. Ng. Rectifier nonlinearities improve neural network acoustic models. In ICML, 2013.
17. Y. Miao, L. Yu, and Phil Blunsomi. Neural variational inference for text processing. In ICML, 2016.
18. A. Mnih and K. Gregor. Neural variational inference and learning in belief networks. In ICML, 2014.
19. A. Mnih and D. J. Rezende. Variational inference for monte carlo objectives. In ICML, 2016.
20. A. Oord, N. Kalchbrenner, and K. Kavukcuoglu. Pixel recurrent neural network. In ICML, 2016.
21. Y. Pu, Z. Gan, R. Henao, X. Yuan, C. Li, A. Stevens, and L. Carin. Variational autoencoder for deep learning of images, labels and captions. In NIPS, 2016.
22. Y. Pu, X. Yuan, and L. Carin. Generative deep deconvolutional learning. In ICLR workshop, 2015.
23. Y. Pu, X. Yuan, A. Stevens, C. Li, and L. Carin. A deep generative deconvolutional image model. Artificial Intelligence and Statistics (AISTATS), 2016.
24. R. Ranganath, L. Tang, L. Charlin, and D. M. Blei. Deep exponential families. In AISTATS, 2015.
25. R. Ranganath, D. Tran, and D. M. Blei. Hierarchical variational models. In ICML, 2016.
26. A. Rasmus, M. Berglund, M. Honkala, H. Valpola, and T. Raiko. Semi-supervised learning with ladder networks. In NIPS, 2015.
27. D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic backpropagation and approximate inference in deep generative models. In ICML, 2014.
28. D.J. Rezende and S. Mohamed. Variational inference with normalizing flows. In ICML, 2015.
29. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-fei. Imagenet large scale visual recognition challenge. IJCV, 2014.
30. D. Shen, Y. Zhang, R. Henao, Q. Su, and L. Carin. Deconvolutional latent-variable model for text sequence matching. In arXiv, 2017.
31. J. T. Springenberg, A. Dosovitskiy, T. Brox, and M. Riedmiller. Striving for simplicity: The all convolutional net. In ICLR workshop, 2015.
32. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. JMLR, 2014.
33. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. JMLR, 2010.
34. Y. Pu W. Wang, R. Henao, L. Chen, Z. Gan, C. Li, and Lawrence Carin. Adversarial symmetric variational autoencoder. In NIPS, 2017.
35. Y. Zhang, D. Shen, G. Wang, Z. Gan, R. Henao, and L. Carin. Deconvolutional paragraph representation learning. In NIPS, 2017.
36. M. Zhou, L. Hannah, D. Dunson, and L. Carin. Beta-negative binomial process and Poisson factor analysis. In AISTATS, 2012.