VAE with a vampprior

International Conference on Artificial Intelligence and Statistics, AISTATS 2018

Volumn , Issue , 2018, Pages 1214-1223

  Tomczak, Jakub M ^a   Welling, Max ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; HIERARCHICAL SYSTEMS;

AUTO ENCODERS; CONVOLUTIONAL NETWORKS; EMPIRICAL STUDIES; GENERATIVE MODEL; HIERARCHICAL MODEL; MIXTURE DISTRIBUTIONS; MIXTURE OF GAUSSIANS; STATE OF THE ART;

MIXTURES;

EID: 85059403423     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (43)

1. A. Alemi, I. Fischer, J. Dillon, and K. Murphy. Deep variational information bottleneck. ICLR, 2017.
2. A. A. Alemi, B. Poole, I. Fischer, J. V. Dillon, R. A. Saurous, and K. Murphy. An information-theoretic analysis of deep latent-variable models. arXiv preprint arXiv:1711.00464, 2017.
3. D. M. Blei, A. Kucukelbir, and J. D. McAuliffe. Variational inference: A review for statisticians. Journal of the American Statistical Association, 2017.
4. J. Bornschein, A. Mnih, D. Zoran, and D. J. Rezende. Variational Memory Addressing in Generative Models. arXiv:1709.07116, 2017.
5. S. R. Bowman, L. Vilnis, O. Vinyals, A. M. Dai, R. Jozefowicz, and S. Bengio. Generating sentences from a continuous space. arXiv:1511.06349, 2016.
6. Y. Burda, R. Grosse, and R. Salakhutdinov. Importance weighted autoencoders. arXiv:1509.00519, 2015.
7. X. Chen, D. P. Kingma, T. Salimans, Y. Duan, P. Dhariwal, J. Schulman, I. Sutskever, and P. Abbeel. Variational Lossy Autoencoder. arXiv:1611.02731, 2016.
8. Y. N. Dauphin, A. Fan, M. Auli, and D. Grangier. Language Modeling with Gated Convolutional Networks. arXiv:1612.08083, 2016.
9. N. Dilokthanakul, P. A. Mediano, M. Garnelo, M. C. Lee, H. Salimbeni, K. Arulkumaran, and M. Shanahan. Deep unsupervised clustering with gaussian mixture variational autoencoders. arXiv:1611.02648, 2016.
10. L. Dinh, D. Krueger, and Y. Bengio. NICE: Non-linear independent components estimation. arXiv:1410.8516, 2014.
11. G. Dziugaite, D. Roy, and Z. Ghahramani. Training generative neural networks via maximum mean discrepancy optimization. UAI, pages 258–267, 2015.
12. X. Glorot and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. AISTATS, 9:249–256, 2010.
13. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. NIPS, pages 2672–2680, 2014.
14. P. Goyal, Z. Hu, X. Liang, C. Wang, and E. Xing. Nonparametric Variational Autoencoders for Hierarchical Representation Learning. arXiv:1703.07027, 2017.
15. I. Gulrajani, K. Kumar, F. Ahmed, A. A. Taiga, F. Visin, D. Vazquez, and A. Courville. PixelVAE: A latent variable model for natural images. arXiv:1611.05013, 2016.
16. M. D. Hoffman and M. J. Johnson. ELBO surgery: yet another way to carve up the variational evidence lower bound. NIPS Workshop: Advances in Approximate Bayesian Inference, 2016.
17. D. Kingma and J. Ba. Adam: A method for stochastic optimization. arXiv:1412.6980, 2014.
18. D. P. Kingma, T. Salimans, R. Jozefowicz, X. Chen, I. Sutskever, and M. Welling. Improved variational inference with inverse autoregressive flow. NIPS, pages 4743–4751, 2016.
19. D. P. Kingma and M. Welling. Auto-encoding variational bayes. arXiv:1312.6114, 2013.
20. B. M. Lake, R. Salakhutdinov, and J. B. Tenenbaum. Human-level concept learning through probabilistic program induction. Science, 350(6266):1332–1338, 2015.
21. H. Larochelle and I. Murray. The Neural Autoregressive Distribution Estimator. AISTATS, 2011.
22. A. B. L. Larsen, S. K. Sønderby, H. Larochelle, and O. Winther. Autoencoding beyond pixels using a learned similarity metric. ICML, 2016.
23. Y. Li, K. Swersky, and R. S. Zemel. Generative moment matching networks. ICML, pages 1718–1727, 2015.
24. Y. Li and R. E. Turner. Rényi Divergence Variational Inference. NIPS, pages 1073–1081, 2016.
25. L. Maaløe, M. Fraccaro, and O. Winther. Semi-supervised generation with cluster-aware generative models. arXiv:1704.00637, 2017.
26. A. Makhzani, J. Shlens, N. Jaitly, I. Goodfellow, and B. Frey. Adversarial autoencoders. arXiv:1511.05644, 2015.
27. B. Marlin, K. Swersky, B. Chen, and N. Freitas. Inductive principles for Restricted Boltzmann Machine learning. AISTATS, pages 509–516, 2010.
28. L. Mescheder, S. Nowozin, and A. Geiger. Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks. In ICML, pages 2391–2400, 2017.
29. E. Nalisnick, L. Hertel, and P. Smyth. Approximate Inference for Deep Latent Gaussian Mixtures. NIPS Workshop: Bayesian Deep Learning, 2016.
30. E. Nalisnick and P. Smyth. Stick-Breaking Variational Autoencoders. arXiv:1605.06197, 2016.
31. R. Ranganath, D. Tran, and D. Blei. Hierarchical variational models. In ICML, pages 324–333, 2016.
32. D. J. Rezende and S. Mohamed. Variational inference with normalizing flows. arXiv:1505.05770, 2015.
33. D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic Backpropagation and Approximate Inference in Deep Generative Models. ICML, pages 1278–1286, 2014.
34. R. Salakhutdinov and I. Murray. On the quantitative analysis of deep belief networks. ICML, pages 872–879, 2008.
35. T. Salimans, D. Kingma, and M. Welling. Markov chain monte carlo and variational inference: Bridging the gap. ICML, pages 1218–1226, 2015.
36. C. K. Sønderby, T. Raiko, L. Maaløe, S. K. Sønderby, and O. Winther. Ladder variational autoencoders. NIPS, pages 3738–3746, 2016.
37. S. Suh and S. Choi. Gaussian Copula Variational Autoencoders for Mixed Data. arXiv:1604.04960, 2016.
38. N. Tishby, F. C. Pereira, and W. Bialek. The information bottleneck method. arXiv preprint physics/0004057, 2000.
39. J. M. Tomczak and M. Welling. Improving Variational Auto-Encoders using Householder Flow. NIPS Workshop: Bayesian Deep Learning, 2016.
40. D. Tran, R. Ranganath, and D. M. Blei. The variational Gaussian process. arXiv:1511.06499, 2015.
41. A. van den Oord, N. Kalchbrenner, L. Espeholt, O. Vinyals, A. Graves, and K. Kavukcuoglu. Conditional image generation with PixelCNN decoders. NIPS, pages 4790–4798, 2016.
42. A. van den Oord, N. Kalchbrenner, and K. Kavukcuoglu. Pixel Recurrent Neural Networks. ICML, pages 1747–1756, 2016.
43. A. W. Yu, Q. Lin, R. Salakhutdinov, and J. Carbonell. Normalized gradient with adaptive step-size method for deep neural network training. arXiv:1707.04822, 2017.