Ladder variational autoencoders

Advances in Neural Information Processing Systems

Volumn 0, Issue , 2016, Pages 3745-3753

  Sønderby, Casper Kaae ^a   Raiko, Tapani ^b   Maaløe, Lars ^c   Sønderby, Søren Kaae ^a   Winther, Ole ^a,c  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

^b AALTO UNIVERSITY   (Finland)

^c TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

LADDERS; LEARNING SYSTEMS; STOCHASTIC SYSTEMS;

DATA DEPENDENT; GENERATIVE MODEL; INFERENCE MODELS; LATENT VARIABLE; STATE OF THE ART; STOCHASTIC LAYERS; STOCHASTIC VARIABLE; VARIATIONAL MODELS;

STOCHASTIC MODELS;

EID: 85019264158     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. J. Bornschein, S. Shabanian, A. Fischer, and Y. Bengio. Bidirectional helmholtz machines. arXiv preprint arXiv: 1506.03877, 2015.
2. S. R. Bowman, L. Vilnis, O. Vinyals, A. M. Dai, R. Jozefowicz, and S. Bengio. Generating sentences from a continuous space. arXiv preprint arXiv: 1511.06349, 2015.
3. Y. Burda, R. Grosse, and R. Salakhutdinov. Importance weighted autoencoders. arXiv preprint arXiv: 1509.00519, 2015.
4. P. Dayan, G. E. Hinton, R. M. Neal, and R. S. Zemel. The Helmholtz machine. Neural computation, 7(5): 889-904, 1995.
5. S. Dieleman, J. Schlüter, C. Raffel, E. Olson, S. K. Sønderby, D. Nouri, A. van den Oord, and E. B. and Lasagne: First release., Aug. 2015.
6. K. Gregor, I. Danihelka, A. Graves, and D. Wierstra. Draw: A recurrent neural network for image generation. arXiv preprint arXiv: 1502.04623, 2015.
7. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv: 1502.03167, 2015.
8. D. Kingma and J. Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv: 1412.6980, 2014.
9. D. P. Kingma, S. Mohamed, D. J. Rezende, and M. Welling. Semi-supervised learning with deep generative models. In Advances in Neural Information Processing Systems, 2014.
10. D. P. Kingma and M. Welling. Auto-encoding variational Bayes. arXiv preprint arXiv: 1312.6114, 2013.
11. B. M. Lake, R. R. Salakhutdinov, and J. Tenenbaum. One-shot learning by inverting a compositional causal process. In Advances in neural information processing systems, 2013.
12. Y. LeCun, F. J. Huang, and L. Bottou. Learning methods for generic object recognition with invariance to pose and lighting. In Computer Vision and Pattern Recognition. IEEE, 2004.
13. L. Maaløe, C. K. Sønderby, S. K. Sønderby, and O. Winther. Auxiliary deep generative models. Proceedings of the 33nd International Conference on Machine Learning, 2016.
14. D. J. MacKay. Local minima, symmetry-breaking, and model pruning in variational free energy minimization. Inference Group, Cavendish Laboratory, Cambridge, UK, 2001.
15. T. Raiko, Y. Li, K. Cho, and Y. Bengio. Iterative neural autoregressive distribution estimator NADE-k. In Advances in Neural Information Processing Systems, 2014.
16. T. Raiko, H. Valpola, M. Harva, and J. Karhunen. Building blocks for variational Bayesian learning of latent variable models. The Journal of Machine Learning Research, 8, 2007.
17. A. Rasmus, M. Berglund, M. Honkala, H. Valpola, and T. Raiko. Semi-supervised learning with ladder networks. In Advances in Neural Information Processing Systems, 2015.
18. D. J. Rezende and S. Mohamed. Variational inference with normalizing flows. arXiv preprint arXiv: 1505.05770, 2015.
19. D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic backpropagation and approximate inference in deep generative models. arXiv preprint arXiv: 1401.4082, 2014.
20. Theano Development Team. Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints, abs/1605.02688, May 2016.
21. D. Tran, R. Ranganath, and D. M. Blei. Variational Gaussian process. arXiv preprint arXiv: 1511.06499, 2015.
22. H. Valpola. From neural PCA to deep unsupervised learning. 2015. arXiv preprint arXiv: 1411.7783.
23. G. van den Broeke. What auto-encoders could learn from brains - generation as feedback in unsupervised deep learning and inference, 2016. MSc thesis, Aalto University, Finland.
24. A. van den Oord, N. Kalchbrenner, and K. Kavukcuoglu. Pixel recurrent neural networks. arXiv preprint arXiv: 1601.06759, 2016.