Β-VAE: Learning basic visual concepts with a constrained variational framework

5th International Conference on Learning Representations, ICLR 2017 - Conference Track Proceedings

Volumn , Issue , 2017, Pages

  Higgins, Irina ^a   Matthey, Loic ^a   Pal, Arka ^a   Burgess, Christopher ^a   Glorot, Xavier ^a   Botvinick, Matthew ^a   Mohamed, Shakir ^a   Lerchner, Alexander ^a  

^a DEEPMIND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED DISCOVERY; HYPER-PARAMETER; RECONSTRUCTION ACCURACY; SEMI-SUPERVISED; STATE OF THE ART; UNSUPERVISED DATA; VARIATIONAL FRAMEWORK; VISUAL INSPECTION;

EID: 85087331890     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. M. Aubry, D. Maturana, A. Efros, B. Russell, and J. Sivic. Seeing 3d chairs: exemplar part-based 2d-3d alignment using a large dataset of cad models. In CVPR, 2014.
2. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. In IEEE Transactions on Pattern Analysis & Machine Intelligence, 2013.
3. Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, and Pieter Abbeel. Infogan: Interpretable representation learning by information maximizing generative adversarial nets. arXiv, 2016.
4. Brian Cheung, Jesse A. Levezey, Arjun K. Bansal, and Bruno A. Olshausen. Discovering hidden factors of variation in deep networks. In Proceedings of the International Conference on Learning Representations, Workshop Track, 2015.
5. T. Cohen and M. Welling. Transformation properties of learned visual representations. In ICLR, 2015.
6. Taco Cohen and Max Welling. Learning the irreducible representations of commutative lie groups. arXiv, 2014.
7. G. Desjardins, A. Courville, and Y. Bengio. Disentangling factors of variation via generative entangling. arXiv, 2012.
8. Carl Doersch. Tutorial on variational autoencoders. arxiv, 2016.
9. John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 2011.
10. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. NIPS, pp. 2672-2680, 2014.
11. Ross Goroshin, Michael Mathieu, and Yann LeCun. Learning to linearize under uncertainty. NIPS, 2015.
12. G. Hinton, A. Krizhevsky, and S. D. Wang. Transforming auto-encoders. International Conference on Artificial Neural Networks, 2011.
13. Michael I Jordan, Zoubin Ghahramani, Tommi S Jaakkola, and Lawrence K Saul. An introduction to variational methods for graphical models. Machine learning, 37(2):183-233, 1999.
14. Theofanis Karaletsos, Serge Belongie, and Gunnar Rätsch. Bayesian representation learning with oracle constraints. ICLR, 2016.
15. W. Karush. Minima of Functions of Several Variables with Inequalities as Side Constraints. Master's thesis, Univ. of Chicago, Chicago, Illinois, 1939.
16. D. P. Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv, 2014.
17. D. P. Kingma and M. Welling. Auto-encoding variational bayes. ICLR, 2014.
18. H. W. Kuhn and A. W. Tucker. Nonlinear programming. In Proceedings of 2nd Berkeley Symposium, pp. 481-492, 1951.
19. Tejas Kulkarni, William Whitney, Pushmeet Kohli, and Joshua Tenenbaum. Deep convolutional inverse graphics network. NIPS, 2015.
20. Brenden M. Lake, Tomer D. Ullman, Joshua B. Tenenbaum, and Samuel J. Gershman. Building machines that learn and think like people. arXiv, 2016.
21. Z. Liu, P. Luo, X. Wang, and X. Tang. Deep learning face attributes in the wild. ICCV, 2015.
22. P. Paysan, R. Knothe, B. Amberg, S. Romdhani, and T. Vetter. A 3d face model for pose and illumination invariant face recognition. AVSS, 2009.
23. Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, and David Cournapeau. Scikit-learn: Machine learning in python. Journal of Machine Learning Research, 2011.
24. Alec Radford, Luke Metz, and Soumith Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv, 2015.
25. Scott Reed, Kihyuk Sohn, Yuting Zhang, and Honglak Lee. Learning to disentangle factors of variation with manifold interaction. ICML, 2014.
26. Danilo J. Rezende, Shakir Mohamed, and Daan Wierstra. Stochastic backpropagation and approximate inference in deep generative models. arXiv, 2014.
27. Karl Ridgeway. A survey of inductive biases for factorial Representation-Learning. arXiv, 2016. URL http://arxiv.org/abs/1612.05299.
28. Oren Rippel and Ryan Prescott Adams. High-dimensional probability estimation with deep density models. arXiv, 2013.
29. Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. Improved techniques for training GANs. arXiv, 2016. URL http://arxiv.org/abs/1606.03498.
30. Jürgen Schmidhuber. Learning factorial codes by predictability minimization. Neural Computation, 4(6):863-869, 1992.
31. Wenzhe Shi, Jose Caballero, Ferenc Huszár, Johannes Totz, Andrew P Aitken, Rob Bishop, Daniel Rueckert, and Zehan Wang. Real-Time single image and video Super-Resolution using an efficient Sub-Pixel convolutional neural network. arXiv, 2016.
32. Yichuan Tang, Ruslan Salakhutdinov, and Geoffrey Hinton. Tensor analyzers. In Proceedings of the 30th International Conference on Machine Learning, 2013, Atlanta, USA, 2013.
33. William F. Whitney, Michael Chang, Tejas Kulkarni, and Joshua B. Tenenbaum. Understanding visual concepts with continuation learning. arXiv, 2016. URL http://arxiv.org/pdf/1602.06822.pdf.
34. Jimei Yang, Scott Reed, Ming-Hsuan Yang, and Honglak Lee. Weakly-supervised disentangling with recurrent transformations for 3d view synthesis. NIPS, 2015.
35. Junbo Zhao, Michael Mathieu, and Yann LeCun. Energy-based generative adversarial network. arXiv, 2016. URL http://arxiv.org/abs/1609.03126.
36. Z. Zhu, P. Luo, X. Wang, and X. Tang. Multi-view perceptron: a deep model for learning face identity and view representations. In Advances in Neural Information Processing Systems 27. 2014.