InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 2180-2188

  Chen, Xi ^a,b   Duan, Yan ^a,b   Houthooft, Rein ^a,b   Schulman, John ^a,b   Sutskever, Ilya ^b   Abbeel, Pieter ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b OpenAI LLC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADVERSARIAL NETWORKS; INTERPRETABLE REPRESENTATION; LATENT VARIABLE; MUTUAL INFORMATIONS; PRESENCE/ABSENCE; RENDERED IMAGES; SUPERVISED METHODS; VISUAL CONCEPT;

INFORMATION THEORY;

EID: 85019228440     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Y. Bengio, "Learning deep architectures for ai," Foundations and trends in Machine Learning, 2009.
2. Y. Bengio, A. Courville, and P. Vincent, "Representation learning: A review and new perspectives," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 35, no. 8, 2013.
3. D. P. Kingma and M. Welling, "Auto-encoding variational bayes," arXiv preprint arXiv:1312.6114, 2013.
4. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets," in NIPS, 2014, pp. 2672-2680.
5. D. P. Kingma, S. Mohamed, D. J. Rezende, and M. Welling, "Semi-supervised learning with deep generative models," in NIPS, 2014, pp. 3581-3589.
6. B. Cheung, J. A. Livezey, A. K. Bansal, and B. A. Olshausen, "Discovering hidden factors of variation in deep networks," arXiv preprint arXiv:1412.6583, 2014.
7. T. D. Kulkarni, W. F. Whitney, P. Kohli, and J. Tenenbaum, "Deep convolutional inverse graphics network," in NIPS, 2015, pp. 2530-2538.
8. W. F. Whitney, M. Chang, T. Kulkarni, and J. B. Tenenbaum, "Understanding visual concepts with continuation learning," arXiv preprint arXiv:1602.06822, 2016.
9. A. Makhzani, J. Shlens, N. Jaitly, and I. Goodfellow, "Adversarial autoencoders," arXiv preprint arXiv:1511.05644, 2015.
10. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
11. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
12. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol, "Extracting and composing robust features with denoising autoencoders," in ICLR, 2008, pp. 1096-1103.
13. G. Desjardins, A. Courville, and Y. Bengio, "Disentangling factors of variation via generative entangling," arXiv preprint arXiv:1210.5474, 2012.
14. A. Rasmus, M. Berglund, M. Honkala, H. Valpola, and T. Raiko, "Semi-supervised learning with ladder networks," in NIPS, 2015, pp. 3532-3540.
15. L. Maaløe, C. K. Sønderby, S. K. Sønderby, and O. Winther, "Improving semi-supervised learning with auxiliary deep generative models," in ICML, 2016.
16. A. Radford, L. Metz, and S. Chintala, "Unsupervised representation learning with deep convolutional generative adversarial networks," arXiv preprint arXiv:1511.06434, 2015.
17. B. M. Lake, R. Salakhutdinov, and J. B. Tenenbaum, "Human-level concept learning through probabilistic program induction," Science, vol. 350, no. 6266, pp. 1332-1338, 2015.
18. J. B. Tenenbaum and W. T. Freeman, "Separating style and content with bilinear models," Neural computation, vol. 12, no. 6, pp. 1247-1283, 2000.
19. Z. Zhu, P. Luo, X. Wang, and X. Tang, "Multi-view perceptron: A deep model for learning face identity and view representations," in NIPS, 2014, pp. 217-225.
20. J. Yang, S. E. Reed, M.-H. Yang, and H. Lee, "Weakly-supervised disentangling with recurrent transformations for 3d view synthesis," in NIPS, 2015, pp. 1099-1107.
21. S. Reed, K. Sohn, Y. Zhang, and H. Lee, "Learning to disentangle factors of variation with manifold interaction," in ICML, 2014, pp. 1431-1439.
22. J. Susskind, A. Anderson, and G. E. Hinton, "The Toronto face dataset," Tech. Rep., 2010.
23. J. S. Bridle, A. J. Heading, and D. J. MacKay, "Unsupervised classifiers, mutual information and 'phantom targets'," in NIPS, 1992.
24. D. Barber and F. V. Agakov, "Kernelized infomax clustering," in NIPS, 2005, pp. 17-24.
25. A. Krause, P. Perona, and R. G. Gomes, "Discriminative clustering by regularized information maximization," in NIPS, 2010, pp. 775-783.
26. D. Barber and F. V. Agakov, "The IM algorithm: A variational approach to information maximization," in NIPS, 2003.
27. G. E. Hinton, P. Dayan, B. J. Frey, and R. M. Neal, "The "wake-sleep" algorithm for unsupervised neural networks," Science, vol. 268, no. 5214, pp. 1158-1161, 1995.
28. P. Paysan, R. Knothe, B. Amberg, S. Romdhani, and T. Vetter, "A 3d face model for pose and illumination invariant face recognition," in AVSS, 2009, pp. 296-301.
29. M. Aubry, D. Maturana, A. Efros, B. Russell, and J. Sivic, "Seeing 3D chairs: Exemplar part-based 2D-3D alignment using a large dataset of CAD models," in CVPR, 2014, pp. 3762-3769.
30. Z. Liu, P. Luo, X. Wang, and X. Tang, "Deep learning face attributes in the wild," in ICCV, 2015.
31. J. T. Springenberg, "Unsupervised and semi-supervised learning with categorical generative adversarial networks," arXiv preprint arXiv:1511.06390, 2015.