Learning to disentangle factors of variation with manifold interaction

31st International Conference on Machine Learning, ICML 2014

Volumn 4, Issue , 2014, Pages 3291-3299

  Reed, Scott ^a   Sohn, Kihyuk ^a   Zhang, Yuting ^a   Lee, Honglak ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING ALGORITHMS; LEARNING SYSTEMS;

BOLTZMANN MACHINES; EMOTION RECOGNITION; FACE DATABASE; FACE VERIFICATION; HIGHER-ORDER; INVARIANT FEATURES; LATENT FACTOR; TRAINING STRATEGY;

FACE RECOGNITION;

EID: 84919832734     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Argyriou, A., Evgeniou, T., and Pontil, M. Multi-task feature learning. In NIPS, 2007.
2. Bengio, Y. Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1): 1-127, 2009.
3. Bengio, Y., Mesnil, G., Dauphin, Y., and Rifai, S. Better mixing via deep representations. In ICML, 2013.
4. Caruana, R. Multitask learning. Machine Learning, 28(1): 41-75, 1997.
5. Coates, A. and Ng, A. Y. The importance of encoding versus training with sparse coding and vector quantization. In ICML, 2011.
6. Courville, A., Bergstra, I., and Bengio, Y. A spike and slab restricted Boltzmann machine. In AISTATS, 2011.
7. Desjardins, G., Courville, A., and Bengio, Y. Disentangling factors of variation via generative entangling. arXiv: 1210.5474, 2012.
8. Goodfellow, I., Mirza, M., Courville, A., and Bengio, Y. Multi-prediction deep Boltzmann machines. In NIPS. 2013.
9. Gross, R., Matthews, I., Cohn, J., Kanade, T., and Baker, S. Multi-PIE. Image and Vision Computing, 28(5), 2010.
10. Hadsell, R., Chopra, S., and LeCun, Y. Dimensionality reduction by learning an invariant mapping. In CVPR, 2006.
11. Hinton, G. E. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8): 1771-1800, 2002.
12. Hinton, G. E. A practical guide to training restricted boltzmann machines. Technical report, 2010.
13. Hinton, G. E. and Salakhutdinov, R. Reducing the dimensionality of data with neural networks. Science, 313 (5786):504-507, 2006.
14. Huang, G. B., Lee, H., and Learned-Miller, E. Learning hierarchical representations for face verification with con- volutional deep belief networks. In CVPR, 2012a.
15. Huang, G. B., Mattar, M., Lee, H., and Learned-Miller, E. Learning to align from scratch. In NIPS. 2012b.
16. Kavukcuoglu, K., Ranzato, M., Fergus, R., and LeCun, Y. Learning invariant features through topographic filter maps. In CVPR, 2009.
17. Larochelle, H. and Bengio, Y. Classification using discriminative restricted Boltzmann machines. In ICML, 2008.
18. Le, Q. V., Zou, W. Y., Yeung, S. Y. and Ng, A. Y. Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis. In CVPR, 2011.
19. LeCun, Y. and Cortes, C. The MNIST database of handwritten digits, 1998.
20. Lee, H., Ekanadham, C., and Ng, A. Y. Sparse deep belief net model for visual area V2. In NIPS. 2008.
21. Lee, H., Grosse, R., Ranganath, R. and Ng, A. Y. Unsupervised learning of hierarchical representations with convolutional deep belief networks. Communications of the ACM, 54(10):95-103, 2011.
22. Lowe, D. G. Object recognition from local scale-invariant features. In CVPR, 1999.
23. Memisevic, R. and Hinton, G. E. Learning to represent spatial transformations with factored higher-order Boltzmann machines. Neural Computation, 22(6): 1473- 1492, 2010.
24. Ranzato, M., Huang, F. J., Boureau, Y. L., and LeCun, Y. Unsupervised learning of invariant feature hierarchies with applications to object recognition. In CVPR, 2007.
25. Ranzato, M., Susskind, J., Mnih, V., and Hinton, G. E. On deep generative models with applications to recognition. In CVPR, 2011.
26. Rifai, S., Vincent, P., Muller, X., Glorot, X., and Bengio, Y. Contractive auto-encoders: Explicit invariance during feature extraction. In ICML, 2011.
27. Rifai, S., Bengio, Y., Courville, A., Vincent, P., and Mirza, M. Disentangling factors of variation for facial expression recognition. In ECCV, 2012.
28. Roweis, S. T. and Saul, L. K. Nonlinear dimensionality reduction by locally linear embedding. Science, 290 (5500):2323-2326, 2000.
29. Salakhutdinov, R. and Hinton, G. E. Deep Boltzmann machines. In AI ST ATS, 2009.
30. Sohn, K. and Lee, H. Learning invariant representations with local transformations. In ICML, 2012.
31. Sohn, K., Zhou, G., Lee, C., and Lee, H. Learning and selecting features jointly with point-wise gated Boltzmann machines. In ICML, 2013.
32. Stoyanov, V., Ropson, A., and Eisner, J. Empirical risk minimization of graphical model parameters given approximate inference, decoding, and model structure. In AISTATS, 2011.
33. Susskind, J., Anderson, A., and Hinton, G. E. The Toronto Face Database. Technical report, University of Toronto, 2010.
34. Susskind, J., Memisevic, R., Hinton, G. E., and Pollefeys, M. Modeling the joint density of two images under a variety of transformations. In CVPR, 2011.
35. Tang, Y., Salakhutdinov, R., and Hinton, G. E. Tensor analyzers. In ICML, 2013.
36. Tenenbaum, J. B. and Freeman, W. T. Separating style and content with bilinear models. Neural Computation, 12 (6): 1247-1283, 2000.
37. Tenenbaum, J. B., De Silva, V., and Langford, J. C. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319-2323, 2000.
38. Tieleman, T. Training restricted Boltzmann machines using approximations to the likelihood gradient. In ICML, 2008.