Learning hierarchical representations for face verification with convolutional deep belief networks

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2012, Pages 2518-2525

  Huang, Gary B ^a   Lee, Honglak ^b   Learned Miller, Erik ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP BELIEF NETWORKS; DEEP LEARNING; DESCRIPTORS; FACE RECOGNITION SYSTEMS; FACE VERIFICATION; FEATURE REPRESENTATION; GLOBAL STRUCTURE; HIERARCHICAL REPRESENTATION; HIGH RESOLUTION IMAGE; IMAGE DESCRIPTORS; LEARNING MODELS; LOCAL BINARY PATTERNS; NATURAL SOURCES; NOVEL APPLICATIONS; OBJECT CLASS; PIXEL INTENSITIES; RECOGNITION SYSTEMS; RESTRICTED BOLTZMANN MACHINE; STATIONARITY;

CONVOLUTION; FACE RECOGNITION; NETWORK ARCHITECTURE;

COMPUTER VISION;

EID: 84866691616     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2012.6247968     Document Type: Conference Paper

References (41)

1. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle. Greedy layer-wise training of deep networks. In NIPS, 2007. 1, 2
2. Y.-L. Boureau, F. R. Bach, Y. LeCun, and J. Ponce. Learning mid-level features for recognition. In CVPR, 2010. 4
3. Z. Cao, Q. Yin, X. Tang, and J. Sun. Face recognition with learning-based descriptor. In CVPR, 2010. 2, 5, 7
4. O. Chapelle, B. Schölkopf, and A. Zien. Semi-supervised learning. MIT Press, 2006. 3
5. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon. Information-theoretic metric learning. In ICML, 2007. 5
6. E. Doi, T. Inui, T.-W. Lee, T. Wachtler, and T. J. Sejnowski. Spatiochromatic receptive field properties derived from information-theoretic analyses of cone mosaic responses to natural scenes. Neural Computation, 15:397-417, 2003. 6
7. I. J. Goodfellow, Q. V. Le, A. M. Saxe, H. Lee, and A. Y. Ng. Measuring invariances in deep networks. In NIPS, volume 22, 2009. 4
8. M. Guillaumin, J. Verbeek, and C. Schmid. Is that you? Metric learning approaches for face identification. In ICCV, 2009. 2
9. G. E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800, 2002. 4
10. G. E. Hinton, S. Osindero, and Y.-W. Teh. A fast learning algorithm for deep belief nets. Neural Computation, 18(7):1527-1554, 2006. 1, 2, 4
11. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst, 2007. 1
12. K. Jarrett, K. Kavukcuoglu, M. Ranzato, and Y. LeCun. What is the best multistage architecture for object recognition? In ICCV, 2009. 2, 3, 4
13. N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar. Attribute and simile classifiers for face verification. In ICCV, 2009. 2
14. H. Larochelle, D. Erhan, A. Courville, J. Bergstra, and Y. Bengio. An empirical evaluation of deep architectures on problems with many factors of variation. In ICML, 2007. 1
15. H. Lee, A. Battle, R. Raina, and A. Y. Ng. Efficient sparse coding algorithms. In NIPS, 2007. 2
16. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML, 2009. 2, 3
17. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Unsupervised learning of hierarchical representations with convolutional deep belief networks. Communications of the ACM, 54(10):95-103, 2011. 4
18. D. G. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60(2):91-110, 2004. 1
19. V. Nair and G. E. Hinton. Rectified linear units improve restricted boltzmann machines. In ICML, 2010. 2, 7
20. H. V. Nguyen and L. Bai. Cosine similarity metric learning for face verification. In ACCV, 2010. 2, 5, 7
21. K. Nigam, A. K. McCallum, S. Thrun, and T. Mitchell. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39:103-134, 2000. 3
22. T. Ojala, M. Pietikinen, and D. Harwood. A comparative study of texture measures with classification based on feature distributions. Pattern Recognition, 19(3):51-59, 1996. 1
23. B. A. Olshausen and D. J. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381:607-609, 1996. 2, 4
24. N. Pinto and D. Cox. Beyond simple features: A large-scale feature search approach to unconstrained face recognition. In Automatic Face and Gesture Recognition, 2011. 2
25. N. Pinto, J. J. DiCarlo, and D. D. Cox. How far can you get with a modern face recognition test set using only simple features? In CVPR, 2009. 7
26. R. Raina, A. Battle, H. Lee, B. Packer, and A. Y. Ng. Self-taught learning: Transfer learning from unlabeled data. In ICML, 2007. 3
27. M. Ranzato, Y. Boureau, and Y. LeCun. Sparse feature learning for deep belief networks. NIPS, 2007. 1
28. M. Ranzato and G. E. Hinton. Modeling Pixel Means and Covariances Using Factorized Third-Order Boltzmann Machines. In CVPR, 2010. 2
29. M. Ranzato, F.-J. Huang, Y.-L. Boureau, and Y. LeCun. Unsupervised learning of invariant feature hierarchies with applications to object recognition. In CVPR, 2007. 2
30. M. Ranzato, C. Poultney, S. Chopra, and Y. LeCun. Efficient learning of sparse representations with an energy-based model. In NIPS, 2006. 1, 4
31. M. Ranzato, J. Susskind, V. Mnih, and G. Hinton. On deep generative models with applications to recognition. In CVPR, 2011. 3, 4
32. S. Roth and M. J. Black. Fields of experts. IJCV, 82(2):205-229, 2009. 4
33. A. Saxe, P. W. Koh, Z. Chen, M. Bhand, B. Suresh, and A. Ng. On random weights and unsupervised feature learning. In ICML, 2011. 2, 3, 6
34. K. Sohn, D. Y. Jung, H. Lee, and A. Hero III. Efficient learning of sparse, distributed, convolutional feature representations for object recognition. In ICCV, 2011. 4
35. S. Sonnenburg, G. Raetsch, S. Henschel, C. Widmer, J. Behr, A. Zien, F. de Bona, A. Binder, C. Gehl, and V. Franc. The SHOGUN machine learning toolbox. JMLR, 11:1799-1802, June 2010. 6
36. J. Susskind, G. Hinton, R. Memisevic, and M. Pollefeys. Modeling the joint density of two images under a variety of transformations. In CVPR, 2011. 3
37. M.Welling, G. E. Hinton, and S. Osindero. Learning sparse topographic representations with products of student-t distributions. In NIPS, 2003. 4
38. L. Wolf, T. Hassner, and Y. Taigman. Similarity scores based on background samples. In ACCV, 2009. 1, 2, 6, 7
39. J. Yang, K. Yu, Y. Gong, and T. S. Huang. Linear spatial pyramid matching using sparse coding for image classification. In CVPR, 2009. 2
40. Q. Yin, X. Tang, and J. Sun. An associate-predict model for face recognition. In CVPR, 2011. 2, 7
41. M. Zeiler, D. Krishnan, G. Taylor, and R. Fergus. Deconvolutional networks. In CVPR, 2010. 2