Hybrid Deep Learning for Face Verification

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 10, 2016, Pages 1997-2009

  Sun, Yi ^a   Wang, Xiaogang ^a   Tang, Xiaoou ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Convolutional networks; deep learning; face recognition

Indexed keywords

CONVOLUTION;

CONVOLUTIONAL NETWORKS; DEEP LEARNING; FACE VERIFICATION; HIDDEN LAYER NEURONS; HIGH-DIMENSIONAL; RELATIONAL FEATURES; RESTRICTED BOLTZMANN MACHINE; SIMILARITY INFORMATIONS;

FACE RECOGNITION;

EID: 84986331512     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2505293     Document Type: Article

References (61)

1. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
2. O. Barkan, J. Weill, L. Wolf, and H. Aronowitz, "Fast high dimensional vector multiplication face recognition, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1960-1967.
3. P. N. Belhumeur, J. P. Hespanha, andD. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
4. T. Berg and P. Belhumeur, "Tom-vs-Pete classifiers and identitypreserving alignment for face verification, " in Proc. Brit. Mach. Vis. Conf., 2012, pp. 129. 1-129. 11.
5. T. Berg and P. Belhumeur, "Poof: Part-based one-vs-one features for fine-grained categorization, face verification, and attribute estimation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 955-962.
6. A. Bissacco, M. Cummins, Y. Netzer, and H. Neven, "Photoocr: Reading text in uncontrolled conditions, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 785-792.
7. X. Cai, C. Wang, B. Xiao, X. Chen, and J. Zhou, "Deep nonlinear metric learning with independent subspace analysis for face verification, " in Proc. ACM Multimedia, 2012, pp. 749-752.
8. Q. Cao, Y. Ying, and P. Li, "Similarity metric learning for face recognition, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 2408-2415.
9. X. Cao, D. Wipf, F. Wen, G. Duan, and J. Sun, "A practical transfer learning algorithm for face verification, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 3208-3215.
10. Z. Cao, Q. Yin, X. Tang, and J. Sun, "Face recognition with learning-based descriptor, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 2707-2714.
11. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines, " ACM Trans. Intell. Syst. Technol., vol. 2, pp. 27:1-27:27, 2011.
12. D. Chen, X. Cao, L. Wang, F. Wen, and J. Sun, "Bayesian face revisited: Ajoint formulation, " in Proc. Eur. Conf. Comput. Vis., 2012.
13. D. Chen, X. Cao, F. Wen, and J. Sun, "Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3025-3032.
14. S. Chopra, R. Hadsell, and Y. LeCun, "Learning a similarity metric discriminatively, with application to face verification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2005, pp. 539-546.
15. D. Ciresan, U. Meier, and J. Schmidhuber, "Multi-column deep neural networks for image classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3642-3649.
16. Z. Cui, W. Li, D. Xu, S. Shan, and X. Chen, "Fusing robust face region descriptors via multiple metric learning for face recognition in the wild, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3554-3561.
17. O. Deniz, G. Bueno, J. Salido, and F. De la Torre, "Face recognition using histograms of oriented gradients, " Pattern Recog. Lett., vol. 32, no. 12, pp. 1598-1603, Sep. 2011.
18. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification, " J. Mach. Learn. Res., vol. 9, pp. 1871-1874, 2008.
19. C. Farabet, C. Couprie, L. Najman, and Y. LeCun, "Learning hierarchical features for scene labeling, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1915-1929, Aug. 2013.
20. M. Guillaumin, J. Verbeek, and C. Schmid, "Is that you metric learning approaches for face identification, " in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 498-505.
21. G. Hinton and S. Osindero, "A fast learning algorithm for deep belief nets, " Neural Comput., vol. 18, pp. 1527-1554, 2006.
22. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, vol. 313, pp. 504-507, 2006.
23. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Improving neural networks by preventing co-adaptation of feature detectors, " CoRR, abs/1207. 0580, 2012.
24. J. Hu, J. Lu, and Y.-P. Tan, "Discriminative deep metric learning for face verification in the wild, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1875-1882.
25. C. Huang, S. Zhu, and K. Yu, "Large scale strongly supervised ensemble metric learning, with applications to face verification and retrieval, " NEC Tech. Rep. TR115, 2011.
26. G. B. Huang, H. Lee, and E. Learned-Miller, "Learning hierarchical representations for face verification with convolutional deep belief networks, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2518-2525.
27. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments, " Univ. Massachusetts, Amherst, Tech. Rep. 07-49, 2007.
28. Z. Huang, X. Zhao, S. Shan, R. Wang, and X. Chen, "Coupling alignments with recognition for still-to-video face recognition, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 3296-3303.
29. K. Jarrett, K. Kavukcuoglu, M. Ranzato, and Y. LeCun, "What is the best multi-stage architecture for object recognition" in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 2146-2153.
30. M. Kan, S. Shan, H. Chang, and X. Chen, "Stacked progressive auto-encoders (SPAE) for face recognition across poses, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1883-1890.
31. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and F.-F. Li, "Large-scale video classification with convolutional neural networks, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1725-1732.
32. A. Krizhevsky, I. Sutskever, and G. Hinton, "Imagenet classification with deep convolutional neural networks, " in Proc. NIPS, 2012, pp. 1097-1105.
33. N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar, "Attribute and simile classifiers for face verification, " in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 365-372.
34. H. Larochelle, M. Mandel, R. Pascanu, and Y. Bengio, "Learning algorithms for the classification restricted Boltzmann machine, " J. Mach. Learn. Res., vol 13, pp. 643-669, 2012.
35. Q. Le, M. Ranzato, R. Monga, M. Devin, K. Chen, G. Corrado, J. Dean, and A. Ng, "Building high-level features using large scale unsupervised learning, " in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 81-88.
36. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition, " Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
37. H. Li, G. Hua, Z. Lin, J. Brandt, and J. Yang, "Probabilistic elastic matching for pose variant face verification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3499-3506.
38. P. Li, S. Prince, Y. Fu, U. Mohammed, and J. Elder, "Probabilistic models for inference about identity, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 144-157, Jan. 2012.
39. P. Luo, X. Wang, and X. Tang, "Hierarchical face parsing via deep learning, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2480-2487.
40. P. Luo, X. Wang, and X. Tang, "A deep sum-product architecture for robust facial attributes analysis, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 2864-2871.
41. V. Nair and G. E. Hinton, "Rectified linear units improve restricted Boltzmann machines, " in Proc. Int. Conf. Mach. Learn., 2010, pp. 807-814.
42. H. V. Nguyen and L. Bai, "Cosine similarity metric learning for face verification, " in Proc. 10th Asian Conf. Comput. Vis., 2010, pp. 709-720.
43. M. Oquab, L. Bottou, I. Laptev, and J. Sivic, "Learning and transferring mid-level image representations using convolutional neural networks, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1717-1724.
44. N. Pinto and D. D. Cox, "Beyond simple features: A large-scale feature search approach to unconstrained face recognition, " in Proc. IEEE Int. Conf. Autom. Face Gesture Recog. Workshops, 2011, pp. 8-15.
45. H. Poon and P. Domingos, "Sum-product networks: A new deep architecture, " in Proc. UAI, 2011, pp. 337-346.
46. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun, "OverFeat: Integrated recognition, localization and detection using convolutional networks, " in Proc. Int. Conf. Learn. Representations, 2014.
47. K. Simonyan, O. M. Parkhi, A. Vedaldi, and A. Zisserman, "Fisher vector faces in the wild, " in Proc. Brit. Mach. Vis. Conf., 2013, pp. 8. 1-8. 12.
48. Y. Sun, X. Wang, and X. Tang, "Deep convolutional network cascade for facial point detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3476-3483.
49. Y. Sun, X. Wang, and X. Tang, "Hybrid deep learning for face verification, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1489-1496.
50. Y. Sun, X. Wang, and X. Tang, "Deep learning face representation from predicting 10, 000 classes, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1891-1898.
51. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "DeepFace: Closing the gap to human-level performance in face verification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1701-1708.
52. A. Wagner, J. Wright, A. Ganesh, Z. Zhou, H. Mobahi, and Y. Ma, "Toward a practical face recognition system: Robust alignment and illumination by sparse representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, vol. 2, pp. 372-386, Feb. 2012.
53. X. Wang and X. Tang, "A unified framework for subspace face recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1222-1228, Sep. 2004.
54. L. Wiskott, J.-M. Fellous, N. Krger, and C. V. D. Malsburg, "Face recognition by elastic bunch graph matching, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 775-779, Jul. 1997.
55. L. Wolf, T. Hassner, and Y. Taigman, "Descriptor based methods in the wild, " in Proc. Workshop Faces Real-Life Images ECCV, 2008.
56. L. Wolf, T. Hassner, and Y. Taigman, "Effective unconstrained face recognition by combining multiple descriptors and learned background statistics, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 1978-1990, Oct. 2011.
57. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
58. M. Yang and L. Zhang, "Gabor feature based sparse representation for face recognition with Gabor occlusion dictionary, " in Proc. Eur. Conf. Comput. Vis., 2010, pp. 448-461.
59. Q. Yin, X. Tang, and J. Sun, "An associate-predict model for face recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 497-504.
60. L. Zhang, M. Yang, and X. Feng, "Sparse representation or collaborative representation: Which helps face recognition" in Proc. Int. Conf. Comput. Vis., 2011, pp. 471-478.
61. Z. Zhu, P. Luo, X. Wang, and X. Tang, "Deep learning Identitypreserving face space, in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 113-120.