Single Sample Face Recognition via Learning Deep Supervised Autoencoders

IEEE Transactions on Information Forensics and Security

Volumn 10, Issue 10, 2015, Pages 2108-2118

  Gao, S ^a   Zhang, Y ^a,d   Jia, K ^b   Lu, J ^c  

^a SHANGHAITECH UNIVERSITY   (China)

^b UNIVERSITY OF MACAU   (Macao)

^c ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

^d ZHEJIANG UNIVERSITY   (China)

Author keywords

Deep architecture; Face recognition; Single training sample per person; Supervised Auto encoder

Indexed keywords

CLASSIFICATION (OF INFORMATION); DEEP LEARNING; NETWORK ARCHITECTURE; SAMPLING;

AUTO ENCODERS; DEEP ARCHITECTURES; DOMAIN INFORMATIONS; FACE REPRESENTATIONS; IMAGE REPRESENTATIONS; RECOGNITION ACCURACY; SINGLE TRAINING SAMPLE; SPARSE REPRESENTATION BASED CLASSIFICATIONS;

FACE RECOGNITION;

EID: 84939231326     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2015.2446438     Document Type: Article

References (57)

1. Y. Su, S. Shan, X. Chen, and W. Gao, "Adaptive generic learning for face recognition from a single sample per person, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2699-2706.
2. X. Tan, S. Chen, Z.-H. Zhou, and F. Zhang, "Face recognition from a single image per person: A survey, " Pattern Recognit., vol. 39, no. 9, pp. 1725-1745, 2006.
3. L. Fei-Fei, R. Fergus, and P. Perona, "One-shot learning of object categories, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 594-611, Apr. 2006.
4. M. A. Turk and A. P. Pentland, "Face recognition using eigenfaces, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 1991, pp. 586-591.
5. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
6. Q.-X. Gao, L. Zhang, and D. Zhang, "Face recognition using FLDA with single training image per person, " Appl. Math. Comput., vol. 205, no. 2, pp. 726-734, 2008.
7. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
8. Q. V. Le et al., "Building high-level features using large scale unsupervised learning, " in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 81-88.
9. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1106-1114.
10. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets, " Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
11. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, " J. Mach. Learn. Res., vol. 11, no. 5, pp. 3371-3408, 2010.
12. D. Erhan, Y. Bengio, A. Courville, P.-A. Manzagol, P. Vincent, and S. Bengio, "Why does unsupervised pre-training help deep learning?" J. Mach. Learn. Res., vol. 11, pp. 625-660, Feb. 2010.
13. J. Yang, D. Zhang, A. F. Frangi, and J.-Y. Yang, "Two-dimensional PCA: A new approach to appearance-based face representation and recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 1, pp. 131-137, Jan. 2004.
14. J. Wu and Z.-H. Zhou, "Face recognition with one training image per person, " Pattern Recognit. Lett., vol. 23, no. 14, pp. 1711-1719, 2002.
15. S. Chen, D. Zhang, and Z.-H. Zhou, "Enhanced (PC)2A for face recognition with one training image per person, " Pattern Recognit. Lett., vol. 25, no. 10, pp. 1173-1181, 2004.
16. A. M. Martinez, "Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 6, pp. 748-763, Jun. 2002.
17. S. Shan, B. Cao, W. Gao, and D. Zhao, "Extended Fisherface for face recognition from a single example image per person, " in Proc. IEEE Int. Symp. Circuits Syst., May 2002, pp. II-81-II-84.
18. S. Chen, J. Liu, and Z.-H. Zhou, "Making FLDA applicable to face recognition with one sample per person, " Pattern Recognit., vol. 37, no. 7, pp. 1553-1555, 2004.
19. T.-K. Kim and J. Kittler, "Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 318-327, Mar. 2005.
20. Y. Tang, R. Salakhutdinov, and G. E. Hinton, "Deep Lambertian networks, " in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 1623-1630.
21. N. Japkowicz, S. J. Hanson, and M. A. Gluck, "Nonlinear autoassociation is not equivalent to PCA, " Neural Comput., vol. 12, no. 3, pp. 531-545, 2000.
22. S. Rifai, P. Vincent, X. Muller, X. Glorot, and Y. Bengio, "Contractive auto-encoders: Explicit invariance during feature extraction, " in Proc. 28th Int. Conf. Mach. Learn., 2011, pp. 833-840.
23. S. Rifai et al., "Higher order contractive auto-encoder, " in Proc. Eur. Conf. Mach. Learn., 2011, pp. 645-660.
24. W. Y. Zou, A. Y. Ng, S. Zhu, and K. Yu, "Deep learning of invariant features via simulated fixations in video, " in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 3203-3211.
25. Q. V. Le, A. Karpenko, J. Ngiam, and A. Y. Ng, "ICA with reconstruction cost for efficient overcomplete feature learning, " in Proc. Adv. Neural Inf. Process. Syst., 2011.
26. S. Chopra, R. Hadsell, and Y. LeCun, "Learning a similarity metric discriminatively, with application to face verification, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 539-546.
27. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "Deepface: Closing the gap to human-level performance in face verification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1701-1708.
28. Z. Zhu, P. Luo, X. Wang, and X. Tang, "Deep learning identitypreserving face space, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 113-120.
29. Z. Zhu, P. Luo, X. Wang, and X. Tang. (2014). "Recover canonicalview faces in the wild with deep neural networks." [Online]. Available: http://arxiv.org/abs/1404.3543
30. V. Nair and G. E. Hinton, "Rectified linear units improve restricted Boltzmann machines, " in Proc. 27th Int. Conf. Mach. Learn., 2010, pp. 807-814.
31. P. Lennie, "The cost of cortical computation, " Current Biol., vol. 13, no. 6, pp. 493-497, 2003.
32. Y. Bengio, "Learning deep architectures for AI, " Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
33. A. Ng, "Sparse autoencoder, " Stanford Univ., Stanford, CA, USA, Lecture Notes CS294A, 2011.
34. J. Xie, L. Xu, and E. Chen, "Image denoising and inpainting with deep neural networks, " in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 350-358.
35. R. Salakhutdinov and G. E. Hinton, "Learning a nonlinear embedding by preserving class neighbourhood structure, " in Proc. Int. Conf. Artif. Intell. Statist., 2007, pp. 412-419.
36. X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks, " in Proc. Int. Conf. Artif. Intell. Statist., 2010, pp. 249-256.
37. Y. Bengio, "Practical recommendations for gradient-based training of deep architectures, " in Neural Networks: Tricks of the Trade. Berlin, Germany: Springer-Verlag, 2012, pp. 437-478.
38. Q. V. Le, J. Ngiam, A. Coates, A. Lahiri, B. Prochnow, and A. Y. Ng, "On optimization methods for deep learning, " in Proc. 28th Int. Conf. Mach. Learn., 2011, pp. 265-272.
39. L. Zhang, M. Yang, and X. Feng, "Sparse representation or collaborative representation: Which helps face recognition?" in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 471-478.
40. L. Wolf, T. Hassner, and Y. Taigman, "The one-shot similarity kernel, " in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 897-902.
41. H. Fan, Z. Cao, Y. Jiang, Q. Yin, and C. Doudou. (2014). "Learning deep face representation." [Online]. Available: http://arxiv.org/abs/1403.2802
42. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression (PIE) database, " in Proc. 5th IEEE Int. Conf. FG, May 2002, pp. 46-51.
43. A. Martínez and R. Benavente, "The AR face database, " CVC Tech. Rep. #24, Jun. 1998.
44. A. S. Georghiades, P. N. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
45. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-PIE, " Image Vis. Comput., vol. 28, no. 5, pp. 807-813, 2010.
46. Y. Tang, R. Salakhutdinov, and G. E. Hinton, "Tensor analyzers, " in Proc. 30th Int. Conf. Mach. Learn., 2013, pp. 163-171.
47. S. Gao, I. W.-H. Tsang, and L.-T. Chia, "Sparse representation with kernels, " IEEE Trans. Image Process., vol. 22, no. 2, pp. 423-434, Feb. 2013.
48. X. Glorot, A. Bordes, and Y. Bengio, "Deep sparse rectifier neural networks, " in Proc. 14th Int. Conf. Artif. Intell. Statist., 2011, pp. 315-323.
49. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, vol. 313, no. 5786, pp. 504-507, 2006.
50. J. Hu, J. Lu, and Y.-P. Tan, "Discriminative deep metric learning for face verification in the wild, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 1875-1882.
51. N. Pinto, J. J. DiCarlo, and D. D. Cox, "How far can you get with a modern face recognition test set using only simple features?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 2591-2598.
52. H. Li, G. Hua, Z. Lin, J. Brandt, and J. Yang, "Probabilistic elastic matching for pose variant face verification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 3499-3506.
53. S. R. Arashloo and J. Kittler, "Efficient processing of MRFs for unconstrained-pose face recognition, " in Proc. IEEE 6th Int. Conf. Biometrics, Theory, Appl. Syst. (BTAS), Sep./Oct. 2013, pp. 1-8.
54. K. Simonyan, O. M. Parkhi, A. Vedaldi, and A. Zisserman, "Fisher vector faces in the wild, " in Proc. Brit. Mach. Vis. Conf., 2013, pp. 8.1-8.12.
55. H. Li, G. Hua, X. Shen, Z. Lin, and J. Brandt, "Eigen-PEP for video face recognition, " in Computer Vision (Lecture Notes in Computer Science), vol. 9005. Berlin, Germany: Springer-Verlag, 2015, pp. 17-33.
56. S. R. Arashloo and J. Kittler, "Class-specific kernel fusion of multiple descriptors for face verification using multiscale binarised statistical image features, " IEEE Trans. Inf. Forensics Security, vol. 9, no. 12, pp. 2100-2109, Dec. 2014.
57. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks, " in Computer Vision (Lecture Notes in Computer Science), vol. 8689. New York, NY, USA: Springer-Verlag, 2014, pp. 818-833.