Robust Face Recognition via Multimodal Deep Face Representation

IEEE Transactions on Multimedia

Volumn 17, Issue 11, 2015, Pages 2049-2058

  Ding, Changxing ^a   Tao, Dacheng ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Convolutional neural networks (CNNs); deep learning; face recognition; multimodal system

Indexed keywords

CONVOLUTION; NEURAL NETWORKS;

CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; FACE RECOGNITION ALGORITHMS; HIGH DIMENSIONAL FEATURE; MULTI-MODAL INFORMATION; MULTIMEDIA APPLICATIONS; MULTIMODAL SYSTEM; PERFORMANCE DEGRADATION;

FACE RECOGNITION;

EID: 84946716984     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2015.2477042     Document Type: Article

References (42)

1. C. Ding and D. Tao, "A comprehensive survey on pose-invariant face recognition," CoRR, 2015 [Online]. Available: http://arxiv.org/abs/1502.04383
2. J. Y. Choi, W. De Neve, K. N. Plataniotis, and Y. M. Ro, "Collaborative face recognition for improved face annotation in personal photo collections shared on online social networks," IEEE Trans. Multimedia, vol. 13, no. 1, pp. 14-28, Jan. 2011.
3. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
4. V. Ojansivu and J. Heikkilä, "Blur insensitive texture classification using local phase quantization," in Image Signal Process. New York, NY, USA: Springer, 2008, pp. 236-243.
5. T. Ahonen, E. Rahtu, V. Ojansivu, and J. Heikkila, "Recognition of blurred faces using local phase quantization," in Proc. Int. Conf. Pattern Recog., 2008, pp. 1-4.
6. C. Ding, J. Choi, D. Tao, and L. S. Davis, "Multi-directional multi-level dual-cross patterns for robust face recognition," IEEE Trans. Pattern Anal. Mach. Intell., to be published.
7. J. Kannala and E. Rahtu, "BSIF: Binarized statistical image features," in Proc. IEEE Int. Conf. Pattern Recog., Nov. 2012, pp. 1363-1366.
8. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "Deepface: Closing the gap to human-level performance in face verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2014, pp. 1701-1708.
9. Y. Sun, Y. Chen, X. Wang, and X. Tang, "Deep learning face representation by joint identification-verification," in Proc. Adv. Neural Inf. Process. Syst., 2014, pp. 1988-1996.
10. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, Labeled faces in the wild: A database for studying face recognition in unconstrained environments Univ. Massachusetts, Amherst, MA, USA, Tech. Rep., Oct. 2007, pp. 07-49.
11. D. Yi, Z. Lei, S. Liao, and S. Z. Li, "Learning face representation from scratch," CoRR, 2014 [Online]. Available: http://arxiv.org/abs/1411. 7923
12. M. Gunther et al., "The 2013face recognition evaluation in mobile environment," in Proc. IEEE/IAPR Int. Conf. Biometrics, Jun. 2013, pp. 1-7.
13. R. Beveridge et al., "Report on the FG 2015 video person recognition evaluation," in Proc. IEEE Int. Conf. Automat. Face Gesture Recog., May 2015, pp. 1-8.
14. S. Rahimzadeh Arashloo and J. Kittler, "Dynamic texture recognition using multiscale binarised statistical image features," IEEE Trans. Multimedia, vol. 16, no. 8, pp. 2099-2109, Aug. 2014.
15. Z. Lei, M. Pietikainen, and S. Z. Li, "Learning discriminant face descriptor," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 2, pp. 289-302, Feb. 2014.
16. C. Ding, C. Xu, and D. Tao, "Multi-task pose-invariant face recognition," IEEE Trans. Image Process., vol. 24, no. 3, pp. 980-993, Mar. 2015.
17. C.-K. Hsieh, S.-H. Lai, and Y.-C. Chen, "Expression-invariant face recognition with constrained optical flow warping," IEEE Trans. Multimedia, vol. 11, no. 4, pp. 600-610, Apr. 2009.
18. E. Zhou, Z. Cao, and Q. Yin, "Naive-deep face recognition: Touching the limit of LFW benchmark or not," CoRR, 2015 [Online]. Available: http://arxiv.org/abs/1501.04690
19. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," CoRR, 2014 [Online]. Available: http://arxiv.org/abs/1409.1556
20. X. Mei, Z. Hong, D. Prokhorov, and D. Tao, "Robust multitask multiview tracking in videos," IEEE Trans. Neural Netw. Learn. Syst., 2015, to be published.
21. G.-J. Qi, X.-S. Hua, Y. Rui, J. Tang, and H.-J. Zhang, "Two-dimensional multilabel active learning with an efficient online adaptation model for image classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1880-1897, Oct. 2009.
22. C. Xu, D. Tao, and C. Xu, "Large-margin multi-viewinformation bottleneck," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 8, pp. 1559-1572, Aug. 2014.
23. G.-J. Qi, X.-S. Hua, Y. Rui, J. Tang, and H.-J. Zhang, "Two-dimensional active learning for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-8.
24. G.-J. Qi, X.-S. Hua, and H.-J. Zhang, "Learning semantic distance from community-tagged media collection," in Proc. ACM Int. Conf. Multimedia, 2009, pp. 243-252.
25. E. Eaton and S. Jacob et al., "Multi-view constrained clustering with an incomplete mapping between views," Knowl. Inf. Syst., vol. 38, no. 1, pp. 231-257, 2014.
26. G.-J. Qi, C. Aggarwal, Q. Tian, H. Ji, and T. S. Huang, "Exploring context and content links in social media: A latent space method," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 5, pp. 850-862, May 2012.
27. S. F. Hussain and S. Bashir, "Co-clustering of multi-view datasets," Knowl. Inf. Syst., pp. 1-26, 2015.
28. G.-J. Qi, X.-S. Hua, Y. Rui, J. Tang, T. Mei, and H.-J. Zhang, "Correlative multi-label video annotation," in Proc. ACM Int. Conf. Multimedia, 2007, pp. 17-26.
29. Z. Zhang, P. Luo, C. C. Loy, and X. Tang, "Facial landmark detection by deep multi-task learning," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 94-108.
30. G. E. Dahl, T. N. Sainath, and G. E. Hinton, "Improving deep neural networks for LVCSR using rectified linear units and dropout," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., May 2013, pp. 8609-8613.
31. Y. Sun, X. Wang, and X. Tang, "Deeply learned face representations are sparse, selective, and robust," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2015, pp. 2892-2900.
32. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst, 2012, pp. 1097-1105.
33. D. Yi, Z. Lei, and S. Z. Li, "Towards pose robust face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit, Jun. 2013, pp. 3539-3545.
34. P. Paysan, R. Knothe, B. Amberg, S. Romdhani, and T. Vetter, "A 3D face model for pose and illumination invariant face recognition," in Proc. IEEE Int. Conf. Adv. Video Signal Based Surveillance, Sep. 2009, pp. 296-301.
35. D. You, O. C. Hamsici, and A. M. Martinez, "Kernel optimization in discriminant analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 631-638, Mar. 2011.
36. S. J. Prince and J. H. Elder, "Probabilistic linear discriminant analysis for inferences about identity," in Proc. IEEE Int. Conf. Comput. Vis, Oct. 2007, pp. 1-8.
37. D. Chen, X. Cao, L. Wang, F. Wen, and J. Sun, "Bayesian face revisited: A joint formulation," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 566-579.
38. T. Liu and D. Tao, "Classification with noisy labels by importance reweighting," IEEE Trans. Pattern Anal.Mach. Intell., to be published.
39. F. Schroff, D. Kalenichenko, and J. Philbin, "Facenet: A unified embedding for face recognition and clustering," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2015, pp. 815-823.
40. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding," in Proc. ACM Int. Conf. Multimedia, 2014, pp. 675-678.
41. D. Wang, C. Otto, and A. K. Jain, "Face search at scale: 80 million gallery," CoRR, 2015 [Online]. Available: http://arxiv.org/abs/1507. 07242
42. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "Web-scale training for face identification," CoRR, 2014 [Online]. Available: http://arxiv. org/abs/1406.5266