Multi-task deep neural network for joint face recognition and facial attribute prediction

ICMR 2017 - Proceedings of the 2017 ACM International Conference on Multimedia Retrieval

Volumn , Issue , 2017, Pages 365-374

  Wang, Zhanxiong ^a   He, Keke ^a   Fu, Yanwei ^a   Feng, Rui ^a   Jiang, Yu Gang ^a   Xue, Xiangyang ^a  

^a FUDAN UNIVERSITY   (China)

Author keywords

Deep learning; Face identification; Face verification; Multi task learning and facial attribute prediction

Indexed keywords

BENCHMARKING; DEEP LEARNING; DEEP NEURAL NETWORKS; EDUCATION; FORECASTING;

EXPERIMENTAL EVALUATION; FACE IDENTIFICATION; FACE RECOGNITION BENCHMARKS; FACE VERIFICATION; MULTITASK LEARNING; PREDICTION TASKS;

FACE RECOGNITION;

EID: 85021792147     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3078971.3078973     Document Type: Conference Paper

References (56)

1. Abrar H Abdulnabi, Gang Wang, Jiwen Lu, and Kui Jia. 2015. Multi-task cnn model for attribute prediction. IEEE TMM (2015).
2. Timo Ahonen, Abdenour Hadid, and Matti Pietikainen. 2006. Face description with local binary patterns: Application to face recognition. IEEE TPAMI (2006).
3. Lacey Best-Rowden, Hu Han, Charles Otto, Brendan F Klare, and Anil K Jain. 2014. Unconstrained face recognition: Identifying a person of interest from a media collection. IEEE Transactions on Information Forensics and Security (2014).
4. Xudong Cao, Yichen Wei, Fang Wen, and Jian Sun. 2014. Face alignment by explicit shape regression. IJCV 107, 2 (2014), 177-190.
5. Dong Chen, Xudong Cao, Liwei Wang, Fang Wen, and Jian Sun. 2012. Bayesian face revisited: A joint formulation. In ECCV.
6. Dong Chen, Shaoqing Ren, Yichen Wei, Xudong Cao, and Jian Sun. 2014. Joint cascade face detection and alignment. In ECCV.
7. Sumit Chopra, Raia Hadsell, and Yann LeCun. 2005. Learning a similarity metric discriminatively, with application to face verification. In CVPR.
8. Max Ehrlich, Timothy J Shields, Timur Almaev, and Mohamed R Amer. 2016. Facial attributes classification using multi-task representation learning. In CVPR Workshops.
9. Pedro F. Felzenszwalb, Ross B. Girshick, David McAllester, and Deva Ramanan. 2010. Object Detection with Discriminatively Trained Part-Based Models. IEEE TPAMI (2010).
10. Yanwei Fu, Timothy M. Hospedales, Tao Xiang, Yuan Yao, and Shaogang Gong. 2014. Interestingness Prediction by Robust Learning to Rank. In ECCV.
11. M. Guillaumin, J. Verbeek, and C. Schmid. 2009. Is that you? Metric Learning Approaches for Face Identification. In CVPR.
12. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385 (2015).
13. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. In CoRR, vol. abs/1502.01852.
14. G. B. Huang, V. Jain, and E. Learned-Miller. 2007. Unsupervised Joint Alignment of Complex Images. In IEEE International Conference on Computer Vision. 1-8. DOI: http://dx.doi.org/10.1109/ICCV.2007.4408858
15. Gary B Huang, Manu Ramesh, Tamara Berg, and Erik Learned-Miller. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report.
16. Sergey Ioffe and Christian Szegedy. 2015. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Co- variate Shift. In ICML.
17. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. 2014. Caffe: Convolutional architecture for fast feature embedding. arXiv (2014).
18. Ira Kemelmacher-Shlizerman, Steven M Seitz, Daniel Miller, and Evan Brossard. 2016. The MegaFace Benchmark: 1 Million Faces for Recognition at Scale. In CVPR.
19. Neeraj Kumar, Alexander Berg, Peter N Belhumeur, and Shree Nayar. 2011. Describable visual attributes for face verification and image search. IEEE TPMAI (2011).
20. Neeraj Kumar, Alexander C. Berg, Peter N. Belhumeur, and Shree K. Nayar. 2009. Attribute and Simile Classifiers for Face Verification. In ICCV.
21. Neeraj Kumar, Alexander C Berg, Peter N Belhumeur, and Shree K Nayar. 2009. Attribute and simile classifiers for face verification. In ICCV. IEEE, 365-372.
22. Jinguo Liu, Yafeng Deng, and Chang Huang. 2015. Targeting ultimate accuracy: Face recognition via deep embedding. arXiv preprint arXiv:1506.07310 (2015).
23. Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, and Ye-Yi Wang. Representation learning using multi-task deep neural networks for semantic classification and information retrieval.
24. Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang. 2015. Deep learning face attributes in the wild. In ICCV.
25. David G. Lowe. 2004. Distinctive Image Features from Scale- Invariant Keypoints. International Journal of Computer Vision 60 (2004).
26. Hong-Wei Ng and Stefan Winkler. 2014. A data-driven approach to cleaning large face datasets. In ICIP.
27. Hieu V. Nguyen and Li Bai. 2010. Cosine Similarity Metric Learning for Face Verification. In ACCV.
28. Timo Ojala, Matti Pietikäinen, and Topi Mäenpää. 2002. Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns. IEEE TPAMI (2002).
29. Rajeev Ranjan, Vishal M Patel, and Rama Chellappa. 2016. Hy-perface: A deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition. arXiv preprint arXiv:1603.01249 (2016).
30. Shaoqing Ren, Xudong Cao, Yichen Wei, and Jian Sun. 2014. Face alignment at 3000 fps via regressing local binary features. In CVPR. IEEE.
31. Ethan M. Rudd, Manuel Gunther, and Terrance E. Boult. 2016. MOON:A Mixed Objective Optimization Network for the Recognition of Facial Attributes. In ECCV.
32. Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015. Facenet: A unified embedding for face recognition and clustering. In CVPR.
33. William Robson Schwartz, Huimin Guo, and Larry S Davis. 2010. A robust and scalable approach to face identification. In ECCV.
34. Yi Sun, Ding Liang, Xiaogang Wang, and Xiaoou Tang. 2015. Deepid3: Face recognition with very deep neural networks. arXiv preprint arXiv:1502.00873 (2015).
35. Yi Sun, Xiaogang Wang, and Xiaoou Tang. 2015. Deeply learned face representations are sparse, selective, and robust. In CVPR.
36. Yaniv Taigman, Ming Yang, Marc'Aurelio Ranzato, and Lior Wolf. 2014. Deepface: Closing the gap to human-level performance in face verification. In CVPR. 1701-1708.
37. Yaniv Taigman, Ming Yang, MarcAurelio Ranzato, and Lior Wolf. 2015. Web-scale training for face identification. In CVPR.
38. Bart Thomee, David A Shamma, Gerald Friedland, Benjamin Elizalde, Karl Ni, Douglas Poland, Damian Borth, and Li-Jia Li. 2015. The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817 (2015).
39. Georgios Tzimiropoulos and Maja Pantic. 2014. Gauss-newton deformable part models for face alignment in-the-wild. In CVPR. IEEE, 1851-1858.
40. Paul Viola and Michael Jones. 2001. Rapid Object Detection using a Boosted Cascade of Simple Features. In CVPR.
41. P. Viola, J. Platt, and C. Zhang. 2005. Multiple instance boosting for ob ject detection. In NIPS.
42. Jing Wang, Yu Cheng, and Rogerio Schmidt Feris. 2016. Walk and Learn: Facial Attribute Representation Learning from Egocentric Video and Contextual Data. arXiv preprint arXiv:160.0633 (2016).
43. Yandong Wen, Kaipeng Zhang, Zhifeng Li, and Yu Qiao. 2016. A discriminative feature learning approach for deep face recognition. In ECCV.
44. Xiang Wu, Ran He, and Zhenan Sun. 2015. A Lightened CNN for Deep Face Representation. arXiv preprint arXiv:1511.02683 (2015) .
45. Xiang Wu, Ran He, Zhenan Sun, and Tieniu Tan. 2016. A Light CNN for Deep Face Representation with Noisy Labels. arxiv (2016) .
46. Xuehan Xiong and Fernando De la Torre. 2013. Supervised descent method and its applications to face alignment. In CVPR.
47. Heng Yang, Wenxuan Mou, Yichi Zhang, Ioannis Patras, Hatice Gunes, and Peter Robinson. 2015. Face Alignment Assisted by Head Pose Estimation. arXiv preprint arXiv:1507.03148 (2015).
48. Hao Ye, Weiyuan Shao, Hong Wang, Jianqi Ma, Li Wang, Yingbin Zheng, and Xiangyang Xue. 2016. Face Recognition via Active Annotation and Learning. In Proceedings of the 2016 ACM on Multimedia Conference. 1058-1062.
49. Dong Yi, Zhen Lei, Shengcai Liao, and Stan Z Li. 2014. Learning face representation from scratch. arXiv preprint arXiv:1411.7923 (2014).
50. Jie Zhang, Shiguang Shan, Meina Kan, and Xilin Chen. 2014. Coarse-to-fine auto-encoder networks (cfan) for real-time face alignment. In ECCV. Springer.
51. K. Zhang, Z. Zhang, Z. Li, and Y. Qiao. 2016. Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks. IEEE SP Letters (2016).
52. Zhanpeng Zhang, Ping Luo, Chen Change Loy, and Xiaoou Tang. 2014. Facial landmark detection by deep multi-task learning. In ECCV.
53. Yang Zhong, Josephine Sullivan, and Haibo Li. 2016. Face Attribute Prediction Using Off-the-Shelf CNN Features. In arxiv.
54. Qiang Zhou, Gang Wang, Kui Jia, and Qi Zhao. 2013. Learning to share latent tasks for action recognition. In ICCV.
55. Shizhan Zhu, Cheng Li, Chen Change Loy, and Xiaoou Tang. 2015. Face Alignment by Coarse-to-Fine Shape Searching. In CVPR.
56. Xiangxin Zhu and Deva Ramanan. 2012. Face detection, pose estimation, and landmark localization in the wild. In CVPR.