Multi-Task Pose-Invariant Face Recognition

IEEE Transactions on Image Processing

Volumn 24, Issue 3, 2015, Pages 980-993

  Ding, Changxing ^a   Xu, Chang ^a,b   Tao, Dacheng ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b Peking University   (China)

Author keywords

multi task learning; partial face recognition; Pose invariant face recognition

Indexed keywords

ALGORITHMS; IMAGE MATCHING; LEARNING SYSTEMS;

FACE IDENTIFICATION; FACE REPRESENTATIONS; MULTITASK LEARNING; PERFORMANCE OF ALGORITHM; POSE-INVARIANT FACE RECOGNITION; STATE-OF-THE-ART METHODS; SYSTEMATIC EXPERIMENTATION; UNCONSTRAINED ENVIRONMENTS;

FACE RECOGNITION;

ALGORITHM; ANATOMY AND HISTOLOGY; ARTIFICIAL INTELLIGENCE; BIOMETRY; BODY POSTURE; FACE; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; PHYSIOLOGY; PROCEDURES;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRIC IDENTIFICATION; DATABASES, FACTUAL; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; POSTURE;

EID: 84928379855     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2390959     Document Type: Article

References (66)

1. X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1635-1650, Jun. 2010.
2. C. Ding, J. Choi, D. Tao, and L. S. Davis. (2014). "Multi-directional multi-level dual-cross patterns for robust face recognition." [Online]. Available: http://arxiv.org/abs/1401.5311
3. M. Gunther et al., "The 2013 face recognition evaluation in mobile environment," in Proc. IEEE/IAPR Int. Conf. Biometrics, Jun. 2013, pp. 1-7.
4. R. Abiantun, U. Prabhu, and M. Savvides, "Sparse feature extraction for pose-tolerant face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 10, pp. 2061-2073, Oct. 2014.
5. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
6. S. J. D. Prince, J. Warrell, J. H. Elder, and F. M. Felisberti, "Tied factor analysis for face recognition across large pose differences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 970-984, Jun. 2008.
7. S. R. Arashloo and J. Kittler, "Energy normalization for pose-invariant face recognition based on MRF model image matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 6, pp. 1274-1280, Jun. 2011.
8. H. T. Ho and R. Chellappa, "Pose-invariant face recognition using Markov random fields," IEEE Trans. Image Process., vol. 22, no. 4, pp. 1573-1584, Apr. 2013.
9. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," Dept. Comput. Sci., Univ. Massachusetts Amherst, Amherst, MA, USA, Tech. Rep. 07-49, Oct. 2007.
10. V. Blanz, P. Grother, P. J. Phillips, and T. Vetter, "Face recognition based on frontal views generated from non-frontal images," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun. 2005, pp. 454-461.
11. X. Chai, S. Shan, X. Chen, and W. Gao, "Locally linear regression for pose-invariant face recognition," IEEE Trans. Image Process., vol. 16, no. 7, pp. 1716-1725, Jul. 2007.
12. Z. Zhu, P. Luo, X. Wang, and X. Tang, "Deep learning identitypreserving face space," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 113-120.
13. S. Liao, A. K. Jain, and S. Z. Li, "Partial face recognition: Alignmentfree approach," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 5, pp. 1193-1205, May 2013.
14. R. Weng, J. Lu, J. Hu, G. Yang, and Y.-P. Tan, "Robust feature set matching for partial face recognition," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 601-608.
15. X. Zhang and Y. Gao, "Face recognition across pose: A review," Pattern Recognit., vol. 42, no. 11, pp. 2876-2896, 2009.
16. A. B. Ashraf, S. Lucey, and T. Chen, "Learning patch correspondences for improved viewpoint invariant face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
17. A. Li, S. Shan, and W. Gao, "Coupled bias-variance tradeoff for crosspose face recognition," IEEE Trans. Image Process., vol. 21, no. 1, pp. 305-315, Jan. 2012.
18. S. Li, X. Liu, X. Chai, H. Zhang, S. Lao, and S. Shan, "Morphable displacement field based image matching for face recognition across pose," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 102-115.
19. N. Wang, D. Tao, X. Gao, X. Li, and J. Li, "A comprehensive survey to face hallucination," Int. J. Comput. Vis., vol. 106, no. 1, pp. 9-30, 2014.
20. N. Wang, D. Tao, X. Gao, X. Li, and J. Li, "Transductive face sketchphoto synthesis," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 9, pp. 1364-1376, Sep. 2013.
21. U. Prabhu, J. Heo, and M. Savvides, "Unconstrained pose-invariant face recognition using 3D generic elastic models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 1952-1961, Oct. 2011.
22. A. Asthana, T. K. Marks, M. J. Jones, K. H. Tieu, and M. Rohith, "Fully automatic pose-invariant face recognition via 3D pose normalization," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 937-944.
23. Y. Zhang, M. Shao, E. K.Wong, and Y. Fu, "Random faces guided sparse many-to-one encoder for pose-invariant face recognition," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 2416-2423.
24. J. Wright and G. Hua, "Implicit elastic matching with random projections for pose-variant face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1502-1509.
25. D. Yi, Z. Lei, and S. Z. Li, "Towards pose robust face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 3539-3545.
26. A. Li, S. Shan, X. Chen, and W. Gao, "Maximizing intra-individual correlations for face recognition across pose differences," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 605-611.
27. A. Sharma and D. W. Jacobs, "Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 593-600.
28. A. Sharma, A. Kumar, H. Daume, and D. W. Jacobs, "Generalized multiview analysis: A discriminative latent space," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2160-2167.
29. M. Kan, S. Shan, H. Zhang, S. Lao, and X. Chen, "Multi-view discriminant analysis," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 808-821.
30. L. Zhang, X. Zhen, and L. Shao, "Learning object-to-class kernels for scene classification," IEEE Trans. Image Process., vol. 23, no. 8, pp. 3241-3253, Aug. 2014.
31. R. Yan, L. Shao, and Y. Liu, "Nonlocal hierarchical dictionary learning using wavelets for image denoising," IEEE Trans. Image Process., vol. 22, no. 12, pp. 4689-4698, Dec. 2013.
32. M. Kan, S. Shan, H. Chang, and X. Chen, "Stacked progressive autoencoders (SPAE) for face recognition across poses," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1883-1890.
33. Z. Hong, X. Mei, D. Prokhorov, and D. Tao, "Tracking via robust multitask multi-view joint sparse representation," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 649-656.
34. B. Mahasseni and S. Todorovic, "Latent multitask learning for viewinvariant action recognition," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 3128-3135.
35. L. Liu, L. Shao, and P. Rockett, "Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition," Pattern Recognit., vol. 46, no. 7, pp. 1810-1818, 2013.
36. F. Zhu and L. Shao, "Weakly-supervised cross-domain dictionary learning for visual recognition," Int. J. Comput. Vis., vol. 109, nos. 1-2, pp. 42-59, 2014.
37. D. Masip, Á. Lapedriza, and J. Vitrià, "Multitask learning: An application to incremental face recognition," in Proc. Int. Conf. Comput. Vis. Appl., 2008, pp. 585-590.
38. D. Masip, Á. Lapedriza, and J. Vitrià, "Multitask learning applied to face recognition," in Proc. 1st Spanish Workshop Biometrics, 2007, pp. 1-8.
39. Z. Zhu, P. Luo, X. Wang, and X. Tang, "Multi-view perceptron: A deep model for learning face identity and view representations," in Advances in Neural Information Processing Systems 27. Red Hook, NY, USA: Curran Associates, 2014, pp. 217-225.
40. Z.-L. Sun, K.-M. Lam, and Q.-W. Gao, "Depth estimation of face images using the nonlinear least-squares model," IEEE Trans. Image Process., vol. 22, no. 1, pp. 17-30, Jan. 2013.
41. A. M. Bruckstein, R. J. Holt, T. S. Huang, and A. N. Netravali, "Optimum fiducials under weak perspective projection," Int. J. Comput. Vis., vol. 35, no. 3, pp. 223-244, 1999.
42. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 6, pp. 679-698, Nov. 1986.
43. A. Myronenko and X. Song, "Point set registration: Coherent point drift," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 12, pp. 2262-2275, Dec. 2010.
44. L. Ma, X. Yang, and D. Tao, "Person re-identification over camera networks using multi-task distance metric learning," IEEE Trans. Image Process., vol. 23, no. 8, pp. 3656-3670, Aug. 2014.
45. M. Schmidt. The minFunc Package. [Online]. Available: http://www.cs. ubc.ca/schmidtm/Software/minFunc.html, accessed Jul. 2014.
46. H. Xu and S. Mannor, "Robustness and generalization," Mach. Learn., vol. 86, no. 3, pp. 391-423, 2012.
47. A. W. van der Vaart and J. A. Wellner, Weak Convergence. New York, NY, USA: Springer-Verlag, 1996.
48. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression database," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
49. P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss, "The FERET evaluation methodology for face-recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
50. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-PIE," Image Vis. Comput., vol. 28, no. 5, pp. 807-813, 2010.
51. L. Liu, L. Shao, and X. Li, "Evolutionary compact embedding for largescale image classification," Inf. Sci., pp. 1-15, Jul. 2014.
52. P. Paysan, R. Knothe, B. Amberg, S. Romdhani, and T. Vetter, "A 3D face model for pose and illumination invariant face recognition," in Proc. 6th IEEE Int. Conf. AVSS, Sep. 2009, pp. 296-301.
53. Y. Sun, X. Wang, and X. Tang, "Deep convolutional network cascade for facial point detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 3476-3483.
54. S. R. Arashloo, J. Kittler, and W. J. Christmas, "Pose-invariant face recognition by matching on multi-resolution MRFs linked by supercoupling transform," Comput. Vis. Image Understand., vol. 115, no. 7, pp. 1073-1083, 2011.
55. S. R. Arashloo and J. Kittler, "Fast pose invariant face recognition using super coupled multiresolution Markov random fields on a GPU," Pattern Recognit. Lett., vol. 48, pp. 49-59, Oct. 2014.
56. S. R. Arashloo and J. Kittler, "Efficient processing of MRFs for unconstrained-pose face recognition," in Proc. IEEE 6th Int. Conf. Biometrics, Theory, Appl., Syst., Sep./Oct. 2013, pp. 1-8.
57. S. Li, X. Liu, X. Chai, H. Zhang, S. Lao, and S. Shan, "Maximal likelihood correspondence estimation for face recognition across pose," IEEE Trans. Image Process., vol. 23, no. 10, pp. 4587-4600, Oct. 2014.
58. T. Zhang, D. Tao, X. Li, and J. Yang, "Patch alignment for dimensionality reduction," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1299-1313, Sep. 2009.
59. D. Chen, X. Cao, F. Wen, and J. Sun, "Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 3025-3032.
60. H. Li, G. Hua, Z. Lin, J. Brandt, and J. Yang, "Probabilistic elastic matching for pose variant face verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 3499-3506.
61. K. Simonyan, O. M. Parkhi, A. Vedaldi, and A. Zisserman, "Fisher vector faces in the wild," in Proc. Brit. Mach. Vis. Conf., 2013, vol. 1, no. 2, pp. 1-12.
62. Y. Taigman, L. Wolf, and T. Hassner, "Multiple one-shots for utilizing class label information," in Proc. Brit. Mach. Vis. Conf., 2009, pp. 1-12.
63. Q. Cao, Y. Ying, and P. Li, "Similarity metric learning for face recognition," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 2408-2415.
64. O. Barkan, J. Weill, L. Wolf, and H. Aronowitz, "Fast high dimensional vector multiplication face recognition," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1960-1967.
65. P. Li, Y. Fu, U. Mohammed, J. H. Elder, and S. J. D. Prince, "Probabilistic models for inference about identity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 144-157, Jan. 2012.
66. S. J. D. Prince and J. H. Elder, "Probabilistic linear discriminant analysis for inferences about identity," in Proc. IEEE 11th Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.