Spartans: Single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios

IEEE Transactions on Image Processing

Volumn 24, Issue 12, 2015, Pages 4780-4795

  Juefei Xu, Felix ^a   Luu, Khoa ^a   Savvides, Marios ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

advanced correlation filters; alignment robustness; Periocular based recognition; pose tolerance; singlesample 3D face synthesis; unconstrained face recognition

Indexed keywords

ALIGNMENT; BINARY IMAGES; IMAGE MATCHING;

3-D FACE SYNTHESIS; CORRELATION FILTERS; DISCRIMINATIVE MATCHING; FACE RECOGNITION GRAND CHALLENGES; FACE RECOGNITION TECHNIQUE; GENERIC ELASTIC MODELS; PERIOCULAR; STATE-OF-THE-ART ALGORITHMS;

FACE RECOGNITION;

ALGORITHM; ANATOMY AND HISTOLOGY; FACE; HUMAN; IMAGE PROCESSING; PROCEDURES; RECEIVER OPERATING CHARACTERISTIC;

ALGORITHMS; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; ROC CURVE;

EID: 84942426071     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2468173     Document Type: Article

References (82)

1. Boston Marathon Bombings-Wikipedia. [Online]. Available: http://en. wikipedia.org/wiki/Boston-Marathon-bombings, accessed Mar. 31, 2015.
2. J. Atick, P. Griffin, and A. Redlich, "Statistical approach to shape from shading: Reconstruction of 3D face surfaces from single 2D images," Neural Comput., vol. 8, pp. 1321-1340, 1997.
3. V. Blanz, S. Romdhani, and T. Vetter, "Face identification across different poses and illuminations with a 3D morphable model," in Proc. FG, 2002, pp. 202-207.
4. S.-F. Wang and S.-H. Lai, "Efficient 3D face reconstruction from a single 2D image by combining statistical and geometrical information," in Proc. 7th ACCV, 2006, pp. 427-436.
5. J. Heo, "Generic elastic models for 2D pose synthesis and face recognition," Ph.D. dissertation, Dept. Elect. Comput. Eng., Carnegie Mellon Univ., Pittsburgh, PA, USA, 2009.
6. U. Prabhu, J. Heo, and M. Savvides, "Unconstrained pose-invariant face recognition using 3D generic elastic models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 1952-1961, Oct. 2011.
7. F. Juefei-Xu, M. Cha, J. L. Heyman, S. Venugopalan, R. Abiantun, and M. Savvides, "Robust local binary pattern feature sets for periocular biometric identification," in Proc. 4th IEEE Int. Conf. Biometrics, Theory, Appl., Syst. (BTAS), Sep. 2010, pp. 1-8.
8. F. Juefei-Xu, K. Luu, M. Savvides, T. D. Bui, and C. Y. Suen, "Investigating age invariant face recognition based on periocular biometrics," in Proc. Int. Joint Conf. Biometrics (IJCB), Oct. 2011, pp. 1-7.
9. F. Juefei-Xu, D. K. Pal, and M. Savvides, "Hallucinating the full face from the periocular region via dimensionally weighted K-SVD," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 1-8.
10. M. Savvides and F. Juefei-Xu, "Image matching using subspace-based discrete transform encoded local binary patterns," U.S. Patent 2014 0 212 044 A1, Jul. 31, 2013.
11. F. Juefei-Xu and M. Savvides, "Subspace-based discrete transform encoded local binary patterns representations for robust periocular matching on NIST's face recognition grand challenge," IEEE Trans. Image Process., vol. 23, no. 8, pp. 3490-3505, Aug. 2014.
12. F. Juefei-Xu, M. Cha, M. Savvides, S. Bedros, and J. Trojanova, "Robust periocular biometric recognition using multi-level fusion of various local feature extraction techniques," in Proc. IEEE 17th Int. Conf. Digit. Signal Process. (DSP), Jul. 2011, pp. 1-6.
13. F. Juefei-Xu and M. Savvides, "Unconstrained periocular biometric acquisition and recognition using COTS PTZ camera for uncooperative and non-cooperative subjects," in Proc. IEEE Workshop Appl. Comput. Vis. (WACV), Jan. 2012, pp. 201-208.
14. F. Juefei-Xu and M. Savvides, "Can your eyebrows tell me who you are?" in Proc. 5th Int. Conf. Signal Process. Commun. Syst. (ICSPCS), Dec. 2011, pp. 1-8.
15. F. Juefei-Xu and M. Savvides, "Multi-class Fukunaga Koontz discriminant analysis for enhanced face recognition," Pattern Recognit., to be published.
16. F. Juefei-Xu and M. Savvides, "An augmented linear discriminant analysis approach for identifying identical twins with the aid of facial asymmetry features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPR), Jun. 2013, pp. 56-63.
17. F. Juefei-Xu and M. Savvides, "Pokerface: Partial order keeping and energy repressing method for extreme face illumination normalization," in Proc. IEEE 7th Int. Conf. Biometrics, Theory, Appl., Syst. (BTAS), Sep. 2015, pp. 1-8.
18. F. Juefei-Xu and M. Savvides, "Encoding and decoding local binary patterns for harsh face illumination normalization," in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2015, pp. 1-5.
19. F. Juefei-Xu, D. K. Pal, K. Singh, and M. Savvides, "A preliminary investigation on the sensitivity of COTS face recognition systems to forensic analyst-style face processing for occlusions," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) Workshops, Jun. 2015, pp. 25-33.
20. K. Seshadri, F. Juefei-Xu, D. K. Pal, and M. Savvides, "Driver cell phone usage detection on strategic highway research program (SHRP2) face view videos," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) Workshops, Jun. 2015, pp. 1-9.
21. U. Park, A. Ross, and A. K. Jain, "Periocular biometrics in the visible spectrum: A feasibility study," in Proc. IEEE 3rd Int. Conf. BTAS, Sep. 2009, pp. 1-6.
22. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," Univ. Massachusetts, Amherst, MA, USA, Tech. Rep. 07-49, Oct. 2007.
23. P. J. Phillips et al., "Overview of the face recognition grand challenge," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Jun. 2005, pp. 947-954.
24. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-PIE," in Proc. 8th IEEE Int. Conf. FG, Sep. 2008, pp. 1-8.
25. M. A. Turk and A. P. Pentland, "Face recognition using eigen-faces," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 1991, pp. 586-591.
26. K. Etemad and R. Chellappa, "Discriminant analysis for recognition of human face images," J. Opt. Soc. Amer. A, vol. 14, no. 8, pp. 1724-1733, 1997.
27. X. He and P. Niyogi, "Locality preserving projections," in Proc. Adv. NIPS, 2003, pp. 153-160.
28. J. Yang, D. Zhang, J.-Y. Yang, and B. Niu, "Globally maximizing, locally minimizing: Unsupervised discriminant projection with applications to face and palm biometrics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 4, pp. 650-664, Apr. 2007.
29. J. Merkow, B. Jou, and M. Savvides, "An exploration of gender identification using only the periocular region," in Proc. 4th IEEE Int. Conf. BTAS, Sep. 2010, pp. 1-5.
30. J. R. Lyle, P. E. Miller, S. J. Pundlik, and D. L. Woodard, "Soft biometric classification using periocular region features," in Proc. 4th IEEE Int. Conf. BTAS, Sep. 2010, pp. 1-7.
31. P. E. Miller, J. R. Lyle, S. J. Pundlik, and D. L. Woodard, "Performance evaluation of local appearance based periocular recognition," in Proc. 4th IEEE Int. Conf. BTAS, Sep. 2010, pp. 1-6.
32. D. L. Woodard, S. J. Pundlik, J. R. Lyle, and P. E. Miller, "Periocular region appearance cues for biometric identification," in Proc. IEEE Comput. Soc. Conf. CVPRW, Jun. 2010, pp. 162-169.
33. U. Park, R. Jillela, A. Ross, and A. K. Jain, "Periocular biometrics in the visible spectrum," IEEE Trans. Inf. Forensics Security, vol. 6, no. 1, pp. 96-106, Mar. 2011.
34. N. Pinto, J. J. DiCarlo, and D. D. Cox, "How far can you get with a modern face recognition test set using only simple features?" in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 2591-2598.
35. M. Guillaumin, J. Verbeek, and C. Schmid, "Is that you? Metric learning approaches for face identification," in Proc. IEEE 12th ICCV, Sep./Oct. 2009, pp. 498-505.
36. Q. Yin, X. Tang, and J. Sun, "An associate-predict model for face recognition," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 497-504.
37. H. J. Seo and P. Milanfar, "Face verification using the LARK representation," IEEE Trans. Inf. Forensics Security, vol. 6, no. 4, pp. 1275-1286, Dec. 2011.
38. Z. Cui, W. Li, D. Xu, S. Shan, and X. Chen, "Fusing robust face region descriptors via multiple metric learning for face recognition in the wild," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 3554-3561.
39. K. Simonyan, O. Parkhi, A. Vedaldi, and A. Zisserman, "Fisher vector faces in the wild," in Proc. Brit. Mach. Vis. Conf. (BMVC), 2013, pp. 8.1-8.12.
40. D. Chen, X. Cao, F. Wen, and J. Sun, "Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 3025-3032.
41. H. Li, G. Hua, Z. Lin, J. Brandt, and J. Yang, "Probabilistic elastic matching for pose variant face verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 3499-3506.
42. D. Yi, Z. Lei, and S. Z. Li, "Towards pose robust face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 3539-3545.
43. K. Seshadri and M. Savvides, "Robust modified active shape model for automatic facial landmark annotation of frontal faces," in Proc. IEEE 3rd BTAS, Sep. 2009, pp. 1-8.
44. I. Matthews and S. Baker, "Active appearance models revisited," Int. J. Comput. Vis., vol. 60, no. 2, pp. 135-164, 2004.
45. F. Juefei-Xu and M. Savvides, "Weight-optimal local binary patterns," in Computer Vision (Lecture Notes in Computer Science), vol. 8926. New York, NY, USA: Springer-Verlag, 2015, pp. 148-159.
46. M. Petrou and P. G. Sevilla, Dealing With Texture. New York, NY, USA: Wiley, 2006.
47. X. He, M. Ji, C. Zhang, and H. Bao, "A variance minimization criterion to feature selection using Laplacian regularization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 2013-2025, Oct. 2011.
48. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
49. B. V. K. V. Kumar, M. Savvides, and C. Xie, "Correlation pattern recognition for face recognition," Proc. IEEE, vol. 94, no. 11, pp. 1963-1976, Nov. 2006.
50. A. Mahalanobis, B. V. K. V. Kumar, and D. Casasent, "Minimum average correlation energy filters," Appl. Opt., vol. 26, no. 17, pp. 3633-3640, Sep. 1987.
51. F. Juefei-Xu and M. Savvides, "Single face image super-resolution via solo dictionary learning," in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2015, pp. 1-5.
52. N. Zehngut, F. Juefei-Xu, R. Bardia, D. K. Pal, C. Bhagavatula, and M. Savvides, "Investigating the feasibility of image-based nose biometrics," in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2015, pp. 1-5.
53. F. Juefei-Xu and M. Savvides, "An image statistics approach towards efficient and robust refinement for landmarks on facial boundary," in Proc. IEEE 6th Int. Conf. Biometrics, Theory, Appl., Syst. (BTAS), Sep./Oct. 2013, pp. 1-8.
54. G. B. Huang and E. Learned-Miller, "Labeled faces in the wild: Updates and new reporting procedures," Dept. Comput. Sci., Univ. Massachusetts Amherst, Amherst, MA, USA, Tech. Rep. UM-CS-2014-003, 2014.
55. H. Li, G. Hua, X. Shen, Z. Lin, and J. Brandt, "Eigen-PEP for video face recognition," in Proc. 12th Asian Conf. Comput. Vis. (ACCV), 2014, pp. 17-33.
56. F. Juefei-Xu and M. Savvides, "Pareto-optimal discriminant analysis," in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2015, pp. 1-5.
57. F. Juefei-Xu, D. K. Pal, and M. Savvides, "NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) Workshops, Jun. 2015, pp. 1-10.
58. F. Juefei-Xu and M. Savvides, "Facial ethnic appearance synthesis," in Computer Vision (Lecture Notes in Computer Science), vol. 8926. New York, NY, USA: Springer-Verlag, 2015, pp. 825-840.
59. G. Huang. (May 2015). Results on the Labeled Faces in the Wild. [Online]. Available: http://vis-www.cs.umass.edu/lfw/results.html
60. E. Nowak and F. Jurie, "Learning visual similarity measures for comparing never seen objects," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2007, pp. 1-8.
61. G. B. Huang, V. Jain, and E. Learned-Miller, "Unsupervised joint alignment of complex images," in Proc. IEEE 11th Int. Conf. Comput. Vis. (ICCV), Oct. 2007, pp. 1-8.
62. L. Wolf, T. Hassner, and Y. Taigman, "Descriptor based methods in the wild," in Proc. Faces Real-Life Images Workshop Eur. Conf. Comput. Vis. (ECCV), 2008, pp. 1-14.
63. L. Wolf, T. Hassner, and Y. Taigman, "Similarity scores based on background samples," in Proc. 9th Asian Conf. Comput. Vis. (ACCV), 2009, pp. 88-97.
64. H. V. Nguyen and L. Bai, "Cosine similarity metric learning for face verification," in Proc. 10th Asian Conf. Comput. Vis. (ACCV), 2010, pp. 709-720.
65. D. Cox and N. Pinto, "Beyond simple features: A large-scale feature search approach to unconstrained face recognition," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. (FG), Mar. 2011, pp. 8-15.
66. Y. Ying and P. Li, "Distance metric learning with eigenvalue optimization," J. Mach. Learn. Res., vol. 13, pp. 1-26, Jan. 2012.
67. G. B. Huang, H. Lee, and E. Learned-Miller, "Learning hierarchical representations for face verification with convolutional deep belief networks," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 2518-2525.
68. Q. Cao, Y. Ying, and P. Li, "Similarity metric learning for face recognition," in Proc. IEEE ICCV, Dec. 2013, pp. 2408-2415.
69. O. Barkan, J. Weill, L. Wolf, and H. Aronowitz, "Fast high dimensional vector multiplication face recognition," in Proc. IEEE ICCV, Dec. 2013, pp. 1960-1967.
70. J. Hu, J. Lu, and Y.-P. Tan, "Discriminative deep metric learning for face verification in the wild," in Proc. IEEE Conf. CVPR, Jun. 2014, pp. 1875-1882.
71. J. Hu, J. Lu, J. Yuan, and Y.-P. Tan, "Large margin multi-metric learning for face and kinship verification in the wild," in Proc. 12th Asian Conf. Comput. Vis. (ACCV), 2014, pp. 252-267.
72. T. Hassner, S. Harel, E. Paz, and R. Enbar, "Effective face frontal-ization in unconstrained images," in Proc. IEEE CVPR, Jun. 2015, pp. 4295-4304.
73. J. Ruiz-del-Solar, R. Verschae, and M. Correa, "Recognition of faces in unconstrained environments: A comparative study," EURASIP J. Adv. Signal Process., vol. 2009, p. 184617, Jan. 2009.
74. G. Sharma, S. ul Hussain, and F. Jurie, "Local higher-order statistics (LHS) for texture categorization and facial analysis," in Proc. 12th Eur. Conf. Comput. Vis. (ECCV), 2012, pp. 1-12.
75. S. R. Arashloo and J. Kittler, "Efficient processing of MRFs for unconstrained-pose face recognition," in Proc. IEEE 6th Int. Conf. BTAS, Sep./Oct. 2013, pp. 1-8.
76. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
77. J. Yang, D. Zhang, Z. Jin, and J.-Y. Yang, "Unsupervised discriminant projection analysis for feature extraction," in Proc. 18th ICPR, vol. 1. 2006, pp. 904-907.
78. B. Schölkopf, A. Smola, and K.-R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, 1998.
79. S. Mika, G. Rätsch, J. Weston, B. Schölkopf, and K.-R. Müller, "Fisher discriminant analysis with kernels," in Proc. IEEE Signal Process. Soc. Workshop Neural Netw. Signal Process. IX, Aug. 1999, pp. 41-48.
80. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, "Face recognition using Laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005.
81. F. Juefei-Xu, C. Bhagavatula, A. Jaech, U. Prasad, and M. Savvides, "Gait-ID on the move: Pace independent human identification using cell phone accelerometer dynamics," in Proc. 5th Int. Conf. Biometrics, Theory, Appl., Syst. (BTAS), Sep. 2012, pp. 8-15.
82. S. Venugopalan, F. Juefei-Xu, B. Cowley, and M. Savvides, "Elec-tromyograph and keystroke dynamics for spoof-resistant biomet-ric authentication," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) Workshops, Jun. 2015, pp. 1-10.