Using facial symmetry to handle pose variations in real-world 3D face recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 33, Issue 10, 2011, Pages 1938-1951

  Passalis, Georgios ^a,b   Perakis, Panagiotis ^a,b   Theoharis, Theoharis ^a,b   Kakadiaris, Ioannis A ^b  

^a UNIVERSITY OF ATHENS   (Greece)

^b University of Houston   (United States)

Author keywords

Biometrics; face and gesture recognition; physically based modeling.

Indexed keywords

3D FACE RECOGNITION; 3D FACE RECOGNITION METHODS; BIOMETRIC APPLICATIONS; BIOMETRIC SIGNATURES; FACE AND GESTURE RECOGNITION; FACE MODELS; FACIAL SYMMETRY; GEOMETRY IMAGES; MISSING DATA; PHYSICALLY-BASED MODELING.; POSE INVARIANT; POSE VARIATION; REAL-WORLD APPLICATION; RECOGNITION RATES; UNIVERSITY OF HOUSTON; UNIVERSITY OF NOTRE DAME;

BIOMETRICS; GESTURE RECOGNITION; THREE DIMENSIONAL;

FACE RECOGNITION;

ANATOMY AND HISTOLOGY; BIOMETRY; BODY POSTURE; FACE; GESTURE; HUMAN; PHYSIOLOGY; PROCEDURES; THREE DIMENSIONAL IMAGING;

BIOMETRIC IDENTIFICATION; FACE; GESTURES; HUMANS; IMAGING, THREE-DIMENSIONAL; POSTURE;

EID: 80052020983     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2011.49     Document Type: Article

References (52)

1. G. Passalis, I. Kakadiaris, and T. Theoharis, "Intraclass Retrieval of Non-Rigid 3D Objects: Application to Face Recognition," IEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2 pp. 218-229, Feb. 2007. (Pubitemid 46620608)
2. I. Kakadiaris, G. Passalis, G. Toderici, M. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis, "Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 640-649, Apr. 2007. (Pubitemid 46464404)
3. P. Perakis, G. Passalis, T. Theoharis, G. Toderici, and I. Kakadiaris, "Partial Matching of Interpose 3D Facial Data for Face Recognition," Proc. Third IEEE Int'l Conf. Biometrics: Theory, Applications, and Systems, pp. 439-446, Sept. 2009.
4. P. Perakis, T. Theoharis, G. Passalis, and I. Kakadiaris, "Automatic 3D Facial Region Retrieval from Multi-Pose Facial Datasets," Proc. Eurographics Workshop 3D Object Retrieval, pp. 37-44, Mar./Apr. 2009.
5. P. Perakis, T. Theoharis, G. Passalis, and I. Kakadiaris, "3D Facial Landmark Detection & Face Registration: A 3D Facial Landmark Model & 3D Local Shape Descriptors Approach," technical report, Computer Graphics Laboratory, Univ. of Athens, http://graphics. di.uoa.gr/Research/TechReports/3D- Lmk-v1.pdf, Jan. 2011.
6. K. Bowyer, K. Chang, and P. Flynn, "A Survey of Approaches and Challenges in 3D and Multi-Modal 3D+2D Face Recognition," Computer Vision and Image Understanding, vol. 101, no. 1, pp. 1-15, Jan. 2006. (Pubitemid 41642085)
7. K. Chang, K. Bowyer, and P.J. Flynn, "An Evaluation of Multi-Modal 2D+3D Face Biometrics," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 619-624, Apr. 2005. (Pubitemid 40556115)
8. X. Lu and A. Jain, "Multimodal Facial Feature Extraction for Automatic 3D Face Recognition," Technical Report MSU-CSE-05-22, Michigan State Univ., Oct. 2005.
9. X. Lu and A. Jain, "Automatic Feature Extraction for Multiview 3D Face Recognition," Proc. Seventh Int'l Conf. Automatic Face and Gesture Recognition, pp. 585-590, Apr. 2006. (Pubitemid 44711412)
10. X. Lu, A. Jain, and D. Colbry, "Matching 2.5D Face Scans to 3D Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 31-43, Jan. 2006.
11. H. Dibeklioglu, "Part-Based 3D Face Recognition under Pose and Expression Variations," master's thesis, Bogazici Univ., 2008.
12. H. Dibeklioglu, A. Salah, and L. Akarun, "3D Facial Landmarking under Expression, Pose and Occlusion Variations," Proc. Second Int'l Conf. Biometrics Theory, Applications and Systems, pp. 1-6, Sept./Oct. 2008.
13. V. Blanz and T. Vetter, "Face Recognition Based on Fitting a 3D Morphable Model," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, Sept. 2003.
14. V. Blanz, K. Scherbaum, and H.-P. Seidel, "Fitting a Morphable Model to 3D Scans of Faces," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, Oct. 2007.
15. A. Bronstein, M. Bronstein, and R. Kimmel, "Robust Expression-Invariant Face Recognition from Partially Missing Data," Proc. European Conf. Computer Vision, pp. 396-408, 2006. (Pubitemid 44029693)
16. P. Nair and A. Cavallaro, "Matching 3D Faces with Partial Data," Proc. British Machine Vision Conf., Sept. 2008.
17. P. Nair and A. Cavallaro, "3-D Face Detection, Landmark Localization, and Registration Using a Point Distribution Model," IEEE Trans. Multimedia, vol. 11, no. 4, pp. 611-623, June 2009.
18. T. Lin, W. Shih, W. Chen, and W. Ho, "3D Face Authentication by Mutual Coupled 3D and 2D Feature Extraction," Proc. 44th ACM Southeast Regional Conf., pp. 423-427, Mar. 2006. (Pubitemid 46733506)
19. A. Mian, M. Bennamoun, and R. Owen, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 1927-1943, Nov. 2007. (Pubitemid 47423788)
20. M. Segundo, C. Queirolo, O. Bellon, and L. Silva, "Automatic 3D Facial Segmentation and Landmark Detection," Proc. 14th Int'l Conf. Image Analysis and Processing, pp. 431-436, Sept. 2007.
21. X. Wei, P. Longo, and L. Yin, "Automatic Facial Pose Determination of 3D Range Data for Face Model and Expression Identification," Advances in Biometrics, pp. 144-153, Springer, 2007.
22. T. Faltemier, K. Bowyer, and P. Flynn, "Rotated Profile Signatures for Robust 3D Feature Detection," Proc. Eighth IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 1-7, Sept. 2008.
23. C. Xu, T. Tan, Y. Wang, and L. Quan, "Combining Local Features for Robust Nose Location in 3D Facial Data," Pattern Recognition Letters, vol. 27, no. 13, pp. 62-73, 2006.
24. Y. Liu and J. Palmer, "A Quantified Study of Facial Asymmetry in 3D Faces," Proc. IEEE Int'l Workshop Analysis and Modeling of Faces and Gestures, pp. 222-229, Oct. 2003.
25. L. Kompanets, "Biometrics of Asymmetrical Face," Proc. First Int'l Conf. Biometric Authentication, pp. 67-73, July 2004.
26. Y. Liu, R.L. Weaver, K. Schmidt, N. Serban, and J. Cohn, "Facial Asymmetry: A New Biometric," Technical Report CMU-RI-TR-01-23, Robotics Inst., Carnegie Mellon Univ. Aug. 2001.
27. S. Mitra, M. Savvides, and B.V. Kumar, "Face Identification Using Novel Frequency-Domain Representation of Facial Asymmetry," IEEE Trans. Information Forensics and Security, vol. 1, no. 3, pp. 350-359, Sept. 2006.
28. S. Gutta, V. Philomin, and M. Trajkovic, "An Investigation into the Use of Partial-Faces for Face Recognition," Proc. Fifth IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 28-33, May 2002.
29. I. Dryden and K. Mardia, Statistical Shape Analysis. Wiley, 1998.
30. M.B. Stegmann and D.D. Gomez, "A Brief Introduction to Statistical Shape Analysis," technical report, Technical Univ. of Denmark, Mar. 2002.
31. T. Cootes and C. Taylor, "Statistical Models of Appearance for Computer Vision," technical report, Univ. of Manchester, Oct. 2001.
32. T. Cootes, C. Taylor, D. Cooper, and J. Graham, "Active Shape Models-Their Training and Application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, Jan. 1995.
33. T. Cootes, C. Taylor, H. Kang, and V. Petrovic, "Modeling Facial Shape and Appearance," Handbook of Face Recognition, pp. 39-63, Springer, 2005.
34. D. Colbry, "Human Face Verification by Robust 3D Surface Alignment," PhD dissertation, Michigan State Univ., 2006.
35. D. Colbry, G. Stockman, and A. Jain, "Detection of Anchor Points for 3D Face Verification," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition Workshops, p. 118, June 2005.
36. A. Johnson, "Spin-Images: A Representation for 3-D Surface Matching," PhD dissertation, Robotics Inst., Carnegie Mellon Univ., Aug. 1997.
37. L. Farkas, Anthropometry of the Head and Face, L.G. Farkas, ed., second ed. Raven Press, 1994.
38. X. Gu, S. Gortler, and H. Hoppe, "Geometry Images," Proc. ACM SIGGRAPH, pp. 355-361, July 2002.
39. E. Praun and H. Hoppe, "Spherical Parametrization and Remesh-ing," Proc. ACM SIGGRAPH, pp. 340-349, July 2003.
40. G. Papaioannou, E. Karabassi, and T. Theoharis, "Reconstruction of Three-Dimensional Objects through Matching of Their Parts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 114-124, Jan. 2002. (Pubitemid 34325620)
41. S. Kirkpatrick, C. Gelatt, and M. Vecchi, "Optimization by Simulated Annealing," Science, vol. 22, no. 4598, pp. 671-680, 1983.
42. P. Siarry, G. Berthiau, F. Durbin, and J. Haussy, "Enhanced Simulated Annealing for Globally Minimizing Functions of Many-Continuous Variables," ACM Trans. Math. Software, vol. 23, no. 2, pp. 209-228, 1997. (Pubitemid 127478027)
43. C. Mandal, "A Dynamic Framework for Subdivision Surfaces," PhD dissertation, Univ. of Florida, 1998.
44. C. Loop, "Smooth Subdivision Surfaces Based on Triangles," master's thesis, Dept. of Math., Univ. of Utah, 1987.
45. A. Klinger, "Pattern and Search Statistics," Proc. Optimizing Methods in Statistics, pp. 303-337, 1971.
46. A. Finkel and J. Bentley, "Quad Trees: A Data Structure for Retrieval of Composite Keys," Acta Informatica, vol. 4, no. 1, pp. 1-9, 1974.
47. E. Stollnitz, T. DeRose, and D. Salesin, Wavelets for Computer Graphics: Theory and Applications. Morgan Kaufmann Publishers, Inc., 1996.
48. P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 947-954, 2005. (Pubitemid 43897294)
49. P. Phillips, W. Scruggs, A. OToole, P. Flynn, K. Bowyer, C. Schott, and M. Sharpe, "FRVT 2006 and ICE 2006 Large-Scale Experimental Results," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 5, pp. 831-846, May 2010.
50. U. of Notre Dame, "University of Notre Dame Biometrics Database," http://www.nd.edu/~cvrl/UNDBiometricsDatabase. html, 2008.
51. "UH Biometrics Databases," http://cbl.uh.edu/URxD/datasets/, 2011.
52. Y. Gao, "Efficiently Comparing Face Images Using a Modified Hausdorff Distance," Proc. IEEE Conf. Vision, Image, and Signal Processing, pp. 346-350, Dec. 2003.