A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition

Computer Vision and Image Understanding

Volumn 101, Issue 1, 2006, Pages 1-15

  Bowyer, Kevin W ^a   Chang, Kyong ^a   Flynn, Patrick ^a  

^a University of Notre Dame   (United States)

Author keywords

Biometrics; Face recognition; Multi modal; Range image; Three dimensional face recognition

Indexed keywords

ALGORITHMS; IMAGE ANALYSIS; PATTERN MATCHING; THREE DIMENSIONAL;

BIOMETRICS; MULTI-MODAL; RANGE IMAGE; THREE DIMENSIONAL FACE RECOGNITION;

FACE RECOGNITION;

EID: 27844534088     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2005.05.005     Document Type: Article

References (60)

1. 3DMD Systems. 3q qlonerator. 〈http://www.3q.com/offerings_prod.htm/ 〉.
2. B. Achermann, H. Bunke, Classifying range images of human faces with Hausdorff distance, in: 15-th International Conference on Pattern Recognition, September 2000, pp. 809-813.
3. B. Achermann, X. Jiang, and H. Bunke Face recognition using range images International Conference on Virtual Systems and MultiMedia 1997 129 136
4. C. Beumier, and M. Acheroy Face verification from 3D and grey level cues Pattern Recognition Letters 22 2001 1321 1329
5. V. Blanz, and T. Vetter Face recognition based on fitting a 3D morphable model IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2003 1063 1074
6. C. Boehnen, P.J. Flynn, Accuracy of 3D scanning technologies in a face scanning context, in: Fifth International Conference on 3D Imaging and Modeling (3DIM 2005), June 2005, pp. 310-317.
7. K.W. Bowyer Face recognition technology and the security versus privacy tradeoff IEEE Technology and Society 2004 9 20
8. K.W. Bowyer, K. Chang, P.J. Flynn, A survey of 3D and multi-modal 3D + 2D face recognition, in: 17-th International Conference on Pattern Recognition, August 2004, pp. 358-361.
9. K.W. Bowyer, K. Chang, P.J. Flynn, A survey of 3D and multi-modal 3D + 2D face recognition, Face Processing: Advanced Modeling and Methods, to appear.
10. A.M. Bronstein, M.M. Bronstein, R. Kimmel, Expression-invariant 3D face recognition, in: International Conference on Audio- and Video-Based Person Authentication (AVBPA 2003), LNCS, vol. 2688, 2003, pp. 62-70.
11. A.M. Bronstein, M.M. Bronstein, and R. Kimmel Three-dimensional face recognition International Journal of Computer Vision 2005 5 30
12. J.Y. Cartoux, J.T. LaPreste, M. Richetin, Face authentication or recognition by profile extraction from range images, in: Proceedings of the Workshop on Interpretation of 3D Scenes, 1989, pp. 194-199.
13. K. Chang, K. Bowyer, and P. Flynn An evaluation of multi-modal 2D + 3D face biometrics IEEE Transactions on Pattern Analysis and Machine Intelligence 27 4 2005 619 624
14. K. Chang, K. Bowyer, P. Flynn, Face recognition using 2D and 3D facial data, in: Multimodal User Authentication Workshop, December 2003, pp. 25-32.
15. K. Chang, K.W. Bowyer, S. Sarkar, and B. Victor Comparison and combination of ear and face images for appearance-based biometrics IEEE Transactions on Pattern Analysis and Machine Intelligence 25 9 2003 1160 1165
16. K.I. Chang, K.W. Bowyer, P.J. Flynn, Adaptive rigid multi-region selection for handling expression variation in 3D face recognition, in: IEEE Workshop on Face Recognition Grand Challenge Experiments, June 2005.
17. C. Chua, F. Han, and Y.K. Ho 3D human face recognition using point signature IEEE International Conference on Automatic Face and Gesture Recognition 2000 233 238
18. L. Farkas Anthropometry of the Head and Face 1994 Raven Press New York
19. A. Godil, S. Ressler, P. Grother, Face recognition using 3D facial shape and color map information: comparison and combination, in: Biometric Technology for Human Identification, SPIE, vol. 5404, April 2005, pp. 351-361.
20. B. Gokberk, A.A. Salah, L. Akarun, Rank-based decision fusion for 3D shape-based face recognition, in: International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA 2005), LNCS, vol. 3546, July 2005, pp. 1019-1028.
21. G. Gordon Face recognition based on depth and curvature features Computer Vision and Pattern Recognition (CVPR) June 1992 108 110
22. C. Hesher, A. Srivastava, G. Erlebacher, A novel technique for face recognition using range imaging, in: Seventh International Symposium on Signal Processing and Its Applications, 2003, pp. 201-204.
23. M. Husken, M. Brauckmann, S. Gehlen, C. von der Malsburg, Strategies and benefits of fusion of 2D and 3D face recognition, in: IEEE Workshop on Face Recognition Grand Challenge Experiments, June 2005.
24. M.L. Koudelka, M.W. Koch, T.D. Russ, A prescreener for 3D face recognition using radial symmetry and the Hausdorff fraction, in: IEEE Workshop on Face Recognition Grand Challenge Experiments, June 2005.
25. S. Lao, Y. Sumi, M. Kawade, F. Tomita, 3D template matching for pose invariant face recognition using 3D facial model built with iso-luminance line based stereo vision, in: International Conference on Pattern Recognition (ICPR 2000), 2000, pp. II:911-916.
26. J.C. Lee, E. Milios, Matching range images of human faces, in: International Conference on Computer Vision, 1990, pp. 722-726.
27. Y. Lee, K. Park, J. Shim, T. Yi, 3D face recognition using statistical multiple features for the local depth information, in: 16th International Conference on Vision Interface, June 2003. Available at 〈www. visioninterface.org/vi2003/〈.
28. Y. Lee, J. Shim, Curvature-based human face recognition using depth-weighted Hausdorff distance, in: International Conference on Image Processing (ICIP), 2004, pp. 1429-1432.
29. Y. Lee, H. Song, U. Yang, H. Shin, K. Sohn. Local feature based 3D face recognition, in: International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA 2005), LNCS, vol. 3546, July 2005, pp. 909-918.
30. X. Lu, D. Colbry, A.K. Jain, Matching 2.5D scans for face recognition, in: International Conference on Pattern Recognition (ICPR 2004), 2004, pp. 362-366.
31. X. Lu, A.K. Jain, Deformation analysis for 3D face matching, in: 7th IEEE Workshop on Applications of Computer Vision (WACV '05), 2005, pp. 99-104.
32. X. Lu, A.K. Jain, Integrating range and texture information for 3D face recognition, in: 7th IEEE Workshop on Applications of Computer Vision (WACV '05), 2005, pp. 155-163.
33. T. Maurer, D. Guigonis, I. Maslov, B. Pesenti, A. Tsaregorodtsev, D. West, G. Medioni, Performance of geometrix activeidtm 3D face recognition engine on the frgc data, in: IEEE Workshop on Face Recognition Grand Challenge Experiments, June 2005.
34. G. Medioni, R. Waupotitsch, Face recognition and modeling in 3D, in: IEEE International Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2003), October 2003, pp. 232-233.
35. K. Messer, J. Matas, J. Kittler, J. Luettin, G. Maitre, XM2VTSDB: the extended M2VTS database, in: Second International Conference on Audio- and Video-based Biometric Person Authentication, 1999, pp. 72-77.
36. J. Min, K.W. Bowyer, and P. Flynn Using multiple gallery and probe images per person to improve performance of face recognition Notre Dame Computer Science and Engineering Technical Report 2003
37. Minolta Inc. Konica Minolta 3D digitizer. 〈http://www.minoltausa. com/vivid/〉.
38. A.B. Moreno, Ángel Sánchez, J.F. Vélez, F.J. Díaz, Face recognition using 3D surface-extracted descriptors, in: Irish Machine Vision and Image Processing Conference (IMVIP 2003), September 2003.
39. T. Nagamine, T. Uemura, I. Masuda, 3D facial image analysis for human identification, in: International Conference on Pattern Recognition (ICPR 1992), 1992, pp. 324-327.
40. Neven Vision, Inc. Nevenvision machine vision technology. 〈http://www.nevenvision.com/〉.
41. G. Pan, S. Han, Z. Wu, Y. Wang, 3D face recognition using mapped depth images, in: IEEE Workshop on Face Recognition Grand Challenge Experiments, June 2005.
42. G. Pan, Z. Wu, Y. Pan, Automatic 3D face verification from range data, in: International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2003, pp. III:193-196.
43. T. Papatheodorou, D. Reuckert, Evaluation of automatic 4D face recognition using surface and texture registration, in: Sixth International Conference on Automated Face and Gesture Recognition, May 2004, pp. 321-326.
44. G. Passalis, I. Kakadiaris, T. Theoharis, G. Toderici, N. Murtuza, Evaluation of 3D face recognition in the presence of facial expressions: an annotated deformable model approach, in: IEEE Workshop on Face Recognition Grand Challenge Experiments, June 2005.
45. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek Overview of the face recognition grand challenge Computer Vision and Pattern Recognition (CVPR) 2005 pp. I:947-954
46. P.J. Phillips, P. Grother, R.J. Michaels, D.M. Blackburn, E. Tabassi, J. Bone, FRVT 2002: overview and summary. Available at 〈www.frvt.org/〉.
47. P.J. Phillips, H. Moon, P.J. Rauss, and S. Rizvi The FERET evaluation methodology for face recognition algorithms IEEE Transactions on Pattern Analysis and Machine Intelligence 22 10 2000
48. M. Rioux, L. Cournoyer, Nrcc three-dimensional image data files, National Research Council of Canada, NRC 29077, June 1988.
49. T.D. Russ, K.W. Koch, C.Q. Little, 3D facial recognition: a quantitative analysis, in: 45-th Annual Meeting of the Institute of Nuclear Materials Management (INMM), July 2004.
50. T.D. Russ, M.W. Koch, C.Q. Little, A 2D range Hausdorff approach for 3D face recognition, in: IEEE Workshop on Face Recognition Grand Challenge Experiments, June 2005.
51. A. Scheenstra, A. Ruifrok, R.C. Veltkamp, A survey of 3D face recognition methods, in: International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA 2005), LNCS, vol. 3546, July 2005, pp. 891-899.
52. H.T. Tanaka, M. Ikeda, H. Chiaki, Curvature-based face surface recognition using spherical correlation principal directions for curved object recognition, in: Third International Conference on Automated Face and Gesture Recognition, 1998, pp. 372-377.
53. F. Tsalakanidou, S. Malassiotis, and M. Strintzis Face authentication and authentication using color and depth images IEEE Transactions on Image Processing 14 2 2005 152 168
54. F. Tsalakanidou, S. Malassiotis, M. Strintzis, Integration of 2D and 3D images for enhanced face authentication, in: Sixth International Conference on Automated Face and Gesture Recognition, May 2004, pp. 266-271.
55. F. Tsalakanidou, D. Tzocaras, and M. Strintzis Use of depth and colour eigenfaces for face recognition Pattern Recognition Letters 24 2003 1427 1435
56. Y. Wang, C. Chua, and Y. Ho Facial feature detection and face recognition from 2D and 3D images Pattern Recognition Letters 23 2002 1191 1202
57. C. Xu, Y. Wang, T. Tan, L. Quan, Automatic 3D face recognition combining global geometric features with local shape variation information, in: Sixth International Conference on Automated Face and Gesture Recognition, May 2004, pp. 308-313.
58. P. Yan, K.W. Bowyer, Empirical evaluation of advanced ear biometrics, in: IEEE Workshop on Empirical Evaluation Methods in Computer Vision (EEMCV 2005), June 2005.
59. P. Yan, K.W. Bowyer, A fast algorithm for ICP-based 3D shape biometrics, in: Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID 2005), October 2005 (to appear).
60. W. Zhao, R. Chellappa, and A. Rosenfeld Face recognition: a literature survey ACM Computing Surveys 35 December 2003 399 458