MeshSIFT: Local surface features for 3D face recognition under expression variations and partial data

Computer Vision and Image Understanding

Volumn 117, Issue 2, 2013, Pages 158-169

  Smeets, Dirk ^a   Keustermans, Johannes ^a   Vandermeulen, Dirk ^a   Suetens, Paul ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

3D face recognition; Expressions; Local features; MeshSIFT; Missing data; Partial data; Pose normalisation; Symmetry plane

Indexed keywords

STATISTICS; VECTOR SPACES;

3D FACE RECOGNITION; EXPRESSIONS; LOCAL FEATURE; MESHSIFT; MISSING DATA; NORMALISATION; PARTIAL DATA; SYMMETRY PLANES;

FACE RECOGNITION;

EID: 84884904296     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2012.10.002     Document Type: Article

References (74)

1. W. W. Bledsoe, The model method in facial recognition, Technical Report PRI 15, Panoramic Research, Inc., Palo Alto, California, 1964.
2. P. J. Phillips, P. J. Flynn, T. Scruggs, K. W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, W. Worek, Overview of the face recognition grand challenge, CVPR'05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), vol. 1, IEEE Computer Society, Washington, DC, USA, 2005, pp. 947-954. (Pubitemid 43897294)
3. R. C. Veltkamp, F. Ter Haar, SHREC 2007 - shape retrieval contest of 3D face models, 2007. .
4. M. Daoudi, F. Ter Haar, R. C. Veltkamp, SHREC 2008 - shape retrieval contest of 3D face scans, 2008. .
5. R. C. Veltkamp, S. Van Jole, B. Ben Amor, M. Daoudi, H. Li, L. Chen, P. Claes, D. Smeets, J. Hermans, D. Vandermeulen, P. Suetens, SHREC'11:3D face models retrieval, in: 3D OR'11, 2011, pp. 89-95.
6. K. W. Bowyer, K. I. Chang, P. J. Flynn, A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition, Computer Vision and Image Understanding 101 (1) (2006) 1-15. (Pubitemid 41642085)
7. A. Scheenstra, A. Ruifrok, R. C. Veltkamp, A survey of 3D face recognition methods, in: T. Kanade, A. K. Jain, N. K. Ratha (Eds.), AVBPA'05: Proceedings of the 5th International Conference on Audio-and Video-Based Biometric Person Authentication, Lecture Notes in Computer Science, vol. 3546, Springer-Verlag, Berlin, Heidelberg, 2005, pp. 891-899 (Hilton Rye Town, NY, USA). (Pubitemid 41423108)
8. A. S. Mian, M. Bennamoun, R. A. Owens, Region-based matching for robust 3D face recognition, in: BMVC'05: Proceedings of the British Machine Vision Conference, vol. 1, Oxford, United Kingdom, September 2005, pp. 199-208.
9. K. I. Chang, K. W. Bowyer, P. J. Flynn, Multiple nose region matching for 3D face recognition under varying facial expression, IEEE Transactions on Pattern Analysis and Machine Intelligence 28 (10) (2006) 1695-1700. (Pubitemid 46405086)
10. J. C. Lee, E. Milios, Matching range images of human faces, in: ICCV'90: Proceedings of the Third IEEE International Conference on Computer Vision, Osaka, Japan, December 1990, pp. 722-726.
11. W.-Y. Lin, M.-Y. Chen, K. R. Widder, Y. H. Hu, N. Boston, Fusion of multiple facial regions for expression-invariant face recognition, in: MMSP'07: Proceedings of the IEEE 9th Workshop on Multimedia Signal Processing, IEEE Computer Society, Chania, Crete, Greece, 2007.
12. S. Berretti, A. D. Bimbo, P. Pala, SHREC'08 entry: 3D face recognition using integral shape information, in: SMI'08: Proceedings of the IEEE International Conference on Shape Modeling and Applications, Stony Brook, NY, USA, 2008, pp. 255-256.
13. C. Xu, S. Li, T. Tan, L. Quan, Automatic 3D face recognition from depth and intensity gabor features, Pattern Recognition 42 (2009) 1895-1905.
14. J. A. Cook, C. McCool, V. Chandran, S. Sridharan, Combined 2D/3D face recognition using log-gabor templates, in: AVSS'06: Proceedings of the IEEE International Conference on Video and Signal Based Surveillance, IEEE Computer Society, Washington, DC, USA, 2006, p. 83.
15. J. A. Cook, V. Chandran, C. B. Fookes, 3D face recognition using log-gabor templates, in: M. Chantler, M. Trucco, B. Fisher (Eds.), BMVC'06:Proceedings of the 17th British Machine Vision Conference, vol. 2, British Machine Vision Association, Edinburgh, Scotland, 2006, pp. 769-778.
16. A. S. Mian, M. Bennamoun, R. A. Owens, Face recognition using 2D and 3D multimodal local features, ISVC'06: Proceedings of International Symposium on Visual Computing, of Lecture Notes in Computer Science, vol. 4291, Springer-Verlag, Berlin Heidelberg, 2006, pp. 860-870. (Pubitemid 44891614)
17. A. Mian, M. Bennamoun, R. A. Owens, An efficient multimodal 2D-3D hybrid approach to automatic face recognition, IEEE Transaction on Pattern Analysis and Machine Intelligence 29 (11) (2007) 1927-1943. (Pubitemid 47423788)
18. I. A. Kakadiaris, G. Passalis, G. Toderici, M. N. Murtuza, Y. Lu, N. Karampatziakis, T. Theoharis, Three-dimensional face recognition in the presence of facial expressions: An annotated deformable model approach, IEEE Transactions on Pattern Analysis and Machine Intelligence 29 (4) (2007) 640-649. (Pubitemid 46464404)
19. D. Huang, K. Ouji, M. Ardabilian, Y. Wang, L. Chen, 3D face recognition based on local shape patterns and sparse representation classifier, in: MMM'11:17th International Multimedia Modeling Conference on Advances in Multimedia Modeling, Lecture Notes in Computer Science, vol. 6523, Springer, Taipei, Taiwan, 2011, pp. 206-216.
20. H. Li, D. Huang, J.-M. Morvan, L. Chen, Learning weighted sparse representation of encoded facial normal information for expression-robust 3D face recognition, in: IJCB'11: International Joint Conference on Biometrics, IEEE Computer Society, Washington, DC, USA, 2011, pp. 1-7.
21. Y. Wang, G. Pan, Z. Wu, Y. Wang, Exploring facial expression effects in 3D face recognition using partial ICP, in: P. Narayanan (Ed.), ACCV'06: Asian Conference on Computer Vision of Lecture Notes in Computer Science, vol. 3851, Springer-Verlag, Berlin Heidelberg, 2006, pp. 581-590. (Pubitemid 43856514)
22. T. Faltemier, K. W. Bowyer, P. J. Flynn, A region ensemble for 3-D face recognition, IEEE Transactions on Information Forensics and Security 3 (2008) 62-73. (Pubitemid 351270073)
23. L. Spreeuwers, Fast and accurate 3d face recognition, International Journal of Computer Vision 93 (2011) 389-414.
24. C. Hesher, A. Srivastava, G. Erlebacher, A novel technique for face recognition using range imaging, ISSPA'03: Proceedings of the 7th IEEE International Symposium on Signal Processing and Its Applications, vol. 2, IEEE Computer Society, Paris, France, 2003, pp. 201-204.
25. T. Heseltine, N. Pears, J. Austin, Three-dimensional face recognition using surface space combinations, in: A. Hoppe, S. Barman, T. Ellis, (Eds.), BMVC'04: Proceedings of the British Machine Vision Conference, London, UK, September 2004.
26. T. Russ, C. Boehnen, T. Peters, 3D face recognition using 3D alignment for PCA, in: CVPR'06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, Washington, DC, USA, pp. 1391-1398.
27. B. Amberg, R. Knothe, T. Vetter, Expression invariant 3D face recognition with a morphable model, in: FG'08: Proceedings of the 8th IEEE International Conference on Automatic Face and Gesture Recognition, IEEE Computer Society, Amsterdam, The Netherlands, 2008.
28. F. Al-Osaimi, M. Bennamoun, A. Mian, An expression deformation approach to non-rigid 3D face recognition, International Journal of Computer Vision 81 (3) (2009) 302-316.
29. I. Mpiperis, S. Malassiotis, M. G. Strintzis, Expression-compensated 3D face recognition with geodesically aligned bilinear models, in: BTAS'08: Proceedings of the IEEE Second International Conference on Biometrics Theory, Applications and Systems, Arlington, Virginia, USA, September 2008.
30. V. D. Kaushik, A. Budhwar, A. Dubey, R. Agrawal, S. Gupta, V. K. Pathak, P. Gupta, An efficient 3D face recognition algorithm, in: NTMS'09: Proceedings of the 3rd International Conference on New Technologies, Mobility and Security, IEEE Press, Cairo, Egypt, 2009, pp. 259-263.
31. S. Berretti, A. D. Bimbo, P. Pala, Description and retrieval of 3D face models using iso-geodesic stripes, in: MIR'06: Proceedings of the 8th ACM SIGMM International Workshop on Multimedia Information Retrieval, ACM, New York, NY, USA, 2006, pp. 13-22. (Pubitemid 47168197)
32. S. Feng, H. Krim, I. A. Kogan, 3D face recognition using euclidean integral invariants signature, in: SSP'07: IEEE/SP 14th Workshop on Statistical Signal Processing, Madison, WI, USA, August 2007, pp. 156-160.
33. S. Jahanbin, H. Choi, Y. Liu, A. C. Bovik, Three dimensional face recognition using iso-geodesic and iso-depth curves, in: BTAS'08: Proceedings of the IEEE Second International Conference on Biometrics Theory, Applications and Systems, Arlington, Virginia, USA, September 2008.
34. F. B. Ter Haar, R. C. Veltkamp, A 3D face matching framework for facial curves, Graphical Models 71 (2) (2009) 77-91.
35. S. Berretti, A. Del Bimbo, P. Pala, 3D face recognition using isogeodesic stripes, IEEE Transactions on Pattern Analysis and Machine Intelligence 32 (2010) 2162-2177.
36. A. M. Bronstein, M. M. Bronstein, R. Kimmel, Three-dimensional face recognition, International Journal of Computer Vision 64 (1) (2005) 5-30. (Pubitemid 40920856)
37. D. Smeets, T. Fabry, J. Hermans, D. Vandermeulen, P. Suetens, Isometric deformation modeling using singular value decomposition for 3D expressioninvariant face recognition, in: BTAS'09: Proceedings of the IEEE Third International Conference on Biometrics: Theory, Applications and Systems, 2009.
38. H. Tang, Y. Sun, B. Yin, Y. Ge, 3D face recognition based on sparse representation, The Journal of Supercomputing (2010) 1-12.
39. D. Smeets, J. Hermans, D. Vandermeulen, P. Suetens, Isometric deformation invariant 3D shape recognition, Pattern Recognition 45 (2012) 2817-2831.
40. S. Gupta, M. K. Markey, J. K. Aggarwal, A. C. Bovik, Three dimensional face recognition based on geodesic and euclidean distances, in: L. J. Latecki, D. M. Mount, A. Y. Wu (Eds.), Vision Geometry XV, vol. 6499, SPIE, San Jose, CA, USA, 2007, p. 64990D.
41. X. Li, T. Jia, H. Zhang, Expression-insensitive 3D face recognition using sparse representation, in: CVPR'09: Proceedings of the International Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, Los Alamitos, CA, USA, 2009, pp. 2575-2582.
42. D. Smeets, P. Claes, J. Hermans, D. Vandermeulen, P. Suetens, A comparative study of 3-D face recognition under expression variations, IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews 42 (5) (2012) 710-727.
43. V. Blanz, T. Vetter, A morphable model for the synthesis of 3d faces, in: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH'99, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 1999, pp. 187-194.
44. P. Perakis, G. Passalis, T. Theoharis, G. Toderici, I. A. Kakadiaris, Partial matching of interpose 3d facial data for face recognition, in: Proceedings of the 3rd IEEE International Conference on Biometrics: Theory, Applications and Systems, BTAS'09, IEEE Press, Piscataway, NJ, USA, 2009, pp. 439-446.
45. G. Passalis, P. Perakis, T. Theoharis, I. A. Kakadiaris, Using facial symmetry to handle pose variations in Real-World 3D face recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence 33 (2011).
46. S. Berretti, A. Del Bimbo, P. Pala, 3d partial face matching using local shape descriptors, in: J-HGBU'11: Proceedings of the 2011 Joint ACM Workshop on Human Gesture and Behavior Understanding, ACM, Scottsdale, Arizona, USA, 2011, pp. 65-71.
47. C. Maes, T. Fabry, J. Keustermans, D. Smeets, P. Suetens, D. Vandermeulen, Feature detection on 3D face surfaces for pose normalisation and recognition, in: BTAS'10: Proceedings of the International Conference on Biometrics: Theory, Applications and Systems, Washington, DC, USA, 2010, pp. 1-6.
48. D. Smeets, J. Keustermans, J. Hermans, P. Claes, D. Vandermeulen, P. Suetens, Symmetric surface-feature based 3D face recognition for partial data, in: IJCB'11: Proceedings of the First International Joint Conference on Biometrics, IEEE, Washington, DC, USA, 2011, pp. 1-6.
49. D. G. Lowe, Object recognition from local scale-invariant features, ICCV'99: Proceedings of the International Conference on Computer Vision, vol. 2, IEEE Computer Society, Washington, DC, USA, 1999, pp. 1150-1157.
50. D. G. Lowe, Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision 60 (2) (2004) 91-110.
51. M. Brown, D. G. Lowe, Automatic panoramic image stitching using invariant features, International Journal of Computer Vision 74 (1) (2007) 59-73. (Pubitemid 46673104)
52. S. Se, D. G. Lowe, J. J. Little, Vision-based mobile robot localization and mapping using scale-invariant features, in: ICRA'01: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, IEEE, 2001, pp. 2051-2058. (Pubitemid 32815156)
53. W. Cheung, G. Hamarneh, n-SIFT: n-dimensional scale invariant feature transform, Transactions on Image Processing 18 (2009) 2012-2021.
54. K. Osada, T. Furuya, R. Ohbuchi, Shrec'08 entry: Local volumetric features for 3d model retrieval, in: SMI'08:International Conference on Shape Modeling and Applications, IEEE Computer Society, 2008, pp. 245-246.
55. I. Laptev, B. Caputo, C. Schüldt, T. Lindeberg, Local velocity-adapted motion events for spatio-temporal recognition, Computer Vision and Image Understanding 108 (2007) 207-229. (Pubitemid 350016963)
56. T.-W. R. Lo, J. P. Siebert, Local feature extraction and matching on range images: 2.5d sift, Computer Vision and Image Understanding 113 (2009) 1235-1250.
57. G. Zou, J. Hua, M. Dong, H. Qin, Surface matching with salient keypoints in geodesic scale space, Computer Animation and Virtual Worlds 19 (2008) 399-410.
58. A. Zaharescu, E. Boyer, K. Varanasi, R. Horaud, Surface feature detection and description with applications to mesh matching, in: CVPR'09: International Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, 2009, pp. 373-380.
59. A. Savran, N. Alyuz, H. Dibeklioglu, O. Celiktutan, B. Gökberk, B. Sankur, L. Akarun, Bosphorus database for 3D face analysis, in: Proceedings of the First COST 2101 Workshop on Biometrics and Identity Management (BIOD), Denmark, May 2008.
60. G. Peyre, Toolbox graph. MATLAB Central File Exchange Select, 2009.
61. G. Peyre, Toolbox fast marching. MATLAB Central File Exchange Select, 2009.
62. P. Claes, M. Walters, D. Vandermeulen, J. G. Clement, Spatially-dense 3D facial asymmetry assessment in both typical and disordered growth, Journal of Anatomy 219 (4) (2011) 444-455.
63. P. Shilane, P. Min, M. Kazhdan, T. Funkhouser, The princeton shape benchmark, in: SMI'04: Proceedings of Shape Modeling International, June 2004.
64. N. Alyüz, B. Gökberk, L. Akarun, A 3D face recognition system for expression and occlusion invariance, in: BTAS'08: Proceedings of the IEEE Second International Conference on Biometrics Theory, Applications and Systems, Arlington, Virginia, USA, September 2008.
65. H. Dibeklioǧlu, B. Gökberk, L. Akarun, Nasal region-based 3D face recognition under pose and expression variations, in: ICB'09: Proceedings of the Third International Conference on Advances in Biometrics, Springer-Verlag, Berlin, Heidelberg, 2009, pp. 309-318.
66. N. Alyüz, B. Gökberk, H. Dibeklioǧlu, A. Savran, A. A. Salah, L. Akarun, B. Sankur, 3D face recognition benchmarks on the bosphorus database with focus on facial expressions, in: Proceedings of the First COST 2101 Workshop on Biometrics and Identity Management (BIOD), Denmark, May 2008.
67. F. Hajati, A. A. Raie, Y. Gao, 2.5d face recognition using patch geodesic moments, Pattern Recognition 45 (2012) 969-982.
68. ™ 3D face recognition engine on the FRGC data, in: CVPR'05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops, IEEE Computer Society, Washington, DC, USA, 2005, p. 154.
69. T. Faltemier, K. W. Bowyer, P. J. Flynn, 3D face recognition with region committee voting, in: 3DPVT'06: Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission, IEEE Computer Society, Washington, DC, USA, 2006, pp. 318-325.
70. C. C. Queirolo, L. Silva, O. R. Bellon, M. P. Segundo, 3D face recognition using simulated annealing and the surface interpenetration measure, IEEE Transactions on Pattern Analysis and Machine Intelligence 32 (2) (2010) 206-219.
71. P. Yan, K. W. Bowyer, Empirical evaluation of advanced ear biometrics, in: CVPRW'05: Proceedings of Workshop on Empirical Evaluation Methods in Computer Vision, IEEE Computer Society, 2005, p. 41.
72. P. Yan, K. W. Bowyer, An automatic 3D ear recognition system, in: 3DPVT'06: Proceedings of International Symposium on 3D Data Processing Visualization and Transmission, IEEE Computer Society, 2006, pp. 326-333.
73. M. A. Fischler, R. C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, Communication of the ACM 24 (1981) 381-395.
74. L. Yin, X. Wei, Y. Sun, J. Wang, M. J. Rosato, A 3D facial expression database for facial behavior research, in: FG'06: Proceedings of the 7th IEEE International Conference on Automatic Face and Gesture Recognition, Southampton, UK, April 2006, pp. 211-216. (Pubitemid 44711352)