Spatially optimized data-level fusion of texture and shape for face recognition

IEEE Transactions on Image Processing

Volumn 21, Issue 2, 2012, Pages 859-872

  Al Osaimi, Faisal R ^a   Bennamoun, Mohammed ^b   Mian, Ajmal ^b  

^a UMM AL QURA UNIVERSITY   (Saudi Arabia)

^b UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

3 D face recognition; Data level fusion; low level fusion; multimodal biometrics

Indexed keywords

3-D SHAPE; 3D FACE RECOGNITION; DATA SETS; EXPERIMENTAL SETUP; FUSION MODEL; HIGHER ORDER; HUMAN FACE RECOGNITION; ILLUMINATION VARIATION; LEARNING CAPABILITIES; LINEAR SUBSPACE; LOW-LEVEL FUSION; MULTI-MODAL BIOMETRICS; SCORE-LEVEL FUSION; SPATIAL OPTIMIZATION;

BIOMETRICS; OPTIMIZATION; TEXTURES; THREE DIMENSIONAL;

FACE RECOGNITION;

ALGORITHM; ARTICLE; BIOMETRY; DISCRIMINANT ANALYSIS; FACE; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; METHODOLOGY; PRINCIPAL COMPONENT ANALYSIS;

ALGORITHMS; BIOMETRIC IDENTIFICATION; DATABASES, FACTUAL; DISCRIMINANT ANALYSIS; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PRINCIPAL COMPONENT ANALYSIS;

EID: 84856272348     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2165218     Document Type: Article

References (62)

1. F. Al-Osaimi, M. Bennamoun, and A. Mian, "An expression deformation approach to non-rigid 3-D face recognition," Int. J. Comput. Vis., vol. 81, no. 3, pp. 302-316, Mar. 2009.
2. M. Bartlett, J. R. Movellan, and T. Sejnowski, "Face recognition by independent component analysis," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1450-1464, Nov. 2002. (Pubitemid 35428531)
3. P. Besl and N. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Mach. Intell, vol. 14, no. 2, pp. 239-256, Feb. 1992.
4. V. Blanz and T. Vetter, "A morphable model for the synthesis of 3-D faces," in Proc. SIGGRAPH, 1999, pp. 187-194.
5. V. Blanz and T. Vetter, "Face recognition based on fitting a 3-D morphable model," IEEE Trans. Pattern Anal. Mach. Intell, vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
6. V. Blanz, K. Scherbaum, and H. Seidel, "Fitting a morphable model to 3-D scans of faces," in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
7. K. Bowyer, K. Chang, and P. Flynn, "A survey of approaches and challenges in 3-D and multi-modal 3-D + 2-D face recognition," Comput. Vis. Image Underst., vol. 101, no. 1, pp. 1-15, Jan. 2006. (Pubitemid 41642085)
8. A. Bronstein, M. Bronstein, and R. Kimmel, "Three-dimensional face recognition," Int. J. Comput. Vis., vol. 64, no. 1, pp. 5-30, Aug. 2005. (Pubitemid 40920856)
9. A. Bronstein, M. Bronstein, and R. Kimmel, "Expression-invariant representations of faces," IEEE Trans. Image Process., vol. 16, no. 1, pp. 188-197, Jan. 2007. (Pubitemid 46437481)
10. K. I. Chang, K. Bowyer, and P. J. Flynn, "Multimodal 2-D and 3-D biometrics for face recognition," in Proc. IEEE Int. Workshop Anal. Model. Faces Gestures, 2003, pp. 187-194.
11. K. Chang, K. W. Bowyer, S. Sarkar, and B. Victor, "Comparison and combination of ear and face images in appearance-based biometrics," IEEE Trans. Pattern Anal. Mach. Intell, vol. 25, no. 9, pp. 1160-1165, Sep. 2003.
12. K. Chang, K. Bowyer, and P. Flynn, "An evaluation of multimodal 2-D + 3-D face biometrics," IEEE Trans. Pattern Anal. Mach. Intell, vol. 27, no. 4, pp. 619-624, Apr. 2005. (Pubitemid 40556115)
13. K. Chang, K. Bowyer, and P. Flynn, "Multiple nose region matching for 3-D face recognition under varying facial expression," IEEE Trans. Pattern Anal. Mach. Intell, vol. 28, no. 10, pp. 1695-1700, Oct. 2006. (Pubitemid 46405086)
14. Y. Chen and G. Medioni, "Object modeling by registration of multiple range images," in Proc. IEEE Int. Conf. Robot Autom., 1991, vol. 3, pp. 2724-2729. (Pubitemid 21716914)
15. L. Chen, H. Mark Liao, M. Ko, J. Lin, and G. Yu, "A new LDA-based face recognition system which can solve the small sample size problem," Pattern Recognit., vol. 33, no. 10, pp. 1713-1726, Oct. 2000.
16. J. Cook, C. McCool, V. Chandran, and S. Sridharan, "Combined2D/3D face recognition using log-Gabor templates," in Proc. IEEE Int. Conf. Video Signal Based Surveillance, 2006, pp. 83-88.
17. T. Cootes, G. Edwards, and C. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell, vol. 23, no. 6, pp. 681-685, Jun. 2001. (Pubitemid 32585279)
18. R. Duda, P. Hart, and D. Stork, Pattern Classification. Hoboken, NJ: Wiley, 2001, p. 34.
19. T. Faltemier, K. Bowyer, and P. Flynn, "A region ensemble for 3-D face recognition," IEEE Trans. Inf. Forensics Security, vol. 3, no. 1, pp. 62-73, Mar. 2008. (Pubitemid 351270073)
20. A. Georghiades, P. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell, vol. 6, no. 23, pp. 643-660, Jun. 2001. (Pubitemid 32585276)
21. B. Gokberk, A. Salah, and L. Akarun, "Rank-based decision fusion for 3-D shape-based face recognition," in Proc. Audio-Video-Based Biometric Person Authentication, 2005, vol. 3546, pp. 1019-1028. (Pubitemid 41423121)
22. B. Gokberk, M. Irfanoglua, and L. Arakun, "3D shape-based face representation and feature extraction for face recognition," Image Vis. Comput., vol. 24, no. 8, pp. 857-869, Aug. 2006. (Pubitemid 44188983)
23. G. Guo, S. Li, and K. Chan, "Face recognition by support vector machines," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., 2000, pp. 196-201.
24. S. Gupta, M. Markey, and A. Bovik, "Anthropometric 3-D face recognition," Int. J. Comput. Vis., vol. 90, no. 3, pp. 331-349, Dec. 2010.
25. M. Hanif and U. Ali, "Optimized visual and thermal image fusion for efficient face recognition," in Proc. Int. Conf. Inf. Fusion, 2006, pp. 1-6.
26. X. He, S. Yan, Y. Hu, P. Niyogi, and H. Zhang, "Face recognition using Laplacian faces," IEEE Trans. Pattern Anal. Mach. Intell, vol. 27, no. 3, pp. 328-340, Mar. 2005. (Pubitemid 40377326)
27. M. Husken, M. Brauckmann, S. Gehlen, and C. Von der Malsburg, "Strategies and benefits of fusion of 2-D and 3-D face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, 2005, vol. 3, p. 174.
28. A. Jain, A. Ross, and S. Prabhakar, "An introduction to biometric recognition," IEEE Trans. Circuits Syst. Video Technol, vol. 14, no. 1, pp. 4-20, Jan. 2004.
29. K. Jonsson, J. Matas, J. Kittler, and Y. Li, "Learning support vectors for face verification and recognition," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., 2000, pp. 208-213.
30. I. Kakadiaris, G. Passalis, G. Toderici, M. Murtuza, Y. Lu, N. Karam-patziakis, and T. Theoharis, "Three-dimensional face recognition in the presence of facial expressions: An annotated deformable model approach," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 4, pp. 640-649, Apr. 2007. (Pubitemid 46464404)
31. J. Kittler, M. Hatef, R. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell, vol. 20, no. 3, pp. 226-239, Mar. 1998. (Pubitemid 128741312)
32. G. Kusuma and C. Chua, "Image level fusion method for multimodal 2-D +3D face recognition," in Proc. Int. Conf. Image Anal. Recognit., 2008, pp. 984-992.
33. S. Li, C. Zhao, M. Ao, and Z. Lei, "Learning to fuse 3-D +2D based face recognition at both feature and decision levels," in Proc. AMFG-Lecture Notes Computer Science, 2005, vol. 3723, pp. 44-54.
34. B. Li, C. Zheng, and D. Huang, "Locally linear discriminant embedding: An efficient method for face recognition," Pattern Recognit., vol. 41, no. 12, pp. 2813-2821, Dec. 2008.
35. Z. Li, D. Lin, and X. Tang, "Nonparametric discriminant analysis for face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 4, pp. 755-761, Apr. 2009.
36. W. Lin, K. Wong, N. Boston, and Y. Hu, "3D face recognition under expression variations using similarity metrics fusion," in Proc. IEEE Int. Conf. Multimedia Expo, 2007, pp. 727-730.
37. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
38. X. Lu, A. Jain, and D. Colbry, "Matching 2.5D scans to 3-D models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 31-43, Jan. 2006.
39. J. Lu, K. Plataniotis, and A. Venetsanopoulos, "Face recognition using LDA-based algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 195-200, Jan. 2003.
40. X. Lu and A. Jain, "Integrating range and texture information for 3-D face recognition," in Proc. IEEE Workshops Appl. Comput. Vis., 2005, vol. 1,pp. 156-163.
41. A. Martinez and A. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell, vol. 23, no. 2, pp. 228-233, Feb. 2001. (Pubitemid 32254716)
42. T. Maurer, D. Guigonis, I. Maslov, B. Pesenti, A. Tsaregorodtsev, D. West, and G. Medioni, "Performance of geometrix ActiveID 3-D face recognition engine on the FRGC data," in Proc. IEEE CVPR Workshop FRGCExp., 2005, vol. 3, p. 154.
43. O. Melnik, Y. Vardi, and C. Zhang, "Mixed group ranks: Preference and confidence in classifier combination," IEEE Trans. Pattern Anal. Mach. Intell, vol. 26, no. 8, pp. 973-981, Aug. 2004.
44. A. Mian, M. Bennamoun, and R. Owens, "An efficient multimodal 2D-3D hybrid approach to automatic face recognition," IEEE Trans. Pattern Anal. Mach. Intell, vol. 29, no. 11, pp. 1927-1943, Nov. 2007. (Pubitemid 47423788)
45. A. Mian, M. Bennamoun, and R. Owens, "Keypoint detection and local feature matching for textured 3-D face recognition," Int. J. Comput. Vis., vol. 79, no. 1, pp. 1-12, Aug. 2008. (Pubitemid 351578659)
46. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, A. Smola, and K. Muller, "Constructing descriptive and discriminative nonlinear features: Rayleigh coefficients in kernel feature spaces," IEEE Trans. Pattern Anal. Mach. Intell, vol. 25, no. 5, pp. 623-628, May 2003.
47. P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the face recognition grand challenge," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 947-954. (Pubitemid 43897294)
48. C. Queirolo, L. Silva, O. Bellon, and M. Segundo, "3D face recognition using simulated annealing and the surface interpenetration measure," IEEE Trans. Pattern Anal. Mach. Intell, vol. 32, no. 2, pp. 206-219, Feb. 2010.
49. A. Ross and R. Govindarajan, "Feature level fusion using hand and face biometrics," in Proc. SPIE Conf. Biometric Technol Human Identification II, 2005, pp. 196-204. (Pubitemid 41432827)
50. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000. (Pubitemid 32041578)
51. B. Scholkopf and A. Smola, Nonlinear component analysis as a kernel eigenvalue problem Max Planck Inst. Biologische Kybernetik, Tübingen, Germany, Tech. Rep. 44, 1996.
52. S. Singh, A. Gyaourova, G. Bebis, and I. Pavlidis, "Infrared and visible image fusion for face recognition," in Proc. SPIE Defense Security Symp., 2004, pp. 12-16.
53. X. Tan and B. Triggs, "Fusing Gabor and LBP feature sets for kernel-based face recognition," in Proc. AMFG-Lecture Notes Computer Science, 2007, vol. 4778, pp. 235-249.
54. M. Turk and A. Pentland, "Face recognition using eigenfaces," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1991, pp. 586-591.
55. J. Wang, J. Liang, H. Hu, and Y. Li, "Performance evaluation of infrared and visible image fusion algorithms for face recognition," in Proc. Int. Conf. Intell. Syst. Knowl. Eng., 2007, pp. 1-8.
56. C. Xu, Y. Wang, T. Tan, and L. Quan, "Automatic 3-D face recognition combining global geometric features with local shape variation information," inProc. IEEE Int. Conf. Pattern Recognit., 2004, pp. 308-313.
57. W. Yang, D. Yi, Z. Lei, J. Sang, and S. Z. Li, "2D-3D face matching using CCA," inProc. IEEE Conf. Autom. Face Gesture Recognit., 2008, pp. 1-6.
58. H. Yu and J. Yang, "A direct LDA algorithm for high-dimensional data with application to face recognition," Pattern Recognit., vol. 34, no. 10, pp. 2067-2070, Oct. 2001.
59. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol. 35, no. 4, pp. 399-458, Dec. 2003.
60. Z.Zhang and R.Blum, "A categorization ofmultiscale-decomposition- based image fusion schemes with a performance study for a digital camera application," Proc. IEEE, vol. 87, no. 8, pp. 1315-1326, Aug. 1999.
61. J. Zhang, H. Shen, and Z. Zhou, "Unified locally linear embedding and linear discriminant analysis algorithm for face recognition," in Proc. Chin. Conf. Biometric Recognit.-Lecture Notes Computer Science, 2004, vol. 3338, pp. 209-307.
62. J. Zhang, H. Shen, and Z. Zhou, "Ensemble-based discriminant manifold learning for face recognition," in Proc. ICNC-Lecture Notes in Computer Science, 2006, vol. 4221, pp. 29-38. (Pubitemid 44617866)