Multimodal biometric human recognition for perceptual humancomputer interaction

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 40, Issue 6, 2010, Pages 676-681

  Jiang, Richard M ^a   Sadka, Abdul H ^b   Crookes, Danny ^c  

^a LOUGHBOROUGH UNIVERSITY   (United Kingdom)

^b BRUNEL UNIVERSITY   (United Kingdom)

^c QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

Author keywords

Laplacian Eigenmap; low level feature fusion; multimodal biometrics; perceptual humancomputer interaction (HCI); speaker recognition

Indexed keywords

BIOMETRIC VERIFICATION; FACE POSE; HUMAN FACES; HUMAN RECOGNITION; HUMAN SUBJECTS; ILL POSED; LAPLACIANS; LATENT SEMANTIC ANALYSIS; LOW LEVEL; LOW-LEVEL FEATURE FUSION; LOW-LEVEL FEATURES; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; MULTI-MODAL; MULTI-MODAL BIOMETRICS; MULTI-MODAL FUSION; REAL TIME PERFORMANCE; SPEAKER RECOGNITION; VIDEO DATABASE;

BIOMETRICS; FACE RECOGNITION; FEATURE EXTRACTION; LAPLACE TRANSFORMS; VIDEO RECORDING;

SPEECH RECOGNITION;

EID: 77958153814     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2010.2050476     Document Type: Article

References (32)

1. B. Jensen, N. Tomatis, L. Mayor, A. Drygajlo, and R. Siegwart, "Robots meet humans-Interaction in public spaces," IEEE Trans. Ind. Electron., vol.52, no.6, pp. 1530-1546, Dec. 2005.
2. T. Bucher, C. Curio, J. Edelbrunner, C. Igel, D. Kastrup, I. Leefken, G. Lorenz, A. Steinhage, and W. von Seelen, "Image processing and behavior planning for intelligent vehicles," IEEE Trans. Ind. Electron., vol.50, no.1, pp. 62-75, Feb. 2003.
3. R.Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, U.K.: Cambridge Univ. Press, Mar. 2004.
4. R. Fergus, P. Perona, and A. Zisserman, "Weakly supervised scaleinvariant learning of models for visual recognition," Int. J. Comput. Vis., vol.71, pp. 273-303, 2007.
5. M. S. Alam and A. Bal, "Improved multiple target tracking via global motion compensation and optoelectronic correlation," IEEE Trans. Ind. Electron., vol.54, no.1, pp. 522-529, Feb. 2007.
6. H. Zhou, M. Taj, and A. Cavallaro, "Target detection and tracking with heterogeneous sensors," IEEE J. Sel. Top. Signal Process., vol.2, no.4, pp. 503-513, Aug. 2008.
7. P. Vadakkepat, P. Lim, L. Silva, L. Jing, and L. L. Ling, "Multimodal approach to human-face detection and tracking," IEEE Trans. Ind. Electron., vol.55, no.3, pp. 1385-1393, Mar. 2008.
8. J. J. Heuring and D. W. Murray, "Modeling and copying human face movements," IEEE Trans. Robot. Autom., vol.15, no.6, pp. 1095-1108, Oct. 1999.
9. P. Viola and M. Jones, "Robust real-time object detection," presented at the 2nd Int.Workshop Stat. Learn. Comput. Theories Vis. Model., Learn., Comput. Sampling, Vancouver, Canada, Jul. 2001.
10. J. Meynet, "Information theoretic combination of classifiers with application to face detection," Ph.D. thesis, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland, No.3951, 2007.
11. L. Hong and A. Jain, "Multimodal biometrics," in Biometrics: Personal Identification in Networked Society. Boston, MA: Kluwer, 1999.
12. P. Ejarque and J. Hernando, "Score bi-Gaussian equalisation for multimodal person verification," IET Signal Process., vol.3, no.4, p. 322, 2009.
13. N. A. Fox, R. Gross, J. Cohn, and R. Reilly, "Robust biometric person identification using automatic classifier fusion of speech, mouth, and face experts," IEEE Trans. Multimedia, vol.9, no.4, pp. 701-714, Jun. 2007.
14. C. Busso and S. Narayanan, "Interrelation between speech and facial gestures in emotional utterances: A single subject study," IEEE Trans. Audio, Speech Lang. Process., vol.15, no.8, pp. 2331-2347, Nov. 2007.
15. M. Faundez-Zanuy, J. Fierrez-Aguilar, J. Ortega-Garcia, and J. Gonzalez-Rodriguez, "Multimodal biometric databases: An overview," IEEE Aerosp. Electron. Syst. Mag., vol.21, no.8, pp. 29-37, Aug. 2006.
16. P. S. Aleksic and A. K. Katsaggelos, "Audio-visual biometrics," Proc. IEEE, vol.94, no.11, pp. 2025-2044, Nov. 2006.
17. Z. Zeng, J. Tu, B. M. Pianfetti, and T. S. Huang, "Audio-visual affective expression recognition through multistream fused HMM," IEEE Trans. Multimedia, vol.10, no.4, pp. 570-577, Jun. 2008.
18. D. Gatica-Perez, G. Lathoud, J. Odobez, and I. McCowan, "Audiovisual probabilistic tracking of multiple speakers in meetings," IEEE Trans. Audio, Speech Lang. Process., vol.15, no.2, pp. 601-616, Feb. 2007.
19. V. Chatzis, A. Bors, and I. Pitas, "Multimodal decision-level fusion for person authentication," IEEE Trans. Syst.,Man, Cybern. A, Syst.,Humans, vol.29, no.6, pp. 674-681, Nov. 1999.
20. X. Zeng, J. Tu,M. Liu, T. S. Huang, B. Pianfetti, D. Roth, and S. Levinson, "Audio-visual affect recognition," IEEE Trans. Multimedia, vol.9, no.2, pp. 424-428, Feb. 2007.
21. J. Kittler, M. Hatef, R. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol.20, no.3, pp. 226-239, Mar. 1998.
22. R. Brunelli and D. Falavigna, "Person identification using multiple cues," IEEE Trans. Pattem Anal. Mach. Intell., vol.17, no.10, pp. 955-966, Oct. 1995.
23. M. Li, D. Li, and N. Dimitrova, "Audio-visual talking face detection," in Proc. Int. Conf. Multimedia Expo., Jul. 2003, vol. 2, no. 6-9 pp. II-473-II-476.
24. Y. Wang, Z. Liu, and J. C. Huang, "Multimedia content analysis using both audio and visual clues," IEEE Signal Process. Mag., vol.17, no.6, pp. 12-36, Nov. 2000.
25. A. M. Martinez and A. C. Kak, "PCA versus LDA," Trans. Pattem Anal. Mach. Intell., vol.23, no.2, pp. 228-233, Feb. 2001.
26. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattem Anal. Mach. Intell., vol.19, no.7, pp. 711-720, Jul. 1997.
27. M. Slaney and M. Covell, "Face synch: A linear operator for measuring synchronization of video facial images and audio tracks," in Proc. Neural Inf. Process. Soc., Denver, CO, 2001, pp. 814-820.
28. B. Tenenbaum, V. Silva, and J. Langford, "A global geometric framework for nonlinear dimensionality," Science, vol.290, no.5500, pp. 2319-2323, 2000.
29. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol.290, no.5500, pp. 2323-2326, 2000.
30. X. He, S. Yan, Y. Hu, P. Niyogi, and H. J. Zhang, "Face recognition using laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol.27, no.3, pp. 328-340, Mar. 2005.
31. S. Z. Li, Q. Fu, L. Ge, Y. Cheng, and H. Zhang, "Kernel machine based learning for multi-view face detection and pose estimation," in Proc. Eighth IEEE Int. Conf. Comput. Vis., 2001, vol.2, pp. 674-679.
32. Individual interviewdatabase provided byUKfuture TV. (2008). [Online]. Available: http://www.ukfuturetv.com/