Multimodal person authentication using speech, face and visual speech

Computer Vision and Image Understanding

Volumn 109, Issue 1, 2008, Pages 44-55

  Palanivel, S ^a   Yegnanarayana, B ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY MADRAS   (India)

Author keywords

Autoassociative neural network; Eye location; Face tracking; Multimodal person authentication; Multiscale morphological dilation and erosion; Visual speech

Indexed keywords

AUTHENTICATION; FACE RECOGNITION; FEATURE EXTRACTION; GAUSSIAN DISTRIBUTION; MATHEMATICAL MODELS; MODAL ANALYSIS; NEURAL NETWORKS;

EYE LOCATION; FACE TRACKING; MULTIMODAL PERSON AUTHENTICATION;

SPEECH RECOGNITION;

EID: 37049017072     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2006.11.013     Document Type: Article

References (39)

1. W. Zhao, R. Chellappa, A. Rosenfeld, P. Phillips, Face recognition: A literature survey, UMD CAFR, Technical Report, CAR-TR-948, 2000.
2. Yilmaz C.C., Deravi F., and Mason J. A review of speech-based bimodal recognition. IEEE Transactions of Multimedia 4 1 (2002) 23-37
3. National Institute of Standards and Technology (NIST), Speaker Recognition Workshop Report, University of Maryland, Baltimore, 2003.
4. Turk M., and Pentland A. Eigenfaces for recognition. Journal of Cognitive NeuroScience 3 (1991) 71-86
5. Swets D., and Weng J. Using discriminant eigenfeatures for image retrieval. IEEE Transactions of Pattern Analysis and Machine Intelligence 18 8 (1996) 831-836
6. Belhumeur P., Hespanha J., and Kriegman D. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions of Pattern Analysis and Machine Intelligence 19 7 (1997) 711-720
7. M. Bartlett, H. Lades, T. Sejnowski, Independent component representations for face recognition, in: Proc. SPIE, vol. 3299, San Jose, CA, 1998, pp. 528-539.
8. Lades M., Vorbruggen J., Buhmann J., Lange J., Malsburg C., Wurtz R., and Konen W. Distortion invariant object recognition in the dynamic link architecture. IEEE Transactions of Computers 43 3 (1993) 300-311
9. Wiskott L., Fellous J., and Malsburg C. Face recognition by elastic bunch graph matching. IEEE Transactions of Pattern Analysis and Machine Intelligence 19 7 (1997) 775-779
10. Gao Y., and Leung M. Face recognition using line edge map. IEEE Transactions of Pattern Analysis and Machine Intelligence 24 6 (2002) 764-779
11. Heisele B., Alessandro, and Poggio T. Learning and vision machines. Proceedings of IEEE 90 7 (2002) 1164-1177
12. Kotropoulos C., and Pitas I. Using support vector machines to enhance the performance of elastic graph matching for frontal face authentication. IEEE Transactions of Pattern Analysis and Machine Intelligence 23 7 (2001) 735-746
13. M. Savvides, B.V. Kumar, P. Khosla, Face verification using correlation filters, in: Proc. 3rd IEEE Automatic Identification Advanced Technologies, Tarrytown, NY, 2002, pp. 56-61.
14. A.J. Howell, H. Buxton, Towards unconstrained face recognition from image sequences, in: Proc. Int. Conf. on Automatic face and gesture recognition, Killington, VT, 1996, pp. 224-229.
15. Zhou S., Krueger V., and Chellappa R. Probabilistic recognition of human faces from video. Computer Vision and Image Understanding 91 (2003) 214-245
16. X. Liu, T. Chen, Video-based face recognition using adaptive hidden Markov models, in: Proc. IEEE Conf. Computer Vision and Pattern Recognition, Madison, WI, 2003, pp. 340-345.
17. T. Choudhury, B. Clarkson, T. Jebara, A. Pentland, Multimodal person recognition using unconstrained audio and video, in: Proc. Audio-and video-based Biometric Person Authentication, Washington, DC, 1999, pp. 176-181.
18. A. Senior, C. Neti, A. Senior, On the use of visual information for improving audio-based speaker recognition, in: Audio-Visual speech processing conference, Santa Cruz, CA, 1999.
19. C. Sanderson, K. Paliwal, Noise resistant audio-visual verification via structural constraints, in: IEEE Int'l Conf. Acoustics, Speech and Signal Processing, Hong Kong, 2003, pp. 716-719.
20. T. Hazen, E. Weinstein, B. Heisele, Multi-modal face and speaker identification on a handheld device, in: Workshop on multimodal user authentication, Santa Barbara, CA, 2003, pp. 113-120.
21. Jourlin P., Luettin J., Genoud D., and Wassner H. Acoustic-labial speaker verification. Pattern Recognition Letters 18 (1997) 853-858
22. U. Chaudhari, G. Ramaswamy, G. Potamianos, C. Neti, Audio-visual speaker recognition using time-varying stream reliability prediction, in: IEEE Int'l Conf. Acoustics, Speech and Signal Processing, Hong Kong, 2003, pp. 712-715.
23. A. Kanak, E. Erzin, Y. Yemez, A. Tekalp, Joint audio-video processing for biometric speaker identification, in: IEEE Int'l Conf. Acoustics, Speech and Signal Processing, Hong Kong, 2003, pp. 377-380.
24. J. Steffens, E. Elagin, H. Neven, Personspotter-fast and robust system for human detection, tracking and recognition, in: Proc. Int. Conf. Automatic face and gesture recognition, Nara, Japan, 1998, pp. 516-521.
25. R. Gross, J. Shi, The CMU motion of body (MoBo) database, Technical Report, CMU-RI-TR-01-18, Robotics institute, Carnegie Mellon University, June 2001.
26. VidTIMIT Database, http://www.eleceng.adelaide.edu.au/Personal/csanders/vidtimit/welcome.html.
27. M2VTS Multimodal Face Database, http://www.tele.ucl.ac.be/PROJECTS/M2VTS/m2fdb.html.
28. Jackway P., and Deriche M. Scale-space properties of the multiscale morphological dilation-erosion. IEEE Transactions of Pattern Analysis and Machine Intelligence 18 1 (1996) 38-51
29. Yang M., Kriegman D., and Ahuja N. Detecting faces in images: A survey. IEEE Transactions of Pattern Analysis and Machine Intelligence 24 1 (2002) 34-58
30. Nikolaidis A., and Pitas I. Facial feature extraction and pose determination. Pattern Recognition 33 11 (2000) 1783-1791
31. Hsu R., Abdel-Mottaleb M., and Jain A. Face detection in color images. IEEE Transactions of Pattern Analysis and Machine Intelligence 24 5 (2002) 696-706
32. Lam K., and Yan H. Locating and extracting the eye in human face images. Pattern Recognition 29 5 (1996) 771-779
33. Smeralsi F., Carmona O., and Bigun J. Saccadic search with Gabor features applied to eye detection and real-time head tracking. Image and Vision Computing 18 4 (2000) 323-329
34. Chen T. Audiovisual speech processing. IEEE Signal Processing Magazine (2001) 9-21
35. Leung S., Wang S., and Lau W. Lip image segmentation using fuzzy clustering incorporating an elliptic shape function. IEEE Transactions of Image Processing 13 1 (2004) 51-62
36. S. Wang, W. Lau, S. Leung, A. Liew, Lip segmentation with the presence of beards, in: IEEE Int'l Conf. Acoustics, Speech and Signal Processing, vol. 3, Montreal, Canada, 2004, pp. 529-532.
37. Kotropoulos C., Tefas A., and Pitas I. Frontal face authentication using discriminating grids with morphological feature vectors. IEEE Transactions of Multimedia 2 1 (2000) 14-26
38. Yegnanarayana B., and Kishore S. AANN: an alternative to GMM for pattern recognition. Neural Networks 15 (2002) 459-469
39. Haykin S. Neural Networks: A Comprehensive Foundation (1999), Prentice Hall International, New Jersey