Robust multi-modal person identification with tolerance of facial expression

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn 1, Issue , 2004, Pages 580-585

  Fox, Niall A ^a   Reilly, Richard B ^a  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

Audio visual; Classifier combination; Fusion; Lip modality; Multi modal; Person identification

Indexed keywords

AUDIO EQUIPMENT; FACE RECOGNITION; FITS AND TOLERANCES; IDENTIFICATION (CONTROL SYSTEMS); PERFORMANCE; SIGNAL TO NOISE RATIO;

AUDIO-VISUAL; CLASSIFIER COMBINATION; LIP MODALITY; MULTI-MODAL; PERSON IDENTIFICATION;

ROBUSTNESS (CONTROL SYSTEMS);

EID: 15744362948     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/icsmc.2004.1398362     Document Type: Conference Paper

References (23)

1. E. B. Bailliere, S. Bengio, F. Bimbot, M. Hamouz, J. Kittler, J. Mariethoz, J. Matas, K. Messer, V. Popovici, F. Poree, B. Ruiz, and J. P. Thiran, "The BANCA Database and Evaluation Protocol," Proceedings of the 4th International Conference on Audio- and Video-Based Biometric Person Authentication, AVBPA, Guildford, UK, pp. 625-638, June 2003.
2. S. Basu, H. S. M. Beigi, S. H. Maes, M. Ghislain, E. Benoit, C. Neti, and A. W. Senior, "Methods and Apparatus for Audio-visual Speaker Recognition and Utterance Verification." United States: Patent 6,219,640, 1999.
3. D. M. Blackburn, M. Bone, and P. J. Phillips, "Facial Recognition Vendor Test 2000: Evaluation Report," 2000.
4. R. Brunelli and D. Falavigna, "Person Identification Using Multiple Cues," IEEE Transactions on Pattern Analysis and Machine Intelligience, vol. 17, pp. 955-966, Oct. 1995.
5. J. P. Campbell, "Speaker Recognition: A Tutorial," Proceedings of the IEEE, vol. 85, pp. 1437-1462, Sept. 1997.
6. T. Chen, "Audiovisual Speech Processing," IEEE Signal Processing Magazine, vol. 18, pp. 9-21, Jan. 2001.
7. C. C. Chibelushi, F. Deravi, and J. S. D. Mason, "Adaptive Classifier Integration for Robust Pattern Recognition," IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, vol. 29, pp. 902-907, Dec. 1999.
8. C. C. Chibelushi, F. Deravi, and J. S. D. Mason, "A Review of Speech-Based Bimodal Recognition," IEEE Transactions on Multimedia, vol. 4, pp. 23-35, Mar 2002.
9. S. Davis and P. Mermelstein, "Comparison of Parametric Representations for Monosyllabic Word Recognition in Continuously Spoken Sentences," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 28, pp. 357-366, Aug. 1980.
10. N. A. Fox, R. Gross, P. de Chazal, J. F. Cohn, and R. B. Reilly, "Person Identification Using Automatic Integration of Speech, Lip, and Face Experts," Proceedings of the ACM SIGMM Multimedia Biometrics Methods and Applications Workshop, Berkeley, CA., pp. 25-32, Nov. 2003.
11. N. A. Fox and R. B. Reilly, "Audio-Visual Speaker Identification Based on the Use of Dynamic Audio and Visual Features," Proc. of the 4th International Conference on Audio- and Video-Based Biometric Person Authentication, Guildford, UK, pp. 743-751, June 2003.
12. M. Heckmann, F. Berthommier, and K. Kristian, "Noise Adaptive Stream Weigthing in Audio-Visual Speech Recognition," EURASIP Journal on Applied Signal Processing, vol. 2002, pp. 1260-1273, Nov. 2002.
13. http://www.mathworks.com/, "Matlab Ver. 6.5, R13."
14. J. Kittler and F. M. Alkoot, "Sum versus Vote Fusion in Multiple Classifier Systems," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, pp. 110-115, Jan. 2003.
15. I. Matthews, T. F. Cootes, J. A. Bangham, J. A. Cox, and R. Harvey, "Extraction of Visual Features for Lipreading," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp. 198-213, Feb. 2002.
16. K. Messer, J. Kittler, J. Luettin, and G. Maitre, "XM2VTSDB: "The Extended M2VTS Database"," The Proceedings of the Second International Conference on Audio and Video-based Biometric Person Authentication (AVBPA'99), Washington D.C., pp. 72-77, March 1999.
17. A. N. Netravali and B. G. Haskell, "Digital Pictures": Plenum Press, 1998.
18. G. Potamianos, H. Graf, and E. Cosatto, "An Image Transform Approach for HMM Based Automatic Lipreading," Proceedings of the IEEE International Conference on Image Processing, ICIP 98, Chicago, vol. 3, pp. 173-177, Oct. 1998.
19. L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of the IEEE, vol. 77, pp. 257-286, Feb. 1989.
20. D. A. Reynolds and R. C. Rose, "Robust Text-Independent Speaker Identification Using Gaussian Mixture Speaker Models," IEEE Transactions on Speech and Audio Processing, vol. 3, pp. 72-83, Jan. 1995.
21. G. K. Wallace, "The JPEG still picture compression standard," Commun. ACM, vol. 34, pp. 31-44, April 1991.
22. T. J. Wark, S. Sridharan, and V. Chandran, "The use of Speech and Lip Modalities for Robust Speaker Verification under Adverse Conditions," Proceedings of the IEEE International Conference on Multimedia Computing and Systems, Florence, Italy, vol. 1, pp. 812-816, June 1999.
23. S. Young, G. Evermann, D. Kershaw, G. Moore, J. Odell, D. Ollason, V. Valtchev, and P. Woodland, "The HTK Book (for HTK Version 3.1)". Cambridge University Engineering Department: Microsoft Corporation, 2001.