Bimodal fusion in audio-visual speech recognition

IEEE International Conference on Image Processing

Volumn 1, Issue , 2002, Pages

  Zhang, Xiaozheng ^a   Mersereau, Russell M ^a   Clements, Mark ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NOISE; IMAGE ANALYSIS; IMAGE UNDERSTANDING; MATHEMATICAL MODELS; OPTIMIZATION;

AUDIO VISUAL SPEECH RECOGNITION; AUTOMATIC SPEECH RECOGNITION; BIMODAL FUSION;

SPEECH RECOGNITION;

EID: 0036451509     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. D. Reisberg, J. McLean, and A. Goldfield, "Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli," in Hearing by Eyes: The Psychology of Lipreading, Barbara Dodd and Ruth Campbell, Eds., pp. 97-113. Lawrence Erlbaum Associates, London, 1987.
2. T. Sullivan and R. Stern, "Multi-microphone correlation-based processing for robust speech recognition," in Proc. IEEE ICASSP, April 1993, pp. 91-94.
3. R. M. Stern, A. Acero, F.-H. Liu, and Y. Ohshima, "Signal processing for robust speech recognition," in Automatic Speech and Speaker Recognition. Advanced Topics, C.-H. Lee, F. K. Soong, and K. K. Paliwal, Eds. Kluwer Academic Publishers, 1996.
4. O. Ghitza, "Auditory nerve representation as a front-end for speech recognition in a noisy environment," Computer Speech and Language, vol. 1, pp. 109-130, 1986.
5. E. D. Petajan, Automatic lipreading to Enhance Speech Recognition, Ph.D thesis, Univ. of Illinois, Urbana-Champaign, 1984.
6. D. G. Stork and M. E. Hennecke, Speechreading by Humans and Machines, vol. 150 of NATO ASI Series F, Springer Verlag, 1996.
7. C. Neti, G. Potamianos, J. Luettin, I. Matthews, H. Glotin, D. Vergyri, J. Sison, A. Mashari, and J. Zhou, "Audio-visual speech recognition," Tech. Rep., CLSP/Johns Hopkins University, Baltimore, 2000.
8. X. Zhang and R. M. Mersereau, "Lip feature extraction towards an automatic speechreading system," in Proc. IEEE Int. Conf. on Image Processing, 2000.
9. X. Zhang, C. C. Broun, R. M. Mersereau, and M. Clements, "Automatic speechreading with applications to human-computer-interfaces," Submitted to EURASIP Journal on Applied Signal Processing, Special issue on Audio-Visual Speech Processing, 2002.
10. D. Massaro, "Bimodal speech perception: A progress report," Speechreading by Humans and Machines, vol. 150 of NATO ASI Series F, Springer Verlag, 1996.
11. M. Brand, "Coupled hidden Markov models for modeling interacting process," Tech. Rep., MIT Media Lab, TR 405, 1996.
12. X. Boyen and D. Koller, "Tractable inference for complex stochastic processes," in Proceedings of the 14th Annual Conference on Uncertainty in Artificial Intelligence (UAI-98), Madison, Wisconsin, July 1998, pp. 33-42.
13. X. Boyen and D. Koller, "Approximate learning of dynamic models," in Proceedings of the 11th Annual Conference on Neural Information Processing Systems (NIPS-98), Denver, Colorado, December 1998, pp. 396-402.
14. C. Huang and A. Darwiche, "Inference in belief networks: a procedural guide," International Journal of Approximate Reasoning, vol. 11, pp. 1-158, 1994.
15. "URL: http://amp.ece.cmu.edu/projects/audiovisual-speechprocessing,".
16. S. Young, D. Kershaw, J. Odell, D. Ollason, V. Valtchev, and P. Woodland, The HTK Book, Entropic Ltd., Cambridge, 1999.
17. K. Murphy, "The Bayes Net Toolbox for Matlab," in Computing Science and Statistics: Proceedings of Interface, 2001, vol. 33.