Audio-visual speech recognition by speech reading

International Conference on Digital Signal Processing, DSP

Volumn 2, Issue , 2002, Pages 1069-1072

  Zhang, Xiaozheng ^a   Mersereau, Russell M ^a   Clements, Mark A ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; AUDIO ACOUSTICS; DIGITAL SIGNAL PROCESSING; FEATURE EXTRACTION; HIDDEN MARKOV MODELS; MARKOV PROCESSES; SIGNAL PROCESSING; SPEECH; SPEECH ANALYSIS; SPEECH INTELLIGIBILITY; SPEECH PROCESSING;

ACOUSTIC SUBSYSTEMS; AUDIO VISUAL SPEECH RECOGNITION; COUPLED HIDDEN MARKOV MODELS; FEATURE EXTRACTION ALGORITHMS; HUMAN SPEECH PERCEPTION; TEMPORAL CORRELATIONS; VISUAL INFORMATION; VISUAL SPEECH FEATURES;

SPEECH RECOGNITION;

EID: 84948661013     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDSP.2002.1028275     Document Type: Conference Paper

References (15)

1. W. H. Sumby and I. Pollack, "Visual Contribution to Speech Intelligibility in Noise", J. Acoust. Soc, Amer., vol. 26, pp. 212-215, 1954.
2. E. D. Petajan. Automatic Lipreading to Enhance Speech Recognition, Ph.D. Thesis, I. of Illinois, 1984.
3. B. P. Yuhas, M. H. Goldstein, and T. J. Sejnowski, "Integration of acoustic and visual speech signals using neural nets, " IEEE Commun. Mag., pp. 65-71, Nov. 1989.
4. C. Bregler and Y. Konig, "Eigenlips for robust speech recognition, " Proc. IEEE ICASSP, pp. 669-672, 1994.
5. P. L. Silsbee and A. C. Bovik, "Computer lipreading for improved accuracy in automatic speech recognition, " IEEE Trans. Speech And Processing, vol. 4, pp. 337-351, 1996.
6. G. Potamianos, J. Luettin, and C. Neti, "Heirarchical discriminant features for audio-visual LVCSR, " Proc. IEEE ICASSP, 2001.
7. I. Matthews, T. F. Coores, J. A. Dangham, S. Cox, and R. Harvey, "Extraction of visual features for lipreading, '' IEEE Trans. PAMI, vol. 24, 2002.
8. X. Zhang and R. M. Mersereau, "Lip feature extraction towards an automatic speechreading system, " Proc. IEEE ICIP, 2000.
9. X. Zhang, C. C. Broun, R. M Mersereau, and M. A. Clements, "Automatic speechreading with applications to human-computer interfaces, " submitted to EURASIPJ. Appl. Sig. Proc., 2001.
10. URL:amp.ece.cmu.edu/intel/feature.data.html.
11. M. Brand, "Coupled hidden Markov models for modeling interacting processes, " Tech. Rep TR 405, MIT Media Lab, 1996.
12. X. Boyen and D. Koller, "Tractable inference for complex stochastic processes, " Proc. 14th Ann. Conf. Uncertainty in Artif. Intel, pp. 33-42, 1998.
13. C. Huang and A. Darwiche, "Inference in belief networks: A procedural guide, " Int. J. Approx. Reasoning, vol 11, pp. 1-158, 1994.
14. S. Young, D. Kershaw, J. Odell, D. Ollason, V. Valichev, and P. Woodland, The HTK Book, En-tropic Ltd., Cambridge, 1999.
15. K. Murphy. ''The Bayes' net toolbox for Matlab, " in Proc, Computing Science and Statistics Interface, vol. 33, 2001.