Stream confidence estimation for audio-visual speech recognition

6th International Conference on Spoken Language Processing, ICSLP 2000

Volumn , Issue , 2000, Pages

  Potamianos, Gerasimos ^a   Neti, Chalapathy ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); DISPERSIONS; GAUSSIAN DISTRIBUTION; LINGUISTICS;

AUDIO VISUAL SPEECH RECOGNITION; AUTOMATIC SPEECH RECOGNITION; CONFIDENCE ESTIMATION; GAUSSIAN MIXTURE MODEL; MISCLASSIFICATION ERROR; PHONE CLASSIFICATIONS; PHONETIC CLASSIFICATION; PIECE-WISE-CONSTANT FUNCTIONS;

SPEECH RECOGNITION;

EID: 85009153179     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. H. McGurk and J. MacDonald, "Hearing lips and seeing voices", Nature, vol. 264, pp. 746-748, 1976.
2. D. W. Massaro and D. G. Stork, "Speech recognition and sensory integration", American Scientist, vol. 86, pp. 236-244, 1998.
3. C. Bregler and Y. Konig, "'Eigenlips' for robust speech recognition", Proc. Int. Conf. Acoust. Speech Signal Process., Adelaide, pp. 669-672, 1994.
4. I. Matthews, J. A. Bangham, and S. Cox, "Audio-visual speech recognition using multiscale nonlinear image decomposition", Proc. Int. Conf. Speech Lang. Process., Philadelphia, pp. 38-41, 1996.
5. A. Adjoudani and C. Benôit, "On the integration of auditory and visual parameters in an HMM-based ASR", In Speechreading by Humans and Machines, D. G. Stork and M. E. Hennecke eds., Springer, Berlin, pp. 461-471, 1996.
6. A. Rogozan, P. Deléglise, and M. Alissali, "Adaptive determination of audio and visual weights for automatic speech recognition", Proc. Europ. Tut. Works. Audio-Visual Speech Process., Rhodes, pp. 61-64, 1997.
7. P. Jourlin, "Word dependent acoustic-labial weights in HMM-based speech recognition", Proc. Europ. Tut. Works. Audio-Visual Speech Process., Rhodes, pp. 69-72, 1997.
8. J. Luettin, "Towards speaker independent continuous speechreading", Proc. Eurospeech, Rhodes, pp. 1991-1994, 1997.
9. G. Potamianos and H. P. Graf, "Discriminative training of HMM stream exponents for audio-visual speech recognition", Proc. Int. Conf. Acoust. Speech Signal Process., Seattle, pp. 3733-3736, 1998.
10. M. E. Hennecke, D. G. Stork, and K. V. Prasad, "Visionary speech: Looking ahead to practical speechreading systems", In Speechreading by Humans and Machines, D. G. Stork and M. E. Hennecke eds., Springer, Berlin, pp. 331-349, 1996.
11. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition: A review", IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 4-37, 2000.
12. H. Bourlard and S. Dupont, "A new ASR approach based on independent processing and recombination of partial frequency bands", Proc. Int. Conf. Speech Lang. Process., Philadelphia, pp. 426-429, 1996.
13. S. Okawa, T. Nakajima, and K. Shirai, "A recombination strategy for multi-band speech recognition based on mutual information criterion", Proc. Europ. Conf. Speech Comm. Tech., Budapest, pp. 603-606, 1999.
14. G. Potamianos, A. Verma, C. Neti, G. Iyengar, and S. Basu, "A cascade image transform for speaker independent automatic speechreading", to appear: Proc. Int. Conf. Multimedia Expo., New York, 2000.
15. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Prentice Hall, Englewood Cliffs, 1993.