Audio-Visual Speech Recognition Using Lip Movement Extracted from Side-Face Images

AVSP 2003 - International Conference on Audio-Visual Speech Processing

Volumn , Issue , 2003, Pages 117-120

  Yoshinaga, Tomoaki ^a   Tamura, Satoshi ^a   Iwano, Koji ^a   Furui, Sadaoki ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NOISE; CAMERAS; FACE RECOGNITION; SPEECH PROCESSING; SPEECH RECOGNITION; TELEPHONE SETS; WHITE NOISE;

AUDIOVISUAL SPEECH RECOGNITION; CONDITION; FACE IMAGES; FRONTAL FACES; LIP MOVEMENTS; MOBILE ENVIRONMENTS; NOISE ROBUSTNESS; OPTICAL FLOW ANALYSIS; RECOGNITION METHODS; VISUAL FEATURE;

SIGNAL TO NOISE RATIO;

EID: 85133593587     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Bregler, C. and Konig, Y., ““Eigenlips” for robust speech recognition,” Proc. ICASSP94, vol.2, pp.669-672, Adelaide, Australia, 1994.
2. Tomlinson, M.J., Russell, M.J., and Brooke, N.M., “Integrating audio and visual information to provide highly robust speech recognition,” Proc. ICASSP96, vol.2, pp.821-824, Atlanta, USA, 1996.
3. Potamianos, G., Cosatto, E., Graf, H.P., and Roe, D.B., “Speaker independent audio-visual database for bimodal ASR,” Proc. AVSP'97, pp.65-68, Rhodes, Greece, 1997.
4. Neti, C., Potamianos, G., Luettin, J., Matthews, I., Glotin, H., Vergyri, D., Sison, J., Mashari, A., and Zhou, J., “Audio-visual speech recognition,” Final Workshop 2000 Report, Center for Language and Speech Processing, Baltimore, 2000.
5. Dupont, S. and Luettin, J., “Audio-visual speech modeling for continuous speech recognition,” IEEE Trans. Multimedia, vol.2, no.3, pp.141-151, 2000.
6. Zhang, Y., Levinson, S., and Huang, T.S., “Speaker independent audio-visual speech recognition,” Proc. ICME2000, TP8-1, New York, USA, 2000.
7. Chu, S.M. and Huang, T.S., “Bimodal speech recognition using coupled hidden markov models,” Proc. ICSLP2000, vol.2, pp.747-750, Beijing, China, 2000.
8. Miyajima, C., Tokuda, K., and Kitamura, T., “Audiovisual speech recognition using MCS-based HMMs and model-dependent stream weights,” Proc. ICSLP2000, vol.2, pp.1023-1026, Beijing, China, 2000.
9. Iwano, K., Tamura, S., and Furui, S., “Bimodal speech recognition using lip movement measured by optical-flow analysis” Proc. HSC2001, pp.187-190, Kyoto, Japan, 2001.
10. Horn, B.K.P and Schunck, B.G., “Determining Optical Flow,” Artificial Intelligence, vol.17, nos.1-3, pp.185-203, 1981.