Product HMMs for audio-visual continuous speech recognition using facial animation parameters

Proceedings - IEEE International Conference on Multimedia and Expo

Volumn 2, Issue , 2003, Pages 481-484

  Aleksic, P S ^a   Katsaggelos, A K ^a  

^a Northwestern University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMATION; AUDIO ACOUSTICS; CONTINUOUS SPEECH RECOGNITION; FACE RECOGNITION; GAUSSIAN NOISE (ELECTRONIC); HIDDEN MARKOV MODELS; INTEGRATION; TELEPHONE SETS; TOPOLOGY; TRELLIS CODES; WHITE NOISE;

ADDITIVE WHITE GAUSSIAN NOISE; AUDIO AND VISUAL INFORMATION; AUDIO-VISUAL DATABASE; AUDIO-VISUAL INFORMATION; AUTOMATIC SPEECH RECOGNITION; FACIAL ANIMATION PARAMETERS; MULTI-STREAM HIDDEN MARKOV MODEL; VISUAL REPRESENTATIONS;

MOTION PICTURE EXPERTS GROUP STANDARDS;

EID: 34247584561     PISSN: 19457871     EISSN: 1945788X     Source Type: Conference Proceeding    
DOI: 10.1109/ICME.2003.1221658     Document Type: Conference Paper

References (14)

1. R. Lippman. "Speech recognition by machines and humans,"Speech Communicorion, vol. 22(1), pp. 1-15, July 1997.
2. D. G. Stork and M. E. Hennecke, editors, Speechreading byMan and Machine, Springer-Verlag New York Inc. , 1996.
3. C. Neti et al. "Audio-visual speech recognition," Tech. Rep. ,Johns Hopkins University. Baltimore, 2000. 14)
4. C. Bregler and Y. Conig, "Eigenlips' for robust speechrecognition," In IEEE Proc. ICASSP, pp. 669-672, Adelaide,1994.
5. S. Dupont, J. Luettin, "Audio-visual speech modeling forcontinuous speech recognition. " IEEE Trans. on Mulr. 2 3),161
6. H. Glotin et al. Weighting schemes for audio-visual fusion inspeech recognition," In IEEE Proc. ICASSP, vol. I 165-168 2001.
7. Text for ISO/IEC FDIS 14496-2 Visual, ISO/IECJTCIfSC29fWGI 1 N2502. Nov. 1998. IS]
8. F. Lavagetto, R. Pockaj, "An efficient use of MPEG-4 FAPinterpolation for facial animation at 70 hits/frame," IEEE Trans. on Cir. and Sys. for Video Tech. , vol. 11(10), pp. 1085-1097,October 2001. 191.
9. L. E. Bemstein. Lipreading Corpus V-VI: Disc 3. GallaudetUniversity, Washington, D. C. , 1991.
10. P. S. Aleksic, 1. 1. Williams, Z. Wu, and A. K. Katsaggelos,"Audio-Visual Speech Recognition Using MPEG-4 ComplionrVisual Features", EURASIP Journnl on Applied SignalProcessing. pp. 121 3-1227,2002.
11. G. A. Abrantes, FACE-Facial Animation System, version3. 3. 1, Instituto Superior Tecnico, (c) 1997-98.
12. S. Nakamura, "Fusion of Audio-Visual Information forIntegrated Speech Processing," Audio-and Video-Based BiometricPerson Authentication (AVBPA), pp. 127-143, Halmstad, Sweden,June 2001.
13. S. Nakamura, K. Kumatani, and S. Tamura, "Multi-modalTemporal Asynchronicity Modeling by Product HMMs for RobustAudio-visual Speech Recognition, " International Conference onMultimodal Interfaces, October 14-16. 2002.
14. J. J. Williams and A. K. Katsaggelos. "An HMM-basedspeech-to-video synthesizer," lEEE Trans. on Neural Networks,Special issue on lntelligenr Mdrimedia, vol. 13, no. 4, July 2002,pp. 900-915. pp. 141-151,2000.