Audio to visual signal mappings with HMM

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 5, Issue , 2004, Pages

  Liu, Wentao ^a   Yin, Baocai ^a   Jia, Xibin ^a   Kong, Dehui ^a  

^a BEIJING UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ANIMATION; AUDIO ACOUSTICS; FACE RECOGNITION; INTEGRATION; MARKOV PROCESSES; MATHEMATICAL MODELS; NEURAL NETWORKS; PARAMETER ESTIMATION; PROBABILITY; SYNCHRONIZATION; VECTOR QUANTIZATION; VECTORS;

FACIAL MOVEMENTS; LINEAR MODELS; TIME DELAY NEURAL NETWORKS (TDNN); VISUAL MAPPING;

SPEECH RECOGNITION;

EID: 4544386358     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. S. Basu, N. Oliver and A. Pentland, "3D modeling and tracking of human lip motion," ICCV'98, 337-343, Bombay, India, 1998.
2. Thomas Vetter and Tomaso Poggio. Linear object classes and image synthesis from a single example image. A.I. Memo 1531, MIT, 1995
3. M. Brand. "Voice Puppetry". In Proc. SIGGRAPH99, pages 21-28, 1999.
4. C. Bregler, M. Covell, and M. Slancy, "Video rewrite: driving visual speech with audio", SIGGRAPH' 97, 1997.
5. T. Chen, and R.R. Rao, "Audio-Visual Integration in Multimodal Communications," Proceedings of the IEEE, vol. 86, no. 5, pp. 837-852, May 1998.
6. T. F. Cootes, C. J. Taylor, et al., "Active shape models - their training and application," Computer Vision and Image Understanding, 61(1):38-59, Jan. 1995.
7. M. Covell and C. Bregler, "Eigen-points," Proc. IEEE ICIP, vol. 3, pp. 471-474, 1996.
8. S. Curinga, F. Lavagetto, and F. Vignoli, "Lip movements synthesis using Time- Delay", Proc. EUSIPCO-96, Trieste, 1996.
9. S. Morishima, K. Aizawa and H. Harashima, "An intelligent facial image coding driven by speech and phoneme," Proc. IEEE ICASSP, p. 1795. Glasgow, UK, 1989.
10. R. Rao and T. Chen, "Exploiting audio-visual correlation in coding of talking head sequences" in Picutre Coding Symposium' 96, Melbourne, Australia, March, 1996.
11. Vetter, T., Jones, M. and Poggio, T., "A bootstrapping algorithm for learning linearized models of object classes," IEEE Conference on Computer Vision and Pattern Recognition, 1997
12. T. Kohonen, "The self-organizing map," Proceedings of the IEEE, vol. 78, pp. 1464-1480, 1990.
13. S. Kshirsagar and N. Magnenat-Thalmann, "Lip Synchronization Using Linear Predictive Analysis", Proceedings of IEEE International Conference on Multimedia and Expo, New York, August 2000.
14. Ezzat, T., Geiger, G., Poggio, T., 2002. "Trainable Videorealistic Speech Animation", SIGGRAPH 2002 pg 389-398.
15. J. P. Lewis, "Automated lip-sync: Background and techniques", J. Visualization and Computer Animation, 2:118-122, 1991.
16. D.W. Massaro, J. Beskow, et al., "PictureMy Voice: Audio to Visual Speech Synthesis using Artificial Neural Networks", in Proc. AVSP'99, Santa Cruz, USA.
17. I. Pandzic, J. Ostermann, and D. Millen, "User evaluation: Synthetic talking faces for interactive services," The Visual Computer, vol. 15, Issue 7/8, 4 November 1999, pp. 330-340.