Dynamic audio-visual mapping using fused Hidden Markov Model inversion method

Proceedings - International Conference on Image Processing, ICIP

Volumn 3, Issue , 2006, Pages

  Xin, Le ^a   Tao, Jianhua ^a   Tan, Tieniu ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

3D motion capture; Audio visual mapping; Baum Welch inversion; Speech driven facial animation

Indexed keywords

ANIMATION; CONFORMAL MAPPING; DIGITAL IMAGE STORAGE; HIDDEN MARKOV MODELS; IMAGE PROCESSING; IMAGING SYSTEMS; MARKOV PROCESSES; OBJECT RECOGNITION; PROBABILITY DISTRIBUTIONS; REAL TIME SYSTEMS; TIME DELAY;

3D MOTION CAPTURE; AUDIO INPUTS; AUDIO-VISUAL MAPPING; BAUM-WELCH INVERSION; CHALLENGING PROBLEMS; GROUND TRUTHS; INVERSION ALGORITHMS; INVERSION METHODS; JOINT PROBABILISTIC; LOOSE SYNCHRONIZATIONS; MARKOV MODELS; SHORT TIME DELAYS; SPEECH DRIVEN FACIAL ANIMATION; TIGHTLY COUPLED; TRAINING CORPORA; VISUAL SPEECHES;

THREE DIMENSIONAL;

EID: 48149105519     PISSN: 15224880     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIP.2007.4379304     Document Type: Conference Paper

References (12)

1. M. Brand. Voice puppetry. In Siggraph, 1999.
2. M. Brand, N. Oliver, and A. Pentland. Coupled hidden markov models for complex action recognition. In CVPR 1997, June 1997.
3. K. Choi and J.-N. Hwang. Baum-welch hmm inversion for reliable audio-to-visual conversion. In Proc. IEEE Int. Workshop Multimedia Signal Processing, 1999.
4. S. Fu, R. Gutierrez-Osuna, A. Esposito, P. K. Kakumanu, and O. N. Garcia. Audio/visual mapping with cross-modal hidden markov models. IEEE Transactions on Multimedia, 7(2):243-252, April 2005.
5. P. Y. Hong, Z. Wen, and T. S. Huang. Real-time speech-driven face animation with expressions using neural networks. IEEE Transactions on Neural Networks, 13(4):916-927, July 2002.
6. P. K. Kakumanu. Audio-visual processing for speech driven facial animation. Master Thesis, Wright Stage University, 2002.
7. S. Moon and J.-N. Hwang. Robust speech recognition based on joint model and feature space optimization of hidden markov model. IEEE Transaction on Neural Networks, 8(2): 194-204, March 1997.
8. H. Pan, S. E. Levinson, T. S. Huang, and Z.-P. Liang. A fused hidden markov model with application to bimodal speech processing. IEEE Transactions on Signal Processing, 52(3):573-581, March 2004.
9. R. R. Rao, T. Chen, and R. M. Mersereau. Audio-to visual conversion for multimedia communication. IEEE Trans. On Industrial Electronics, 45(1):15-22, Feb 1998.
10. L. Xie and Z.-Q. Liu. Speech animation using coupled hidden markov models. In ICPR 2006, August 2006.
11. E. Yamamoto, S. Nakamura, and K. Shikano. Lip movement synthesis from speech based on hidden markov models. Speech Communication, 26(1): 105-115, May 1998.
12. Z. Zeng, J. Tu, B. Pianfetti, M. Liu, T. Zhang, Z. Zhang, T. S. Huang, and S. Levinson. Audio-visual affect recognition through multi-stream fused hmm for hci. In CVPR 2005, June 2005.