Model-based synthesis of visual speech movements from 3D video

Eurasip Journal on Audio, Speech, and Music Processing

Volumn 2009, Issue , 2009, Pages

  Edge, James D ^a   Hilton, Adrian ^a   Jackson, Philip ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 74849098422     PISSN: 16874714     EISSN: 16874722     Source Type: Journal    
DOI: 10.1155/2009/597267     Document Type: Article

References (36)

1. Mori M., The uncanny valley Energy 1970 7 4 33 35. translated by K. F. MacDorman and T. Minato
2. Fisher C. G., Confusions among visually perceived consonants Journal of Speech and Hearing Research 1968 11 4 796 804
3. Ezzat T., Geiger G., Poggio T., Trainable videorealistic speech animation 21 Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 02) July 2002 388 398
4. Albrecht I., Haber J., Seidel H.-P., Speech synchronization for physics-based facial animation Proceedings of the 10th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG 02) 2002 9 16
5. Reveret L., Bailly G., Badin P., Mother: a new generation of talking heads providing a flexible articulatory control for video-realistic speech animation Proceedings of the 6th International Conference on Spoken Language Processing (ICSLP 00) 2000 755 758
6. Cohen M. M., Massaro D. W., Modeling coarticulation in synthetic visual speech Models and Techniques in Computer Animation 1993 Berlin, Germany Springer
7. Lfqvist A., Speech as audible Gestures Speech Production and Speech Modelling 1990 Berlin, Germany Springer 289 322
8. Cohen M., Massaro D., Clark R., Training a talking head Proceedings of the 4th IEEE International Conference on Multimodal Interfaces 2002 499 510
9. hman S., Numerical model of coarticulation Journal of the Acoustical Society of America 1967 41 310 320
10. Deng Z., Neumann U., Lewis J. P., Kim T.-Y., Bulut M., Narayanan S., Expressive facial animation synthesis by learning speech coarticulation and expression spaces IEEE Transactions on Visualization and Computer Graphics 2006 12 6 1523 1534
11. Black A., Taylor P., Caley R., The festival speech synthesis system 1999
12. Dutoit T., Pagel V., Pierret N., Bataille E., van der Vrecken O., The MBROLA project: towards a set of high quality speech synthesizers free of use for non commercial purposes 3 Proceedings of the International Conference on Spoken Language Processing (ICSLP 96) 1996 1393 1396
13. Bregler C., Covell M., Slaney M., Video Rewrite: driving visual speech with audio Proceedings of the ACM SIGGRAPH Conference on Computer Graphics (SIGGRAPH 97) August 1997 Los Angeles, Calif, USA 353 360
14. Deng Z., Neumann U., eFASE: expressive facial animation synthesis and editing with phoneme-isomap controls Proceedings of the ACM SIGGRAPH/ Eurographics Symposium on Computer Animation (SCA 06) 2006 251 260
15. Kshirsagar S., Magnenat-Thalmann N., Visyllable based speech animation 22 Proceedings of the Annual Conference of the European Association for Computer Graphics (EUROGRAPHICS 03) September 2003 631 639
16. Cao Y., Tien W. C., Faloutsos P., Pighin F., Expressive speech-driven facial animation ACM Transactions on Graphics 2005 24 4 1283 1302
17. Zhang L., Renals S., Acoustic-articulatory modeling with the trajectory HMM IEEE Signal Processing Letters 2008 15 245 248
18. Brand M., Voice puppetry Proceedings of the 26th International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 99) 1999 21 28
19. Massaro D. W., Beskow J., Cohen M. M., Fry C. L., Rodriguez T., Picture my voice: audio to visual speech synthesis using artificial neural networks Proceedings of the International Conference on Auditory-Visual Speech Processing (AVSP 99) 1999 133 138
20. Theobald B., Wilkinson N., A probabilistic trajectory synthesis system for synthesising visual speech Proceedings of the 9th International Conference on Spoken Language Processing (Interspeech 08) 2008
21. Ezzat T., Poggio T., Videorealistic talking faces: a morphing approach Proceedings of the ESCA Workshop on Audio-Visual Speech Processing (AVSP 97) 1997 141 144
22. Edge J. D., Hilton A., Jackson P., Parameterisation of 3D speech lip movements Proceedings of the International Conference on Auditory-Visual Speech Processing (AVSP 08) 2008
23. Mueller P., Kalberer G. A., Proesmans M., Van Gool L., Realistic speech animation based on observed 3D face dynamics IEE Vision, Image Signal Processing 2005 152 491 500
24. Ypsilos I. A., Hilton A., Rowe S., Video-rate capture of dynamic face shape and appearance Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition (FGR 04) May 2004 117 122
25. Zhang L., Snavely N., Curless B., Seitz S. M., Spacetime faces: high resolution capture for modeling and animation Proceedings of the 31st International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 04) August 2004 Los Angeles, Calif, USA 548 558
26. Govokhina O., Bailly G., Breton G., Bagshaw P., A new trainable trajectory formation system for facial animation Proceedings of the ISCA Workshop on Experimental Linguistics 2006 25 32
27. http://www.3dmd.com/
28. Zhang Z., Iterative point matching for registration of free-form curves and surfaces International Journal of Computer Vision 1994 13 2 119 152
29. Fisher W., Doddington G., Goudie-Marshall K., The DARPA speech recognition research database: specifications and status Proceedings of the DARPA Workshop on Speech Recognition 1986 93 99
30. Roweis S., EM algorithms for PCA and SPCA Proceedings of the Neural Information Processing Systems Conference (NIPS 97) 1997 626 632
31. Kruskal J., Wish M., Multidimensional Scaling 1979 Beverly Hills, Calif, USA Sage
32. Mermelstein P., Distance measures for speech recognition, psychological and instrumental Pattern Recognition and Artificial Intelligence 1976 New York, NY, USA Academic Press 374 388
33. Vatikiotis-Bateson E., Ostry D. J., Analysis and modeling of 3D jaw motion in speech and mastication 2 Proceedings of the IEEE International Conference on Systems, Man and Cybernetics October 1999 Tokyo, Japan 442 447
34. Ostry D. J., Vatikiotis-Bateson E., Gribble P. L., An examination of the degrees of freedom of human jaw motion in speech and mastication Journal of Speech, Language, and Hearing Research 1997 40 6 1341 1351
35. Cosatto E., Graf H.-P., Sample-based synthesis of photorealistic talking heads Proceedings of the Computer Animation Conference 1998 103 110
36. Cootes T. F., Edwards G. J., Taylor C. J., Active appearance models Proceedings of the European Conference on Computer Vision (ECCV 98) 1998 484 498