Expressive visual text-to-speech using active appearance models

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2013, Pages 3382-3389

  Anderson, Robert ^a   Stenger, Bjorn ^b   Wan, Vincent ^b   Cipolla, Roberto ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b TOSHIBA CORPORATION   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE APPEARANCE MODELS; COMPLETE SYSTEM; RECONSTRUCTION ERROR; TALKING HEADS; USER STUDY; VISUAL TEXT TO SPEECH;

COMPUTER SCIENCE; ELECTRICAL ENGINEERING; PATTERN RECOGNITION; SOFTWARE ENGINEERING;

IMAGE RECOGNITION;

EID: 84887344163     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2013.434     Document Type: Conference Paper

References (29)

1. I. Albrecht, M. Schröder, J. Haber, and H. Seidel. Mixed feelings: expression of non-basic emotions in a musclebased talking head. Virt. Real., 8(4):201-212, 2005. 1, 2
2. V. Blanz and T. Vetter. A morphable model for the synthesis of 3D faces. SIGGRAPH, pages 187-194, 1999. 4
3. D. Bradley,W. Heidrich, T. Popa, and A. Sheffer. High resolution passive facial performance capture. ACM TOG, 29(4), 2010. 2
4. M. Brand. Voice puppetry. In SIGGRAPH, pages 21-28, 1999. 2
5. Y. Cao, W. Tien, P. Faloutsos, and F. Pighin. Expressive speech-driven facial animation. ACM TOG, 24(4):1283-1302, 2005. 1, 2, 7
6. Y. Chang and T. Ezzat. Transferable videorealistic speech animation. In SIGGRAPH, pages 143-151, 2005. 1, 2, 7
7. T. Cootes, G. Edwards, and C. Taylor. Active appearance models. IEEE PAMI, 23(6):681-685, 2001. 1, 2, 3, 5
8. D. Cosker, S. Paddock, D. Marshall, P. Rosin, and S. Rushton. Towards perceptually realistic talking heads: models, methods and mcgurk. In Symp. Applied perception in graphics and visualization, pages 151-157, 2004. 2
9. F. De la Torre and M. Black. Robust parameterized component analysis: theory and applications to 2d facial appearance models. Computer Vision and Image Understanding, 91(1):53-71, 2003. 2, 4
10. S. Deena, S. Hou, and A. Galata. Visual speech synthesis by modelling coarticulation dynamics using a non-parametricswitching state-space model. In ICMI-MLMI, pages 1-8, 2010. 1, 2, 7
11. G. Edwards, A. Lanitis, C. Taylor, and T. Cootes. Statistical models of face images-improving specificity. Image and Vision Computing, 16(3):203-211, 1998. 2, 3
12. T. Ezzat and T. Poggio. Miketalk: A talking facial display based on morphing visemes. In In Proceedings of the Computer Animation Conference, pages 96-102, 1998. 2
13. X. Gao, Y. Su, X. Li, and D. Tao. A review of active appearance models. IEEE Transactions on Systems, Man, and Cybernetics, 40(2):145-158, 2010. 2
14. J. Gonzalez-Mora, F. De la Torre, R. Murthi, N. Guil, and E. Zapata. Bilinear active appearance models. ICCV, pages 1-8, 2007. 2
15. J. Latorre, V. Wan, M. J. F. Gales, L. Chen, K. Chin, K. Knill, and M. Akamine. Speech factorization for HMM-TTS based on cluster adaptive training. In Interspeech, 2012. 5
16. K. Liu and J. Ostermann. Realistic facial expression synthesis for an image-based talking head. In International Conference on Multimedia & Expo, pages 1-6, 2011. 1, 2, 7
17. W. Ma, A. Jones, J. Chiang, T. Hawkins, S. Frederiksen, P. Peers, M. Vukovic, M. Ouhyoung, and P. Debevec. Facial performance synthesis using deformation-driven polynomial displacement maps. SIGGRAPH, 27(5), 2008. 2
18. J. Melenchón, E. Mart́?nez, F. De la Torre, and J. Montero. Emphatic visual speech synthesis. Trans. Audio, Speech and Lang. Proc., 17(3):459-468, 2009. 7
19. I. Pandzic, J. Ostermann, and D. Millen. User evaluation: synthetic talking faces for interactive services. The Visual Computer, 15(7):330-340, 1999. 1
20. E. Sifakis, A. Selle, A. Robinson-Mosher, and R. Fedkiw. Simulating speech with a physics-based facial muscle model. In SCA ACM/Eurographics, pages 261-270, 2006. 2
21. S. Taylor, M. Mahler, B. Theobald, and I. Matthews. Dynamic units of visual speech. In Eurographics Symposium on Computer Animation, pages 275-284, 2012. 2
22. J. Tena, F. De la Torre, and I. Matthews. Interactive regionbased linear 3d face models. ACM TOG, 30(4):76, 2011. 4
23. B. Theobald, J. Bangham, I. Matthews, and G. Cawley. Nearvideorealistic synthetic talking faces: implementation and evaluation. Speech Comm., 44(14):127-140, 2004. 1, 2
24. K. Wampler, D. Sasaki, L. Zhang, and Z. Popovíc. Dynamic, expressive speech animation from a single mesh. In SCA ACM/Eurographics, pages 53-62, 2007. 2
25. L. Wang, W. Han, X. Qian, and F. Soong. Photo-real lips synthesis with trajectory-guided sample selection. In Speech Synth. Workshop, Int. Speech Comm. Assoc., 2010. 1, 2
26. L. Wang, W. Han, F. Soong, and Q. Huo. Text driven 3D photo-realistic talking head. In Interspeech, pages 3307-3308, 2011. 2, 7
27. K. Waters and T. Levergood. DECface: A system for synthetic face aplications. Multimedia Tools and Applications, 1(4):349-366, 1995. 1
28. H. Zen, N. Braunschweiler, S. Buchholz, M. Gales, K. Knill, S. Krstulovíc, and J. Latorre. Statistical Parametric Speech Synthesis Based on Speaker and Language Factorization. IEEE Trans. Audio Speech Lang. Process., 20(5), 2012. 5
29. H. Zen, K. Tokuda, and A. Black. Statistical parametric speech synthesis. Speech Communication, 51(11):1039-1154, November 2009. 1, 5