Dynamic, expressive speech animation from a single mesh

Symposium on Computer Animation 2007 - ACM SIGGRAPH / Eurographics Symposium Proceedings, SCA 2007

Volumn , Issue , 2007, Pages 53-62

  Wampler, Kevin ^a   Sasaki, Daichi ^c   Zhang, Li ^b   Popović, Zoran ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

BLENDING; COMPUTER GRAPHICS; INTERACTIVE COMPUTER GRAPHICS; MESH GENERATION;

EMOTIONAL EXPRESSIONS; EXPRESSIVE SPEECH; FACE SHAPES; HUMAN FACES; MULTILINEAR MODELS; SYNTHESIS METHOD;

ANIMATION;

EID: 84887399892     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. BLANZ V., BASSO C., VETTER T., POGGIO T.: Reanimating faces in images and video. In EUROGRAPHICS 2003 (EUROGRAPHICS-03): the European Association for Computer Graphics, 24th Annual Conference (Granada, Spain, 2003), Brunet P., Fellner D. W., (Eds.), vol. 22 of Computer Graphics Forum, The Eurographics Association, Blackwell, pp. 641-650.
2. BREGLER C., COVELL M., SLANEY M.: Video rewrite: driving visual speech with audio. In SIGGRAPH '97: Proceedings of the 24th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1997), ACM Press/Addison-Wesley Publishing Co., pp. 353-360.
3. BRAND M.: Voice puppetry. In SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1999), ACM Press/Addison-Wesley Publishing Co., pp. 21-28.
4. BLANZ V., VETTER T.: A morphable model for the synthesis of 3d faces. In SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1999), ACM Press/Addison-Wesley Publishing Co., pp. 187-194.
5. CAMBRIDGE UNIVERSITY ENGINEERING DEPARTMENT: Hidden markov model toolkit. http://htk.eng.cam.ac.uk/.
6. CHUANG E., BREGLER C.: Mood swings: expressive speech animation. ACM Trans. Graph. 24, 2 (2005), 331-347.
7. CHANG Y.-J., EZZAT T.: Transferable videorealistic speech animation. In SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation (New York, NY, USA, 2005), ACM Press, pp. 143-151.
8. CAO Y., TIEN W. C., FALOUTSOS P., PIGHIN F.: Expressive speech-driven facial animation. ACM Trans. Graph. 24, 4 (2005), 1283-1302.
9. DENG Z., LEWIS J., NEUMANN U.: Synthesizing speech animation by learning compact speech coarticulation models. In Computer Graphics International (2005), pp. 19-25.
10. EKMAN P., FRIESEN W.: The facial action coding system: A technique for the measurement of facial movement, 1978.
11. EZZAT T., GEIGER G., POGGIO T.: Trainable videorealistic speech animation. In SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 2002), ACM Press, pp. 388-398.
12. JONES M. J., POGGIO T.: Multidimensional morphable models: A framework for representing and matching object classes. Int. J. Comput. Vision 29, 2 (1998), 107-131.
13. KIM T.-Y., BULUT M.: Expressive facial animation synthesis by learning speech coarticulation and expression spaces. IEEE Transactions on Visualization and Computer Graphics 12, 6 (2006), 1523-1534. Member-Zhigang Deng and Member-Ulrich Neumann and Member-J. P. Lewis and Senior Member-Shrikanth Narayanan.
14. KING M.-S. A., PARENT M.-R. E.: Creating speech-synchronized animation. IEEE Transactions on Visualization and Computer Graphics 11, 3 (2005), 341-352.
15. LATHAUWER L. D.: Signal Processing based on Multilinear Algebra. PhD thesis, Faculteit der Toegepaste Wetenschappen. Katholieke Universiteit Leuven, 1997.
16. LEE Y., TERZOPOULOS D., WALTERS K.: Realistic modeling for facial animation. In SIGGRAPH '95: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1995), ACM Press, pp. 55-62.
17. LEVIN A., ZOMET A., PELEG S., WEISS Y.: Seamless image stitching in the gradient domain, 2003.
18. MUELLER P., KALBERER G. A., PROESMANS M., GOOL L. V.: Realistic speech animation based on observed 3d face dynamics. IEE Proc. Vision, Image and Signal Processing 152 (August 2005), 491-500.
19. MATUSIK W., ZWICKER M., DURAND F.: Texture design using a simplicial complex of morphable textures. In SIGGRAPH '05: ACM SIGGRAPH 2005 Papers (New York, NY, USA, 2005), ACM Press, pp. 787-794.
20. PARKE F. I.: Parameterized models for facial animation. j-IEEE-CGA 2, 9 (nov 1982), 61-64, 66-68.
21. PIGHIN F., LEWIS J. P.: Facial motion retargeting. In SIGGRAPH '06: ACM SIGGRAPH 2006 Courses (New York, NY, USA, 2006), ACM Press, p. 2.
22. SIFAKIS E., SELLE A., ROBINSONMOSHER A., FEDKIW R.: Simulating speech with a physics-based facial muscle model. In SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation (Aire-la-Ville, Switzerland, Switzerland, 2006), Eurographics Association, pp. 261-270.
23. VLASIC D., BRAND M., PFISTER H., POPOVIĆ J. P.: Face transfer with multilinear models. ACM Trans. Graph. 24, 3 (2005), 426-433.
24. VASILESCU M. A. O., TERZOPOULOS D.: Multilinear analysis of image ensembles: Tensorfaces. In ECCV '02: Proceedings of the 7th European Conference on Computer Vision-Part I (London, UK, 2002), Springer-Verlag, pp. 447-460.
25. VASILESCU M. A. O., TERZOPOULOS D.: Tensortextures: multilinear image-based rendering. In SIGGRAPH '04: ACM SIGGRAPH 2004 Papers (New York, NY, USA, 2004), ACM Press, pp. 336-342.
26. WATERS K.: A muscle model for animation three-dimensional facial expression. In SIGGRAPH '87: Proceedings of the 14th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1987), ACM Press, pp. 17-24.
27. WILLIAMS L.: Performance-driven facial animation. In SIGGRAPH '90: Proceedings of the 17th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1990), ACMPress, pp. 235-242.
28. WANG H., WU Q., SHI L., YU Y., AHUJA N.: Out-of-core tensor approximation of multidimensional matrices of visual data. ACM Trans. Graph. 24, 3 (2005), 527-535.
29. XIANG CHAI J., XIAO J., HODGINS J.: Vision-based control of 3d facial animation. In SCA '03: Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation (Aire-la-Ville, Switzerland, Switzerland, 2003), Eurographics Association, pp. 193-206.
30. ZHANG L., SNAVELY N., CURLESS B., SEITZ S. M.: Spacetime faces: high resolution capture for modeling and animation. ACM Trans. Graph. 23, 3 (2004), 548-558.