EFASE: Expressive facial animation synthesis and editing with phoneme-isomap controls

Computer Animation, Conference Proceedings

Volumn 02-04-September-2006, Issue , 2006, Pages 251-260

  Deng, Zhigang ^a   Neumann, Ulrich ^b  

^a UNIVERSITY OF HOUSTON   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COST FUNCTIONS; DYNAMIC PROGRAMMING; INTERACTIVE COMPUTER GRAPHICS;

CONSTRAINED DYNAMICS; FACIAL ANIMATION; FACIAL MOTIONS; HARD CONSTRAINTS; NODE CONSTRAINTS; PHONEME-ISOMAP; SEARCH PROCESS; SOFT CONSTRAINT;

ANIMATION;

EID: 84981334718     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. [BBPV03] BLANZ V., BASSO C., POGGIO T., VETTER T.: Reanimating faces in images and video. Computer Graphics Forum 22, 3 (2003).
2. [BCS97] BREGLER C., COVELL M., SLANEY M.: Video rewrite: Driving visual speech with audio. Proc. of ACM SIGGRAPH' 97 (1997), 353-360.
3. [BDNN05] BUSSO C., DENG Z., NEUMANN U., NARAYANAN S.: Natural head motion synthesis driven by acoustic prosody features. Computer Animation and Virtual Worlds 16, 3-4 (July 2005), 283-290.
4. [Bra99] BRAND M.: Voice pupperty. Proc. of ACM SIGGRAPH' 99 (1999), 21-28.
5. [BV99] BLANZ V., VETTER T.: A morphable model for the synthesis of 3d faces. Proc. of ACM SIGGRAPH'99 (1999), 187-194.
6. [CB05] CHUANG E., BREGLER C.: Moodswings: Expressive speech animation. ACM Trans. on Graph. 24, 2 (2005).
7. [CDB02] CHUANG E. S., DESHPANDE H., BREGLER C.: Facial expression space learning. In Proc. of Pacific Graphics'2002 (2002), pp. 68-76.
8. [CFKP04] CAO Y., FALOUTSOS P., KOHLER E., PIGHIN F.: Real-time speech motion synthesis from recorded motions. In Proc. of Symposium on Computer Animation (2004), pp. 345-353.
9. [CG00] COSATTO E., GRAF H. P.: Audio-visual unit selection for the synthesis of photo-realistic talking-heads. In Proc. of ICME (2000), pp. 619-622.
10. [CM93] COHEN M. M., MASSARO D. W.: Modeling coarticulation in synthetic visual speech. Models and Techniques in Computer Animation, Springer Verlag (1993), 139-156.
11. [CXH03] CHAI J., XIAO J., HODGINS J.: Vision-based control of 3d facial animation. In Proc. of Symposium on Computer Animation (2003), ACM Press, pp. 193-206.
12. [DCFN06] DENG Z., CHIANG P. Y., FOX P., NEUMANN U.: Animating blendshape faces by cross-mapping motion capture data. In Proc. of ACM SIGGGRAPH Symposium on Interactive 3D Graphics and Games (2006), pp. 43-48.
13. [DLN05] DENG Z., LEWIS J. P., NEUMANN U.: Synthesizing speech animation by learning compact speech co-articulation models. In Proc. of Computer Graphics International (2005), pp. 19-25.
14. [DNL06] DENG Z., NEUMANN U., LEWIS J. P., KIM T. Y., BULUT M., NARAYANAN S.: Expressive facial animation synthesis by learning speech co-articulations and expression spaces. IEEE Trans. Vis. Graph. 12, 6 (2006).
15. [EGP02] EZZAT T., GEIGER G., POGGIO T.: Trainable videorealistic speech animation. ACM Trans. Graph. (2002), 388-398.
16. [fes04], http://www.cstr.ed.ac.uk/projects/festival/, 2004.
17. [GGW98] GUENTER B., GRIMM C., WOOD D., MALVAR H., PIGHIN F.: Making faces. Proc.of ACM SIGGRAPH'98 (1998), 55-66.
18. [JTDP03] JOSHI P., TIEN W. C., DESBRUN M., PIGHIN F.: Learning controls for blend shape based realistic facial animation. In Proc. of Symposium on Computer animation (2003), pp. 187-192.
19. [KGT00] KSHIRSAGAR S., GARCHERY S., THALMANN N. M.: Feature point based mesh deformation applied to mpeg-4 facial animation. In Proc. Deform'2000, Workshop on Virtual Humans by IFIP Working Group 5.10 (November 2000), pp. 23-34.
20. [KHS01] KÄHLER K., HABER J., SEIDEL H. P.: Geometrybased muscle modeling for facial animation. In Proc. of Graphics Interface'2001 (2001).
21. [KP05] KING S. A., PARENT R. E.: Creating speechsynchronized animation. IEEE Trans. Vis. Graph. 11, 3 (2005), 341-352.
22. [KT03] KSHIRSAGAR S., THALMANN N. M.: Visyllable based speech animation. Computer Graphics Forum 22, 3 (2003).
23. [Lew91] LEWIS J. P.: Automated lip-sync: Background and techniques. Journal of Visualization and Computer Animation (1991), 118-122.
24. [LTW95] LEE Y. C., TERZOPOULOS D., WATERS K.: Realistic modeling for facial animation. Proc. of ACM SIGGRAPH'95 (1995), 55-62.
25. [MCP05] MA J., COLE R., PELLOM B., WARD W., WISE B.: Accurate visible speech synthesis based on concatenating variable length motion capture data. IEEE Transaction on Visualization and Computer Graphics (online) (2005).
26. [NN01] NOH J. Y., NEUMANN U.: Expression cloning. Proc. of ACM SIGGRAPH'01 (2001), 277-288.
27. [Pel91], PELACHAUD C.: Communication and coarticulation in facial animation. Ph.D, Thesis, Univ. of Pennsylvania (1991).
28. [PHL98], PIGHIN F., HECKER J., LISCHINSKI D., SZELISKI R., SALESIN D. H.: Synthesizing realistic facial expressions from photographs. Proc. Of ACM SIGGRAPH'98 (1998), 75-84.
29. [PKC03] PYUN H., KIM Y., CHAE W., KANG H. W., SHIN S. Y.: An example-based approach for facial expression cloning. In Proc. of Symposium on Computer Animation (2003), pp. 167-176.
30. [PW96] PARKE F. I., WATERS K.: Computer Facial Animation. A K Peters, Wellesley, Massachusets, 1996.
31. [SHP04] SAFONOVA A., HODGINS J. K., POLLARD N. S.: Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. ACM Trans. Graph. 23, 3 (2004), 514-521.
32. [SNF05] SIFAKIS E., NEVEROV I., FEDKIW R.: Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Trans. Graph. 24, 3 (2005), 417-425.
33. [TSL00] TENENBAUM J., SILVA V. D., LANGFORD J.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500 (2000), 2319-2333.
34. [VBPP05] VLASIC D., BRAND M., PFISTER H., POPOVÍC J.: Face transfer with multilinear models. ACM Trans. Graph. 24, 3 (2005), 426-433.
35. [WF95] WATERS K., FRISBLE J.: A coordinated muscle model for speech animation. Proc. of Graphics Interface'95 (1995), 163-170.
36. [Wil90] WILLIAMS L.: Performance-driven facial animation. In Proc. of ACM SIGGRAPH '90 (1990), ACM Press, pp. 235-242.
37. [ZLGS03] ZHANG Q., LIU Z., GUO B., SHUM H.: Geometrydriven photorealistic facial expression synthesis. In Proc. of Symposium on Computer Animation (2003), pp. 177-186.
38. [ZSCS04],ZHANG L., SNAVELY N., CURLESS B., SEITZ S., M.: Spacetime faces: high resolution capture for modeling and animation. ACM Trans. Graph. 23, 3 (2004), 548-558.