Semantic 3D motion retargeting for facial animation

Proceedings - APGV 2006: Symposium on Applied Perception in Graphics and Visualization

Volumn , Issue , 2006, Pages 77-84

  Curio, Cristóbal ^a   Breidt, Martin ^a   Kleiner, Mario ^a   Vuong, Quoc C ^a   Giese, Martin A ^b   Bülthoff, Heinrich H ^a  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

Author keywords

Facial animation; Facial motion; Human perception; Motion retargeting; Performance capture

Indexed keywords

DATA ACQUISITION; INFORMATION ANALYSIS; OPTICAL RESOLVING POWER; SENSORY PERCEPTION; THREE DIMENSIONAL;

FACIAL ACTION CODING SYSTEM; PERCEIVED NATURALNESS; REALISTIC FACIAL ANIMATION; SEMANTICALLY MEANINGFUL MOTION CHANNELS;

ANIMATION;

EID: 34250787450     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1140491.1140508     Document Type: Conference Paper

References (29)

1. ARUN, K. S., HUANG, T. S., AND BLOSTEIN, S. D. 1987. Least-squares fitting of two 3-d point sets. IEEE Trans Pattern Anal Machine Intell 9, 698-700.
2. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3d faces. In S1GGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 187-194.
3. BLANZ, V., BASSO, C., POGGIO, T., AND VETTER, T. 2003. Reanimating faces in images and video. Comput. Graph. Forum 22, 3, 641-650.
4. BRAINARD, D. H. 1997. The psychophysics toolbox. Spatial Vision 10, 433-436.
5. BREIDT, M., WALLRAVEN, C., CUNNINGHAM, D. W., AND BÜLTHOFF, H. H. 2003. Facial animation based on 3d scans and motion capture. In SIGGRAPH '03 Sketches & Applications, ACM Press, New York, NY, USA, N. Campbell, Ed.
6. CHOE, B., AND KO, H.-S. 2001. Analysis and synthesis of facial expressions with hand-generated muscle actuation basis. In Proceedings of Computer Animation, 12-19.
7. CHUANG, E., AND BREGLER, C. 2005. Mood swings: expressive speech animation. ACM Trans. Graph. 24, 2, 331-347.
8. CUNNINGHAM, D. W., KLEINER, M., BÜLTHOFF, H. H., AND WALLRAVEN, C. 2004. The components of conversational facial expressions. In APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualization, ACM Press, New York, NY, USA, 143-150.
9. EISERT, P., AND GIROD, B. 1998. Analyzing facial expressions for virtual conferencing. IEEE Comput. Graph. Appl. 18, 5, 70-78.
10. EKMAN, P., AND FRIESEN, W. V. 1978. Facial Action Coding System: A Technique for the Measurements of Facial Movement. Palo Alto, CA, USA.
11. ESSA, I., AND PENTLAND, A. 1994. A vision system for observing and extracting facial action parameters. In Computer Vision and Pattern Recognition Conference, 76-83.
12. EZZAT, T., GEIGER, G., AND POGGIO, T. 2002. Trainable videorealistic speech animation. In SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 388-398.
13. GEIGER, G., EZZAT, T., AND POGGIO, T. 2003. CBCL paper #224/ AI memo #2003-003. Tech. rep., Massachusetts Institute of Technology, Cambridge, MA, USA.
14. GUENTER, B., GRIMM, C., WOOD, D., MALVAR, H., AND PIGHIN, R 1998. Making faces. In Proceedings of SIGGRAPH 98, Addison Wesley, M. Cohen, Ed., Annual Conference Series, Addison Wesley, 55-66.
15. HILL, H., AND JOHNSTON, A. 2001. Categorizing sex and identity from the biological motion of faces. Current Biology 11, 11, 880-885.
16. JOSHI, P., TIEN, W. C., DESBRUN, M., AND PIGHIN, F. 2003. Learning controls for blend shape based realistic facial animation. In SCA '03: Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 187-192.
17. KALBERER, G. A., AND GOOL, L. V. 2002. Realistic face animation for speech. Journal of Visualization and Computer Animation 13, 97-106.
18. KLEINER, M., SCHWANINGER, A., CUNNINGHAM, D. W., AND KNAPPMEYER, B. 2004. Using facial texture manipulation to study facial motion perception. In APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualization, ACM Press, New York, NY, USA, 180.
19. KNAPPMEYER, B., THORNTON, I., AND BÜLTHOFF, H. H. 2001. Facial motion can determine facial identity. J. Vis. 1, 3 (12), 338a.
20. KNAPPMEYER, B., GIESE, M., AND BÜLTHOFF, H. H. 2003. Spatio-temporal caricature effects for facial motion. J. Vis. 3, 9 (10), 304.
21. LIEN, J.-J. J., KANADE, T., COHN, J., AND LI, C.-C. 1998. Automated facial expression recognition based on facs action units. In Third IEEE International Conference on Automatic Face and Gesture Recognition, 390-395.
22. PARKE, F. I. 1972. Computer generated animation of faces. PhD thesis, University of Utah, Salt Lake City.
23. PIGHIN, F., SZELISKI, R., AND SALESIN, D. H. 2002. Modeling and animating realistic faces from images. International Journal of Computer Vision 50, 2 (November), 143-169.
24. SIFAKIS, E., NEVEROV, I., AND FEDKIW, R. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Trans. Graph. 24, 3, 417-425.
25. TIAN, Y.-L., KANADE, T., AND COHN, J. 2000. Recognizing lower face action units for facial expression analysis. In Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG'00), 484-490.
26. TROJE, N. F., AND BÜLTHOFF, H. H. 1996. Face recognition under varying poses: The role of texture and shape. Vision Research 36, 1761-1771.
27. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ, J. 2005. Face transfer with multilinear models. ACM Trans. Graph. 24, 3, 426-433.
28. WALLRAVEN, C., BREIDT, M., CUNNINGHAM, D. W., AND BÜLTHOFF, H. H. 2005. Psychophysical evaluation of animated facial expressions. In APGV '05: Proceedings of the 2nd symposium on Applied perception in graphics and visualization, ACM Press, New York, NY, USA, 17-24.
29. WILLIAMS, L. 1990. Performance-driven facial animation. In SIGGRAPH '90: Proceedings of the 17th annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 235-242.