Sample-based synthesis of photo-realistic talking heads

Proceedings - Computer Animation, CA 1998

Volumn , Issue , 1998, Pages 103-110

  Cosatto, E ^a   Graf, H P ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

face recognition and location samplebased coarticulation; photorealistic rendering; sample based synthesis; Talking head synthesis

Indexed keywords

ANIMATION; APPLICATION PROGRAMS; EYE MOVEMENTS; HUMAN COMPUTER INTERACTION; SPEECH SYNTHESIS;

AUTOMATIC EXTRACTION; CO-ARTICULATION; FACIAL RECOGNITION; HUMAN MACHINE INTERFACE; PHOTO-REALISTIC VIDEO; PHOTOREALISTIC RENDERING; TALKING HEADS; TEXT TO SPEECH SYNTHESIZERS;

FACE RECOGNITION;

EID: 84872004031     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CA.1998.681914     Document Type: Conference Paper

References (24)

1. J. Ostermann, A. Puri, Natural and Synthetic video in MPEG-4, Proc. of ICASSP 1998.
2. Frederic I. Parke, Keith Waters, Computer Facial Animation, A.K. Peters, Wellesley, Massachussets, 1997.
3. N. Magnenat-Thalmann, P. Primeau, D. Thalmann, Abstract Muscle Action Procedures for Face Animation, Visual Computing. 3, 1988, 290-297.
4. D. Terzopoulos, K. Waters, Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models, IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 15/6, pp. 569-579, 1993.
5. J. Ostermann, L.S. Chen, and T.S. Huang, Animated Talking Head with Personalized 3D Head Model, to be published 1998.
6. M. Escher and N.M. Thalmann, Automatic 3D Cloning and Real-Time Animation of a Human Face, Proceedings of IEEE Computer Animation 97, pp. 58 - 66.
7. S. Morishima, H. Harashima, A Media Conversion from Speech to Facial Image for Intelligent Man-Machine Interface, IEEE J. Selected Areas in Communications, 9, 1991, pp. 594-600.
8. T. Kuratate, F. Garcia, H. Yehia, E. Vatikiotis-Bateson, Facial Animation from 3D Kinematics, ASJ, Sept 1997, Sapporo.
9. C. Bregler, M. Covell, M. Slaney, Video Rewrite: Driving Visual Speech with Audio, Proc. SIGGRAPH'97, pp.353-360.
10. G. Wolberg, Digital Image Warping, IEEE Computer Society Press, Los Alamitos, CA, 1990.
11. S.M. Seitz, and C.R. Dyer, View Morphing, Proc. SIGGRAPH 96, pp. 21-30.
12. N. Arad, N. Dyn, D. Reisfeld, and Y. Yshurun, Image Warping by Radial Basis Functions: Applications to Facial Expressions, CVGIP: Graphical Models and Image Processing, 56, 1994, pp. 161-172.
13. D. Beymer and T. Poggio, Image Representation for Visual Learning, Science, 28 June 1996, vol 272, pp1905-1909.
14. T. Beier, and S. Neely, Feature-Based Image Metamorphosis, Computer Graphics, 26, 1992, pp. 35-42.
15. T. Ezzat and T. Poggio, Facial Analysis and Synthesis Using Image-Based Models, Proc. 2nd Int. Conf. on Automatic Face and Gesture Recognition, IEEE CS Press, 1996, pp.116- 121.
16. M. Bichsel, Automatic Interpolation and Recognition of Faces by Morphing, Proc. 2nd Int. Conf. on Automatic Face and Gesture Recognition, IEEE CS Press, 1996, pp.128-135.
17. P. Ekman, and W. Friesen, Facial Action Coding System: A Technique for the Measurement of Facial Movement; Consulting Psychologists Press, Palo Alto, CA, 1978.
18. T. Horprasert, Y. Yacoob, L. Davis, Computing 3D Head Orientation from a monocular image sequence; Proc. 2nd Int. Conf. on Automatic Face and Gesture Recognition, IEEE CS Press, 1996, pp.242-247.
19. D. Oberkampf, D. Dementhon, L. Davis, Iterative Pose Estimation Using Coplanar Feature Points; Internal Report, CVL, CAR-TR-677, University of Maryland.
20. M.M. Cohen, D.W. Massaro, Modeling Coarticulation in Synthetic Visual Speech, in: Models and Techniques in Computer Animation, M. Magnenat-Thalmann and D. Thalmann (eds.), Tokyo, 1993, Springer Verlag.
21. D.G. Stork and M.E. Hennecke (eds.), Speechreading by Humans and Machines, Springer, Berlin, 1996.
22. Proc. Audio-Visual Speech Processing, C. Benoit and R. Campbell (eds.), Rhodes, Greece, 1997.
23. H.P. Graf, E. Cosatto, D. Gibbon, M. Kocheisen, and E. Petajan, Multi-Modal System for Locating Heads and Faces, Proc. 2nd Int. Conf. Automatic Face and Gesture Recognition, IEEE Computer Soc. Press, 1996; pp. 88-93.
24. G. Potamianos, E. Cosatto, H.P. Graf, and D.B. Roe, Speaker Independent Audio-Visual Database for Bimodal ASR, Proc. Audio-Visual Speech Processing: 1997, pp.65-68.