Image-based talking heads using radial basis functions

Proceedings - Theory and Practice of Computer Graphics, TPCG 2003

Volumn , Issue , 2003, Pages 74-80

  Edge, J D ^a   Maddock, S ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Deformable models; Facial animation; Focusing; Head; Interpolation; Lattices; Muscles; Scattering; Speech synthesis; Synthesizers

Indexed keywords

ANIMATION; COMPUTER GRAPHICS; CRYSTAL LATTICES; FOCUSING; FUNCTIONS; HUMAN COMPUTER INTERACTION; INTERPOLATION; MUSCLE; RADIAL BASIS FUNCTION NETWORKS; SCATTERING; SPEECH; SPEECH SYNTHESIS;

DEFORMABLE MODELS; FACIAL ANIMATION; HEAD; HUMAN-COMPUTER DIALOGUES; RADIAL BASIS FUNCTIONS; SPEECH SYNTHESIS SYSTEM; SYNTHESIZED SPEECH; SYNTHESIZERS;

SPEECH INTELLIGIBILITY;

EID: 84942154593     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/TPCG.2003.1206933     Document Type: Conference Paper

References (31)

1. N. Arad, N. Dyn, D. Reisfeld, and Y. Yeshurun. Image warping by radial basis functions: Application to facial expressions. Computer Vision, Graphics, and Image Processing. Graphical Models and Image Processing, 56(2):161-172, 1994.
2. J. Barron, D. Fleet, S. Beauchemin, and T. Burkitt. Performance of optical flow techniques. CVPR, 92:236-242, 1992.
3. T. Beier and S. Neely. Feature-based image metamorphosis. Computer Graphics, 26(Annual Conference Series):35-42, 1992.
4. A. Black, P. Taylor, and R. Caley. The festival speech synthesis system. (http://www.cstr.ed.ac.uk/projects/festival/manual/festival-toc.html), June 1999.
5. C. Bregler, M. Covell, and M. Slaney. Video rewrite: Driving visual speech with audio. Computer Graphics, 31(Annual Conference Series):353-360, 1997.
6. N. Brooke and S. Scott. Two and three-dimensional audio visual speech synthesis. Proc. AVSP'98, 1998.
7. M. Cohen and D. Massaro. Modeling coarticulation in synthetic visual speech. Computer Animation '93, 1993.
8. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. Lecture Notes in Computer Science, 1407, 1998.
9. J. Edge and S. Maddock. Expressive visual speech using geometric muscle functions. Proc. Eurographics UK, pages 11-18, 2001.
10. T. Ezzat and T. Poggio. Visual speech synthesis by morphing visemes. Technical Report AIM-1658, MIT, 1999.
11. G. H. Golub and C. F. V. Loan. Matrix computations (3rd ed.). Johns Hopkins University Press, 1996.
12. A. Hyvärinen, J. Karhunen, and E. Oja. Independant Component Analysis. John Wiley and Sons Inc., 2001.
13. I. T. Jolliffe. Principal Component Analysis. Springer-Verlag, 1986.
14. K. Kähler, J. Haber, and H.-P. Siedel. Geometry-based muscle modeling for facial animation. Proc. Graphics Interface 2001, pages 37-46, 2001.
15. P. Kalra, A. Mangili, N. Magnenat-Thalmann, and D. Thalmann. Simulation of facial muscle actions based on rational free form deformations. Computer Graphics Forum (EUROGRAPHICS '92 Proceedings), 11(3):59-69, 1992.
16. S. King, R. Parent, and B. Olafsky. An anotomically-based 3d parametric lip model to support facial animation and synchronized speech. Proc. Deform 2000, pages 7-9, 2000.
17. R. Koenen. Overview of the mpeg-4 standard. Technical Report ISO/IEC JTC1/SC29/WG11 N2725, Moving Picture Experts Group, March 1999.
18. S.-Y. Lee, K.-Y. Chwa, and S. Y. Shin. Image metamorphosis using snakes and free-form deformations. Computer Graphics, 29(Annual Conference Series):439-448, 1995.
19. Y. Lee, D. Terzopoulos, and K. Waters. Realistic modeling for facial animation. Computer Graphics, 29(Annual Conference Series):55-62, 1995.
20. P. Litwinowicz and L. Williams. Animating images with drawings. Computer Graphics, 21(Annual Conference Series):409-412, 1994.
21. Z. Liu, Y. Shan, and Z. Zhang. Expressive expression mapping with ratio images. Computer Graphics, 35(Annual Conference Series):271-276, 2001.
22. A. Löfqvist. Speech as audible gestures. Speech Production and Speech Modelling, pages 289-322, 1990.
23. D. Massaro. Perceiving Talking Faces : From Speech Perception to a Behavioral Principle. Bradford Books Series in Cognitive Psychology. MIT Press, 1998.
24. S. E. G. Öhman. Numerical model of coarticulation. Journal of the Acoustical Society of America, 41:310-320, 1967.
25. F. I. Parke. A parametric model for human faces. Technical report, University of Utah, 1974.
26. F. I. Parke and K. Waters. Computer Facial Animation. A. K. Peters, Ltd., 1996.
27. S. M. Platt and N. I. Badler. Animating facial expressions. Computer Graphics, 15(Annual Conference Series):245-252, 1981.
28. L. Revéret, G. Bailly, and P. Badin. Mother : A new generation of talking heads providing a flexible articulatory control for video-realistic speech animation. 6th Int. Conference of Spoken Language Processing, ICSLP'2000, 2000.
29. D. Ruprecht, R. Nagel, and H. Müller. Spatial free-form deformation with scattered data interpolation methods. Computers and Graphics, 19(1):63-71, 1995.
30. W. Sumby and I. Pollack. Visual contribution to speech intelligibility in noise. The journal of the acoustical society of america, 26(2):212-215, 1954.
31. G. Wolberg. Image morphing: a survey. The Visual Computer, 14(8/9):360-372, 1998.