Video Rewrite: Driving visual speech with audio

Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1997

Volumn , Issue , 1997, Pages 353-360

  Bregler, Christoph ^a   Covell, Michele ^a   Slaney, Malcolm ^a  

^a Interval Research Corporation   (United States)

Author keywords

facial animation; lip sync

Indexed keywords

ANIMATION; COMPUTER GRAPHICS; SOUND RECORDING;

ASSEMBLY TASKS; COMPUTER VISION TECHNIQUES; FACIAL ANIMATION; HEAD POSITION; LIP SYNC; MORPHING TECHNIQUES; STITCHING PROCESS; VIDEO SEQUENCES;

INTERACTIVE COMPUTER GRAPHICS;

EID: 84942814785     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/258734.258880     Document Type: Conference Paper

References (26)

1. T. Beier, S. Neely. Feature-based image metamorphosis. Computer Graphics, 26(2):35-42, 1992. ISSN 0097-8930.
2. M.J. Black, Y. Yacoob. Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. Proc. IEEE Int. Conf. Computer Vision, Cambridge, MA, pp. 374-381, 1995. ISBN 0-8186-7042-8.
3. C. Bregler, S. Omohundro. Nonlinear manifold learning for visual speech recognition. Proc. IEEE Int. Conf. Computer Vision, Cambridge, MA, pp. 494-499, 1995. ISBN 0-8186-7042-8.
4. P.J. Burt, E.H. Adelson. A multiresolution spline with application to image mosaics. ACM Trans. Graphics, 2(4): 217-236, 1983. ISSN 0730-0301.
5. M.M. Cohen, D.W. Massaro. Modeling coarticulation in synthetic visual speech. In Models and Techniques in Computer Animation, ed. N.M Thalman, D. Thalman, pp. 139-156, Tokyo: Springer-Verlag, 1993. ISBN 0-3877-0124-9.
6. M. Covell, C. Bregler. Eigenpoints. Proc. Int. Conf. Image Processing, Lausanne, Switzerland, Vol. 3, pp. 471-474, 1996. ISBN 0-7803-3258-x.
7. T. Guiard-Marigny, A. Adjoudani, C. Benoit. A 3-D model of the lips for visual speech synthesis. Proc. ESCA/IEEE Workshop on Speech Synthesis, New Paltz, NY, pp. 49-52, 1994.
8. M. Kass, A. Witkin, D. Terzopoulos. Snakes: Active contour models. Int. J. Computer Vision, 1(4):321-331, 1987. ISSN 0920-5691.
9. M. Kirby, L. Sirovich. Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE PAMI, 12(1):103-108, Jan. 1990. ISSN 0162-8828.
10. L. F. Lamel, R. H. Kessel, S. Seneff. Speech database development: Design and analysis of the acoustic-phonetic corpus. Proc. Speech Recognition Workshop (DARPA), Report #SAIC-86/1546, pp. 100-109, McLean VA: Science Applications International Corp., 1986.
11. A. Lanitis, C.J. Taylor, T.F. Cootes. A unified approach for coding and interpreting face images. Proc. Int. Conf. Computer Vision, Cambridge, MA, pp. 368-373, 1995. ISBN 0-8186-7042-8.
12. J.Lewis. Automated lip-sync: Background and techniques. J.Visualization and Computer Animation, 2(4):118-122, 1991. ISSN 1049-8907.
13. P. Litwinowicz, L. Williams. Animating images with drawings. SIGGRAPH 94, Orlando, FL, pp. 409-412, 1994. ISBN 0-89791-667-0.
14. S. Morishima, H. Harashima. A media conversion from speech to facial image for intelligent man-machine interface. IEEE J Selected Areas Communications, 9 (4):594-600, 1991. ISSN 0733-8716
15. E. Moulines, P. Emerard, D. Larreur, J. L. Le Saint Milon, L. Le Faucheur, F. Marty, F. Charpentier, C. Sorin. A real-time French text-to-speech system generating high-quality synthetic speech. Proc. Int. Conf. Acoustics, Speech, and Signal Processing, Albuquerque, NM, pp. 309-312, 1990.
16. J.J. Ohala. The frequency code underlies the sound symbolic use of voice pitch. In Sound Symbolism, ed. L. Hinton, J. Nichols, J. J. Ohala, pp. 325-347, Cambridge UK: Cambridge Univ. Press, 1994. ISBN 0-5214-5219-8.
17. E. Owens, B. Blazek. Visemes observed by hearingimpaired and normal-hearing adult viewers. J. Speech and Hearing Research, 28:381-393, 1985. ISSN 0022-4685.
18. F. Parke. Computer generated animation of faces. Proc. ACM National Conf., pp. 451-457, 1972.
19. L. R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. In Readings in Speech Recognition, ed. A. Waibel, K. F. Lee, pp. 267-296, San Mateo, CA: Morgan Kaufmann Publishers, 1989. ISBN 1-5586-0124-4.
20. K.C. Scott, D.S. Kagels, S.H. Watson, H. Rom, J.R. Wright, M. Lee, K.J. Hussey. Synthesis of speaker facial movement to match selected speech sequences. Proc. Australian Conf. Speech Science and Technology, Perth Australia, pp. 620-625, 1994. ISBN 0-8642-2372-2.
21. J. Tenenbaum, W. Freeman. Separable mixture models: Separating style and content. In Advances in Neural Information Processing 9, ed. M. Jordan, M. Mozer, T. Petsche, Cambridge, MA: MIT Press, (in press).
22. M. Turk, A. Pentland. Eigenfaces for recognition. J. Cognitive Neuroscience, 3(1):71-86, 1991. ISSN 0898-929X
23. A. J. Viterbi. Error bounds for convolutional codes and an asymptotically optimal decoding algorithm. IEEE Trans. Informat. Theory, IT-13:260-269, 1967. ISSN 0018-9448.
24. K. Waters, T. Levergood. DECface: A System for Synthetic Face Applications. J. Multimedia Tools and Applications, 1 (4):349-366, 1995. ISSN 1380-7501.
25. L. Williams. Performance-Driven Facial Animation. Computer Graphics (Proceedings of SIGGRAPH 90), 24(4):235-242, 1990. ISSN 0097-8930.
26. A.L. Yuille, D.S. Cohen, P.W. Hallinan. Feature extraction from faces using deformable templates. Proc. IEEE Computer Vision and Pattern Recognition, San Diego, CA, pp. 104-109, 1989. ISBN 0-8186-1952-x.