Three-dimensional facial adaptation for MPEG-4 talking heads

Eurasip Journal on Applied Signal Processing

Volumn 2002, Issue 10, 2002, Pages 1005-1020

  Grammalidis, Nikos ^a,b   Sarris, Nikos ^b   Deligianni, Fani ^a,b   Strintzis, Michael G ^a,b,c,d  

^a INFORMATION TECHNOLOGIES INSTITUTE   (Greece)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^c UNIVERSITY OF PITTSBURGH   (United States)

^d Informatics and Telematics Research Institute   (Greece)

Author keywords

3D model based coding; Facial adaptation; MPEG 4; Talking face; Text to speech

Indexed keywords

ANIMATION; MAN MACHINE SYSTEMS; SPEECH SYNTHESIS; VIRTUAL REALITY;

THREE-DIMENSIONAL FACIAL ADAPTATION;

FACE RECOGNITION;

EID: 0036822658     PISSN: 11108657     EISSN: None     Source Type: Journal    
DOI: 10.1155/S1110865702206113     Document Type: Article

References (29)

1. P. Eisert and B. Girod, "Analyzing facial expressions for virtual conferencing," IEEE Computer Graphics and Applications, vol. 18, no. 5, pp. 70-78, 1998.
2. Y. Lee, D. Terzopoulos, and K. Waters, "Realistic modeling for facial animation," in Computer Graphics (Proc. SIGGRAPH '95), pp. 55-62, Los Angeles, Calif, USA, August 1995.
3. F. Lavagetto and R. Pockaj, "The facial animation engine: toward a high-level interface for the design of MPEG-4 compliant animated faces," IEEE Trans. Circuits and Systems for Video Technology, vol. 9, no. 2, pp. 277-289, 1999.
4. R. Pockaj, M. Costa, F. Lavagetto, and C. Braccini, "MPEG-4 facial animation: an implementation," in Proc. International Workshop on Synthetic-Natural Hybrid Coding and 3-D Imaging, pp. 33-36, Santorini, Greece, September 1999.
5. W.-S. Lee, M. Escher, G. Sannier, and N. Magnenat-Thalmann, "MPEG-4 compatible faces from orthogonal photos," in International Conference on Computer Animation, pp. 186-194, Geneva, Switzerland, May 1999.
6. L. Moccozet and N. Magnenat-Thalmann, "Dirichlet free-form deformations and their application to hand simulation," in International Conference on Computer Animation, pp. 93-102, IEEE Computer Society, Geneva, Switzerland, 1997.
7. T. Sederberg and S. R. Parry, "Free form deformation of solid geometric models," in Proc. SIGGRAPH '86, pp. 151-160, Dallas, Tex, USA, August 1986.
8. F. Pighin, J. Auslander, D. Lischinski, D. Salesin, and R. Szeliski, "Realistic facial animation using image based 3D morphing," Tech. Rep. UW-CSE-97-01-03, University of Washington, Seattle, Wash, USA, May 1997.
9. L. Zhang, "Automatic adaptation of a face model using action units for semantic coding of videophone sequences," IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 6, pp. 781-795, 1998.
10. T. Dutoit, An Introduction to Text-To-Speech Synthesis, Kluwer Academic, Dordrecht, Netherlands, 1996.
11. Digimask - The Face of the Future, http://www.digimask.com.
12. LifeFX - The face of the Internet, http://www.lifefx.com.
13. N. M. Brooke, "Computer graphics synthesis of talking faces," in Talking Machines: Theories, Models, and Designs, G. Bailly, C. Benot, and T. R. Sawallis, Eds., pp. 505-522, North Holland, Elvsevier, Amsterdam, 1992.
14. B. DeGraph and M. Wahrman, "Mike, the talking head," Computer Graphics, vol. 11, pp. 15-17,1988.
15. J. Ostermann, M. Beutnagel, A. Fischer, and Y. Wang, "Integration of talking heads and text-to-speech synthesizers for visual TTS," in Proc. 5th International Conference on Spoken Language Processing (ICSLP-98), Sydney, Australia, November 1998.
16. MBROLA project, http://tcts.fpms.ac.be/synthesis/mbrola.html.
17. MBRDICO project, http://tcts.fpms.ac.be/synthesis/mbrdico/.
18. A. Al-Qayedi and A. F. Clark, "An algorithm for face and facial-feature location based on grey-scale information and facial geometry," in Proc. IEEE International Conference on Image Processing and its Applications, vol. 2, pp. 625-629, Manchester, UK, July 1999.
19. T. C. Chang and T. S. Huang, "Facial feature extraction from color images," in 12th International Conference on Pattern Recognition, vol. 2, pp. 39-43, Israel, October 1994.
20. M. Reinders, P. J. L. van Beek, B. Sankur, and J. C. A. van der Lubbe, "Facial feature localization and adaptation of a generic face model for model based-coding," Signal Processing: Image Communication, vol. 7, no. 1, pp. 57-74,1995.
21. N. Sarris and M. G. Strintzis, "Construction of a 3D facial model from two image views," in IEEE International Symposium on Intelligent Signal Processing and Communication Systems, Honolulu, Hawaii, November 2000.
22. R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, vol. II, Addison-Wesley, Reading, Mass, USA, 1993.
23. K. Levenberg, "A method for the solution of certain nonlinear problems in least squares," Quart. Appl. Math., vol. 2, no. 2, pp. 164-168, 1944.
24. D. W. Marquardt, "An algorithm for least squares estimation of non-linear parameters," SIAM J. Appl. Math., vol, 11, pp. 431-441, 1963.
25. The minpack library, Netlib repository, http://www.netlib.org/minpack/.
26. G. A. Abrantes and F. Pereira, "MPEG-4 facial animation technology: survey, implementation, and results," IEEE Trans. Circuits and Systems for Video Technology, vol. 9, no. 2, pp. 290-305, 1999.
27. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. H. Salesin, "Synthesizing realistic facial expressions from photographs," Computer Graphics, vol. 32, pp. 75-84, August 1998, Annual Conference Series.
28. Esopos, Hellenic TTS System, http://esopos.ee.auth.gr.
29. V. Pagel, K. Lenzo, and A. W. Black, "Letter to sound rules for accented lexicon compression," in Proc. 5th International Conference on Spoken Language Processing (ICSLP-98), Sydney, Australia, November 1998.