Shape and appearance models of talking faces for model-based tracking

AVSP 2003 - International Conference on Audio-Visual Speech Processing

Volumn , Issue , 2003, Pages 105-110

  Odisio, Matthias ^a   Bailly, Gérard ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH PROCESSING; SPEECH RECOGNITION;

ANALYSIS BY SYNTHESIS; APPEARANCE MODELS; FACE GEOMETRY; FACE MODELS; FACIAL DEFORMATIONS; MODEL-BASED TRACKING; MODELING PARAMETERS; MONOCULAR SEQUENCES; SHAPE AND APPEARANCE MODEL; TRACKING MODELS;

TEXTURES;

EID: 77953181722     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. F. I. Parke, “Parameterized models for facial animation,” IEEE Comp. Graphics & Applications, vol. 2, pp. 61-68, Nov. 1982.
2. M. Rydfalk, “CANDIDE, a parameterized face,” Dept. of Electrical Engineering, Linköping University, Tech. Rep. LiTH-ISY-I-866, 1987.
3. D. Terzopoulos and K. Waters, “Analysis and synthesis of facial image sequences using physical and anatomical models,” IEEE PAMI, vol. 15, no. 6, pp. 569-579, June 1993.
4. S. Basu, N. Oliver, and A. Pentland, “3D lip shapes from video: A combined physical-statistical model,” Speech Communication, vol. 26, pp. 131-148, 1998.
5. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin, “Making faces,” in Proc. of SIGGRAPH, July 1998, pp. 55-66.
6. B. J. Theobald, J. A. Bangham, I. Matthews, and G. C. Cawley, “Visual speech synthesis using statistical models of shape and appearance,” in Proc. of AVSP, 2001, pp. 78-83.
7. P. Hong, Z. Wen, and T. S. Huang, “Real-time speech-driven face animation,” in MPEG-4 Facial Animation. The Standard, Implementation and Applications., I. S. Pandzic and R. Forchheimer, Eds. Wiley, 2002, ch. 7, pp. 115-124.
8. L. Bretzner and T. Lindeberg, “Qualitative multi-scale feature hierarchies for object tracking,” in Proc. of Scale-Space, Corfu, Greece, Sept. 1999, pp. 117-128.
9. J. Ström, T. Jebara, S. Basu, and A. Pentland, “Real time tracking and modeling of faces: an EKF-based analysis by synthesis approach,” in Proc. of ICCV, Corfu, Greece, Sept. 1999.
10. H. Li, P. Roivainen, and R. Forchheimer, “3-D motion estimation in model-based facial image coding,” IEEE PAMI, vol. 15, no. 6, pp. 545-555, June 1993.
11. D. DeCarlo and D. Metaxas, “Optical flow constraints on deformable models with applications to face tracking,” IJCV, vol. 38, no. 2, pp. 99-127, July 2000.
12. P. Eisert and B. Girod, “Analyzing facial expressions for virtual conferencing,” IEEE Comp. Graphics & Applications, vol. 18, no. 5, pp. 70-78, Sept. 1998.
13. M. La Cascia, S. Sclaroff, and V. Athitsos, “Fast, reliable head tracking under varying illumination: an approach based on registration of texture-mapped 3D models,” IEEE PAMI, vol. 22, no. 4, pp. 322-336, Apr. 2000.
14. F. Pighin, R. Szeliski, and D. H. Salesin, “Modeling and animating realistic faces from images,” IJCV, vol. 50, no. 2, pp. 143-169, Nov. 2002.
15. S. Romdhani, V. Blanz, and T. Vetter, “Face identification by fitting a 3D morphable model using linear shape and texture error functions,” in Proc. of ECCV, Copenhagen, Denmark, May 2002, pp. 3-19.
16. F. Elisei, M. Odisio, G. Bailly, and P. Badin, “Creating and controlling video-realistic talking heads,” in Proc. of AVSP, Aalborg, Denmark, Sept. 2001, pp. 90-97.
17. P. Badin, G. Bailly, L. Revéret, M. Baciu, C. Segebarth, and C. Savariaux, “Three-dimensional articulatory modeling of tongue, lips and face, based on MRI and video images,” J. of Phonetics, vol. 30, no. 3, pp. 533-553, 2002.
18. M. Bérar, G. Bailly, M. Chabanas, F. Elisei, M. Odisio, and Y. Payan, “Towards a generic talking head,” in Proc. of ISSP, Sydney, Australia, Dec. 2003.
19. S. Yan, C. Liu, S. Li, H. Zhang, H. Shum, and Q. Cheng, “Texture-constrained active shape models,” in Proc. of Int. W. on Generative-Model-Based Vision, Copenhagen, Denmark, May 2002.
20. T. Lindeberg, “Feature detection with automatic scale selection,” IJCV, vol. 30, no. 2, pp. 77-116, 1998.
21. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C, 2nd ed. Cambridge University Press, 1992.
22. J. Robert-Ribes, J.-L. Schwartz, T. Lallouache, and P. Escudier, “Complementarity and synergy in bimodal speech: Auditory, visual and audio-visual identification of french oral vowels in noise,” JASA, vol. 103, no. 6, pp. 3677-3689, June 1998.
23. C. S. Wiles, A. Maki, and N. Matsuda, “Hyperpatches for 3D model acquisition and tracking,” IEEE PAMI, vol. 23, no. 12, pp. 1391-1403, Dec. 2001.
24. G. Bailly, G. Gibert, and M. Odisio, “Evaluation of movement generation systems using the point-light technique,” in IEEE Workshop on Speech Synthesis, Santa Monica, USA, Sept. 2002.