Compression of MPEG-4 facial animation parameters for transmission of talking heads

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 9, Issue 2, 1999, Pages 264-276

  Tao, Hai ^a,b   Chen, Homer H ^a,c   Wu, Wei ^c   Huang, Thomas S ^a,d  

^a IEEE

^b SARNOFF CORPORATION   (United States)

^c ROCKWELL SCIENCE CENTER   (United States)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMATION; COMMUNICATION CHANNELS (INFORMATION THEORY); IMAGE COMMUNICATION SYSTEMS; INTERPOLATION; MATHEMATICAL MODELS; MATHEMATICAL TRANSFORMATIONS; PARAMETER ESTIMATION;

BIT RATE REDUCTION; FACIAL ANIMATION PARAMETER; MPEG 4; PRINCIPAL COMPONENT ANALYSIS; SYNTHETIC NATURAL HYBRID CODING;

IMAGE COMPRESSION;

EID: 0033097118     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/76.752094     Document Type: Article

References (33)

1. "Text for CD 14496-2 video," ISO/IEC JTC1/SC29/WG11 N1902, Nov. 1997.
2. C. S. Choi, K. Aizawa, H. Harashima, and T. Takebe, "Analysis and synthesis of facial image sequences in model-based image coding," IEEE Trans. Circuits Syst. Video Technol., vol. 4, pp. 257-275, June 1994.
3. T. Fukuhara and T. Murakami, "3-D motion estimation of human head for model-based image coding," Proc. Inst. Elect. Eng., vol. 140, no. 1, pp. 26-35, Feb. 1993.
4. K. Nagao and A. Takeuchi, "Speech dialogue with facial displays: Multimodal human-computer conversation," in Proc. 32nd Annu. Meeting Association for Computational Linguistics (ACL'94), 1994, pp. 102-109.
5. F. I. Parke and K. Waters, Computer Facial Animation. Wellesley, MA: Peters, 1996.
6. N. M. Thalmann, H. T. Minh, M. de Angelis, and D. Thalmann, "Design, transformation and animation of human faces," Visual Comput., vol. 5, no. 1/2, pp. 32-39, Mar. 1989.
7. N. M. Thalmann and D. Thalmann, "Complex models for animating synthetic actors," IEEE Comput. Graph. Appl. Mag., vol. 11, no. 5, pp. 32-44, Sept. 1991.
8. P. Doenges, T. K. Capin, F. Lavagetto, J. Ostermann, I. S. Pandzic, and E. D. Petajan, "MPEG-4: Audio/video & synthetic graphics/audio for mixed media," Signal Process.: Image Commun., vol. 9, no. 4, pp. 433-464, May 1997.
9. R. Koenen, F. Pereira, and C. Chiariglione, "MPEG-4: Context and objectives," Signal Process.: Image Commun., vol. 9, no. 4, pp. 295-304, May 1997.
10. "MPEG-4 video verification model 2.0," ISO/IEC JTC1/SC29/WG11 N1260, Mar. 1996.
11. P. Ekman and W. V. Friesen, Facial Action Coding System. Palo Alto, CA: Consulting Psychologists Press, 1977.
12. P. Kalra, A. Mangili, N. M. Thalmann, and D. Thalmann, "Smile: A multilayered facial animation system," in Proc. IFIP Conf. Modeling in Computer Graphics, 1991, pp. 189-198.
13. F. I. Parke, "Computer generated animation of faces," in Proc. ACM Annual Conf., Aug. 1972, pp. 451-457.
14. _, "Parameterized models for facial animation - revisited," in State of the Art in Facial Animation, ACM SIGGRAPH 89 Course Notes, 1989, pp. 43-56.
15. _, "Parameterized models for facial animation," IEEE Comput. Graph. Appl. Mag., vol. 2, no. 9, pp. 61-68, Nov. 1982.
16. N. M. Thalmann, N. E. Primeau, and D. Thalmann, "Abstract muscle action procedures for human face animation," Visual Comput., vol. 3, no. 5, pp. 290-297, Mar. 1988.
17. Y. Lee, D. Terzopoulos, and K. Waters, "Realistic modeling for facial animation," in Proc. SIGGRAPH'95, 1995, pp. 55-62.
18. S. M. Platt, "Animating facial expressions," in Proc. SIGGRAPH'81, Aug. 1981, pp. 245-252.
19. D. Terzopoulos and K. Waters, "Analysis and synthesis of facial image sequences using physical and anatomical models," in Proc. 3rd Int. Conf. Comput. Vision (ICCV'90), Osaka, Japan, Dec. 1990, pp. 727-732.
20. K. Waters, "A muscle model for animating three-dimensional facial expression," in Proc. SIGGRAPH'87, July 1987, pp. 17-24.
21. P. Kalra, A. Mangili, N. M. Thalmann, and D. Thalmann, "Simulation of facial muscle actions based on rational free form deformations," in Proc. EUROGRAPHICS'92, Sept. 1992, pp. 59-69.
22. L. Williams, "Performance-driven facial animation," in Proc. SIGGRAPH'90, Aug. 1990, pp. 235-242.
23. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin, "Making faces," in Proc. SIGGRAPH 98, 1998, pp. 55-66.
24. H. Li, P. Roivainen, and R. Forchheimer, "3-D motion estimation in model-based facial image coding," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, pp. 545-555, June 1993.
25. I. Essa and A. Pentland, "Coding, analysis, interpretation and recognition of facial expressions," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 757-763, July 1997.
26. D. DeCarlo and D. Metaxas, "The integration of optical flow and deformable models with applications to human face shape and motion estimation," in Proc. CVPR'96, 1996, pp. 231-238.
27. H. Tao, R. Lopez, and T. S. Huang, "Facial feature tracking under varying pose using Bayesian nets," in Proc. Int. Workshop Coding Tech. for Very Low Bit-Rate Video (VLBV'97), Linkoping, Sweden, July 1997, pp. 65-68.
28. "Text for CD 14496-1 systems," ISO/IEC JTC1/SC29/WG11 N1901, Nov. 1997.
29. "FAP interpolation table (FIT)," ISO/IEC JTC1/SC29/WG11 MPEG97/M2599, Aug. 1997.
30. L. Sirovich and R. Everson, "Management and analysis of large scientific datasets," Int. J. Supercomput. Appl., vol. 6, no. 1, pp. 50-68, Spring 1992.
31. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
32. K. Jain, Fundamentals of Digital Image Processing. Englewood Cliffs, NJ: Prentice-Hall, 1989.
33. H. Tao, H. Chen, and T. S. Huang, "Analysis and compression of facial animation parameter set (FAP's)," in Proc. IEEE Workshop Multimedia Signal Process (MMSP'97), June 1997, pp. 245-250.