Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 15, Issue 6, 1993, Pages 569-579

  Terzopoulos, Demetri ^a   Waters, Keith ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b HEWLETT PACKARD COMPANY   (United States)

Author keywords

Computer graphics; computer vision; deformable; face modeling; facial image analysis; facial image synthesis; models; nonrigid motion analysis; physics based modeling; snakes; tracking

Indexed keywords

COMPUTER VISION; HUMAN FORM MODELS; IMAGE RECONSTRUCTION; INTERACTIVE COMPUTER GRAPHICS; MACHINE VISION; PATTERN RECOGNITION; PHYSIOLOGICAL MODELS; THREE DIMENSIONAL COMPUTER GRAPHICS;

FACE MODELING; IMAGE SYNTHESIS; MOTION ANALYSIS;

IMAGE ANALYSIS;

EID: 0027609968     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.216726     Document Type: Article

References (35)

1. K. Aizawa, H. Harashima, and T. Saito, “Model-based analysis synthesis image coding (MBASIC) system for a person’s face,” Signal Commun., vol. 1, no. 1989.
2. W. W. Bledsoe, “Man-machine facial recognition,” Panoramic Res. Inc., Palo Alto, CA, Rep. PRI:22, Aug. 1966.
3. V. Bruce, Recognizing Faces. Hillsdale: Lawrence Erlbaum, 1988.
4. C. S. Choi, H. Harashima, and T. Takebe, “Analysis and synthesis of facial expressions in knowledge-based coding of facial image sequences,” in Proc. Int. Conf. Acoustics Speech Signal Processing (Toronto), 1991, pp. 2737–2740.
5. G. M. Davies, H. D. Ellis, and G. M. Shepherd, Perceiving and Remembering Faces. New York: Academic, 1981.
6. X. Deng, “A finite element analysis of surgery of the human facial tissues,” Ph.D. thesis, Graduate Sch. Arts Sci., Columbia Univ., New York, NY, 1988.
7. P. Ekman, Unmasking the Human Face. New York: Prentice-Hall, 1971.
8. P. Ekman and W. V. Friesen, Manual for the Facial Action Coding System. Palo Alto: Consulting Psychologists, 1977.
9. M. A. Fischler and R. A. Elschlager, “The representation and matching of pictorial structures,” IEEE Trans. Comput., vol. C-22, pp. 67–92 1973.
10. R. Forchheimer and T. Kronander, “Image coding—From waveforms to animation,” IEEE Trans. Acoustics Speech Signal Processing, vol. ASSP-37, no. 12, pp. 2008–2023, 1989.
11. A. J. Goldstein, L. D. Harmon, and A. B. Lesk, “Man-machine interaction in human face identification,” Bell System Tech. J., vol. 51, no. 2, 399-427, 1972.
12. D. Hill, A. Pearce, and B. Wyvill, “Animating speech: A automated approach using speech synthesised by rules,” Visual Comput., vol. 3, pp. 277–287, 1988.
13. T. Kanade, “Picture processing System by computer complex and recognition of human faces,” Ph.D. Thesis, Dept, of Inform. Sci., Kyoto Univ., Nov. 1973.
14. M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active contour models,” Int. J. Comput. Vision, vol. 1, no. 4, pp. 321–331, 1987.
15. Y. Kaya and K. Kobayashi, “A basic study on human face recognition,” in Frontiers of Pattern Recognition (S. Watanabe, Ed.). 1972, p. 265.
16. R. M. Kenedi, T. Gibson, J. H. Evans, and J. C. Barbenel, “Tissue mechanics,” Phys. Med. Biol., vol. 20, no. 5, pp. 699–717, 1975.
17. K. Komatsu, “Human skin model capable of natural shape variation,” Visual Comput., vol. 3, pp. 265–271, 1988.
18. W. Larrabee, “A finite element model of skin deformation I. Biomechanics of skin and soft tissue: A review,” Laryngoscope, vol. 96, pp. 399—419, 1986; “II. An experimental model of skin deformation,” Laryngoscope, vol. 96, pp. 406—412, 1986; “III. The finite element model,” Laryngoscope, vol. 96, pp. 413-419, 1986.
19. Y. Lee, D. Terzopoulos, and K. Waters, “Constructing physics based facial models of individuals,” in Proc. Graphics Interface ’93 (Toronto), to be published in May 1993.
20. J. P. Lewis and F. I. Parke, “Automated lipsynch and speech synthesis for character animation,” in Proc. Human Factors Comput. Syst. Graphics Interface ’87 (Toronto), 1987, pp. 143–147.
21. K. Mase, “Recognition of facial expression from optical flow,” IEICE Trans., vol. E74, no. 10, pp. 3474–3483, Oct. 1991.
22. F. I. Parke, “Parameterized models for facial animation,” IEEE Comput. Graphics Applications, vol. 2, no. 9, pp. 61–68, Nov. 1982.
23. S. Pieper, “More than skin deep: Physical modeling of facial tissue,” M.Sc. thesis, Dept, of Media Arts Sci., Mass. Inst, of Technol., Cambridge MA, Jan. 1989.
24. W. Press, B. Flanney, S. Teukolsky, and W. Verttering, Numerical Recipes: The Art of Scientific Computing,. Cambridge, UK: Cambridge University Press, 1986.
25. T. Sakai, M. Nagao, and S. Jujibayashi, “Line extraction and pattern detection in a photograph,” Patt. Recogn., vol. 1, p. 233, 1969.
26. M. A. Shakleton and W. J. Welsh, “Classification of facial features for recognition,” in Proc. Comput. Vision Patt. Recogn. Conf. (CVPR’91) (Lahaina, HI), 1991, pp. 573–578.
27. D. Terzopoulos, “On matching deformable models to images,’ in Proc. Topical Meeting Machine Vision, Tech. Digest Series, vol. 12, Opt. Soc. Amer., Washington, DC, 1987, pp. 160-163; also Tech. Rep. 60, Schlumberger Palo Alto Res., Palo Alto, CA, Nov. 1986.
28. D. Terzopoulos and K. Fleischer. “Deformable models,” Visual Cornput., vol. 4, no. 6, pp. 306–331, 1988.
29. D. Terzopoulos and K. Waters. “Analysis of dynamic facial images using physical and anatomical models,” in Proc. Third Int. Conf Comput. Vision (ICCV’90) (Osaka), 1990, 727–732.
30. N. Magnenat-Thalmann, E. Primeau, and D. Thalmann, “Abstract muscle action procedures for face animation,” Visual Comput., vol. 3, pp. 290–297, 1988.
31. A. L. Yuille, D. S. Cohen, and P. W. Hallinan, “Feature extraction from faces using deformable templates,” in Proc. Comput. Vision Patt. Recogn. Conf. (San Diego, CA), June 1989, pp. 104–109.
32. J. Waite and W. Welsh, “Head boundary location using snakes,” Brit. Telecom Tech. J., vol. 8, no. 3, pp. 127–136, 1990.
33. K. Waters, “A muscle model for animating three-dimensional facial expression,” Comput. Graphics, vol. 22, no. 4, pp. 17–24, 1987.
34. K. Waters and D. Terzopoulos, “Modeling and animating faces using scanned data,” J. Visualization Comput. Animation, vol. 2, no. 4. pp. 123–128, 1991.
35. L. Williams, “Performance-driven facial animation,” Comput. Graphics, vol. 24, no. 4, pp. 235–242.