Modeling, tracking and interactive animation of faces and heads//using input from video

Proceedings - Computer Animation, CA 1996

Volumn , Issue , 1996, Pages 68-79

  Essa, Irfan ^a   Basu, Sumit ^a   Darrell, Trevor ^a   Pentland, Alex ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Computer Vision; Expressions and Gestures; Facial Animation; Facial Modeling; Interactive Animation

Indexed keywords

COMPUTER VISION; GEOMETRY; MUSCLE; PIXELS;

EXPRESSIONS AND GESTURES; FACIAL ANIMATION; FACIAL MODEL; GEOMETRIC MODELING; INPUT MEASUREMENTS; INTERACTIVE ANIMATIONS; PHYSICALLY BASED MODELING; VISUAL MEASUREMENTS;

ANIMATION;

EID: 84943316576     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CA.1996.540489     Document Type: Conference Paper

References (41)

1. A. Azarbayejani, B. Horowitz, and A. Portland. Recursive estimation of structure and motion using the relative orientation constraint. In Proceedings of the Computer Vision and Pattern Recognition Conference, 1993.
2. Sumit Basu, Irfan Essa, and Alex Pentland. Motion regularization for model-based head tracking. Technical Report 362, MIT Media Laboratory, Perceptual Computing Section, January 1996. Available as MIT Media Lab Perceptual Computing Techreport # 362 from http://www-white.media.mit.edu/vismod/.
3. M. J. Black and Y. Yacoob. Tracking and recognizing rigid and non-rigid facial motions using local parametric model of image motion. In Proceedings of the International Conference on Computer Vision, pages 374-381. IEEE Computer Society, Cambridge, MA, 1995.
4. T. Darrell and A. Pentland. Space-time gestures. In Proceedings of the Computer Vision and Pattern Recognition Conference, 1993. Available as MIT Media Lab Perceptual Computing Techreport # 197 from http://www-white.media.mit.edu/vismod/.
5. P. Ekman. Facial expression of emotion: An old controversy and new findings. Philosophical Transactions: Biological Sciences (Series B), 335(1273):63-69, 1992.
6. P. Ekman and W. V. Friesen. Facial Action Coding System. Consulting Psychologists Press Inc., 577 College Avenue, Palo Alto, California 94306, 1978.
7. P. Ekman, T. Huang, T. Sejnowski, and J. Hager (Editors). Final Report to NSF of the Planning Workshop on Facial Expression Understanding. Technical report, National Science Foundation, Human Interaction Lab., UCSF, CA 94143, 1993.
8. A. Emmett. Digital portfolio: Tony de peltrie. Computer Graphics World, 8(10):72-77, October 1985.
9. I. Essa. Analysis, Interpretation, and Synthesis of Facial Expressions. PhD thesis, Massachusetts Institute of Technology, MIT Media Laboratory, Cambridge, MA 02139, USA, 1994. Available as MIT Media Lab Perceptual Computing Techreport # 303 from http://www-white.media.mit.edu/vismod/.
10. I. Essa, T. Darrell, and A. Pentland. Tracking facial motion. In Proceedings of the Workshop on Motion of Nonrigid and Articulated Objects, pages 36-42, IEEE Computer Society, 1994, Available as MIT Media Lab Perceptual Computing Techreport # 272 from http://www-white.media.mit.edu/vismod/.
11. I. Essaand A. Pentland. A vision system for observing and extracting facial action parameters. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 76-83. IEEE Computer Society, 1994. Available as MIT Media Lab Perceptual Computing Techreport # 247 from http://www-white.media.mit.edu/vismod/.
12. S. Glenn. VActoranimation system. In ACM SIGGRAPH Visual Proceedings, page 223, SimGraphics Engineering Corporation, 1993.
13. B. K. P. Horn and B. G. Schunck. Determining optical flow. Artificial Intelligence, 17:185-203, 1981.
14. M. Kass, A. Witkin, and D. Terzopoulos. Snakes: Active contour models. International Journal of Computer Vision, 1(4):321-331, 1987.
15. Viewpoint Data Labs. 625 S. State, Orem, Ut 84058, USA, +1-800-DATASET. http://www.viewpoint.com/home.shtml.
16. Y. Lee, D. Terzopoulos, and K. Waters. Realistic modeling for facial animation. In ACM SIGGRAPH Conference Proceedings, 1995.
17. P. Litwinowitcz and L. Williams. Animating images with drawings. ACM SIGGRAPH Conference Proceedings, pages 409-412, 1994. Annual Conference Series.
18. N. Magnenat-Thalmann, E. Primeau, and D. Thalmann. Abstract muscle action procedures for face animation. The Visual Computer, 3:290-297, 1988.
19. B. Moghaddamand A. Pentland. Face recognition using view-based and modular eigenspaces. In Automatic Systems for the Identification and Inspection of Humans, volume 2277. SPIE, 1994.
20. B. Moghaddam and A. Pentland. Probabistic visual learning for object detection. In Proceedings of the International Conference on Computer Vision. IEEE Computer Society, 1995. Available as MIT Media Lab Perceptual Computing Techreport # 326 from http://www-white.media.mit.edu/vismod/.
21. F. Parke. Parameterized modeling for facial animation. IEEE Computer Graphics and Applications, 2(9):61-68, 1982.
22. F. I. Parke. Techniques of facial animation. In Nadia Magnenat Thalmann and Daniel Thalmann, editors, New Trends in Animation and Visualization, chapter 16, pages 229-241 John Wiley and Sons, 1991.
23. C. Pelachaud, N. Badler, and M. Viaud. Final Report to NSF of the Standards for Facial Animation Workshop. Technical report, National Science Foundation, University of Pennsylvania, Philadelphia, PA 19104-6389, 1994.
24. A. Pentland and B. Horowitz. Recovery of nonrigid motion and structure. IEEE Trans. Pattern Analysis and Machine Intelligence, 13(7):730-742, Julylr991.
25. A. Pentland, B. Moghaddam, and T. Starner. View-based and modular eigenspaces for face recognition. In Computer Vision and Pattern Recognition Conference, pages 84-91. IEEE Computer Society, 1994. Available as MIT Media Lab Perceptual Computing Techreport # 245 from http://www-white.media.mit.edu/vismod/.
26. A. Pentland, B. Moghaddam, and T. Starner. View-based and modular eigenspaces for face recognition. In Computer Vision and Pattern Recognition Conference, pages 84-91. IEEE Computer Society, 1994.
27. S. Pieper, J. Rosen, and D. Zeltzer. Interactive graphics for plastic surgery: A task level analysis and implementation. Computer Graphics, Special Issue: ACM Siggraph, 1992 Symposiumon Interactive 3D Graphics, pages 127-134, 1992.
28. S. M. Platt and N. I. Badler. Animating facial expression. ACM SIGGRAPH Conference Proceedings, 15(3):245-252, 1981.
29. T. Poggio and F. Girosi. A theory of networks for approximation and learning. Technical Report A.I. Memo No. 1140, Artificial Intelligence Lab, MIT, Cambridge, MA, July 1989.
30. M. Rydfalk. CANDIDE: A Parameterized Face. PhD thesis, Linkbping University, Department of Electrical Engineering, Oct 1987.
31. A. Saulnier, M. L. Viaud, and D. Geldreich. Real-time facial analysis and synthesis chain. In International Workshop on Automatic Face and Gesture Recogntion, pages 86-91, Zurich, Switzerland, 1995. Editor, M. Bichsel.
32. E. P. Simoncelli. Distributed Representation and Analysis of Visual Motion. PhD thesis, Massachusetts Institute of Technology, 1993.
33. D. Terzopoulos and R. Szeliski. Tracking with kalman snakes. In A. Blake and A. Yuille, editors, Active Vision, pages 3-20. MIT Press, 1993.
34. D. Terzopoulos and K. Waters. Physically-based facial modeling, analysis, and animation. The Journal of Visualization and Computer Animation, 1:73-80, 1990.
35. D. Terzopoulus and K. Waters. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. Pattern Analysis and Machine Intelligence, 15(6):569-579, June 1993.
36. M. Viaud and H. Yahia. Facial animation with muscle and wrinkle simulation. In IMAGECON1993: Second International Conference on Image Communication, pages 117-121, 1993.
37. S. A. Wainwright, W. D. Biggs, J. D. Curry, and J. M. Gosline. Mechanical Design in Organisms. Princeton University Press, 1976.
38. J. Y. A. Wang and E. Adelson. Layered representation for motion analysis. In Proceedings of the Computer Vision and Pattern Recognition Conference, 1993.
39. K. Waters. A muscle model for animating three-dimensional facial expression. ACM SIGGRAPH Conference Proceedings, 21(4):17-23, 1987.
40. K. Waters and D. Terzopoulos. Modeling and animating faces using scanned data. The Journal of Visualization and Computer Animation, 2:123-128, 1991.
41. L. Williams. Performance-driven facial animation. ACM SIGGRAPH Conference Proceedings, 24(4):235-242, 1990.