Facial action recognition for facial expression analysis from static face images

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 34, Issue 3, 2004, Pages 1449-1461

  Pantic, Maja ^a   Rothkrantz, Leon J M ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Facial action unit combinations; Facial action units; Facial expression analysis; Image processing; Rule based reasoning; Spatial reasoning; Uncertainty

Indexed keywords

ALGORITHMS; COLOR; FEATURE EXTRACTION; IMAGE ANALYSIS; UNCERTAIN SYSTEMS;

FACIAL ACTION RECOGNITION; FACIAL ACTION UNIT COMBINATION; FACIAL ACTION UNITS; FACIAL EXPRESSION ANALYSIS; RULE BASED REASONING; SPATIAL REASONING; STATIC FACE IMAGES;

OBJECT RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BODY POSTURE; CLINICAL TRIAL; COMPUTER ASSISTED DIAGNOSIS; FACE; FACIAL EXPRESSION; HISTOLOGY; HUMAN; METHODOLOGY; PHOTOGRAPHY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VALIDATION STUDY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; FACE; FACIAL EXPRESSION; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; POSTURE; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 2942612281     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2004.825931     Document Type: Article

References (31)

1. M. S. Bartlett, J. C. Hager, P. Ekman, and T. J. Sejnowski, "Measuring facial expressions by computer image analysis," Psychophysiology, vol. 36, pp. 253-263, 1999.
2. M. Black, and Y. Yacoob, "Recognizing facial expressions in image sequences using local parameterized models of image motion," Comput. Vis., vol. 25, no. 1, pp. 23-48, 1997.
3. J. F. Cohn, A. J. Zlochower, J. Lien, and T. Kanade, "Automated face analysis by feature point tracking has high concurrent validity with manual faces coding," Psychophysiology, vol. 36, pp. 35-43, 1999.
4. C. Darwin, The Expression of the Emotions in Man and Animals. Chicago, IL: Univ. of Chicago Press, 1872, 1965.
5. G, Donato, M. S. Bartlett, J. C. Hager, P. Ekman, and T. J. Sejnowski, "Classifying facial actions," IEEE Trans. Pattern Anal. Machine Intell., vol. 21, pp. 974-989, Oct. 1999.
6. P. Ekman and W. Friesen, Facial Action Coding System. Palo Alto, CA: Consulting Psychol. Press, 1978.
7. P. Ekman, T. S. Huang, T. J. Sejnowski, and J. C. Hager, "Final Report to NSF of the Planning Workshop on Facial Expression Understanding," Human Interaction Lab., Univ. California, San Francisco, 1993.
8. P. Ekman, J. Hager, C. H. Methvin, and W. Irwin, "Ekman-Hager Facial Action Exemplars," Human Interaction Lab., Univ. California, San Francisco.
9. I. Essa and A. Pentland, "Coding, analysis, interpretation and recognition of facial expressions," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 757-763, July 1997.
10. W. V. Friesen, and P. Ekman, "Dictionary - Interpretation of FACS Scoring," Human Interaction Laboratory, Univ. California, San Francisco.
11. S. B. Gokturk, J. Y. Bouguet, C. Tomasi, and B. Girod, "Model-based face tracking for view-independent facial expression recognition," in Proc. IEEE Int. Conf. Automatic Face Gesture Recognition, 2002, pp. 272-278.
12. Handbook of Emotions, M. Lewis and J. M. Haviland-Jones, Eds., Guilford Press, New York, 2000, pp. 236-249.
13. K. Mase, "Recognition of facial expression from optical flow," IEICE Trans., vol. E-74, no. 10, pp. 3474-3483, 1991.
14. A. Ortony and T. J. Turner, "What is basic about basic emotions?," Psychol. Rev., vol. 74, pp. 315-341, 1990.
15. M. Pantic and L. J. M. Rothkrantz, "Expert system for automatic analysis of facial expression," Image Vis. Comput. J., vol. 18, no. 11, pp. 881-905, 2000.
16. ____, "Automatic analysis of facial expressions: The state of the art," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 1424-1445, Dec. 2000.
17. ____, "Toward an affect-sensitive multimodal human-computer interaction," in Proc. IEEE, vol. 91, Sept. 2003, pp. 1370-1390.
18. M. Pantic, M. Tomc, and L. J. M. Rothkrantz, "A hybrid approach to mouth features detection," Proc. IEEE Int. Conf. Systems, Man, Cybernetics, pp. 1188-1193, 2001.
19. M. Pantic, I. Patras, and L. J. M. Rothkrantz, "Facial action recognition in face profile image sequences," in Proc. IEEE Int. Conf. Multimedia and Expo, 2002, pp. 37-40.
20. A. Pentland, "Looking at people," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 107-119, Jan. 2000.
21. B. Raducanu, M. Pantic, L. J. M. Rothkrantz, and M. Grana, "Automatic eyebrow tracking using boundary Chain code," in Proc. Advanced School Computing Imaging Conf., 1999, pp. 137-143.
22. J. Russell, and J. Fernandez-Dols, The Psychology of Facial Expression. New York: Cambridge Univ. Press, 1997.
23. Handbook Methods in Non-Verbal Behavior Research, K. R. Scherer and P. Ekman, Eds., Cambridge Univ. Press, Cambridge, MA, 1982.
24. M. Schneider, A. Kandel, G. Langholz, and G. Chew, Fuzzy Expert System Tools. New York: Wiley, 1997.
25. L. Shafarekno, M. Petrou, and J. Kittler, "Automatic watershed segmentation of randomly textured color images," IEEE Trans. Image Processing, vol. 6, pp. 1530-1544, Nov. 1997.
26. K. Sobottka, and I. Pitas, "A novel method for automatic face segmentation, facial feature extraction and tracking," Signal Process. Image Commun., vol. 12, no. 3, pp. 263-281, 1998.
27. Y. Tian, T. Kanade, and J. F. Cohn, "Recognizing action units for facial expression analysis," IEEE Trans. Pattern Anal. Machine Intell., vol. 23, pp. 97-115, Jan. 2001.
28. J. M. Vincent, D. J. Myers, and R. A. Hutchinson, "Image feature location in multi-resolution images using multi-layer perceptrons," in Neural Networks for Vision, Speech & Natural Language, R. Lingard, D. J. Myers, and C. Nightingale, Eds. London, U.K.: Chapman & Hall, 1992, pp. 13-29.
29. L. Vincent and P. Soille, "Watersheds in digital spaces: An efficient algorithm based on immersion simulations," IEEE Trans. Pattern Anal. Machine Intell., vol. 33, pp. 583-589, June 1991.
30. J. Yang and A. Waibel, "A real-time face tracker," in Proc. Workshop on Applications of Computer Vision, 1996, pp. 142-147.
31. M. H. Yang, D. J. Kriegman, and N. Ahuja, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 34-58, Jan. 2002.