Pose-invariant facial expression recognition using variable-intensity templates

International Journal of Computer Vision

Volumn 83, Issue 2, 2009, Pages 178-194

  Kumano, Shiro ^a   Otsuka, Kazuhiro ^b   Yamato, Junji ^b   Maeda, Eisaku ^b   Sato, Yoichi ^a  

^a INSTITUTE OF INDUSTRIAL SCIENCE   (Japan)

^b NTT Communication Science Laboratories   (Japan)

Author keywords

Facial expression recognition; Intensity distribution models; Particle filter; Variable intensity templates

Indexed keywords

AIR FILTERS; COMPUTER VISION; GESTURE RECOGNITION; NONLINEAR FILTERING; VIDEO RECORDING;

EXISTING METHODS; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; FACIAL PARTS; IN PLANES; INTENSITY DISTRIBUTION MODELS; MONOCULAR VIDEO SEQUENCES; MULTIPLE POINTS; PARTICLE FILTER; RECOGNITION RATES; SIMPLE MODELS; VARIABLE-INTENSITY TEMPLATES;

FACE RECOGNITION;

EID: 63049094206     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-008-0185-x     Document Type: Article

References (50)

1. M. S. Bartlett G. Littlewort M. G. Frank C. Lainscsek I. R. Fasel J. R. Movellan 2006 Automatic recognition of facial actions in spontaneous expressions Journal of Multimedia 1 6 22 35
2. A. E. Beaton J. W. Tukey 1974 The fitting of power series, meaning polynomials, illustrated on band-spectroscopic data Technometrics 16 2 147 185
3. M. J. Black Y. Yacoob 1997 Recognizing facial expressions in image sequences using local parameterized models of image motion International Journal of Computer Vision 25 1 23 48
4. M. L. Cascia S. Sclaroff V. Athitsos 2000 Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models IEEE Transactions on Pattern Analysis and Machine Intelligence 22 4 322 336
5. M. Castrillon O. Deniz C. Guerra M. Hernandez 2007 Encara2: Real-time detection of multiple faces at different resolutions in video streams Journal of Visual Communication and Image Representation 18 2 130 140
6. Y. Chang C. Hu R. Feris M. Turk 2006 Manifold based analysis of facial expression Image and Vision Computing 24 6 605 614
7. I. Cohen N. Sebe A. Garg L. S. Chen T. S. Huang 2003 Facial expression recognition from video sequences: temporal and static modeling Computer Vision and Image Understanding 91 1-2 160 187
8. F. Dornaika F. Davoine 2008 Simultaneous facial action tracking and expression recognition in the presence of head motion International Journal of Computer Vision 76 3 257 281
9. Ekman, P., & Friesen, W. V. (1975). Unmasking the face: a guide to recognizing emotions from facial expressions. Englewood Cliffs: Prentice Hall.
10. Ekman, P., & Friesen, W. V. (1978). The facial action coding system: a technique for the measurement of facial movement. Palo Alto: Consulting Psychologists Press.
11. Ekman, P., Friesen, W. V., & Hager, J. C. (2002). FACS investigator's guide. A human face.
12. B. Fasel J. Luettin 2003 Automatic facial expression analysis: Survey Pattern Recognition 36 259 275
13. Fasel, B., Monay, F., & Gatica-Perez, D. (2004). Latent semantic analysis of facial action codes for automatic facial expression recognition. In Proceedings of the ACM SIGMM international workshop on multimedia information retrieval (pp. 181-188).
14. S. Geman D. E. McClure 1987 Statistical methods for tomographic image reconstruction Bulletin of the International Statistical Institute LII 5 21
15. Gokturk, S. B., Tomasi, C., Girod, B., & Bouguet, J. (2002). Model-based face tracking for view-independent facial expression recognition. In Proceedings of the IEEE international conference on automatic face and gesture recognition (pp. 287-293).
16. R. Gross I. Matthews S. Baker 2005 Generic vs. person specific active appearance models Image and Vision Computing 23 11 1080 1093
17. Hu, Y., Zeng, Z., Yin, L., Wei, X., Zhou, X., & Huang, T. S. (2008). Multi-view facial expression recognition. In Proceedings of the IEEE international conference on automatic face and gesture recognition.
18. C. L. Huang Y. M. Huang 1997 Facial expression recognition using model-based feature extraction and action parameters classification Journal of Visual Communication and Image Representation 8 3 278 290
19. M. Isard A. Blake 1998 Condensation-conditional density propagation for visual tracking International Journal of Computer Vision 29 1 5 28
20. Kanade, T., Cohn, J., & Tian, Y. L. (2000). Comprehensive database for facial expression analysis. In Proceedings of the IEEE international conference on automatic face and gesture recognition (pp. 46-53).
21. M. Kass A. Witkin D. Terzopoulos 1988 Snakes: Active contour models International Journal of Computer Vision 1 4 321 331
22. Koelstra, S., & Pantic, M. (2008). Non-rigid registration using free-form deformations for recognition of facial actions and their temporal dynamics. In Proceedings of the IEEE international conference on automatic face and gesture recognition.
23. I. Kotsia I. Pitas 2007 Facial expression recognition in image sequences using geometric deformation features and support vector machines IEEE Transactions on Image Processing 16 1 172 187
24. Kumano, S., Otsuka, K., Yamato, J., Maeda, E., & Sato, Y. (2007). Pose-invariant facial expression recognition using variable-intensity templates. In Proceedings of Asian conference on computer vision (Vol. 1, pp. 324-334).
25. A. Lanitis C. J. Taylor T. F. Cootes 1997 Automatic interpretation and coding of face images using flexible models IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 743 756
26. Liao, W. K., & Cohen, I. (2006). Belief propagation driven method for facial gestures recognition in presence of occlusions. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition workshop (pp. 158-163).
27. G. Littlewort M. S. Bartlett I. R. Fasel J. Susskind J. R. Movellan 2006 Dynamics of facial expression extracted automatically from video Image and Vision Computing 24 6 615 625
28. G. Loy A. Zelinsky 2003 Fast radial symmetry for detecting points of interest IEEE Transactions on Pattern Analysis and Machine Intelligence 25 8 959 973
29. Lucey, S., Matthews, I., Hu, C., Ambadar, Z., Torre, F., & Cohn, J. (2006). AAM derived face representations for robust facial action recognition. In Proceedings of the IEEE international conference on automatic face and gesture recognition (pp. 155-160).
30. Y. Matsubara T. Shakunaga 2005 Sparse template matching and its application to real-time object tracking IPSJ Transactions on Computer Vision and Image Media 46 9 17 40 (in Japanese)
31. Murphy-Chutorian, E., & Trivedi, M. M. (2008). Head pose estimation in computer vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence (in press).
32. Oka, K., & Sato, Y. (2005). Real-time modeling of face deformation for 3D head pose estimation. In Proceedings of the IEEE international conference on automatic face and gesture recognition (pp. 308-320).
33. Otsuka, K., Sawada, H., & Yamato, J. (2007). Automatic inference of cross-modal nonverbal interactions in multiparty conversations: "who responds to whom, when, and how?" from gaze, head gestures, and utterances. In Proceedings of the international conference on multimodal interfaces (pp. 255-262).
34. Pantic, M., & Bartlett, M. (2007). Machine analysis of facial expressions. In I-Tech education and publishing (pp. 377-416).
35. M. Pantic L. Rothkrantz 2000 Expert system for automatic analysis of facial expression Image and Vision Computing 18 881 905
36. M. Pantic L. J. M. Rothkrantz 2000 Automatic analysis of facial expressions: the state of the art IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1424 1445
37. Russell, S., & Norvig, P. (2003). Artificial intelligence-a modern approach. Paris: Pearson Education.
38. N. Sebe M. S. Lew Y. Sun I. Cohen T. Gevers T. S. Huang 2007 Authentic facial expression analysis Image and Vision Computing 25 12 1856 1863
39. Tang, H., & Huang, T. S. (2008). 3D facial expression recognition based on properties of line segments connecting facial feature points. In Proceedings of the IEEE international conference on automatic face and gesture recognition.
40. Y. L. Tian T. Kanade J. F. Cohn 2001 Recognizing action units for facial expression analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 23 2 97 115
41. Tian, Y. L., Kanade, T., & Cohn, J. (2005). Facial expression analysis. Berlin: Springer.
42. Y. Tong W. Liao Q. Ji 2007 Facial action unit recognition by exploiting their dynamic and semantic relationships IEEE Transactions on Pattern Analysis and Machine Intelligence 29 10 1683 1699
43. Viola, P., & Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (pp. 511-518).
44. Wang, J., Yin, L., Wei, X., & Sun, Y. (2006). 3D facial expression recognition based on primitive surface feature distribution. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (pp. 1399-1406).
45. J. Xiao T. Moriyama T. Kanade J. Cohn 2003 Robust full-motion recovery of head by dynamic templates and re-registration techniques International Journal of Imaging Systems and Technology 13 85 94
46. Xiao, J., Baker, S., Matthews, I., & Kanade, T. (2004). Real-time combined 2D+3D active appearance models. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (Vol. 2, pp. 535-542).
47. Yang, P., Liu, Q., Cui, X., & Metaxas, D. N. (2008). Facial expression recognition based on dynamic binary patterns. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition.
48. Zhang, W., Chen, H., Yao, P., Li, B., & Zhuang, Z. (2006). Precise eye localization with AdaBoost and fast radial symmetry. In Proceedings of the international conference on computational intelligence and security (Vol. 1, pp. 725-730).
49. G. Zhao M. Pietikainen 2007 Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Transactions on Pattern Analysis and Machine Intelligence 29 6 915 928
50. Zhu, Z., & Ji, Q. (2006). Robust real-time face pose and facial expression recovery. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (pp. 681-688).