Subtle facial expression recognition using motion magnification

Pattern Recognition Letters

Volumn 30, Issue 7, 2009, Pages 708-716

  Park, Sungsoo ^a   Kim, Daijin ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

Author keywords

Active appearance models; Feature point tracking; Motion estimation; Motion magnification; Subtle facial expression recognition

Indexed keywords

FEATURE EXTRACTION; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; LIGHT MEASUREMENT; MOTION ESTIMATION; OPTICAL FLOWS; SUPPORT VECTOR MACHINES;

ACTIVE APPEARANCE MODELS; FACE IMAGES; FACIAL EXPRESSIONS; FACIAL FEATURE POINTS; FACIAL RECOGNITION; FEATURE POINT TRACKING; FEATURE POINTS; MOTION MAGNIFICATION; MOTION VECTORS; NOVEL METHODS; SHAPE AND APPEARANCE MODELS; SUBTLE FACIAL EXPRESSION RECOGNITION;

FACE RECOGNITION;

EID: 63149124145     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2009.02.005     Document Type: Article

References (27)

1. Baker, S., Matthews, I., 2002. Lucas-kanade 20 years on: A unifying framework: Part 1, CMU-RI-TR-02-16.
2. Cowell, J.R., Ayesh, A., 2004. Extracting subtle facial expression for emotional analysis. In: Proc. of IEEE International Conference on Systems Man and Cybernetics, vol. 1, pp. 677-681.
3. Donalto G., Bartlett M.S., Hager J.C., Ekman P., and Sejnowski T. Classifying facial actions. IEEE Trans. Pattern Anal. Mach. Intell. 21 10 (1999) 974-999
4. Edwards G., Taylor C., and Cootes T. Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23 6 (2001) 681-685
5. Ekman P. Emotions in the Human Face (1982), Cambridge University Press
6. Ekman P., and Friesen W. Facial Action Coding System: A Technique for the Measurement of Facial Movement (1978), Consulting Psychologists Press
7. Ekman P., and Friesen W. A Mathematical Introduction to Robotic Manipulation (1978), Consulting Psychologists Press
8. Essa I.A., and Pentland A.P. Coding, analysis, interpretation, and recognition of facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 757-763
9. Fasel B., and Luettin J. Automatic facial expression analysis: a survey. Pattern Recognit. 36 1 (2003) 259-275
10. Gross, R., Matthews, I., Baker, S., 2003. Lucas-kanade 20 years on: a unifying framework: Part 3, CMU-RI-TR-03-05.
11. Kobayahsi, K., Hara, F., 1997. Dynamic recognition of bias facial expressions by discrete-time recurrent neural networks. In: Proc. of the International Conference on Systems, Man, and Cybernetics, pp. 3732-3737.
12. Lien, J., 1998. Automatic recognition of facial expressions using hidden markov models and estimation of expression intensity. Ph.D. thesis, Carnegie Mellon University.
13. Liu, Z., Shan, Y., Zhang, Z., 2001. Expressive expression mapping with ratio images. In: Proc. of SIGGRAPH.
14. Lucas, B., Kanade, T., 1981. An iterative image registration technique with an application to stereo vision. In: Proc, of the 7th International Joint Conference on Artificial Intelligence, pp. 674-679.
15. Lucas, B.D., 1984. Generalized image matching by the method of differences. Ph.D. thesis, Carnegie Mellon University.
16. Mase K., and Pentland A. Recognition of facial expression from optical flow. IEICE Trans. 74 10 (1991) 3474-3484
17. Matthews I., and Baker S. Active appearance models revisited. Int. J. Comput. Vis. 60 2 (2004) 135-164
18. Otsuka, T., Ohya, J., 1998. Spotting segments displaying facial expression from image sequences using HMM. In: Proc. of IEEE Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, pp. 442-447.
19. Pantic M., and Rothkrantz L. Expert system for automatic analysis of facial expressions. Image Vis. Comput. 8 (2000) 881-905
20. Park, S., Lee, H.-S., Shin, J., Kim, D., 2008. The postech subtle facial expression database 2007(sfed07). In: Proc, of the 8th POSTECH-KYUTECH Joint Workshop On Neuroinformatics, pp. 653-54.
21. Song, M., Wang, H., Bu, J., Chen, C., Liu, Z., 2006. Subtle facial expression modeling with vector field decomposition. In: Proc. of IEEE International Conference on Image Processing, pp. 2102-2104.
22. Szeliski R., and Coughlan J. Spline-based image registration. Inter. J. Comput. Vis. 22 3 (1997) 199-218
23. Tian Y., Kanade J., and Cohn J.F. Recognizing action units for facial expression analysis. IEEE Trans. Pattern Anal. Mach. Intell. 23 2 (2001) 97-115
24. Vapnik V.N. Statistical Learning Theory (1998), Wiley-Interscience Press
25. VideoClip, 2007. Subtle facial expression using motion magnification. Available at: .
26. Wu, Y.T., Kanade, T., Cohn, J.F., Li, C., 1998. Optical flow estimation using wavelet motion model. In: Proc. of IEEE International Conference on Computer Vision, pp. 992-998.
27. Zheng, W., Zhou, X., Zou, C., Zhao, L., 2004. Facial expression recognition using kernel discriminant plane. In: Proc. of International Symposium on Neural Networks. pp. 947-952.