Automatic facial expression recognition using bags of motion words

British Machine Vision Conference, BMVC 2010 - Proceedings

Volumn , Issue , 2010, Pages

  Xu, Liefei ^a   Mordohai, Philippos ^a  

^a Stevens Institute of Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; GESTURE RECOGNITION;

AUTOMATIC APPROACHES; AUTOMATIC FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSION RECOGNITION; FACIAL FEATURE; FACIAL MOTIONS; LOCAL MOTIONS; OPTICAL FLOW ESTIMATION; VIDEO SEQUENCES;

FACE RECOGNITION;

EID: 84898441520     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5244/C.24.13     Document Type: Conference Paper

References (47)

1. K. Anderson and P.W. McOwan. Real-time automated system for the recognition of human facial expressions. IEEE Trans. Systems, Man and Cybernetics, 36(1):96-105, 2006.
2. M. Ankerst, G. Kastenmüller, H.-P. Kriegel, and T. Seidl. 3d shape histograms for similarity search and classification in spatial databases. In International Symposium on Spatial Databases. Springer, 1999.
3. J. N. Bassili. Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology, 37:2049-2058, 1979.
4. M.J. Black and P. Anandan. The robust estimation of multiple motions: Parametric and piecewise-smooth flow-fields. Computer Vision and Image Understanding, 63(1): 75-104, 1996.
5. M.J. Black and Y. Yacoob. Recognizing facial expressions in image sequences using local parameterized models of image motion. International Journal of Computer Vision, 25(1):23-48, 1997.
6. C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
7. I. Cohen, N. Sebe, A. Garg, L.S. Chen, and TS Huang. Facial expression recognition from video sequences: Temporal and static modeling. Computer Vision and Image Understanding, 91(1-2):160-187, 2003.
8. G Csurka, C. Dance, J. Willamowski, L. Fan, and C. Bray. Visual categorization with bags of keypoints. In Workshop on Statistical Learning in Computer Vision, 2004.
9. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In IEEE Conf. on Computer Vision and Pattern Recognition, pages I: 886-893, 2005.
10. F. de la Torre, J. Campoy, Z. Ambadar, and J.F. Cohn. Temporal segmentation of facial behavior. In Int. Conf. on Computer Vision, pages 1-8, 2007.
11. P. Dollar, V. Rabaud, G. Cottrell, and S.J. Belongie. Behavior recognition via sparse spatio-temporal features. In PETS, pages 65-72, 2005.
12. G. Donato, M.S. Bartlett, J.C. Hager, P. Ekman, and T.J. Sejnowski. Classifying facial actions. IEEE Trans. Pattern Analysis and Machine Intelligence, 21(10):974-989, 1999.
13. A.A. Efros, A.C. Berg, G Mori, and J. Malik. Recognizing action at a distance. In Int. Conf. on Computer Vision, pages 726-733, 2003.
14. P. Ekman and W.V. Friesen. The Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, 1978.
15. I.A. Essa and A.P Pentland. Coding, analysis, interpretation, and recognition of facial expressions. IEEE Trans. Pattern Analysis and Machine Intelligence, 19(7):757-763, 1997.
16. C. Faloutsos, R. Barber, M. Flickner, J. Hafner, W. Niblack, D. Petkovic, and W. Equitz. Efficient and effective querying by image content. Journal of Intelligent Information Systems, 3(3/4):231-262, 1994.
17. B. Fasel and J. Luettin. Automatic facial expression analysis: A survey. Pattern Recognition, 36(1):259-275, 2003.
18. Li. Fei-Fei and P. Perona. A bayesian hierarchical model for learning natural scene categories. In IEEE Conf. on Computer Vision and Pattern Recognition, pages 524-531, 2005.
19. M.J. Jones and P.A. Viola. Robust real-time face detection. In Int. Conf. on Computer Vision, page II: 747, 2001.
20. F Jurie and B. Triggs. Creating efficient codebooks for visual recognition. In Int. Conf. on Computer Vision, pages I: 604-610, 2005.
21. S. Koelstra, M. Pantic, and I. Patras. A dynamic texture based approach to recognition of facial actions and their temporal models. IEEE Trans. Pattern Analysis and Machine Intelligence, 2010.
22. I. Kotsia and I. Pitas. Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans. Image Processing, 16 (1):172-187, 2007.
23. I. Laptev and T. Lindeberg. Space-time interest points. In Int. Conf. on Computer Vision, pages 432-439, 2003.
24. J.J.J. Lien, T. Kanade, J.F. Cohn, and C.C. Li. Automated facial expression recognition based on facs action units. In Automatic Face and Gesture Recognition, pages 390-395, 1998.
25. D. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91-110, 2004.
26. K. Mase. Recognition of facial expression from optical flow. IEICE, E74(10):3474-3483, 1991.
27. J.C. Niebles, H.C. Wang, and F.F. Li. Unsupervised learning of human action categories using spatial-temporal words. International Journal of Computer Vision, 79:299-318, 2008.
28. E. Nowak, F. Jurie, and B. Triggs. Sampling strategies for bag-of-features image classification. In European Conf. on Computer Vision, pages IV: 490-503, 2006.
29. M. Pantic and L.J.M. Rothkrantz. Automatic analysis of facial expressions: The state of the art. IEEE Trans. Pattern Analysis and Machine Intelligence, 22(12):1424-1445, 2000.
30. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Lost in quantization: Improving particular object retrieval in large scale image databases. In IEEE Conf. on Computer Vision and Pattern Recognition, 2008.
31. Y. Rubner, C. Tomasi, and L.J. Guibas. The earth mover's distance as a metric for image retrieval. International Journal of Computer Vision, 40(2):99-121, 2000.
32. C. Schmid, R. Mohr, and C. Bauckhage. Evaluation of interest point detectors. International Journal of Computer Vision, 37(2):151-172, 2000.
33. J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In Int. Conf. on Computer Vision, pages 1470-1477, 2003.
34. Y. Sun and L.J. Yin. Facial expression recognition based on 3d dynamic range model sequences. In European Conf. on Computer Vision, pages II: 58-71, 2008.
35. YL. Tian, T. Kanade, and J.F Cohn. Recognizing action units for facial expression analysis. IEEE Trans. Pattern Analysis and Machine Intelligence, 23(2):97-115, 2001.
36. YL. Tian, T. Kanade, and J. F Cohn. Facial expression analysis. In S.Z. Li and A.K. Jain, editors, Handbook of Face Recognition. Springer-Verlag, 2005.
37. Y. Tong, W.H. Liao, and Q.A. Ji. Facial action unit recognition by exploiting their dynamic and semantic relationships. IEEE Trans. Pattern Analysis and Machine Intelligence, 29(10):1683-1699, 2007.
38. M.F Valstar and M. Pantic. Combined support vector machines and hidden markov models for modeling facial action temporal dynamics. In IEEE Workshop on Human Computer Interaction, pages 118-127, 2007.
39. J.C. van Gemert, C.J. Veenman, A.W.M. Smeulders, and J.M. Geusebroek. Visual word ambiguity. IEEE Trans. Pattern Analysis and Machine Intelligence, 2010.
40. H. Wang, M.M. Ullah, A. Klaser, I. Laptev, and C. Schmid. Evaluation of local spatio-temporal features for action recognition. In British Machine Vision Conference, 2009.
41. T.H. Wang and J.J.J. Lien. Facial expression recognition system based on rigid and non-rigid motion separation and 3d pose estimation. Pattern Recognition, 42(5):962-977, May 2009.
42. M. Werlberger, W. Trobin, T. Pock, A. Wedel, D. Cremers, and H. Bischof. Anisotropic Huber-L1 optical flow. In British Machine Vision Conference, 2009.
43. Y. Yacoob and L.S. Davis. Recognizing human facial expressions from long image sequences using optical-flow. IEEE Trans. Pattern Analysis and Machine Intelligence, 18(6):636-642, 1996.
44. L.J. Yin, X.C. Chen, Y. Sun, T. Worm, and M. Reale. A high-resolution 3d dynamic facial expression database. In Automatic Face and Gesture Recognition, 2008.
45. L. Zelnik-Manor and M. Irani. Event-based analysis of video. In IEEE Conf. on Computer Vision and Pattern Recognition, pages II: 123-130, 2001.
46. Z.H. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Trans. Pattern Analysis and Machine Intelligence, 31(1):39-58, 2009.
47. G.Y. Zhao and M. Pietikainen. Boosted multi-resolution spatiotemporal descriptors for facial expression recognition. Pattern Recognition Letters, 30(12):1117-1127., 2009.