Recognizing emotions from an ensemble of features

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 4, 2012, Pages 1017-1026

  Tariq, Usman ^a   Lin, Kai Hsiang ^a   Li, Zhen ^a   Zhou, Xi ^b   Wang, Zhaowen ^a   Le, Vuong ^a   Huang, Thomas S ^a   Lv, Xutao ^c   Han, Tony X ^c  

^a University of Illinois at Urbana Champaign   (United States)

^b Chinese Academy of Sciences   (China)

^c UNIVERSITY OF MISSOURI   (United States)

Author keywords

Biometrics; computer vision; emotion recognition; machine vision

Indexed keywords

AUTOMATIC ALGORITHMS; CLASSIFICATION RATES; CLASSIFICATION TASKS; EMOTION RECOGNITION; FACIAL EXPRESSION RECOGNITION; FEATURE GENERATION; GAUSSIANIZATION; MANUAL IDENTIFICATION; MOTION FEATURES; MULTI-MODAL; PERSON-INDEPENDENT; RECOGNIZING EMOTIONS; SCALE INVARIANT FEATURE TRANSFORMS;

BIOMETRICS; COMPUTER VISION; GESTURE RECOGNITION; SPEECH RECOGNITION;

FACE RECOGNITION;

EID: 84864127477     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2194701     Document Type: Article

References (34)

1. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion recognition in human-computer interaction," IEEE Signal Process. Mag., vol. 18, no. 1, pp. 32-80, Jan. 2001. (Pubitemid 32287669)
2. E. H. Kim, K. H. Hyun, S. H. Kim, and Y. K. Kwak, "Improved emotion recognition with a novel speaker-independent feature," IEEE/ASME Trans. Mechatron., vol. 14, no. 3, pp. 317-325, Jun. 2009.
3. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 39-58, Jan. 2009.
4. N. Ambady and R. Rosenthal, "Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-Analysis," Psychol. Bull., vol. 111, no. 2, pp. 256-274, 1992.
5. [Online]. Available: http://sspnet.eu/fera2011/
6. S. Yang and B. Bhanu, "Facial expression recognition using emotion avatar image," in Proc. IEEE Int. Conf. FG, Mar. 2011, pp. 866-871.
7. Y. Chang, C. Hu, R. Feris, and M. Turk, "Manifold based analysis of facial expression," Image Vis. Comput., vol. 24, no. 6, pp. 605-614, Jun. 2006. (Pubitemid 43867834)
8. M. Pantic and M. Bartlett, Machine Analysis of Facial Expressions. Vienna, Austria: I-Tech Educ. Publ., Jul. 2007, pp. 377-416.
9. S. Lucey, A. B. Ashraf, and J. F. Cohn, "Investigating spontaneous facial action recognition through AAM representations of the face," in Face Recognition, K. Delac and M. Grgic, Eds. Mammendorf, Germany: Pro Literatur Verlag, 2007, pp. 275-286.
10. M. F. Valstar, H. Gunes, and M. Pantic, "How to distinguish posed from spontaneous smiles using geometric features," in Proc. 9th ICMI, 2007, pp. 38-45.
11. M. S. Bartlett, G. Littlewort, B. Braathen, T. J. Sejnowski, and J. R. Movellan, "A prototype for automatic recognition of spontaneous facial actions," in Proc. Adv. Neural Inf. Process. Syst., 2003, pp. 1271-1278.
12. K. Anderson and P. W. McOwan, "A real-Time automated system for the recognition of human facial expressions," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 1, pp. 96-105, Feb. 2006. (Pubitemid 43174144)
13. M. F. Valstar, M. Pantic, and I. Patras, "Motion history for facial action detection in video," in Proc. SMC, 2004, vol. 1, pp. 635-640. (Pubitemid 40415930)
14. Y. Hu, Z. Zeng, L. Yin, X. Wei, X. Zhou, and T. Huang, "Multi-view facial expression recognition," in Proc. 8th IEEE Int. Conf. FG, Sep. 2008, pp. 1-6.
15. S. Berretti, A. Bimbo, P. Pala, B. Amor, and M. Daoudi, "A set of selected sift features for 3d facial expression recognition," in Proc. 20th ICPR, Aug. 2010, pp. 4125-4128.
16. A. Dhall, A. Asthana, R. Goecke, and T. Gedeon, "Emotion recognition using PHOG and LPQ features," in Proc. IEEE Int. Conf. FG, Mar. 2011, pp. 878-883.
17. Y.-L. Tian, T. Kanade, and J. Cohn, "Recognizing action units for facial expression analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 97-115, Feb. 2001. (Pubitemid 32254704)
18. H. Tang and T. Huang, "3d facial expression recognition based on automatically selected features," in Proc. 3D Face, 2008, pp. 1-8.
19. H. Tang and T. S. Huang, "3D facial expression recognition based on properties of line segments connecting facial feature points," in Proc. FG, 2008, pp. 1-6.
20. M. F. Valstar, B. Jiang, M. Méhu, M. Pantic, and K. Scherer, "The first facial expression recognition and analysis challenge," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., 2011, pp. 921-926.
21. T. Bänziger and K. Scherer, "Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) corpus," in Blueprint for Affective Computing: A Sourcebook, K. R. Scherer, T. Banziger, and E. Roesch, Eds. Oxford, U.K.: Oxford Univ. Press, 2010.
22. A. C. Bovik, Handbook of Image and Video Processing (Communications, Networking and Multimedia). Orlando, FL: Academic, 2005.
23. H. Schneiderman, "Feature-centric evaluation for efficient cascaded object detection," in Proc. CVPR, 2004, pp. 29-36.
24. H. Schneiderman, "Learning a restricted bayesian network for object detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2004, pp. II-639-II-646.
25. T. F. Cootes, D. Cooper, C. J. Taylor, and J. Graham, "Active shape models-Their training and application," Comput. Vis. Image Understand., vol. 61, no. 1, pp. 38-59, Jan. 1995.
26. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
27. X. Zhou, N. Cui, Z. Li, F. Liang, and T. Huang, "Hierarchical Gaussianization for image classification," in Proc. IEEE 12th Int. Conf. Comput. Vis., 2010, pp. 1971-1977.
28. C. M. Bishop, Pattern Recognition and Machine Learning. NewYork: Springer-Verlag, 2006.
29. C. Zach, T. Pock, and H. Bischof, "A duality based approach for realtime TV-L 1 optical flow," in Proc. 29th DAGM Conf. Pattern Recognit., 2007, pp. 214-223.
30. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification," J. Mach. Learn. Res., vol. 9, pp. 1871-1874, Jun. 2008.
31. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines, 2001. [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm
32. X. Zhou, S. Yan, S. Chang, M. Hasegawa-Johnson, and T. Huang, SIFTBag Kernel for Video Event Analysis. New York: ACM, 2008.
33. C. Liu, J. Yuen, and A. Torralba, "SIFT flow: Dense correspondence across scenes and its applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 978-994, May 2011.
34. N. Cornelis and L. Van Gool, "Real-Time connectivity constrained depth map computation using programmable graphics hardware," in Proc. IEEE Comput. Soc. CVPR, 2005, vol. I, pp. 1099-1104. (Pubitemid 43897315)