Real-time inference of mental states from facial expressions and upper body gestures

2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

Volumn , Issue , 2011, Pages 909-914

  Baltrušaitis, Tadas ^a   McDuff, Daniel ^b   Banda, Ntombikayise ^a   Mahmoud, Marwa ^a   Kaliouby, Rana El ^b   Robinson, Peter ^a   Picard, Rosalind ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b MIT MEDIA LAB   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

A-FRAMES; ACTION UNIT; BODY GESTURE; CLASSIFICATION RATES; DYNAMIC BAYESIAN NETWORK; EMOTIONAL STATE; FACIAL ACTION; FACIAL EXPRESSIONS; FEATURE POINT; GABOR FILTER; MENTAL STATE; MULTI-LEVEL; REAL-TIME INFERENCE; TIME-SCALES; VIDEO CLIPS;

BAYESIAN NETWORKS; FACE RECOGNITION; HIDDEN MARKOV MODELS; INFERENCE ENGINES; REAL TIME SYSTEMS;

GESTURE RECOGNITION;

EID: 79958759245     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2011.5771372     Document Type: Conference Paper

References (15)

1. M. Pantic and L. Rothkrantz, "Toward an affect-sensitive multimodal human-computer interaction," Proceedings of the IEEE, vol. 91, no. 9, pp. 1370-1390, 2003. (Pubitemid 40890819)
2. R. Kaliouby and P. Robinson, "Generalization of a vision-based computational model of mind-reading," ACII, 2005.
3. P. Ekman andW. Friesen, Manual for the Facial Action Coding System. Palo Alto: Consulting Psychologists Press, 1977.
4. N. Oliver, E. Horvitz, and A. Garg, "Hierarchical representations for learning and inferring office activity from multimodal information," in ICMI, 2002.
5. M. L. Cascia, S. Sclaroff, and V. Athitsos, "Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models," IEEE Trans. PAMI., 2000.
6. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-pie," in Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, 2008.
7. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, "Active Shape Models-Their Training and Application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, January 1995.
8. M. Pantic and L. Rothkrantz, "Facial Action Recognition for Facial Expression Analysis from Static Face Images," IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, vol. 34, 2004.
9. R. E. Kaliouby, P. Robinson, S. Keates, and E. D. Centre, "Temporal context and the recognition of emotion from facial expression," in Proceedings of the HCI International Conference. APA, 2003.
10. T. Bnzinger and K. R. Scherer, "Introducing the geneva multimodal emotion portrayal(gemep) corpus," in Blueprint for Affective Computing: A Sourcebook, K. R. Scherer, B. T., and R. E. B., Eds. Oxford University Press, Oxford, 2010, pp. 271-294.
11. M. F. Valstar, B. Jiang, M. Mehu, M. Pantic, and K. Scherer, "The first facial expression recognition and analysis challenge," in IEEE Intl Conf. Automatic Face and Gesture Recognition, 2011.
12. S. Afzal and P. Robinson, "Natural affect data-collection & annotation in a learning context," 2009.
13. P. Rozin and A. B. Cohen, "High frequency of facial expressions corresponding to confusion, concentration, and worry in an analysis of naturally occurring facial expressions of Americans," Emotion, vol. 3, no. 1, pp. 68-75, 2003. (Pubitemid 37322443)
14. R. Cowie, "Building the databases needed to understand rich, spontaneous human behaviour," in Automatic Face & Gesture Recognition, 2008. FG '08. 8th IEEE International Conference on, 2008.
15. J. Cohn and K. Schmidt, "The timing of facial motion in posed and spontaneous smiles," IJWMIP, 2004.