Gesture and Emotion: Can basic gestural form features discriminate emotions?

Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

Volumn , Issue , 2009, Pages

  Kipp, Michael ^a   Martin, Jean Claude ^b  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^b UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL AGENTS; FORM FEATURES; HAND SHAPE; MOTION DIRECTION;

INTELLIGENT COMPUTING;

EID: 77949397156     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2009.5349544     Document Type: Conference Paper

References (46)

1. J. H. Astington. Actors and the body: Meta-theatrical rhetoric in shakespeare. Gesture, 6(2):241-259, 2006.
2. T. Bänziger, H. Pirker, and K. Scherer. Gemep - geneva multimodal emotion portrayals: A corpus for the study of multimodal emotional expressions. In Workshop "Corpora for research on emotion and affect" at the 5th International Conference on Language Resources and Evaluation (LREC'2006), pages 15-19, 2006.
3. R. T. Boone and J. G. Cunningham. Children's understanding of emotional meaning in expressive body movement. In Biennial Meeting of the Society for Research in Child Development, 1996.
4. J. Bressem. Recurrent form features in coverbal gestures. Talk at the Third International Conf. of the International Society for Gesture Studies (ISGS), June 2007.
5. C. Busso and S. Narayanan. Scripted dialogs versus improvisation: Lessons learned about emotional elicitation techniques from the iemocap database. In Interspeech, Brisbane, Australia, 2008.
6. G. Calbris. Semiotics of French Gesture. Indiana University Press, Bloomington, Indiana, 1990.
7. G. Calbris. From left to right...: Coverbal gestures and their symbolic use of space. In Metaphor and Gesture, pages 27-53. John Benjamins, 2008.
8. J. Cassell, J. Sullivan, S. Prevost, and E. Churchill. Embodied Conversational Agents. MIT Press, Cambridge, MA, 2000.
9. C. Clavel, I. Vasilescu, L. Devillers, G. Richard, and T. Ehrette. The safe corpus: illustrating extreme emotions in dynamic situation. In Workshop "Corpora for research on emotion and affect". 5th International Conference on Language Resources and Evaluation (LREC'2006), pages 76-79, Genova, Italy, 2006.
10. M. Courgeon, J.-C. Martin, and C. Jacquemin. User's gestural exploration of different virtual agents' expressive profiles. In 7th Int. Conf. on Autonomous Agents and Multiagent Systems. ACM, 12-16 May 2008.
11. M. de Meijer. The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior, 13(4):247-268, 1989.
12. P. De Silva, A. Kleinsmith, and N. Bianchi-Berthouze. Towards unsupervised detection of affective body posture nuances. In J. Tao, T. Tieniu, and R. Picard, editors, 1st Int. Conf. Affective Computing and Intelligent Interaction (ACII'2005), LNCS 3783, pages 32-40, Beijing, China, 2005. Springer.
13. E. Douglas-Cowie, N. Campbell, R. Cowie, and P. Roach. Emotional speech; towards a new generation of databases. Speech Communication, 40:33-60, 2003.
14. E. Douglas-Cowie, R. Cowie, Sneddon, C. Cox, Lowry, McRorie, J.-C. Martin, L. Devillers, and A. Batliner. The humaine database: addressing the needs of the affective computing community. In A. Paiva, R. Prada, and R. Picard, editors, 2nd International Conference on Affective Computing and Intelligent Interaction (ACII'2007), LNCS, vol. 4738, pages 488-500, Lisbon, Portugal, 2007.
15. P. Ekman. Facial Expression of Emotion: New Findings, New Questions. Psychological Science, 3(1):34-38, January 1992.
16. P. Ekman. Basic emotions. In T. Dalgleish and M. J. Power, editors, Handbook of Cognition and Emotion, pages 301-320. John Wiley, New York, 1999.
17. P. Ekman and W. V. Friesen. Hand and Body Cues in the Judgment of Emotion. Perceptual and Motor Skills, 24:711-724, 1967.
18. F. Enos and J. Hirschberg. A framework for eliciting emotional speech: Capitalizing on the actor's process. In Workshop "Corpora for research on emotion and affect". 5th International Conference on Language Resources and Evaluation (LREC'2006), pages 6-10, Genova, Italy, 2006.
19. S. Frey, H. P. Hirsbrunner, A. Florin, W. Daw, and R. Crawford. A unified approach to the investigation of nonverbal and verbal behavior in communication research. In W. Doise and S. Moscovici, editors, Current Issues in European Social Psychology, pages 143-199. Cambridge University Press, Cambridge, 1983.
20. S. Frey and J. Pool. A new approach to the analysis of visible behavior. Technical Report 1976-2, University of Berlin, 1976.
21. S. Frigo. The relationship between acted and naturalistic emotional corpora. In Workshop "Corpora for research on emotion and affect". 5th International Conference on Language Resources and Evaluation (LREC'2006), pages 34-36, Genova, Italy, 2006.
22. P. Gebhard. Alma a layered model of affect. In Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, 2005.
23. H. Gunes and M. Piccardi. Fusing face and body display for bi-modal emotion recognition: Single frame analysis and multi-frame post integration. In J. Tao, T. Tieniu, and R. Picard, editors, 1st Int. Conf. Affective Computing and Intelligent Interaction (ACII'2005), LNCS 3783, pages 102-110, Beijing, China, 2005. Springer.
24. B. Hayes-Roth, R. van Gent, and D. Huber. Acting in character. In R. Trappl and P. Petta, editors, Creating Personalities for Synthetic Actors: Towards Autonomous Personality Agents, pages 92-112. Springer, New York, 1997.
25. A. Heloir and M. Kipp. Embr - a realtime animation engine for interactive embodied agents. In Proceedings of the 9th International Conference on Intelligent Virtual Agents (IVA-09), 2009.
26. K. Johnstone. Impro. Improvisation and the Theatre. Routledge/Theatre Arts Books, New York, 1979. (Corrected reprint 1981).
27. A. Kapur, A. Kapur, N. Virji-Babul, G. Tzanetakis, and P. Driessen. Gesture-based affective computing on motion capture data. In J. Tao, T. Tieniu, and R. Picard, editors, 1st Int. Conf. Affective Computing and Intelligent Interaction (ACII'2005), LNCS 3783, pages 1-8, Beijing, China, 2005. Springer.
28. M. Kipp. Anvil - a Generic Annotation Tool for Multimodal Dialogue. In Proceedings of Eurospeech, pages 1367-1370, 2001.
29. M. Kipp. Gesture Generation by Imitation: From Human Behavior to Computer Character Animation. Dissertation.com, Boca Raton, Florida, 2004.
30. M. Kipp, M. Neff, K. H. Kipp, and I. Albrecht. Toward Natural Gesture Synthesis: Evaluating gesture units in a data-driven approach. In Proc. of the 7th International Conference on Intelligent Virtual Agents (IVA-07), pages 15-28. Springer, 2007.
31. S. Kita, I. van Gijn, and H. van der Hulst. Movement phases in signs and co-speech gestures, and their transcription by human coders. In I. Wachsmuth and M. Fröhlich, editors, Gesture and Sign Language in Human-Computer Interaction, pages 23-35, Berlin, 1998. Springer.
32. E. Konijn. Acting emotions: Shaping emotions on stage. Amsterdam: Amsterdam University Press, 2000.
33. C. H. Martell. Form: An extensible, kinematically based gesture annotation scheme. In Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems. Kluwer Academic Press, 2004.
34. D. McNeill. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press, Chicago, 1992.
35. D. McNeill. Gesture and Thought. University of Chicago Press, Chicago, 2005.
36. A. Mehrabian. Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Current Psychology, 14:261-292, 1996.
37. M. Neff, M. Kipp, I. Albrecht, and H.-P. Seidel. Gesture Modeling and Animation Based on a Probabilistic Recreation of Speaker Style. ACM Transactions on Graphics, 27(1):1-24, March 2008.
38. A. Ortony, G. L. Clore, and A. Collins. The cognitive structure of emotions. Cambridge University Press, MA, 1988.
39. I. Poggi. Mind, Hands, Face and Body: A Goal and Belief View of Multimodal Communication. Weidler Buchverlag, Berlin, 2007.
40. R. Posner. Believing, causing, intending: The basis for a hierarchy of sign concepts in the reconstruction of communication. In R. J. Jorna, B. van Heusden, and R. Posner, editors, Signs, Search, and Communication: Semiotic Aspects of Artificial Intelligence, pages 215-270. deGruyter, Berlin, New York, 1993.
41. F. Poyatos. Nonverbal communication across disciplines. John Benjamins Publishing Company, Amsterdam/Philadelphia, 2002.
42. J. Russell and A. Mehrabian. Evidence for a three-factor theory of emotions. Journal of Research in Personality, 11:273-294, 1977.
43. K. R. Scherer. Emotion. In M. Stroebe and W. Hewstone, editors, Introduction to Social Psychology: A European perspective, pages 151-191. Oxford: Blackwell, 2000.
44. M. Schröder. Experimental study of affect burst. Speech Communication. Special Issue following the ISCA Workshop on Speech and Emotion, 40(1-2):99-116, 2003.
45. H. G. Wallbott. Bodily expression of emotion. European Journal of Social Psychology, 28(6):879-896, 1998.
46. R. Webb. Linguistic Properties of Metaphoric Gestures. UMI, New York, 1997.