Collection and annotation of a corpus of human-human multimodal interactions: Emotion and others anthropomorphic characteristics

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4738 LNCS, Issue , 2007, Pages 464-475

  Zara, Aurélie ^a,b   Maffiolo, Valérie ^a   Martin, Jean Claude ^b   Devillers, Laurence ^b  

^a ORANGE LABS   (France)

^b CNRS   (France)

Author keywords

Annotation; Corpus collection; Human human interaction; Multimodal behaviours

Indexed keywords

HUMAN COMPUTER INTERACTION; USER INTERFACES;

ANNOTATION METHODOLOGY; CORPUS COLLECTION; EMOTABOO PROTOCOL; MULTIMODAL BEHAVIOURS;

INTERACTIVE COMPUTER SYSTEMS;

EID: 38049034874     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-74889-2_41     Document Type: Conference Paper

References (43)

1. Kaiser, S., Wehrle, T., Edwards, P.: Multi-modal emotion measurement in an interactive computer game. A pilot study. 8th Conference of the International Society for Research on Emotions (1993)
2. Wang, N., Marsella, S.: An Emotion Evoking Game. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, Springer, Heidelberg (2006)
3. Picard, R.: Affective Computing. MIT Press, Cambridge (1997)
4. Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., De Carolis, B.: GRETA. A Believable Embodied Conversational Agent. In: Stock, O., Zancarano, M. (eds.) Multimodal Intelligent Information Presentation, Kluwer, Dordrecht (2005)
5. Prendinger, H., Descamps, S., Ishizuka, M.: Scripting Affective Communication with Lifelike Characters. In Web-based Interaction Systems. Applied Artificial, Intelligence Journal 16(7-8), 519-553 (2002)
6. Ekman, P.: Emotions revealed. Understanding faces and feelings. In: Weidenfeld & Nicolson (2003)
7. Douglas-Cowie, E., Campbell, N., Cowie, R., Roach, P.: Emotional speech - Towards a new generation of databases. In Speech Communication 40, 33-60 (2003)
8. Schröder, M.: Experimental study of affect burst. In Speech Communication. Special Issue following the ISCA Workshop on Speech and Emotion 40(1-2), 99-116 (2003)
9. Wallbott, H.G.: Bodily expression of emotion. In European Journal of Social Psychology 28, 879-896 (1998)
10. Martin, J.C., Abrilian, S., Devillers, L.: Annotating Multimodal Behaviors Occurring during Non Basic Emotions. 1st Int. Conf. Affective Computing and Intelligent Interaction (ACII'2005), Beijing, China (October 2005)
11. Le Chenadec, G., Maffiolo, V., Chateau, N., Colletta, J.: Creation of a corpus of multimodal spontaneous expressions of emotions in Human-Machine Interaction. 5th Int. Conference on Language Resources and Evaluation (LREC'2006), Genova, Italy, (May 2006)
12. Bänziger, T., Pirker, H., Scherer, K., GEMEP.: - Geneva Multimodal Emotion Portrayals: A corpus for the study of multimodal emotional expressions. Workshop "Corpora for research on emotion and affect (LREC'2006), Genova, Italy (May 2006)
13. Reidsma, D., Heylen, D., Ordelman, R.: Annotating emotion in meetings. 5th Int. Conf. on Language Resources and Evaluation (LREC'2006), Genova, Italy (May 2006)
14. Campbell N.: A Language-Resources Approach to Emotion: Corpora for the analysis of Expressive Speech. Workshop Corpora for research on Emotion and Affect (LREC'2006), Genova, Italy (May 2006)
15. Poggi, I.: Mind Markers. 5th International Pragmatics Conference, Mexico (July 1996)
16. Forgas, J.: Affective influences on attitudes and judgements. In: Davidson, R., Scherr, K., Goldsmith, H. (eds.) Handbook of Affective Studies, Oxford University Press, Oxford (2003)
17. Krone, H.W.: Individual differences in emotional reactions and coping. In: Davidson, R.J., Scherer, K.R., Goldsmith, H.H (eds.) Handbook of Affective Sciences, pp. 698-725. Oxford University Press, New York (2003)
18. Knutson, B.: Facial expressions of emotion influence interpersonal trait inferences. In Journal of Nonverbal Behavior 20, 165-182 (1996)
19. Baron-Cohen, S., Riviere, A., Fukushima, M., French, D., Hadwin, J., Cross, P., Bryant, C., Sotillo, M.: Reading the Mind in the Face. A Cross-cultural and Developmental Study, Visual Cognition 3, 39-59 (1996)
20. Baron-Cohen, S., Wheelwright, S., Jolliffe, T.: Is There a Language of the Eyes? Evidence from Normal Adults, and Adults with Autism or Asperger Syndrome. In Visual Cognition 4(3), 311-331 (1997)
21. Hall, J.A., Coats, E.J., Smith LeBeau, L.: Nonverbal behavior and the vertical dimension of social relations: A meta-analysis
22. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N.: Emotion recognition in human-computer interaction. In IEEE Signal Processing Magazine 18(1), 32-80 (2001)
23. Argyle, M.: Bodily communication. Second edition. London and New York, Routledge. Taylor & Francis. 0-415-05114-2 (2004)
24. Thomas, F., Johnson, O.: Disney Animation.The illusion of life. Abbeville Press (1981)
25. Eysenck H. J. and Eysenck S. B. G.: Manuel de l'Inventaire de Personnalité d'Eysenck. Paris. Les éditions du Centre de Psychologie Appliquée (1971)
26. Craggs, R., Wood, M.M.: A categorical annotation scheme for emotion in the linguistic content. Presented at Affective Dialogue Systems (ADS'2004), Kloster Irsee, Germany (2004)
27. Scherer, K.R.: Emotion. In: Stroebe, M.H.W, (ed.) In Introduction to Social Psychology: A European perspective, pp. 151-191. Blackwell, Oxford (2000)
28. Auberge, V., Audibert, N., Rilliard, A.: Auto-annotation: an alternative method to label expressive corpora. In: LREC 2006 Workshop on Emotional Corpora, Genova, Italy, pp. 45-46 (2006)
29. Valitutti, A., Strapparava, C., Stock, O.: Developing affective lexical resources. Psychology 2(1), 61-83 (2004)
30. Mathieu, Y.Y.: Annotations of Emotions and Feelings in Texts. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, Springer, Heidelberg (2005)
31. Barrett, L.F.: Solving the emotion paradox: categorization and the experience of emotion. In Personality and Social Psychology Review 10(1), 20-46 (2006)
32. Devillers, L., Abrilian, S., Martin, J.C.: Representing real life emotions in audiovisual data with non basic emotional patterns and context features. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, Springer, Heidelberg (2005)
33. Core, M.G., Allen, J.F.: Coding Dialogues with the DAMSL Annotation Scheme, presented at AAAI Fall Symposium on Communicative Action in Humans and Machines, Menlo Park, California (1997)
34. Kipp, M.: Gesture Generation by Imitation - From Human Behavior to Computer Character Animation. Boca Raton, Florida: Dissertation.com (2004)
35. Zara, A., Martin, J.C., Devillers, L., Maffiolo, V., Le Chenadec, G.: Gestural expressions of emotion in human interactions. International Society for Gesture Studies Conference, Evanston United States (accepted 2007)
36. Lindquist, K.A., Barrett, L.F., Bliss-Moreau, E., Russel, J.A.: Language and the perception of emotion. In Emotion 6(1), 125-138 (2006)
37. Innes-Ker, A., Niedenthal, P.M.: Emotion concepts and emotional states in social judgment and categorization. Journal of Personality and Social Psychology 83, 804-816 (2002)
38. Russel, J.A.: A circumplex model of affect. In Journal of Personality and Social Psychology 45, 1281-1288 (1980)
39. Plutchik, R.: The emotion. Boston: University Press of America (1991)
40. Galati, D., Innes-Ker, A., Niedenthal, P.M.: Emotion concepts and emotional states in social judgment and categorization. Journal of Personality and Social Psychology 83, 804-816 (2002)
41. Gebhard, P., ALMA,: - A Layered Model of Affect Fourth International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS'05), Utrecht (2005)
42. Wiggins, J.S.: The Five-Factor Model of Personality. Theoretical perspectives, The Guildford Press (1996)
43. Martin, J. C,: Multimodal Human-Computer Interfaces and Individual Differences. Habilitation à diriger des recherches en Informatique. Université Paris XI (2006)