From annotated aultimodal corpora to simulated human-like behaviors

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4930 LNAI, Issue , 2008, Pages 1-17

  Rehm, Matthias ^a   André, Elisabeth ^a  

^a UNIVERSITY OF AUGSBURG   (Germany)

Author keywords

Behavior modelling; Embodied conversational agent; Multimodal corpora; Multimodal interaction

Indexed keywords

BEHAVIORAL RESEARCH; HUMAN COMPUTER INTERACTION; INFORMATION ANALYSIS; INFORMATION USE; MODAL ANALYSIS;

BEHAVIOR MODELING; EMBODIED CONVERSATIONAL AGENT; MULTIMODAL CORPORA; MULTIMODAL INTERACTION;

COMMUNICATION SYSTEMS;

EID: 43149104722     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-79037-2_1     Document Type: Conference Paper

References (35)

1. Abrilian, S., Martin, J.-C., Buisine, S., Devillers, L.: Perception of movement expressivity in emotional tv interviews. In: HUMAINE Summerschool (2006)
2. Allwood, J., Nivre, J., Anisén, E.: On the semantics and pragmatics of linguistic feedback. Journal of Semantics 9, 1-26 (1992)
3. Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., Paggio, P.: The mumin annotation scheme for feedback, turn management and sequencing. In: Gothenburg Papers in Theoretical Linguistics 92: Proceedings from The Second Nordic Conference on Multimodal Communication, pp. 91-109 (2005)
4. Argyle, M., Cook, M.: Gaze and mutual gaze. Cambridge University Press, Cambridge (1976)
5. Brown, P., Levinson, S.C.: Politeness - Some universals in language usage. Cambridge University Press, Cambridge (1987)
6. Pelachaud, C., Martin, J.-C., Niewiadomski, R., Abrilian, S., Devillers, L., Buisine, S.: Perception of Blended Emotions: From Video Corpus to Expressive Agent. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 93-106. Springer, Heidelberg (2006)
7. Caldognetto, E.M., Poggi, I., Cosi, P., Cavicchio, F., Merola, G.: Multimodal Score: an ANVIL Based Annotation Scheme for Multimodal Audio-Video Analysis. In: Proceedings of the LREC-Workshop on Multimodal Corpora, pp. 29-33 (2004)
8. Cassell, J.: Body Language: Lessons from the Near-Human. In: Riskin, J. (ed.) The Sistine Gap: History and Philosophy of Artificial Life, University of Chicago Press, Chicago (in press)
9. Cassell, J., Vilhjalmsson, H., Bickmore, T.: BEAT: The Behavior Expression Animation Toolkit. In: Proceedings of SIGGRAPH 2001, Los Angeles, CA, pp. 477-486 (2001)
10. Chafai, N.E., Pelachaud, C., Pelé, D.: Analysis of gesture expressivity modulations from cartoon animations. In: Proceedings of the LREC-Workshop on Multimodal Corpora (2006)
11. Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE Model for Effort and Shape. In: Proceedings of SIGGRAPH, pp. 173-182 (2000)
12. Ekman, P., Rosenberg, E. (eds.): What the Face Reveals: Basic &: Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press, Oxford (1998)
13. Foster, M.E.: Issues for corpus-based multimodal generation. In: Proceedings of the Workshop on Multimodal Output Generation (MOG 2007), pp. 51-58 (2007)
14. Foster, M.E., Oberlander, J.: Data-driven generation of emphatic facial displays. In: Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics (EACL), pp. 353-360 (2006)
15. Frey, S., Hirschbrunner, H.P., Florin, A., Daw, W., Crawford, R.A.: A unified approach to the investigation of nonverbal and verbal behavior in communication research. In: Doise, W., Moscovici, S. (eds.) Current Issues in European Social Psychology, pp. 143-199. Cambridge University Press, Cambridge (1983)
16. Garau, M., Slater, M., Vinayagamoorthy, V., Brogn, A., Steed, A., Sasse, M.A.: The Impact of Avatar Realism and Eye Gaze Control on Perceived Quality of Communication in a. Shared Immersive Virtual Environment. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 529-536 (2003)
17. Höysniemi, J., Hämäläinen, P.: Describing children's intuitive movements in a perceptive adventure game. In: Martin, J.-C., Os, E.D., Kühnlein, P., Boves, L., Paggio, P., Catizone, R. (eds.) Multimodal Corpora: Models Of Human Behaviour For The Specification And Evaluation Of Multimodal Input And Output Interfaces, pp. 21-24 (2004)
18. Karpouzis, K., Raouzaiou, A., Drosopoulos, A., Ioannou, S., Balomenos, T., Tsapatsoulis, N., Kollias, S.: Facial expression and gesture analysis for emotionally-rich man-machine interaction. In: Sarris, N., Strintzis, M. (eds.) 3D Modeling and Animation: Synthesis and Analysis Techniques, pp. 175-200. Idea Group, USA (2004)
19. Kendon, A.: Some functions of gaze direction in social interaction. Acta Psychology 32, 1-25 (1967)
20. Kendon, A.: Gesture - Visible Action as Utterance. Cambridge University Press, Cambridge (2004)
21. Kipp, M.: Creativity meets Automation: Combining Nonverbal Action Authoring with Rules and Machine Learning. In: Gratch, J., et al. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 230-242. Springer, Heidelberg (2006)
22. Kipp, M., Neff, M., Albrecht, I.: An annotation scheme for conversational gestures: How to economically capture timing and form. In: Proceedings of the LRECWorkshop on Multimodal Corpora, pp. 24-27 (2006)
23. Knudsen, M.W., Martin, J.-C., Dybkjr, L., Ayuso, M.J.M., Bernsen, N.O., Carletta, J., Heid, U., Kita, S., Lüstern, J., Pelachaud, C., Poggi, I., Reithinger, N., van Elswijk, G., Wittenburg, P.: ISLE Natural Interactivity and Multimodality Working Group Deliverable D9.1: Survey of Multimodal Coding Schemes and Best Practice (2002), URL(07.02.07): http://isle.nis.sdu/dk/reports/ wp9/D9.1-7.3.2002-F.pdf
24. Lamb, W., Watson, E.: Body Code: The Meaning in Movement. Routledge & Kegan Paul, London (1979)
25. Lee, S.P., Badler, J.B., Badler, N.L: Eyes alive. In: Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pp. 637-644 (2002)
26. McNeill, D.: Hand and Mind - What Gestures Reveal about Thought. The University of Chicago Press, Chicago, London (1992)
27. Nakano, Y.I., Reinstein, G., Stocky, T., Cassell, J.: Towards a Model of Face-to-face Grounding. In: Proceedings of the Association for Computational Linguistics, Sapporo, Japan, July 1-12, pp. 553-561 (2003)
28. Pelachaud, C.: Multimodal expressive embodied conversational agents. In: Proceedings of ACM Multimedia, pp. 683-689 (2005)
29. Poggi, I., Pelachaud, C., Magno Caldognetto, E.: Gestural Mind Markers in ECAs. In: Gesture-Based Communication in Human-Computer Interaction, pp. 338-349. Springer, Heidelberg (2004)
30. André, E., Rehm, M.: Where Do They Look? Gaze Behaviors of Multiple Users Interacting with an Embodied Conversational Agent. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 241-252. Springer, Heidelberg (2005)
31. Rehm, M., André, E.: Informing the design of agents by corpus analysis. In: Nishida, T., Nakano, Y. (eds.) Conversational Informatics, John Wiley & Sons, Chichester (2007)
32. Sidner, C.L., Lee, C., Kidd, C., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artificial Intelligence 166(1-2), 140-164 (2005)
33. Stone, M., DeCarlo, D., Oh, I., Rodriguez, C., Stere, A., Lees, A., Bregler, C.: Speaking with Hands: Creating Animated Conversational Characters from Recordings of Human Performance. ACM Transactions on Graphics 23(3), 506-513 (2004)
34. Tsapatsoulis, N., Raouzaiou, A., Kollias, S., Cowie, R., Douglas-Cowie, E.: Emotion Recognition and Synthesis based on MPEG-4 FAPs. In: Pandzic, I., Forchheimer, R. (eds.) MPEG-4 Facial Animation, pp. 141-167. John Wiley & Sons, Chichester (2002)
35. Walker, M.A., Cahn, J.E., Whittaker, S.J.: Improvising Linguistic Style: Social and Affective Bases for Agent Personality. In: Proceedings of AAMAS 1997, pp. 96-105 (1997)