Modeling parallel state charts for multithreaded multimodal dialogues

ICMI'11 - Proceedings of the 2011 ACM International Conference on Multimodal Interaction

Volumn , Issue , 2011, Pages 385-392

  Mehlmann, Gregor ^a   Endrass, Birgit ^a   André, Elisabeth ^a  

^a UNIVERSITY OF AUGSBURG   (Germany)

Author keywords

dialogue modeling; multimodality; multithreading

Indexed keywords

CONTEXT-SENSITIVE; DIALOGUE MODELING; GAME SCENARIO; IN-FIELD; MODELING APPROACH; MULTI-MODALITY; MULTI-THREADING; MULTIMODAL DIALOGUE; MULTITHREADED; REAL TIME VISUALIZATION; RUNTIMES; SCOPING; STATE CHARTS; VIRTUAL CHARACTER;

RAPID PROTOTYPING; VISUALIZATION;

INTERACTIVE COMPUTER SYSTEMS;

EID: 83455223788     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2070481.2070555     Document Type: Conference Paper

References (37)

1. J. Brusk, T. Lager, A. Hjalmarsson, and P. Wik. Deal: Dialogue management in scxml for believable game characters. In ACM Future Play, pages 137-144. ACM, 2007.
2. H. Bunt, J. Alexandersson, J. Carletta, J.-W. Choe, A. C. Fang, K. Hasida, K. Lee, V. Petukhova, A. Popescu-Belis, L. Romary, C. Soria, and D. R. Traum. Towards an ISO standard for dialogue act annotation. In 7th International Conference on Language Resources and Evaluation (LREC), Valletta, Malta, May 19-21, 2010 2010.
3. M. Cavazza, F. Charles, and S.-J. Mead. Agents' Interaction in Virtual Storytelling. In IVA 2001, pages 156-170, 2001.
4. M. Core and J. Allen. Coding Dialogs with the DAMSL Annotation Scheme. In Working Notes of AAAI Fall Symposium on Communicative Action in Humans and Machines, 1997.
5. B. Endrass, M. Wissner, G. Mehlmann, R. Buehling, M. Haering, and E. André. Teenage Girls as Authors for Digital Storytelling - A Practical Experience Report. In Workshop on Education in Interactive Digital Storytelling on ICIDS, 2010.
6. R. Engel. Robust and efficient semantic parsing of freeword order languages in spoken dialogue systems. In Interspeech 2005, 2005.
7. S. Gandhe, N. Whitman, D. Traum, and R. Artstein. An integrated authoring tool for tactical questioning dialogue systems, 2008.
8. P. Gebhard, M. Kipp, M. Klesen, and T. Rist. Authoring scenes for adaptive, interactive performances. In AAMAS 2003, pages 725-732. ACM, 2003.
9. P. Gebhard, M. Schröder, M. Charfuelan, C. Endres, M. Kipp, S. Pammi, M. Rumpler, and O. Türk. IDEAS4Games: Building Expressive Virtual Characters for Computer Games. In IVA 2008, pages 426-440, 2008.
10. D. Harel. Statecharts: A visual formalism for complex systems. In Science of Computer Programming, volume 8, pages 231-274. Elsevier, 1987.
11. S. Heidig and G. Clarebout. Do pedagogical agents make a difference to student motivation and learning? A review of empirical research. Educational Research Review, 2010.
12. I. Iurgel. Cyranus : An authoring tool for interactive edutainment applications. In Technologies for E-Learning and Digital Entertainment, Hangzhou, China, April 16-19 2006. Springer, Berlin.
13. I. A. Iurgel, R. E. da Silva, P. R. Ribeiro, A. B. Soares, and M. F. dos Santos. CREACTOR - An Authoring Framework for Virtual Actors. In IVA 2009, pages 562-563. Springer, 2009.
14. M. Kipp and P. Gebhard. IGaze: Studying reactive gaze behavior in semi-immersive human-avatar interactions. In IVA 2008, pages 191-199, 2008.
15. M. Kipp, A. Heloir, P. Gebhard, and M. Schröder. Realizing multimodal behavior: Closing the gap between behavior planning and embodied agent presentation. In IVA 2010. Springer, 2010.
16. M. Kipp, M. Neff, K. H. Kipp, and I. Albrecht. Toward natural gesture synthesis: Evaluating gesture units in a data-driven approach. In IVA 2007, LNAI 4722, pages 15-28, 2007.
17. S. Kopp, B. Krenn, S. Marsella, A.-N. Marshall, C. Pelachaud, H. Pirker, K.-R. Thórisson, and H. Vilhjálmsson. Towards a common framework for multimodal generation: The behavior markup language. In IVA 2006, 2006.
18. A. Kröner, P. Gebhard, L. Spassova, G. Kahl, and M. Schmitz. Informing customers by means of digital product memories. In 1st international Workshop on Digital Object Memories, 2009.
19. S. Marsella and J. Gratch. Ema: A computational model of appraisal dynamics. In Agent Construction and Emotions, 2006.
20. S. Marsella, W.-L. Johnson, and C.-M. Labore. Interactive pedagogical drama for health interventions. In Artificial Intelligence in Education, pages 341-348. IOS Press, 2003.
21. M. Mateas and A. Stern. Facade: An experiment in building a fully-realized interactive drama. In Game Developer's Conference: Game Design Track, 2003.
22. D. McNeill. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press, 1992.
23. M. F. Mctear. Using the cslu toolkit for practicals in spoken dialogue technology. In University College London, pages 1-7, 1999.
24. G. Mehlmann, M. Häring, R. Bühling, M. Wissner, and E. André. Multiple agent roles in an adaptive virtual classroom environment. In J. Albeck, N. Badler, T. Bickmore, C. Pelachaud, and A. Safonova, editors, IVA 2010, pages 250-256. Springer, 2010.
25. J. Miksatko, K.-H. Kipp, and M. Kipp. The persona zero-effect: Evaluating virtual character benefits ona learning task. In IVA 2010. Springer, 2010.
26. C. Pelachaud. Multimodal expressive embodied conversational agents. In ACM international conference on Multimedia, pages 683-689, 2005.
27. K. Perlin and A. Goldberg. Improv: A system for scripting interactive actors in virtual worlds. In Computer Graphics (SIGGRAPH), pages 205-216. ACM, 1996.
28. H. Prendinger, S. Saeyor, and M. Ishizuk. MPML and SCREAM: Scripting the Bodies and Minds of Life-like Characters. In Life-like Characters - Tools, Affective Functions, and Applications, pages 213-242. Springer, 2004.
29. M. Rehm, N. Bee, B. Endrass, M. Wissner, and E. André. Too close for comfort? Adapting to the user's cultural background. In Workshop on Human-Centered Multimedia, 2007.
30. M. Riedl, C.-J. Saretto, and R.-M. Young. Managing interaction between users and agents in a multi-agent storytelling environment. In AAMAS 2003, pages 741-748. ACM, 2003.
31. M. Schröder. Emotions in the Human Voice, Culture and Perception, volume 3, chapter Approaches to emotional expressivity in synthetic speech, pages 307-321. Pural, 2008.
32. M. Si, S. Marsella, and D. Pynadath. Thespian: An architecture for interactive pedagogical drama. In AIED 2005, 2005.
33. U. Spierling, S.-A. Weiss, and W. Mueller. Towards accessible authoring tools for interactive storytelling. In Technologies for Interactive Digital Storytelling and Entertainment. Springer, 2006.
34. W. Swartout, J. Gratch, R. Hill, E. Hovy, S. Marsella, J. Rickel, and D. Traum. Toward virtual humans. AI Magazine, 27(2):96-108, 2006. (Pubitemid 44054833)
35. D. Traum, A. Leuski, A. Roque, S. Gandhe, D. DeVault, J. Gerten, S. Robinson, and B. Martinovski. Natural language dialogue architectures for tactical questioning characters. In Army Science Conference, 2008.
36. H. Vilhjalmsson, N. Cantelmo, J. Cassell, N.-E. Chafai, M. Kipp, S. Kopp, M. Mancini, S. Marsella, A.-N. Marshall, C. Pelachaud, Z. Ruttkay, K.-R. Thórisson, H. van Welbergen, and R.-J. van der Werf. The behavior markup language: Recent developments and challenges. In IVA 2007, 2007.
37. M. von der Beeck. A comparison of statecharts variants. In ProCoS 1994, pages 128-148. Springer, 1994.