E-drama: Facilitating online role-play using an ai actor and emotionally expressive characters

International Journal of Artificial Intelligence in Education

Volumn 19, Issue 1, 2009, Pages 5-38

  Zhang, Li ^a   Gillies, Marco ^b   Dhaliwal, Kulwant ^c   Gower, Amanda ^d   Robertson, Dale ^d   Crabtree, Barry ^d  

^a TEESSIDE UNIVERSITY   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c The Arch   (United Kingdom)

^d MARTLESHAM HEATH   (United Kingdom)

Author keywords

Affect detection; E drama; Emotionally expressive behaviour and an educational improvisational interactive environment

Indexed keywords

EID: 73449137566     PISSN: 15604292     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (55)

1. Argyle, M., & Cook, M. (1976). Gaze and Mutual Gaze. Cambridge University Press.
2. Aylett, R. S., Dias, J., & Paiva, A. (2006). An affectively-driven planner for synthetic characters. In D. Long, S. F. Smith, D. Borrajo & L. McCluskey (Eds.) Proceedings of the Sixteenth International Conference on Automated Planning and Scheduling (ICAPS 2006) (pp. 2-10). AAAI Press.
3. Aylett, R., Louchart, S., Dias, J., Paiva, A., Vala, M., Woods, S., & Hall, L. E. (2006). Unscripted Narrative for Affectively Driven Characters. IEEE Computer Graphics and Applications, 26(3), 42-52. (Pubitemid 46404983)
4. Barnden, J. A., Glasbey, S. R., Lee, M. G., & Wallington, A. M. (2004). Varieties and Directions of Interdomain Influence in Metaphor. Metaphor and Symbol, 19(1), 1-30.
5. Brand, M., & Hertzmann, A. (2000). Style Machines. In Proceedings of the 27th Annual Conference on Computer Graphics SIGGRAPH 2000 (pp. 183-192). New Orleans, Louisiana, USA, July 23-28. ACM.
6. Briscoe, E., & Carroll, J. (2002). Robust Accurate Statistical Annotation of General Text. In Proceedings of the 3rd International Conference on Language Resources and Evaluation (pp. 1499-1504). Las Palmas, Gran Canaria.
7. Carletta, J. (1996). Assessing Agreement on Classification Tasks: The Kappa statistic. Computational Linguistics, 22(2), 249-254.
8. Cassell, J., & Thórisson, K. R. (1999). The Power of a Nod and a Glance: Envelope vs. Emotional Feedback in Animated Conversational Agents. International Journal of Applied Artificial Intelligence, 13(4-5), 519-538.
9. Cassell, J., & Vilhjálmsson, H. (1999). Fully Embodied Conversational Avatars: Making Communicative Behaviors Autonomous. Autonomous Agents and Multi-Agent Systems, 2(1), 45-64.
10. Cassell, J., Stocky, T., Bickmore, T., Gao, Y., Nakano, Y., Ryokai, K., Tversky, D., Vaucelle, C., & Vilhjálmsson, H. (2002). MACK: Media lab Autonomous Conversational Kiosk. In Proceedings of Imagina '02. February 12-15, Monte Carlo.
11. Cavazza, M., Smith, C., Charlton, D., Zhang, L., Turunen, M., & Hakulinen, J. (2008). A 'Companion' ECA with Planning and Activity Modeling. In L. Padgham, D. Parkes, J. Müller & S. Parsons (Eds.) Proceedings of the 7th International Conference on Autonomous Agents and Multiagent Systems (pp. 1281-1284). May 2008. Portugal.
12. Chi, D., Costa, M., Zhao, L., & Badler, N. I. (2000) The EMOTE Model for Effort and Shape. In Proceedings of the 27th Annual Conference on Computer Graphics SIGGRAPH 2000 (pp. 173-182). New York, NY: ACM Press.
13. Chopra-Khullar, S., & Badler, N. (1999). Where to look? Automating visual attending behaviors of virtual human characters. In O. Etzioni, J. P. Müller & J. M. Bradshaw (Eds.) Proceedings of the Third Annual Conference on Autonomous Agents (pp. 16-23). Seattle, Washington, United States.
14. Craggs, R., & Wood. M. (2004). A Two Dimensional Annotation Scheme for Emotion in Dialogue. In Y. Qu, J. Shanahan & J. Wiebe (Eds.) Exploring Attitude and Affect in Text: Theories and Applications. Papers from the AAAI Spring Symposium (pp. 44-49). Technical Report SS-04-07. Menlo Park, CA: AAAI Press.
15. Egges, A., Kshirsagar, S., & Magnenat-Thalmann, N. (2003). A Model for Personality and Emotion Simulation. In V. Palade, R. J. Howlett & L. C. Jain (Eds.) Proceedings of 7th International Conference of Knowledge- Based Intelligent Information and Engineering Systems (KES 2003) (pp. 453-461). LNAI 2773. Berlin: Springer-Verlag.
16. Ekman, P. (1982) Emotion in the Human Face. Cambridge University Press.
17. Elliott, C., Rickel, J., & Lester, J. (1997). Integrating Affective Computing into Animated Tutoring Agents. In Proceedings of the IJCAI Workshop on Animated Interface Agents: Making Them Intelligent (pp. 113-121). Nagoya, Japan.
18. Esuli, A., & Sebastiani, F. (2006). Determining Term Subjectivity and Term Orientation for Opinion Mining. In Proceedings of EACL-06, 11th Conference of the European Chapter of the Association for Computational Linguistics (pp. 193-200). Trento, Italy. ACL.
19. Fellbaum, C. (1998). WordNet, an Electronic Lexical Database. Cambridge, MA: MIT Press.
20. Friedman, D., Steed, A., & Slater, M. (2007). Spatial Social Behavior in Second Life. In C. Pelachaud, J.-C. Martin, E. Andre, G. Chollet, K. Karpouzis & D. Pelè (Eds.) Intelligent Virtual Agents: Proceedings of the 7th International Workshop on Intelligent Virtual Agents (pp. 252-263). LNAI 4722. Berlin: Springer.
21. Fussell, S., & Moss, M. (1998). Figurative Language in Emotional Communication. In S. R. Fussell & R. J. Kreuz (Eds.) Social and Cognitive Approaches to Interpersonal Communication (pp.113-142). Lawrence Erlbaum.
22. Garau, M., Slater, M., Bee, S., & Sasse, M.A. (2001). The impact of eye gaze on communication using humanoid avatars. In M. Beaudouin-Lafon & R. J. K. Jacob (Eds.) Proceedings of the SIGCHI conference on Human Factors in Computing Systems (pp. 309-316). March 31 - April 5, 2001, Seattle, WA USA. ACM Press.
23. Garau, M., Slater, M., Vinayagamoorhty, V., Brogni, A., Steed, A., & Sasse, M.A. (2003). The Impact of Avatar Realism and Eye Gaze Control on Perceived Quality of Communication in a Shared Immersive Virtual Environment. In G. Cockton & P. Korhonen (Eds.) Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 529-536). New York, NY: ACM Press.
24. Gillies, M., & Ballin, D. (2004). Integrating autonomous behavior and user control for believable agents. In G. Cockton & P. Korhonen (Eds.) Proceedings of the Third International Joint Conference on Autonomous Agents and Multi-Agent Systems (pp. 336-343). Columbia University, New York. IEEE Computer Society.
25. Gillies, M., & Dodgson, N. A. (2002). Eye Movements and Attention for Behavioural Animation. Journal of Visualization and Computer Animation, 13, 287-300.
26. Gillies, M., Ballin, D., Dodsgon, N.A., & Slater, M. (2002). Integrating internal behavioural models with external expressions. In H. Prendinger (Ed.) Proceedings of the International Workshop on Lifelike Animated Agents: Tools, Affective Functions, and Applications (pp. 34-39). Held at 7th Pacific Rim International Conference on AI (PRICAI-02). August 19, Tokyo, Japan.
27. Gratch, J., & Marsella, S. (2004). A Domain-Independent Framework for Modeling Emotion. Journal of Cognitive Systems Research, 5(4), 269-306.
28. Hartmann, B., Mancini, M., & Pelachaud, C. (2006). Implementing Expressive Gesture Synthesis for Embodied Conversational Agents. In S. Gibet, N. Courty, J.-H. Kamp, (Eds.) Gesture in Human-Computer Interaction and Simulation (pp. 188-199). LNAI 3881. Berlin: Springer-Verlag.
29. Heck, R., Kovar, L., & Gleicher. M. (2006). Splicing Upper-Body Actions with Locomotion. Computer Graphics Forum, 25(3), 459-466.
30. Heise, D. R. (1965). Semantic Differential Profiles for 1,000 Most Frequent English Words. Psychological Monographs. 79(8), Whole of 601.
31. Kopp, S., & Wachsmuth, I. (2004). Synthesizing Multimodal Utterances for Conversational Agents. Journal of Computer Animation and Virtual Worlds, 15(1), 39-52.
32. Lee S. P., Badler, J. B., & Badler, N. (2002). Eyes Alive. ACM Transactions on Graphics, 21(3), 637-644.
33. Lee, J., Marsella, S., Traum, D. R., Gratch, J., & Lance, B. (2007). The Rickel Gaze Model: A Window on the Mind of a Virtual Human. In C. Pelachaud, J.-C. Martin, E. Andre, G. Chollet, K. Karpouzis & D. Pelè (Eds.) Proceedings of Intelligent Virtual Agents, 7th International Conference, (IVA 2007) (pp 296-303). LNCS 4722. Berlin: Springer.
34. Li, Y., Wang, T., & Shum, H-Y. (2002). Motion texture: a two-level statistical model for character motion synthesis. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques (pp 465-472). ACM Press.
35. Magerko, B., Laird, J. E., Assanie, M., Kerfoot, A., & Stokes, D. (2004). AI Characters and Directors for Interactive Computer Games. In Proceedings of the Nineteenth National Conference on Artificial Intelligence, Sixteenth Conference on Innovative Applications of Artificial Intelligence (pp 877-883). AAAI Press / MIT Press.
36. Mateas, M. (2002). Interactive Drama, Art and Artificial Intelligence. Ph.D. Thesis. School of Computer Science, Carnegie Mellon University.
37. McCrae, R. R., & John, O. P. (1992). An Introduction to the Five Factor Model and Its Application. Journal of Personality, 60, 175-215.
38. Mehdi, E. J., Nico, P., Julie, D., & Bernard, P. (2004). Modeling Character Emotion in an Interactive Virtual Environment. In Proceedings of AISB 2004 Symposium Language, Speech & Gesture for Expressive Characters. Leeds, UK.
39. Ortony, A., Clore, G.L., & Collins, A. (1988). The Cognitive Structure of Emotions. Cambridge University Press.
40. Pelachaud, C., & Poggi, I. (2002). Subtleties of Facial Expressions in Embodied Agents. Journal of Visualization and Computer Animation, 13, 301-312.
41. Picard, R.W. (2000). Affective Computing. Cambridge, MA: MIT Press.
42. Prendinger, H., & Ishizuka, M. (2001). Simulating Affective Communication with Animated Agents. In Proceedings of Eighth IFIP TC.13 Conference on Human-Computer Interaction (pp.182-189). Tokyo, Japan.
43. Riedl, M. O., & Young, R. M. (2006). From Linear Story Generation to Branching Story Graphs. IEEE Computer Graphics and Applications, 26(3), 23-31.
44. Rose, C., Cohen, M. F., & Bodenheimer, B. (1998). Verbs and Adverbs: Multidimensional Motion Interpolation. IEEE Computer Graphics & Applications, 18(5), 32-40.
45. Sharoff, S. (2005). How to Handle Lexical Semantics in SFL: a Corpus Study of Purposes for Using Size Adjectives. Systemic Linguistics and Corpus. London: Continuum.
46. Slater, M., Guger, C., Edlinger, G., Leeb, R., Pfurtscheller, G., Antley, A., Garau, M., Brogni, A., Steed, A., & Friedman, D. (2006). Analysis of Physiological Responses to a Social Situation in an Immersive Virtual Environment, Presence. Teleoperators and Virtual Environments, 15(5), 553-569. (Pubitemid 44728706)
47. Tanguy, E. A. R., Willis, P. J., & Bryson, J. J. (2003). A Layered Dynamic Emotion Representation for the Creation of Complex Facial Animation. In T. Rist, R. Aylett, D. Ballin & J. Rickel (Eds.) Proceedings of Intelligent Virtual Agents (pp. 101-105). LNCS 2792. Berlin: Springer-Verlag.
48. Vilhjálmsson, H., & Cassell, J. (1998). BodyChat: Autonomous Communicative Behaviors in Avatars. In K. P. Sycara & M. Wooldridge (Eds.) Proceedings of Second International Conference on Autonomous Agents (pp. 269-276). New York, NY: ACM Press.
49. Vinayagamoorthy, V., Garau, M., Steed, A., & Slater, M. (2004). An Eye Gaze Model for Dyadic Interaction in an Immersive Virtual Environment: Practice and Experience. Computer Graphics Forum, 23(1), 1-12.
50. Vinayagamoorthy, V., Gillies, M., Steed, A., Tanguy, E., Pan, X., Loscos, C., & Slater, M. (2006). Building Expression into Virtual Characters. In Proceedings of Eurographics 2006, 04-08 Sept 2006, Vienna, Austria.
51. Weizenbaum, J. (1966). ELIZA - A Computer Program For the Study of Natural Language Communication Between Man and Machine. Communications of the ACM, 9(1), 36-45.
52. Wiltschko, W. R. (2003). Emotion Dialogue Simulator. eDrama learning, Inc. eDrama Front Desk.
53. Zhang, L., Barnden, J. A., Hendley, R. J., & Wallington, A. M. (2006). Exploitation in Affect Detection in Open-ended Improvisational Text. In Proceedings of Workshop on Sentiment and Subjectivity (pp. 47-55). Held at COLING-ACL 2006, Sydney, July 2006.
54. Zhang, L., Gillies, M., Barnden, J. A., & Hendley, R. J. (2007). An Improvisational AI Agent and Emotionally Expressive Characters. In Proceedings of the Workshop on Narrative Learning Environments (pp. 60-69). Supplementary Proceedings of the 13th International Conference of Artificial Intelligence in Education (AIED 2007), July 9-13, 2007, Los Angeles, USA. Amsterdam: IOS Press.
55. Zhe, X., & Boucouvalas, A. C. (2002). Text-to-Emotion Engine for Real Time Internet Communication. In Proceedings of International Symposium on Communication Systems, Networks and DSPs (pp.164-168). Staffordshire University, UK.