Intelligent virtual humans with autonomy and personality: State-of-the-art

Intelligent Decision Technologies

Volumn 1, Issue 1-2, 2007, Pages 3-15

  Kasap, Zerrin ^a   Magnenat Thalmann, Nadia ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

Decision making; Intelligent virtual human; Interaction

Indexed keywords

EID: 85013595039     PISSN: 18724981     EISSN: 18758843     Source Type: Journal    
DOI: 10.3233/IDT-2007-11-202     Document Type: Article

References (112)

1. A. Egges and N. Magnenat-Thalmann, Emotional Communicative Body Animation for Multiple Characters, ln V-Crowds’05, Lausanne, Switzerland, 2005, 31-40.
2. D. Romano, G. Sheppard, J. Hall, A. Miller and Z. Ma, Basic: A Believable, Adaptable Socially Intelligent Character for Social Presence In PRESENCE 2005, The 8th Annual International Workshop on Presence, 2005.
3. N. Magnenat-Thalmann, A. Egges and T. Molet, Personalised Real-Time Idle Motion Synthesis, In Pacific Graphics 2004, Seoul, Korea, 2004, 121-130.
4. A. Collins, A. Ortony and G.L. Clore, The Cognitive Structure of Emotions, Cambridge University Press, 1988.
5. D. Sobral, A. Paiva, J. Dias and R. Aylett, Caring for Agents and Agents that Care: Building Empathic Relations with Synthetic Agents In Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems, 2004.
6. G. Wyvill, A. Pearce, B. Wyvill and D. Hill, Speech and Expression: A Computer Solution to Face Animation, In Graphics Interface 86, 1986, 136-140.
7. K. Karpouzis, A. Raouzaiou and S. Kollias, Emotion Synthesis in Virtual Environments In 6th International Conference on Enterprise Information Systems, 2004.
8. Webpage AIML, http://www.alicebot.org, Accessed September 2006.
9. R. Bindiganavale, W. Schuler, J.M. Allbeck, N.I. Badler, A.K. Joshi and M. Palmer, Dynamically Altering Agent Behaviors using Natural Language Instructions, In Proceedings of the fourth international conference on Autonomous agents, 2000, 293-300.
10. G. Arbantes and F. Pereira, Mpeg-4 facial animation technology: Survey, implementation, and results, IEEE Transactions on Circuits and Systems for Video Technology 9(2) (1999), 290-305.
11. G.E. Churcher, E.S. Atwell and C. Souter, Dialogue management systems: A survey and overview, Technical report, University ofLeeds, 1997.
12. R. Aylett and M. Luck, Applying artificial intelligence to virtual reality: Intelligent virtual environments, Applied Artificial Intelligence 14(1) (2000), 3-32.
13. C. Pelachaud, B. Hartmann and M. Mancini, Implementing Expressive Gesture Synthesis for Embodied Conversational Agents In Gesture Workshop. LNAI, Springer, 2005, 188199.
14. C. Bartneck, Integrating the Occ Model of Emotions in Embodied Characters In Proceedings of the Workshop on Workshop on Virtual Conversational Characters: Applications, Methods, and Research Challenges, Melbourne, 2002.
15. T. Bickmore and J. Cassell, Social dialogue with embodied conversational agents, in: Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems, J. van Kup-pevelt, L. Dybkjaer and N. Bernsen, eds, New York: Kluwer Academic, 2005.
16. C. Bordeux, R. Boulic and D. Thalmann, An efficient and flexible perception pipeline for autonomous agents, Computer Graphics Forum (Eurographics '99) 18(3) (1999), 23-30.
17. M. Brand, Voice Puppetry, Proceedings of SIGGRAPH 1999, 1999, 21-28.
18. N. Bratman, Intention, Plans, and Practical Reason, Cambridge, Mass:Harvard University Press, 1987.
19. R.A. Brooks, How to build complete creatures rather than isolated cognitive simulators, in: Architectures for Intelligence, Lawrence Erlbaum Assosiates, K. VanLehn, ed., 2001, 225239.
20. L. Caamero, Emotions for activity selection, Dept. of Computer Science Technical Report DAIMI PB 545, University of Aarhus, Denmark, 2000.
21. J. Gratch, J. Rickel, E. Andre, N. Badler, J. Cassell and E. Petajan, Creating interactive virtual humans: Some assembly required, IEEE Intelligent Systems 17(4) (2002), 5463.
22. P.H.-M. Chang, Y.-H. Chien, E.C.-C. Kao and V.-W. Soo, A Knowledge-Based Scenario Framework to Support Intelligent Planning Characters, In Lecture Notes in Computer Science, 2005, 134-145.
23. S. Chopra-Khullar and N.I. Badler, Where to Look? Automating Attending Behaviors of Virtual Human Characters, In AGENTS '99: Proceedings of the third annual conference on Autonomous Agents, 1999, 16-23.
24. M. Cohen and D. Massaro, Modelling coarticulation in synthetic visual speech, in: Models and Techniques in Computer Animation, N.M. Thalmann and D. Thalmann, eds, 1993, pp. 139-156.
25. R. Cornelius, The Science of Emotion, New Jersey: Prentice Hall, 1996.
26. A. Pearce, D. Hill and B. Wyvill, Animating speech: an automated approach using speech synthesis by rules, The Visual Computer 3 (1988), 277-289.
27. E. de Sevin and D. Thalmann, An Affective Model of Action Selection for Virtual Humans, In Proceedings of Agents that Want and Like: Motivational and Emotional Roots ofCogni-tion and Action symposium at the Artificial Intelligence and Social Behaviors Conference, 2005, 293-297.
28. J. Dinerstein and P.K. Egbert, Fast multi-level adaptation for interactive autonomous characters, ACM Trans Graph 24(2) (2005), 262-288.
29. S. Nakamura, E. Yamamato and K. Shikano, Lip movement synthesis from speech based on hidden markov models, Speech Communication 26 (1998), 105-115.
30. A. Egges, Real-Time Animation of Interactive Virtual Characters, PhD thesis, MIRALab, University ofGeneva, 2006.
31. P. Ekman, Emotion in the Human Face, Cambridge University Press, New York, 1982.
32. I.A. Ferguson, TouringMachines: An Architecture for Dynamic, Rational, Mobile Agents, PhD thesis, Clare Hall, University ofCambridge, 1992.
33. R. Gockley, J. Forlizzi and R. Simmons, Interactions with a Moody Robot, In Proceedings of Human-Robot Interaction, 2006, 186-193.
34. E. Friesen, Facial Action Coding System: A Technique for the Measurement ofFacial Movement, Consulting Psychologists Press, 1978.
35. S. Gadanho, Learning behavior-selection by emotions and cognition in a multi-goal robot task, Journal of Machine Learning 4 (2003), 385-412.
36. P.Gebhard, Alma-ALayeredModel of Affect, In Proceedings ofthe Fourth International Joint Conference on Autonomous Agents and Multi Agent Systems, 2005, 29-36.
37. M. Gillies and D. Ballin, Integrating Autonomous Behavior and User Control for Believable Agents In AAMAS '04: Proceedings of the first international joint conference on Autonomous agents and multiagent systems, 2004.
38. M.F.P. Gillies and N.A. Dodgson, Eye movements and attention for behavioural animation, The Journal of Visualization and Computer Animation 13(5) (2002), 287-300.
39. B. Grandstrom, Multi-Modal Speech Synthesis with Applications, In 3rd International School on Neural Nets, 1999, 136-140.
40. S. Hampson, State ofthe art: Personality, The Psychologist 12(6) (1999), 284-290.
41. P. Herrero and A. de Antonio, Introducing Human-Like Hearing Perception in Intelligent Virtual Agents, In AAMAS '03: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, 2003, 733-740.
42. D. Heylen, A closer look at gaze, in: Creating Bonds with Embodied Conversational Agents: AAMAS Workshop, C. Pelachaud, E. Andr, S. Kopp and Z.M. Ruttkay, eds, 2005.
43. Y. Kim, R.W. Hill and D.R. Traum, A Computational Model ofDynamic Perceptual Attention for Virtual Humans In 14th Conference on Behavior Representation in Modeling and Simulation, 2005.
44. F. de Rosis, I. Poggi and C. Pelachaud, Eye communication in a conversational 3d synthetic agent. in: Special Issue of Artificial Intelligence Communications, The European Journal on Artificial Intelligence, (Vol. 13)(3), E. Andr, ed., IOS Press, 2000, pp. 169-181.
45. M.S. Spindel, I. Roseman and P.E. Jose, Appraisals of emotion-eliciting events: Testing a theory of discrete emotions, Personality and Social Psychology 59(5) (1990), 899913.
46. A.J. Champandard, AIGame Development: Synthetic Creatures with Learning and Reactive Behaviors, New Riders, 2003.
47. S. Khirsagar, Facial Communication, MIRALab, University ofGeneva, 2003.
48. P. Tepper, S. Kopp and J. Cassell, Content in Context: Generating Language and Iconic Gesture without a Gestionary In Proceedings ofthe Workshop on Balanced Perception and Action in ECAs at AAMAS '04, 2004.
49. S. Kopp and I. Wachsmuth, in: A Knowledge-Based Approach for Lifelike Gesture Animation, W. Horn, ed., ECAI 2000, 2000.
50. S. Kopp and I. Wachsmuth, Synthesizing multimodal utterances for conversational agents, IEEE Intelligent Systems 15(1) (2004), 39-52.
51. A. Egges, S. Kshirsagar and N. Magnenat-Thalmann, Generic personality and emotion simulation for conversational agents, Computer Animation and Virtual Worlds 15(1) (2004), 1-13.
52. R. Laban and F.C. Lawrence, Embodied Conversational Agents, Plays, Inc., Boston, 1974.
53. F. Lavagetto and R. Pockaj, The facial animation engine: towards a high-level interface for the design of mpeg-4 compliant animated faces, IEEE Transactions on Circuits and Systems for Video Technology 9(2) (1999), 277-289.
54. M. Stone, D. DeCarlo, I. Oh, C. Rodriguez, A. Stere, A. Lee and C. Bregler, Speaking with hands: Creating animated conversational characters from recordings of human performance, ACM Transactions on Graphics 23(3) (2004), 506513.
55. H Lehnert, Fundamentlas of auditory virtual environment, in: Artificial Life and Virtual Reality, N.M. Thalmann and D. Thalmann, eds, John Wiley and Sons Ltd, 1994.
56. J. Lewis, Automated lip-sync: Background and techniques, The Journal ofVisualization and Computer Animation 2 (1991), 118-122.
57. B. Blumberg, M. Downie, Y. Ivanov, M. Berlin and M.P. Johnson, Integrated Learning for Interactive Synthetic Characters, Proceedings of SIGGRAPH 2002, 2002, 417-126.
58. A. Fukayama, T. Ohno, N. Mukawa, M. Sawaki and N. Hagita, Messages Embedded in Gaze of Interface Agents-Impression Management with Agent’s Gaze, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, 2002.
59. O. Renault, N. Magnenat-Thalmann and D. Thalmann, A vision-based approach to behavioural animation, ournal of Visualization and Computer Animation 1(1) (1990), 18-21.
60. S. Marsella and J. Gratch, A Step Toward Irrationality: Using Emotion to Change Belief, Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems, 2002, 334-341.
61. R.R. Mccrae and P. O. John, An introduction to the five-factor model and its applications, Journal of Personality 60 (1992), 175-215.
62. D. McNeill, Hand and Mind: What Gestures Reveal about Thought, University of Chicago Press, 1992.
63. M. McTear, Spoken dialogue technology: Enabling the conversational user interface, ACM Computing Survey 34(1) (2002).
64. S. Morishima, Real-Time Talking Head Driven by Voice and its Application to Communication and Entertainment, International Conference on Auditory Visual Speech Processing, 1998.
65. J. Muller and M. Pischel, The agent architecture interrap: concept and application, Technical Report RR-93-26, DFKI Saarbrucken, 1993.
66. A. Nareyek, Languages for Programming Bdi-style Agents: An Overview, Proc. of the Second International Conference on Computers and Games, 2000.
67. A. Nijholt, Humor and Embodied Conversational Agents, CTIT Technical Report series No. 03-03, University of Twente, ISSN 1381-3625, 2003.
68. J. Noh and U. Neumann, A survey of facial modeling and animation techniques. USC Technical Report 99-705, 1998.
69. N.I. Badler, O. Palmer and R. Bindiganavale, Fast multi-level adaptation for interactive autonomous characters, Communications of ACM 42(8) (1999), 65-73.
70. N. Bianchi-Berthouze and P.R. De Silva, Modeling human affective postures: an information theoretic characterization of posture features, Journal ofVisualization and Computer Animation 15(3-4) (2004), 269-276.
71. F. Parke, Computer Generated Animation Faces, ACM Annual Conference, 1972.
72. C. Pelachaud, Communication and Coarticulation in Facial Animation, University ofPennsylvania, 1991.
73. K. Perlin and A. Goldberg, Improv: A system for scripting interactive actors in virtual worlds, Computer Graphics 30 (Annual Conference Series) (1996), 205-216.
74. C. Peters and C O’Sullivan, Synthetic vision and memory for autonomous virtual humans, Computer Graphis Forum 21(4) (2002).
75. C. Peters and C. Sullivan, Bottom-up Visual Attention for Virtual Human Animation, CASA 03: Proceedings of the 16th International Conference on Computer Animation and Social Agents, 2003.
76. R.W. Picard, Affective Computing, MIT Press, 1997.
77. R. Plutchik, Ageneral psychoevolutionarytheoryofemotion. in: Emotion: Theory, Research, and Experience, (Vol. 1), R. Plutchik and H. Kellerman, eds, 1980, pp. 2-33.
78. J. Cassell, J. Sullivan, S. Prevost and E. Churchill, Embodied Conversational Agents, MIT Press, 2000.
79. S. Project, University of michigan. project homepage:http://sitemaker.umich.edu/soar. Accessed September 2006.
80. T.F. Rabie and D. Terzopoulos, Active Perception in Virtual Humans, Vision Interface 2000 Montreal, Canada, 2000.
81. C.W. Reynolds, Flocks, herds, and schools: a distributed behavioral model, SIGGRAPH '87 Conference Proceedings 21(4) (1987), 25-34.
82. J. Rickel and W.L. Johnson, Animated agents for procedural training in virtual reality: Perception, cognition, and motor control, Applied Artificial Intelligence 13 (1999), 343-382.
83. Zs. Ruttkay and H. Noot, Variations in gesturing and speech by gestyle, International Journal of Human-Computer Studies, Special Issue on Subtle Expressivity for Characters and Robots 62(2) (2005), 211-229.
84. C. Becker, S. Kopp and I. Wachsmuth, Simulating the Emotion Dynamics of a Multimodal Conversational Agent, Proceedings of Affective Dialogue Systems: Tutorial and research workshop (ADS 2004): LNCS 3068, 2004, 154-165.
85. N. Magnenat-Thalmann, S. Kshirsagar and S. Garchery, Feature Point Based Mesh Deformation Applied to Mpeg-4 Facial Animation, Proceedings of the IFIP DEFORM’2000 Workshop and AVATARS’2000 Workshop on Deformable Avatars, 2000, 23-34.
86. C. Pelachaud and S. Pasquariello, Greta: A Simple Facial Animation Engine, 6th Online World Conference on Soft Computing in Industrial Appications, 2001.
87. M. Schroder, Emotional Speech Synthesis: A Review, Proceedings of Eurospeech 01, 2001.
88. N. Badler, R. Bindiganavale, J. Bourne, M. Palmer, J. Shi and W. Schuler, A Parameterized Action Representation for Virtual Agents, Workshop on Embodied Conversational Characters, 1998.
89. J.J.S. Stronks, Friendship Relations with Embodied Conversational Agents: Integrating Social Psychology in Eca Design, Master Thesis, Faculty of Computer Science, University ofTwente, 2002.
90. A. Wardhani, W. Su and B. Pham, in: High-Level Control Posture ofStory Characters Based on Personality and Emotion, Pisan and Yusuf, eds, Proceedings IE05', The Second Australasian Interactive entertainment conference, 2005, pp. 179-186.
91. W. Tang T. Ruan Wan, Integrated Learning for Interactive Synthetic Characters, WSCG-Short Papers, 2002, 137-144.
92. H. Noser, O. Renault, D. Thalmann and N. Magnenat Thalmann, Navigation for digital actors based on synthetic vision memory and learning, Computers and Graphics 19(1) (1995), 7-19.
93. B. Blumberg, P. Todd and P. Maes, NoBadDogs: Ethological Lessons for Learning in Hamsterdam, Proceedings of the 4th International Conference on the Simulation of Adaptive Behavior, 1996.
94. B. Tomlinson, From linear to interactive animation: how autonomous characters change the process and product of animating, ACMComputers in Entertainment 3(1) (2005).
95. TRINDIKIT, http://www.ling.gu.se/projekt/trindi/trindikit/ index.html. Accessed September 2006.
96. H.B. Trung, Multimodal dialogue management-state of the art, Human Media Interaction Department, University of Twente (2006).
97. X. Tu and D. Terzopoulos, Perceptual Modeling for the Behavioral Animation of Fishes, Proc. Pacific Graphics '94, World Scientific Publishers, Singapore, 1994, 165-178.
98. J. Cassell, T. Stocky, T. Bickmore, Y. Gao, Y. Nakano, K. Ryokai, D. Tversky, C. Vaucelle and H. Vilhjalmsson, MACK: Media Lab Autonomous Conversational Kiosk, Proceedings of Imagina 02, 2002.
99. J. Cassell, H. Vilhjalmsson and T. Bickmore, BEAT: the Behavior Expression Animation Toolkit, Proceedings of SIG-GRAPH, 2001.
100. J. Cassell, T. Bickmore, M. Billinghurst, L. Campbell, K. Chang, H. Vilhjalmsson and H. Yan, Embodiment in Conversational Interfaces: Rea, Proceedings ofthe CHI’99 Conference, 1999.
101. D. Ancona, V. Mascardi and D. Demergasso, Languages for Programming Bdi-Style Agents: An Overview, WOA '05, 2005.
102. S. Vosinakis and T. Panayiotopoulos, Simhuman: A Platform for Real-Time Virtual Agents with Planning Capabilities, Proceedings ofthe 3rd International Workshop on Intelligent Virtual Agents, 2001.
103. F. Wang and E. Mckenzie, Virtual life in virtual environments. CSG report ECS-CSG-44-98, Institute for Computing Systems Architecture, University ofEdinburgh, 1998.
104. K. Waters and T. Levergood, Decface: A system for synthetic face applications, Multimedia Tools and Applications 1(4) (1988), 349-366.
105. J. Weizenbaum, Eliza-a computer program for the study of natural language communication between man and machine, ACM Computing Survey 9(1) (1966), 36-45.
106. C.M. Whissel, in: The Dictionary of Affect in Language, R. Plutchik and H. Kellerman, eds, Emotion: Theory, research, and experience, 4, The measurement of emotions, 1980.
107. Wikipedia-Behaviour, http://en.wikipedia.org/wiki/behavio-ur, Accessed September 2006.
108. I. Wilson, The artificial emotion engine, driving emotional behaviour, Artificial Intelligence and Interactive Entertainment (2000).
109. M. Woolridge, An Introduction to MultiAgent Systems, John Wiley and Sons, 2002.
110. Y. Chang and T. Ezzat, Transferable Videorealistic Speech Animation, ACM Siggraph/Eurographics Symposium on Computer Animation, Los Angeles, 2005, 21-28.
111. D.M. Chi, M. Costa, L. Zhao and N. Badler, The EMOTE Model for Effort and Shape, Siggraph 2000, Computer Graphics Proceedings, 2000.
112. N. Badler, J. Allbeck, L. Zhao and M. Byun, Representing and Parameterizing Agent Behaviors, Computer Animation, 2002, 133-143.