Learnable behavioural model for autonomous virtual agents: Low-level learning

Proceedings of the International Conference on Autonomous Agents

Volumn 2006, Issue , 2006, Pages 89-96

  Conde, Toni ^a   Thalmann, Daniel ^a  

^a EPFL   (Switzerland)

Author keywords

AI based animation; Behavioural modelling; Character animation; Computer animation; Machine learning; Reinforcement learning

Indexed keywords

ANIMATION; COMPUTER GRAPHICS; COMPUTER SIMULATION; MULTI AGENT SYSTEMS; VIRTUAL REALITY;

AI-BASED ANIMATION; BEHAVIOURAL MODELING; CHARACTER ANIMATION;

LEARNING SYSTEMS;

EID: 34247185397     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1160633.1160644     Document Type: Conference Paper

References (29)

1. P. Larkin. Achieving human style navigation for synthetic characters. A survey. In Proceedings of Neural Networks and Computational Intelligence, pages 30-37, 2003.
2. R. Downs and D. Stea. Cognitive maps and spatial behavior. Image and Environment. R. Downs and D. Stea, Eds., pages 8-26, Chicago: Adline Publishing, 1973.
3. D. Griffin. Topographical Orientation. Image and Environment. R. Downs and D. Stea, Eds., pages 296-299, Chicago: Adline Publishing, 1973.
4. N. Kamwisher and P. Downing. Separating the wheat from the chaff. Science, vol. 282, pages 57-58, 1998.
5. T. Conde and D. Thalmann. An Artificial Life Environment for Autonomous Virtual Agents with multi-sensorial and multi-perceptive features. Computer Animation and Virtual Worlds, 15(3-4), pages 311-318, John Wiley, 2004.
6. C. Reynolds. Flocks, herds, and schools: A distributed behavioural model. In Proceedings of ACM SIGGRAPH, pages 25-34, 1987.
7. X. Tu and D. Terzopoulos. Artificial fishes: Physics, locomotion, perception, behaviour. In Proceedings of ACM SIGGRAPH, pages 43-50, 1994.
8. B. Blumberg and T. Galyean. Multi-level direction of autonomous creatures for real-time virtual environments. In Proceedings of ACM SIGGRAPH, pages 47-54, 1996.
9. K. Perlin and A. Golberg. A improv: a system for scripting interactive actors in virtual worlds. In Proceedings of ACM SIGGRAPH, pages 205-216, 1996.
10. R. Burke, D. Isla, M. Downie, Y. Ivanov and B. Blumberg. Creature smarts: The art and architecture of a virtual brain. In Proceedings of the Computer Game Developers Conference, pages 147-166, 2001.
11. B. Tomlinson and B. Blumberg. Alphawolf: Social learning, emotion and development in autonomous virtual agents. In Proceedings of First GSFC/JPL Workshop on Radical Agent Concepts, pages 35-45, 2002.
12. B. Blumberg, M. Downie, Y. Ivanov, M. Berlin, M. Johnson and B. Tomlinson. Integrated learning for interactive synthetic characters. In Proceedings of ACM SIGGRAPH, pages 417-426, 2002.
13. T. Conde, W. Tambellini and D. Thalmann. Behavioral Animation of Autonomous Virtual Agents helped by Reinforcement Learning. Lecture Notes in Computer Science, vol. 272, pages 175-180, Springer-Verlag: Berlin, 2003.
14. K. Sims. Evolving virtual creatures. In Proceedings of ACM SIGGRAPH, pages 15-22, 1994.
15. R. Grzeszczuk and D. Terzopoulos. Automated learning of muscle-actuated locomotion through control abstraction. In Proceedings of ACM SIGGRAPH, pages 63-70, 1995.
16. R. S. Sutton and G. Barto. Reinforcement Learning: An Introduction, MIT Press, 1998.
17. T. Mitchell. Machine Learning, McGraw Hill, 1997.
18. R. Pfeiffer and C. Scheier. Understanding Intelligence, MIT Press, 1999.
19. S. Russell and A. L. Zimdars. Q-Decomposition for Reinforcement Learning Agents. In Proceedings of Conference on Machine Learning ICML, pages 656-663, 2003.
20. P. Abbeel and A.Y. Ng. Apprenticeship Learning via Inverse Reinforcement Learning. In Proceedings of Conference on Machine Learning ICML, vol. 69, ACM Press, New York, 2004.
21. A. Y. Ng and S. Russell. Algorithms for Inverse Reinforcement Learning. In Proceedings of Conference on Machine Learning ICML, pages 663-670, 2000.
22. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach, Prentice-Hall, 1995.
23. M. Lutz. Programming Python, O'Reilly Ed., Sebastopol, CA, 1996.
24. M. Ponder, G. Papagiannakis, T. Molet, N. Magnenat-Thalmann and D. Thalmann. VHD++ Development Framework: Towards Extendible, Component Based VR/AR Simulation Engine Featuring Advanced Virtual Character Technologies. Computer Graphics International (CGI), pages 96-104, 2003.
25. M. Kallmann, H. Bieri and D. Thalmann. Fully Dynamic Constrained Delaunay Triangulations. Geometric Modelling for Scientific Visualization, 4:74-123, Heidelberg, Germany, 2003.
26. R. Boulic, N. Magnenat-Thalmann and D. Thalmann. A Glogal Human Walking Model with Real-Time kinematics Personification. Visual Computer, 6:344-358, 1990.
27. L. M. G. Gonçalvez, M. Kallmann and D. Thalmann. Defining Behaviors for Autonomous Agents based on Local Perception and Smart Objects. Computer & Graphics, 26(6):887-897, 2002.
28. J. Dinerstein, P.K. Egbert and H. de Garis. Fast and learnable behavioural and cognitive modelling for virtual character animation. Computer Animation and Virtual Worlds, 15:95-108, 2004.
29. M. Kasper, G. Fricke, K. Steuernagi and E. von Puttkamer. A behavior-based mobile robot architecture for learning from demonstration. Robotics and Autonomous Systems, vol. 34, pages 153-164, 2001.