Motivated learning from interesting events: Adaptive, multitask learning agents for complex environments

Adaptive Behavior

Volumn 17, Issue 1, 2009, Pages 7-27

  Merrick, Kathryn ^a,c   Maher, Mary Lou ^b  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

^c UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Agent; Computer games; Interest; Motivation; Reinforcement learning; Supervised learning

Indexed keywords

EID: 62149118940     PISSN: 10597123     EISSN: 17412633     Source Type: Journal    
DOI: 10.1177/1059712308100236     Document Type: Article

References (21)

1. Berlyne, D.E. (1966). Exploration and curiosity. Science, 153, 25-33.
2. Berlyne, D.E. (1971). Aesthetics and psychobiology. Englewood Cliffs, NJ: Prentice-Hall.
3. Canamero, L., Avila-Garcia, O., & Hafner, E. (2002). First experiments relating behaviour selection architectures to environmental complexity. Paper presented at the 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2002. Vol. 3, pp 3024-3029, Lausanne, Switzerland.
4. Kaelbling, L., Littman, M., & Moore, A. (1996). Reinforcement learning: a survey. Journal of Artificial Intelligence Research, 4, 237-285.
5. Kaplan, F., & Oudeyer, P.-Y. (2003). Motivational principles for visual know-how development. Paper presented at the Proceedings of the 3rd International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems, Lund University Cognitive Studies, 73-80, Sweden.
6. Laird, J., & van Lent, M. (2001). Human-level AI's killer application: interactive computer games. AI magazine, pp 15-25, Summer 2001.
7. Luck, M., & d'Inverno, M. (1998). Motivated behaviour for goal adoption. In C Zhang and D Lukose (Eds) Multi-Agents Systems: Theories, Languages and Applications, Proceedings of the Fourth Australian Workshop on Distributed Artificial Intelligence, Springer-Verlag, pp 58-73.
8. Marsland, S., Nehmzow, U., & Shapiro, J. (2000). A real-time novelty detector for a mobile robot. Presented at the EUREL European Advanced Robotics Systems Masterclass and Conference, http://citeseerx.ist.psu.edu/viewdoc/ summary?doi=10.1.1.42.9052, Accessed November, 2008.
9. Merceron, A. (2001). Languages and logic. Prentice Hall, Australia.
10. Merrick, K. (2007). Modelling motivation for adaptive non-player characters in dynamic computer game worlds. ACM Computers in Entertainment, 5 (4). online journal, no page numbers. http://portal.acm.org/citation.cfm?id= 1324198.1324203&coll=GUIDE&dl=ACM&idx=J912&part= magazine&WantType=Magazines&title= Computers%20in%20Entertainment%20%28CIE%29&CFID=://cie.acm.org/&CFTOKEN= cie.acm.org/, Accessed November, 2008.
11. Merrick, K., & Maher, M.-L. (2006). Motivated reinforcement learning for non-player characters in persistent computer game worlds. Presented at the International Conference in Computer Entertainment, CA, USA, CD proceedings, no page numbers.
12. Nilsson, N.J. (1996). Introduction to machine learning. http://ai.stanford.edu/people/nilsson/mlbook.html (accessed January, 2006).
13. Russel, S.J., & Norvig, P. (1995). Artificial intelligence: a modern approach. Prentice Hall, Englewood Cliffs, New Jersey.
14. Saunders, R., & Gero, J.S. (2001). Designing for interest and novelty: motivating design agents. Paper presented at the CAAD Futures 2001, Kluwer, Dordrecht, pp 725-738.
15. Saunders, R., & Gero, J.S. (2002). Curious agents and situated design evaluations. In J. S. Gero & F. M. T. Brazier (Eds.), Agents in design (pp. 133-149). Sydney, Australia: Key Centre of Design Computing and Cognition, University of Sydney.
16. Schmidhuber, J. (1991). A possibility for implementing curiosity and boredom in model-building neural controllers. In J Meyer and S Wilson (Eds) The International Conference on Simulation of Adaptive Behaviour: From Animals to Animats, MIT Press / Bradford Books, pp 222-227.
17. Singh, S., Barto, A.G., & Chentanez, N. (2005). Intrinsically motivated reinforcement learning. Advances in Neural Information Processing Systems (NIPS) 17, 1281-1288.
18. Sutton, R.S., & Barto, A.G. (2000). Reinforcement learning: an introduction. Cambridge, MA: MIT Press.
19. Watkins, C. (1989). Learning from delayed rewards. Unpublished Ph.D., Cambridge University, England.
20. Weng, J., McClelland, J., Pentland, A., Sporns, O., Stockman, I., Sur, M., & Thelen, E. (2001). Artificial intelligence: autonomous mental development by robots and animals. Science, 291, 599-600.
21. Woodworth, R.S. (1918). Dynamic psychology. New York: Columbia University Press.