Novelty and beyond: Towards combined motivation models and integrated learning architectures

Intrinsically Motivated Learning in Natural and Artificial Systems

Volumn 9783642323751, Issue , 2013, Pages 209-233

  Merrick, Kathryn E ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; NETWORK ARCHITECTURE; COMPLEX NETWORKS; EDUCATION;

BEHAVIORAL COMPONENT; COMPLEX AGENT; FUNDAMENTAL UNITS; INTEGRATED LEARNING; INTRINSIC MOTIVATION; LEARNING ARCHITECTURES; MODEL LEARNING; MOTIVATION MODELS; NETWORK FRAMEWORKS; NEURAL-NETWORKS; BASIC UNITS; NOVELTY DETECTORS;

MOTIVATION;

EID: 84929042861     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-3-642-32375-1_9     Document Type: Chapter

References (46)

1. Baldassarre, G.: What are intrinsic motivations? a biological perspective. In: proceedings of International Conference on Developmental Learning and Epigenetic Robotics, pp. 1-8. IEEE, New York (2011)
2. Baraldi, A., Alpaydin, E.: Simplified art: A new class of art algorithms. Technical report, International Computer Science Institute, Berkley (1998)
3. Barto, A., Singh, S., Chentanez, N.: Intrinsically motivated learning of hierarchical collections of skills. In: International Conference on Developmental Learning (2004)
4. Berlyne, D.: Conflict, Arousal and Curiosity. McGraw-Hill, New York (1960)
5. Berlyne, D.: Exploration and curiosity. Science 153, 25-33 (1966)
6. BLIPSystems: Blipnet technical white paper. BLIP Systems A/S, Aalborg (2007)
7. Chandola, V., Banerjee, A, Kumar, V.: Anomaly detection: A survey. ACM Comput. Surv. 41(3), 1-58 (2009)
8. Deci, E., Ryan, R.: Intrinsic Motivation and Self-determination in Human Behaviour. Plenum, New York (1985)
9. Fritzke, B.: Incremental learning of local linear mappings. In: The International Conference on Artificial Neural Networks, pp. 217-222 (1995)
10. Gero, J.: Creativity, emergence and evolution in design. In: Second International Roundtable Conference on Computational Models of Creative Design, pp. 1-28, Sydney (1992)
11. Heckhausen, J., Heckhausen, H.: Motivation and Action. Cambridge University Press, New York (2008)
12. Hettich, S., Bay, S.: The uci kdd archive (1999). http://kdd.ics.uci.edu/databases/kddcup99/kddcup99 (Accessed March 2009)
13. Hill, C., Amodeo, A., Joseph, J., Patel, H.: Nano- and microrobotics: How far is the reality. Expert Rev. 8(12), 1891-1897 (2008)
14. Kaplan, F., Oudeyer, P.-Y.: Intrinsically motivated machines. In: Lungarella, M., Iida, F.J.B., Pfeifer, R. (eds.) Fifty Years of Artificial Intelligence, pp. 304-315. Springer, Berlin (2007)
15. King, R., et al.: The automation of science. Science 324 (5923), 85-89 (2009)
16. Kohonen, T.: Self-organisation and Associative Memory. Springer, Berlin (1993)
17. Lee, W., Stolfo, S.: A framework for constructing features and models for intrusion detection systems. ACM Trans. Inform. Syst. Security 3(4), 227-261 (2001)
18. Lenat, D.: AM: An artificial intelligence approach to discovery in mathematics. Ph.D. Thesis, Stanford University (1976)
19. MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: The Fifth Berkeley Symposium on Mathematical Statistics and Probability, pp. 281-297. University of California Press (1967)
20. Maher, M., Gero, J.: Agent models of 3d virtual worlds. In: ACADIA 2002: Thresholds, pp. 127-138. California State Polytechnic University (2002)
21. Maher, M.L., Merrick, K., Saunders, R.: Achieving Creative Behaviour Using Curious Learning Agents, AAAI Spring Symposium on Creative Intelligent Systems, March 26-28, Stanford University, pp. 40-46 (2008).
22. Marsland, S., Nehmzow, U., Shapiro, J.: A real-time novelty detector for a mobile robot. In: EUREL European Advanced Robotics Systems Masterclass and Conference (2000)
23. Merrick, K.: Designing toys that come alive: Curious robots for creative play. In: Seventh International Conference on Entertainment Computing (ICEC 2008), pp. 149-154. Carnegie Mellon University, Springer (2008)
24. Merrick, K.: A comparative study of value systems for self-motivated exploration and learning by robots. IEEE Trans. Auton. Mental Dev. 2(2), 119-131 (2010a). Special Issue on Active Learning and Intrinsically Motivated Exploration in Robots
25. Merrick, K.: Modeling behavior cycles as a value system for developmental robots. Adap. Behav. 18(3-4), 237-257 (2010b)
26. Merrick, K., Maher, M.: Motivated Reinforcement Learning: Curious Characters for Multiuser Games. Springer, Berlin (2009)
27. Merrick, K., Scully, T.: Modelling affordances for the control and evaluation of intrinsically motivated robots. In: Australian Conference on Robotics and Automation, CD. Sydney (2009)
28. Merrick, K., Shafi, K.: Agent models for self-motivated home-assistant bots. In: International Symposium on Computational Models for Life Sciences, pp. 131-150. AIP (2009)
29. Merrick, K., Shafi, K.: Achievement, affiliation and power: Motive profiles for artificial agents. Adap. Behav. 9(1), 40-62 (2011)
30. Mirolli, M., Baldassarre, G.: Functions and mechanisms of intrinsic motivations: The knowledge versus competence distinction. In: Baldassarre, G., Mirolli, M. (eds.) Intrinsically Motivated Learning in Natural and Artificial Systems, pp. 49-72. Springer, Berlin (2012)
31. Nehmzow, U., Gatsoulis, Y., Kerr, E., Condell, J., Siddique, N.H., McGinnity, M.T.: Novelty detection as an intrinsic motivation for cumulative learning robots. In: Baldassarre, G., Mirolli, M. (eds.) Intrinsically Motivated Learning in Natural and Artificial Systems, pp. 185-207. Springer, Berlin (2012)
32. Oudeyer, P.-Y., Kaplan, F.: Intelligent adaptive curiosity: A source of self-development. In: Fourth International Workshop on Epigenetic Robotics, pp. 127-130. Lund University, Lund (2004)
33. Oudeyer, P.-Y., Kaplan, F.: What is intrinsic motivation? a typology of computational approaches. Front. Neurorobot. 1(6) (2007) (online, openaccess)
34. Oudeyer, P.-Y., Kaplan, F., Hafner, V.: Intrinsic motivation systems for autonomous mental development. IEEE Trans. Evol. Comput. 11(2), 265-286 (2007)
35. Saunders, R.: Curious design agents and artificial creativity. Ph.D. Thesis, University of Sydney, Sydney (2001)
36. Schembri, M., Mirolli, M., Baldassarre, G.: Evolution and learning in an intrinsically motivated reinforcement learning robot. In: Advances in Artificial Life. Proceedings of the 9th European Conference on Artificial Life (ECAL2007), Lecture Notes in Artificial Intelligence, Vol. 4648, pp. 294-333. Springer, Berlin (2007)
37. Schmidhuber, J.: Curious model building control systems. In: International Joint Conference on Artificial Neural Networks, pp. 1458-1463. IEEE, Singapore (1991)
38. Schmidhuber, J.: Formal theory of creativity, fun and intrinsic motivation (1990-2010): IEEE Trans. Auton. Mental Dev. 2(3), 230-247 (2010)
39. Shafi, K., Merrick, K.: A curious agent for network anomaly detection. In: The Tenth International Conference on Autonomous Agents and Multiagent Systems, pp. 1075-1076 (2011)
40. Stanley, J.: Computer simulation of a model of habituation. Nature 261, 146-148 (1976)
41. Steels, L.: Self-organising vocabularies. Vrije Universiteit, Artificial Intelligence Laboratory, Brussels (1996)
42. Sutton, R., Barto, A.: Reinforcement Learning: An Introduction. MIT, Cambridge (2000)
43. Watkins, C., Dayan, P.: Q-learning. Mach. Learn. 8(3), 279-292 (1992)
44. Weiser, M.: The computer for the 21st century. Sci. Am. 265(3), 94-104 (1991)
45. White, R.: Motivation reconsidered: The concept of competence. Psychol. Rev. 66, 297-333 (1959)
46. Wundt, W.: Principles of Physiological Psychology. Macmillan, New York (1910)