What are intrinsic motivations? A biological perspective

2011 IEEE International Conference on Development and Learning, ICDL 2011

Volumn , Issue , 2011, Pages

  Baldassarre, Gianluca ^a  

^a INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL MECHANISMS; COGNITIVE SCIENCE; EVOLUTIONARY PERSPECTIVE; EXTRINSIC MOTIVATION; HOMEOSTATIC REGULATIONS; INTRINSIC MOTIVATION; LEARNING MACHINES;

MOTIVATION;

EID: 80054971108     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEVLRN.2011.6037367     Document Type: Conference Paper

References (55)

1. B. Skinner, The Behavior of Organisms. D. Appleton-Century, 1938.
2. C. L. Hull, Principles of Behavior. Appleton-century-crofts, 1943.
3. H. F. Harlow, "Learning and satiation of response in intrinsically motivated complex puzzle performance by monkeys," Journal of Comparative and Physiological Psychology, vol. 43, pp. 289-294, 1950.
4. G. Kish, "Learning when the onset of illumination is used as the reinforcing stimulus," Journal of Comparative and Physiological Psychology, vol. 48, no. 4, pp. 261-264, 1955.
5. D. E. Berlyne, "Curiosity and exploration," Science, vol. 143, pp. 25-33, 1966.
6. R. W. White, "Motivation reconsidered: The concept of competence," Psychological Review, vol. 66, pp. 297-333, 1959.
7. R. Ryan and E. Deci, "Intrinsic and extrinsic motivations: Classic definitions and new directions," Contemporary Educational Psychology, vol. 25, pp. 54-67, 2000.
8. N. Tinbergen, "On aims and methods of ethology," Zeitschrift fur Tierpsychologie, vol. 20, no. 4, pp. 410-433, 1963.
9. D. A. Lieberman, Learning, Behaviour and Cognition. Brooks/Cole, 1993.
10. B. A. G. Singh S. and N. Chentanez, "Intrinsically motivated reinforcement learning," in Advances in Neural Information Processing Systems 17: Proceedings of the 2004 Conference, L. K. Saul, Y. Weiss, and L. Bottou, Eds. Cambridge, MA: The MIT Press, 2005.
11. D. Parisi, "Internal robotics," Connection science, vol. 16, no. 4, pp. 325-338, 2004.
12. K. Lorenz, King Solomon's Ring. London: Methuen, 1961, translated by Marjorie Kerr Wilson.
13. N. Tinbergen, The Study of Instinct. Oxford: Clarendon Press, 1951.
14. P. Lehner, Handbook of Ethological Methods. Cambridge: Cambridge University Press, 1998.
15. J. Alcock, Animal Behavior: An Evolutionary Approach. Sunderland, MA: Sinauer Associated, 1998.
16. T. Johnston, "Selective costs and benefits in the evolution of learning," Advances in the Study of Behavior, vol. 12, pp. 65-106, 1982.
17. I. P. Pavlov, Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex, G. V. in Anrep, Ed. Oxford University Press., 1927.
18. B. F. Skinner, The Behavior of Organisms. New York, NY: Appleton Century Crofts, 1938.
19. J. Panksepp, Affective Neuroscience: The Foundations of Human and Animal Emotions. Oxford: Oxford Unversity Press, 1998.
20. D. Parisi, F. Cecconi, and S. Nolfi, "Econets: Neural networks that learn in an environment," Network: Computation in Neural Systems, vol. 1, no. 2, pp. 149-168, 1990.
21. S. J. Gould, The mismeasure of man. WW Norton & Company, 1996.
22. M. Mirolli, F Mannella, and G. Baldassarre, "The roles of the amygdala in the affective regulation of body, brain and behaviour," Connection Science, vol. 22, no. 3, pp. 215-245, 2010.
23. J. K. Elmquist, R. Coppari, N. Balthasar, M. Ichinose, and B. B. Lowell, "Identifying hypothalamic pathways controlling food intake, body weight, and glucose homeostasis." Journal of Comparative Neurology, vol. 493, no. 1, pp. 63-71, 2005.
24. E. R. Kandel, J. H. Schwartz, and T. M. Jessel, Principles of Neural Science. New York: McGraw-Hill, 2000.
25. I. Kupfermann, "Neural control of feeding." Current Opinions in Neurobiology, vol. 4, no. 6, pp. 869-876, 1994.
26. S. Geisler, C. Derst, R. W. Veh, and D. S. Zahm, "Glutamatergic affer-ents of the ventral tegmental area in the rat." Journal of Neuroscience, vol. 27, no. 21, pp. 5730-5743, 2007.
27. J. Olds and P. Milner, "Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain." Journal of Comparative Physiological Psychology, vol. 47, no. 6, pp. 419-427, 1954.
28. P. M. Milner, "Brain-stimulation reward: a review." Canadian Journal of Psychology, vol. 45, no. 1, pp. 1-36, 1991.
29. W. Schultz, "Getting formal with dopamine and reward." Neuron, vol. 36, no. 2, pp. 241-263, 2002.
30. R. Spanagel and F Weiss, "The dopamine hypothesis of reward: past and current status." Trends in Neurosciences, vol. 22, no. 11, pp. 521-527, 1999.
31. P. Crine, C. Gianoulakis, N. G. Seidah, F. Gossard, P. D. Pezalla, M. Lis, and M. Chrtien, "Biosynthesis of beta-endorphin from beta-lipotropin and a larger molecular weight precursor in rat pars intermedia." Proceedings of the National Academy of Sciences, vol. 75, no. 10, pp. 4719-4723, 1978.
32. S. Pecina, K. S. Smith, and K. C. Berridge, "Hedonic hot spots in the brain." Neuroscientist, vol. 12, no. 6, pp. 500-511, 2006.
33. J. A. Boulant, "Role of the preoptic-anterior hypothalamus in thermoregulation and fever." Clinical Infectious Diseases, vol. 31, pp. S157-S161, 2000.
34. E. Strieker and S. Woods, Neurobiology of food and fluid intake. Plenum Press, 2004.
35. L. D. Reid, "Endogenous opioid peptides and regulation of drinking and feeding." American Journal of Clinical Nutrition, vol. 42, no. 5 Suppl, pp. 1099-1132, 1985.
36. J. D. Corbit, "Voluntary control of hypothalamic temperature." Journal of Comparative Physiological Psychology, vol. 83, no. 3, pp. 394-411, 1973.
37. P. Redgrave and K. Gurney, "The short-latency dopamine signal: a role in discovering novel actions?" Nature Review Neuroscience, vol. 7, no. 12, pp. 967-975, 2006.
38. D. Kumaran and E. A. Maguire, "Which computational mechanisms operate in the hippocampus during novelty detection?" Hippocampus, vol. 17, no. 9, pp. 735-748, 2007.
39. J. E. Lisman and A. A. Grace, "The hippocampal-vta loop: controlling the entry of information into long-term memory." Neuron, vol. 46, no. 5, pp. 703-713, 2005.
40. A. Yu and P. Dayan, "Expected and unexpected uncertainty: ACh and NE in the neocortex," in Advances in Neural Information Processing Systems 15: Proceedings of the 2002 Conference. Cambridge, MA: The MIT Press, 2003, pp. 157-164.
41. J. M. Pearce and G. Hall, "A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli." Psychological Review, vol. 87, no. 6, pp. 532-552, 1980.
42. S. J. Sara, A. Vankov, and A. Herv, "Locus coeruleus-evoked responses in behaving rats: a clue to the role of noradrenaline in memory." Brain Research Bulletin, vol. 35, no. 5-6, pp. 457-465, 1994.
43. S. J. Sara, "The locus coeruleus and noradrenergic modulation of cognition." Nature Review Neuroscience, vol. 10, no. 3, pp. 211-223, 2009.
44. P. Oudeyer and F Kaplan, "What is intrinsic motivation? a typology of computational approaches," Frontiers in Neurorobotics, vol. 1, 2007.
45. J. Schmidhuber, "Curious model-building control systems," in Proceedings of the International Joint Conference on Neural Networks, vol. 2, 1991, pp. 1458-1463.
46. -, "Formal theory of creativity, fun, and intrinsic motivation (1990-2010)," IEEE Transactions on Autonomous Mental Development, vol. 2, no. 3, pp. 230-247, 2010.
47. P. Oudeyer, F. Kaplan, and V. Hafner, "Intrinsic motivation systems for autonomous mental development," IEEE Transactions on Evolutionary Computation, vol. 11, no. 2, pp. 265-286, 2007.
48. F. Kaplan and P.-Y. Oudeyer, "In search of the neural circuits of intrinsic motivation." Frontiers in neuroscience, vol. 1, pp. 225-36, 2007.
49. V. G. Santucci, G. Baldassarre, and M. Marco, "Biological cumulative learning through intrinsic motivations: a simulated robotic study on development of visually-guided reaching." in Proceedings of the Tenth International Conference on Epigenetic Robotics (EpiRob2010), B. Johansson, E. Sahin, and C. Balkenius, Eds. Lund, Sweden: Lund University, 2010, pp. 121-128.
50. H. V. Neto and U. Nehmzow, "Visual novelty detection with automatic scale selection," Robotics and Autonomous Systems, vol. 55, no. 9, pp. 693-701, 2007.
51. M. Schembri, M. Mirolli, and G. Baldassarre, "Evolving childhood's length and learning parameters in an intrinsically motivated reinforcement learning robot," in Proceedings of the Seventh International Conference on Epigenetic Robotics, L. Berthouze, P. G. Dhristiopher, M. Littman, H. Kozima, and C. Balkenius, Eds. Lund: Lund University, 2007, vol. 134, pp. 141-148.
52. A. Stout and A. G. Barto, "Competence progress intrinsic motivation," in IEEE International Conference on Development and Learning (ICDL2010), B. Kuipers, T. Shultz, A. Stoytchev, and C. Yu, Eds. Piscataway, NJ: IEEE, 2010.
53. S. Singh, R. Lewis, A. Barto, and J. Sorg, "Intrinsically motivated reinforcement learning: An evolutionary perspective," Autonomous Mental Development, IEEE Transactions on, vol. 2, no. 2, pp. 70-82, 2010.
54. K. Murayama, M. Matsumoto, K. Izuma, and K. Matsumoto, "Neural basis of the undermining effect of monetary reward on intrinsic motivation," Proceedings of the National Academy of Sciences, vol. 107, no. 49, pp. 20911-20916, 2010.
55. D. Caligiore, M. Mirolli, D. Parisi, and G. Baldassarre, "A bio-inspired hierarchical reinforcement learning architecture for modeling learning of multiple skills with continuous state and actions," in IEEE International Conference on Development and Learning (ICDL2010), B. Kuipers, T. Shultz, A. Stoytchev, and C. Yu, Eds. Piscataway, NJ: IEEE, 2010.