The mechatronic board: A tool to study intrinsic motivations in humans, monkeys, and humanoid robots

Intrinsically Motivated Learning in Natural and Artificial Systems

Volumn 9783642323751, Issue , 2013, Pages 411-432

  Taffoni, Fabrizio ^a   Formica, Domenico ^a   Schiavone, Giuseppina ^a   Scorcia, Maria ^a   Tomassetti, Alessandra ^a   Di Sorrentino, Eugenia Polizzi ^b   Sabbatini, Gloria ^b   Truppa, Valentina ^b   Mannella, Francesco ^b   Fiore, Vincenzo ^b   Mirolli, Marco ^b   Baldassarre, Gianluca ^b   Visalberghi, Elisabetta ^b   Keller, Flavio ^a   Guglielmelli, Eugenio ^a  

^a UNIVERSITY CAMPUS BIO MEDICO   (Italy)

^b INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; COMPUTATIONAL METHODS; MACHINE DESIGN; MAMMALS; MOTIVATION; ANTHROPOMORPHIC ROBOTS; EDUCATION; ROBOTS;

BEHAVIORAL ANALYSIS; COMPUTATIONAL MODELLING; DESIGN APPROACHES; HUMAN ROBOTS; HUMANOID ROBOT; INTRINSIC MOTIVATION; LEARNING MECHANISM; MECHATRONIC PLATFORM; MULTI-DISCIPLINARY DESIGNS; NON-HUMAN PRIMATE; COMPUTATIONAL MODEL; PILOT EXPERIMENT;

ANTHROPOMORPHIC ROBOTS; MACHINE DESIGN;

EID: 84897613441     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-3-642-32375-1_16     Document Type: Chapter

References (32)

1. Baldassarre, G.: What are intrinsic motivations? A biological perspective. In: Cangelosi, A., Triesch, J., Fasel, I., Rohlfing, K., Nori, F., Oudeyer, P.-Y., Schlesinger, M., Nagai, Y. (eds.) Proceedings of the International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob-2011), pp. E1-8. IEEE, Piscataway (2011)
2. Baldassarre, G., Mannella, F., Fiore, V., Redgrave, P., Gurney, K., Mirolli, M.: Intrinsically motivated action-outcome learning and goal-based action recall: A system-level bio-constrained computational model. Neural Netw. (2012, in press)
3. Baldassarre, G., Mirolli, M.: Deciding which skill to learn when: Temporal-difference competence-based intrinsic motivation (TD-CB-IM): In: Baldassarre, G., Mirolli, M. (eds.) Intrinsically Motivated Learning in Natural and Artificial Systems, pp. 255-276. Springer, Berlin (2012)
4. Caligiore, D., Borghi, A., Parisi, D., Baldassarre, G.: Tropicals: A computational embodied neuroscience model of compatibility effects. Psychol. Rev. 117(4), 1188-1228 (2010)
5. Glow, P., Roberts, J.S., Russell, A.: Sound and light preference behaviour in näive adult rats. Aust. J. Psychol. 24, 173-178 (1972)
6. Glow, P., Winefield, A.H.: Response-contingent sensory change in a causally structured environment. Anim. Learn. Behav. 6, 1-18 (1978)
7. Goodale, M.A., Milner, A.D.: Separate visual pathways for perception and action. Trends Neurosci. 15(1), 20-25 (1992)
8. Harlow, H.F.: Learning and satiation of response in intrinsically motivated complex puzzle performance by monkeys. J. Comp. Physiol. Psychol. 43(4), 289-294 (1950)
9. Harlow, H.F., Harlow, M.K., Meyer, D.R.: Learning motivated by a manipulation drive. J. Exp. Psychol. 40, 228-234 (1950)
10. Houk, J.C., Adams, J.L., Barto, A.G.: A model of how the basal ganglia generate and use neural signals ghat predict reinforcement. In: Houk, J.C., Davids, J.L., Beiser, D.G. (eds.) Models of Information Processing in the Basal Ganglia, pp. 249-270. MIT, Cambridge (1995)
11. Jacobs, G.: A perspective on colour vision in platyrrhine monkeys. Vis. Res. 38, 3307-3313 (1998)
12. Kaplan, F., Oudeyer, P.: In: search of the neural circuits of intrinsic motivation. Front. Neuorosci. 1, 225-236 (2007)
13. Klemke, E.D. (ed.): Introductory Readings in the Philosophy of Science. Prometheus Books, New York (1980)
14. Lee, M.H., Meng, Q., Chao, F.: Staged competence learning in developmental robotics. Adap. Behav, 15(3), 241-255 (2007)
15. Lockmann, J.J.: A perception-action perspective on tool use development. Child Dev. 71(1), 137-144 (2000)
16. Martin, P., Bateson, P. (eds.): Measuring Behaviour: An introductory guide, Cambridge University Press, Cambridge (1998)
17. Miller, E.K., Cohen, J.D.: An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167-202 (2001)
18. Mirolli, M., Baldassarre, G.: Functions and mechanisms of intrinsic motivations: The knowledge versus competence distinction. In: Baldassarre, G., Mirolli, M. (eds.) Intrinsically Motivated Learning in Natural and Artificial Systems, pp. 47-72. Springer, Berlin (2012)
19. Mirolli, M., Santucci, V.G., Baldassarre, G.: Phasic dopamine as a prediction error of intrinsic and extrinsic reinforcements driving both action acquisition and reward maximization: A simulated robotic study. Neural Netw. (2012, submitted)
20. Natale, L., Nori, F., Metta, G., Fumagalli, M., Ivaldi, S., Pattacini, U., Randazzo, M., Schmitz, A., Sandini, G.: The icub platform: A tool for studying intrinsically motivated learning. In: Baldassarre, G., Mirolli, M. (eds.) Intrinsically Motivated Learning in Natural and Artificial Systems, pp. 433-458. Springer, Berlin (2012)
21. Redgrave, P., Gurney, K.: The short-latency dopamine signal: A role in discovering novel actions? Nat. Rev. Neurosci. 7(12), 967-975 (2006)
22. Redgrave, P., Gurney, K., Stafford, T., Thirkettle, M., Lewis, J.: The role of the basal ganglia in discovering novel actions. In: Baldassarre, G., Mirolli, M. (eds.) Intrinsically Motivated Learning in Natural and Artificial Systems, pp. 129-149. Springer, Berlin (2012)
23. Schembri, M., Mirolli, M., Baldassarre, G.: Evolution and learning in an intrinsically motivated reinforcement learning robot. In: Almeida e Costa Fernando, Rocha, L.M., Costa, E., Harvey, I., Coutinho, A. (eds.) Advances in Artificial Life. Proceedings of the 9th European Conference on Artificial Life (ECAL2007). Lecture Notes in Artificial Intelligence, Vol. 4648, pp. 294-333, Lisbon, Portugal, September 2007. Springer, Berlin (2007a)
24. Schembri, M., Mirolli, M., Baldassarre, G.: Evolving childhood's length and learning parameters in an intrinsically motivated reinforcement learning robot. In: Berthouze, L., Dhristiopher, P.G., Littman, M., Kozima, H., Balkenius, C. (eds.) Proceedings of the Seventh International Conference on Epigenetic Robotics, Vol. 134, pp. 141-148. Lund University, Lund (2007b)
25. Schembri, M., Mirolli, M., Baldassarre, G.: Evolving internal reinforcers for an intrinsically motivated reinforcement-learning robot. In: Demiris, Y., Mareschal, D., Scassellati, B., Weng, J. (eds.) Proceedings of the 6th International Conference on Development and Learning, pp. E1-6. Braga, Portugal, July 2007. Imperial College, London (2007c)
26. Stout, A., Barto, A.G.: Competence progress intrinsic motivation. In: Kuipers, B., Shultz, T., Stoytchev, A., Yu, C. (eds.) IEEE International Conference on Development and Learning (ICDL2010). IEEE, Piscataway (2010)
27. Taffoni, F., Vespignani, M., Formica, D., Cavallo, G., Polizzi di Sorrentino, E., Sabbatini, G., Truppa, V., Mirolli, M., Baldassarre, G., Visalberghi, E., Keller, F., Guglielmelli, E.: A mecha-tronic platform for behavioral analysis on nonhuman primates. J. Integr. Neurosci. 11(1), 87-101 (2012)
28. Thelen, E., Smith, L.: A Dynamic Systems Approach to the Development of Cognition and Action. MIT, Boston (1994)
29. Wasserman, E., Zentall, T.: Comparative Cognition: Experimental Explorations of Animal Intelligence. Oxford University Press, New York (2006)
30. Welker, W.L.: Some determinants of play and exploration in chimpanzees. J. Comp. Physiol. Psychol. 49, 84-89 (1956)
31. White, R.W.: Motivation reconsidered: The concept of competence. Psychol. Rev. 66, 297-333 (1959)
32. Yin, H.H., Knowlton, B.J.: The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7(6), 464-476 (2006)