Trying anyways: How ignoring the errors may help in learning new skills

2011 IEEE International Conference on Development and Learning, ICDL 2011

Volumn , Issue , 2011, Pages

  Grzyb, Beata J ^a,b   Boedecker, Joschka ^b   Asada, Minoru ^b   Del Pobil, Angel P ^a   Smith, Linda B ^c  

^a UNIVERSITAT JAUME I   (Spain)

^b OSAKA UNIVERSITY   (Japan)

^c INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EXPLORATION AND EXPLOITATION; LEARNING PROCESS; PROOF OF CONCEPT; ROBOT SIMULATORS; SELF EFFICACY;

FEEDBACK;

ERRORS;

EID: 80054969979     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEVLRN.2011.6037333     Document Type: Conference Paper

References (35)

1. J. Weng, "A theory for mentally developing robots," in Proc. 2nd Int. Conf. Development Learn., 2002.
2. A. Barto, S. Singh, and N. Chentanez, "Intrinsically motivated learning of hierarchical collections of skills," in Proc. 3rd Int. Conf. Development Learn., 2004.
3. J. Marshall, D. Blank, and L. Meeden, "An emergent framework for self-motivation in developmental robotics," in Proc. 3rd Int. Conf. Development Learn., 2004.
4. S. Roa, G.-J. M. Kruijff, and H. Jacobsson, "Curiosity-driven acquisition of sensorimotor concepts using memory-based active learning," in Proceedings of the 2008 IEEE International Conference on Robotics and Biomimetics, 2009.
5. A. Barto and O. Simsek, "Intrinsic motivation for reinforcement learning systems," in Proceedings of the Thirteenth Yale Workshop on Adaptive and Learning Systems, 2005.
6. A. Baranes and P.-Y. Oudeyer, "Maturationally-constrained competence-based intrinsically motivated learning," in Proceedings of the Ninth IEEE International Conference on Development and Learning, 2010.
7. -, "Intrinsically motivated goal exploration for active motor learning in robots: A case study," in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, 2010.
8. P.-Y. Oudeyer, F. Kaplan, and V. V. Hafner, "Intrinsic motivation systems for autonomous mental development," IEEE Transactions on Evolutionary Computation, vol. 11(2), 2007.
9. P.-Y. Oudeyer and F. Kaplan, "What is intrinsic motivation? a typology of computational approaches," Frontiers in Neurorobotics, vol. 1(6), 2007.
10. M. Asada, K. Hosoda, Y Kuniyoshi, H. Ishiguro, T. Inui, Y. Yoshikawa, M. Ogino, and C. Yoshida, "Cognitive developmental robotics: a survey," IEEE Transactions on Autonomous Mental Development, vol. 1(1), pp. 12-34, 2009.
11. S. B. Thrun, Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches. Van Nostrand Reinhold, NY, 1992. New York, 1992, ch. The role of exploration in learning control.
12. B. J. Grzyb, A. P. del Pobil, and L. B. Smith, "Reaching for the unreachable: (mis)perception of body effectivity in older infants," manuscript in preparation.
13. -, "Reaching for the unreachable: the cause or the consequence of learning to walk," manuscript in preparation.
14. L. Leotti, S. Iyengar, and K. Ochsner, "Born to choose: the origins and value of the need for control," Trends Cogn Sci., vol. 14(10), pp. 457-463, 2010.
15. D. J. Shapiro, C. Schwartz, and J. Astin, "Controlling ourselves, controlling our world, psychology's role in understanding positive and negative consequences of seeking and gaining control." Am Psychol, vol. 51(12), pp. 1213-30, 1996.
16. P. Zelazo, "The development of walking: new findings and old assumptions," J Mot Behav., vol. 15(2), pp. 99-137, 1983.
17. W. Schultz, P. Dayan, and P. Montague, "A neural substrate of prediction and reward," Science, vol. 275 (5306), pp. 1593-1599, 1997.
18. W. Schultz, 'The reward signal of midbrain dopamine neurons," News Physiol. Sci., vol. 14, pp. 249-255, 1999.
19. R. O'Reilly, M. J. Frank, T. Hazy, and B. Watz, "Pvlv: The primary value and learned value pavlovian learning algorithm," Behavioral Neuroscience, vol. 121(1), pp. 31-49, 2007.
20. T. V. Maia and M. J. Frank, "From reinforcement learning models to psychiatric and neurological disorders," Nature Neuroscience, vol. 14, pp. 154-162, 2011.
21. M. R. Delgado, R. H. Frank, and E. A. Phelps, "Perceptions of moral character modulate the neural systems of reward during the trust game," Nature Neuroscience, vol. 8, pp. 1611-1618, 2005.
22. E. Leibenluft, B. A. Rich, D. T. Vinton, E. E. Nelson, S. J. Fromm, L. H. Berghorst, P. Joshi, A. Robb, R. J. Schachar, D. P. Dickstein, E. B. McClure, and D. S. Pine, "Neural circuitry engaged during unsuccessful motor inhibition in pediatric bipolar disorder," Am J Psychiatry, vol. 164, pp. 52-60, 2007.
23. P. Najt, J. Perez, M. Sanches, M. Peluso, D. Glahn, and J. Soares, "Impulsivity and bipolar disorder," European Neuropsychopharmacology, vol. 17, pp. 313-320, 2007.
24. S. Johnson, "Mania and dysregulation in goal pursuit: a review," Clin Psychol Rev, vol. 25, pp. 241-262, 2005.
25. "American psychiatric association (2000). diagnostic and statistical manual of mental disorders. Washington, dc."
26. B. Abler, I. Greenhouse, D. Ongur, H. Walter, and S. Heckers, "Abnormal reward system activation in mania," Neuropsychopharmacology, vol. 33, pp. 2217-2227, 2008.
27. Z. Biringen, R. N. Emde, J. J. Campos, and M. I. Appelbaum, "Affective reorganization in the infant, the mother, and the dyad: the role of upright locomotion and its timing," Child Development, vol. 66(2), pp. 499-514, 1995.
28. M. E. Jackson, A. S. Frost, and B. Moghaddam, "Stimulation of prefrontal cortex at physiologically relevant frequencies inhibits dopamine release in the nucleus accumbens," Journal of Neurochemistry, vol. 78, pp. 920-923, 2001.
29. P. T. Wong, "Frustration, exploration, and learning," Canadian Psychological Review, vol. 20(3), pp. 133-144, 1979.
30. A. Scher, "The onset of upright locomotion and night wakings," Perceptual and Motor Skills, vol. 83, pp. 11-22, 1996.
31. Z. Biringen, R. N. Emde, J. J. Campos, and M. Appelbaum, "Development of autonomy: role of walking onset and its timing," Perceptual and Motor Skills, vol. 106, pp. 395-414, 2008.
32. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
33. J. A. Beeler, N. Daw, C. R. Frazier, and X. Zhuang, 'Tonic dopamine modulates exploitation of reward learning," Frontiers in behavioral neuroscience, vol. 4, pp. 1-14, 2010.
34. R. Sutton, "Learning to predict by the methods of temporal differences," Machine Learning, vol. 3(1), pp. 9-44, 1988.
35. E. Thelen and L. Smith, A Dynamic Systems Approach to the Development of Cognition and Action. MIT Press, 1994.