Bootstrapping intrinsically motivated learning with human demonstration

2011 IEEE International Conference on Development and Learning, ICDL 2011

Volumn , Issue , 2011, Pages

  Nguyen, Sao Mai ^a   Baranes, Adrien ^a   Oudeyer, Pierre Yves ^a  

^a INRIA   (France)

Author keywords

[No Author keywords available]

Indexed keywords

INTRINSIC MOTIVATION; SOCIAL INTERACTIONS; SOCIAL LEARNING;

DEMONSTRATIONS; MOTIVATION;

LEARNING ALGORITHMS;

EID: 80055011598     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEVLRN.2011.6037329     Document Type: Conference Paper

References (35)

1. J. Weng, J. McClelland, A. Pentland, O. Sporns, I. Stockman, M. Sur, and E. Thelen, "Autonomous mental development by robots and animals," Science, vol. 291, no. 599-600, 2001.
2. M. Asada, K. Hosoda, Y. Kuniyoshi, H. Ishiguro, T. Inui, Y. Yoshikawa, M. Ogino, and C. Yoshida, "Cognitive developmental robotics: A survey," IEEE Trans. Autonomous Mental Development, vol. 1, no. 1, 2009.
3. S. Chernova and M. Veloso, "Interactive policy learning through confidence-based autonomy," Journal of Artificial Intelligence Research, vol. 34, 2009.
4. M. Lopes, F. Melo, B. Kenward, and J. Santos-Victor, "A computational model of social-learning mechanisms," Adaptive Behavior, vol. 467, no. 17, 2009.
5. T. Cederborg, M. Li, A. Baranes, and P.-Y Oudeyer, "Incremental local inline gaussian mixture regression for imitation learning of multiple tasks," in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan, 2010.
6. S. Calinon, Robot Programming by Demonstration: A Probabilistic Approach. EPFL/CRC Press, 2009, ePFL Press ISBN 978-2-940222-31-5, CRC Press ISBN 978-1-4398-0867-2.
7. S. Calinon, G. F., and A. Billard, "On learning, representing and generalizing a task in a humanoid robot," IEEE Transactions on Systems, Man and Cybernetics, Part B., 2007.
8. B. Blumberg, M. Downie, Y Ivanov, M. Berlin, M. P. Johnson, and B. Tomlinson, "Integrated learning for interactive synthetic characters," ACM Trans. Graph, vol. 21, pp. 417-426, July 2002. [Online], Available: http://doi.acm.org/10.1145/566654.566597
9. F. Kaplan, P.-Y. Oudeyer, E. Kubinyi, and A. Miklosi, "Robotic clicker training," Robotics and Autonomous Systems, vol. 38(, no. 3-4, pp. 197-206, 2002.
10. J. Clouse and P. Utgoff, "A teaching method for reinforcement learning," Proc. of the Nineth International Conf. on Machine Learning, 1992.
11. W. Smart and L. Kaelbling, "Effective reinforcement learning for mobile robots," Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3404-3410., 2002.
12. C. L. Nehaniv and K. Dautenhahn, Eds., Imitation and Social Learning in Robots, Humans and Animals. Behavioural, Social and Communicative Dimensions. Cambridge, March 2007.
13. M. Lopes and P.-Y. Oudeyer, "Active learning and intrinsically motivated exploration in robots: Advances and challenges (guest editorial)," IEEE Transactions on Autonomous Mental Development, vol. 2, no. 2, pp. 65-69, 2010.
14. R. M. Ryan and E. L. Deci, "Intrinsic and extrinsic motivations: Classic definitions and new directions," Contemporary Educational Psychology, vol. 25, no. 1, pp. 54-67, 2000.
15. E. Deci and R. M. Ryan, Intrinsic Motivation and self-determination in human behavior. New York: Plenum Press, 1985.
16. P.-Y. Oudeyer and F. Kaplan, "How can we define intrinsic motivations ?" in Proc. Of the 8th Conf. On Epigenetic Robotics., 2008.
17. A. G. Barto, S. Singh, and N. Chenatez, "Intrinsically motivated learning of hierarchical collections of skills," in Proc. 3rd Int. Conf. Development Learn., San Diego, CA, 2004, pp. 112-119.
18. P.-Y. Oudeyer, F. Kaplan, and V. Hafner, "Intrinsic motivation systems for autonomous mental development," IEEE Transactions on Evolutionary Computation, vol. 11(2), pp. pp. 265-286, 2007.
19. A. Baranes and P.-Y. Oudeyer, "Riac: Robust intrinsically motivated active learning," in Proc. of the IEEE International Conference on Learning and Development., 2009.
20. J. Schmidhuber, "Formal theory of creativity," IEEE Transation on Autonomous Mental Development, vol. 2, no. 3, pp. 230-247, 2010.
21. M. Schembri, M. Mirolli, and G. Baldassarre, "Evolving internal rein-forcers for an intrinsically motivated reinforcement learning robot," in Proceedings of the 6the IEEE International Conference on Development and Learning (ICDL07), Y. Demeris, B. Scasselati, and D. Mareschal, Eds., 2007.
22. J. Schmidhuber, "Curious model-building control systems," in Proc. Int. Joint Conf. Neural Netw., vol. 2, 1991, pp. 1458-1463.
23. V. Fedorov, Theory of Optimal Experiment. New York, NY: Academic Press, Inc., 1972.
24. D. A. Cohn, Z. Ghahramani, and M. I. Jordan, "Active learning with statistical models," Journal of Artificial Intelligence Research, vol. 4, pp. 129-145, 1996.
25. N. Roy and A. McCallum, "Towards optimal active learning through sampling estimation of error reduction," in Proc. 18th Int. Conf. Mach. Learn., vol. 1, 2001, pp. 143-160.
26. P.-Y. Oudeyer, A. Baranes, F. Kaplan, and O. Ly, Intrinsic Motivation in Animals and Machines, to appear, ch. Developmental constraints on intrinsically motivated skill learning: towards addressing high-dimensions and unboundedness in the real world.
27. C. Bishop, "Pattern recognition and machine learning," in Information Science and Statistics. Springer, 2007.
28. A. L. Thomaz and C. Breazeal, "Experiments in socially guided exploration: Lessons learned in building robots that learn with and without human teachers," Connection Science, Special Issue on Social Learning in Embodied Agents, vol. 20, no. 2, pp. 91-110, 2008. [Online]. Available: http://www.cc.gatech.edu/athomaz/pubs.html
29. A. L. Thomaz, "Socially guided machine learning," Ph.D. dissertation, MIT, 5 2006. [Online]. Available: http://www.cc.gatech.edu/ath- omaz/pubs.html
30. A. Baranes and P.-Y. Oudeyer, "Riac: Robust intrinsically motivated active learning," in Proceedings of the IEEE International Conference on Development and Learning, Shanghai, China, 2009.
31. C. Breazeal and L. Aryananda, "Recognition of affective communicative intent in robot-directed speech," Autonomous Robots, vol. 12, pp. 83-104, 2002, 10.1023/A:1013215010749. [Online], Available: http://dx.doi.org/10.1023/A:1013215010749
32. J. Call and M. Carpenter, Imitation in animals and artifacts. Cambridge, MA: MIT Press., 2002, ch. Three sources of information in social learning, pp. 211-228.
33. V. Horner and A. Whiten, "Causal knowledge and imitation/emulation switching in chimpanzees (pan troglodytes) and children (homo sapiens)," Animal Cognition, vol. 8, pp. 164-181, 2005, 10.1007/s10071-004-0239-6. [Online], Available: http://dx.doi.org/10.1007/sl0071-004-0239-6
34. M. Muja and D. Lowe, "Fast approximate nearest neighbors with automatic algorithm," in International Conference on Computer Vision Theory and Applications (VISAPP'09), 2009.
35. J. C. Lagarias, J. A. Reeds, M. H. Wright, and P. E. Wright, "Convergence properties of the nelder-mead simplex method in low dimensions," SIAM Journal of Optimization, vol. 9, no. 1, pp. 112-147, 1998.