Experiments in socially guided exploration: Lessons learned in building robots that learn with and without human teachers

Connection Science

Volumn 20, Issue 2-3, 2008, Pages 91-110

  Thomaz, Andrea L ^a   Breazeal, Cynthia ^b  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b MIT MEDIA LAB   (United States)

Author keywords

Artificial intelligence; Computational models of social learning; Human robot interaction; Machine learning; Social scaffolding

Indexed keywords

COMMUNICATIVE INTENT; HIERARCHICAL REINFORCEMENT LEARNING; LEARNING OPPORTUNITY; LEARNING PERFORMANCE; SOCIAL INTERACTIONS; SOCIAL LEARNING; SOCIAL SCAFFOLDING; STRONG CONSISTENCY;

ARTIFICIAL INTELLIGENCE; EXPERIMENTS; HUMAN ROBOT INTERACTION; LEARNING SYSTEMS; REINFORCEMENT LEARNING; SCAFFOLDS; TEACHING;

BEHAVIORAL RESEARCH;

EID: 46249122873     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540090802091917     Document Type: Article

References (28)

1. Atkeson, C.G., and Schaal, S. (1997), "Robot Learning from Demonstration," in Proceedings of Fourteenth International Conference on Machine Learning, ed. D.H. Fisher Jr., Morgan Kaufmann, pp. 12-20.
2. Breazeal, C. (2002), Designing Sociable Robots, Cambridge, MA: MIT Press.
3. Breazeal, C., Berlin, M., Brooks, A., Gray, J., and Thomaz, A.L. (2005), "Using Perspective Taking to Learn from Ambiguous Demonstrations," Journal of Robotics and Autonomous Systems, 54, 385-393. Special Issue on Robot Programming by Demonstration.
4. Blumberg, B., Downie, M., Ivanov, Y., Berlin, M., Johnson, M., and Tomlinson, B. (2002), "Integrated Learning for Interactive Synthetic Characters," in Proceedings of the ACM SIGGRAPH, pp. 417-426.
5. Calinon, S., Guenter, F., and Billard, A. (2007), "On Learning, Representing and Generalizing a Task in a Humanoid Robot," IEEE Transactions on Systems, Man and Cybernetics, Part B. Special Issue on Robot Learning by Observation, Demonstration and Imitation, 37, 286-298.
6. Chernova, S., and Veloso, M. (2007), "Confidence-Based Policy Learning from Demonstration Using Gaussian Mixture Models," in Proceedings of Autonomous Agents and Multi-Agent Systems (AAMAS), ACM.
7. Clark, H.H. (1996), Using Language, Cambridge: Cambridge University Press.
8. Clouse, J. and Utgoff, P. (1992), "A Teaching Method for Reinforcement Learning," in Proceedings of the Nineth International Conference on Machine Learning (ICML), Aberdeen, Scotland, pp. 92-101.
9. Kaiser, M., and Dillman, R. (1996), "Building Elementary Robot Skills from Human Demonstration," in Proceedings of the IEEE International Conference on Robotics and Automation, Piscathaway, NJ: IEEE, pp. 2700-2705.
10. Kuniyoshi, Y., Inaba, M., and Inoue, H. (1994), "Learning By Watching: Extracting Reusable Task Knowledge from Visual Observation of Human Performance," IEEE Transactions on Robotics and Automation, 10, 799-822.
11. Kaplan, F., Oudeyer, P.Y., Kubinyi, E., and Miklosi, A. (2002), "Robotic Clicker Training," Robotics and Autonomous Systems, 38, 197-206.
12. Lamere, P., Kwok, P., Walker, W., Gouvea, E., Singh, R., Raj, B., and Wolf, P. (2003), "Design of the CMU Sphinx-4 decoder," in 8th European Conference on Speech Communication and Technology (EUROSPEECH 2003), Geneva, Switzerland.
13. Levas, A. and Selfridge, M. (1984), "A User-Friendly High-level Robot Teaching System," in Proceedings of the IEEE International Conference on Robotics, Atlanta, Georgia, pp. 413-416.
14. Lockerd-Thomaz, A., and Breazeal, C. (2004), "Tutelage and Socially Guided Robot Learning," in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Sendai, Japan.
15. Maclin, R., Shavlik, J., Torrey, L., Walker, T., and Wild, E. (2005), "Giving Advice about Preferred Actions to Reinforcement Learners Via Knowledge-Based Kernel Regression," in Proceedings of the The Twentieth National Conference on Artificial Intelligence (AAAI), July, Pittsburgh, PA.
16. Nicolescu, M.N., and Malariæ, M.J. (2003), "Natural Methods for Robot Task Learning: Instructive Demonstrations, Generalization and Practice," in Proceedings of the Second International Conference, AAMAS, July, Melbourne, Australia.
17. Oudeyer, P.Y., and Kaplan, F. (2004), "Intelligent Adaptive Curiosity: a Source of Self-Development," in Proceedings of the 4th International Workshop on Epigenetic Robotics, Vol. 117, pp. 127-130.
18. Saksida, L.M., Raymond, S.M., and Touretzky, D.S. (1998), "Shaping Robot Behaviour Using Principles from Instrumental Conditioning," Robotics and Autonomous Systems, 22, 231.
19. Schmidhuber, J. (2005), "Self-Motivated Development Through Rewards for Predictor Errors/Improvements," in Proceedings of the Developmental Robotics 2005 AAAI Spring Symposium, Standford University, CA, eds. D. Blank and L. Meeden.
20. Singh, S., Barto, A.G., and Chentanez, N. (2005), "Intrinsically Motivated Reinforcement Learning," in Proceedings of Advances in Neural Information Processing Systems 17 (NIPS) Vancouver, B.C., Canada.
21. Smart, W.D. and Kaelbling, L.P. (2002), "Effective Reinforcement Learning for Mobile Robots," in Proceedings of the IEEE International Conference on Robotics and Automation, Piscataway, NJ, pp. 3404-3410.
22. Smith, C. and Scott, H. (1997), "A Componential Approach to the Meaning of Facial Expressions," in The Psychology of Facial Expression, Cambridge, UK: Cambridge University Press.
23. Sutton, R., Precup, D., and Singh, S. (1998), "Intra-option Learning About Temporally Abstract Actions," in Proceedings of the Fifteenth International Conference on Machine Learning (ICML98), Masion, WI.
24. Thomaz, A.L. and Breazeal, C. (2008), "Teachable Robots: Understanding Human Teaching Behaviour to Build More Effective Robot Learners," Artificial Intelligence Journal, 172, 716-737.
25. _, (2006), "Transparency and Socially Guided Machine Learning," in Proceedings of the Fifth International Conference on Developmental Learning (1CDL), Bloomington, IN.
26. Thomaz, A.L., Berlin, M., and Breazeal, C. (2005), "An Embodied Computational Model of Social Referencing," in IEEE International Workshop on Human Robot Interaction (RO-MAN), Nashville, TN.
27. _, (1999), "Between MDPs and Semi-MDPs: Learning, Planning and Representing Knowledge at Multiple Temporal Scales," Journal of Artificial Intelligence Research, 1, 139.
28. Vygotsky, L. S. E.M.C. (1978), Mind in Society: the Development of Higher Psychological Processes, Cambridge, MA: Harvard University Press.