Teachable robots: Understanding human teaching behavior to build more effective robot learners

Artificial Intelligence

Volumn 172, Issue 6-7, 2008, Pages 716-737

  Thomaz, Andrea L ^a   Breazeal, Cynthia ^b  

^a Georgia Institute of Technology   (United States)

^b MIT MEDIA LAB   (United States)

Author keywords

Human robot interaction; Reinforcement learning; User studies

Indexed keywords

ALGORITHMS; FEEDBACK CONTROL; HUMAN COMPUTER INTERACTION; REINFORCEMENT LEARNING; SOFTWARE DESIGN; USER INTERFACES;

HUMAN TRAINER CONTROL; HUMAN-ROBOT INTERACTIONS; ROBOT-LEARNER PARTNERSHIP; USER STUDIES;

INTELLIGENT ROBOTS;

EID: 38649092712     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2007.09.009     Document Type: Article

References (38)

1. Argyle M., Ingham R., and McCallin M. The different functions of gaze. Semiotica (1973) 19-32
2. R. Arkin, M. Fujita, T. Takagi, R. Hasegawa, An ethological and emotional basis for human-robot interaction, in: Proceedings of the Conference on Robotics and Autonomous Systems, 2003
3. Bates J. The role of emotion in believable agents. Communications of the ACM 37 7 (1997) 122-125. http://citeseer.ist.psu.edu/bates94role.html
4. B. Blumberg, Old tricks, new dogs: Ethology and interactive creatures, Ph.D. thesis, Massachusetts Institute of Technology, 1997
5. B. Blumberg, M. Downie, Y. Ivanov, M. Berlin, M. Johnson, B. Tomlinson, Integrated learning for interactive synthetic characters, in: Proceedings of the ACM SIGGRAPH, 2002
6. Breazeal C. Designing Sociable Robots (2002), MIT Press, Cambridge, MA
7. Breazeal C., Brooks A., Gray J., Hoffman G., Lieberman J., Lee H., Lockerd A., and Mulanda D. Tutelage and collaboration for humanoid robots. International Journal of Humanoid Robotics 1 2 (2004)
8. J. Clouse, P. Utgoff, A teaching method for reinforcement learning, in: Proc. of the Ninth International Conf. on Machine Learning (ICML), 1992, pp. 92-101
9. Cohn D., Ghahramani Z., and Jordan M. Active learning with statistical models. In: Tesauro G., Touretzky D., and Alspector J. (Eds). Advances in Neural Information Processing vol. 7 (1995), Morgan Kaufmann
10. Evans R. Varieties of learning. In: Rabin S. (Ed). AI Game Programming Wisdom (2002), Charles River Media, Hingham, MA 567-578
11. Greenfield P.M. Theory of the teacher in learning activities of everyday life. In: Rogoff B., and Lave J. (Eds). Everyday Cognition: Its Development in Social Context (1984), Harvard University Press, Cambridge, MA
12. E. Horvitz, J. Breese, D. Heckerman, D. Hovel, K. Rommelse, The lumiere project: Bayesian user modeling for inferring the goals and needs of software users, in: Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, Madison, WI, July 1998, pp. 256-265
13. C. Isbell, C. Shelton, M. Kearns, S. Singh, P. Stone, Cobot: A social reinforcement learning agent, in: 5th Intern. Conf. on Autonomous Agents, 2001
14. Kaplan F., Oudeyer P.-Y., Kubinyi E., and Miklosi A. Robotic clicker training. Robotics and Autonomous Systems 38 3-4 (2002) 197-206
15. Krauss R.M., Chen Y., and Chawla P. Nonverbal behavior and nonverbal communication: What do conversational hand gestures tell us?. In: Zanna M. (Ed). Advances in Experimental Social Psychology (1996), Academic Press, Tampa 389-450
16. Vygotsky L.S. In: Cole M. (Ed). Mind in Society: The Development of Higher Psychological Processes (1978), Harvard University Press, Cambridge, MA
17. Lashkari Y., Metral M., and Maes P. Collaborative interface agents. Proceedings of the Twelfth National Conference on Artificial Intelligence vol. 1 (1994), AAAI Press, Seattle, WA. http://citeseer.ist.psu.edu/lashkari94collaborative.html
18. Lauria S., Bugmann G., Kyriacou T., and Klein E. Mobile robot programming using natural language. Robotics and Autonomous Systems 38 3-4 (2002) 171-181
19. In: Lieberman H. (Ed). Your Wish is My Command: Programming by Example (2001), Morgan Kaufmann, San Francisco, CA
20. A. Lockerd, C. Breazeal, Tutelage and socially guided robot learning, in: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2004
21. R. Maclin, J. Shavlik, L. Torrey, T. Walker, E. Wild, Giving advice about preferred actions to reinforcement learners via knowledge-based kernel regression, in: Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI), Pittsburgh, PA, July 2005
22. Mataric M. Reinforcement learning in the multi-robot domain. Autonomous Robots 4 1 (1997) 73-83
23. T.M. Mitchell, S. Wang, Y. Huang, Extracting knowledge about users' activities from raw workstation contents, in: Proceedings of the 21st National Conference on Artificial Intelligence (AAAI), 2006
24. M.N. Nicolescu, M.J. Matarić, Natural methods for robot task learning: Instructive demonstrations, generalization and practice, in: Proceedings of the 2nd Intl. Conf. AAMAS. Melbourne, Australia, July 2003
25. Saksida L.M., Raymond S.M., and Touretzky D.S. Shaping robot behavior using principles from instrumental conditioning. Robotics and Autonomous Systems 22 3/4 (1998) 231
26. Schaal S. Is imitation learning the route to humanoid robots?. Trends in Cognitive Sciences 3 (1999) 233-242
27. Schohn G., and Cohn D. Less is more: Active learning with support vector machines. Proc. 17th ICML (2000), Morgan Kaufmann, San Francisco, CA 839-846
28. W.D. Smart, L.P. Kaelbling, Effective reinforcement learning for mobile robots, in: Proceedings of the IEEE International Conference on Robotics and Automation, 2002, pp. 3404-3410
29. K.O. Stanley, B.D. Bryant, R. Miikkulainen, Evolving neural network agents in the nero video game, in: Proceedings of IEEE 2005 Symposium on Computational Intelligence and Games (CIG'05), 2005
30. Steels L., and Kaplan F. Aibo's first words: The social learning of language and meaning. Evolution of Communication 4 1 (2001) 3-32
31. Stern A., Frank A., and Resner B. Virtual petz (video session): A hybrid approach to creating autonomous, lifelike dogz and catz. AGENTS '98: Proceedings of the Second International Conference on Autonomous Agents (1998), ACM Press, New York 334-335
32. Thomas F., and Johnson O. Disney Animation: The Illusion of Life (1981), Abbeville Press, New York
33. Thrun S. Robotics. In: Russell S., and Norvig P. (Eds). Artificial Intelligence: A Modern Approach. second ed. (2002), Prentice Hall
34. S.B. Thrun, T.M. Mitchell, Lifelong robot learning, Tech. Rep. IAI-TR-93-7, 1993
35. Tomlinson B., and Blumberg B. Social synthetic characters. Computer Graphics 26 2 (2002)
36. R. Voyles, P. Khosla, A multi-agent system for programming robotic agents by human demonstration, in: Proceedings of AI and Manufacturing Research Planning Workshop, 1998
37. Watkins C., and Dayan P. Q-learning. Machine Learning 8 3 (1992) 279-292
38. Wertsch J.V., Minick N., and Arns F.J. Creation of context in joint problem solving. In: Rogoff B., and Lave J. (Eds). Everyday Cognition: Its Development in Social Context (1984), Harvard University Press, Cambridge, MA