Asymmetric interpretations of positive and negative human feedback for a social learning agent

Proceedings - IEEE International Workshop on Robot and Human Interactive Communication

Volumn , Issue , 2007, Pages 720-725

  Thomaz, Andrea L ^a   Breazeal, Cynthia ^a  

^a MIT MEDIA LAB   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGENTS; ARTIFICIAL INTELLIGENCE; AUTOMATION; EDUCATION; FEEDBACK; LEARNING SYSTEMS; MACHINE DESIGN; METROPOLITAN AREA NETWORKS; MILITARY DATA PROCESSING; REINFORCEMENT; REINFORCEMENT LEARNING; REVERSE OSMOSIS; ROBOTICS; ROBOTS; TEACHING; TURBULENT FLOW;

COMPUTER GAMES; DESIGN AGENT (DA); HUMAN FEEDBACK; INTERACTIVE COMMUNICATIONS; INTERNATIONAL CONFERENCES; MACHINE-LEARNING; NEGATIVE FEEDBACK (NFB); P RIOR WORK; PARTNER (CO); REINFORCEMENT LEARNING (RL) AGENT; SOCIAL LEARNING; SOCIAL ROBOTS;

CONTROL THEORY;

EID: 46249092526     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROMAN.2007.4415180     Document Type: Conference Paper

References (28)

1. Christopher G. Atkeson and Stefan Schaal. Robot learning from demonstration. In Proc. 14th International Conference on Machine Learning, pages 12-20. Morgan Kaufmann, 1997.
2. B. Blumberg, R. Burke, D. Isla, M. Downie, and Y Ivanov. CreatureSmarts: The art and architecture of a virtual brain. In Proceedings of the Game Developers Conference, pages 147-166, 2001.
3. B. Blumberg, M. Downie, Y. Ivanov, M. Berlin, M.P. Johnson, and B. Tomlinson. Integrated learning for interactive synthetic characters. In Proceedings of the ACM SIGGRAPH, 2002.
4. C. Breazeal, G. Hoffman, and A. Lockerd. Teaching and working with robots as collaboration. In Proceedings of the AAMAS, 2004.
5. C. Breazeal and B. Scassellati. Robots that imitate humans. Trends in Cognitive Science, 6(11), 2002.
6. H. H. Clark. Using Language. Cambridge University Press, Cambridge, 1996.
7. J. Clouse and P. Utgoff. A teaching method for reinforcement learning. In Proc. of the Nineth International Conf. on Machine Learning (ICML), pages 92-101, 1992.
8. R. Evans. Varieties of learning. In S. Rabin, editor, AI Game Programming Wisdom, pages 567-578. Charles River Media, Hingham, MA, 2002.
9. C. Holroyd and M. Coles. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109(4):679-709, 2002.
10. E. Horvitz, J. Breese, D. Heckerman, D. Hovel, and K. Rommelse. The lumiere project: Bayesian user modeling for inferring the goals and needs of software users. In In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, pages 256-265, Madison, WI, July 1998.
11. C. Isbell, C. Shelton, M. Kearns, S. Singh, and P. Stone. Cobot: A social reinforcement learning agent. 5th Intern. Conf. on Autonomous Agents, 2001.
12. F. Kaplan, P-Y Oudeyer, E. Kubinyi, and A. Miklosi. Robotic clicker training. Robotics and Autonomous Systems, 3 8(3-4):197-206, 2002.
13. G. Kuhlmann, P. Stone, R. J. Mooney, and J. W. Shavlik. Guiding a reinforcement learner with natural language advice: Initial results in robocup soccer. In Proceedings of the AAAI-2004 Workshop on Supervisory Control of Learning and Adaptive Systems, San Jose, CA, July 2004.
14. Y. Kuniyoshi, M. Inaba, and H. Inoue. Learning by watching: Extracting reusable task knowledge from visual observation of human performance. IEEE Transactions on Robotics and Automation, 10:799-822, 1994.
15. Y. Lashkari, M. Metral, and P. Maes. Collaborative Interface Agents. In Proceedings of the Twelfth National Conference on Artificial Intelligence, volume 1. AAAI Press, Seattle, WA, 1994.
16. H. Lieberman, editor. Your Wish is My Command: Programming by Example. Morgan Kaufmann, San Francisco, 2001.
17. L. J. Lin. Self-improving reactive agents based on reinforcement learning, planning and teaching. Machine Learning, 8:293-321, 1992.
18. A. Lockerd and C. Breazeal. Tutelage and socially guided robot learning. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2004.
19. R. Maclin, J. Shavlik, L. Torrey, T. Walker, and E. Wild. Giving advice about preferred actions to reinforcement learners via knowledge-based kernel regression. In Proceedings of the The Twentieth National Conference on Artificial Intelligence (AAAI), Pittsburgh, PA, July 2005.
20. M. N. Nicolescu and M. J. Matarić. Natural methods for robot task learning: Instructive demonstrations, generalization and practice. In Proceedings of the 2nd Intl. Conf. AAMAS, Melbourne, Australia, July 2003.
21. P. E. Rybski, K. Yoon, J. Stolarz, and M. Veloso. Interactive robot task training through dialog and demonstration. In Proceedings of the 2nd Annual Conference on Human-Robot Interaction (HRI), 2007.
22. L. M. Saksida, S. M. Raymond, and D. S. Touretzky. Shaping robot behavior using principles from instrumental conditioning. Robotics and Autonomous Systems, 22(3/4):231, 1998.
23. S. Schaal. Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3:233242, 1999.
24. W. D. Smart and L. P. Kaelbling. Effective reinforcement learning for mobile robots. In In Proceedings of the IEEE International Conference on Robotics and Automation, pages 3404-3410, 2002.
25. A. Stern, A. Frank, and B. Resner. Virtual petz (video session): a hybrid approach to creating autonomous, lifelike dogz and catz. In AGENTS '98: Proceedings of the second international conference on Autonomous agents, pages 334-335, New York, NY, USA, 1998. ACM Press.
26. A. L. Thomaz, G. Hoffman, and C. Breazeal. Reinforcement learning with human teachers: Understanding how people want to teach robots. In Proceedings of the 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN06), 2006.
27. C. Watkins and P. Dayan. Q-learning. Machine Learning, 8(3):279-292, 1992.
28. T. Zalla, E. Koechlin, P. Pietrini, F. Basso, P. Aquino, A. Sirigu, and J. Grafman. Differential amygdala responses to winning and losing: a functional magnetic resonance imaging study in humans. European Journal of Neuroscience, 12:1764-1770, 2000.