Learning non-myopically from human-generated reward

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2013, Pages 191-201

  Knox, W Bradley ^a   Stone, Peter ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b University of Texas at Austin   (United States)

Author keywords

End user programming; Human teachers; Human agent interaction; Interactive machine learning; Modeling and prediction of user behavior; Reinforcement learning

Indexed keywords

END USER PROGRAMMING; HUMAN TEACHERS; HUMAN-AGENT INTERACTION; INTERACTIVE MACHINE LEARNING; USER BEHAVIORS;

COMPUTER PROGRAMMING; LEARNING ALGORITHMS; MARKOV PROCESSES; REINFORCEMENT LEARNING; RESEARCH;

BEHAVIORAL RESEARCH;

EID: 84875869978     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2449396.2449422     Document Type: Conference Paper

References (14)

1. Argall, B., Chernova, S., Veloso, M., and Browning, B. A survey of robot learning from demonstration. Robotics and Autonomous Systems 57, 5 (2009), 469-483.
2. Gelly, S., and Silver, D. Achieving master level play in 9× 9 computer go. In Proceedings of AAAI (2008), 1537-1540.
3. Hester, T., and Stone, P. Learning and using models. In Reinforcement Learning: State of the Art, M. Wiering and M. van Otterlo, Eds. Springer Verlag, Berlin, Germany, 2011.
4. Isbell, C., Kearns, M., Singh, S., Shelton, C., Stone, P., and Kormann, D. Cobot in LambdaMOO: An Adaptive Social Statistics Agent. Proceedings of The 5th Annual International Conference on Autonomous Agents and Multiagent Systems (AAMAS) (2006).
5. Knox, W. B. Learning from Human-Generated Reward. PhD thesis, Department of Computer Science, The University of Texas at Austin, August 2012.
6. Knox, W. B., and Stone, P. Interactively shaping agents via human reinforcement: The TAMER framework. In The 5th International Conference on Knowledge Capture (September 2009).
7. Knox, W. B., and Stone, P. Reinforcement learning from human reward: Discounting in episodic tasks. In 21st IEEE International Symposium on Robot and Human Interactive Communication (Ro-Man) (September 2012).
8. Kocsis, L., and Szepesvári, C. Bandit based monte-carlo planning. Machine Learning: ECML 2006 (2006), 282-293.
9. León, A., Morales, E., Altamirano, L., and Ruiz, J. Teaching a robot to perform task through imitation and on-line feedback. Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications (2011), 549-556.
10. Pilarski, P., Dawson, M., Degris, T., Fahimi, F., Carey, J., and Sutton, R. Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning. In IEEE International Conference on Rehabilitation Robotics (ICORR), IEEE (2011), 1-7.
11. Suay, H., and Chernova, S. Effect of human guidance and state space size on interactive reinforcement learning. In 20th IEEE International Symposium on Robot and Human Interactive Communication (Ro-Man) (2011), 1-6.
12. Sutton, R., and Barto, A. Reinforcement Learning: An Introduction. MIT Press, 1998.
13. Tenorio-Gonzalez, A., Morales, E., and Villaseñor-Pineda, L. Dynamic reward shaping: training a robot by voice. Advances in Artificial Intelligence-IBERAMIA (2010), 483-492.
14. Thomaz, A., and Breazeal, C. Teachable robots: Understanding human teaching behavior to build more effective robot learners. Artificial Intelligence 172, 6-7 (2008), 716-737.