Reinforcement learning from simultaneous human and MDP reward

11th International Conference on Autonomous Agents and Multiagent Systems 2012, AAMAS 2012: Innovative Applications Track

Volumn 1, Issue , 2012, Pages 528-535

  Knox, W Bradley ^a   Stone, Peter ^a  

^a University of Texas at Austin   (United States)

Author keywords

Human teachers; Human agent interaction; Interactive learning; Reinforcement learning; Shaping

Indexed keywords

AUTONOMOUS AGENTS; LEARNING ALGORITHMS; MARKOV PROCESSES; MULTI AGENT SYSTEMS; REINFORCEMENT LEARNING;

COMPLEX ENVIRONMENTS; COMPUTATIONAL AGENTS; HUMAN TEACHERS; HUMAN-AGENT INTERACTION; INTERACTIVE LEARNING; MARKOV DECISION PROCESSES; SHAPING; TRADITIONAL REINFORCEMENTS;

PERSONNEL TRAINING;

EID: 84899434166     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. R. Bianchi, C. Ribeiro, and A. Costa. Heuristically Accelerated Q-Learning: a new approach to speed up Reinforcement Learning. Advances in AI - SBIA, 2004.
2. L. Cobo, P. Zang, C. Isbell Jr, and A. Thomaz. Automatic state abstraction from demonstration. In IJCAI, 2011.
3. M. Dorigo and M. Colombetti. Robot shaping: Developing situated agents through learning. Artificial Intelligence, 1994.
4. F. Fernández and M. Veloso. Probabilistic policy reuse in a reinforcement learning agent. AAMAS, 2006.
5. C. Isbell, M. Kearns, S. Singh, C. Shelton, P. Stone, and D. Kormann. Cobot in LambdaMOO: An Adaptive Social Statistics Agent. AAMAS, 2006.
6. K. Judah, S. Roy, A. Fern, and T. Dietterich. Reinforcement Learning Via Practice and Critique Advice. AAAI, 2010.
7. W. Knox and P. Stone. Interactively shaping agents via human reinforcement: The TAMER framework. K-CAP, 2009.
8. W. Knox and P. Stone. Combining manual feedback with subsequent MDP reward signals for reinforcement learning. AAMAS, 2010.
9. G. Kuhlmann, P. Stone, R. Mooney, and J. Shavlik. Guiding a reinforcement learner with natural language advice: Initial results in RoboCup soccer. In The AAAI-2004 Workshop on Supervisory Control of Learning and Adaptive Systems, July 2004.
10. M. Mataric. Reward functions for accelerated learning. ICML, 1994.
11. B. Price and C. Boutilier. Accelerating reinforcement learning through implicit imitation. JAIR, 19:569-629, 2003.
12. W. Smart and L. Kaelbling. Practical reinforcement learning in continuous spaces. ICML, 2000.
13. M. Sridharan. Augmented reinforcement learning for interaction with non-expert humans in agent domains. In Proceedings of IEEE International Conference on Machine Learning Applications, 2011.
14. K. Subramanian, C. Isbell, and A. Thomaz. Learning options through human interaction. In 2011 IJCAI Workshop on Agents Learning Interactively from Human Teachers (ALIHT), 2011.
15. R. Sutton and A. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
16. B. Tanner and A. White. RL-Glue: Language-independent software for reinforcement-learning experiments. JMLR, 10, 2009.
17. M. Taylor, H. Suay, and S. Chernova. Integrating reinforcement learning with human demonstrations of varying ability. AAMAS, 2011.
18. A. Tenorio-Gonzalez, E. Morales, and L. Villasehor-Pineda. Dynamic reward shaping: training a robot by voice. Advances in Artificial Intelligence- IBERAMIA 2010, pages 483-492, 2010.
19. A. Thomaz and C. Breazeal. Reinforcement Learning with Human Teachers: Evidence of Feedback and Guidance with Implications for Learning Performance. AAAI, 2006.
20. E. Wiewiora, G. Cottrell, and C. Elkan. Principled methods for advising reinforcement learning agents. ICML, 2003.