Combining manual feedback with subsequent MDP reward signals for reinforcement learning

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 1, Issue , 2010, Pages 5-12

  Knox, W Bradley ^a   Stone, Peter ^a  

^a University of Texas at Austin   (United States)

Author keywords

Human teachers; Human agent interaction; Reinforcement learning; Shaping

Indexed keywords

FEEDBACK; INTELLIGENT AGENTS; LEARNING ALGORITHMS; MARKOV PROCESSES; MULTI AGENT SYSTEMS; PERSONNEL TRAINING; REINFORCEMENT LEARNING; TEACHING;

AUTONOMOUS LEARNING; DESIGNING AGENTS; HUMAN TEACHERS; HUMAN-AGENT INTERACTION; MARKOV DECISION PROCESSES; PROGRAMMING SKILLS; SAMPLE COMPLEXITY; SHAPING;

AUTONOMOUS AGENTS;

EID: 84884357468     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. B. Argali, S. Chernova, M. Vcloso, and B. Browning. A survey of robot learning from demonstration. Robotics and Autonomous Systems, 57(5):469-483, 2009.
2. B. Blumberg, M. Downie, Y. Ivanov, M. Berlin, M. Johnson, and B. Tomlinson. Integrated learning for interactive synthetic characters. SIGGRAPH, 2002.
3. J. Boyan and A. Moore. Generalization in reinforcement learning: Safely approximating the value function. NIPS, 1995.
4. M. Dorigo and M. Colombctti. Robot shaping: Developing situated agents through learning. Artificial Intelligence, 70(2):321-370, 1994.
5. F. Fernandez and M. Veloso. Probabilistic policy reuse in a reinforcement learning agent. AAMAS, 2006.
6. C. Isbell, M. Kcarns, S. Singh, C. Shelton, P. Stone, and D. Kormann. Cobot in LambdaMOO: An Adaptive Social Statistics Agent. AAMAS, 2006.
7. F. Kaplan, P. Oudcycr, E. Kubinyi, and A. Miklósi. Robotic clicker training. Robotics and Autonomous Systems, 38(3-4), 2002.
8. W. B. Knox, I. Fasel, and P. Stone. Design principles for creating human-shapable agents. In AAAI Spring 2009 Symposium, on Agents that Learn from, Human Teachers, March 2009.
9. W. B. Knox and P. Stone. TAMER: Training an agent manually via evaluative reinforcement. In IEEE 7th International Conference, on Development and Learning, August. 2008.
10. W. B. Knox and P. Stone. Interactively shaping agents via human reinforcement: The TAMER framework. In The Fifth Internatzonal Conference on Knowledge Capture, September 2009.
11. M. Mataric. Reward functions for accelerated learning. ICML, 1994.
12. A. Ng, D. Harada, and S. Russell. Policy invariance under reward transformations: Theory and application to reward shaping. ICML, 1999.
13. B. Price and C. Boutilier. Accelerating reinforcement learning through implicit imitation. JAIR, 19:569-629, 2003.
14. R. Sutton and A. Barto. Reinforcement Learning: An Intioduction. MIT Press, 1998.
15. B. Tanner and A. White. Rl-glue: Language-independent software for reinforcement-learning experiments. JMLR, 10, 2009.
16. M. E. Taylor, N. K. Jong, and P. Stone. Transferring instances for model-based reinforcement learning. ECML PKDD, 2008.
17. M. E. Taylor and P. Stone. Cross-domain transfer for reinforcement learning. ICML, 2007.
18. M. E. Taylor, P. Stone, and Y. Liu. Transfer learning via inter-task mappings for temporal difference learning. JMLR, 8(1):2125-2167, 2007.
19. A. Thomaz and C. Brcazcal. Reinforcement Learning with Human Teachers: Evidence of Feedback and Guidance with Implications for Learning Performance. AAAI, 2006.