Autonomous shaping: Knowledge transfer in reinforcement learning

ACM International Conference Proceeding Series

Volumn 148, Issue , 2006, Pages 489-496

  Konidaris, George ^a   Barto, Andrew ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTONOMOUS AGENTS; PREDICTIVE CONTROL SYSTEMS; REINFORCEMENT LEARNING;

ROD POSITIONING TASK; SHAPING FUNCTION;

KNOWLEDGE ACQUISITION;

EID: 34250719248     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1143844.1143906     Document Type: Conference Paper

References (24)

1. Barto, A., Bradtke, S., & Singh, S. (1995). Learning to act using real-time dynamic programming. Artificial Intelligence, 72, 81-138.
2. Bernstein, D. (1999). Reusing old policies to accelerate learning on new MDPs (Technical Report UM-CS-1999-026). Department of Computer Science, University of Massachusetts at Amherst.
3. Dorigo, M., & Colombetti, M. (1998). Robot shaping: An experiment in behavior engineering. MIT Press/Bradford Books.
4. Koenig, S. (1999). Exploring unknown environments with real-time search or reinforcement learning. Advances in Neural Information Processing Systems (NIPS) 12 (pp. 1003-1009).
5. Koenig, S., & Simmons, R. (1996). The effect of representation and knowledge on goal-directed exploration with reinforcement-learning algorithms. Machine Learning, 22, 227-250.
6. Konidaris, G., & Hayes, G. (2004). Estimating future reward in reinforcement learning animals using associative learning. From Animals to Animals 8: Proceedings of the 8th International Conference on the Simulation of Adaptive Behavior (pp. 297-304).
7. Korf, R. (1990). Real-time heuristic search. Artificial Intelligence, 42, 189-211.
8. Mahadevan, S. (2005). Proto-value functions: Developmental reinforcement learning. Proceedings of the Twenty Second International Conference on Machine Learning (ICML 05).
9. Matarić, M. (1997). Reinforcement learning in the multi-robot domain. Autonomous Robots, 4, 73-83.
10. Moore, A., & Atkeson, C. (1993). Prioritized sweeping: Reinforcement learning with less data and less time. Machine Learning, 13, 103-130.
11. Ng, A., Harada, D., & Russell, S. (1999). Policy invariance under reward transformations: theory and application to reward shaping. Proceedings of the 16th International Conference on Machine Learning (pp. 278-287).
12. Perkins, S., & Hayes, G. (1996). Robot shaping - principles, methods and architectures. Artificial Intelligence and Simulation of Behaviour 1996 - Workshop on Learning in Robots and Animals.
13. Pickett, M., & Barto, A. (2002). Policyblocks: An algorithm for creating useful macro-actions in reinforcement learning. Proceedings of the Nineteenth International Conference of Machine Learning (ICML 02) (pp. 506-513).
14. Randløv, J., & Alstrøm, P. (1998). Learning to drive a bicycle using reinforcement learning and shaping. Proceedings of the 15th International Conference on Machine Learning (pp. 463-471).
15. Selfridge, O., Sutton, R. S., & Barto, A. G. (1985). Training and tracking in robotics. Proceedings of the Ninth International Joint Conference on Artificial Intelligence (pp. 670-672).
16. Skinner, B. F. (1938). The behavior of organisms: An experimental analysis. New York: Appleton-Century-Crofts.
17. Stone, P., & Veloso, M. (2000). Layered learning. Proceedings of the 11th European Conference on Machine Learning (pp. 369-381). Barcelona, Spain: Springer, Berlin.
18. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
19. Taylor, M., Stone, P., & Liu, Y. (2005). Value functions for RL-based behavior transfer: a comparative study. Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI-05).
20. Thrun, S. (1992). Efficient exploration in reinforcement learning (Technical Report CS-92-102). Carnegie Mellon University.
21. Thrun, S., & Schwartz, A. (1995). Finding structure in reinforcement learning. Advances in Neural Information Processing Systems (pp. 385-392). The MIT Press.
22. Van Roy, B. (1998). Learning and value function approximation in complex decision processes. Doctoral dissertation, Massachusetts Institute of Technology.
23. Weng, J., McClelland, J., Pentland, A., Sporns, O., Stockman, I., Sur, M., & Thelen, E. (2000). Autonomous mental development by robots and animals. Science, 291, 599-600.
24. Wiewiora, E. (2003). Potential-based shaping and Q-value initialization are equivalent. Journal of Artificial Intelligence Research, 19, 205-208.