Transfer learning for reinforcement learning on a physical robot

Proceedings of the Adaptive and Learning Agents Workshop, ALA 2010 - In Conjunction with the 9th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2010

Volumn , Issue , 2010, Pages 24-29

  Barrett, Samuel ^a   Taylor, Matthew E ^b   Stone, Peter ^a  

^a University of Texas at Austin   (United States)

^b University of Southern California ^*  (United States)

Author keywords

Artificial Intelligence; Reinforcement Learning; Robotics; Transfer Learning

Indexed keywords

ASYMPTOTIC PERFORMANCE; DEVELOPMENT AND TESTING; PHYSICAL ROBOTS; REAL ROBOT; ROBOT BEHAVIOR; SAMPLE COMPLEXITY; SPEED UP; TRANSFER LEARNING;

ARTIFICIAL INTELLIGENCE; AUTONOMOUS AGENTS; INTELLIGENT AGENTS; MULTI AGENT SYSTEMS; REINFORCEMENT LEARNING; ROBOTICS;

ROBOTS;

EID: 84881589485     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. P. Abbeel and A. Y. Ng. Exploration and apprenticeship learning in reinforcement learning. In ICML '05, pages 1-8. ACM, 2005.
2. J. S. Albus. Brains, Behavior, and Robotics. Byte Books, Peterborough, NH, 1981.
3. J. A. Bagnell and J. Schneider. Autonomous helicopter control using reinforcement learning policy search methods. In ICRA '01, pages 1615-1620. IEEE Press, 2001.
4. A. Coates, P. Abbeel, and A. Y. Ng. Learning for control from multiple demonstrations. In ICML '08, pages 144-151. ACM, 2008.
5. Y. Davidor. Genetic Algorithms and Robotics: A Heuristic Strategy for Optimization. World Scientific Publishing Co., Inc., 1991.
6. E. Gat. On the role of simulation in the study of autonomous mobile robots. In AAAI-95 Spring Symposium on Lessons Learned from Implemented Software Architectures for Physical Agents., March 1995.
7. T. Hester, M. Quinlan, and P. Stone. Generalized model learning for reinforcement learning on a humanoid robot. In ICRA '10, 2010.
8. N. Kohl and P. Stone. Policy gradient reinforcement learning for fast quadrupedal locomotion. In ICRA '04, May 2004.
9. A. Y. Ng, H. J. Kim, M. I. Jordan, and S. Sastry. Inverted autonomous helicopter flight via reinforcement learning. In In International Symposium on Experimental Robotics. MIT Press, 2004.
10. J. M. Porta and E. Celaya. Efficient gait generation using reinforcement learning. In Proceedings of the Fourth International Conference on Climbing and Walking Robots, pages 411-418, 2001.
11. G. A. Rummery and M. Niranjan. On-line Q-learning using connectionist systems. Technical Report CUEF/F-INFENG/TR 166, Cambridge University Engineering Dept., 1994.
12. O. G. Selfridge, R. S. Sutton, and A. G. Barto. Training and tracking in robotics. In IJCAI, pages 670-672, 1985.
13. S. P. Singh. Transfer of learning by composing solutions of elemental sequential tasks. Machine Learning, 8:323-339, 1992.
14. R. S. Sutton. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In NIPS '96, 1996.
15. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, USA, 1998.
16. E. Talvitie and S. Singh. An experts algorithm for transfer learning. In IJCAI, pages 1065-1070, 2007.
17. M. E. Taylor, N. K. Jong, and P. Stone. Transferring instances for model-based reinforcement learning. In ECML PKDD, pages 488-505, September 2008.
18. M. E. Taylor and P. Stone. Transfer learning for reinforcement learning domains: A survey. JMLR, 10(1):1633-1685, 2009.
19. M. E. Taylor, P. Stone, and Y. Liu. Transfer learning via inter-task mappings for temporal difference learning. JMLR, 8(1):2125-2167, 2007.
20. L. Torrey, J. W. Shavlik, T. Walker, and R. Maclin. Relational macros for transfer in reinforcement learning. In ILP '07, 2007.