Reinforcement learning transfer via sparse coding

11th International Conference on Autonomous Agents and Multiagent Systems 2012, AAMAS 2012: Innovative Applications Track

Volumn 1, Issue , 2012, Pages 89-96

  Ammar, Haitham B ^a   Tuyls, Karl ^a   Taylor, Matthew E ^b   Driessens, Kurt ^a   Weiss, Gerhard ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b LAFAYETTE COLLEGE   (United States)

Author keywords

Intertask mapping; Optimization; Reinforcement Learning; Sparse Coding; Sparse Gaussian Processes; Transfer Learning

Indexed keywords

ALGORITHMS; AUTONOMOUS AGENTS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); MULTI AGENT SYSTEMS; OPTIMIZATION; POLES; REINFORCEMENT LEARNING;

COMPLEX ENVIRONMENTS; LEAST SQUARES POLICY ITERATIONS; NEAR-OPTIMAL POLICIES; SPARSE CODING; SPARSE GAUSSIAN PROCESS; TRANSFER LEARNING; TRANSFER LEARNING METHODS; TRANSFER OF INFORMATION;

ITERATIVE METHODS;

EID: 84899426993     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. L. Buşoniu, R. Babuska, B. De Schutter, and D. Ernst. Reinforcement Learning and Dynamic Programming Using Function Approximators. CRC Press, Boca Raton, Florida, 2010.
2. S. jean Kim, K. Koh, M. Lustig, S. Boyd, and D. Gorinevsky. An interior-point method for large-scale 11-regularized logistic regression. Journal of Machine Learning Research, 2007, 2007.
3. G. Konidaris and A. Barto. Autonomous shaping: knowledge transfer in reinforcement learning. In In Proceedings of the 23rd Internation Conference on Machine Learning, pages 489-496, 2006.
4. G. Kuhlmann and P. Stone. Graph-based domain mapping for transfer learning in general games. In Proceedings of The Eighteenth European Conference on Machine Learning, September 2007.
5. M. G. Lagoudakis and R. Parr. Least-squares policy iteration. J. Mach. Learn. Res., 4:1107-1149, December 2003.
6. A. Lazaric, M. Restelli, and A. Bonarini. Transfer of samples in batch reinforcement learning. In Proceedings of the 25th international conference on Machine learning, ICML '08, pages 544-551, New York, NY, USA, 2008. ACM.
7. H. Lee, A. Battle, R. Raina, and A. Y. Ng. Efficient sparse coding algorithms. In In NIPS, pages 801-808. NIPS, 2007.
8. Y. Liu and P. Stone. Value-function-based transfer for reinforcement learning using structure mapping. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pages 415-20, July 2006.
9. S. J. Pan and Q. Yang. A survey on transfer learning.
10. R. Raina, A. Battle, H. Lee, B. Packer, and A. Y. Ng. Self-taught learning: Transfer learning from unlabeled data. In ICML '07: Proceedings of the 24th international conference on Machine learning, 2007.
11. C. E. Rasmussen. In Gaussian processes for machine learning. MIT Press, 2006.
12. O. G. Selfridge, R. S. Sutton, and A. G. Barto. Training and tracking in robotics. In IJCAI, pages 670-672, 1985.
13. S. Singh. Transfer of learning by composing solutions of elemental sequential tasks. In Machine Learning, pages 323-339, 1992.
14. E. Snelson and Z. Ghahramani. Sparse Gaussian processes using pseudo-inputs. In Advances In Neural Information Processing Systems, pages 1257-1264. MIT press, 2006.
15. R. S. Sutton and A. G. Barto. Reinforcement learning: An introduction, 1998.
16. E. Talvitie and S. Singh. An experts algorithm for transfer learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, 2007.
17. M. E. Taylor, G. Kuhlmann, and P. Stone. Autonomous transfer for reinforcement learning. In Proceedings of the Seventh International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), pages 283-290, May 2008.
18. M. E. Taylor and P. Stone. Transfer learning for reinforcement learning domains: A survey. J. Mach. Learn. Res., 10:1633-1685, December 2009.
19. M. E. Taylor, P. Stone, and Y. Liu. Transfer learning via inter-task mappings for temporal difference learning. Journal of Machine Learning Research, 8(1):2125-2167, 2007.
20. M. E. Taylor, S. Whiteson, and P. Stone. Transfer via inter-task mappings in policy search reinforcement learning. In Proceedings of the Sixth International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), pages 156-163, May 2007.
21. L. Torrey, T. Walker, J. Shavlik, and R. Maclin. Using advice to transfer knowledge acquired in one reinforcement learning task to another. In In Proceedings of the Sixteenth European Conference on Machine Learning, pages 412-424, 2005.