Transfer via soft homomorphisms

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 1, Issue , 2009, Pages 546-553

  Sorg, Jonathan ^a   Singh, Satinder ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Homomorphism; Markov decision process; Transfer learning

Indexed keywords

AUTONOMOUS AGENTS; MARKOV PROCESSES; MULTI AGENT SYSTEMS;

APPROXIMATE METHODS; DOMAIN KNOWLEDGE; HOMOMORPHISM; MARKOV DECISION PROCESSES; STOCHASTIC MAPPING; STRONG CONVERGENCE; THEORETICAL GUARANTEES; TRANSFER LEARNING;

LEARNING ALGORITHMS;

EID: 84899792946     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. R. Givan, T. Dean, and M. Greig. Equivalence notions and model minimization in markov decision processes. Artificial Intelligence, 147(1-2):163-223, 2003.
2. G. Konidaris and A. G. Barto. Building portable options: Skill transfer in reinforcement learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, pages 895-900, 2007.
3. Y. Liu and P. Stone. Value-function-based transfer for reinforcement learning using structure mapping. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pages 415-20, July 2006.
4. L. F. Portugal, J. J. Judice, and L. N. Vicente. A comparison of block pivoting and interior-point algorithms for linear least squares problems with nonnegative variables. Mathematics of Computation, 63(208):625-643, 1994.
5. B. Ravindran. An Algebraic Approach to Abstraction in Reinforcement Learning. PhD dissertation, University of Massachusetts, Amherst MA, 2004.
6. S. Singh and R. Yee. An upper bound on the loss from approximate optimal-value functions. Machine Learning, 16(3):227-233, 1994.
7. S. P. Singh, T. Jaakkola, and M. I. Jordan. Reinforcement learning with soft state aggregation. In Advances in Neural Information Processing Systems, volume 7, pages 361-368, 1995.
8. V. Soni and S. Singh. Using homomorphisms to transfer options across reinforcement learning domains. In Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence, 2006.
9. M. E. Taylor, G. Kuhlmann, and P. Stone. Autonomous transfer for reinforcement learning. In Procedings of the Seventh International Joint Conference on Autonomous Agents and Multiagent Systems, May 2008.
10. M. E. Taylor, P. Stone, and Y. Liu. Value functions for RL-based behavior transfer: A comparative study. In Proceedings of the Twentieth National Conference on Artificial Intelligence, pages 880-885, July 2005.
11. M. E. Taylor, S. Whiteson, and P. Stone. Transfer via inter-task mappings in policy search reinforcement learning. In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, pages 1-8, May 2007.
12. A. P. Wolfe and A. G. Barto. Decision tree methods for finding reusable mdp homomorphisms. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pages 530-535, 2006.