Transfer in variable-reward hierarchical reinforcement learning

Machine Learning

Volumn 73, Issue 3, 2008, Pages 289-312

  Mehta, Neville ^a   Natarajan, Sriraam ^a   Tadepalli, Prasad ^a   Fern, Alan ^a  

^a Oregon State University   (United States)

Author keywords

Average reward learning; Hierarchical reinforcement learning; Multi criteria learning; Transfer learning

Indexed keywords

EDUCATION; LEARNING SYSTEMS; PROBABILITY DENSITY FUNCTION; PROBLEM SOLVING; REINFORCEMENT; REINFORCEMENT LEARNING; SILVER;

AVERAGE-REWARD LEARNING; DO-MAINS; EFFICIENT ALGORITHMS; FASTER LEARNINGS; FINITE NUMBERS; HIERARCHICAL REINFORCEMENT LEARNING; HIERARCHICAL REINFORCEMENT LEARNINGS; MARKOV DECISION PROCESSES; MULTI-CRITERIA LEARNING; ONLINE ALGORITHMS; OPTIMAL VALUE FUNCTIONS; REWARD FUNCTIONS; TASK HIERARCHIES; TIME STRATEGIES; TRANSFER LEARNING; TRANSFER LEARNINGS; TRANSITION DYNAMICS; VALUE FUNCTIONS;

LEARNING ALGORITHMS;

EID: 55149090494     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-008-5061-y     Document Type: Article

References (24)

1. Abbeel, P., & Ng, A. (2004). Apprenticeship learning via inverse reinforcement learning. In Proceedings of the ICML.
2. Andre, D., & Russell, S. (2002). State abstraction for programmable reinforcement learning agents. In Eighteenth national conference on artificial intelligence (pp. 119-125).
3. T. Dietterich 2000 Hierarchical reinforcement learning with the MAXQ value function decomposition Journal of Artificial Intelligence Research 9 227 303
4. E. Feinberg A. Schwartz 1995 Constrained Markov decision models with weighted discounted rewards Mathematics of Operations Research 20 2 302 320
5. Gabor, Z., Kalmar, Z., & Szepesvari, C. (1998). Multi-criteria reinforcement learning. In Proceedings of the ICML.
6. Guestrin, C., Koller, D., & Parr, R. (2001). Multiagent planning with factored MDPs. In Proceedings NIPS-01.
7. Guestrin, C., Koller, D., Gearhart, C., & Kanodia, N. (2003). Generalizing plans to new environments in relational MDPs. In International joint conference on artificial intelligence.
8. Kaelbling, L., Littman, M., & Cassandra, A. (1998). Planning and acting in partially observable stochastic domains. AI Journal.
9. Liu, Y., & Stone, P. (2006). Value-function-based transfer for reinforcement learning using structure mapping. In Proceedings of the twenty-first national conference on artificial intelligence.
10. Mausam, D. (2003). Solving relational MDPs with first-order machine learning. In Proceedings of the ICAPS workshop on planning under uncertainty and incomplete information.
11. Mehta, N., & Tadepalli, P. (2005). Multi-agent shared hierarchy reinforcement learning. In ICML workshop on rich representations in reinforcement learning.
12. Natarajan, S., & Tadepalli, P. (2005). Dynamic preferences in multi-criteria reinforcement learning. In Proceedings of the ICML.
13. Parr, R. (1998). Flexible decomposition algorithms for weakly coupled Markov decision problems. In UAI.
14. Price, B., & Boutilier, C. (2003). Accelerating reinforcement learning through implicit imitation. Journal of Artificial Intelligence Research, 569-629.
15. Puterman, M. L. (1994). Markov decision processes. New York: Wiley.
16. Russell, S., & Zimdars, A. (2003). Q-decomposition for reinforcement learning agents. In Proceedings of ICML-03.
17. Schwartz, A. (1993). A reinforcement learning method for maximizing undiscounted rewards. In Proceedings of the 10th international conference on machine learning. San Mateo: Morgan Kaufmann.
18. Seri, S., & Tadepalli, P. (2002). Model-based hierarchical average reward reinforcement learning. In Proceedings of the ICML (pp. 562-569).
19. R. Sutton D. Precup S. Singh 1999 Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning Artificial Intelligence 112 1-2 181 211
20. P. Tadepalli D. Ok 1998 Model-based average reward reinforcement learning Artificial Intelligence 100 177 224
21. Taylor, M., Stone, P., & Liu, Y. (2005). Value functions for RL-based behavior transfer: a comparative study. In Proceedings of the twentieth national conference on artificial intelligence.
22. Torrey, L., Shavlik, J., Walker, T., & Maclin, R. (2007). Relational macros for transfer in reinforcement learning. In Proceedings of the 17th conference on inductive logic programming.
23. Weeks, J. (1985). The shape of space: how to visualize surfaces and three-dimensional manifolds.
24. D. White 1982 Multi-objective infinite-horizon discounted Markov decision processes Journal of Mathematical Analysis and Applications 89 639 647