Structural abstraction experiments in reinforcement learning

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3809 LNAI, Issue , 2005, Pages 164-175

  Fitch, Robert ^a   Hengst, Bernhard ^a   Šuc, Dorian ^a   Calbert, Greg ^b   Scholz, Jason ^b  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b DEFENCE SCIENCE AND TECHNOLOGY ORGANISATION   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SCIENCE; HIERARCHICAL SYSTEMS; MULTI AGENT SYSTEMS; PROBLEM SOLVING; SOFTWARE AGENTS; STORAGE ALLOCATION (COMPUTER);

ABSTRACTION EXPERIMENTS; HIERARCHICAL DECOMPOSITION; REINFORCEMENT LEARNING; TIME COMPLEXITY;

LEARNING SYSTEMS;

EID: 33745586802     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11589990_19     Document Type: Conference Paper

References (16)

1. Button, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge, Massachusetts (1998)
2. Clark, A., Thornton, C.: Trading spaces: Computation, representation, and the limits of uninformed learning. Behavioral and Brain Sciences 20 (1997) 57-66
3. Utgoff, P.E., Stracuzzi, D.J.: Many-layered learning. In: Neural Computation, MIT Press Journals (2002)
4. Ashby, R.: Introduction to Cybernetics. Chapman &: Hall, London (1956)
5. Dietterich, T.G.: Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research 13 (2000) 227-303
6. Watkins, C.J.C.H.: Learning from Delayed Rewards. PhD thesis, King's College (1989)
7. Ravindran, B., Barto, A.G.: SMDP homomorphisms: An algebraic approach to abstraction in semi markov decision processes. In: Proc. of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI 03). (2003) 1011-1018
8. Ravindran, B., Barto, A.G.: Model minimization in hierarchical reinforcement learning. In: Fifth Symposium on Abstraction, Reformulation and Approximation (SARA 2002). LNCS, Springer Verlag (2002) 196-211
9. Dean, T., Givan, R.: Model minimization in markov decision processes. In: AAAI/IAAI. (1997) 106-111
10. Givan, R., Leach, S.M., Dean, T.: Bounded-parameter markov decision processes. Artificial Intelligence 122 (2000) 71-109
11. Crites, R.H., Barto, A.G.: Elevator group control using multiple reinforcement learning agents. Machine Learning 33 (1998) 235-262
12. Wolpert, D., Turner, K.: An introduction to collective intelligence. Technical Report NASA-ARC-IC-99-63, NASA Ames Research Center, CA (1999)
13. Braess, D.: Über ein Paradoxon der Verkehrsplanung. Unternehmensforschung 12 (1968) 258-268
14. Rohanimanesh, K., Mahadevan, S.: Learning to take concurrent actions. In: NIPS. (2002) 1619-1626
15. Hengst, B.: Discovering hierarchy in reinforcement learning with HEXQ. In Sammut, C., Hoffmann, A., eds.: Proceedings of the Nineteenth International Conference on Machine Learning, Morgan-Kaufman (2002) 243-250
16. Kaelbling, L.P.: Hierarchical learning in stochastic domains: Preliminary results. In: Machine Learning Proceedings of the Tenth International Conference, San Mateo, CA, Morgan Kaufmann (1993) 167-173