Fuzzy partition optimization for approximate fuzzy Q-iteration

IFAC Proceedings Volumes (IFAC-PapersOnline)

Volumn 17, Issue 1 PART 1, 2008, Pages

  Busoniu, Lucian ^a   Ernst, Damien ^a   De Schutter, Bart ^a   Babuska, Robert ^a  

^a NONE

Author keywords

Reinforcement learning control

Indexed keywords

ADAPTIVE AGENTS; APPROXIMATE ALGORITHMS; BASIS FUNCTIONS; CROSS ENTROPY; FUNCTION REPRESENTATIONS; FUZZY PARTITION; INITIAL STATE; ITERATION ALGORITHMS; LEARNING PARADIGMS; OPTIMIZATION CRITERIA; PRIOR KNOWLEDGE; Q-FUNCTIONS; REINFORCEMENT LEARNING CONTROL; TRIANGULAR MEMBERSHIP FUNCTIONS; VALUE FUNCTIONS;

EDUCATION; LEARNING ALGORITHMS; OPTIMIZATION; REINFORCEMENT; REINFORCEMENT LEARNING; SET THEORY;

MEMBERSHIP FUNCTIONS;

EID: 79961019197     PISSN: 14746670     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3182/20080706-5-KR-1001.1519     Document Type: Conference Paper

References (13)

1. Dimitri P. Bertsekas. Dynamic Programming and Optimal Control, volume 2. Athena Scientific, 2nd edition, 2001.
2. Lucian Busoniu, Damien Ernst, Bart De Schutter, and Robert Babuska. Fuzzy approximation for convergent model-based reinforcement learning. In Proceedings 2007 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-07), pages 968-973, London, UK, 23-26 July 2007.
3. Damien Ernst, Pierre Geurts, and Louis Wehenkel. Tree-based batch mode reinforcement learning. Journal of Machine Learning Research, 6:503-556, 2005
4. Geoffrey Gordon. Stable function approximation in dynamic programming. In Proceedings Twelfth International Conference on Machine Learning (ICML-95), pages 261-268, Tahoe City, US, 9-12 July 1995.
5. Philipp W. Keller, Shie Mannor, and Doina Precup. Automatic basis function construction for approximate dynamic programming and reinforcement learning. In Proceedings Twenty-Third International Conference on Machine Learning (ICML-06), pages 449-456, Pittsburgh, US, 25-29 June 2006.
6. Sridhar Mahadevan. Samuel meets Amarel: Automating value function approximation using global state space analysis. In Proceedings 20th National Conference on Artificial Intelligence and the 17th Innovative Applications of Artificial Intelligence Conference (AAAI-05), pages 1000-1005, Pittsburgh, US, 9-13 July 2005.
7. Ishai Menache, Shie Mannor, and Nahum Shimkin. Basis function adaptation in temporal difference reinforcement learning. Annals of Operations Research, 134:215-238, 2005. (Pubitemid 40550047)
8. Remi Munos and Andrew Moore. Variable-resolution discretization in optimal control. Machine Learning, 49 (2-3):291-323, 2002.
9. Dirk Ormoneit and Saunak Sen. Kernel-based reinforcement learning. Machine Learning, 49(2-3):161-178, 2002.
10. Bohdana Ratitch and Doina Precup. Sparse distributed memories for on-line value-based reinforcement learning. In Proceedings 15th European Conference on Machine Learning (ECML-04), volume 3201 of Lecture Notes in Computer Science, pages 347-358, Pisa, Italy, 20-24 September 2004.
11. Reuven Y. Rubinstein and Dirk P. Kroese. The Cross-Entropy Method. A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning. Information Science and Statistics. Springer, 2004.
12. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
13. Csaba Szepesvari and William D. Smart. Interpolation-based Q-learning. In Proceedings Twenty-First International Conference on Machine Learning (ICML-04), pages 791-798, Bannf, Canada, 4-8 July 2004.