An adjustment method of the number of states on Q-learning segmenting state space adaptively

Proceedings of the IEEE International Conference on Systems, Man and Cybernetics

Volumn 4, Issue , 2003, Pages 3062-3067

  Hamagami, Tomoki ^a   Hirata, Hironori ^a  

^a CHIBA UNIVERSITY   (Japan)

Author keywords

Adaptive learning; Autonomous behavior; Q learning; QLASS; Reinforcement learning

Indexed keywords

AUTONOMOUS AGENTS; LEARNING ALGORITHMS; MOBILE ROBOTS; PROBABILITY DISTRIBUTIONS; RANDOM PROCESSES; STATE SPACE METHODS;

ADAPTIVE LEARNING; AUTONOMOUS BEHAVIOR; DISCRETE STATE SPACE; Q-LEARNING WITH ADAPTIVE STATE SEGMENTATION; VORONOI DIAGRAM;

LEARNING SYSTEMS;

EID: 0242721808     PISSN: 08843627     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. M. A. Al-Ansari and R. J. Williams, "Efficient, globally-optimized reinforcement learning with the parti-game algorithm," Advances in Neural Information Processing Systems, 11, The MIT Press, 1999.
2. M. Asada, S. Noda, and K. Hosoda, "Action-based sensor space categorization for robot learning," Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp.1502-1509, 1996.
3. J. L. Bentley, "Multidimensional binary search trees used for associative searching," Communications of the ACM, vol.18, No.9, pp.509-517, 1975.
4. H. Ishiguro, R. Sato, and T. Ishida, "Robot oriented state space construction," Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp.1496-1501, 1996.
5. A. W. Moore and C. G. Atkeson, "The parti-game algorithm for variable resolution reinforcement learning in multidimensional state-spaces," Machine Learning, 21, pp.199-233, 1995.
6. R. Munos and A. W. Moore, "Variable resolution discretization for high-accuracy solutions of optimal control problems," Proc. 16th International Joint Conference on Artificial Intelligence, pp.1348-1355, 1999.
7. H. Murao and S. Kitamura, "Q-Learning with adaptive state segmentation (QLASS)," Proc. IEEE International Symposium on Computational Intelligence in Robotics And Automation, pp.179-184, 1997.
8. S. I. Reynolds, "Adaptive resolution model-free reinforcement learning: decision boundary partitioning," Proc. 17th International Conf. on Machine Learning, pp.783-790, 2000.
9. K. Samejima and T. Omori, "Adaptive internal state space construction method for reinforcement learning of a real-world agent," Neural Networks, vol.11, pp.1143-1155, 1999.
10. R.S. Sutton, Reinforcement learning: An introduction, The MIT Press, pp.163-192, 1998.
11. C.J.C.H. Watkins and P. Dayan, "Technical notes: Q-learning," Machine Learning, 8, pp.279-292, 1992