Swarm reinforcement learning methods for problems with continuous state-action space

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn , Issue , 2011, Pages 2173-2180

  Iima, Hitoshi ^a   Kuroe, Yasuaki ^a   Emoto, Kazuo ^a  

^a KYOTO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

particle swarm optimization; reinforcement learning; swarm intelligence

Indexed keywords

ACTOR-CRITIC METHODS; BIPED ROBOT; CONTINUOUS STATE-ACTION SPACES; INDIVIDUAL LEARNING; MULTIPLE SET; NUMERICAL EXPERIMENTS; OPTIMAL POLICIES; Q-LEARNING METHOD; REINFORCEMENT LEARNING METHOD; SWARM INTELLIGENCE; SWARM REINFORCEMENT LEARNING;

ARTIFICIAL INTELLIGENCE; CELLULAR AUTOMATA; NUMERICAL METHODS; OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO); REINFORCEMENT;

REINFORCEMENT LEARNING;

EID: 83755225300     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2011.6083999     Document Type: Conference Paper

References (13)

1. R.S. Sutton and A.G. Barto, Reinforcement Learning, MIT Press, 1998.
2. J. Kennedy and R.C. Eberhart, Swarm Intelligence, Morgan Kaufmann Publishers, 2001.
3. H. Iima and Y. Kuroe, "Reinforcement learning through interaction among multiple agents", SICE-ICASE International Joint Conference 2006 CD-ROM, pp.2457-2462, 2006.
4. H. Iima and Y. Kuroe, "Swarm reinforcement learning algorithms based on particle swarm optimization", IEEE International Conference on Systems, Man and Cybernetics, pp.1110-1115, 2008.
5. H. Iima, Y. Kuroe and S. Matsuda: "Swarm reinforcement learning method based on ant colony optimization", IEEE International Conference on Systems, Man and Cybernetics, pp.1726-1733, 2010.
6. C.J.C.H.Watkins and P. Dayan, "Q-learning", Machine Learning, Vol.8, pp.279-292, 1992.
7. L. Busoniu, R. Babuska and B. De Schutter, "A comprehensive survey of multiagent reinforcement learning", IEEE Transactions on Systems, Man, and Cybernetics, Part C, Vol.38, No.2, pp.156-172, 2008. (Pubitemid 351404112)
8. H. Kimura and S. Kobayashi, "An analysis of actor/critic algorithms using eligibility traces: Reinforcement learning with imperfect value function", 15th International Conference on Machine Learning, pp.278-286, 1998.
9. K. Doya, "Reinforcement learning in continuous time and space", Neural Computation, Vol.12, pp.219-245, 2000.
10. Y. Nakamura, M. Sato, and S. Ishii, "Reinforcement learning for rhythmic movements using a neural oscillator network", IEICE Transactions on Information and Systems, Vol.J87-D-II, No.3, pp.893-902, 2004 (in Japanese).
11. T. Kondo and K. Ito, "A study on designing robot controllers by using reinforcement learning with evolutionary state recruitment strategy", The First International Workshop on Biologically Inspired Approaches to Advanced Information Technology, pp.244-257, 2004.
12. H. Iima and Y. Kuroe: "Swarm reinforcement learning method based on an actor-critic method", Eighth International Conference on Simulated Evolution and Learning, 2010.
13. G. Taga, Y. Yamaguchi, and H. Shimizu, "Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment", Biological Cybernetics, Vol.65, pp.147-159, 1991.