An adaptation of particle swarm optimization for markov decision processes

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn 2, Issue , 2004, Pages 1643-1648

  Chang, Hyeong Soo ^a  

^a Sogang University   (South Korea)

Author keywords

Markov decision process; Particle swarm optimization; Reinforcement learning

Indexed keywords

MARKOV DECISION PROCESS; MULTIDEMENSIONAL SEARCHING; PARTICLE SWARM OPTIMIZATION; REINFORCEMENT LEARNING;

ALGORITHMS; FUNCTIONS; HEURISTIC METHODS; MARKOV PROCESSES; OPTIMIZATION; PROBLEM SOLVING; SET THEORY; STATISTICS;

DECISION THEORY;

EID: 15744369589     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2004.1399867     Document Type: Conference Paper

References (15)

1. D. P. Bertsekas, Dynamic Programming and Optimal Control, Volumes 1 and 2. Athena Scientific, 1995.
2. D. P. Bertsekas and J. N. Tsitsiklis, Neuro Dynamic Programming. Athena Scientific, 1996.
3. H. S. Chang, M. Fu, and S. I. Marcus, "An asymptotically efficient algorithm for finite horizon stochastic dynamic programming problems," in Proc. of the 42nd IEEE Conf. Decision and Control, 2003.
4. H. S. Chang, H-G. Lee, M. Fu, and S. I. Marcus, "Evolutionary policy iteration for solving Markov decision processes," IEEE T'rans. on Automatic Control, revised, 2004.
5. H. S. Chang, R. Givan, and E. K. P. Chong, "Parallel rollout for on-line solution of partially observable Markov decision processes," Discrete Event Dynamic Systems: Theory and Application, Vol. 14, No. 3, pp. 309-341, 2004.
6. H. S. Chang, W. J. Gutjahr, J. Yang, and S. Park, "An Ant System Approach to Markov Decision Processes," in Proc. of the American Control Conference, 2004.
7. H. S. Chang, "An Ant System Based Exploration-Exploitation for Reinforcement Learning," in Proc. of the IEEE Conf. on Systems, Man, and Cybernetics, 2004.
8. K. A. De Jong, An Analysis of the Behavior of a Class of Genetic Adaptive Systems, Ph.D. Thesis, Univ. of Michigan, Ann Arbor, MI, 1975.
9. R. C. Eberhart and J. Kennedy, Swarm Intelligence. Morgan Kaufmann, 2001.
10. J. Kennedy and R. C. Eberhart, "A discrete binary version of the particle swarm algorithm," in Proc. of the IEEE Conf. on Systems, Man, and Cybernetics, 1997, pp. 4104-4109.
11. J. Kennedy and R. C. Eberhart, "Particle swarm optimization," in Proc. of the IEEE Conf. on Neural Networks, 1995, pp. 1942-1948.
12. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New York, 1994.
13. S. Singh, T. Jaakkola, M. Littman, and C. Szepesvari, "Convergence results for single-step on-policy reinforcement learning algorithms," Machine Learning, Vol. 38, pp. 287-308, 2000.
14. R. Sutton and A. Barto, Reinforcement Learning. MIT Press, 2000.
15. J. N. Tsitsiklis, "Asynchronous stochastic approximation and Q-learning," Machine Learning, Vol. 16, pp. 185-202, 1994.