An ant system based exploration-exploitation for reinforcement learning

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn 4, Issue , 2004, Pages 3805-3810

  Chang, Hyeong Soo ^a  

^a Sogang University   (South Korea)

Author keywords

Ant colony system; Markov decision process; Reinforcement learning

Indexed keywords

ANT COLONY SYSTEM; MARKOV DECISION PROCESS; REINFORCEMENT LEARNING; SIMULATED TRAJECTORIES;

COMPUTER SIMULATION; DECISION THEORY; GRAPH THEORY; MARKOV PROCESSES; OPTIMIZATION; PROBABILITY; RANDOM PROCESSES; THEOREM PROVING; TRAJECTORIES;

LEARNING SYSTEMS;

EID: 15744397544     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2004.1400937     Document Type: Conference Paper

References (15)

1. D. P. Bertsekas and J. N. Tsitsiklis, Neuro Dynamic Programming, Athena Scientific, 1996.
2. E. Bonabeau, M. Dorigo, and G. Theralaz, Swarm Intelligence: From Natural to Artifical Systems. Oxford Press, 1999.
3. H. S. Chang, W. J. Gutjahr, J. Yang, and S. Park, "An ant system approach to Markov decision processes," in Proc. of the American Control Conference, 2004.
4. H. S. Chang, "An adaptation of particle swarm optimization for Markov decision processes," in Proc. of the IEEE Conf. on Systems, Man, and Cybernetics, 2004.
5. D. Corne, Fl Glover, and M. Dorigo (eds.), New Ideas in Optimization, McGraw-Hill, 1999.
6. M. Dorigo and G. Di Caro, "The ant colony optimization metaheuristic," New Ideas in Optimization, D. Corne, M. Dorigo (eds.), pp. 11-32, McGraw-Hill, NY, USA, 1999.
7. R. C. Eberhart and J. Kennedy, Swarm Intelligence. Morgan Kaufmann, 2001.
8. L. M. Gambardella and M. Dorigo, "Ant-Q: a reinforcement learning approach to the traveling salesman problem," in Proc. of the 12th Int. Conf. on Machine Learning, 1995, pp. 252-260.
9. W. J. Gutjahr, "A graph-based ant system and its convergence," Future Generation Computer Systems, vol. 16, pp. 873-888, 2000.
10. C. Mariano and E. Morales, "DQL: a New Updating Strategy for Reinforcement Learning based on Q-learning," in Proc. of the 12th European Conference on Machine Learning, 2001, pp. 324-335.
11. N. Monekosso and P. Remagnino, "The analysis and performance evaluation of the pheromone-Q-learning algorithm," Expert Systems, vol. 21, no. 2, pp. 80-91, 2004.
12. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New York, 1994.
13. S. Singh, T. Jaakkola, M. Littman, and C. Szepesvari, "Convergence results for single-step on-policy reinforcement learning algorithms," Machine Learning, vol. 38, pp. 287-308, 2000.
14. R. Sutton and A. Barto, Reinforcement Learning. MIT Press, 2000.
15. J. N. Tsitsiklis, "Asynchronous stochastic approximation and Q-learning," Machine Learning, vol. 16, pp. 185-202, 1994.