On-line evolutionary computation for reinforcement learning in stochastic domains

GECCO 2006 - Genetic and Evolutionary Computation Conference

Volumn 2, Issue , 2006, Pages 1577-1584

  Whiteson, Shimon ^a   Stone, Peter ^a  

^a University of Texas at Austin   (United States)

Author keywords

Evolutionary computation; Neural networks; On line learning; Reinforcement learning

Indexed keywords

LEARNING SYSTEMS; NEURAL NETWORKS; ONLINE SYSTEMS; RANDOM PROCESSES; SCHEDULING;

ON-LINE LEARNING; REINFORCEMENT LEARNING; STOCHASTIC DOMAINS; TEMPORAL DIFFERENCE (TD);

EVOLUTIONARY ALGORITHMS;

EID: 33750226914     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1143997.1144252     Document Type: Conference Paper

References (29)

1. P. Auer, N. Cesa-Bianchi, and P. Fischer. Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2-3):235-256, 2002.
2. T. Beielstein and S. Markon. Threshold selection, hypothesis tests and DOE methods. In 2002 Congresss on Evolutionary Computation, pages 777-782, 2002.
3. R. E. Bellman. A problem in the sequential design of experiments. Sankhya, 16:221-229, 1956.
4. J. A. Boyan and A. W. Moore. Generalization in reinforcement learning: Safely approximating the value function. In Advances in Neural Information Processing Systems 7, 1995.
5. L. Bull and J. Hurst. A neural learning classifier system with self-adaptive constructivism. In GECCO-03: Proceedings of the Genetic and Evolutionary Computation Conference, pages 11-18, 2003.
6. D. E. Goldberg and J. Richardson. Genetic algorithms with sharing for multimodal function optimization. In Proceedings of the Second International Conference on Genetic Algorithms, pages 148-154, 1987.
7. F. Gruau, D. Whitley, and L. Pyeatt. A comparison between cellular encoding and direct encoding for genetic neural networks. In Genetic Programming 1996: Proceedings of the First Annual Conference, pages 81-89, 1996.
8. J. H. Holland. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence. University of Michigan Press, Ann Arbor, MI, 1975.
9. L. P. Kaelbling. Learning in Embedded System. MIT Press, 1993.
10. J. O. Kephart and D. M. Chess. The vision of autonomic computing. Computer, 36(1):41-50, January 2003.
11. P. L. Lanzi and M. Colombetti. An extension to the XCS classifier system for stochastic environments. In GECCO-99: Proceedings of the Genetic and Evolutionary Computation Conference, pages 353-360, 1999.
12. P. L. Lanzi, W. Stolzmann, and S. Wilson. Learning classifier systems from foundations to applications. Springer, 2000.
13. W. G. Macready and D. H. Wolpert. Bandit problems and the exploration/exploitation tradeoff. In IEEE Transactions on Evolutionary Computation, volume 2(1), pages 2-22, 1998.
14. A. McMahon, D. Scott, and W. N. Browne. An autonomous explore/exploit strategy. In GECCO-05: Proceedings of the Genetic and Evolutionary Computation Conference Workshop Program, 2005.
15. N. J. Radcliffe. Genetic set recombination and its application to neural network topology optimization. Neural computing and applications, 1(1):67-90, 1993.
16. W. D. Smart and L. P. Kaelbling. Practical reinforcement learning in continuous spaces. In Proceedings of the Seventeeth International Conference on Machine Learning, pages 903-910, 2000.
17. S. Smith. Flexible learning of problem solving heuristics through adaptive search. In Proceedings of the Eighth International Joint Conference on Articial Intelligence, pages 422-425, 1983.
18. P. Stagge. Averaging efficiently in the presence of noise. In Parallel Problem Solving from Nature, volume 5, pages 188-197, 1998.
19. K. O. Stanley and R. Miikkulainen. Evolving neural networks through augmenting topologies. Evolutionary Computation, 10(2):99-127, 2002.
20. K. O. Stanley and R. Miikkulainen. Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research, 21:63-100, 2004.
21. K. O. Stanley and R. Miikkulainen. Evolving a roving eye for go. In Proceedinngs of the Genetic and-Evolutionary Computation Conference, 2004.
22. R. Sutton, D. McAllester, S. Singh, and Y. Mansour. Policy gradient methods for reinforcement learning with function approximation.
23. R. S. Sutton. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In Advances in Neural Information Processing Systems 8, pages 1038-1044, 1996.
24. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge,.MA, 1998.
25. W. E. Walsh, G. Tesauro, J. O. Kephart, and R. Das. Utility functions in autonomic systems. In Proceedings of the International Conference on Autonomic Computing, pages 70-77, 2004.
26. C. Watkins. Learning from Delayed Rewards. PhD thesis, King's College, Cambridge, 1989.
27. S. Whiteson and P. Stone. Evolutionary function approximation for reinforcement learning. Journal of Machine Learning Research, 2006. To Appear.
28. S. W. Wilson. Explore/exploit strategies in autonomy. In Prom Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, 1996.
29. X. Yao. Evolving artificial neural networks. Proceedings of the IEEE, 87(9): 1423-1447, 1999.