XCS with computed prediction in multistep environments

GECCO 2005 - Genetic and Evolutionary Computation Conference

Volumn , Issue , 2005, Pages 1859-1866

  Lanzi, Pier Luca ^a,b   Loiacono, Daniele ^a   Wilson, Stewart W ^b,c   Goldberg, David E ^b  

^a POLITECNICO DI MILANO   (Italy)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c Prediction Dynamics   (United States)

Author keywords

Generalization; LCS; RL; XCS

Indexed keywords

COMPUTATION THEORY; COMPUTATIONAL METHODS; COMPUTER SCIENCE; MATHEMATICAL MODELS; PROBLEM SOLVING;

GENERALIZATION; LCS; RL; XCS;

LEARNING SYSTEMS;

EID: 32444436359     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1068009.1068323     Document Type: Conference Paper

References (13)

1. J. A. Boyan and A. W. Moore. Generalization in reinforcement learning: Safely approximating the value function. In G. Tesauro, D. S. Touretzky, and T. K. Leen, editors, Advances in Neural Information Processing Systems 7, pages 369-376, Cambridge, MA, 1995. The MIT Press.
2. M. V. Butz and S. W. Wilson. An algorithmic description of xcs. Journal of Soft Computing, 6(3-4):144-153, 2002.
3. P. L. Lanzi and M. Colombetti. An Extension to the XCS Classifier System for Stochastic Environments. In W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, and R. E. Smith, editors, Proceedings of the Genetic and Evolutionary Computation Conference (GECCO), pages 353-360, Orlando (FL), July 1999. Morgan Kaufmann.
4. T. J. Perkins and D. Precup. A convergent form of approximate policy iteration, pages 1595-1602, 2003.
5. R. S. Sutton. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems 8, pages 1038-1044. The MIT Press, Cambridge, MA., 1996.
6. R. S. Sutton and A. G. Barto. Reinforcement Learning - An Introduction. MIT Press, 1998.
7. G. Tesauro. TD-gammon, a seJf-teaching backgammon program, achieves master-level play. Neural Computation, 6(2):215-219, 1994.
8. S. Thrun and A. Schwartz. Issues in Using Function Approximation for Reinforcement Learning. 1993.
9. B. Widrow and M. E. Hoff. Adaptive Switching Circuits, chapter Neurocomputing: Foundation of Research, pages 126-134. The MIT Press, Cambridge, 1988.
10. S. W. Wilson. Classifier Fitness Based on Accuracy. Evolutionary Computation, 3(2):149-175, 1995. http://prediction-dynamics.com/.
11. S. W. Wilson. Mining Oblique Data with XCS. volume 1996 of Lecture notes in Computer Science, pages 158-174. Springer-Verlag, Apr. 2001.
12. S. W. Wilson. Classifiers that approximate functions. Journal of Natural Computating, 1(2-3):211-234, 2002.
13. S. W. Wilson. Classifier systems for continuous payoff environments. In K. Deb, R. Poli, W. Banzhaf, H.-G. Beyer, E. Burke, P. Darwen, D. Dasgupta, D. Floreano, J. Foster, M. Harman, O. Holland, P. L. Lanzi, L. Spector, A. Tettamanzi, D. Thierens, and A. Tyrrell, editors, Genetic and Evolutionary Computation - GECCO-2004, Part II, volume 3103 of Lecture Notes in Computer Science, pages 824-835, Seattle, WA, USA, 26-30 June 2004. Springer-Verlag.