Empirical analysis of generalization and learning in XCS with gradient descent

Proceedings of GECCO 2007: Genetic and Evolutionary Computation Conference

Volumn , Issue , 2007, Pages 1814-1821

  Lanzi, Pier Luca ^a   Butz, Martin V ^b,c   Goldberg, David E ^d  

^a POLITECNICO DI MILANO   (Italy)

^b UNIVERSITY OF WÜRZBURG   (Germany)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^d NONE

Author keywords

Generalization; Gradient descent; LCS; RL; XCS

Indexed keywords

NUMERICAL METHODS; WHEELS;

GENERALIZATION; GRADIENT DESCENT; XCS;

LEARNING SYSTEMS;

EID: 34548070260     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1276958.1277321     Document Type: Conference Paper

References (25)

1. Alwyn M. Barry. Limits in long path learning with XCS. In Springer-Verlag, editor, Genetic and Evolutionary Computation Conference (GECCO-2003), pages 1832-1843, Chicago, IL, 2003.
2. Alwyn M. Barry, John H. Holmes, and Xavier Llorà. Data mining using learning classifier systems. In Bull [5], pages 15-67.
3. Ester Bernadó, Xavier Llorà, and Josep M. Garrell. XCS and GALE: A comparative study of two learning classifier systems on data mining. In Pier Luca Lanzi, Wolfgang Stolzmann, and Stewart W. Wilson, editors, Advances in Learning Classifier Systems, volume 2321 of LNAI, pages 115-132. Springer-Verlag, Berlin, 2002.
4. Justin A. Boyan and Andrew W. Moore. Generalization in reinforcement learning: Safely approximating the value function. In G. Tesauro et al., editors, Advances in Neural Information Processing Systems 1, pages 369-376, 1995. The MIT Press.
5. Larry Bull, editor. Applications of Learning Classifier Systems. Studies in Fuzziness & Soft Computing. Springer-Verlag, 2004.
6. Martin Butz, David G. Goldberg, and Pier Luca Lanzi. Gradient descent methods in learning classifier systems. Technical Report 2003028, Illinois Genetic Algorithms Laboratory - University of Illinois at Urbana-Champaign, 117 Transportation Building, 104 S. Mathews Avenue, Urbana, IL 61801, January 2003.
7. Martin V. Butz. Rule-Based Evolutionary Online Learning Systems: A Principled Approach to LCS Analysis and Design. Springer-Verlag, Berlin, 2006.
8. Martin V. Butz, David E. Goldberg, and Pier Luca Lanzi. Gradient descent methods in learning classifier systems: Improving XCS performance in multistep problems. IEEE Transaction on Evolutionary Computation, 9(5):452-473, October 2005.
9. Martin V. Butz, Kumara Sastry, and David E. Goldberg. Strong, stable, and reliable fitness pressure in XCS due to tournament selection. Genetic Programming and Evolvable Machines, 6:53-77, 2005.
10. Martin V. Butz and Stewart W. Wilson. An algorithmic description of XCS. Journal of Soft Computing, 6(3-4):144-153, 2002.
11. Marco Dorigo. Genetic and non-genetic operators in alecsys. Evolutionary Computation, 1(2):151-164, 1993.
12. Jan Drugowitsch and Alwyn M. Barry. A formal framework and extensions for function approximation in learning classifier systems. Technical Report CSBU-2006-02, Department of Computer Science, University of Bath, January 2006.
13. Jan Drugowitsch and Alwyn M. Barry. A formal framework for reinforcement learning with function approximation in learning classifier systems. Technical Report CSBU-2006-02, Department of Computer Science, University of Bath, January 2006.
14. Geoffrey J. Gordon. Online fitted reinforcement learning from the value function approximation. Workshop on Value Function Approximation held during the 12th International Conference on Machine Learning, 1995.
15. Pier Luca Lanzi. An Analysis of Generalization in the XCS Classifier System. Evolutionary Computation Journal, 7(2):125-149, 1999.
16. Pier Luca Lanzi. Learning classifier systems from a reinforcement learning perspective. Soft Computing -A Fusion of Foundations, Methodologies and Applications, 6(3):162-170, 2002.
17. Pier Luca Lanzi and Daniele Loiacono. Standard and averaging reinforcement learning in XCS. In GECCO '06: Proceedings of the 8th annual conference on Genetic and evolutionary computation, pages 1489-1496, New York, NY, USA, 2006. ACM Press.
18. Pier Luca Lanzi, Daniele Loiacono, Stewart W. Wilson, and David E. Goldberg. Classifier prediction based on tile coding. In GECCO '06: Proceedings of the 8th annual conference on Genetic and evolutionary computation, pages 1497-1504, New York, NY, USA, 2006. ACM Press.
19. Pier Luca Lanzi, Wolfgang Stolzmann, and Stewart W. Wilson, editors. Learning Classifier Systems: From Foundations to Applications, volume 1813 of Lecture Notes in Computer Science. Springer-Verlag, April 2000.
20. Stuart Ian Reynolds. Reinforcement Learning with Exploration. PhD thesis, School of Computer Science. The University of Birmingham, Birmingham, B15 2TT, December 2002.
21. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning - An Introduction. MIT Press, 1998.
22. Atsushi Wada, Keiki Takadama, and Katsumori Shimohara. Learning classifier system equivalent with reinforcement learning with function approximation, 2005. Eighth International Workshop on Learning Classifier Systems (IWLCS-2005).
23. Atsushi Wada, Keiki Takadama, Katsumori Shimohara, and Osamu Katai. Learning classifier systems with convergence and generalization. In Larry Bull and Tim Kovacs, editors, Foundations of Learning Classifier Systems, volume 183 of Studies in Fuzziness and Soft Computing, pages 285-304. Springer, 2005.
24. Stewart W. Wilson. Classifier Fitness Based on Accuracy. Evolutionary Computation, 3(2):149-175, 1995. http://prediction-dynamics.com/.
25. Stewart W. Wilson. Generalization in the XCS classifier system. In Genetic Programming 1998: Proceedings of the Third Annual Conference, pages 665-674. Morgan Kaufmann, 1998.