Effective and reliable online classification combining XCS with EDA mechanisms

Studies in Computational Intelligence

Volumn 33, Issue , 2007, Pages 249-273

  Butz, Martin ^a   Pelikan, Martin ^b   Llorà, Xavier ^c   Goldberg, David E ^c  

^a UNIVERSITY OF WÜRZBURG   (Germany)

^b UNIVERSITY OF MISSOURI ST LOUIS   (United States)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Bayesian networks; Classification; Decomposable problems; Evolutionary computation; Gradient descent; Hierarchical problem solving; Learning classifier systems; Reinforcement learning; Scalability

Indexed keywords

EID: 33846266187     PISSN: 1860949X     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-540-34954-9_11     Document Type: Article

References (42)

1. Bernadó, E., Llorà, X., and Garrell, J. M. (2002). XCS and GALE: A comparative study of two learning classifier systems and six other learning algorithms on classification tasks. In Lanzi, P. L., Stolzmann, W., and Wilson, S. W., (Eds.), Advances in Learning Classifier Systems (LNAI 2321), pp. 115-132. Springer, Berlin Heidelberg New York
2. Bernadó-Mansilla, E. and Garrell-Guiu, J. M. (2003). Accuracy-based learning classifier systems: Models, analysis, and applications to classification tasks. Evolutionary Computation, 11:209-238
3. Butz, M. V. (2004). Rule-based evolutionary online learning systems: Learning bounds, classification, and prediction. PhD thesis, University of Illinois at Urbana-Champaign, Urbana, IL
4. Butz, M. V. (2005a). Kernel-based, ellipsoidal conditions in the real-valued XCS classifier system. GECCO 2005: Genetic and Evolutionary Computation Conference: Vol. 2, pp. 1835-1842
5. Butz, M. V. (2005b). Rule-based evolutionary online learning systems: A principled approach to LCS analysis and design. Studies in Fuzziness and Soft Computing. Springer, Berlin Heidelberg New York
6. Butz, M. V. and Goldberg, D. E. (2004). Hierarchical classification problems demand effective building block identification and processing in LCSs. IlliGAL report 2004017, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign
7. Butz, M. V., Goldberg, D. E., and Lanzi, P. L. (2005). Foundations of Learning Classifier Systems, Computational Complexity of the XCS Classifier System, pp. 91-126. Studies in Fuzziness and Soft Computing. Springer, Berlin Heidelberg New York
8. Butz, M. V., Goldberg, D. E., and Stolzmann, W. (2002). The anticipatory classifier system and genetic generalization. Natural Computing, 1:427-467
9. Butz, M. V., Goldberg, D. E., and Tharakunnel, K. (2003a). Analysis and improvement of fitness exploitation in XCS: Bounding models, tournament selection, and bilateral accuracy. Evolutionary Computation, 11:239-277
10. Butz, M. V., Kovacs, T., Lanzi, P. L., and Wilson, S. W. (2001). How XCS evolves accurate classifiers. Proceedings of the Third Genetic and Evolutionary Computation Conference (GECCO-2001), pp. 927-934
11. Butz, M. V., Kovacs, T., Lanzi, P. L., and Wilson, S. W. (2004a). Toward a theory of generalization and learning in XCS. IEEE Transactions on Evolutionary Computation, 8:28-46
12. Butz, M. V., Sastry, K., and Goldberg, D. E. (2003b). Tournament selection in XCS. Proceedings of the Fifth Genetic and Evolutionary Computation Conference (GECCO-2003), pp. 1857-1869
13. Butz, M. V., Sastry, K., and Goldberg, D. E. (2004b). Strong, stable, and reliable fitness pressure in XCS due to tournament selection. Genetic Programming and Evolvable Machines, 6:53-77
14. Butz, M. V. and Wilson, S. W. (2001). An algorithmic description of XCS. In Lanzi, P. L., Stolzmann, W., and Wilson, S. W., (Eds.), Advances in Learning Classifier Systems: Third International Workshop, IWLCS 2000 (LNAI 1996), pp. 253-272. Springer, Berlin Heidelberg New York
15. Chickering, D. M., Heckerman, D., and Meek, C. (1997). A Bayesian approach to learning Bayesian networks with local structure. Technical Report MSR-TR-97-07, Microsoft Research, Redmond, WA
16. Cooper, G. F. and Herskovits, E. H. (1992). A Bayesian method for the induction of probabilistic networks from data. Machine Learning, 9: 309-347
17. De Jong, K. A. and Spears, W. M. (1991). Learning concept classification rules using genetic algorithms. IJCAI-91 Proceedings of the Twelfth International Conference on Artificial Intelligence, pp. 651-656
18. Friedman, N. and Goldszmidt, M. (1999). Learning Bayesian networks with local structure. In Jordan, M. I., (Ed.), Graphical models, pp. 421-459. MIT, Cambridge, MA
19. Gérard, P. and Sigaud, O. (2003). Designing efficient exploration with MACS: Modules and function approximation. Proceedings of the Fifth Genetic and Evolutionary Computation Conference (GECCO-2003), pp. 1882-1893
20. Gibson, J. J. (1979). The Ecological Approach to Visual Perception. Lawrence Erlbaum Associates, Mahwah, NJ
21. Goldberg, D. E. (2002). The Design of Innovation: Lessons from and for Competent Genetic Algorithms. Kluwer Academic, Boston, MA
22. Harik, G. (1999). Linkage learning via probabilistic modeling in the ECGA. IlliGAL report 99010, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign
23. Heckerman, D., Geiger, D., and Chickering, D. M. (1994). Learning Bayesian networks: The combination of knowledge and statistical data. Technical Report MSR-TR-94-09, Microsoft Research, Redmond, WA
24. Howard, R. A. and Matheson, J. E. (1981). Influence diagrams. In Howard, R. A. and Matheson, J. E., (Eds.), Readings on the Principles and Applications of Decision Analysis, Vol. 2, pp. 721-762. Strategic Decisions Group, Menlo Park, CA
25. Kovacs, T. (1996). Evolving optimal populations with XCS classifier systems. Master's thesis, School of Computer Science, University of Birmingham, Birmingham, UK
26. Kovacs, T. (1997). XCS classifier system reliably evolves accurate, complete, and minimal representations for boolean functions. In Roy, Chawdhry, and Pant, (Eds.), Soft Computing in Engineering Design and Manufacturing, pp. 59-68. Springer, London Berlin Heidelberg New York
27. Kovacs, T. (2000). Strength or Accuracy? Fitness calculation in learning classifier systems. In Lanzi, P. L., Stolzmann, W., and Wilson, S. W., (Eds.), Learning Classifier Systems: From Foundations to Applications (LNAI 1813), pp. 143-160. Springer, Berlin Heidelberg New York
28. Kovacs, T. (2001). Towards a theory of strong overgeneral classifiers. Foundations of Genetic Algorithms 6, pp. 165-184
29. Lobo, F. and Harik, G. (1999). Extended compact genetic algorithm in C++. IlliGAL report 99016, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign
30. Mühlenbein, H. (1992). How genetic algorithms really work: I.Mutation and Hillclimbing. In Männer, R. and Manderick, B., (Eds.), Parallel Problem Solving from Nature, pp. 15-25, Elsevier, Amsterdam Netherlands
31. Neal, R. M. (1993). Probabilistic inference using Markov chain Monte Carlo methods. Technical Report CRG-TR-93-1, Department of Computer Science, University of Toronto
32. Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo, CA
33. Pelikan, M. (2001). Bayesian optimization algorithm, decision graphs, and Occam's razor. Proceedings of the Third Genetic and Evolutionary Computation Conference (GECCO-2001), pp. 511-518
34. Pelikan, M. (2002). Bayesian optimization algorithm: From single level to hierarchy. PhD thesis, University of Illinois at Urbana-Champaign, Urbana, IL. Also IlliGAL Report No. 2002023
35. Pelikan, M., Goldberg, D. E., and Cantu-Paz, E. (1999). BOA: The Bayesian optimization algorithm. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-99), pp. 525-532
36. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6:461-464
37. Simon, H. A. (1969). Sciences of the Artificial. MIT, Cambridge, MA
38. Thierens, D. and Goldberg, D. E. (1993). Mixing in genetic algorithms. Proceedings of the Fifth International Conference on Genetic Algorithms, pp. 38-45
39. Wilson, S. W. (1994). ZCS: A zeroth-level classifier system. Evolutionary Computation, 2:1-18
40. Wilson, S. W. (1995). Classifier fitness based on accuracy. Evolutionary Computation, 3(2):149-175
41. Wilson, S. W. (1998). Generalization in the XCS classifier system. Genetic Programming 1998: Proceedings of the Third Annual Conference, pp. 665-674
42. Wilson, S. W. (2001). Mining oblique data with XCS. In Lanzi, P. L., Stolzmann, W., and Wilson, S. W., (Eds.), Advances in Learning Classifier Systems: Third International Workshop, IWLCS 2000 (LNAI 1996), pp. 158-174. Springer, Berlin Heidelberg New York