Accuracy-Based Learning Classifier Systems: Models, Analysis and Applications to Classification Tasks

Evolutionary Computation

Volumn 11, Issue 3, 2003, Pages 209-238

  Bernadó Mansilla, Ester ^a,b   Garrell Guiu, Josep M ^a  

^a UNIVERSITAT RAMON LLULL   (Spain)

^b LUCENT TECHNOLOGIES   (United States)

Author keywords

Accuracy based fitness; Data mining; Generalization; Knowledge representation; Learning classifier systems; Learning complexity

Indexed keywords

LEARNING CLASSIFIER SYSTEMS (LCS);

CLASSIFICATION (OF INFORMATION); DATA MINING; KNOWLEDGE REPRESENTATION; LEARNING ALGORITHMS;

LEARNING SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; BIOLOGY; CLASSIFICATION; DECISION TREE; HUMAN; LEARNING; METHODOLOGY; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLASSIFICATION; COMPUTATIONAL BIOLOGY; DECISION TREES; HUMANS; LEARNING; MODELS, GENETIC; MODELS, STATISTICAL;

EID: 0043284115     PISSN: 10636560     EISSN: None     Source Type: Journal    
DOI: 10.1162/106365603322365289     Document Type: Article

References (38)

1. Aha, D., Kibler, D., and Albert, M. (1991). Instance-based Learning Algorithms. Machine Learning, Vol. 6, pages 37-66.
2. Bernadó-Mansilla, E. (2002). Contributions to Genetic Based Classifier Systems. PhD thesis, Enginyeria i Arquitectura La Salle, Ramon Lull University, Barcelona, Spain.
3. Bernadó-Mansilla, E. and Garrell-Guiu, J. M. (2001). MOLeCS: Using Multiobjective Evolutionary Algorithms for Learning. In Zitzler, E., Deb, K., Thiele, L., Coello, C., and Corne, D., editors, First International Conference on Evolutionary Multi-Criterion Optimization, volume 1993 of Lecture Notes in Computer Science, pages 696-710. Springer Verlag.
4. Bernadó-Mansilla, E., Llorà-Fàbrega, X., and Garrell-Guiu, J. M. (2002). XCS and GALE: a Comparative Study of Two Learning Classifier Systems on Data Mining. In Lanzi, P., Stolzmann, W., and Wilson, S., editors, Advances in Learning Classifier Systems, 4th International Workshop, volume 2321 of Lecture Notes in Artificial Intelligence, pages 115-132. Springer.
5. Blake, C. and Merz, C. (1998). UCI Repository of machine learning databases, [http://www.ics.uci.edu/̃mlearn/MLRepository.html]. University of California, Irvine, Department of Information and Computer Sciences.
6. Bonelli, P., Parodi, A., Sen, S., and Wilson, S. W. (1990). NEWBOOLE: A fast GBML System. In Porter, B. and Mooney, R., editors, Seventh International Conference on Machine Learning, pages 153-159. Morgan Kaufmann.
7. Bull, L., Wyatt, D., and Parmee, I. (2002). Initial Modifications to XCS for Use in Interactive Evolutionary Design. In Merelo Guervos, J. J., Adamidis, P., Beyer, H.-G., Fernández-Villacanas, J. L., and Schwefer, H.-P, editors, Parallel Problem Solving from Nature - PPSN VII, pages 568-577. Springer.
8. Butz, M. and Wilson, S. (2001). An algorithmic description of XCS. In Lanzi, P., Stolzmann, W., and Wilson, S., editors, Advances in Learning Classifier Systems: Proceedings of the Third International Workshop, volume 1996 of Lecture Notes in Artificial Intelligence, pages 253-272. Springer-Verlag Berlin Heidelberg.
9. Butz, M. V., Kovacs, T., Lanzi, P. L., and Wilson, S. W. (2001). How XCS Evolves Accurate Classifiers. In Specter, L., Goodman, E., Wu, A., Langdon, W., Voigt, H., Gen, M., Sen, S., Dorigo, M., Pezeshk, S., Garzon, M., and Burke, E., editors, Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'2001), pages 927-934. San Francisco, CA: Morgan Kaufmann.
10. Butz, M. V. and Pelikan, M. (2001). Analyzing the Evolutionary Pressures in XCS. In Spector, L., Goodman, E., Wu, A., Langdon, W., Voigt, H., Gen, M., Sen, S., Dorigo, M., Pezeshk, S., Garzon, M., and Burke, E., editors, Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'2001), pages 935-942. San Francisco, CA: Morgan Kaufmann.
11. Cliff, D. and Ross, S. (1995). Adding Temporary Memory to ZCS. Adaptive Behavior, 3(2):101-150.
12. Conover, W. (1971). Practical Nonparametric Statistics. New York: John Wiley, pages 206-209, 383.
13. Dietterich, T. G. (1998). Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Computation, 10(7):1895-1924.
14. Frank, E. and Witten, I. H. (1998). Generating Accurate Rule Sets Without Global Optimization. In Shavlik, J., editor, Machine Learning: Proceedings of the Fifteenth International Conference, pages 144-151. Morgan Kaufmann.
15. Frey, P. and Slate, D. (1991). Letter recognition using Holland-style adaptive classifiers. Machine Learning, 6:161-182.
16. Hartley, A. H. (1999). Accuracy-based fitness allows similar performance to humans in static and dynamic environments. In Banzhaf, W., Daida, J., Eiben, A., Garzon, M. H., Honavar, V., Jakiela, M., and Smith, R. E., editors, Proceedings of the Genetic and Evolutionary Computation Conference, (GECCO-99), pages 266-273. Morgan Kaufmann.
17. Holland, J. H. (1975). Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor.
18. Holmes, J. H. (1997). Discovering Risk of Disease with a Learning Classifier System. In Back, T., editor, Proceedings of the Seventh International Conference of Genetic Algorithms (ICGA97), pages 426-433. Morgan Kaufmann.
19. Horn, J., Goldberg, D. E., and Deb, K. (1994). Implicit Niching in a Learning Classifier System: Nature's Way. Evolutionary Computation, 2(1), pages 37-66.
20. John, G. H. and Langley, P. (1995). Estimating Continuous Distributions in Bayesian Classifiers. In Besnard, P. and Hanks, S., editors, 11th Conference on Uncertainty in Artificial Intelligence, pages 338-345. Morgan Kaufmann.
21. Kovacs, T. (1997). XCS Classifier System Reliably Evolves Accurate, Complete and Minimal Representations for Boolean Functions. In Roy, R., Chawdhry, P., and Pant, R., editors, Soft Computing in Engineering Design and Manufacturing, pages 59-68. Springer-Verlag.
22. Kovacs, T. (1999). Deletion Schemes for Classifier Systems. In Banzhaf, W., Daida, J., Eiben, A., Garzon, M. H., Honavar, V., Jakiela, M., and Smith, R. E., editors, Proceedings of the Genetic and Evolutionary Computation Conference, (GECCO-99), pages 329-336. Morgan Kaufmann.
23. Kovacs, T. (2000). Strength or Accuracy? A comparison of two approaches to fitness calculation in learning classifier systems. In Stolzmann, W., Lanzi, P., and Wilson, S., editors, Learning Classifier Systems: From Foundations to Applications, volume 1813 of Lecture Notes in Computer Science, pages 143-160. Springer-Verlag Berlin Heidelberg.
24. Kovacs, T. (2001). Towards a Theory of Strong Overgeneral Classifiers. In Foundations of Genetic Algorithms, volume 6, pages 165-184. Morgan Kaufmann.
25. Kovacs, T. (2002). A Comparison of Strength and Accuracy-based Fitness in Learning Classifier Systems. PhD thesis, School of Computer Science. University of Birmingham. Birmingham, UK.
26. Kovacs, T. and Kerber, M. (2001). What Makes a Problem Hard for XCS? In Lanzi, P., Stolzmann, W., and Wilson, S., editors, Advances in Learning Classifier Systems: Proceedings of the Third International Workshop, volume 1996 of Lecture Notes in Artificial Intelligence, pages 80-99. Springer-Verlag Berlin Heidelberg.
27. Lanzi, P. L. (1997). A Study of the Generalization Capabilities of XCS. In Bäck, T., editor, Proceedings of the Seventh International Conference of Genetic Algorithms (ICGA97), pages 418-425. Morgan Kaufmann.
28. Platt, J. (1998). Fast training of support vector machines using sequential minimal optimization. In Schlkopf, B., Burges, C., and Smola, A., editors, Advances in Kernel Methods-Support Vector Learning. Cambridge, MA:MIT Press.
29. Quinlan, R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers.
30. Saxon, S. and Barry, A. (2000). XCS and the Monk's Problem. In Lanzi, P., Stolzmann, W., and Wilson, S., editors, Learning Classifier Systems: From Foundations to Applications, volume 1813 of Lecture Notes in Computer Science, pages 223-242. Springer-Verlag Berlin Heidelberg.
31. Sutton, R. and Barto, A. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: The MIT Press/Bradford Books.
32. Wilson, S. W. (1987). Classifier Systems and the Animat Problem. Machine Learning Journal, 2:199-228.
33. Wilson, S. W. (1995). Classifier Fitness Based on Accuracy. Evolutionary Computation, 3(2):149-175.
34. Wilson, S. W. (1998). Generalization in the XCS Classifier System. In Koza, J., Banzhaf, W., Chellapilla, K., Deb, K., Dorigo, M., Fogel, D., Garzon, M., Goldberg, D., Iba, H., and Riolo, R., editors, Genetic Programming: Proceedings of the Third Annual Conference, pages 665-674. San Francisco, CA: Morgan Kaufmann.
35. Wilson, S. W. (1999). Get Real! XCS with Continuous-Valued Inputs. In Booker, L., Forrest, S., Mitchell, M., and Riolo, R., editors, Festschrift in Honor of John H. Holland, pages 111-121. Center for the Study of Complex Systems, University of Michigan.
36. Wilson, S. W. (2001). Mining Oblique Data with XCS. In Lanzi, P., Stolzmann, W., and Wilson, S., editors, Advances in Learning Classifier Systems: Proceedings of the Third International Workshop, volume 1996 of Lecture Notes in Artificial Intelligence, pages 158-176. Springer-Verlag Berlin Heidelberg.
37. Wilson, S. W. (2002). Compact Rulesets from XCSI. In Lanzi, P., Stolzmann, W., and Wilson, S., editors, Advances in Learning Classifier Systems, 4th International Workshop, volume 2321 of Lecture Notes in Artificial Intelligence, pages 197-210. Springer.
38. Witten, I. H. and Frank, E. (2000). Data Mining. Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann Publishers.