Substructrual surrogates for learning decomposable classification problems: Implementation and first results

Proceedings of GECCO 2007: Genetic and Evolutionary Computation Conference, Companion Material

Volumn , Issue , 2007, Pages 2875-2882

  Orriols Puig, Albert ^a,b   Bernadó Mansilla, Ester ^a   Sastry, Kumara ^b   Goldberg, David E ^b  

^a UNIVERSITAT RAMON LLULL   (Spain)

^b University of Illinois at Urbana Champaign

Author keywords

Estimation of distribution algorithms; Machine learning; Structural learning

Indexed keywords

APPROXIMATION ALGORITHMS; DISTRIBUTION FUNCTIONS; MATHEMATICAL MODELS; PROBLEM SOLVING;

ESTIMATION OF DISTRIBUTION ALGORITHMS; STRUCTURAL LEARNING; STRUCTURAL MODELS;

LEARNING SYSTEMS;

EID: 34548059157     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1274000.1274058     Document Type: Conference Paper

References (31)

1. S. Baluja. Incorporating a priori knowledge in probabilistic-model based optimization. In Martin Pelikan, Kumara Sastry, and Erick Cantú-Paz, editors, Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications, chapter 9, pages 205-219. Springer, Berlin, 2006.
2. E. Bernadó-Mansilla and J.M. Garrell. Accuracy-Based Learning Classifier Systems: Models, Analysis and Applications to Classification Tasks. Evolutionary Computation, 11(3):209-238, 2003.
3. M.V. Butz. Rule-Based Evolutionary Online Learning Systems: A Principled Approach to LCS Analysis and Design, volume 109 of Studies in Fuzziness and Soft Computing. Springer, 2006.
4. M.V. Butz, M. Pelikan, X. Llorà, and D.E. Goldberg. Automated Global Structure Extraction for Effective Local Building Block Processing in XCS. Evolutionary Computation, 14(3):345-380, 2006.
5. K.A. De Jong and W.M. Spears Learning Concept Classification Rules Using Genetic Algorithms. In Proceedings of the International Joint Conference on Artificial Intelligence, pages 651-656. Sidney, Australia, 1991.
6. N.R. Drapper and H. Smith. Applied Regression Analysis. John Wiley & Sons, New York, USA, 1966.
7. J.J. Gibson. The Ecological Approach to Visual Perception. Mahwah, NJ: Lawrence Erlbaum Associates, 1979.
8. D.E. Goldberg. The Design of Innovation: Lessons from and for Competent Genetic Algorithms. Kluwer Academic Publishers, 1 edition, 2002.
9. G.R. Harik. Linkage Learning via Probabilistic Modeling in the ECGA. Technical report, (IlliGAL Report No. 99010).Urbana, IL: University of Illinois at Urbana-Champaign, January 1999.
10. G.R. Harik, F. Lobo, and K. Sastry. Linkage learning via probabilistic modeling in the ECGA. In Martin Pelikan, Kumara Sastry, and Erick Cantú-Paz, editors, Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications, chapter 3, pages 39-61. Springer, Berlin, 2006. (Also IlliGAL Report No. 99010).
11. J.H. Holland. Adaptation in Natural and Artificial Systems. The University of Michigan Press, 1975.
12. S.S. Keerthi and C.J. Lin. Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel. Neural Computation, 15(7): 1667-1689, 2003.
13. J. Korst and E. Aarts. Simulated Annealing and Boltzmann Machines. Wiley-Interscience, New York, 1997.
14. T. Kovacs. Deletion Schemes for Classifier Systems. In GECCO '99: Proceedings of the Genetic and Evolutionary Computation Conference, pages 329-336. Morgan Kaufmann, 1999.
15. X. Llorà, K. Sastry, D. E. Goldberg, and L. de la Ossa. The X-ary extended compact genetic algorithm: Linkage learning in Pittsburgh les. In T. Kovacs, X. Llorà, and K. Takadama, editors, Advances at the frontier of LCS. Springer, Berlin, 2007. (Also IlliGAL Report No. 2006015).
16. X. Llorà, K. Sastry, T.-L. Yu, and D. E. Goldberg. Do not match, inherit: Fitness surrogates for genetics-based machine learning. Proceedings of the 2007 Genetic and Evolutionary Computation Conference, page Accepted, 2007.
17. M. Pelikan. Hierarchical Bayesian Optimization Algorithm: Toward a new Generation of Evolutionary Algorithms. Berlin: Springer Verlag, 2005.
18. M. Pelikan and K. Sastry. Fitness inheritance in the Bayesian optimization algorithm. Proceedings of the 2004 Genetic and Evolutionary Computation Conference, 2:48-59, 2004. (Also IlliGAL Report No. 2004009).
19. M. Pelikan, K. Sastry, and E. Cantú-Paz, editors. Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications, volume 33 of Studies in Computational Intelligence. Springer, 2006.
20. J. Piatt. Fast Training of Support Vector Machines using Sequential Minimal Optimization. In Advances in Kernel Methods - Support Vector Learning, pages 557-563. MIT Press, 1998.
21. J.R. Quinlan. C4-5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo, California, 1995.
22. C.R. Rao and H. Toutenburg. Linear Models: Least Squares and Alternatives. Springer, Berlin, 1999.
23. K. Sastry and D.E. Goldberg. Probabilistic Model Building and Competent Genetic Programming. In Rick L. Riolo and Bill Worzel, editors, Genetic Programming Theory and Practise, chapter 13, pages 205-220. Kluwer, 2003.
24. K. Sastry, C.F. Lima, and D.E. Goldberg. Evaluation Relaxation Using Substructural Information and Linear Estimation. In GECCO '06: Proceedings of the 8th annual Conference on Genetic and Evolutionary Computation, pages 419-426, New York, NY, USA, 2006. ACM Press.
25. K. Sastry, M. Pelikan, and D. E. Goldberg. Efficiency enhancement of genetic algorithms via building-block-wise fitness estimation. Proceedings of the IEEE International Conference on Evolutionary Computation, pages 720-727, 2004. Also IlliGAL Report No. 2004010.
26. H.A. Simon. Sciences of the Artificial. Cambridge, MA: MIT Press, 1969.
27. T.G. Dietterich. Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Comp., 10(7): 1895-1924, 1998.
28. S.W. Wilson. Quasi-Darwinian Learning in a Classifier System. In 4th IWML, pages 59-65. Morgan kaufman, 1987.
29. S.W. Wilson. Classifier Fitness Based on Accuracy. Evolutionary Computation, 3(2): 149-175, 1995.
30. I.H Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, San Francisco, 2nd edition, 2005.
31. T.-L. Yu. A matrix approach for finding extrema: Problems with modularity, hierarchy, and overlap. PhD thesis, University of Illinois at Urbana-Champaign, Urbana, IL, 2006.