Handling continuous attributes in an evolutionary inductive learner

IEEE Transactions on Evolutionary Computation

Volumn 9, Issue 1, 2005, Pages 31-43

  Divina, Federico ^a   Marchiori, Elena ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Discretization; Evolutionary computation; Inductive concept learning (ICL)

Indexed keywords

EVOLUTIONARY ALGORITHMS; LEARNING ALGORITHMS; LOGIC PROGRAMMING; MATHEMATICAL OPERATORS; OPTIMIZATION;

DISCRETIZATION; EVOLUTIONARY CONCEPT LEARNING; INDUCTIVE CONCEPT LEARNING;

LEARNING SYSTEMS;

EID: 14844362968     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2004.837752     Document Type: Article

References (54)

1. T. Mitchell, Machine Learning, ser. Computer Science. New York: McGraw-Hill, 1997. McGraw-Hill
2. S. Muggleton and L. D. Raedt, "Inductive logic programming: Theory and methods," J. Logic Prog., vol. 19-20, pp. 669-679, 1994.
3. J. Dougherty, R. Kohavi, and M. Sahami, "Supervised and unsupervised discretization of continuous features," in Proc. In. Conf Mach. Learn., 1995, pp. 194-202.
4. A. Freitas, Data Mining and Knowledge Discovery with Evolutionary Algorithms, ser. Natural Computing. Berlin, Germany: Springer-Verlag, 2002.
5. A. Freitas and S. Lavington, Mining Very Large Databases with Parallel Processing. Norwell, MA: Kluwer, 1998.
6. R. Kohavi and M. Sahami, "Error-based and entropy-based discretization of continuous features" in Proc. 2nd Int. Conf. Knowl. Discovery Data Mining, 1996, pp. 114-119.
7. H. Liu, F. Hussain, C. Tan, and M. Dash, "Discretization: An enabling technique," J. Data Mining Knowl. Discovery, vol. 6, no. 4, pp. 393-23, 2002.
8. U. Fayyad and K. Irani, "Multi-interval discretization of continues attributes as preprocessing for classification learning," in Proc. 13th Int. Joint Conf Artif. Intell.. San Mateo, CA, 1993, pp. 1022-1027.
9. F. Divina and E. Marchiori, "Evolutionary concept learning," in Proc. Genetic Evol. Comput. Conf., Jul. 9-13, 2002, pp. 343-350.
10. F. Divina, M. Keijzer, and E. Marchiori, "A method for handling numerical attributes in GA-based inductive concept learners," in Proc. Genetic Evol. Comput. Conf., Chicago, IL, Jul. 12-16, 2003, pp. 898-908.
11. U. Fayyad and K. Irani, "On the handling of continuous-valued attributes in decision tree generation," Mach. Learn., vol. 8, pp. 87-102, 1992.
12. J. Rissanen, Stochastic Complexity in Statistical Inquiry. River Edge, NJ: World Scientific, 1989.
13. F. Divina, M. Keijzer, and E. Marchiori, "Non-universal suffrage selection operators favor population diversity in genetic algorithms," in Proc. Genetic Evol. Comput. Conf., Chicago, IL, Jul. 12-16, 2003, pp. 1571-1573.
14. F. Divina and E. Marchiori, Knowledge-Based Evolutionary Search for Inductive Concept Learning. Berlin, Germany: Springer-Verlag, 2004, ch. III, pp. 237-254.
15. A. Giordana and F. Neri, "Search-intensive concept induction," Evol. Comput., vol. 3, no. 4, pp. 375-16, 1996.
16. F. Divina, M. Keijzer, and E. Marchiori, "Evolutionary concept learning with constraints for numerical attributes," in Proc. Belgian-Dutch Conf. Artif. Intell., Utrecht, The Netherlands, Oct. 23-24, 2003, pp. 107-114.
17. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Stat. Society, vol. 39, pp. 1-38, 1977.
18. C. Blake and C. Merz. (1998) UCI repository of machine learning databases. Online. Available: http://www.ics.uci.edu/-mlearn/ MLRepository.html
19. W. Van Laer, "From prepositional to first order logic in machine learning and data mining - induction of first order rules with ICL," Ph.D. Dissertation, Dept. Comput. Sci., K. U. Leuven, Leuven, Belgium, Jun. 2002.
20. A. Debnath, R. L. de Compadre, G. Debnath, A. Schusterman, and C. Hansch, "Structure-activity relationship of mutagenic aromatic and heteroaromatic nitro compounds. Correlation with molecular orbital energies and hydrophobicity," J. Med. Chem., vol. 34, no. 2, pp. 786-797, 1991.
21. S. Dzeroski, N. Jacobs, M. Molina, and C. Moure, "ILP experiments in detecting traffic problems," in Proc. Eur. Conf. Mach. Learn., 1998, pp. 61436.
22. S. Dzeroski, N. Jacobs, M. Molina, C. Moure, S. Muggleton, and W. V. Laer, "Detecting traffic problems with ILP," in Proc. Int. Workshop Inductive Logic Program., 1998, pp. 281-290.
23. S. Dzeroski, H. Blockeel, B. Kompare, S. Kramer, B. Pfahringer, and W. V. Laer, "Experiments in predicting biodegradability," in Proc. Int. Workshop Inductive Logic Program., 1999, pp. 80-91.
24. J. Quinlan, C4.5: Programs for Machine Learning, ser. Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.
25. G. H. John and P. Langley, "Estimating continuous distributions in Bayesian classifiers," in Proc. 11th Conf. Uncertainty Artif Intell. 1995, pp. 338-345.
26. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," Adv. Kernel Methods: Support Vector Learn. pp. 185-208, 1999.
27. D. W. Aha, D. Kibler, and M. Albert, "Instance-based learning algorithms," Mach. Learn., vol. 6, pp. 37436, 1991.
28. R. Giráldez, J. S. Aguilar-Ruiz, and J. C. Riquelme, "Natural coding: A more efficient representation for evolutionary learning," in Proc. Genetic Evol. Comput. Conf., Chicago, IL, July 12-16, 2003, pp. 979-990.
29. J. Bacardit and J. M. Garrel, "Evolving multiple discretizations with adaptive intervals for a Pittsburgh rule-based genetic learning classifier system," in Proc. Genetic Evol. Comput. Conf., 2003, pp. 1818-1831.
30. I. Witten and E. Frank, WEKA Machine Learning Algorithms in Java. San Mateo, CA: Morgan Kaufmann, 2000, ch. 8, pp. 265-320.
31. S. Muggleton, "Inverse entailment and Progol," New Generation Comput. (Special Issue on Inductive Logic Programming), vol. 13, no. 3-4, pp. 245-286, 1995.
32. S. Muggleton, "Learning from positive data," in Proc. 6th Int. Workshop Inductive Logic Program., S. Muggleton, Ed., 1996, pp. 225-244.
33. H. Blockeel and L. D. Raedt, "Top-down induction of first-order logical decision trees," Artif. Intell., vol. 101, no. 1-2, pp. 285-297, 1998.
34. L. De Raedt and W. Van Laer, "Inductive constraint logic," in Lecture Notes in Artificial Intelligence. Berlin, Germany: Springer-Verlag, 1995, vol. 997, Proc. 6th Conf. Algorithmic Learning Theory, pp. 80-94.
35. P. Clark and R. Boswell, "Rule induction with CN2: Some recent improvements," in Proc. 5th Eur. Working Session Learn., 1991, pp. 151-163.
36. H. Blockeel, L. Dehaspe, B. Demoen, G. Janssens, J. Mon, and H. Vandecasteele, "Improving the efficiency of inductive logic programming through the use of query packs," J. Artif. Intell. Res., vol. 16, pp. 135-166, 2002.
37. J. R. Quinlan, "Induction of decision trees," Readings in Mach. Learn., vol. 1, pp. 81-106, 1986. Originally published in Machine Learning.
38. W. Kwedlo and M. Kretowski, "An evolutionary algorithm using multivariate discretization for decision rule induction," Principles Data Mining Knowl. Discovery, pp. 392-397, 1999.
39. J. Bacardit and J. M. Garrell, "Evolution of multi-adaptive discretization intervals for a rule-based genetic learning system," in Lecture Notes in Artificial Intelligence. Berlin, Germany: Springer-Verlag, 2002, vol. 2527, Proc. Iberoamerican Conf. Artif. Intell. (IBERAMIA'2002), pp. 350-360.
40. C. Janikow, "A knowledge intensive genetic algorithm for supervised learning" Mach. Learn., vol. 13, pp. 198-228, 1993.
41. K. D. Jong, W. Spears, and D. Gordon, "Using genetic algorithms for concept learning," Mach. Learn., vol. 13, no. 1/2, pp. 155-188, 1993.
42. J.S. Aguilar-Ruiz, J. C. Riquelme, and M. Toro, "Evolutionary learning of hierarchical decision roles," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 33, no. 2, pp. 324-331, Apr. 2003.
43. J.C. Riquelme, J. S. Aguilar-Ruiz, and C. D. Valle, "Supervised learning by means of accuracy-aware evolutionary algorithms," Inf. Sci., vol. 156, no. 3-4, pp. 173-188, 2003.
44. J. S. Aguilar-Ruiz, "Removing examples and discovering hierarchical decision rules with evolutionary algorithms," Artif. Intell. Commun. vol. 14, no. 4, pp. 231-233, 2002.
45. R. Giráldez, J. S. Aguilar-Ruiz, J. C. Riquelme, F. Ferrer-Troyano, and D. Rodriguez, "Discretization oriented to decision rules generation," Frontiers Artif. Intell. Applicat., vol. 82, pp. 275-279, 2002.
46. S. Augier, G. Venturini, and Y. Kodratoff, "Learning first order logic rules with a genetic algorithm," in Proc. 1st Int. Conf Knowl. Discovery Data Mining, U. M. Fayyad and R. Uthurusamy, Eds., 20-21, 1995, pp. 21-26.
47. X. Llorá and J. M. Garrell et al., "Knowledge-independent data mining with fine-grained parallel evolutionary algorithms," in Proc. Genetic Evol. Comput. Conf., L. Spector et al., Eds., Jul. 7-11, 2001, pp. 461-468.
48. X. Llorá and J. M. Garrell et al., "Inducing partially-defined instances with evolutionary algorithms," in Proc. 18th lnt. Conf. Mach. Learn. 2001, pp. 337-344.
49. E. Cantu-Paz and C. Kamath, "Inducing oblique decision trees with evolutionary algorithms," IEEE Trans. Evol. Comput., vol. 7, no. 1, pp. 54-68, Feb. 2003.
50. C. Stone and L. Bull, "For real! XCS with continuous - Valued inputs," Evol. Comput. J.l, vol. 11, no. 3, pp. 298-336, 2003.
51. S. W. Wilson et al., "Generalization in the XCS classifier system," in Proc. 3rd Annu. Conf. Genetic Program., J. R. Koza et al., Eds.. Madison, WI, 22-25, 1998, pp. 665-674.
52. R. L. De Mántaras, "A distance-based attribute selection measure for decision tree induction," Mach. Learn., vol. 6, no. 1, pp. 81-92, 1991.
53. R. C. Holte, "Very simple classification rules perform well on most commonly used datasets," Mach. Learn., vol. 11, no. 1, pp. 63-90, 1993.
54. R. Kerber, "ChiMerge: Discretization of numeric attributes," in Proc. 10th Nat. Conf. Artif Intell., 1992, pp. 123-127.