A coevolutionary algorithm for rules discovery in data mining

International Journal of Systems Science

Volumn 37, Issue 12, 2006, Pages 835-864

  Tan, K C ^a   Yu, Q ^a   Ang, J H ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Classification; Data mining; Evolutionary algorithms

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER SIMULATION; DATA MINING; DATA REDUCTION; DATABASE SYSTEMS; INFORMATION RETRIEVAL; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS;

COEVOLUTIONARY CLASSIFICATION TECHNIQUE; COEVOLUTIONARY RULE EXTRACTOR (CORE); RANDOM PARTITION OF DATASETS; UNIVERSITY OF CALIFORNIA, IRVINE (UCI);

EVOLUTIONARY ALGORITHMS;

EID: 33749017627     PISSN: 00207721     EISSN: 14645319     Source Type: Journal    
DOI: 10.1080/00207720600879641     Document Type: Review

References (61)

1. P.J. Angeline and J.B. Pollack, "Competitive environments evolve better solutions for complex tasks", in Proceedings of the Fifth International Conference on Genetic Algorithms, Urbana-Champaign, IL, USA, 1993, pp. 264-270.
2. J. Bacardit and J.M. Garrrell, "Evolving multiple discretizations with adaptive intervals for a Pittsburgh rule-based learning classifier system", in Proceedings of the Genetic and Evolutionary Computation Conference, (LNCS 2724), Berlin: Springer-Verlag, 2003, pp. 1818-1831.
3. W. Banzhaf, P. Nordin, R.E. Keller and F.D. Francone, Genetic Programming: an Introduction on the Automatic Evolution of Computer Programs and its Applications, San Francisco, CA: Morgan Kaufmann, 1998.
4. A. Barry, J. Holmes and X. Llorà, "Data mining using learning classifier systems", Appl. Learn. Classif. Sys., 150, pp. 15-67, 2004.
5. E. Bernadó, X. Llorà, and J.M. Garrell, "XCS and GALE: a comparative study of two learning classifier systems on data mining", in Advances in Learning Classifier Systems, P. Lanzi, W. Stolzmann and S. Wilson, Eds, 4th International Workshop, volume 2321 of Lecture Notes in Artificial Intelligence, New York: Springer, 2001, pp. 115-132.
6. C.C. Bojarczuk, H.S. Lopes and A.A. Freitas, "Genetic programming for knowledge discovery in chest-pain diagnosis", IEEE Eng. Med. Biol. Mag., 4, pp. 38-4, 2000.
7. M. Brameier and W. Banzhaf, "A comparison of linear genetic programming neural networks in medical data mining", IEEE Trans. Evolut. Comp., 5, pp. 17-26, 2001.
8. D.R. Carvalho and A.A. Freitas, "A genetic algorithm for discovering small disjunct rules in data mining", Appl. Soft Comp., 2, pp. 75-88, 2002.
9. D.R. Carvalho and A.A. Freitas, "A hybrid decision tree/genetic algorithm method for data mining", Inform. Sci., 63, pp. 77-86, 2004.
10. R. Cattral, F. Oppacher and D. Deugo, "Rule acquisition with a genetic algorithm", in Proceedings of the 1999 Congress on Evolutionary Computation, Vol. 1, Washington DC, 1999, pp. 125-129.
11. G. Cestnik, I. Konenenko and I. Bratko, "Assistant-86: a knowledge-elicitation tool for sophisticated users", in Machine Learning, Sigma Press, Bratko, L., Ed., Imprint: Belmont, Calif: Wadsworth International Group, Boston: Duxburg Press, 1983, pp. 31-45.
12. J.M. Chambers, W.S. Cleveland, B. Kleiner and P.A. Turkey, Graphical Methods for Data Analysis, Pacific, CA: Wadsworth & Brooks/Cole, 1983.
13. C.B. Congdon, "Classification of epidemiological data: a comparison of genetic algorithm and decision tree approaches", in Proceedings of the IEEE Congress on Evolutionary Computation, Vol. 1, La Jolla, CA, USA, 2000, pp. 442-449.
14. I. De Falco, A. Della Cioppa and E. Tarantino, "Discovering interesting classification rules with genetic programming", Appl. Soft Comp., 23, pp. 1-13, 2002.
15. K.A. De Jong, W.M. Spears and D.F. Gordon, "Using genetic algorithms for concept learning", Machine Learn., 13, pp. 161-188, 1993.
16. U. Fayyad, "Data mining and knowledge discovery in databases: implications for scientific databases", in Proceedings of the Ninth International Conference on Scientific and Statistical Database Management, Olympia, WA, USA, 1997, pp. 2-11.
17. M.V. Fidelis, H.S. Lopes and A.A. Freitas, "Discovering comprehensible classification rules with a genetic algorithm", in Proceedings of IEEE Congress on Evolutionary Computation, Vol. 1, La Jolla, CA, USA, 2000, pp. 805-810.
18. R.A. Fisher, "The use of multiple measurements in taxonomic problems", Ann. Eugen., 7, pp. 179-188, 1936.
19. E. Frank and I.H. Witten, "Generating accurate rule sets without global optimization", in Proceedings of the Fifteenth International Conference Machine Learning (ICML'98), Madison, WI, USA, 1998, pp. 144-151.
20. A.A. Freitas, "Understanding the crucial role of attribute interaction in data mining", Artif. Intellig. Rev., 16, pp. 177-199, 2001.
21. A.A. Freitas, "A survey of evolutionary algorithms for data mining and knowledge discovery", in Advances in Evolutionary Compulation, A. Ghosh and S. Tsutsui, Eds, Berlin: Springer-Verlag, 2002a, pp. 819-845.
22. A.A. Freitas, Data Mining and Knowledge Discovery with Evolutionary Algorithms, A. Ghosh and S. Tsutsui, Eds, Berlin: Springer-Verlag, 2002b.
23. E.R. Hruschka and N.F.F. Ebecken, "A clustering genetic algorithm for extracting rules from supervised neural network models in data mining tasks", Inter. J. Comp., Syst. Sig., 1, pp. 17-29, 2000.
24. H. Ishibuchi and S. Namba, "Evolutionary multiobjective knowledge extraction for high-dimensional pattern classification problems", in Lecture Notes in Computer Science 3242: Parallel Problem Solving from Nature - PPSN y VIII, Berlin: Springer, 2004, pp. 1123-1132.
25. H. Ishibuchi and T. Yamamoto, Effects of three-objective genetic rule selection on the generalization ability of fuzzy rule-based systems, in Lecture Notes in Computer Science 2632: Evolutionary Multi-Criterion Optimzation, Berlin: Springer, 2003, pp. 608-622.
26. H. Ishibuchi and T. Yamamoto, "Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining", Fuzzy Sets Sys., 141, pp. 59-88, 2004.
27. H. Ishibuchi, T. Nakashima and T. Murata, "Three-objective genetic-based machine learning for linguistic rule extraction", Inform. Sci., 136, pp. 109-133, 2001.
28. G.H. John and P. Langley, "Estimating continuous distributions in Bayesian classifiers", in Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, San Mateo: Morgan Kaufmann, 1995, pp. 338-345.
29. V. Khare, X. Yao and B. Sendhoff, "Credit assignment among neurons in co-evolving populations", in Proceedings of the Parallel Problem Solving from Nature VIII Conference, Birmingham, UK, 2004 pp. 882-891.
30. J.K. Kishore, L.M. Patnaik, V. Mani and V.K. Agrawal, "Application of genetic programming for multicategory pattern classification", IEEE Trans. Evolut. Comp., 4, pp. 242-258, 2000.
31. P.L. Lanzi and M. Colombetti, "An extension to the XCS classifier system for stochastic environments", in Proceedings of the Genetic and Evolutionary Computation Conference, San Francisco, CA: Morgan Kaufmann, 1999, pp. 353-360.
32. P.L. Lanzi and A. Perrucci, "Extending the representation of classifier conditions, part If: from messy coding to s-expression", in Proceedings of the Genetic and Evolutionary Computation Conference, San Francisco, CA: Morgan Kaufmann, 1999, pp. 345-352.
33. R.J.A. Little and D.B. Rubin, Statistical Analysis with Missing Data, New York: Wiley, 1987.
34. H. Liu and H. Motoda, Feature Selection for Knowledge Discovery and Data Mining, Boston: Kluwer Academic Publishers, 1998.
35. R.R.F. Mendes, F.B. Voznika, A.A. Freitas and J.C. Nievola, "Discovering fuzzy classification rules with genetic programming and co-evolution", Principles of Data Mining and Knowledge Discovery (Proc. 5th European Conf., PKDD 2001) - Lecture Notes in Artificial Intelligence 2168, New York: Springer-Verlag, 2001, pp. 314-325.
36. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, London: Kluwer Academic Publishers, 1994.
37. D. Michie, D.J. Spiegelhalter and C.C. Taylor, Machine Learning, Neural and Statistical Classification, London: Ellis Horwood, 1994.
38. T.M. Mitchell, Machine Learning, New York: McGraw Hill, 1997.
39. D.E. Moriarty, "Symbiotic evolution of neural networks in sequential decision tasks". PhD thesis, The University of Texas at Austin (1997).
40. E. Noda, A.A. Freitas and H.S. Lopes, "Discovering interesting prediction rules with a genetic algorithm", in Proceedings of the IEEE Conference on Evolutionary Computation, Washington DC, 1999, pp. 1322-1329.
41. C.A. Peña-Reyes and M. Sipper, "Fuzzy CoCo: a cooperative-coevolutionary approach to fuzzy modelling", IEEE Trans Fuzzy Sys., 9, pp. 727-737, 2001.
42. M.A. Potter and K.A. De Jong, "A cooperative coevolutionary approach to function optimization", in Proceedings of the Parallel Problem Solving from Nature III Conference, Jerusalem, Israel, 1994, pp. 249-257.
43. M.A. Potter and K.A. De Jong, "Cooperative coevolution: an architecture for evolving coadapted subcomponents", Evolut. Comp., 8, pp. 129, 2000.
44. A.R. Pozo and M. Hasse, "A genetic classifier tool", in Proceedings of the 20th International Conference of the Chilean Computer Science Society, Santiago, Chile, 2000, pp. 14-23.
45. L. Prechelt, "Some notes on neural learning algorithm benchmarking", Neuralcomputing, 9, pp. 343-347, 1995.
46. J.R. Quinlan, C4.5: Programs for Machine Learning, San Mateo, CA: Morgan Kaufmann, 1993.
47. C.D. Rosin and R.K. Belew, "New methods for competitive coevolution", Evolut. Camp., 5, pp. 1-29, 1997.
48. S.E. Rouwhorst and A.P. Engelbrecht, "Searching the forest: using decision trees as building blocks for evolutionary search in classification databases", in Proceedings of the IEEE Congress on Evolutionary Computation, Vol. 1, California, CA, USA, 2000, pp. 633-638.
49. S. Saxon and A. Barry, "XCS and the monk's problems", Learning Classifier Systems, From Foundations to Applications Lecture Notes in Artificial Intelligence (LNAI-1813), P.L. Lanzi W. Stolzmann and S.W. Wilson, Eds, Berlin: Springer-Verlag, 2000, pp. 223-242.
50. R. Setiono and H. Liu, "NeuroLinear from neural networks to oblique decision rules", Neurocomputing, 17, pp. 1-24, 1997.
51. K.C. Tan, A. Tay, T.H. Lee and C.M. Heng, "Mining multiple comprehensible classification rules using genetic programming", in Proceedings of the IEEE Congress on Evolutionary Computation, Honolulu, Hawaii, 2002a, pp. 1302-1307.
52. K.C. Tan, T.H. Lee and E.F. Khor, "Evolutionary algorithms for multi-objective optimization: performance assessments and comparisons", Artif. Intellig. Rev., 17, pp. 251-290, 2002b.
53. K.C. Tan, Q. Yu, C.M. Heng and T.H. Lee, "Evolutionary computing for knowledge discovery in medical diagnosis", Artif. Intellig. Med., 27, pp. 129-154, 2003.
54. K.C. Tan, Q. Yu and J.H. Ang, "A dual-objective evolutionary algorithm for rules extraction in data mining", Comput. Optim. Appl., 34, pp. 273-294, 2006.
55. C.H. Wang, T.P. Hong and S.S. Tseng, "Integrating membership functions and fuzzy rule sets from multiple knowledge sources", Fuzzy Sets Sys., 112, pp. 141-154, 2000.
56. S.W. Wilson, "Classifier fitness based on accuracy", Evolut. Camp., 3, pp. 149-175, 1995.
57. S.W. Wilson, "Get real! XCS with continuous-valued inputs", Learning Classifier Systems. From Foundations to Applications Lecture Notes in Artificial Intelligence (LNAI-1813), P.L. Lanzi, W. Stolzmann and S.W. Wilson, Eds, Berlin: Springer-Verlag, 2000, pp. 209-222.
58. I.H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, CA: Morgan Kaufmann Publishers, 1999.
59. M.L. Wong and K.S. Leung, Data Mining Using Grammar Based Genetic Programming and Applications, London: Kluwer Academic Publishers, 2000.
60. M.L. Wong, "A flexible knowledge discovery system using genetic programming and logic grammars", Dec. Sup. Syst., 31, pp. 405-428, 2001.
61. X. Yao and Y. Liu, "A new evolutionary system for evolving artificial neural networks", IEEE Trans. Neural Netw., 8, pp. 694-713, 1997.