A survey on the application of genetic programming to classification

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 40, Issue 2, 2010, Pages 121-144

  Espejo, Pedro G ^a   Ventura, Sebastián ^a   Herrera, Francisco ^b  

^a UNIVERSITY OF CÓRDOBA   (Spain)

^b UNIVERSITY OF GRANADA   (Spain)

Author keywords

Classification; Decision trees; Ensemble classifiers; Feature construction; Feature selection; Genetic programming (GP); Rule based systems

Indexed keywords

CLASSIFICATION DECISION; ENSEMBLE CLASSIFIERS; FEATURE CONSTRUCTION; FEATURE SELECTION; RULE BASED SYSTEM;

CHARACTER RECOGNITION; CLASSIFIERS; DATA MINING; DECISION TREES; DIAGNOSIS; GENETIC ALGORITHMS; GENETIC PROGRAMMING; MEDICAL PROBLEMS; NEONATAL MONITORING; SURVEYS; TEXT PROCESSING;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 77249174228     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2009.2033566     Document Type: Review

References (182)

1. J. Han and M. Kamber, Data Mining-Concepts and Technique (The Morgan Kaufmann Series in Data Management Systems), 2nd ed. San Mateo, CA: Morgan Kaufmann, 2006.
2. P.-N. Tan, M. Steinbach, and V. Kumar, Introduction to Data Mining. Reading, MA: Addison-Wesley, 2005.
3. W. Banzhaf, P. Nordin, R. E. Keller, and F. D. Francone, Genetic Programming-An Introduction; On the Automatic Evolution of Computer Programs and its Applications. San Mateo, CA/Heidelberg, Germany: Morgan Kaufmann/dpunkt.verlag, 1998.
4. M. Oltean and L. Diosan, "An autonomous GP-based system for regression and classification problems," Appl. Soft Comput., vol.9, no.1, pp. 49-60, Jan. 2009.
5. J. C. Bezdek, S. Boggavarapu, L. O. Hall, and A. Bensaid, "Genetic algorithm guided clustering," in Proc. 1st IEEE Conf. Evol. Comput., Orlando, FL, Jun.1994, pp. 34-39.
6. L. Jie, G. Xinbo, and J. Li-cheng, "A GA-based clustering algorithm for large data sets with mixed numeric and categorical values," in Proc. 5th Int. Conf. Comput. Intell. Multimedia Appl., Xi'an, China: IEEE, Sep. 2003, pp. 102-107.
7. I. D. Falco, E. Tarantino, A. D. Cioppa, and F. Fontanella, "An innovative approach to genetic programming-based clustering," in Proc. 9th Online WorldConf. SoftComput. Ind. Appl. (Advances in Soft Computing Series, 34)., Berlin, Germany: Springer-Verlag, Sep./Oct. 2004, pp. 55-64.
8. Y. Liu, T. Özyer, R. Alhajj, and K. Barker, "Cluster validity analysis of alternative results from multi-objective optimization," in Proc. 5th SIAM Int. Conf. Data Mining, Newport Beach, CA, 2005, pp. 496-500.
9. R. Alhajj and M. Kaya, "Multi-objective genetic algorithms based automated clustering for fuzzy association rules mining," J. Intell. Inf. Syst., vol.31, no.3, pp. 243-264, Dec. 2008.
10. M. Lyman and G. Lewandowski, "Genetic programming for association rules on card sorting data," in Proc. Genet. Evol. Comput. Conf., Washington, DC: ACM, Jun. 2005, pp. 1551-1552.
11. W. M. Spears, K. A. De Jong, T. Bäck, D. B. Fogel, and H. de Garis, "An overview of evolutionary computation," in Proc. Eur. Conf. Mach. Learning (Lecture Notes in Computer Science, 667). Berlin,Germany: Springer-Verlag, Apr. 1993, pp. 442-459.
12. J. H. Holland, Adaptation in Natural and Artificial Systems. AnnArbor, MI: Univ. of Michigan Press, 1975.
13. C. M. Bishop, Pattern Recognition and Machine Learnin (Information Science and Statistics Series). Berlin, Germany: Springer-Verlag, 2006.
14. U. Fayyad, G. Piatetsky-Shapiro, and P. Smyth, "The KDD process for extracting useful knowledge from volumes of data," Commun. ACM, vol.39, no.11, pp. 27-34, Nov. 1996.
15. S. K. Murthy, "Automatic construction of decision trees from data: A multi-disciplinary survey," Data Mining Knowl. Discov., vol.2, no.4, pp. 345-389, 1998.
16. G. L. Pappa, A. A. Freitas, and C. A. A. Kaestner, "Attribute selection with a multi-objective genetic algorithm," in Proc. 16th Brazilian Symp. Artif. Intell. - Adv. Artif. Intell. (Lecture Notes in Computer Science Series, 2507). Porto de Galinhas/Recife, Brazil: Springer-Verlag, Nov. 2002, pp. 280-290.
17. J. R. Cano, F. Herrera, and M. Lozano, "Evolutionary stratified training set selection for extracting classification rules with trade off precisioninterpretability," Data Knowl. Eng., vol.60, no.1, pp. 90-108, Jan. 2007.
18. R. C. Holte, "Very simple classification rules perform well on most commonly used datasets," Mach. Learning, vol.11, pp. 63-91, 1993.
19. K. Deb, Multi-Objective Optimization Using Evolutionary Algorithms. New York: Wiley, Jun. 2001.
20. C. A. C. Coello,G. B. Lamont, and D. A.V.Veldhuizen, Evolutionary Algorithms for SolvingMulti-Objective Problem (Genetic and Evolutionary Computation Series), 2nd ed. Berlin, Germany: Springer-Verlag, 2007.
21. H. Liu and H. Motoda, Feature Extraction, Construction and Selection: A Data Mining Perspectiv (The Springer International Series in Engineering and Computer Science Series, 453).. Berlin, Germany: Springer-Verlag, 1998.
22. R. A. Davis, A. J. Charlton, S. Oehlschlager, and J. C. Wilson, "Novel feature selection method for genetic programming using metabolomic 1H NMR data," Chemometrics Intell. Lab. Syst., vol.81, no.1, pp. 50- 59, Mar. 2006.
23. M. L. Raymer, W. F. Punch, E. D. Goodman, and L. A. Kuhn, "Genetic programming for improved data mining-Application to the biochemistry of protein interactions," in Proc. 1st Annu. Conf. Genetic Program. 1996, Cambridge, MA: MIT Press, Jul., pp. 375-380.
24. H. Guo and A. K. Nandi, "Breast cancer diagnosis using genetic programming generated feature," Pattern Recog., vol.39, no.5, pp. 980-987, May 2006.
25. C. Est́ebanez, J. M. Valls, R. Aler, and I. M. Galv́an, "A first attempt at constructing genetic programming expressions for EEG classification," in Proc. 15th Int. Conf. Artif. Neural Netw.: Biol. Inspirations (Lecture Notes in Computer Science Series, 3696). Warsaw, Poland: Springer- Verlag, Sep. 2005, pp. 665-670.
26. C. Est́ebanez, J. M. Valls, and R. Aler, "GPPE: A method to generate adhoc feature extractors for prediction in financial domains," Appl. Intell., vol.29, no.3, pp. 174-185, Dec. 2008.
27. X. Tan, B. Bhanu, andY. Lin, "Fingerprint classification based on learned features," IEEE Trans. Syst.,Man, Cybern.C, vol.35, no.3, pp. 287-300, Aug. 2005.
28. H. Guo, L. B. Jack, and A. K. Nandi, "Feature generation using genetic programming with application to fault classification," IEEE Trans. Syst., Man, Cybern. B, vol.35, no.1, pp. 89-99, Feb. 2005. (Pubitemid 40226201)
29. Y. Lin and B. Bhanu, "Evolutionary feature synthesis for object recognition," IEEE Trans. Syst., Man, Cybern. C, vol.35, no.2, pp. 156-171, May 2005.
30. M. Muharram and G. D. Smith, "Evolutionary constructive induction," IEEE Trans. Knowl. Data Eng., vol.17, no.11, pp. 1518-1528, Nov. 2005.
31. K. Neshatian and M. Zhang, "Genetic programming and class-wise orthogonal transformation for dimension reduction in classification problems," in Proc. 11th Eur. Conf. Genet. Program. (Lecture Notes in Computer Science Series, 4971), Naples, Italy: Springer-Verlag, Mar. 2008, pp. 242-253.
32. K. Krawiec, "Genetic programming-based construction of features for machine learning and knowledge discovery tasks," Genet. Program. Evol. Mach., vol.3, no.4, pp. 329-343, Dec. 2002.
33. M. G. Smith and L. Bull, "Genetic programming with a genetic algorithm for feature construction and selection," Genet. Program. Evol. Mach., vol.6, no.3, pp. 265-281, Sep. 2005.
34. J. Sherrah, R. E. Bogner, and A. Bouzerdoum, "Automatic selection of features for classification using genetic programming," in Proc. Australian New Zealand Conf. Intell. Inf. Syst., Piscataway, NJ: IEEE, Nov.1996, pp. 284-287.
35. J. R. Sherrah, R. E. Bogner, and A. Bouzerdoum, "The evolutionary pre-processor: Automatic feature extraction for supervised classification using genetic programming," in Proc. 2nd Annu. Conf. Genet. Program., San Mateo, CA: Morgan Kaufmann, Jul.1997, pp. 304-312.
36. P. Murphy and D. Aha. (1994), "UCI repository of machine learning databases," Dept. Inf. Comput. Sci., Univ. California, Irvine, CA [Online]. Available: http://www.ics.uci.edu/?mlearn/MLRepository.html
37. J. K. Estrada Gil, J. C. Ferńandez-Ĺopez, E. Herńandez-Lemus, I. Silva- Zolezzi, A. Hidalgo-Miranda, G. Jiḿenez-Śanchez, and E. E. Vallejo- Clemente, "GPDTI: A genetic programming decision tree induction method to find epistatic effects in common complex diseases," in Proc. 15th Int. Conf. Intell. Syst. Molecular Biol., 6th Eur. Conf. Comput. Biol. (Suppl. Bioinf.), Vienna, Austria, Jul. 2007, pp. 167-174.
38. C.-S. Kuo, T.-P. Hong, and C.-L. Chen, "An improved knowledgeacquisition strategy based on genetic programming," Cybern. Syst., vol.39, no.7, pp. 672-685, Oct. 2008.
39. E. M. Mugambi, A. Hunter, G. Oatley, and R. L. Kennedy, "Polynomialfuzzy decision tree structures for classifying medical data," Knowl. Based Syst., vol.17, no.2-4, pp. 81-87, May 2004.
40. C.-S. Kuo, T.-P. Hong, and C.-L. Chen, "Applying genetic programming technique in classification trees," Soft Comput., vol.11, no.12, pp. 1165- 1172, 2007.
41. T. M. Khoshgoftaar and Y. Liu, "A multi-objective software quality classification model using genetic programming," IEEE Trans. Rel., vol.56, no.2, pp. 237-245, Jun. 2007.
42. M. Shirasaka, Q. Zhao, O. Hammani, K. Kuroda, and K. Saito, "Automatic design of binary decision trees based on genetic programming," presented at the 2nd Asia-Pacific Conf. Simul. Evol. Learning, Canberra, Australia, Nov. 1998.
43. T. Tanigawa and Q. Zhao, "A study on efficient generation of decision trees using genetic programming," in Proc. Genet. Evol. Comput. Conf., San Mateo, CA: Morgan Kaufmann, Jul. 2000, pp. 1047-1052.
44. S. Haruyama and Q. Zhao, "Designing smaller decision trees using multiple objective optimization based GPs," in Proc. IEEE Int. Conf. Syst., Man Cybern., vol.6, Piscataway, NJ: IEEE, Oct. 2002, p. 5.
45. S. Oka and Q. Zhao, "Design of decision trees through integration of C4.5 and GP," in Proc. 4th Jpn.-Australia Joint Workshop Intell. Evol. Syst., 2000, pp. 128-135.
46. G. Folino, C. Pizzuti, and G. Spezzano, "A cellular genetic programming approach to classification," in Proc. Genet. Evol. Comput. Conf., San Mateo, CA: Morgan Kaufmann, Jul. 1999, pp. 1015-1020.
47. G. Folino, C. Pizzuti, and G. Spezzano, "Genetic programming and simulated annealing:Ahybrid method to evolve decission trees," in Proc. Genet. Program. (EuroGP 2000) (Lecture Notes in Computer Science Series, 1802). Berlin, Germany: Springer-Verlag, Apr., pp. 294-303.
48. H. Zhao, "A multi-objective genetic programming approach to developing pareto optimal decision trees," Decis. Support Syst., vol.43, no.3, pp. 809-826, Apr. 2007.
49. J. Eggermont, "Evolving fuzzy decision trees with genetic programming and clustering," in Proc. 5th Eur. Conf. Genet. Program. (EuroGP 2002) (Lecture Notes in Computer Science, 2278), Berlin, Germany: Springer- Verlag, Apr., pp. 71-82.
50. S. Rouwhorst and A. Engelbrecht, "Searching the forest: Using decision trees as building blocks for evolutionary search in classification databases," in Proc. 2000 Congr. Evol. Comput., vol.1, La Jolla, CA: IEEE, Jul., pp. 633-638.
51. M. C. J. Bot and W. B. Langdon, "Application of genetic programming to induction of linear classification trees," in Proc. Genet. Program. (EuroGP) (Lecture Notes in Computer Science Series), vol.1802, Berlin, Germany: Springer-Verlag, Apr. 2000, pp. 247-258.
52. M. C. J. Bot, "Improving induction of linear classification trees with genetic programming," in Proc. Genet. Evol. Comput. Conf., San Mateo, CA: Morgan Kaufmann, 2000, pp. 403-410.
53. R. E. Marmelstein and G. B. Lamont, "Pattern classification using a hybrid genetic program - decision tree approach," in Proc. 3rd Annu. Conf. Genet. Program., San Mateo, CA: Morgan Kaufmann, Jul. 1998, pp. 223-231.
54. A. Tsakonas, "A comparison of classification accuracy of four genetic programming-evolved intelligent structures," Inf. Sci., vol.176, no.6, pp. 691-724, Mar. 2006.
55. V. Slavov and N. I. Nokolaev, "Fitness landscapes and inductive genetic programming," in Proc. 3rd Int. Conf. Artif. Neural Nets Genet. Algorithms, Berlin, Germany: Springer-Verlag, 1997, pp. 414-418.
56. J. R. Koza, "Concept formation and decision tree induction using the genetic programming paradigm," in Proc. 1st Workshop Parallel Probl. Solving Nat. (Lecture Notes in Computer Science Series, 496). Berlin, Germany: Springer-Verlag, Oct. 1990, pp. 124-128.
57. C. Elkan, "The foundations of cost-sensitive learning," in Proc. 17th Int. Joint Conf. Artif. Intell. (IJCAI 2001), vol.2, San Mateo, CA: Morgan Kaufmann, pp. 973-978.
58. T. Fawcett, "ROC graphs: Notes and practical considerations for data mining researchers," HP, Tech. Rep. HPL-2003-2004, 2003.
59. A. A. Freitas, Data Mining and Knowledge DiscoveryWith Evolutionary Algorithms. Berlin, Germany: Springer-Verlag, 2002.
60. H. E. Johnson, R. J. Gilbert, M. K. Winson, R. Goodacre, A. R. Smith, J. J. Rowland, M. A. Hall, and D. B. Kell, "Explanatory analysis of the metabalone using genetic programming of simple, interpretable rules," Genet. Program. Evol. Mach., vol.1, no.3, pp. 243-258, Jul. 2000.
61. S. X. Wang and P. Lichodzijewski, "Boolean genetic programming for promoter recognition in eukaryotes," in Proc. IEEE Congr. Evol. Comput., Edimburgh, UK: IEEE, Sep. 2005, pp. 683-690.
62. R. J. Gilbert, J. J. Rowland, and D. B. Kell, "Genomic computing: Explanatory modelling for functional genomics," in Proc. Genet. Evol. Comput. Conf., San Mateo, CA: Morgan Kaufmann, Jul. 2000, pp. 551- 557.
63. J. Yu, J. Yu, A. A. Almal, S. M. Dhanasekaran, D. Ghosh, W. P. Worzel, and A.M. Chinnaiyan, "Feature selection and molecular classification of cancer using genetic programming," Neoplasia, vol.9, no.4, pp. 292- 303, Apr. 2007.
64. S. Shen,W. Sandham, M. H. Granat, M. F. Dempsey, and J. Patterson, "A new approach to brain tumour diagnosis using fuzzy logic based genetic programming," in Proc. 25th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., vol.1, Piscataway, NJ: IEEE, Sep. 2003, pp. 870-873.
65. K. C. Tan, Q.Yu,C.M.Heng, and T.H. Lee, "Evolutionary computing for knowledge discovery in medical diagnosis," Artif. Intell. Med., vol.27, no.2, pp. 129-154, 2003.
66. C. C. Bojarczuk, H. S. Lopes, A. A. Freitas, and E. L. Michalkiewicz, "A constrained-syntax genetic programming system for discovering classification rules: Application to medical data sets," in Artif. Intell. Med., vol.30, no.1, pp. 27-48, 2004, ISSN 0933-3657.
67. C. C. Bojarczuk, H. S. Lopes, and A. A. Freitas, "Genetic programming for knowledge discovery in chest pain diagnosis," IEEE Eng. Med. Biol. Mag., vol.19, no.4, pp. 38-44, Jul./Aug. 2000.
68. P. S. Ngan, M. L. Wong, W. Lam, K. S. Leung, and J. C. Y. Cheng, "Medical data mining using evolutionary computation," Artif. Intell. Med., vol.16, no.1, pp. 73-96, May 1999.
69. M. L.Wong,W. Lam, K. S. Leung, P. S. Ngan, and J. C. Y. Cheng, "Discovering knowledge from medical databases using evolutionary algorithms," IEEE Eng. Med. Biol. Mag., vol.19, no.4, pp. 45-55, Jul./Aug. 2000.
70. A. Tsakonas, G. Dounias, J. Jantzen, H. Axer, B. Bjerregaard, and D. G. v. Keyserlingk, "Evolving rule-based systems in two medical domains using genetic programming," Artif. Intell. Med., vol.32, no.3, pp. 195- 216, Nov. 2004.
71. C. Qing-Shan, Z. De Fu,W. Li-Jun, and C. Huo-Wang, "A modified genetic programming for behavior scoring problem," in Proc. IEEE Symp. Comput. Intell. Data Mining. Honolulu, Hawaii: IEEE, Apr. 2007, pp. 535-539.
72. S. Sakprasat andM. C. Sinclair, "Classification rulemining for automatic credit approval using genetic programming," in Proc. IEEE Congr. Evol. Comput., Singapore: IEEE, Sep. 2007, pp. 548-555.
73. P. J. Bentley, "'Evolutionary, my dearWatson': Investigating committeebased evolution of fuzzy rules for the detection of suspicious insurance claims," in Proc. Genet. Evol. Comput. Conf., San Mateo, CA: Morgan Kaufmann, Jul. 2000, pp. 702-709.
74. A. L. Garcia-Almanza and E. P. K. Tsang, "Evolving decision rules to predict investment opportunities," Int. J. Autom. Comput., vol.5, no.1, pp. 22-31, Jan. 2008.
75. S. A. Stanhope and J. M. Daida, "Genetic programming for automatic target classification and recognition in synthetic aperture radar imagery," in Proc. 7th Annu. Conf. Evol. Program. VII (Lecture Notes in Computer Science Series, 1447). Mission Valley Marriott, San Diego, CA: Springer-Verlag, 25-27, 1998, pp. 735-744.
76. C. D. Stefano, A. D. Cioppa, and A. Marcelli, "Character preclassification based on genetic programming," Pattern Recogn. Lett., vol.23, no.12, pp. 1439-1448, Oct. 2002.
77. I. De Falco, A. Della Cioppa, and E. Tarantino, "Discovering interesting classification rules with genetic programming," Appl. Soft Comput. J., vol.1, no.4, pp. 257-269, 2002.
78. K. C. Tan, A. Tay, T. H. Lee, and C.M. Heng, "Mining multiple comprehensible classification rules using genetic programming," in Proc. 2002 Congr. Evol. Comput., vol.2, Piscataway, NJ: IEEE, May, pp. 1302- 1307.
79. E. C. no, G. Leguizaḿon, and N. Wagner, "Evolution of classification rules for comprehensible knowledge discovery," in Proc. IEEE Congr. Evol. Comput., Singapore: IEEE, Sep. 2007, pp. 1261-1268.
80. M. L. Wong and K. S. Leung, Data Mining using Grammar-Based Genetic Programming and Applications. Norwell, MA: Kluwer, 2000.
81. F. J. Berlanga, M. J. del Jesus, and F. Herrera, "A novel genetic cooperative-competitive fuzzy rule based learning method using genetic programming for high dimensional problems," in Proc. 3rd Int. Workshop Genet. Evol. Fuzzy Syst.. Witten-Bommerholz, Germany: IEEE, Mar. 2008, pp. 101-106.
82. J. Eggermont, A. E. Eiben, and J. I. van Hemert, "Adapting the fitness function in GP for data mining," in Proc. 2nd Eur. Workshop, Genet. Program. (EuroGP) (ser. Lecture Notes in Computer Science, 1598). Berlin, Germany: Springer-Verlag, May 1999, pp. 193-202.
83. J. Eggermont, A. E. Eiben, and J. I. van Hemert, "A comparison of genetic programming variants for data classification," in Proc. 3rd Int. Symp. Adv. Intell. Data Anal. (IDA) (Lecture Notes in Computer Science, 1642). Berlin, Germany: Springer-Verlag, Aug. 1999, pp. 281- 290.
84. S. García, F. Gonźalez, and L. Śanchez, "Evolving fuzzy rule based classifiers with GA-P:Agrammatical approach," in Proc. 2nd Eur.Workshop, Genet. Program. (EuroGP) (Lecture Notes in Computer Science Series, 1598). Berlin, Germany: Springer-Verlag, May 1999, pp. 203-210.
85. R. R. F. Mendes, F. de B. Voznika, J. C. Nievola, and A. A. Freitas, "Discovering fuzzy classification rules with genetic programming and co-evolution," in Proc. Genet. Evol. Comput. Conf., San Mateo, CA: Morgan Kaufmann, Jul. 2001, p. 183.
86. P. G. Espejo, C. Romero, S. Ventura, and C. Herv́as, "Induction of classification rules with grammar-based genetic programming," in Proc. 2nd Int. Conf. Mach. Intell. (ACIDCA ICMI), Tozeur, Tunisia, Nov. 2005, pp. 596-601.
87. R. Cattral, F. Oppacher, and D. Deugo, "Supervised and unsupervised data mining with an evolutionary algorithm," in Proc. 2001 Congr. Evol. Comput., vol.2, Piscataway, NJ: IEEE, May, pp. 767-774.
88. L. M. Howard and D. J. D'Angelo, "The GA-P: A genetic algorithm and genetic programming hybrid," IEEE Exp., vol.10, no.3, pp. 11-15, Jun. 1995.
89. H.-G. Beyer and H.-P. Schwefel, "Evolution strategies -Acomprehensive introduction," Nat. Comput., vol.1, no.1, pp. 3-52, Mar. 2002.
90. D. Lennartsson and P. Nordin, "A genetic programming method for the identification of signal peptides and prediction of their cleavage sites," EURASIP J. Appl. Signal Process., vol.2004, no.1, pp. 138-145, Jan. 2004.
91. H. F. Gray, R. J. Maxwell, I. Martínez-Ṕerez, C. Aŕus, and S. Cerd́an, "Genetic programming for classification of brain tumours from nuclear magnetic resonance biopsy spectra," in Proc. 1st Annu. Conf. Genet. Program., Stanford, CA: MIT Press, Jul. 1996, p. 424..
92. D. Hope, E. Munday, and S. Smith, "Evolutionary algorithms in the classification of mammograms," in Proc. IEEE Symp. Comput. Intell. Image Signal Process., Piscataway, NJ: IEEE, Apr. 2007, pp. 258-265.
93. W.Wongseree, N. Chaiyaratana, K. Vichittumaros, P.Winichagoon, and S. Fucharoen, "Thalassaemia classification by neural networks and genetic programming," Inf. Sci., vol.177, no.3, pp. 771-786, Feb. 2007.
94. T. K. Paul and H. Iba, "Classification of scleroderma and normal biopsy data and identification of possible biomarkers of the disease," in Proc. IEEE Symp. Comput. Intell. Bioinf. Comput. Biol., Toronto, ON: IEEE, Sep. 2006, pp. 306-311.
95. G. C. Wilson and M. I. Heywood, "Introducing probabilistic adaptive mapping developmental genetic programming with redundant mappings," Genet. Program. Evol. Mach., vol.8, no.2, pp. 187-220, Jun. 2007.
96. J.-Y. Lin, H.-R. Ke, B.-C. Chien, andW.-P. Yang, "Classifier design with feature selection and feature extraction using layered genetic programming," Exp. Syst. Appl., vol.34, no.2, pp. 1384-1393, Feb. 2008.
97. S.Winkler, M. Affenzeller, and S.Wagner, "Advanced genetic programming basedmachine learning," J. Math.Model. Algorithms, vol.6, no.3, pp. 455-480, 2007.
98. M. Zhang and P.Wong, "Genetic programming for medical classification: A program simplification approach," Genet. Program. Evol. Mach., vol.9, pp. 229-255, 2008.
99. M. Brameier andW. Banzhaf, "A comparison of linear genetic programming and neural networks in medical data mining," IEEE Trans. Evol. Comput., vol.5, no.1, pp. 17-26, Feb. 2001.
100. S. Silva andY.-T. Tseng, "Classification of seafloor habitats using genetic programming," in Proc. Appl. Evol. Comput. (EvoWorkshops). (Lecture Notes in Computer Science, 4974). Naples, Italy: Springer-Verlag, Mar. 2008, pp. 315-324.
101. A. Vieira, B. Ribeiro, S. Mukkamala, J. C. Neves, and A. H. Sung, "On the performance of learning machines for bankruptcy detection," in Proc. 2nd IEEE Int. Conf. Comput. Cybern., Piscataway, NJ: IEEE, 2004, pp. 323-327.
102. T. Lensberg, A. Eilifsen, and T. E. McKee, "Bankruptcy theory development and classification via genetic programming," Eur. J. Oper. Res., vol.169, no.2, pp. 677-697, Mar. 2006.
103. S. Sette, B. Wyns, and L. Boullart, "Comparing learning classifier systems and genetic programming: A case study," Eng. Appl. Artif. Intell., vol.17, no.2, pp. 199-204, Mar. 2004.
104. L. Zhang and A. K. Nandi, "Fault classification using genetic programming," Mech. Syst. Signal Process., vol.21, no.3, pp. 1273-1284, Apr. 2007.
105. L. Zhang, L. B. Jack, and A. K. Nandi, "Fault detection using genetic programming," Mech. Syst. Signal Process., vol.19, no.2, pp. 271-289, Mar. 2005.
106. K. Hennessy,M. G.Madden, J. Conroy, and A. G. Ryder, "An improved genetic programming technique for the classification of Raman spectra," Knowl. Based Syst., vol.18, no.4-5, pp. 217-224, Aug. 2005.
107. Y. Zhang, H. Li, M. Niranjan, and P. Rockett, "Applying cost-sensitive multiobjective genetic programming to feature extraction for spam email filtering," in Proc. 11th Eur. Conf. Genet. Program. (Lecture Notes in Computer Science Series, 4971). Naples, Italy: Springer-Verlag, Mar. 2008, pp. 325-336.
108. K. Faraoun and A. Boukelif, "Genetic programming approach for multicategory pattern classification applied to network intrusions detection," Int. Arab J. Inf. Technol., vol.4, no.3, pp. 237-246, Jul. 2007.
109. S. Mukkamala, A. H. Sung, and A. Abraham, "Modeling intrusion detection systems using linear genetic programming approach," in Proc. 17th Int. Conf. Ind. Eng. Appl. Artif. Intell. Exp. Syst. - Innovations Appl. Artif. Intell. (Lecture Notes in Computer Science Series, 3029). Ottawa, Canada: Springer-Verlag, May 2004, pp. 633-642.
110. Y. Liu, T. Khoshgoftaar, and J.-F. Yao, "Building a novel GP-based software quality classifier using multiple validation datasets," in Proc. IEEE Int. Conf. Inf. Reuse Integr., Las Vegas, NV: IEEE, Aug. 2007, pp. 644-650.
111. W. A. Tackett, "Genetic programming for feature discovery and image discrimination," in Proc. 5th Int. Conf. Genet. Algorithms, San Mateo, CA: Morgan Kaufmann, Jul. 1993, pp. 303-309.
112. A. M. Teredesai and V. Govindaraju, "Issues in evolving GP based classifiers for a pattern recognition task," in Proc. IEEE Congr. Evol. Comput., vol.1, Portland, Oregon: IEEE, Jun. 2004, pp. 509-515.
113. G. Wijesinghe and V. Ciesielski, "Using restricted loops in genetic programming for image classification," in Proc. IEEE Congr. Evol. Comput., Singapore: IEEE, Sep. 2007, pp. 4569-4576.
114. P. J. Rauss, J. M. Daida, and S. A. Chaudhary, "Classification of spectral image using genetic programming," in Proc.Genet. Evol. Comput. Conf., Las Vegas, Nevada: Morgan Kaufmann, Jul. 2000, pp. 726-733.
115. N. Petrovíc and V. S. Crnojevíc, "Impulse noise detection based on robust statistics and genetic programming," in Proc. 7th Int. Conf. Adv. Concepts Intell. Vis. Syst. (Lecture Notes in Computer Science Series, 3708), Antwerp, Belgium: Springer-Verlag, Sep. 2005, pp. 643-649.
116. D. Agnelli, A. Bollini, and L. Lombardi, "Image classification: An evolutionary approach," Pattern Recogn. Lett., vol.23, no.1-3, pp. 303-309, Jan. 2002.
117. A. Song and V. Ciesielski, "Texture analysis by genetic programming," in Proc. IEEE Congr. Evol. Comput., vol.2, Portland, OR: IEEE, Jun. 2004, pp. 2092-2099.
118. Z. Chen and S. Lu, "A genetic programming approach for classification of textures based on wavelet analysis," in Proc. Int. Symp. Intell. Signal Process., Piscataway, NJ: IEEE, Oct. 2007, pp. 1-6.
119. M. Zhang and W. D. Smart, "Multiclass object classification using genetic programming," in Proc. Appl. Evol. Comput. EvoWorkshops 2004, (Lecture Notes in Computer Science Series, 3005). Coimbra, Portugal: Springer-Verlag, Apr., pp. 369-378.
120. Y.-M. Li, M. Wang, L.-J. Cui, and D.-M. Huang, "A new classification arithmetic for multi-image classification in genetic programming," in Proc. 6th Int. Conf. Mach. Learning Cybern., vol.3, Hong Kong: IEEE, Aug. 2007, pp. 1683-1687.
121. M. Zhang and W. D. Smart, "Using Gaussian distribution to construct fitness functions in genetic programming for multiclass object classification," Pattern Recogn. Lett., vol.27, no.11, pp. 1266-1274, Aug. 2006.
122. M. Zhang, X. Gao, and W. Lou, "A new crossover operator in genetic programming for object classification," IEEE Trans. Syst.,Man, Cybern. B, vol.37, no.5, pp. 1332-1343, Oct. 2007.
123. A. Teller and M. Veloso, "Program evolution for data mining," Int. J. Exp. Syst., vol.8, no.3, pp. 213-236, 1995.
124. G. Patterson and M. Zhang, "Fitness functions in genetic programming for classification with unbalanced data," in Proc. 20th Australian Joint Conf. Artif. Intell. - Adv. Artif. Intell. (Lecture Notes in Computer Science Series), vol.4830. Gold Coast, Australia: Springer-Verlag, Dec. 2007, pp. 769-775.
125. R. Curry, P. Lichodzijewski, and M. I. Heywood, "Scaling genetic programming to large datasets using hierarchical dynamic subset selection," IEEE Trans. Syst., Man, Cybern. B, vol.37, no.4, pp. 1065-1073, Aug. 2007.
126. G. Li, J. F.Wang, K. H. Lee, and K.-S. Leung, "Instruction-matrix- based genetic programming," IEEE Trans. Syst., Man, Cybern. B, vol.38, no.4, pp. 1036-1049, Aug. 2008.
127. M. J. Cavaretta and K. Chellapilla, "Data mining using genetic programming - the implications of parsimony on generalization error," in Proc. Congr. Evol. Comput., vol.2, Piscataway, NJ: IEEE, Jul. 1999, pp. 1330-1337.
128. J.-Y. Lin, H.-R. Ke, B.-C. Chien, andW.-P. Yang, "Designing a classifier by a layered multi-population genetic programming approach," Pattern Recogn., vol.40, no.8, pp. 2211-2225, Aug. 2007.
129. D. P. Muni, N. R. Pal, and J. Das, "A novel approach to design classifiers using genetic programming," IEEE Trans. Evol. Comput., vol.8, no.2, pp. 183-196, Apr. 2004.
130. M. Lemczyk and M. I. Heywood, "Training binary GP classifiers efficiently: A pareto-coevolutionary approach," in Proc. 10th Eur. Conf. Genet. Program. (Lecture Notes in Computer Science Series, 4445), Berlin, Germany: Springer-Verlag, Apr. 2007, pp. 229-240.
131. J. K. Kishore, L. M. Patnaik, V. Mani, and V. K. Agrawal, "Application of genetic programming for multicategory pattern classification," IEEE Trans. Evol. Comput., vol.4, no.3, pp. 242-258, Sep. 2000.
132. T. Loveard and V. Ciesielski, "Representing classification problems in genetic programming," in Proc. IEEE Congr. Evol. Comput.. vol.2, Seoul, South Korea: IEEE, May 2001, pp. 1070-1077.
133. M. Oltean and C. G. san, "Solving classification problems using infix form genetic programming," in Proc. 5th Int. Symp. Intell. Data Anal. - Adv. Intell. Data Anal. V, (ser. Lecture Notes in Computer Science), vol.2810. Berlin, Germany: Springer-Verlag, Aug. 2003, pp. 242-253.
134. B.-C. Chien, J. Y. Lin, and T.-P. Hong, "Learning discriminant functions with fuzzy attributes for classification using genetic programming," Exp. Syst. Appl., vol.23, no.1, pp. 31-37, Jul. 2002.
135. B.-C. Chien and J.-H. Yang, "Features selection based on rough membership and genetic programming," in Proc. IEEE Int. Conf. Syst., Man Cybern., 2006, vol.5, pp. 4124-4129.
136. B.-C. Chien, J.-H. Yang, andW.-Y. Lin, "Generating effective classifiers with supervised learning of genetic programming," in Proc. 5th Int. Conf. Data Warehousing Knowl. Discov., (Lecture Notes in Computer Science Series, 2737). Prague, Czech Republic: Springer-Verlag, Sep. 2003, pp. 192-201.
137. B.-C. Chien, J.-Y. Lin, and W.-P. Yang, "Learning effective classifiers with Z-value measure based on genetic programming," Pattern Recogn., vol.37, no.10, pp. 1957-1972, Oct. 2004.
138. M. D. Ritchie, A. A. Motsinger,W. S. Bush,C. S.Coffey, and J.H.Moore, "Genetic programming neural networks: A powerful bioinformatics tool for human genetics," Appl. Soft Comput., vol.7, no.1, pp. 471-479, Jan. 2007.
139. R. K. Rao, S. Lakshminarayanan, and K. Tun, "Genetic programming models for classification of data from biological systems," in Proc. IEEE Congr. Evol. Comput., Singapore: IEEE, Sep. 2007, pp. 4154-4161.
140. J.-J. Huang, G.-H. Tzeng, and C.-S. Ong, "Two-stage genetic programming (2SGP) for the credit scoring model," Appl. Math. Comput., vol.174, no.2, pp. 1039-1053, Mar. 2006.
141. A. Tsakonas, G. Dounias,M.Doumpos, and C. Zopounidis, "Bankruptcy prediction with neural logic networks by means of grammar-guided genetic programming," Exp. Syst. Appl., vol.30, no.3, pp. 449-461, Apr. 2006.
142. C. G. Doherty, "Fundamental analysis using genetic programming for classification rule induction," in Proc. Genet. Algorithms Genet. Program. Stanford 2003, Stanford, CA: Stanford Bookstore, pp. 45-51, [Online]. Available: http://www.geneticprogramming. org/sp2003/Doherty.pdf
143. L. Hirsch, R.Hirsch, andM. Saeedi, "Evolving Lucene search queries for text classification," in Proc. 2007 Genet. Evol. Comput. Conf., London, England: ACM, Jul., pp. 1604-1611.
144. A. Majid, A. Khan, and A.M.Mirza, "Improving performance of nearest neighborhood classifier using genetic programming," in Proc. IEEE Int. Conf. Mach. Learning Appl., Louisville, Kentucky: IEEE, Dec. 2004, pp. 469-476.
145. L. Diosan, A. Rogozan, and J.-P. Ṕecuchet, "Optimising multiple kernels forSVMby genetic programming," in Proc. 8th Eur. Conf. Evol. Comput. Comb.Optim., (Lecture Notes in Computer Science Series 4972).Naples, Italy: Springer-Verlag, Mar. 2008, pp. 230-241.
146. T. Howley and M. G. Madden, "The genetic kernel support vector machine: Description and evaluation," Artif. Intell. Rev., vol.24, no.3-4, pp. 379-395, Nov. 2005.
147. K. Sullivan and S. Luke, "Evolving kernels for support vector machine classification," in Proc. 2007 Genet. Evol. Comput. Conf., London, England: ACM, Jul., pp. 1702-1707.
148. T. Phienthrakul and B. Kijsirikul, "GPES: An algorithm for evolving hybrid kernel functions of support vector machines," in Proc. IEEE Congr. Evol. Comput., Singapore: IEEE, Sep. 2007, pp. 2636-2643.
149. M. Gîrdea and L. Ciortuz, "A hybrid genetic programming and boosting technique for learning kernel functions from training data," in Proc. 9th Int. Symp. Symbolic Numeric Algorithms Sci. Comput., Timisoara, Romania: IEEE, Sep. 2007, pp. 395-402.
150. T. Watson and T. Rakowski, "Data mining with an evolving population of database queries," in Proc. MENDEL 1995, pp. 169-174.
151. C. Gagńe, M. Schoenauer, M. Sebag, and M. Tomassini, "Genetic programming for kernel-based learning with co-evolving subsets selection," in Proc. 9th Int. Conf.Parallel Probl. SolvingNat. (Lecture Notes in Computer Science, 4193), Reykjavik, Iceland: Springer-Verlag, Sep. 2006, pp. 1008-1017.
152. P. Lichodzijewski andM. I. Heywood, "GP classifier problem decomposition using first-price and second-price auctions," in Proc. 10th Eur. Conf. Genet. Program. (Lecture Notes in Computer Science Series, 4445), Valencia, Spain: Springer-Verlag, Apr. 2007, pp. 137-147.
153. P. Lichodzijewski and M. I. Heywood, "Coevolutionary bid-based genetic programming for problem decomposition in classification," Genet. Program. Evol. Mach., vol.9, no.4, pp. 331-365, Dec. 2008.
154. C. Gagńe and M. Parizeau, "Coevolution of nearest neighbor classifiers," Int. J. Pattern Recogn. Artif. Intell., vol.21, no.5, pp. 921-946, 2007.
155. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, Jul. 1998.
156. V. N. Vapnik, The Nature of Statistical Learning, 2nd ed. Berlin, Germany: Springer-Verlag, 2000.
157. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
158. A. A. Freitas, "A genetic programming framework for two data mining tasks: Classification and generalized rule induction," in Proc. 2nd Annu. Conf. Genet. Program., San Mateo, CA: Morgan Kaufmann, 1997, pp. 96-101.
159. C. Y. Ishida and A. T. R. Pozo, "GPSQL Miner: SQL-grammar genetic programming in data mining," in Proc. Congr. Evol. Comput., vol.2, Piscataway, NJ: IEEE, May 2002, pp. 1226-1231.
160. K. Yu, L. Ji, and X. Zhang, "Kernel nearest neighbor
161. E. B. Baum and I. Durdanovic, "An artificial economy of post production systems," in Proc. 3rd Int. Workshop Adv. Learning ClassifierSyst., (Lecture Notes in Computer Science Series, 1996). Paris, France: Springer-Verlag, Sep. 2000, pp. 3-20.
162. E. Baum and I. Durdanovic, "Toward code evolution by artificial economies," in Evolution as Computation, L. F. Landweber and E.Winfree, Eds. Berlin, Germany: Springer-Verlag, 2002, pp. 314-332.
163. L. Breiman, "Bagging predictors," Mach. Learning, vol.24, no.2, pp. 123-140, Aug. 1996.
164. E. Bauer and R. Kohavi, "An empirical comparison of voting classification algorithms: Bagging, boosting, and variants," Mach. Learning, vol.36, no.1-2, pp. 105-139, Jul. 1999.
165. T. G. Dietterich, "An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization," Mach. Learning, vol.40, no.2, pp. 139-157, Aug. 2000.
166. M. Brameier and C.Wiuf, "Ab initio identification of human microRNAs based on structure motifs," BMC Bioinf., vol.8, p. 478, Dec. 2007.
167. C.-G. Xu and K.-H. Liu, "A GP based approach to the classification of multiclass microarray datasets," in Proc. 4th Int. Conf. Intell. Comput., (Lecture Notes in Computer Science Series, 5227). Shanghai, China: Springer-Verlag, Sep. 2008, pp. 340-346.
168. K. Imamura, T. Soule, R. B. Heckendorn, and J. A. Foster, "Behavioral diversity and a probabilistically optimal GP ensemble," Genet. Program. Evol. Mach., vol.4, no.3, pp. 235-253, Sep. 2003.
169. J.-H. Hong and S.-B. Cho, "The classification of cancer based on DNA microarray data that uses diverse ensemble genetic programming," Artif. Intell. Med., vol.36, no.1, pp. 43-58, Jan. 2006.
170. S. Hengpraprohm and P. Chongstitvatana, "A genetic programming ensemble approach to cancer microarray data classification," in Proc. 3rd Int. Conf. Innovative Comput. Inf. Control, Piscataway, NJ: IEEE, Jun. 2008, pp. 340-340
171. M. Brameier and W. Banzhaf, "Evolving teams of predictors with linear genetic programming," Genet. Program. Evol. Mach., vol.2, no.4, pp. 381-407, Dec. 2001.
172. W. B. Langdon, S. J. Barret, and B. F. Buxton, "Combining decision trees and neural networks for drug discovery," in Proc. 5th Eur. Conf., Genet. Program. (EuroGP). (Lecture Notes in Computer Science, 2278). Berlin, Germany: Springer-Verlag, Apr. 2002, pp. 60-70.
173. Y. Zhang and S. Bhattacharyya, "Genetic programming in classifying large-scale data: An ensemble method," Inf. Sci., vol.163, no.1-3, pp. 85-101, Jun. 2004.
174. G. Folino, C. Pizzuti, and G. Spezzano, "Training distributed GP ensemble with a selective algorithm based on clustering and pruning for pattern classification," IEEE Trans. Evol. Comput., vol.12, no.4, pp. 458-468, Aug. 2008.
175. R. Thomason and T. Soule, "Novel ways of improving cooperation and performance in ensemble classifiers," in Proc. Genet. Evol. Comput. Conf., London, England: ACM, Jul. 2007, pp. 1708-1715.
176. G. Folino, C. Pizzuti, and G. Spezzano, "Mining distributed evolving data streams using fractal GP ensembles," in Proc. 10th Eur. Conf.Genet. Program., (Lecture Notes in Computer Science Series, 4445). Valencia, Spain: Springer-Verlag, Apr. 2007, pp. 160-169.
177. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice-Hall, 1988.
178. D. H. Wolpert, "The lack of a priori distinctions between learning algorithms," Neural Comput., vol.8, no.7, pp. 1341-1390, Oct. 1996.
179. D. H. Wolpert and W. G. Macready, "No free lunch theorems for optimization," IEEE Trans. Evol. Comput., vol.1, no.1, pp. 67-82, Apr. 1997.
180. P. Whigham, "Gramatical bias for evolutionary learning," Ph.D. dissertation, School of Comput. Sci.; Univ. College; Univ. of New South Wales; Australian Defence Force Academy, 1996.
181. N. V. Chawla, N. Japkowicz, and A. Kotcz, "Editorial: Special issue on learning from imbalanced data sets," SIGKDD Explorations, vol.6, no.1, pp. 1-6, Jun. 2004.
182. G. M. Weiss, "Mining with rarity: A unifying framework," SIGKDD Explorations, vol.6, no.1, pp. 7-19, Jun. 2004.