Evolutionary computation for training set selection

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

Volumn 1, Issue 6, 2011, Pages 512-523

  Garćia Pedrajas, Nicolás ^a  

^a UNIVERSITY OF CÓRDOBA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); DECISION TREES; EVOLUTIONARY ALGORITHMS; FORESTRY; LARGE DATASET; LEARNING SYSTEMS; NEAREST NEIGHBOR SEARCH; NEURAL NETWORKS;

INSTANCE SELECTION; INSTANCE-BASED METHODS; K-NEAREST NEIGHBORS; LARGE DATASETS; LEARNING PROCESS; PROTOTYPE SELECTION; SCALING PROBLEM; TRAINING SET SELECTION;

LEARNING ALGORITHMS;

ALGORITHMS; CLASSIFICATION; DECISION MAKING; FORESTRY; INFORMATION RETRIEVAL; NEURAL NETWORKS; TREES;

EID: 84861092128     PISSN: 19424787     EISSN: 19424795     Source Type: Journal    
DOI: 10.1002/widm.44     Document Type: Article

References (60)

1. Craven M, DiPasquoa D, Freitagb D, McCalluma A, Mitchella T, Nigama K, Slatterya S. Learning to construct knowledge bases from the World Wide Web. Artif Intell 2000, 118:69-113.
2. Provost FJ, Kolluri V. A survey of methods for scaling up inductive learning algorithms. Data Min Knowl Discovery 1999, 2:131-169.
3. LiuH, MotadaH, Yu L. A selective sampling approach to active feature selection. Artif Intell 2004, 159:49-74.
4. Cano JR, Herrera F, Lozano M. Using evolutionary algorithms as instance selection for data reduction in KDD: an experimental study. IEEE Trans Evolut Comput 2003, 7:561-575.
5. Brighton H, Mellish C. Advances in instance selection for instance-based learning algorithms. Data Min Knowl Discovery 2002, 6:153-172.
6. Weiss SM, Indurkhya N, Zhang T, Damerau F. Text Mining: Predictive Methods for Analyzing Unstructured Information. Berlin: Springer; 2010.
7. Olvera-Ĺopez JA, Carrasco-Ochoa JA, Mart́inez-Trinidad JF, Kittler J. A review of instance selection methods. Artif Intell Rev 2010, 34:133-143.
8. Fukunaga K. Introduction to Statistical Pattern Recognition. Academic Press; 1990.
9. Brodley CE. Recursive automatic bias selection for classifier construction. Mach Learn 1995, 20:63-94.
10. Holland JH. Adaptation in Natural and Artificial Systems. Ann Arbor, MI: The University of Michigan Press; 1975.
11. Goldberg DE. GeneticAlgorithms in Search, Optimization and Machine Learning. Reading, MA: Addison-Wesley; 1989.
12. Michalewicz Z. Genetic Algorithms + Data Structures = Evolution Programs. New York: Springer-Verlag; 1994.
13. Kuncheva L. Editing for the k-nearest neighbors rule by a genetic algorithm. Pattern Recognit Lett 1995, 16:809-814.
14. Dasarathy BV. Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. Los Alamitos, California: IEEE Computer Society Press; 1990.
15. Sebban M, Nock R, Chauchat JH, Rakotomalala R. Impact of learning set quality and size on decision tree performances. Int J Comput Syst Signals 2000, 1:85-105.
16. GrochowskiM, Jankowski N. Comparison of instance selection algorithms ii. results and comments. In: Proceedings of the 7th International Conference on Artificial Intelligence and Soft Computing (ICAISC'2004). Lecture Notes in Artificial Intelligence, Vol. 3070. 2004, 580-585.
17. Cook R, Weisberg S. A Mathematical Theory of Evidence. New York: Chapman and Hall; 1982.
18. Plutowski M. Selecting Training Exemplars for Neural Network Learning. PhD Thesis, San Diego, CA: University of California; 1994.
19. Sun J, Hong GS, Wong YS, Rahman M, Wang ZG. Effective training data selection in tool condition monitoring system. Int J Mach ToolsManuf 2006, 46:218-224.
20. Garćia-Osorio C, de Haro-Garćia A, Garćia-Pedrajas N. Democratic instance selection: a linear complexity instance selection algorithm based on classifier ensemble concepts. Artif Intell 2010, 174:410-441.
21. Garćia S, Cano JR, Herrera F. A memetic algorithm for evolutionary prototype selection: a scaling up approach. Pattern Recognit 2008, 41:2693-2709.
22. Leray P, Gallinari P. Feature selection with neural networks. Behaviormetrika 1998, 26:145-166.
23. Reeves CR, Taylor SJ. Selection of training sets for neural networks by a genetic algorithm. In: Eiden A, B̈ack T, Schoenauer M, Schwefel H-P, eds. Parallel Problem Solving from Nature (PPSN V). Berlin: Springer; 1998.
24. Reeves CR, Bush DR. Using genetic algorithms for training data selection in RBF networks. In: Liu H, Motoda H, eds. Instances Selection and Construction for Data Mining. Norwell, MA: Kluwer; 2001.
25. Kim K-J. Artificial neural networks with evolutionary instance selection for financial forecasting. Expert Syst Appl 2006, 30:519-526.
26. Sierra B, Lazkano E, Inza I, Merino M, Larrañaga P, Quiroga J. Prototype selection and feature subset selection by estimation of distribution algorithms. a case study in the survival of cirrhotic patients treated with TIPS. In: Proceedings of the 8th Conference on Artificial Intelligence in Medicine in Europe. Springer-Verlag; 2001, 20-29.
27. Oates T, Jensen D. The effects of training set size on decision tree complexity. In: Proceedings of the Fourteenth International Conference on Machine Learning. 1997, 254-262.
28. Whitley D. The GENITOR Algorithm and Selective Pressure. In: Proceedings of the 3rd International Conference onGenetic Algorithms. Los Altos, CA: Morgan Kaufmann Publishers; 1989, 116-121.
29. Eshelman LJ. The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination. San Mateo, CA: Morgan Kauffman; 1990.
30. Baluja S. Population-based incremental learning. Technical Report CMU-CS-94-163. Pittsburgh, PA: Carnegie Mellon University; 1994.
31. Cano JR, Herrera F, Lozano M. Evolutionary stratified training set selection for extracting classification rules with trade off precision-interpretability. Data Knowl Eng 2007, 60:90-108.
32. Cano JR, Herrera F, Lozano M. Stratification for scaling up evolutionary prototype selection. Pattern Recognit Lett 2005, 26:953-963.
33. Barandela R, Śanchez JL, Garćia V, Rangel E. Strategies for learning in class imbalance problems. Pattern Recognit 2003, 36:849-851.
34. Sun Y, Kamel MS, Wong AKC, Wang Y. Cost-sensitive boosting for classification of imbalanced data. Pattern Recognit 2007, 40:3358-3378.
35. Lewis D, Gale W. Training text classifiers by uncertainty sampling. In: Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information. New York; 1998, 73-79.
36. KubatM, Holte R, Matwin S. Machine learning for the detection of oil spills in satellite radar images. Mach Learn 1998, 30:195-215.
37. Drown DJ, Khoshgoftaar TM. Using evolutionary sampling to mine imbalanced data. In: Proceedings of the Sixth International Conference on Machine Learning and Applications. IEEE Press; 2007, 55: 363-368.
38. Lee S. Noisy replication in skewed binary classification. Comput Stat Data Anal 2000, 34:165-191.
39. Garćia S, Ferńandez A, Herrera F. Enhancing the effectiveness and interpretability of decision tree and rule induction classifiers with evolutionary training set selection over imbalanced problems. Appl Soft Comput 2009, 9:1304-1314.
40. Garćia S, Herrera F. Evolutionary undersampling for classification with imbalanced datasets: proposals and taxonomy. Evolut Comput, 2009, 17:275-306. 41. Hodge V, Austin J. A survey of outlier detection methodologies. Artif Intell Rev 2004, 22:85-126.
41. Hodge V, Austin J. A survey of outlier detection methodologies. Artif Intell Rev 2004, 22:85-126.
42. Podgorelec V. Improved mining of software complexity data on evolutionary filtered training sets. WSEAS Trans Inf Sci Appl 2009, 6:1751-1760.
43. Byeon B, Rasheed K, Doshi P. Enhancing the quality of noisy training data using a genetic algorithm and prototype selection. In: Arabnia HR, Mun Y, eds. Proceedings of the 2008 International Conference on Artificial Intelligence, ICAI 2008. CSREA Press; 2008, 821-827.
44. Derrac J, Garćia S, Herrera F. Stratified prototype selection based on a steady-state memetic algorithm: a study of scalability. Memetic Comput 2010, 2:183-189.
45. Wilson DR, Martinez TR. Reduction techniques for instance-based learning algorithms. Mach Learn 2000, 38:257-286.
46. Angiulli F. Fast nearest neighbor condensation for large data sets classification. IEEE Trans Knowl Data Eng 2007, 19:1450-1464.
47. Brodley CE, Friedl MA. Identifying mislabeled training data. J Artif Intell Res 1999, 11:131-167. 48. Czarnowski I. Prototype selection algorithms for distributed learning. Pattern Recognit 2010, 43:2292-2300.
48. Czarnowski I. Prototype selection algorithms for distributed learning. Pattern Recognit 2010, 43:2292-2300.
49. Czarnowski I, Jȩdrzejowicz P. An approach to data reduction and integrated machine classification. New Gener Comput 2010, 28:21-40.
50. Potter M, De Jong KA. A coopetative coevolutionary approach to function optimization. In: Proceedings of the Third Conferece on Parallel Problem Solving from Nature. Springer-Verlag; 1994, 33: 249-257.
51. Moriarty DE, Miikkulainen R. Efficient reinforcement learning through symbiotic evolution. Mach Learn 1996, 22:11-32.
52. Potter MA, De Jong KA. Cooperative coevolution: an architecture for evolving coadapted subcomponents. Evolut Comput 2000, 8:1-29.
53. Potter MA. The Design and Analysis of a ComputationalModel of Cooperative Coevolution. PhD Thesis, Fairfax, VA: Goerge Mason University; 1997.
54. Garćia-Pedrajas N, Herv́as-Mart́inez C, Mũnoz-Ṕerez J. Covnet: a cooperative coevolutionary model for evolving artificial neural networks. IEEE Trans Neur Netw 2003, 14:575-596.
55. Garćia-PedrajasN, Herv́as-Mart́inez C, Ortiz-BoyerD. Cooperative coevolution of artificial neural network ensembles for pattern classification. IEEE Trans Evolut Comput 2005, 9:271-302.
56. Garćia-Pedrajas N, Romero del Castillo JA, Ortiz-Boyer D. A cooperative coevolutionary algorithm for instance selection for instance-based learning. Mach Learn 2010, 78:381-420.
57. Arenas MG, Castillo PA, Romero G, Rateb F, Merelo JJ. Co-evolving multilayer perceptrons along with training sets. Appl Soft Comput 2005, 2:503-513.
58. Jiao LC, Liu J, Zhong WC. An organizational coevolutionary algorithm for classification. IEEE Trans Evolut Comput 2006, 10:67-80.
59. Wilcox JR. Organizational learning within a learning classifier system. Master's Thesis, University of Illinois, Chicago; 1995.
60. Antonelli M, Ducange P, Marcelloni F. Exploiting a coevolutionary approach to concurrently select training instances and learn rule bases of Mamdani fuzzy systems. In: Proceedings of the 2010 IEEE International Conference on Fuzzy Systems. 2010, 77: 1-7.