Integrating a differential evolution feature weighting scheme into prototype generation

Neurocomputing

Volumn 97, Issue , 2012, Pages 332-343

  Triguero, Isaac ^a   Derrac, Joaquín ^a   García, Salvador ^b   Herrera, Francisco ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF JAÉN   (Spain)

Author keywords

Classification; Differential evolution; Feature weighting; Nearest neighbor; Prototype generation; Prototype selection

Indexed keywords

DIFFERENTIAL EVOLUTION; FEATURE WEIGHTING; NEAREST NEIGHBORS; PROTOTYPE GENERATIONS; PROTOTYPE SELECTION;

CLASSIFICATION (OF INFORMATION); DATA REDUCTION; EVOLUTIONARY ALGORITHMS; OPTIMIZATION; STATISTICAL TESTS;

FEATURE EXTRACTION;

ACCURACY; ARTICLE; CLASSIFICATION ALGORITHM; CLASSIFIER; CONTROLLED STUDY; DATA MINING; FEATURE WEIGHTING SCHEME; K NEAREST NEIGHBOR; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; PREDICTION; PRIORITY JOURNAL; PROCESS DEVELOPMENT; PROCESS OPTIMIZATION; SENSITIVITY AND SPECIFICITY;

EID: 84865330252     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2012.06.009     Document Type: Article

References (64)

1. Alpaydin E. Introduction to Machine Learning 2010, MIT Press, Cambridge, MA. 2nd edition.
2. Kononenko I., Kukar M. Machine Learning and Data Mining: Introduction to Principles and Algorithms 2007, Horwood Publishing Limited.
3. Mitchell T.M. Machine Learning 1997, McGraw-Hill.
4. Lazy Learning 1997, Springer. D.W. Aha (Ed.).
5. Cover T.M., Hart P.E. Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 1967, 13(1):21-27.
6. The Top Ten Algorithms in Data Mining 2009, Chapman & Hall/CRC Data Mining and Knowledge Discovery. X. Wu, V. Kumar (Eds.).
7. Gao Y., Gao F. Edited AdaBoost by weighted kNN. Neurocomputing 2010, 73(16-18):3079-3088.
8. Derrac J., García S., Herrera F. IFS-CoCo: instance and feature selection based on cooperative coevolution with nearest neighbor rule. Pattern Recognition 2010, 43(6):2082-2105.
9. Pyle D. Data Preparation for Data Mining, The Morgan Kaufmann Series in Data Management Systems 1999, Morgan Kaufmann.
10. Urquiza J.M., Rojas I., Pomares H., Herrera L.J., Ortega J., Prieto A. Method for prediction of protein-protein interactions in yeast using genomics/proteomics information and feature selection. Neurocomputing 2011, 74(16):2683-2690.
11. Computational Methods of Feature Selection, Chapman & Hall/CRC Data Mining and Knowledge Discovery Series 2007, Chapman & Hall/CRC. H. Liu, H. Motoda (Eds.).
12. Peng J.X., Ferguson S., Rafferty K., Kelly P. An efficient feature selection method for mobile devices with application to activity recognition. Neurocomputing 2011, 74(17):3543-3552.
13. Derrac J., Cornelis C., García S., Herrera F. Enhancing evolutionary instance selection algorithms by means of fuzzy rough set based feature selection. Inf. Sci. 2012, 186(1):73-92.
14. Liu H., Motoda H. Feature Extraction, Construction and Selection: A Data Mining Perspective 2001, Kluwer Academic Publishers.
15. Wilson D.R., Martinez T.R. Reduction techniques for instance-based learning algorithms. Mach. Learn. 2000, 38(3):257-286.
16. Guillén A., Herrera L.J., Rubio G., Pomares H., Lendasse A., Rojas I. New method for instance or prototype selection using mutual information in time series prediction. Neurocomputing 2010, 73(10-12):2030-2038.
17. García S., Derrac J., Cano J., Herrera F. Prototype selection for nearest neighbor classification: taxonomy and empirical study. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 34(3):417-435.
18. Fayed H.A., Hashem S.R., Atiya A.F. Self-generating prototypes for pattern classification. Pattern Recognition 2007, 40(5):1498-1509.
19. Triguero I., Derrac J., García S., Herrera F. A taxonomy and experimental study on prototype generation for nearest neighbor classification. IEEE Trans. Syst. Man Cybern.-Part C: Appl. Rev. 2012, 42(1):86-100.
20. Wettschereck D., Aha D.W., Mohri T. A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artif. Intell. Rev. 1997, 11:273-314.
21. Paredes R., Vidal E. Learning weighted metrics to minimize nearest-neighbor classification error. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(7):1100-1110.
22. Eiben A.E., Smith J.E. Introduction to Evolutionary Computing 2003, Springer-Verlag, Berlin.
23. Freitas A.A. Data Mining and Knowledge Discovery with Evolutionary Algorithms 2002, Springer-Verlag, Berlin.
24. Pappa G.L., Freitas A.A. Automating the Design of Data Mining Algorithms: An Evolutionary Computation Approach, Natural computing 2009, Springer.
25. Cano J.R., Herrera F., Lozano M. Using evolutionary algorithms as instance selection for data reduction in KDD: an experimental study. IEEE Trans. Evol. Comput. 2003, 7(6):561-575.
26. Krasnogor N., Smith J. A tutorial for competent memetic algorithms: model, taxonomy, and design issues. IEEE Trans. Evol. Comput. 2005, 9(5):474-488.
27. García S., Cano J.R., Herrera F. A memetic algorithm for evolutionary prototype selection: a scaling up approach. Pattern Recognition 2008, 41(8):2693-2709.
28. Fernández F., Isasi P. Evolutionary design of nearest prototype classifiers. J. Heuristics 2004, 10(4):431-454.
29. Cervantes A., Galván I.M., Isasi P. AMPSO: a new particle swarm method for nearest neighborhood classification. IEEE Trans. Syst. Man Cybern.-Part B: Cybern. 2009, 39(5):1082-1091.
30. Nanni L., Lumini A. Particle swarm optimization for prototype reduction. Neurocomputing 2008, 72(4-6):1092-1097.
31. Storn R., Price K.V. Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 1997, 11(10):341-359.
32. Price K.V., Storn R.M., Lampinen J.A. Differential Evolution: A Practical Approach to Global Optimization, Natural Computing Series 2005.
33. Das S., Suganthan P. Differential evolution: a survey of the state-of-the-art. IEEE Trans. Evol. Comput. 2011, 15(1):4-31.
34. Triguero I., García S., Herrera F. Differential evolution for optimizing the positioning of prototypes in nearest neighbor classification. Pattern Recognition 2011, 44(4):901-916.
35. Fernández F., Isasi P. Local feature weighting in nearest prototype classification. IEEE Trans. Neural Networks 2008, 19(1):40-53.
36. Li J., Manry M.T., Yu C., Wilson D.R. Prototype classifier design with pruning. Int. J. Artif. Intell. Tools 2005, 14(1-2):261-280.
37. Triguero I., García S., Herrera F. IPADE: iterative prototype adjustment for nearest neighbor classification. IEEE Trans. Neural Networks 2010, 21(12):1984-1990.
38. I. Triguero, S. García, F. Herrera, Enhancing IPADE algorithm with a different individual codification, in: Proceedings of the 6th International Conference on Hybrid Artificial Intelligence Systems (HAIS), Lecture Notes in Artificial Intelligence, vol. 6679, 2011, pp. 262-270.
39. Cano J.R., Herrera F., Lozano M. Stratification for scaling up evolutionary prototype selection. Pattern Recognition Lett. 2005, 26(7):953-963.
40. I. Triguero, J. Derrac, S. García, F. Herrera, A study of the scaling up capabilities of stratified prototype generation, in: Proceedings of the Third World Congress on Nature and Biologically Inspired Computing (NABIC'11), 2011, pp. 304-309.
41. Neri F., Tirronen V. Scale factor local search in differential evolution. Memetic Comput. 2009, 1(2):153-171.
42. García S., Fernández A., Luengo J., Herrera F. Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf. Sci. 2010, 180:2044-2064.
43. Hart P.E. The condensed nearest neighbor rule. IEEE Trans. Inf. Theory 1968, 18:515-516.
44. Wilson D.L. Asymptotic properties of nearest neighbor rules using edited data. IEEE Trans. Syst. Man Cybern. 1972, 2(3):408-421.
45. Sánchez J.S., Barandela R., Marqués A.I., Alejo R., Badenas J. Analysis of new techniques to obtain quality training sets. Pattern Recognition Lett. 2003, 24(7):1015-1022.
46. Sánchez J.S. High training set size reduction by space partitioning and prototype abstraction. Pattern Recognition 2004, 37(7):1561-1564.
47. Aha D.W., Kibler D., Albert M.K. Instance-based learning algorithms. Mach. Learn. 1991, 6(1):37-66.
48. K. Kira, L.A. Rendell, A practical approach to feature selection, in: Proceedings of the Ninth International Conference on Machine Learning, Morgan Kaufmann, Aberdeen, Scotland, 1992, pp. 249-256.
49. Ye K., Feenstra K., Heringa J., Ijzerman A., Marchiori E. Multi-RELIEF: a method to recognize specificity determining residues from multiple sequence alignments using a machine learning approach for feature weighting. Bioinformatics 2008, 24(1):18-25.
50. I. Kononenko, Estimating attributes: analysis and extensions of RELIEF, in: Proceedings of the 1994 European Conference on Machine Learning, Springer Verlag, Catania, Italy, 1994, pp. 171-182.
51. Sikonja M.R., Kononenko I. Theoretical and empirical analysis of ReliefF and RReliefF. Mach. Learn. 2003, 53(1-2):23-69.
52. Tahir M.A., Bouridane A., Kurugollu F. Simultaneous feature selection and feature weighting using hybrid tabu search/k-nearest neighbor classifier. Pattern Recognition Lett. 2007, 28(4):438-446.
53. Gertheiss J., Tutz G. Feature selection and weighting by nearest neighbor ensembles. Chemometr. Intell. Lab. Syst. 2009, 99:30-38.
54. Qin A.K., Huang V.L., Suganthan P.N. Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans. Evol. Comput. 2009, 13(2):398-417.
55. Das S., Abraham A., Chakraborty U.K., Konar A. Differential evolution using a neighborhood-based mutation operator. IEEE Trans. Evol. Comput. 2009, 13(3):526-553.
56. Zhang J., Sanderson A.C. JADE: adaptive differential evolution with optional external archive. IEEE Trans. Evol. Comput. 2009, 13(5):945-958.
57. Alcalá-Fdez J., Fernandez A., Luengo J., Derrac J., García S., Sánchez L., Herrera F. KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J. Mult. 2011, 17(2-3):255-287.
58. Keller J.M., Gray M.R., Givens J.A. A fuzzy K-nearest neighbor algorithm. IEEE Trans. Syst. Man Cybern. 1985, 15(4):580-585.
59. Ahn H., Kim K. Bankruptcy prediction modeling with hybrid case-based reasoning and genetic algorithms approach. Appl. Soft Comput. 2009, 9:599-607.
60. Sheskin D.J. Handbook of Parametric and Nonparametric Statistical Procedures 2011, Chapman & Hall/CRC. 5th edition.
61. García-Osorio C., de Haro-García A., García-Pedrajas N. Democratic instance selection: a linear complexity instance selection algorithm based on classifier ensemble concepts. Artif. Intell. 2010, 174:410-441.
62. Cano J.R., Herrera F., Lozano M. Evolutionary stratified training set selection for extracting classification rules with trade off precision-interpretability. Data Knowl. Eng. 2007, 60:90-108.
63. García S., Fernández A., Herrera F. Enhancing the effectiveness and interpretability of decision tree and rule induction classifiers with evolutionary training set selection over imbalanced problems. Appl. Soft Comput. 2009, 9:1304-1314.
64. Nanni L., Lumini A. Prototype reduction techniques: a comparison among different approaches. Expert Syst. Appl. 2011, 38(9):11820-11828.