OligoIS: Scalable instance selection for class-imbalanced data sets

IEEE Transactions on Cybernetics

Volumn 43, Issue 1, 2013, Pages 332-346

  García Pedrajas, Nicolás ^a   Peŕez Rodríguez, Javier ^a   De Haro Garciá, Aida ^a  

^a UNIVERSITY OF CÓRDOBA   (Spain)

Author keywords

Class imbalance problem; Instance selection; Instance based learning; Very large problems

Indexed keywords

AMOUNT OF INFORMATION; CLASS-IMBALANCE PROBLEM; DIVIDE-AND-CONQUER PRINCIPLE; INSTANCE BASED LEARNING; INSTANCE SELECTION; LARGE PROBLEMS; PARALLEL ENVIRONMENT; VERY LARGE DATUM;

ALGORITHMS; BIOINFORMATICS; DATA MINING; INTRUSION DETECTION; RESEARCH;

LOADING;

EID: 84885429252     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2206381     Document Type: Article

References (32)

1. H. He and E. A. Garcia, "Learning from imbalanced data," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263-1284, Sep. 2009.
2. N. V. Chawla, W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic minority over-sampling technique," J. Artif. Intell. Res., vol. 16, no. 1, pp. 321-357, Jan. 2002.
3. C. Ling and G. Li, "Data mining for direct marketing problems and solutions," in Proc. 4th Int. Conf. KDD, New York, 1998, pp. 73-79.
4. G. M. Weiss and F. Provost, "The effect of class distribution on classifier learning: An empirical study," Dept. Comput. Sci., Rutgers Univ., Newark, NJ, Tech. Rep. TR-43, 2001.
5. A. Estabrooks, T. Jo, and N. Japkowicz, "A multiple resampling method for learning from imbalanced data sets," Comput. Intell., vol. 20, no. 1, pp. 18-36, Feb. 2004.
6. M. Kubat and S. Matwin, "Addressing the curse of imbalanced training sets: One-sided selection," in Proc. 14th Int. Conf. Mach. Learn., 1997, pp. 179-186.
7. S. García, J. Derrac, I. Triguero, C. J. Carmona, and F. Herrera, "Evolutionary-based selection of generalized instances for imbalanced classification," Knowl.-Based Syst., vol. 25, no. 1, pp. 3-12, Feb. 2012.
8. N. García-Pedrajas, J. A. Romero del Castillo, and D. Ortiz-Boyer, "A cooperative coevolutionary algorithm for instance selection for instance-based learning," Mach. Learn., vol. 78, no. 3, pp. 381-420, Mar. 2010.
9. S. García and F. Herrera, "Evolutionary undersampling for classification with imbalanced datasets: Proposals and taxonomy," Evol. Comput., vol. 17, no. 3, pp. 275-306, Fall 2009.
10. L. Kuncheva and C. J. Whitaker, "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy," Mach. Learn., vol. 51, no. 2, pp. 181-207, May 2003.
11. N. García-Pedrajas, C. García-Osorio, and C. Fyfe, "Nonlinear boosting projections for ensemble construction," J. Mach. Learn. Res., vol. 8, pp. 1-33, May 2007.
12. R. Barandela, J. L. Sánchez, V. García, and E. Rangel, "Strategies for learning in class imbalance problems," Pattern Recognit., vol. 36, no. 3, pp. 849-851, Mar. 2003.
13. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, Mar. 2003.
14. A. Frank and A. Asuncion, UCI Machine Learning Repository, 2010.
15. N. García-Pedrajas, "Constructing ensembles of classifiers by means of weighted instance selection," IEEE Trans. Neural Netw., vol. 20, no. 2, pp. 258-277, Feb. 2009.
16. D. R. Wilson and T. R. Martinez, "Reduction techniques for instance-based learning algorithms," Mach. Learn., vol. 38, no. 3, pp. 257-286, Mar. 2000.
17. D. L. Wilson, "Asymptotic properties of nearest neighbor rules using edited data," IEEE Trans. Syst., Man, Cybern., vol. SMC-2, no. 3, pp. 408-421, Jul. 1972.
18. H. Brighton and C. Mellish, "Advances in instance selection for instance-based learning algorithms," Data Mining Knowl. Discov., vol. 6, no. 2, pp. 153-172, Apr. 2002.
19. L. Kuncheva, "Editing for the k-nearest neighbors rule by a genetic algorithm," Pattern Recognit. Lett., vol. 16, no. 8, pp. 809-814, Aug. 1995.
20. H. Ishibuchi and T. Nakashima, "Pattern and feature selection by genetic algorithms in nearest neighbor classification," J. Adv. Comput. Intell. Intell. Inf., vol. 4, no. 2, pp. 138-145, 2000.
21. C. R. Reeves and D. R. Bush, "Using genetic algorithms for training data selection in RBF networks," in Instances Selection and Construction for Data Mining, H. Liu and H. Motoda, Eds. Norwell, MA: Kluwer, 2001, pp. 339-356.
22. J. R. Cano, F. Herrera, and M. Lozano, "Using evolutionary algorithms as instance selection for data reduction in KDD: An experimental study," IEEE Trans. Evol. Comput., vol. 7, no. 6, pp. 561-575, Dec. 2003.
23. S. García, A. Fernández, and F. Herrera, "Enhancing the effectiveness and interpretability of decision tree and rule induction classifiers with evolutionary training set selection over imbalanced problems," Appl. Soft Comput., vol. 9, no. 4, pp. 1304-1314, Sep. 2009.
24. P. E. Hart, "The condensed nearest neighbor rule," IEEE Trans. Inf. Theory, vol. IT-14, no. 3, pp. 515-516, May 1968.
25. I. Tomek, "Two modifications of CNN," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. SMCB-6, no. 11, pp. 769-772, Nov. 1976.
26. G. E. A. P. A. Batista, R. C. Prati, and M. C. Monard, "A study of the behavior of several methods for balancing machine learning training data," SIGKDD Explor. Newslett., vol. 6, no. 1, pp. 20-29, Jun. 2004.
27. R. Barandela, F. J. Ferri, and J. S. Sánchez, "Decision boundary preserving prototype selection for nearest neighbor classification," Int. J. Pattern Recognit. Artif. Intell., vol. 19, no. 6, pp. 787-806, Sep. 2005.
28. G. L. Ritter, H. B. Woodruff, S. R. Lowry, and T. L. Isenhour, "An algorithm for selective nearest neighbor decision rule," IEEE Trans. Inf. Theory, vol. IT-21, no. 6, pp. 665-669, Nov. 1975.
29. J. Demšar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, Dec. 2006.
30. J. Maudes-Raedo, J. J. Rodríguez-Díez, and C. García-Osorio, "Disturbing neighbors diversity for decision forest," in Proc. Workshop SUEMA, G. Valentini and O. Okun, Eds., Patras, Grecia, Jul. 2008, pp. 67-71.
31. J. R. Quinlan, C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.
32. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1999.