Feature selection for high-dimensional class-imbalanced data sets using Support Vector Machines

Information Sciences

Volumn 286, Issue , 2014, Pages 228-246

  Maldonado, Sebastián ^a   Weber, Richard ^b   Famili, Fazel ^c  

^a UNIVERSIDAD DE LOS ANDES   (Chile)

^b UNIVERSITY OF CHILE   (Chile)

^c NATIONAL RESEARCH COUNCIL CANADA   (Canada)

Author keywords

Data mining; Dimensionality reduction; Feature selection; Imbalanced data set; Support Vector Machine

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA MINING; FEATURE EXTRACTION; SUPPORT VECTOR MACHINES;

BACKWARD ELIMINATION; BALANCED LOSS FUNCTION; BINARY CLASSIFICATION; DIMENSIONALITY REDUCTION; FEATURE SELECTION AND CLASSIFICATION; IMBALANCED DATA-SETS; MICROARRAY DATA SETS; SELECTION TECHNIQUES;

CLASSIFICATION (OF INFORMATION);

EID: 84906691312     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.07.015     Document Type: Article

References (44)

1. M. Alibeigi, S. Hashemi, and A. Hamzeh DBFS: an effective density based feature selection scheme for small sample size and high dimensional imbalanced data sets Data Knowl. Eng. 2012 67 103
2. K. Balasubramanian, B.K. Sriperumbudur, G. Lebanon, Ultrahigh dimensional feature screening via RKHS embeddings, in: Proceedings of the Sixteenth International Conference on Artificial Intelligence and Statistics, 2013.
3. D.G. Beer, S.L. Kardia, C.C. Huang, T.J. Giordano, A.M. Levin, D.E. Misek, L. Lin, G. Chen, T.G. Gharib, D.G. Thomas, M.L. Lizyness, R. Kuick, S. Hayasaka, J.M.G. Taylor, M.D. Iannettoni, M.B. Orringer, and S. Hanash Gene-expression profiles predict survival of patients with lung adenocarcinoma Nat. Med. 8 2002 816 824
4. A. Bhattacharjee, W.G. Richards, J. Staunton, C. Li, S. Monti, P. Vasa, C. Ladd, J. Beheshti, R. Bueno, M. Gillette, M. Loda, G. Weber, E.J. Mark, E.S. Lander, W. Wong, B.E. Johnson, T.R. Golub, D.J. Sugarbaker, and M. Meyerson Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses Proc. Nat. Acad. Sci. USA 98 2001 13790 13795
5. R. Blagus, and L. Lusa Class prediction for high-dimensional class-imbalanced data BMC Bioinform. 2010 2010 (11:523)
6. P. Bradley, O. Mangasarian, Feature selection vía concave minimization and support vector machines, in: Machine Learning Proceedings of the Fifteenth International Conference (ICML'98), Morgan Kaufmann, 1998, pp. 82-90.
7. L. Bullinger, K. Dohner, S. Frohling, E. Bair, R.F. Schlenk, R. Tibshirani, H. Dohner, and J.R. Pollack Use of gene-expression profiling to identify prognostic subclasses in adult acute myeloid leukemia New England J. Med. 350 16 2004 1605 1616
8. N.V. Chawla, N. Japkowicz, and A. Kotcz Editorial: special issue on learning from imbalanced data sets SIGKDD Explor. 6 1 2004 1 6
9. N.V. Chawla, L.O. Hall, K.W. Bowyer, and W.P. Kegelmeyer SMOTE: synthetic minority oversampling technique J. Artif. Intell. Res. 16 2002 321 357
10. X. Chen, M. Wasikowski, FAST: a roc-based feature selection metric for small samples and imbalanced data classification problems, in: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2008), 2009, pp. 124-132.
11. S. Chowdhury, J.K. Sing, D.K. Basu, and M. Nasipuri Face recognition by generalized two-dimensional FLD method and multi-class support vector machines Appl. Soft Comput. 11 7 2011 4282 4292
12. J. Fan, R. Samworth, and Y. Wu Ultrahigh dimensional feature selection: beyond the linear model J. Mach. Learn. Res. 10 2009 2013 2038
13. A. Fernández, M.J. del Jesus, and F. Herrera On the 2-tuples based genetic tuning performance for fuzzy rule based classification systems in imbalanced data-sets Inf. Sci. 180 8 2010 1268 1291
14. I. Guyon, S. Gunn, M. Nikravesh, and L.A. Zadeh Feature Extraction, Foundations and Applications 2006 Springer Berlin
15. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik Gene selection for cancer classification using support vector machines Mach. Learn. 46 1-3 2002 389 422
16. H. He, and E. García Learning from imbalanced data IEEE Trans. Knowl. Data Eng. 21 9 2009 1263 1284
17. A.R. Hidalgo-Munoz, M.M. López, I.M. Santos, A.T. Pereira, M. Vázquez-Marrufo, A. Galvao-Carmona, and A.M. Tomé Application of SVM-RFE on EEG signals for detecting the most relevant scalp regions linked to affective valence processing Expert Syst. Appl. 40 6 2013 2102 2108
18. J. Khan, J.S. Wei, M. Ringner, L.H. Saal, M. Ladanyi, F. Westermann, F. Berthold, M. Schwab, C.R. Antonescu, C. Peterson, and P.S. Meltzer Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks Nat. Med. 7 2001 673 679
19. D.A. Kumar, and V. Ravi Predicting credit card customer churn in banks using data mining Int. J. Data Anal. Techn. Strategies 1 1 2008 4 28
20. S. Maldonado, and R. Weber A wrapper method for feature selection using Support Vector Machines Inf. Sci. 179 13 2009 2208 2217
21. S. Maldonado, R. Weber, and J. Basak Kernel-penalized SVM for feature selection Inf. Sci. 181 1 2011 115 128
22. C.L. Nutt, D.R. Mani, R.A. Betensky, P. Tamayo, J.G. Cairncross, C. Ladd, U. Pohl, C. Hartmann, M.E. McLaughlin, T.T. Batchelor, P.M. Black, A. von Deimling, S.L. Pomeroy, T.R. Golub, and D.N. Louis Gene expression-based classification of malignant gliomas correlates better with survival than histological classification Cancer Res. 63 2003 1602 1607
23. C.H. Papadimitriou Computational Complexity 1994 Addison Wesley (Reading)
24. B.-J. Park, S.-K. Ohb, and W. Pedrycz The design of polynomial function-based neural network predictors for detection of software defects Inf. Sci. 229 2013 40 57
25. R.C. Prati, G.E.A.P.A. Batista, and M.C. Monard Class Imbalances versus class overlapping: an analysis of a learning system behavior MICAI 2004: Advances in Artificial Intelligence, Lecture Notes in Computer Science vol. 2972 2004 Springer Berlin Heidelberg 312 321
26. Y. Qu, H. Su, L. Guo, and J. Chu A novel SVM modeling approach for highly imbalanced and overlapping classification Intell. Data Anal. 15 2011 319 341
27. A. Rakotomamonjy Variable selection using SVM-based criteria J. Mach. Learn. Res. 3 2003 1357 1370
28. G. Rätsch, T. Onoda, and K.-R. Müller Soft margins for AdaBoost Mach. Learn. 42 3 2001 287 320
29. A.A. Shanab, T.M. Khoshgoftaar, R. Wald, J.V. Hulse, Comparison of approaches to alleviate problems with high-dimensional and class-imbalanced data, in: 2011 IEEE International Conference on Information Reuse and Integration (IRI), 2011, pp. 234-239.
30. M. Sokolova, N. Japkowicz, and S. Szpakowicz Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation Advances in Artificial Intelligence vol. 4304 2006 Springer Berlin Heidelberg 1015 1021
31. L. Song, A. Smola, A. Gretton, J. Bedo, and K. Borgwardt Feature selection via dependence maximization J. Mach. Learn. Res. 13 2012 1393 1434
32. A.I. Su, J.B. Welsh, L.M. Sapinoso, S.G. Kern, P. Dimitrov, H. Lapp, P.G. Schultz, S.M. Powell, C.A. Moskaluk, H.F. Jr. Frierson, and G.M. Hampton Molecular classification of human carcinomas by use of gene expression signatures Cancer Res. 61 2001 7388 7393
33. Y. Sun, M.S. Kamel, A.K.C. Wong, and Y. Wang Cost-sensitive boosting for classification of imbalanced data Pattern Recogn. 40 12 2007 3358 3378
34. D.M.J. Tax, and R. Duin Support vector data description Mach. Learn. 54 2004 45 66
35. J. Van Hulse, T.M. Khoshgoftaar, A. Napolitano, R. Wald, Feature selection with high-dimensional imbalanced data, in: Proceedings of the 2009 IEEE International Conference ICDMW '09, 2009, pp. 507-514.
36. V. Vapnik Statistical Learning Theory 1998 John Wiley and Sons New York
37. P. Villar, A. Fernández, R.A. Carrasco, and F. Herrera Feature selection and granularity learning in genetic fuzzy rule-based classification systems for highly imbalanced data-sets International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 20 3 2012 369 397
38. G. Victo Sudha George, and V. Cyril Raj Review on feature selection techniques and the impact of SVM for cancer classification using gene expression profile Int. J. Comput. Sci. Eng. Surv. 2 3 2011 16 27
39. S. Wang, D. Li, X. Song, Y. Wei, and H. Li A feature selection method based on improved fisher's discriminant ratio for text sentiment classification Expert Syst. Appl. 38 7 2011 8696 8702
40. M. Wasikowski, and X. Chen Combating the small sample class imbalance problem using feature selection IEEE Trans. Knowl. Data Eng. 22 10 2010 1388 1400
41. J. Weston, A. Elisseeff, B. Schölkopf, and M. Tipping The use of zero-norm with linear models and kernel methods J. Mach. Learn. Res. 3 2003 1439 1461
42. K. Yang, Z. Cai, J. Li, and G. Lin A stable gene selection in microarray data analysis BMC Bioinform. 7 2006 228
43. Z. Zheng, X. Wu, and R. Srihari Feature selection for text categorization on imbalanced data SIGKDD Explor. 6 1 2004 80 89
44. Y. Zhu, X. Shen, and W. Pan Simultaneous grouping pursuit and feature selection over an undirected graph J. Am. Stat. Assoc. 108 502 2013 713 725 Tecnológico