Feature selection for support vector machines with RBF kernel

Artificial Intelligence Review

Volumn 36, Issue 2, 2011, Pages 99-115

  Liu, Quanzhong ^a   Chen, Chihau ^b   Zhang, Yang ^a   Hu, Zhengguo ^a  

^a NORTHWEST A F UNIVERSITY   (China)

^b Department of Electrical and Computer Engineering   (United States)

Author keywords

Feature selection; Information gain; RBF kernel; Recursive Feature Elimination; SVM RFE

Indexed keywords

BLACK BOXES; FEATURE SELECTION ALGORITHM; INFORMATION GAIN; K-NN CLASSIFIER; LINEAR KERNEL; MACLAURIN SERIES; MAPPING FUNCTIONS; MICROARRAY DATA SETS; RANKING CRITERION; RBF KERNELS; RECURSIVE FEATURE ELIMINATION; SUPPORT VECTOR MACHINE RECURSIVE FEATURE ELIMINATIONS; SVM-RFE; WEIGHT VECTOR;

ALGORITHMS; DATA REDUCTION; RADIAL BASIS FUNCTION NETWORKS; SUPPORT VECTOR MACHINES; VECTORS;

FEATURE EXTRACTION;

EID: 80051522580     PISSN: 02692821     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10462-011-9205-2     Document Type: Article

References (40)

1. A Albrecht 2006 Stochastic local search for the feature set problem, with applications to microarray data Appl Math Comput 183 2 1148 1164 1110.68370 10.1016/j.amc.2006.05.128 (Pubitemid 46014662)
2. S Ando H Iba 2004 Classification of gene expression profile using combinatory method of evolutionary computation and machine learning Genet Program Evol Mach 5 1573 7632 10.1023/B:GENP.0000023685.83861.69 (Pubitemid 38497846)
3. G Bontempi 2007 A blocking strategy to improve gene selection for classification of gene expression data IEEE/ACM Trans Comput Biology Bioinform 4 293 300 10.1109/TCBB.2007.1014 (Pubitemid 46733332)
4. Brank J, Grobelnik M, Milic-Frayling N, Mladenic D (2002) Feature selection using linear support vector machines. Technical Report, MSR-TR-2002-63, Microsoft Research, Microsoft Corporation
5. C Burges 1998 A tutorial on support vector machines for pattern recognition Data Mining Knowl Discovery 2 121 167 10.1023/A:1009715923555 (Pubitemid 128126769)
6. G Claeskens C Croux J Kerckhoven 2008 An information criterion for variable selection in support vector machines J Mach Learn Res 9 541 558 (Pubitemid 351469011)
7. Cristianini N, Taylor J (2000) An introduction to support vector machines. Cambridge University Press, Cambridge
8. Deng L, Pei J, Ma J, Lee D (2004) A rank sum test method for informative gene discovery. In: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, pp 410-419 (Pubitemid 40114951)
9. C Ding H Peng 2005 Minimum redundancy feature selection from microarray gene expression data J Bioinform Comput Biology 3 2 185 205 10.1142/ S0219720005001004 (Pubitemid 40561382)
10. Ding Y, Wilkins D(2006)Improving the performance of SVM-RFE to select genes in microarray data. BMC Bioinform 7 (Suppl 2):S12. doi: 10.1186/1471-2105-7-S2-S12 (Pubitemid 46442967)
11. M Draminski A Rada-Iglesias S Enroth C Wadelius J Koronacki J Komorowski 2008 Monte Carlo feature selection for supervised classification Bioinformatics 24 1 110 117 10.1093/bioinformatics/btm486
12. Duan K, Rajapakse J (2004a) SVM-RFE peak selection for cancer classification with mass spectrometry data. In: Proceedings of the 3rd Asia-pacific bioinformatics conference, pp 191-200
13. Duan K, Rajapakse J (2004b) A variant of SVM-RFE for gene selection in cancer classification with expression data. In: Proceedings of IEEE symposium computational intelligence in bioinformatics and computational biology, pp 49-55 (Pubitemid 40497982)
14. K Duan J Rajapakse H Wang F Azuaje 2005 Multiple SVM-RFE for gene selection in cancer classification with expression data IEEE Trans Nanobiosci 4 3 228 234 10.1109/TNB.2005.853657 (Pubitemid 41441412)
15. M Elalami 2009 A filter model for feature subset selection based on genetic algorithm Knowledge-Based Syst 22 356 362 10.1016/j.knosys.2009.02.006
16. P Estevez M Tesmer C Perez J Zurada 2009 Normalized mutual information feature selection IEEE Trans Neural Netw 20 189 201 10.1109/TNN.2008.2005601
17. Fayyad U, Irani K (1993) Multi-interval discretization of continuous-valued attributes for classification learning. In: Proceedings of the 13th international joint conference on artificial intelligence, pp 1022-1027
18. T Golub, et al. 1999 Molecular classification of cancer: class discovery and class prediction by gene expression monitoring Science 286 531 537 10.1126/science.286.5439.531
19. W Guyon V Barnhill 2002 Gene selection for cancer classification using support vector machines Mach Learn 46 389 422 0998.68111 10.1023/A:1012487302797 (Pubitemid 34129977)
20. I Guyon A Elisseeff 2003 An introduction to variable and feature selection J Mach Learn Res 3 1157 1182 1102.68556 10.1162/153244303322753616
21. S Ho C Hsieh H Chen H Huang 2006 Interpretable gene expression classifier with an accurate and compact fuzzy rule base for microarray data analysis BioSystems 85 165 176 10.1016/j.biosystems.2006.01.002 (Pubitemid 44209361)
22. J Huang Y Cai X Xu 2007 A hybrid genetic algorithm for feature selection wrapper based on mutual information Pattern Recogn Lett 28 1825 1844 10.1016/j.patrec.2007.05.011 (Pubitemid 47058633)
23. R Kohavi G John 1997 Wrappers for feature subset selection Artif Intell 97 1-2 273 324 0904.68143 10.1016/S0004-3702(97)00043-X (Pubitemid 127401107)
24. Y LeCun J Denker S Solla 1990 Optimal brain damage Adv Neural Inform Process Syst II 598 605
25. C Lee G Lee 2006 Information gain and divergence-based feature selection for machine learning-based text categorization Inform Process Manage 42 1 155 165 10.1016/j.ipm.2004.08.006 (Pubitemid 41119082)
26. F Li Y Yang 2005 Analysis of recursive gene selection approaches from microarray data Bioinformatics 21 19 3741 3747 10.1093/bioinformatics/bti618 (Pubitemid 41535522)
27. Liu Q, Zhang Y, Hu Z (2007) Extracting positive and negative association classification rules from RBF kernel. In: 2007 International conference on convergence information technology. IEEE Computer Society, pp 1285-1291
28. S Niijima S Kuhara 2006 Gene subset selection in kernel-induced feature space Pattern Recogn Lett 27 1884 1892 10.1016/j.patrec.2006.04.017 (Pubitemid 44556804)
29. C Schoch A Kohlmann S Schnittger, et al. 2002 Acute myeloid leukemias with reciprocal rearrangements can be distinguished by specific gene expression profiles Proc Nat Acad Sci USA 99 15 10008 10013 10.1073/pnas.142103599 (Pubitemid 34831163)
30. M Shipp K Ross P Tamayo, et al. 2002 Diffuse large B-Cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning Nature Med 8 1 68 74 10.1038/nm0102-68 (Pubitemid 34101731)
31. P Silva R Hashimoto S Kim, et al. 2005 Feature selection algorithms to find strong genes Pattern Recogn Lett 26 1444 1453 10.1016/j.patrec.2004.11.017 (Pubitemid 40744185)
32. D Singh P Febbo, et al. 2002 Gene expression correlates of clinical prostate cancer behavior Cancer Cell 1 203 209 10.1016/S1535-6108(02)00030-2 (Pubitemid 41039166)
33. Sun Y (2007) Iterative RELIEF for feature weighting: algorithms, theories, and applications. In: IEEE transactions on pattern analysis and machine intelligence, vol. 29(6):1035-1051 (Pubitemid 46667414)
34. Y Tang Y Zhang Z Huang 2007 Development of two-stage SVM-RFE gene selection strategy for microarray expression data analysis IEEE/ACM Trans Comput Biol Bioinform 4 3 365 381 10.1109/TCBB.2007.70224 (Pubitemid 47274713)
35. Tong D, Phalp K, Schierz A, Mintram R (2009) Innovative hybridisation of genetic algorithms and neural networks in detecting marker genes for leukaemia cancer. In: 4th IAPR international conference on pattern recognition in bioinformatics, Sheffield, 7-9 September 2009
36. Vapnik V (1998) Statistical learning theory. Wiley, New York
37. Wang Z, Palade V, Xu Y (2006) Neuro-fuzzy ensemble approach for microarray cancer gene expression data analysis. In: Proceedings of the second international symposium on evolving fuzzy system (EFS'06), IEEE Computational Intelligence Society 2006, pp 241-246 (Pubitemid 46948116)
38. E Youn M Jeong 2009 Class dependent feature scaling method using naive Bayes classifier for text data mining Pattern Recogn Lett 30 477 485 10.1016/j.patrec.2008.11.013
39. C Zhang X Lu X Zhang 2006 Significance of gene ranking for classification of microarray samples IEEE/ACM Trans Comput Biology Bioinform 3 3 312 320 10.1109/TCBB.2006.42 (Pubitemid 44249902)
40. Zhang H, Song X, Wang H, Zhang X (2009) MIClique: an algorithm to identify differentially coexpressed disease gene subset from microarray data. J Biomed Biotechnol 2009. Article No.: 42524, doi: 10.1155/2009/642524