The problem of fragile feature subset preference in feature selection methods and a proposal of algorithmic workaround

Proceedings - International Conference on Pattern Recognition

Volumn , Issue , 2010, Pages 4396-4399

  Somol, P ^a   Grim, J ^a   Pudil, P ^b  

^a INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

^b UNIVERSITY OF ECONOMICS   (Czech Republic)

Author keywords

Classification; Feature acquisition cost; Feature selection; Feature weights; Machine learning; Over fitting; Weighted features

Indexed keywords

CLASSIFICATION; FEATURE ACQUISITION; FEATURE SELECTION; FEATURE WEIGHT; MACHINE-LEARNING; OVERFITTING; WEIGHTED FEATURES;

LEARNING SYSTEMS; MERGERS AND ACQUISITIONS; SET THEORY;

FEATURE EXTRACTION;

EID: 78149482663     PISSN: 10514651     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPR.2010.1068     Document Type: Conference Paper

References (15)

1. A. Asuncion and D. Newman. UCI mach. learn. repository, http://archive.ics.uci.edu/ml/, 2007.
2. C.-C. Chang and C.-J. Lin. LIBSVM: a library for SVM, http://www.csie.ntu.edu.tw/cjlin/libsvm, 2001.
3. P. A. Devijver and J. Kittler. Pattern Recognition: A Statistical Approach. Prentice Hall, 1982.
4. F. W. Glover and G. A. Kochenberger, editors. Handbook of Metaheuristics, volume 57 of Int. Ser. in Operat. Research & Management Science. Springer, 2003.
5. I. Guyon and A. Elisseeff. An introduction to variable and feat. sel. J. Mach. Learn. Res., 3:1157-1182, 2003.
6. F. Hussein, R. Ward, and N. Kharma. Genetic algorithms for feature selection and weighting, a review and study. icdar, 00:1240, 2001.
7. A. Kalousis, J. Prados, and M. Hilario. Stability of feature selection algorithms. Knowledge and Information Systems, 12(1):95-116, 2007.
8. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artif. Intell., 97(1-2):273-324, 1997. (Pubitemid 127401107)
9. P. Pudil, J. Novovičová, and J. Kittler. Floating search methods in feature selection. Pattern Recognition Letters, 15(11):1119-1125, 1994.
10. Š. J. Raudys. Feature over-selection. In Proc. S+SSPR, LNCS 4109, pages 622-631. Springer-Verlag, 2006.
11. J. Reunanen. A pitfall in determining the optimal feature subset size. In Proc. 4th Int. Workshop PRIS, pages 176-185, Porto, Portugal, 2004.
12. J. Reunanen. Less biased measurement of feature selection benefits. In SLSFS 2005, Revised Selected Papers, volume LNCS 3940, pages 198-208. Springer, 2006.
13. F. Sebastiani. Machine learning in automated text categorization. ACM Computing Surveys, 34(1):1-47, March 2002.
14. P. Somol, J. Novovičová, J. Grim, and P. Pudil. Dynamic oscillating search algorithms for feature selection. In Proc. ICPR. IEEE Computer Society, 2008.
15. M. A. Tahir, A. Bouridane and F. Kurugollu. Simultaneous FS and feature weighting using hybrid tabu search/k-nearest neighbor classifier. Patt. Rec. Lett., 28(4):438-446, 2007.