Improving sequential feature selection methods'performance by means of hybridization

Proceedings of the 6th IASTED International Conference on Advances in Computer Science and Engineering, ACSE 2010

Volumn , Issue , 2010, Pages 1-10

  Somol, Petr ^a   Novovičová, Jana ^a   Pudil, Pavel ^b  

^a INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

^b UNIVERSITY OF ECONOMICS   (Czech Republic)

Author keywords

Classification performance; Feature selection; Hybrid methods; Sequential search; Statistical pattern recognition; Subset search

Indexed keywords

FEATURE EXTRACTION;

CLASSIFICATION PERFORMANCE; HYBRID METHOD; SEQUENTIAL SEARCH; STATISTICAL PATTERN RECOGNITION; SUBSET SEARCHES;

CLASSIFICATION (OF INFORMATION);

EID: 84858821237     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.2316/p.2010.689-001     Document Type: Conference Paper

References (35)

1. H. Liu and L. Yu, Toward integrating feature selection algorithms for classification and clustering, IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 3, 491-502, 2005. (Pubitemid 40495592)
2. H. Liu and H. Motoda, Feature Selection for Knowledge Discovery and Data Mining. (Norwell, MA, USA: Kluwer Academic Publishers, 1998).
3. Special issue on variable and feature selection, Journal of Machine Learning Research. http://www.jmlr.org/papers/special/feature.html, 2003.
4. A. Salappa, M. Doumpos, and C. Zopounidis, Feature selection algorithms in classification problems: An experimental evaluation, Optimization Methods and Software, vol. 22, no. 1, 199-212, 2007. (Pubitemid 44878967)
5. L. Yu and H. Liu, Feature selection for highdimensional data: A fast correlation-based filter solution, in Proceedings of the 20th International Conference on Machine Learning, 2003, 56-63.
6. M. Dash, K. Choi, S. Pu, and H. Liu, Feature selection for clustering - a filter solution, in Proceedings of the Second International Conference on Data Mining, 2002, 115-122.
7. R. Kohavi and G. John, Wrappers for feature subset selection, Artificial Intelligence, vol. 97, 273-324, 1997. (Pubitemid 127401107)
8. S. Das, Filters, wrappers and a boosting-based hybrid for feature selection, in Proc. of the 18th International Conference on Machine Learning, 2001, 74-81.
9. M. Sebban and R. Nock, A hybrid filter/wrapper approach of feature selection using information theory, Pattern Recognition, vol. 35, 835-846, 2002. (Pubitemid 34128810)
10. P. Somol, J. Novovǐcov́a, and P. Pudil, Flexible-hybrid sequential floating search in statistical feature selection, in Structural, Syntactic, and Statistical Pattern Recognition, vol. LNCS 4109. Berlin/Heidelberg, Germany: Springer-Verlag, 2006, 632-639. (Pubitemid 44543154)
11. I. Guyon and A. Elisseeff, An introduction to variable and feature selection, J. Mach. Learn. Res., vol. 3, 1157- 1182, 2003.
12. Guyon, S. Gunn, M. Nikravesh, and L. Zadeh, Eds., Feature Extraction - Foundations and Applications, ser. Studies in Fuzziness and Soft Computing vol. 207. (Physica-Verlag, Springer, 2006).
13. I. Kononenko, Estimating attributes: Analysis and extensions of relief, in ECML-94: Proc. European Conf. on Machine Learning. Secaucus, NJ, USA: Springer-Verlag New York, Inc., 1994, 171-182.
14. P. Pudil, J. Novovǐcov́a, N. Choakjarernwanit, and J. Kittler, Feature selection based on approximation of class densities by finite mixtures of special type, Pattern Recognition, vol. 28, 1389-1398, 1995.
15. J. Novovǐcov́a, P. Pudil, and J. Kittler, Divergence based feature selection for multimodal class densities, IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 2, 218-223, 1996. (Pubitemid 126772809)
16. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach. (Englewood Cliffs, London, UK: Prentice Hall, 1982).
17. P. Somol, P. Pudil, and J. Kittler, Fast branch & bound algorithms for optimal feature selection, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 7, 900-912, 2004.
18. S. Nakariyakul and D. P. Casasent, Adaptive branch and bound algorithm for selecting optimal features, Pattern Recogn. Lett., vol. 28, no. 12, 1415-1427, 2007. (Pubitemid 46990579)
19. F. Hussein, R. Ward, and N. Kharma, Genetic algorithms for feature selection and weighting, a review and study, Proc. ICDAR, vol. 00, IEEE Comp. Soc., 1240-1244, 2001.
20. H. Zhang and G. Sun, Feature selection using tabu search method, Pattern Recognition, vol. 35, 701-711, 2002.
21. R. Jensen, Performing Feature Selection with ACO, ser. Studies in Computational Intelligence. Springer Berlin/Heidelberg, 2006, vol. 34, 45-73.
22. Y. Yang and J. O. Pedersen, A comparative study on feature selection in text categorization, in ICML'97: Proc. 14th Int. Conf. on Machine Learning. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 1997, 412-420.
23. F. Sebastiani, Machine learning in automated text categorization, ACM Computing Surveys, vol. 34, no. 1, 1-47, March 2002.
24. E. P. Xing, Feature Selection in Microarray Analysis. Springer, 2003, 110-129.
25. Y. Saeys, I. naki Inza, and P. L. naga, A review of feature selection techniques in bioinformatics, Bioinformatics, vol. 23, no. 19, 2507-2517, 2007. (Pubitemid 350048351)
26. R. Kohavi and G. H. John, Wrappers for feature subset selection, Artif. Intell., vol. 97, no. 1-2, 273-324, 1997. (Pubitemid 127401107)
27. A. W. Whitney, A direct method of nonparametric measurement selection, IEEE Trans. Comput., vol. 20, no. 9, 1100-1103, 1971.
28. P. Pudil, J. Novovǐcov́a, and J. Kittler, Floating search methods in feature selection, Pattern Recogn. Lett., vol. 15, no. 11, 1119-1125, 1994.
29. P. Somol, P. Pudil, J. Novovǐcov́a, and P. Pacĺik, Adaptive floating search methods in feature selection, Pattern Recogn. Lett., vol. 20, no. 11-13, 1157-1163, 1999. (Pubitemid 32261893)
30. S. Nakariyakul and D. P. Casasent, An improvement on floating search algorithms for feature subset selection, Pattern Recognition, vol. 42, no. 9, 1932-1940, 2009.
31. P. Somol and P. Pudil, Oscillating search algorithms for feature selection, in ICPR 2000, vol. 02. Los Alamitos, CA, USA: IEEE Computer Society, 2000, 406-409.
32. J. Novovǐcov́a, P. Somol, and P. Pudil, Oscillating feature subset search algorithm for text categorization, in Structural, Syntactic, and Statistical Pattern Recognition, vol. LNCS 4109. Berlin/Heidelberg, Germany: Springer-Verlag, 2006, 578-587. (Pubitemid 44850421)
33. A. Asuncion and D. Newman, UCI machine learning repository, http//www.ics.uci.edu/mlearn/mlrepository.html 2007.
34. Š. J. Raudys, Feature over-selection, in Structural, Syntactic, and Statistical Pattern Recognition, vol. LNCS 4109. Berlin/Heidelberg, Germany: Springer-Verlag, 2006, 622-631.
35. P. Somol, J. Novovǐcov́a, J. Grim, and P. Pudil, Dynamic oscillating search algorithms for feature selection, in ICPR 2008. Los Alamitos, CA, USA: IEEE Computer Society, 2008.