A methodology for improving the performance of non-ranker feature selection filters

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 21, Issue 5, 2007, Pages 809-830

  Rokach, Lior ^a   Chizi, Barak ^b   Maimon, Oded ^b  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^b TEL AVIV UNIVERSITY   (Israel)

Author keywords

Ensemble methodology; Feature selection; Pattern classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL EFFICIENCY; DATA REDUCTION; LEARNING ALGORITHMS;

CLASSIFICATION PERFORMANCE; DATASETS; ENSEMBLE METHODOLOGY;

FEATURE EXTRACTION;

EID: 34547761741     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001407005727     Document Type: Article

References (35)

1. D. Aha and D. Kibler, Instance-based learning algorithms, Mach. Learn. 6 (1991) 37-66.
2. P. Bartlett and J. Shawe-Taylor, Generalization performance of support vector machines and other pattern classifiers, Advances in Kernel Methods, Support Vector Learning, eds. B. Scholkopf, C. J. C. Burges and A. J. Smola (MIT Press, Cambridge, USA, 1998), pp. 43-54.
3. P. Buhlmann and B. Yu, Boosting with $L.28 loss: regression and classification, J. Amer. Statist. Assoc. 98 (2003) 324-338.
4. S. le Cessie and J. C. van Houwelingen, Ridge estimators in logistic regression, Appl. Stat. 41(1) (1992) 191-201.
5. B. Chizi, O. Maimon and A. Smilovici, On dimensionality reduction of high-dimensional data sets, Frontiers in Artificial Intelligence and Applications (IOS press, 2002), pp. 230-236.
6. P. Cunningham and J. Carney, Diversity versus quality in classification ensembles based on feature selection, Proc. ECML 2000, 11th European Conf. Machine Learning, Barcelona, Spain, eds. R. L. de Mántaras and E. Plaza, Lecture Notes in Computer Science, Vol. 1810 (Springer), 2000, pp. 109-116.
7. P. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach (Prentice Hall International, 1982).
8. E. Dimitriadou, A. Weingessel and K. Hornik, A cluster ensembles framework, Design and Application of Hybrid Intelligent Systems (IOS Press, Amsterdam, The Netherlands, 2003).
9. R. Duda and P. Hart, Pattern Classification and Scene Analysis (Wiley, New York, 1973).
10. I. Guyon, S. Gunn, A. Ben-Hur and G. Dror, Design and analysis of the NIPS 2003 variable selection challenge, Feature Extraction: Foundation and Applications (Physcia-Verlag, Springer, 2006).
11. M. Hall, Correlation - based feature selection for machine learning, University of Waikato (1999).
12. T. K. Ho, The random subspace method for constructing decision forests, IEEE Trans. Patt. Anal. Mach. Intell. 20(8) (1998) 832-844.
13. R. C. Holte, Very simple classification rules perform well on most commonly used datasets, Mach. Learn. 11 (1993) 63-91.
14. X. Hu, Using rough sets theory and database operations to construct a good ensemble of classifiers for data mining applications, ICDM01 (2001), pp. 233-240.
15. G. V. Kass, An exploratory technique for investigating large quantities of categorical data, Appl. Stat. 29(2) (1980) 119-127.
16. J. Kittler, Feature set search algorithms, Pattern Recognition and Signal Processing, ed. C. H. Chen, Sijthoff and Noordhoff (Alphen ann den Rijn, The Netherlands, 1978), pp. 41-60.
17. R. Kohavi and G. John, Wrappers for feature subset selection, Artif. Intel. 97(1-2) (1996) 273-324.
18. P. Langley and S. Sage, Scaling to domains with irrelevant features, Computational Learning Theory and Natural Learning Systems, ed. R. Greiner, Vol. 4 (MIT Press, 1994).
19. H. Liu, and R. Setiono, A probabilistic approach to feature selection (Morgan Kaufmann, 1996), pp. 319-327.
20. F. Masulli and S. Rovetta, Random Voronoi ensembles for gene selection in DNA microarray data, Bioinformatics using Computational Intelligence Paradigms, eds. U. Seiffert and L. C. Jain (World Scientific, Singapore, 2003).
21. A. Miller, Subset Selection in Regression (Chapman and Hall, NY, 1990).
22. L. S. Oliveira, R. Sabourin, F. Bortolozzi and C. Y. Suen, A methodology for feature selection using multi-objective genetic algorithms for handwritten digit string recognition, Int. J. Patt. Recogn. Artif. Intell. 17(6) (2003) 903-930.
23. L. S. Oliveira, M. E. Morita, R. Sabourin and F. Bortolozzi, Multi-objective genetic algorithms to create ensemble of classifiers, Proc. Third Int. Conf. Evolutionary Multi-Criterion Optimization (EMO 2005), Guanajuato, Mexico, March 9-11, 2005, Lecture Notes in Computer Science, Vol. 3410 (Springer, 2005), pp. 592-606.
24. P. V. W. Radtke, R. Sabourin and T. Wong, Intelligent feature extraction for ensemble of classifiers, 8th Int. Conf. Document Analysis and Recognition (ICDAR. 2005), Seoul, South Korea, August 29-September 1st, 2006, pp. 866-870.
25. D. Opitz, Feature selection for ensembles, Proc. 16th Nat. Conf. Artificial Intelligence, AAAI (1999), pp. 379-384.
26. J. Pearl, Heuristics: Intelligent Search Strategies for Computer Problem Solving (Addison-Wesley, 1984), p. 48.
27. J. Quinlan, Simplifying decision trees, Int. J. Man-Machine Studies 27 (1987) 221-234.
28. J. Quinlan, C4-5: Programs for Machine Learning (Morgan Kaufmann, Los Altos, 1993).
29. J. Quinlan, Induction of decision trees, Mach. Learn. 1 (1996) 81-106.
30. K. Torkkola and E. Tuv, Variable selection using ensemble methods, IEEE Intell. Syst. 20(6) (2005) 68-70.
31. A. Tsymbal, S. Puuronen and D. Petterson, Ensemble feature selection with the simple Bayesian classification, Information Fusion 4(2) (2003) 87-100.
32. K. Turner and J. Ghosh, Error correlation and error reduction in ensemble classifiers, Connect. Sci. 8(3-4) (1999) 385-404.
33. E. Tuv and K. Torkkola, Feature filtering with ensembles using artificial contrasts, Proc. SIAM 2005 Int. Workshop on Feature Selection for Data Mining (Newport Beach, CA, April 23, 2005), pp. 69-71.
34. I. H. Witten and E. Frank, Data mining: practical machine learning tools and techniques, 2nd edn. (Morgan Kaufmann, San Francisco, 2005).
35. J. Yang and V. Honavar, Feature subset selection using a genetic algorithm, IEEE Intell. Syst. (Special Issue on Feature Transformation and Subset Selection) 13(2) (1998) 44-49.