An evaluation of classifier-specific filter measure performance for feature selection

Pattern Recognition

Volumn 48, Issue 5, 2015, Pages 1812-1826

  Freeman, Cecille ^a   Kulić, Dana ^a   Basir, Otman ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Classification; Feature selection; Filter measures

Indexed keywords

FEATURE EXTRACTION; MOTION COMPENSATION; NEAREST NEIGHBOR SEARCH; SUPPORT VECTOR MACHINES;

CONDITIONAL MUTUAL INFORMATION; CORRELATION FEATURES; EVALUATION MEASURES; FEATURE SELECTION METHODS; FILTER MEASURES; K-NEAREST NEIGHBORS CLASSIFIERS; SEPARABILITY CRITERION; SUPPORT VECTOR MACHINE CLASSIFIERS;

CLASSIFICATION (OF INFORMATION);

EID: 84921784324     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.11.010     Document Type: Article

References (38)

1. G. Forman An extensive empirical study of feature selection metrics for text classification J. Mach. Learn. Res. 3 2003 1289 1305
2. R. Kohavi, and G.H. John Wrappers for feature subset selection Artif. Intell. 97 1-2 1997 273 324
3. P. Somol, J. Grim, P. Pudil, Fast dependence-aware feature selection in very-high-dimensional pattern recognition, in: Proceedings of the 2011 IEEE International Conference on Systems, Man and Cybernetics, vol. 1, Anchorage, Alaska, USA, 2011.
4. K. Kira, L. Rendell, The feature selection problem: traditional methods and a new algorithm, in: AAAI-92. Proceedings Tenth National Conference on Artificial Intelligence, Menlo Park, CA, USA, 1992, pp. 129-34.
5. I. Kononenko, Estimating attributes. analysis and extensions of relief, in: Proceedings of European Conference on Machine Learning, vol. 784, Catania, Italy, 1994, p. 171.
6. C. Freeman, D. Kulić, O. Basir, Joint feature selection and hierarchical classifier design, in: Proceedings of the 2011 IEEE International Conference on Systems, Man and Cybernetics, vol. 1, Anchorage, Alaska, USA, 2011, pp. 1728-1734.
7. P. Devijver, and J. Kittler Pattern Recognition: A Statistical Approach 1982 Prentice-Hall International N.J., USA
8. D.J. MacKay Information Theory, Inference, and Learning Algorithms 7th Edition 2003 Cambridge University Press U.K.
9. G. Brown, A new perspective for information theoretic feature selection, in: Proceedings of the 12th International Conference on Artificial Intelligence and Statistics (AISTATS), Clearwater Beach, Florida, USA, 2009, pp. 49-56.
10. T.M. Cover, and J.A. Thomas Elements of Information Theory 2nd Edition 2006 John Wiley & Sons Inc. Hoboken, NJ, USA
11. I. Kononenko, On biases in estimating multi-valued attributes, in: Proceedings of the 14th International Joint Conference on Artificial Intelligence, vol. 2 of IJCAI'95, 1995, pp. 1034-1040.
12. L. Yu, H. Liu, Feature selection for high-dimensional data: a fast correlation-based filter solution, in: Proceedings of the International Conference on Machine Learning, vol. 2, Washington DC, US, 2003, pp. 856-863.
13. M.A. Hall, Correlation-based feature selection for machine learning (Ph.D. thesis), University of Waikato, 1999.
14. F. Fleuret Fast binary feature selection with conditional mutual information J. Mach. Learn. Res. 5 2004 1531 1555
15. H. Peng, F. Long, and C. Ding Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy IEEE Trans. Pattern Anal. Mach. Intell. 27 8 2005 1226 1238
16. H. Almuallim, T.G. Dietterich, Learning with many irrelevant features, in: Proceedings of the Ninth National Conference on Artificial Intelligence, 1991, pp. 547-552.
17. M. Dash, and H. Liu Consistency-based search in feature selection Artif. Intell. 151 1-2 2003 155 176
18. X. He, D. Cai, P. Niyogi, Laplacian score for feature selection, in: Y. Weiss, B. Schölkopf, J. Platt (Eds.), Advances in Neural Information Processing Systems, vol. 18, 2006, pp. 507-514.
19. D. Cai, C. Zhang, X. He, Unsupervised feature selection for multi-cluster data, in: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2010, pp. 333-342.
20. K. Sjöstrand, L.H. Clemmensen, R. Larsen, B. Ersbøll, Spasm: A matlab toolbox for sparse statistical modelling, 2005. url: 〈 http://www2.imm.dtu.dk/projects/spasm/ 〉.
21. R. Tibshirani, W. Guenther, and T. Ha Estimating the number of clusters in a data set via the gap statistic J. R. Stat. Soc. B 6 2 2001 411 423
22. M. Kudo, and J. Sklansky Comparison of algorithms that select features for pattern classifiers Pattern Recognit. 33 1 2000 25 41
23. I.A. Gheyas, and L.S. Smith Feature subset selection in large dimensionality domains Pattern Recognit. 43 1 2010 5 13
24. J. Reunanen Overfitting in making comparisons between variable selection methods J. Mach. Learn. Res. 3 2003 1371 1382
25. C.J. Burges A tutorial on support vector machines for pattern recognition Data Min. Knowl. Discov. 2 1998 121 167
26. R.A. Johnson Miller and Freund's Probability and Statistics for Engineers 5th Edition 1994 Prentice-Hall Inc N.J., USA pp. 337-369
27. A. Asuncion, D. Newman, UCI machine learning repository, 2007. url: 〈 http://www.ics.uci.edu/~mlearn/MLRepository.html 〉.
28. P. Mowforth, B. Shepherd, Statlog (vehicle silhouettes) data set, 1993. url: 〈 http://archive.ics.uci.edu/ml/datasets/Statlog+%28Vehicle+Silhouettes%29 〉.
29. O.L. Mangasarian, and W.H. Wolberg Cancer diagnosis via linear programming SIAM News 23 5 1990 1 18
30. S. Thrun, J. Bala, E. Bloedorn, I. Bratko, B. Cestnik, J. Cheng, K.D. Jong, S. Dzeroski, S. Fahlman, D. Fisher, R. Hamann, K. Kaufman, S. Keller, I. Kononenko, J. Kreuziger, R. Michalski, T. Mitchell, P. Pachowicz, Y. Reich, H. Vafaie, W.V. de Welde, W. Wenzel, J. Wnek, J. Zhang, The Monk's Problems - A Performance Comparison of Different Learning Algorithms, Technical Report CS-CMU-91-197, Carnegie Mellon University, December 1991.
31. A. Arauzo-Azofra, J.M. Benítez, J.L. Castro, A feature set measure based on RELIEF, in: Proceedings of the 5th International Conference on Recent Advances in Soft Computing, 2004, pp. 104-109.
32. G. Brown, A. Pocock, M.-J. Zhao, and M. Luján Conditional likelihood maximisation: a unifying framework for information theoretic feature selection J. Mach. Learn. Res. 13 2012 27 66
33. M. Balasubramanian, and E.L. Schwartz The isomap algorithm and topological stability Science 295 7 2002 7a
34. J. B. Tenenbaum, V. de Silva, J. C. Langford, A global geometric framework for nonlinear dimensionality reduction, Science 290 (200) 2319-2323.
35. L.J.P. van der Maaten, E.O. Postma, H.J. van den Herik, Dimensionality Reduction: A Comparative Review, Technical Report, Tilburg University, 2008.
36. Solomon Kullback, and Richard A. Leibler On information and sufficiency Ann. Math. Stat. 22 1 1951 79 86
37. Jianhua Lin Divergence measures based on the Shannon entropy IEEE Trans. Inf. Theory 37 1 1991 145 151
38. Anil Bhattacharyya On a measure of divergence between two statistical populations defined by their probability distributions Bull. Calcutta Math. Soc. 35 1943 99 109