Efficient feature size reduction via predictive forward selection

Pattern Recognition

Volumn 47, Issue 4, 2014, Pages 1664-1673

  Reif, Matthias ^a   Shafait, Faisal ^b  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^b UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

Classification; Feature selection; Forward selection; Meta learning; SVM

Indexed keywords

AUTOMATIC FEATURE SELECTION; CLASSIFICATION ALGORITHM; FEATURE SELECTION ALGORITHM; FORWARD SELECTION; METALEARNING; REAL-WORLD DATASETS; REDUNDANT FEATURES; SVM;

ALGORITHMS; FEATURE EXTRACTION; SUPPORT VECTOR MACHINES;

CLASSIFICATION (OF INFORMATION);

EID: 84891632626     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.10.009     Document Type: Article

References (43)

1. S. Ali, and K.A. Smith On learning algorithm selection for classification Appl. Soft Comput. 6 January 2006 119 138
2. A. Asuncion, D. Newman, UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences, 〈 http://www.ics.uci.edu/~mlearn/MLRepository.html a〉, 2007.
3. N. Becker, W. Werft, G. Toedt, P. Lichter, and A. Benner PenalizedSVM a R-package for feature selection SVM classification Bioinformatics 25 13 2009 1711 1712
4. H. Bensusan, C. Giraud-Carrier, Casa batló is in passeig de gràcia or how landmark performances can describe tasks, in: Proceedings of the ECML-00 Workshop on Meta-Learning: Building Automatic Advice Strategies for Model Selection and Method Combination, 2000, pp. 29-46.
5. H. Bensusan, C. Giraud-Carrier, C. Kennedy, A higher-order approach to meta-learning, in: Proceedings of the ECML'2000 Workshop on Meta-Learning: Building Automatic Advice Strategies for Model Selection and Method Combination, June 2000, pp. 109-117.
6. H. Bensusan, C.G. Giraud-Carrier, Discovering task neighbourhoods through landmark learning performances, in: PKDD'00: Proceedings of the Fourth European Conference on Principles of Data Mining and Knowledge Discovery, Springer Berlin/Heidelberg, 2000, pp. 325-330.
7. H. Bensusan, and A. Kalousis Estimating the predictive accuracy of a classifier L. De Raedt, P. Flach, Machine Learning ECML 2001, Lecture Notes in Computer Science vol. 2167 2001 Springer Berlin/Heidelberg 25 36
8. A.L. Blum, and P. Langley Selection of relevant features and examples in machine learning Artif. Intell. (Special Issue on Relevance) 97 1997 235 271
9. P. Bradley, O.L. Mangasarian, Feature selection via concave minimization and support vector machines, in: International Conference on Machine Learning (ICML), Morgan Kaufmann, 1998, pp. 82-90.
10. P.B. Brazdil, C. Soares, Zoomed ranking: selection of classification algorithms based on relevant performance information, in: Proceedings of Principles of Data Mining and Knowledge Discovery, Fourth European Conference, 2000, pp. 126-135.
11. P.B. Brazdil, C. Soares, and J.P. da Costa Ranking learning algorithms using IBL and meta-learning on accuracy and time results Mach. Learn. 50 3 2003 251 277
12. L. Breiman Random forests Mach. Learn. 45 1 2001 5 32
13. L. Breiman, J. Friedman, R. Olshen, C. Stone, Classification and Regression Trees, Wadsworth, 1984.
14. C.J. Burges A tutorial on support vector machines for pattern recognition Data Mining Knowl. Discovery 2 1998 121 167
15. C. Castiello, G. Castellano, A.M. Fanelli, Meta-data: characterization of input features for meta-learning, in: V. Torra, Y. Narukawa, S. Miyamoto (Eds.), Modeling Decisions for Artificial Intelligence, Lecture Notes in Computer Science, vol. 3558, Springer, Berlin/Heidelberg, 2005, pp. 295-304.
16. C.-C. Chang, C.J. Lin, LIBSVM: a library for support vector machines, Software available at 〈 http://www.csie.ntu.edu.tw/~cjlin/libsvm a〉, 2001.
17. C. Cortes, and V. Vapnik Support-vector networks Mach. Learn. 20 3 1995 273 297
18. J. Demšar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30
19. R. Engels, C. Theusinger, Using a data metric for preprocessing advice for data mining applications, in: Proceedings of the European Conference on Artificial Intelligence (ECAI-98), John Wiley & Sons, 1998, pp. 430-434.
20. J. Gama, and P.B. Brazdil Characterization of classification algorithms C. Pinto-Ferreira, N. Mamede, Progress in Artificial Intelligence. Lecture Notes in Computer Science vol. 990 1995 Springer Berlin/Heidelberg 189 200
21. I. Guyon, and A. Elisseeff An introduction to variable and feature selection J. Mach. Learn. Res. March (3) 2003 1157 1182
22. C.-W. Hsu, and C.-J. Lin A comparison of methods for multi-class support vector machines IEEE Trans. Neural Networks 13 2002 415 425
23. R.D. King, C. Feng, and A. Sutherland Statlog comparison of classification algorithms on large real-world problems Appl. Artif. Intell. 9 1995 289 333
24. R. Kohavi, and G.H. John Wrappers for feature subset selection Artif. Intell. (Special Issue on Relevance) 97 December 1997 273 324
25. C. Köpf, C. Taylor, J. Keller, Meta-analysis: from data characterisation for meta-learning to meta-regression, in: Proceedings of the PKDD-00 Workshop on Data Mining, Decision Support, Meta-Learning and ILP, 2000.
26. K.Z. Mao Fast orthogonal forward selection algorithm for feature subset selection IEEE Trans. Neural Networks 13 5 2002 1218 1224
27. D. Michie, D.J. Spiegelhalter, and C.C. Taylor Machine Learning Neural and Statistical Classification 1994 Ellis Horwood
28. H. Peng, F. Long, and C. Ding Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy IEEE Trans. Pattern Anal. Mach. Intell. 27 8 2005 1226 1238
29. Y. Peng, P. Flach, C. Soares, and P.B. Brazdil Improved dataset characterisation for meta-learning S. Lange, K. Satoh, C. Smith, Discovery Science. Lecture Notes in Computer Science vol. 2534 2002 Springer Berlin/Heidelberg 193 208
30. B. Pfahringer, H. Bensusan, C. Giraud-Carrier, Meta-learning by landmarking various learning algorithms, in: Proceedings of the Seventeenth International Conference on Machine Learning, Morgan Kaufmann, 2000, pp. 743-750.
31. M. Reif, A comprehensive dataset for evaluating approaches of various meta-learning tasks, in: First International Conference on Pattern Recognition and Methods (ICPRAM), SciPress, February 2012.
32. M. Reif, F. Shafait, M. Goldstein, T. Breuel, A. Dengel, Automatic classifier selection for non-experts, Pattern Anal. Appl. http://dx.doi.org/10. 1007/s10044-012-0280-z, in press.
33. N. Sánchez-Maroño, A. Alonso-Betanzos, and M. Tombilla-Sanromán Filter methods for feature selection a comparative study H. Yin, P. Tino, E. Corchado, W. Byrne, X. Yao, Intelligent Data Engineering and Automated Learning-IDEAL 2007. Lecture Notes in Computer Science vol. 4881 2007 Springer Berlin, Heidelberg 178 187 URL http://dx.doi.org/10. 1007/978-3-540-77226-2-19
34. S. Segrera, J. Pinho, and M. Moreno Information-theoretic measures for meta-learning E. Corchado, A. Abraham, W. Pedrycz, Hybrid Artificial Intelligence Systems. Lecture Notes in Computer Science vol. 5271 2008 Springer Berlin/Heidelberg 458 465
35. J.S. Simonoff Analyzing Categorical Data. Springer Texts in Statistics 2003 Springer Berlin/Heidelberg 〈 http://people.stern.nyu.edu/jsimonof/ AnalCatData/a〉
36. A.J. Smola, and B. Schölkopf A tutorial on support vector regression Stat. Comput. 14 August (3) 2004 199 222
37. S.Y. Sohn Meta analysis of classification algorithms for pattern recognition IEEE Trans. Pattern Anal. Mach. Intell. 21 11 1999 1137 1144
38. R. Vilalta, C. Giraud-Carrier, P.B. Brazdil, and C. Soares Using meta-learning to support data mining Int. J. Comput. Sci. Appl. 1 1 2004 31 45
39. P. Vlachos, StatLib Datasets Archive, Department of Statistics, Carnegie Mellon University, 〈 http://lib.stat.cmu.edu a〉, 1998.
40. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, T. Poggio, and V. Vapnik Feature selection for SVMs Adv. Neural Inf. Process. Syst. 13 2000 668 674
41. D.H. Wolpert The lack of a priori distinctions between learning algorithms Neural Comput. 8 7 1996 1341 1390
42. L. Yu, and H. Liu Efficient feature selection via analysis of relevance and redundancy J. Mach. Learn. Res. 5 2004 1205 1224
43. H.H. Zhang, J. Ahn, and X. Lin Gene selection using support vector machines with nonconvex penalty Bioinformatics 22 2006 88 95