An unsupervised approach to feature discretization and selection

Pattern Recognition

Volumn 45, Issue 9, 2012, Pages 3048-3060

  Ferreira, Artur J ^a,c   Figueiredo, Mário A T ^b,c  

^a INSTITUTO SUPERIOR DE ENGENHARIA DE LISBOA   (Portugal)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^c INSTITUTO DE TELECOMUNICAÇÕES   (Portugal)

Author keywords

Feature discretization; Feature quantization; Feature selection; k nearest neighbor; Linde Buzo Gray algorithm; Na ve Bayes; Sparse data; Support vector machines

Indexed keywords

FEATURE DISCRETIZATION; FEATURE QUANTIZATION; K-NEAREST NEIGHBORS; LINDE-BUZO-GRAY ALGORITHMS; SPARSE DATA;

GENE EXPRESSION; LEARNING ALGORITHMS; SUPPORT VECTOR MACHINES;

FEATURE EXTRACTION;

EID: 84861590173     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.12.008     Document Type: Conference Paper

References (47)

1. D. Aha, D. Kibler, and M. Albert Instance-based learning algorithms Machine Learning 6 1991 37 66
2. V. Bolon-Canedo, S. Seth, N. Sanchez-Marono, A. Alonso-Betanzos, J. Principe, Statistical dependence measure for feature selection in microarray datasets, in: 19th European Symposium on Artificial Neural Networks-ESANN2011. Belgium, 2011, pp. 23-28.
3. B. Boser, I. Guyon, and V. Vapnik A training algorithm for optimal margin classifiers Proceedings of the Fifth Annual Workshop on Computational Learning Theory. COLT 92 1992 ACM New York, NY, USA 144 152 〈 http://doi.acm.org/10. 1145/130385.130401 〉
4. E. Clarke, and B. Barton Entropy and MDL discretization of continuous variables for Bayesian belief networks International Journal of Intelligent Systems 15 1 2000 61 92
5. T. Cover, and J. Thomas Elements of Information Theory 1991 John Wiley
6. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods 2000 Cambridge University Press
7. J. Demsar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
8. J. Dougherty, R. Kohavi, and M. Sahami Supervised and unsupervised discretization of continuous features International Conference Machine Learning - ICML95 1995 Morgan Kaufmann 194 202
9. R. Duda, P. Hart, and D. Stork Pattern Classification second ed. 2001 John & Wiley Sons
10. R. Duin, P. Juszczak, P. Paclik, E. Pekalska, D. Ridder, D. Tax, S. Verzakov, PRTools4.1, a Matlab Toolbox for Pattern Recognition, Technical Report, Delft University of Technology, 2007.
11. F. Escolano, P. Suau, and B. Bonev Information Theory in Computer Vision and Pattern Recognition 2009 Springer
12. O. Fang, N. Mustapha, and N. Sulaiman Integrative gene selection for classification of microarray data Computer and Information Science 4 2 2011 55 63
13. U. Fayyad, K. Irani, Multi-interval discretization of continuous-valued attributes for classification learning, in: Proceedings of the International Joint Conference on Uncertainty in Artificial Intelligence, 1993, pp. 1022-1027.
14. A. Ferreira, M. Figueiredo, Feature transformation and reduction for text classification, in: 10th International Workshop on Pattern Recognition and Information Systems - PRIS2010, 2010, pp. 72-81.
15. A. Ferreira, M. Figueiredo, Unsupervised feature selection for sparse data, in: 19th European Symposium on Artificial Neural Networks-ESANN2011, 2011, pp. 339-344.
16. G. Forman An extensive empirical study of feature selection metrics for text classification Journal of Machine Learning Research 3 2003 1289 1305
17. A. Frank, A. Asuncion, UCI machine learning repository, 2010 〈 http://archive.ics.uci.edu/ml 〉.
18. M. Friedman The use of ranks to avoid the assumption of normality implicit in the analysis of variance Journal of the American Statistical Association 32 200 1937 675 701 〈 http://dx.doi.org/10.2307/2279372 〉
19. M. Friedman A comparison of alternative tests of significance for the problem of m rankings The Annals of Mathematical Statistics 11 1 1940 86 92
20. T. Furey, N. Cristianini, N. Duffy, D. Bednarski, M. Schummer, and D. Haussler Support vector machine classification and validation of cancer tissue samples using microarray expression data Bioinformatics 16 10 2000 906 914
21. I. Guyon, and A. Elisseeff An introduction to variable and feature selection Journal of Machine Learning Research 3 2003 1157 1182
22. I. Guyon, S. Gunn, M. Nikravesh, and L. Zadeh Feature Extraction, Foundations and Applications 2006 Springer
23. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning second ed. 2001 Springer
24. T. Ho The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis Machine Intelligence 20 8 1998 832 844
25. E. Huerta, B. Duval, and J. Hao A hybrid GA/SVM approach for gene selection and classification of microarray data EvoWorkshops 2006, LNCS 3907 2006 Springer 34 44
26. T. Joachims Learning to Classify Text Using Support Vector Machines 2001 Kluwer Academic Publishers
27. R. Kohavi, and G. John Wrappers for feature subset selection Artificial Intelligence 97 1 1997 273 324
28. C. Lai, M. Reinders, and L. Wessels Random subspace method for multivariate feature selection Pattern Recognition Letters 27 10 2006 1067 1076
29. Z. Lee An integrated algorithm for gene selection and classification applied to microarray data of ovarian cancer Artificial Intelligence in Medicine 42 1 2008 81 93
30. Y. Linde, A. Buzo, and R. Gray An algorithm for vector quantizer design IEEE Transactions on Communications 28 1 1980 84 94
31. H. Liu, F. Hussain, C. Tan, and M. Dash Discretization: an enabling technique Data Mining and Knowledge Discovery 6 4 2002 393 423
32. L. Liu, J. Kang, J. Yu, Z. Wang, A comparative study on unsupervised feature selection methods for text clustering, in: IEEE International Conference on Natural Language Processing and Knowledge Engineering, 2005, pp. 597-601.
33. C. Manning, P. Raghavan, and H. Schütze Introduction to Information Retrieval 2008 Cambridge University Press
34. P. Meyer, C. Schretter, and G. Bontempi Information-theoretic feature selection in microarray data using variable complementarity IEEE Journal of Selected Topics in Signal Processing (Special Issue on Genomic and Proteomic Signal Processing) 2 3 2008 261 274
35. P. Mitra, C. Murthy, and S. Pal Unsupervised feature selection using feature similarity IEEE Transactions on Pattern Analysis and Machine Intelligence 24 3 2002 301 312
36. H. Peng, F. Long, and C. Ding Feature selection based on mutual information: Criteri, of max-dependency, max-relevance and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 8 2005 1226 1238
37. Y. Saeys, I. Inza, and P. Larrañaga A review of feature selection techniques in bioinformatics Bioinformatics 23 19 2007 2507 2517
38. A. Statnikov, C. Aliferis, I. Tsamardinos, D. Hardin, and S. Levy A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis Bioinformatics 21 5 2005 631 643
39. C.-J. Tsai, C. Lee, and W.-P. Yang A discretization algorithm based on class-attribute contingency coefficient Information Sciences 178 3 2008 714 731
40. V. Vapnik The Nature of Statistical Learning Theory 1999 Springer-Verlag
41. G. Webb, J. Boughton, and Z. Wang Not so naive Bayes: aggregating one-dependence estimators Machine Learning 58 1 2005 5 24
42. I. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques second ed. 2005 Elsevier, Morgan Kauffmann
43. X. Yan A formal study of feature selection in text categorization Journal of Communication and Computer 6 4 2009 32 41
44. L. Yu, H. Liu, Feature selection for high-dimensional data: a fast correlation-based filter solution, in: Proceedings of International Conference on Machine Learning - ICML03, 2003, pp. 856-863.
45. L. Yu, H. Liu, and I. Guyon Efficient feature selection via analysis of relevance and redundancy Journal of Machine Learning Research 5 2004 1205 1224
46. Q. Zhu, L. Lin, M. Shyu, S. Chen, Effective supervised discretization for classification based on correlation maximization, in: IEEE International Conference on Information Reuse and Integration - IRI2011, 2011, pp. 390-395.
47. A. Zien, N. Krämer, S. Sonnenburg, and G. Rätsch The feature importance ranking measure Proceedings of the European Conference on Machine Learning - KDD2009 vol. 5782 2009 Springer 694 709