Information-theoretic feature selection for functional data classification

Neurocomputing

Volumn 72, Issue 16-18, 2009, Pages 3580-3589

  Gómez Verdejo, Vanessa ^a   Verleysen, Michel ^b   Fleury, Jérôme ^c  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

^b UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^c Michelin   (France)

Author keywords

Classification; Feature selection; Functional data; Mutual information

Indexed keywords

ADDED VALUES; CLASSIFICATION; CLASSIFICATION TASKS; CURSE OF DIMENSIONALITY; EFFICIENT ESTIMATOR; FEATURE SELECTION; FINITE SET; FUNCTIONAL CLASSIFICATION; FUNCTIONAL DATA; FUNCTIONAL DATAS; HIGH DIMENSIONAL DATA; MULTI-CLASS; MUTUAL INFORMATION; MUTUAL INFORMATIONS; STOPPING CRITERIA;

ESTIMATION; FEATURE EXTRACTION; INFORMATION THEORY; SET THEORY;

CLASSIFICATION (OF INFORMATION);

ACCURACY; ARTICLE; CLASSIFICATION ALGORITHM; INFORMATION PROCESSING; INTERMETHOD COMPARISON; MATHEMATICAL MODEL; PREDICTION; PRIORITY JOURNAL; PROCESS OPTIMIZATION; QUALITY CONTROL;

EID: 69249222802     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.12.035     Document Type: Article

References (24)

1. S. Astakhov, P. Grassberger, A. Kraskov, H. Stögbauer, MILCA software: mutual information least-dependant component analysis. Software available at 〈http://www.klab.caltech.edu/~kraskov/MILCA/〉.
2. Battiti R. Using the mutual information for selecting features in supervised neural net learning. IEEE Transactions on Neural Networks 5 (1994) 537-550
3. C. Chang, C. Lin, LIBSVM: a library for support vector machines, 2001. Software available at 〈http://www.csie.ntu.edu.tw/~cjlin/libsvm〉.
4. Cover T.M., and Thomas J.A. Elements of Information Theory (1991), Wiley, New York
5. Darbellay G.A., and Vajda I. Estimation of the information by an adaptive partitioning of the observation space. IEEE Transactions on Information Theory 45 4 (1999) 1315-1321
6. C. Ding, H. Peng, Minimum redundancy feature selection from microarray gene expression data, in: Proceedings of the Second IEEE Computational Systems Bioinformatics Conference, Stanford, CA, 2003, pp. 523-528.
7. Ding C., and Peng H. Minimum redundancy feature selection from microarray gene expression data. Journal of Bioinformatics and Computational Biology 3 2 (2005) 185-205
8. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley, New York
9. François D., Rossi F., Wertz V., and Verleysen M. Resampling methods for parameter-free and robust feature selection with mutual information. Neurocomputing 70 (2007) 1276-1288
10. Fukunaga K. Introduction to Statistical Pattern Recognition. second ed. (1990), Academic Press, New York
11. Good P. Permutation Tests (1994), Springer, New York
12. V. Gómez-Verdejo, M. Verleysen, J. Fleury, Information-theoretic feature selection for the classification of hysteresis curves, in: Proceedings of the IWANN 2007, Lecture Notes in Computer Science, Springer, Berlin, vol. 4507, 2007, pp. 522-529.
13. Haykin S. Neural Networks: A Comprehensive Foundation. second ed. (1999), Prentice-Hall, Englewood Cliffs, NJ
14. Huang T.K., Weng R.C., and Lin C.J. Generalized Bradley-Terry models and multi-class probability estimates. Journal of Machine Learning Research 7 (2006) 85-115
15. Kozachenko L.F., and Leonenko N.N. A statistical estimate for the entropy of a random vector. Problems Information Transmission 23 2 (1987) 9-16
16. Kraskov A., Stögbauer H., and Grassberger P. Estimating mutual information. Physical Review E 69 (2004)
17. Kwak N., and Choi C.H. Input feature selection by mutual information based on Parzen window. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 12 (2002) 1667-1671
18. D.M. Mount, S. Arya, Approximate near neighbour (ANN) C ++ library. Software available at 〈http://www.cs.umd.edu/~mount/ANN/〉, 2009.
19. D.J. Newman, S. Hettich, C.L. Blake, C.J. Merz, UCI repository of machine learning databases 〈http://www.ics.uci.edu/~mlearn/MLRepository.html〉, University of California, Department of Information and Computer Sciences, Irvine, 1998.
20. Peng H., Long F., and Ding C. Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 8 (2005) 1226-1238
21. Rossi F., Lendasse A., François D., Wertz V., and Verleysen M. Mutual information for the selection of relevant variables spectrometric nonlinear modelling. Chemometrics and Intelligent Laboratory Systems 80 (2006) 215-226
22. Scott D.W., and Multivariable Density Estimation: Theory. Practice and Visualization (1992), Wiley, New York
23. Sorjamaa A., Hao J., Reyhani N., Ji Y., and Lendasse A. Methodology for long-term prediction of time series. Neurocomputing 70 16-18 (2007) 2861-2869
24. Steuer R., Kurths J., Daub C.O., Weise J., and Selbig J. The mutual information: detecting and evaluating dependencies between variables. Bioinformatics 18 2 (2002) 231-240