Mutual information for feature selection with missing data

ESANN 2011 - 19th European Symposium on Artificial Neural Networks

Volumn , Issue , 2011, Pages 269-274

  Doquire, Gauthier ^a   Verleysen, Michel ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

NEURAL NETWORKS; PREDICTIVE ANALYTICS;

IMPORTANT FEATURES; IMPUTATION ALGORITHM; MACHINE LEARNING APPLICATIONS; MISSING DATA; MUTUAL INFORMATIONS; NEAREST NEIGHBORS; PREDICTION MODEL; REAL-WORLD DATASETS;

FEATURE EXTRACTION;

EID: 85088919043     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. D. B. Rubin. Inference and missing data. Biometrika, 63(3):581–592, 1976.
2. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157–1182, 2003.
3. A. Kraskov, H. Stögbauer, and P. Grassberger. Estimating mutual information. Phys. Rev. E, 69(6):066138, 2004.
4. C. E. Shannon. A mathematical theory of communication. Bell Systems Technical Journal, 27:379–423,623–656, 1948.
5. R. Battiti. Using mutual information for selecting features in supervised neural net learning. IEEE Transactions on Neural Networks, 5:537–550, 1994.
6. E. Parzen. On estimation of a probability density function and mode. The Annals of Mathematical Statistics, 33(3):1065–1076, 1962.
7. F. Rossi, A. Lendasse, D. François, V. Wertz, and M. Verleysen. Mutual information for the selection of relevant variables in spectrometric nonlinear modelling. Chemometrics and Intelligent Laboratory Systems, 80(2):215–226, 2006.
8. L. F. Kozachenko and N. Leonenko. Sample estimate of the entropy of a random vector. Problems Inform. Transmission, 23:95–101, 1987.
9. J. Friedman. Multivariate adaptive regression splines (with discussion). Annals of Statistics, 19(1), 1991.
10. T. Schneider. Analysis of incomplete climate data: Estimation of mean values and covariance matrices and imputation of missing values. J. Climate, 14:2001, 2001.
11. F. Rossi, N. Delannay, B. Conan-Guez, and M. Verleysen. Representation of functional data in neural networks. Neurocomputing, 64:183 – 210, 2005.
12. A. Sorjamaa, A. Lendasse, and E. Séverin. Combination of SOMs for fast missing value imputation. Proceedings of MASHS 2010, Modèles et Apprentissage en Sciences Humaines et Sociale, 2010.