Effective feature selection scheme using mutual information

Neurocomputing

Volumn 63, Issue SPEC. ISS., 2005, Pages 325-343

  Huang, Di ^a   Chow, Tommy W S ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Feature selection; Kernel based density estimator; Quadratic mutual information; Supervised data compression

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); DATA COMPRESSION; DATA REDUCTION; ESTIMATION; FEATURE EXTRACTION; PROBLEM SOLVING;

CLASSIFICATION PROBLEMS; DATA COMPRESSION ALGORITHMS; DATA SET; FEATURE SELECTION;

INFORMATION THEORY;

ALGORITHM; ARTICLE; CLASSIFICATION; CONTROLLED STUDY; DATA BASE; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; METHODOLOGY; PRIORITY JOURNAL;

EID: 12144251725     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2004.01.194     Document Type: Article

References (17)

1. A. Ai-ani M. Deriche An optimal feature selection technique using the concept of mutual information in: Proceedings of the Sixth International Symposium on Signal Processing and its Applications 2001 Kuala Lumpur Malaysia 477-480
2. Available at http://www.cs.waikato.ac.nx/~ml/weka.
3. Available at http://www.ics.uci.edu/~mlearn/MLRepository.html, UCI machine learning repository.
4. R. Battiti Using mutual information for selecting features in supervised neural net learning IEEE Trans. Neural Network 5 4 1994 537-550
5. B. Bonnlander, Nonparametric selection of input variables for connectionist learning, Ph.D. thesis, CU-CS-812-96, University of Colorado at Boulder, 1996.
6. T.M. Cover J.A. Thomas Elements of Information Theory 1991 Wiley New York
7. A.M. Fraser H.L. Swinney Independent coordinates for strange attractors from mutual information Phys. Rev. A 33 1986 1134-1140
8. J.W. Han M. Kamber Data Mining Concepts and Techniques 2001 Morgan Kaufmann Publishers San Francisco
9. N. Kwak C-H. Choi Input feature selection for classification problems IEEE Trans. Neural Networks 13 1 2002 143-159
10. N. Kwak C-H. Choi Input feature selection by mutual information based on parzen window IEEE Trans. PAMI 24 12 2002 1667-1671
11. W.T. Li Mutual information functions versus correlation functions Stat. Phys. 60 5/6 1990 823-837
12. Y. Moon B. Rajagopalan U. Lall Estimation of mutual information using kernel density estimators Phys. Rev. E 52 3 1995 2318-2321
13. E. Parzen On the estimation of a probability density function and mode Ann. Math. Statist 33 1962 1064-1076
14. J.C. Principe J.W. Fisher III Xu Dongxin Information theoretic learning in: S. Haykin (Ed.), Unsupervised Adaptive Filtering 2000 Wiley New York
15. B.W. Silverman Density Estimation for Statistics and Data Analysis 1986 Chapman & Hall London
16. H. Wang D. Bell F. Murtagh Axiomatic approach to feature subset selection based on relevance IEEE Trans. PAMI 21 3 1999 271-277
17. H.H. Yang J. Moody Feature selection based on joint mutual information in: Advances in Intelligent Data Analysis (AIDA) and Computational Intelligent Methods and Application (CIMA) 1999 Rochestor New York