A new mutual information based measure for feature selection

Intelligent Data Analysis

Volumn 7, Issue 1, 2003, Pages 43-57

  Al Ani, Ahmed ^a   Deriche, Mohamed ^a   Chebil, Jalel ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

feature selection; filter evaluation function; information measure

Indexed keywords

CLASSIFICATION (OF INFORMATION); TEXTURES;

DISCRIMINATION ABILITY; EVALUATION FUNCTION; EVALUATION MEASURES; INFORMATION MEASURES; MUTUAL INFORMATION FEATURE SELECTIONS; ROBUST FEATURE SELECTION; SPEAKER IDENTIFICATION; TEXTURE CLASSIFICATION;

FEATURE EXTRACTION;

EID: 38049072198     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/ida-2003-7105     Document Type: Article

References (16)

1. H. Almuallim and T.G. Dietterich, Learning boolean concepts in the presence of many irrelevant features, Artificial Intelligence 69 (1994), 279-305.
2. R. Battiti, Using mutual information for selecting features in supervised neural net learning, IEEE Transactions on Neural Networks 5 (1994), 537-550.
3. G.A. Darbellay and I. Vajda, Estimation of the mutual information by an adaptive partitioning of the observation space. IEEE Transactions on Information Theory 45 (1999), 1315-1321.
4. M. Dash and H. Liu, Feature selection for classification, Intelligent Data Analysis 1 (1997), 1-27.
5. P.A. Devijver and J. Kittler, Pattern recognition: A statistical approach, Prentice-Hall, 1982.
6. R.H. Duda and P.H. Hart, Pattern classification and scene analysis, Wiley, 1973.
7. R. Fano, Transmission of information: A statistical theory of communications, Wiley, 1961.
8. A.M. Fraser and H.L. Swinney, Independent coordinates for strange attractors from mutual information, Physical Review A 33 (1986), 1134-1140.
9. M.A. Hall, Correlation-based feature selection for machine learning, PhD thesis, The University of Waikato, 1999.
10. A. Jain and D. Zongker, Feature selection: evaluation, application, and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 (1997), 153-158.
11. M.I.T. SRI and T.I. DARPA TIMIT acoustic-phonetic continuous speech corpus, 1990, http://www.ldc.upenn.edu/doc/TIMIT.html.
12. A.N. Mucciardi and E.E. Gose, A comparison of seven techniques for choosing subsets of pattern recognition properties, IEEE Transactions on Computers C-20 (1971), 1023-1031.
13. P.M. Narendra and K. Fukunaga. A branh and bound algorithm for feature subset selection. IEEE Transactions on Computers C-26 (1977), 917-922.
14. B.D. Ripley, Pattern recognition and neural networks, Cambridge university press, 1996.
15. Signal and Image Processing Institute, USC. USC-SIPI image database, 1981. http://sipi.usc.edu/services/database/.
16. H. Vafie and I.F. Imam, Feature selection methods: genetic algorithms vs. greedy-like search, in: Proc. 9th Intl. Conf. Fuzzy and Intelligent Control Systems, 1994.