A filter approach to feature selection based on mutual information

Proceedings of the 5th IEEE International Conference on Cognitive Informatics, ICCI 2006

Volumn 1, Issue , 2006, Pages 84-89

  Huang, Jinjie ^a   Cai, Yunze ^a   Xu, Xiaoming ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Feature selection; Filter approach; Machine learning; Mutual information; Pattern classification

Indexed keywords

FEATURE SELECTION; FILTER APPROACH; MACHINE LEARNING; MUTUAL INFORMATIONS; PATTERN CLASSIFICATION;

CLASSIFICATION (OF INFORMATION); INFORMATION SCIENCE; LEARNING SYSTEMS;

FEATURE EXTRACTION;

EID: 67449169301     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/COGINF.2006.365681     Document Type: Conference Paper

References (20)

1. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection", Journal of Machine Learning Research, vol.3, pp. 1157-1182, 2003
2. R. Kohavi and G.H. John, "Wrappers for feature subset selection", Artificial Intelligence 97, pp.273-324, 1997
3. H. Liu and H. Motoda, Feature Selection for Knowledge Discovery and Data Mining. Boston: Kluwer Academic Publishers, 1998
4. A. Ahmad and L. Dey, "A feature selection technique for classificatory analysis", Pattern Recognition Letters vol.26, no.1, pp. 43-56, 2005
5. M. Dash and H. Liu, "Feature selection for classification", Intelligent Data Analysis, 1(1997), pp. 131-156, 1997
6. X. Wang and Kuldip K. Paliwal, "Feature extraction and dimensionality reduction algorithms and their applications in vowel recognition", Pattern Recognition, vol.36, no. 10, pp. 2429-2439, 2003
7. B. Lazzerini and F. Marcelloni, "Feature selection based on similarity", Electronics Letters vol.38, no.3, pp. 121-122, 2002
8. M. Dash and H. Liu, "Consistency-based search in feature selection", Artificial Intelligence 151(1-2), pp. 155-176, 2003
9. C. E. Shannon and W. Weaver, The Mathematical Theory of Communication. Univ. Illinois Press, Urbana, IL, 1949
10. T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, New York, 1991
11. M. Last and O. Maimon, "A compact and accurate model for classification", IEEE Transactions on Knowledge and Data Engineering, vol.16, no.2, pp.203-215, 2004
12. D. Roller and M. Sahami, "Toward optimal feature selection". In: Proceedings of International Conference on Machine Learning, Bari, Italy, pp. 284-292, 1996
13. R. Battiti, "Using mutual information for selecting features in supervised neural net learning", IEEE Transactions on Neural Networks, vol.5, no.4, pp.537-550, 1994
14. N. Kwak and C. H. Choi, "Input feature selection for classification problems", IEEE Transactions on Neural Networks, vol.13, no.1, pp. 143-159, 2002
15. E. Grail-Maes and P. Beauseroy, "Mutual information-based feature extraction on the time-frequency plane", IEEE Transactions on Signal Processing, vol.50, no.4, pp. 779-790, 2002
16. J. R. Quinlan, "Improved use of continuous attributes in C4.5", Journal of Artificial Intelligence Research, 4 (1996), pp.77-90, 1996
17. Fano R. M. Transmission of Information: A Statistical Theory of Communications, Wiley, New York. 1961.
18. A. M. Fraser and H. L. Swinney, "Independent coordinates for strange attractors from mutual information". Phys. Rev. A, vol 33, no.2, pp. 1134-1140, 1986.
19. C. J. Merz, P. M. Murphy, UCI Repository of machine learning databases. Irvine, CA: University of California, Department of Information and Computer Science, http://www.ics.uci.edu/~mlearn/MLRepositorv.htmL 1996
20. V. Vapnik, Statistical learning Theory, Wiley, New York, 1998.