A new perspective for information theoretic feature selection

Journal of Machine Learning Research

Volumn 5, Issue , 2009, Pages 49-56

  Brown, Gavin ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CLASS LABELS; CONTINUOUS SPACES; FILTER CRITERIA; MUTUAL INFORMATIONS; STATISTICAL CRITERION;

INFORMATION THEORY;

ARTIFICIAL INTELLIGENCE;

EID: 83455217064     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (13)

1. Battiti, R. (1994). Using mutual information for selecting features in supervised neural net learning. IEEE Trans. Neural Networks, 5(4):537-550.
2. Bender, E. A. and Goldman, J. R. (1975). On the Applications of Mobius Inversion in Combinatorial Analysis. Amer. Math. Monthly, 82:789-803.
3. Fano, R. (1961). Transmission of Information: Statistical Theory of Communications. New York: Wiley.
4. Fleuret, F. (2004). Fast Binary Feature Selection with Conditional Mutual Information. The Journal of Machine Learning Research, 5:1531-1555.
5. Guyon, I. and Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, 3(7-8):1157-1182.
6. Kwak, N. and Choi, C. (2002). Input Feature Selection for Classification Problems. Neural Networks, IEEE Transactions on, 13(1):143-159.
7. Lin, D. and Tang, X. (2006). Conditional Infomax Learning: An Integrated Framework for Feature Extraction and Fusion. In European Conference on Computer Vision.
8. McGill, W. (1954). Multivariate information transmission. IEEE Trans. Inf. Theory, 4(4):93-111.
9. Peng, H., Long, F., and Ding, C. (2005). Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and MinRedundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(8):1226-1238.
10. Rota, G. (1964). On the Foundations of Combinatorial Theory I. Theory of Mobius Functions. Probability Theory and Related Fields, 2:340-368.
11. Shannon, C. (1948). A mathematical theory of communication, Bell Syst. Tech. J, 27(3):379-423.
12. Vidal-Naquet, M. and Ullman, S. (2003). Object recognition with informative features and linear classification. IEEE Conf. on Computer Vision and Pattern Recognition.
13. Yang, H. and Moody, J. (1999). Data Visualization and Feature Selection: New Algorithms for Nongaussian Data. Advances in Neural Information Processing Systems, 12.