A novel information theory method for filter feature selection

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4827 LNAI, Issue , 2007, Pages 431-440

  Bonev, Boyan ^a   Escolano, Francisco ^a   Cazorla, Miguel Angel ^a  

^a UNIVERSITY OF ALICANTE   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ALGORITHMS; CLASSIFICATION (OF INFORMATION); GRAPH THEORY; PROBABILITY DENSITY FUNCTION;

GRAPHS APPROXIMATION; MUTUAL INFORMATION;

INFORMATION THEORY;

EID: 38149013865     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-76631-5_41     Document Type: Conference Paper

References (22)

1. Neemuchwala, H., Hero, A., Carson, P.: Image registration methods in high dimensional space. International Journal on Imaging (2006)
2. Sima, C., Dougherty, E.R.: What should be expected from feature selection in small-sample settings. Bioinformatics 22(19), 2430-2436 (2006)
3. Jirapech-Umpai, T., Aitken, S.: Feature selection and classification for microarray data analysis: Evolutionary methods for identifying predictive genes. BMC Bioinformatics 6, 148 (2005)
4. Guyon, I., Elisseeff, A.: An Introduction to Variable and Feature Selection. Journal of Machine Learning Research 3, 1157-1182 (2003)
5. Blum, A.L., Langley, P.: Selection of Relevant Features and Examples in Machine Learning. Artificial Intelligence (1997)
6. Perkins, S., Theiler, J.: Online Feature Selection using Grafting. In: ICML 2003. Proceedings of the Twentieth International Conference on Machine Learning, Washington DC (2003)
7. Peng, H., Long, F., Ding, C.: Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(8) (2005)
8. Cover, T., Thomas, J.: Elements of Information Theory. J. Wiley and Sons, Chichester (1991)
9. Beirlant, E., Dudewicz, E., Gyorfi, L., Van der Meulen, E.: Nonparametric Entropy Estimation. International Journal on Mathematical and Statistical Sciences 5(1), 17-39 (1996)
10. Paninski, I.: Estimation of Entropy and Mutual Information. Neural Computation 15(1) (2003)
11. Viola, P., Wells-III, W.M.: Alignment by Maximization of Mutual Information. In: 5th Intern. Conf. on Computer Vision, IEEE, Los Alamitos (1995)
12. Viola, P., Schraudolph, N.N., Sejnowski, T.J.: Empirical Entropy Manipulation for Real-World Problems. Adv. in Neural Infor. Proces. Systems 8(1) (1996)
13. Hyvarinen, A., Oja, E.: Independent Component Analysis: Algorithms and Applications. Neural Networks 13(4-5), 411-430 (2000)
14. Wolpert, D., Wolf, D.: Estimating Function of Probability Distribution from a Finite Set of Samples, Los Alamos National Laboratory Report LA-UR-92-4369, Santa Fe Institute Report TR-93-07-046 (1995)
15. Hero, A.O., Michel, O.: Applications of spanning entropic graphs. IEEE Signal Processing Magazine 19(5), 85-95 (2002)
16. Hero, A.O., Michel, O.: Asymptotic theory of greedy aproximations to minnimal k-point random graphs. IEEE Trans. on Infor. Theory 45(6), 1921-1939 (1999)
17. Bertsimas, D.J., Van Ryzin, G.: An asymptotic determination of the minimum spanning tree and minimum matching constants in geometrical probability. Operations Research Letters 9(1), 223-231 (1990)
18. Zyczkowski, K.: Renyi Extrapolation of Shannon Entropy. Open Systems and Information Dynamics 10(3), 298-310 (2003)
19. Mokkadem, A.: Estimation of the entropy and information of absolutely continuous random variables. IEEE Trans. on Inform. Theory 35(1), 193-196 (1989)
20. Peñalver, A., Escolano, F., Sáez, J.M.: EBEM: An Entropy-based EM Algorithm for Gaussian Mixture Models. ICPR , 451-455 (2006)
21. Xing, E.P.. Jordan, M.I., Karp, R.M.: Feature selection for high-dimensional genomic microarray data. In: Proceedings of the Eighteenth International Conference on Machine Learning, pp. 601-608 (2001)
22. Gentile, C.: Fast Feature Selection from Microarray Expression Data via Multiplicative Large Margin Algorithms. In: Proceedings NIPS (2003)