Comparison of feature ranking methods based on information entropy

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn 2, Issue , 2004, Pages 1415-1419

  Duch, Włodzisław ^a,b   Wieczorek, Tadeusz ^c   Biesiada, Jacek ^c   Blachnik, Marcin ^c  

^a NICOLAUS COPERNICUS UNIVERSITY   (Poland)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c SILESIAN UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

[No Author keywords available]

Indexed keywords

ENTROPY-BASED METHODS; INFORMATION ENTROPY; RANKING METHODS;

ALGORITHMS; BIOMEDICAL ENGINEERING; CLASSIFICATION (OF INFORMATION); NEURAL NETWORKS; NUMERICAL METHODS; PROBLEM SOLVING; STATISTICAL METHODS;

FEATURE EXTRACTION;

EID: 10944231193     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2004.1380157     Document Type: Conference Paper

References (15)

1. Breiman L., Friedman J.H., Olshen R.H., Stone C.J., Classification and Regression Trees. Wadsworth and Brooks, Monterey, CA, 1984.
2. th Australian Conf. on Neural Networks (ACNN'93), pp. 181-196, 1993.
3. Duch W., Adamczak R., Grābczewski K., "A new methodology of extraction, optimization and application of crisp and fuzzy logical rules." IEEE Transactions on Neural Networks, vol. 12, pp. 277-306, 2001.
4. Duch W., Biesiada J., Winiarski T., Grudziński T., Grābczewski K., "Feature selection based on information theory filters and feature elimination wrapper methods." In: Neural Networks and Soft Computing (eds. L. Rutkowski and J. Kacprzyk), Advances in Soft Computing, Physica Verlag (Springer), pp. 173-176, 2002.
5. Duch W., Winiarski T., Biesiada J., Kachel A., "Feature Ranking, Selection and Discretization". Int. Conf. on Artificial Neural Networks (ICANN) and Int. Conf. on Neural Information Processing (ICONIP), Istanbul, June 2003, pp. 251-254.
6. Hall M.A., Correlation based feature selection for machine learning. PhD thesis, Dept. of Comp. Science, Univ. of Waikato, Hamilton, New Zealand (1998)
7. Kohavi R., John G.H., "Wrappers for feature Subset Selection." Artificial Intelligence, vol. 97, pp 273-324, 1997.
8. th Conferencia de la Asociación Española para la Inteligencia Artificial, (CAEPIA 1997), pp. 469-478, 1997.
9. Lopez de Mantaras R., "A Distance-Based Attribute Selecting Measure for Decision Tree Induction", Machine Learning vol. 6, pp. 81-92, 1991.
10. Mertz C.J., Murphy P.M., UCI repository of machine learning databases http://www.ics.uci.edu.pl/~mlearn/MLRespository.html. Irvine, CA: University of California, Department of Information and Computer Science.
11. Setion R., Liu H., "Improving backpropagation learning with feature selection". Applied Intelligence: The International Journal of Artifical Intelligence, Neural Networks, and Complex Problem-Solving Technologies, vol. 6, pp. 129-139, 1996.
12. Setion R., Liu H., "Chi2: Feature selection and discretization of numeric attributes". In: Proc. 7th IEEE International Conf. on Tools with Artificial Intelligence, Washington D.C., pp. 388-391, Nov. 1995.
13. Shanonn C.E., Weaver W., The Mathematical Theory of Communication. Urbana, IL, University of Illinois Press, 1946.
14. Shridhar D.V., Bartlett E.B., Seagrave R.C., "Information theoretic subset selection." Computers in Chemical Engineering, vol. 22, pp. 613-626, 1998.
15. Quinlan J.R. C4.5: Programs for machine learning. San Mateo, Morgan Kaufman, 1993.