Bias of importance measures for multi-valued attributes and solutions

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6792 LNCS, Issue PART 2, 2011, Pages 293-300

  Deng, Houtao ^a   Runger, George ^a   Tuv, Eugene ^b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b INTEL CORPORATION   (United States)

Author keywords

Attribute importance; cardinality; feature selection; random forest

Indexed keywords

ATTRIBUTE IMPORTANCE; BIAS PROBLEMS; CARDINALITIES; IMPORTANCE MEASURE; INFORMATIVE ATTRIBUTES; INTERPRETABILITY; LEARNING ACCURACY; MULTI-VALUED ATTRIBUTE; PERMUTATION TESTS; RANDOM FORESTS; SAMPLING METHOD;

DECISION TREES; FEATURE EXTRACTION;

NEURAL NETWORKS;

EID: 79959348887     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-21738-8_38     Document Type: Conference Paper

References (11)

1. Altmann, A., Tolośi, L., Sander, O., Lengauer, T.: Permutation importance: a corrected feature importance measure. Bioinformatics 26(10), 1340-1347 (2010)
2. Breiman, L.: Random forests. Machine Learning 45, 5-32 (2001)
3. Breiman, L., Friedman, J., Olshen, R., Stone., C.: Classification and Regression Trees, Wadsworth, Belmont, MA (1984)
4. Hothorn, T., Hornik, K., Achim, Z.: Unbiased recursive partitioning: A conditional inference framework. Journal of Computational and Graphical Statistics 15, 651-674 (2006)
5. Kira, K., Rendell, L.A.: A practical approach to feature selection. In: Proceedings of the Ninth International Workshop on Machine Learning, Aberdeen, Scotland, United Kingdom, pp. 249-256 (1992)
6. Kononenko, I.: On biases in estimating multi-valued attributes. In: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, Montral, Canada, pp. 1034-1040 (1995)
7. Quinlan, J.R.: Induction of decision trees. Machine Learning 1(1), 81-106 (1986)
8. Radivojac, P., Obradovic, Z., Dunker, A.K., Vucetic, S.: Feature selection filters based on the permutation test. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) ECML 2004. LNCS (LNAI), vol. 3201, Springer, Heidelberg (2004)
9. Strobl, C., Boulesteix, A.-L., Zeileis, A., Hothorn, T.: Bias in random forest variable importance measures: Illustrations, sources and a solution. BMC Bioinformatics 8(25) (January 2007)
10. Tuv, E., Borisov, A., Runger, G., Torkkola, K.: Feature selection with ensembles, artificial variables, and redundancy elimination. Journal of Machine Learning Research 10, 1341-1366 (2009)
11. White, A.P., Liu, W.Z.: Technical note: Bias in information-based measures in decision tree induction. Machine Learning 15(3), 321-329 (1994)