Understanding variable importances in Forests of randomized trees

Advances in Neural Information Processing Systems

Volumn , Issue , 2013, Pages

  Louppe, Gilles ^a   Wehenkel, Louis ^a   Sutera, Antonio ^a   Geurts, Pierre ^a  

^a UNIVERSITY OF LIÈGE   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

DEGREE OF INTERACTION; INPUT VARIABLES; INTERACTION TERM; IRRELEVANT VARIABLES; RANDOMIZED TREES; THEORETICAL POINTS; TREE-BASED ENSEMBLES; VARIABLE IMPORTANCES;

DECISION TREES;

EID: 84898857912     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Biau, G. (2012). Analysis of a random forests model. The Journal of Machine Learning Research, 98888:1063-1095.
2. Biau, G., Devroye, L., and Lugosi, G. (2008). Consistency of random forests and other averaging classifiers. The Journal of Machine Learning Research, 9:2015-2033.
3. Breiman, L. (1996). Bagging predictors. Machine learning, 24(2):123-140.
4. Breiman, L. (2001). Random forests. Machine learning, 45(1):5-32.
5. Breiman, L. (2002). Manual on setting up, using, and understanding random forests v3. 1. Statistics Department University of California Berkeley, CA, USA.
6. Breiman, L. (2004). Consistency for a simple model of random forests. Technical report, UC Berkeley.
7. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (1984). Classification and regression trees.
8. Genuer, R., Poggi, J.-M., and Tuleau-Malot, C. (2010). Variable selection using random forests. Pattern Recognition Letters, 31(14):2225-2236.
9. Geurts, P., Ernst, D., and Wehenkel, L. (2006). Extremely randomized trees. Machine Learning, 63(1):3-42.
10. Ho, T. (1998). The random subspace method for constructing decision forests. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 20(8):832-844.
11. Ishwaran, H. (2007). Variable importance in binary regression trees and forests. Electronic Journal of Statistics, 1:519-537.
12. Kohavi, R. and John, G. H. (1997). Wrappers for feature subset selection. Artificial intelligence, 97(1):273-324.
13. Liaw, A. andWiener, M. (2002). Classification and regression by randomforest. R news, 2(3):18-22.
14. Lin, Y. and Jeon, Y. (2006). Random forests and adaptive nearest neighbors. Journal of the American Statistical Association, 101(474):578-590.
15. Meinshausen, N. (2006). Quantile regression forests. The Journal of Machine Learning Research, 7:983-999.
16. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., et al. (2011). Scikit-learn: Machine learning in python. The Journal of Machine Learning Research, 12:2825-2830.
17. Strobl, C., Boulesteix, A.-L., Kneib, T., Augustin, T., and Zeileis, A. (2008). Conditional variable importance for random forests. BMC bioinformatics, 9(1):307.
18. Strobl, C., Boulesteix, A.-L., Zeileis, A., and Hothorn, T. (2007). Bias in random forest variable importance measures: Illustrations, sources and a solution. BMC bioinformatics, 8(1):25.
19. White, A. P. and Liu, W. Z. (1994). Technical note: Bias in information-based measures in decision tree induction. Machine Learning, 15(3):321-329.
20. Zhao, G. (2000). A new perspective on classification. PhD thesis, Utah State University, Department of Mathematics and Statistics.