Bias in random forest variable importance measures: Illustrations, sources and a solution

BMC Bioinformatics

Volumn 8, Issue , 2007, Pages

  Strobl, Carolin ^a   Boulesteix, Anne Laure ^b   Zeileis, Achim ^c   Hothorn, Torsten ^d  

^a UNIVERSITY OF MUNICH   (Germany)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c VIENNA UNIVERSITY OF ECONOMICS AND BUSINESS   (Austria)

^d UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BOOTSTRAP SAMPLINGS; CLASSIFICATION TASKS; CLASSIFICATION TREES; COMPUTATIONAL BIOLOGY; CONTINUOUS VARIABLES; RANDOM FOREST ALGORITHM; STATISTICAL COMPUTING; VARIABLE IMPORTANCES;

AMINO ACIDS; BIOINFORMATICS; COMPUTER AIDED DIAGNOSIS;

DECISION TREES;

ALGORITHM; AMINO ACID SEQUENCE; ARTICLE; BIOINFORMATICS; COMPUTER ANALYSIS; GENOMICS; INFORMATION PROCESSING; INTERNAL BIAS; NONHUMAN; PREDICTION; RELIABILITY; RNA ANALYSIS; SEQUENCE ANALYSIS; SIMULATION; BIOLOGICAL MODEL; BIOLOGY; COMPUTER SIMULATION; POPULATION DYNAMICS; PROCEDURES; STATISTICAL ANALYSIS; STATISTICAL BIAS; STATISTICAL MODEL;

ALGORITHMS; BIAS (EPIDEMIOLOGY); COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; GENOMICS; MODELS, BIOLOGICAL; MODELS, STATISTICAL; POPULATION DYNAMICS;

EID: 33847096395     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/1471-2105-8-25     Document Type: Article

References (38)

1. Bureau A Dupuis J Falls K Lunetta KL Hayward B Keith TP Eerdewegh PV Identifying SNPs Predictive of Phenotype Using Random Forests Genetic Epidemiology 2005 28 171 182 10.1002/gepi.20041 15593090
2. Heidema AG Boer JMA Nagelkerke N Mariman ECM van der A DL Feskens EJM The Challenge for Genetic Epidemiologists: How to Analyze Large Numbers of SNPs in Relation to Complex Diseases BMC Genetics 2006 7 23 1479365 16630340 10.1186/1471-2156-7-23
3. Breiman L Random Forests Machine Learning 2001 45 5 32 10.1023/ A:1010933404324
4. Díaz-Uriarte R Alvarez de Andrés S Gene Selection and Classification of Microarray Data Using Random Forest BMC Bioinformatics 2006 7 3 1363357 16398926 10.1186/1471-2105-7-3
5. Lunetta KL Hayward LB Segal J Eerdewegh PV Screening Large-Scale Association Study Data: Exploiting Interactions Using Random Forests BMC Genetics 2004 5 32 545646 15588316 10.1186/1471-2156-5-32
6. Gunther EC Stone DJ Gerwien RW Bento P Heyes MP Prediction of Clinical Drug Efficacy by Classification of Drug-induced Genomic Expression Profiles in vitro Proceedings of the National Academy of Sciences 2003 100 9608 9613 10.1073/pnas.1632587100
7. Huang X Pan W Grindle S Han X Chen Y Park SJ Miller LW Hall J A Comparative Study of Discriminating Human Heart Failure Etiology Using Gene Expression Profiles BMC Bioinformatics 2005 6 205 1224853 16120216 10.1186/1471-2105-6-205
8. Shih Y Tumor Classification by Tissue Microarray Profiling: Random Forest Clustering Applied to Renal Cell Carcinoma Modern Pathology 2005 18 547 557 10.1038/modpathol.3800322 15529185
9. Segal MR Barbour JD Grant RM Relating HIV-1 Sequence Variation to Replication Capacity via Trees and Forests Statistical Applications in Genetics and Molecular Biology 2004 3 2
10. Cummings MP Segal MR Few Amino Acid Positions in rpoB are Associated with Most of the Rifampin Resistance in Mycobacterium Tuberculosis BMC Bioinformatics 2004 5 137 524371 15453919 10.1186/1471-2105-5-137
11. Cummings MP Myers DS Simple Statistical Models Predict C-to-U Edited Sites in Plant Mitochondrial RNA BMC Bioinformatics 2004 5 132 521485 15373947 10.1186/1471-2105-5-132
12. Qi Y Bar-Joseph Z Klein-Seetharaman J Evaluation of Different Biological Data and Computational Classification Methods for Use in Protein Interaction Prediction Proteins 2006 63 490 500 10.1002/prot.20865 16450363
13. Guha R Jurs PC Development of Linear, Ensemble, and Nonlinear Models for the Prediction and Interpretation of the Biological Activity of a Set of PDGFR Inhibitors Journal of Chemical Information and Computer Sciences 2003 44 2179-2189 10.1021/ci049849f
14. Svetnik V Liaw A Tong C Culberson JC Sheridan RP Feuston BP Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling Journal of Chemical Information and Computer Sciences 2003 43 1947-958 10.1021/ci034160g
15. Arun K Langmead CJ Structure Based Chemical Shift Prediction Using Random Forests Non-linear Regression Proceedings of the Fourth Asia-Pacific Bioinformatics Conference, Taipei, Taiwan Jiang T, Yang UC, Chen YPP, Wong L 2006 317-326
16. Furlanello C Neteler M Merler S Menegon S Fontanari S Donini D Rizzoli A Chemini C GIS and the Random Forest Predictor: Integration in R for Tick-Borne Disease Risk Assessment Proceedings of the 3rd International Workshop on Distributed Statistical Computing, Vienna, Austria Hornik K, Leisch F, Zeileis A 2003 http://www.ci.tuwien.ac.at/Conferences/DSC-2003/ Proceedings/
17. Ward MM Pajevic S Dreyfuss J Malley JD Short-Term Prediction of Mortality in Patients with Systemic Lupus Erythematosus: Classification of Outcomes Using Random Forests Arthritis and Rheumatism 2006 55 74-80 10.1002/art.21695
18. Breiman L Friedman JH Olshen RA Stone CJ Classification and Regression Trees New York: Chapman and Hall 1984
19. Friedman J Greedy Function Approximation: A Gradient Boosting Machine The Annals of Statistics 2001 29 1189 1232 10.1214/aos/1013203451
20. R Development Core Team R: A Language and Environment for Statistical Computing R Foundation for Statistical Computing, Vienna, Austria 2006 http://www.R-project.org/
21. Breiman L Cutler A Liaw A Wiener M Breiman and Cutler's Random Forests for Classification and Regression 2006 http://CRAN.R-project.org/ [R package version 4.5-16].
22. Liaw A Wiener M Classification and Regression by randomForest R News 2002 2 18-22 http://CRAN.R-project.org/doc/Rnews/
23. Hothorn T Hornik K Zeileis A party: A Laboratory for Recursive Part(y)itioning 2006 http://CRAN.R-project.org/ [R package version 0.9-0].
24. Kononenko I On Biases in Estimating Multi-Valued Attributes Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, Montréal, Canada Mellish C 1995 1034-1040
25. Kim H Loh W Classification Trees with Unbiased Multiway Splits Journal of the American Statistical Association 2001 96 589-604 10.1198/ 016214501753168271
26. Boulesteix AL Maximally Selected Chi-square Statistics for Ordinal Variables Biometrical Journal 2006 48 451-462 10.1002/bimj.200510161 16845908
27. Boulesteix AL Maximally Selected Chi-square Statistics and Binary Splits of Nominal Variables Biometrical Journal 2006 48 838-848 10.1002/ bimj.200510191 17094347
28. Strobl C Boulesteix AL Augustin T Unbiased Split Selection for Classification Trees Based on the Gini Index Computational Statistics & Data Analysis 2006 http://dx.doi.org/10.1016/j.csda.2006.12.030
29. Hothorn T Hornik K Zeileis A Unbiased Recursive Partitioning: A Conditional Inference Framework Journal of Computational and Graphical Statistics 2006 15 651-674 10.1198/106186006X133933
30. Friedman J Hall P On Bagging and Nonlinear Estimation preprint 1999 http://www-stat.stanford.edu/~jhf/
31. Bühlmann P Yu B Analyzing Bagging The Annals of Statistics 2002 30 927-961 10.1214/aos/1031689014
32. Politis DN Romano JP Wolf M Subsampling New York: Springer 1999
33. Dobra A Gehrke J Bias Correction in Classification Tree Construction Proceedings of the Seventeenth International Conference on Machine Learning, Williams College, Williamstown, MA, USA Brodley CE, Danyluk AP 2001 90-97
34. Strobl C Statistical Sources of Variable Selection Bias in Classification Tree Algorithms Based on the Gini Index Discussion Paper 420, SFB "Statistical Analysis of Discrete Structures", Munich, Germany 2005 http://www.stat.uni-muenchen.de/sfb386/papers/dsp/ paper420.ps
35. Strobl C Variable Selection in Classification Trees Based on Imprecise Probabilities Proceedings of the Fourth International Symposium on Imprecise Probabilities and Their Applications, Carnegy Mellon University, Pittsburgh, PA, USA Cozman F, Nau R, Seidenfeld T 2005 340-348
36. Therneau TM Atkinson B Ripley BD rpart: Recursive Partitioning 2006 http://CRAN.R-project.org/ [R package version 3.1-30].
37. Bickel PJ Ren JJ The Bootstrap in Hypothesis Testing State of the Art in Probability and Statistics, Festschrift for Willem R. van Zwet, IMS Lecture Notes Monograph Series, Beachwood, OH, USA de Gunst M, Klaassen C, van der Vaart A 2001 36 91-112
38. van der Laan M Statistical Inference for Variable Importance International Journal of Biostatistics 2006 2 1008-1008