An AUC-based permutation variable importance measure for random forests

BMC Bioinformatics

Volumn 14, Issue , 2013, Pages

  Janitza, Silke ^a   Strobl, Carolin ^b   Boulesteix, Anne Laure ^a  

^a UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Area under the curve.; Class imbalance; Conditional inference trees; Feature selection; Random forest; Unbalanced data; Variable importance measure

Indexed keywords

AREA UNDER THE CURVES; CLASS IMBALANCE; CONDITIONAL INFERENCE; RANDOM FORESTS; UNBALANCED DATA; VARIABLE IMPORTANCES;

DECISION TREES; FEATURE EXTRACTION; FORESTRY;

TREES (MATHEMATICS);

DECISION MAKING; FORESTRY; MATHEMATICS; TREES;

ALGORITHM; AREA UNDER THE CURVE; ARTICLE; RNA EDITING; SAMPLE SIZE;

ALGORITHMS; AREA UNDER CURVE; RNA EDITING; SAMPLE SIZE;

EID: 84875818068     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/1471-2105-14-119     Document Type: Article

References (31)

1. Breiman L. Random forests. Machine Learning 2001, 45:5-32.
2. Boulesteix AL, Janitza S, Kruppa J, König I. Overview of random forest methodology and practical guidance with emphasis on computational biology and bioinformatics. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 2012, 2(6):493-507.
3. Briggs F, Goldstein B, McCauley J, Zuvich R, De Jager P, Rioux J, Ivinson A, Compston A, Hafler D, Hauser S. Variation within DNA repair pathway genes and risk of multiple sclerosis. Am J Epidemiol 2010, 172(2):217. 10.1093/aje/kwq086, 20522537.
4. Chang J, Yeh R, Wiencke J, Wiemels J, Smirnov I, Pico A, Tihan T, Patoka J, Miike R, Sison J. Pathway analysis of single-nucleotide polymorphisms potentially associated with glioblastoma multiforme susceptibility using random forests. Cancer Epidemiol Biomarkers Prev 2008, 17(6):1368-1373. 10.1158/1055-9965.EPI-07-2830, 18559551.
5. Liu C, Ackerman H, Carulli J. A genome-wide screen of gene-gene interactions for rheumatoid arthritis susceptibility. Hum Genet 2011, 129(5):473-485. 10.1007/s00439-010-0943-z, 21210282.
6. Nicodemus K, Callicott J, Higier R, Luna A, Nixon D, Lipska B, Vakkalanka R, Giegling I, Rujescu D, Clair D. Evidence of statistical epistasis between DISC1, CIT and NDEL1 impacting risk for schizophrenia: biological validation with functional neuroimaging. Hum Genet 2010, 127(4):441-452. 10.1007/s00439-009-0782-y, 20084519.
7. Sun Y, Cai Z, Desai K, Lawrance R, Leff R, Jawaid A, Kardia S, Yang H. Classification of rheumatoid arthritis status with candidate gene and genome-wide single-nucleotide polymorphisms using random forests. BMC Proceedings 2007, 1(Suppl 1):S62. 10.1186/1753-6561-1-s1-s62, 2367463, 18466563.
8. Blagus R, Lusa L. Class prediction for high-dimensional class-imbalanced data. BMC Bioinformatics 2010, 11:523. 10.1186/1471-2105-11-523, 3098087, 20961420.
9. Lin WJ, Chen J. Class-imbalanced classifiers for high-dimensional data. Brief Bioinform 2012,
10. Khoshgoftaar T, Golawala M, Van Hulse J. An empirical study of learning from imbalanced data using random forest. Tools with Artificial Intelligence, 2007 2007, 310-317. ICTAI 2007: 19th IEEE International Conference on, Volume 2, IEEE.
11. Huang Y, Hung C, Jiau H. Evaluation of neural networks and data mining methods on a credit assessment task for class imbalance problem. Nonlinear Analysis: Real World Applications 2006, 7(4):720-747.
12. Fawcett T, Provost F. Adaptive fraud detection. Data Mining and Knowledge Discovery 1997, 1(3):291-316.
13. Kubat M, Holte R, Matwin S. Machine learning for the detection of oil spills in satellite radar images. Machine Learning 1998, 30(2):195-215.
14. Chen C, Liaw A, Breiman L. Using random forest to learn imbalanced data 2004, University of California, Berkeley: Tech. rep, [http://statistics.berkeley.edu/tech-reports/666].
15. Xie Y, Li X, Ngai E, Ying W. Customer churn prediction using improved balanced random forests. Expert Systems with Applications 2009, 36(3):5445-5449.
16. Batista G, Prati R, Monard M. A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explorations Newsletter 2004, 6:20-29.
17. Estabrooks A, Jo T, Japkowicz N. A multiple resampling method for learning from imbalanced data sets. Computational Intelligence 2004, 20:18-36.
18. Van Hulse J, Khoshgoftaar T, Napolitano A. Experimental perspectives on learning from imbalanced data 2007, 935-942. ACM: In Proceedings of the 24th International Conference on Machine Learning.
19. Van Hulse J, Khoshgoftaar T. Knowledge discovery from imbalanced and noisy data. Data & Knowledge Engineering 2009, 68(12):1513-1542. 10.1016/j.datak.2009.08.005, 23573530.
20. Japkowicz N, Stephen S. The class imbalance problem: A systematic study. Intelligent Data Analysis 2002, 6(5):429-449.
21. Khalilia M, Chakraborty S, Popescu M. Predicting disease risks from highly imbalanced data using random forest. BMC Med Inform Decis Mak 2011, 11:51. 10.1186/1472-6947-11-51, 3163175, 21801360.
22. Strobl C, Boulesteix AL, Zeileis A, Hothorn T. Bias in random forest variable importance measures: Illustrations, sources and a solution. BMC Bioinformatics 2007, 8:25. 10.1186/1471-2105-8-25, 1796903, 17254353.
23. Nicodemus KK, Malley JD. Predictor correlation impacts machine learning algorithms: implications for genomic studies. Bioinformatics 2009, 25(15):1884-1890. 10.1093/bioinformatics/btp331, 19460890.
24. Nicodemus KK. Letter to the editor: On the stability and ranking of predictors from random forest variable importance measures. Brief Bioinform 2011, 12(4):369-373. 10.1093/bib/bbr016, 3137934, 21498552.
25. Boulesteix AL, Bender A, Bermejo JL, Strobl C. Random forest Gini importance favours SNPs with large minor allele frequency: assessment, sources and recommendations. Brief Bioinform 2012, 13:292-304. 10.1093/bib/bbr053, 21908865.
26. Calle M, Urrea V, Boulesteix AL, Malats N. AUC-RF: A new strategy for genomic profiling with random forest. Hum Hered 2011, 72(2):121-132. 10.1159/000330778, 21996641.
27. Hothorn T, Hornik K, Zeileis A. Unbiased recursive partitioning: A conditional inference framework. J Comput Graph Stat 2006, 15(3):651-674.
28. Pepe M. The statistical evaluation of medical tests for classification and prediction 2004, USA: Oxford University Press.
29. Hothorn T, Hornik K, Zeileis A. Party: a laboratory for recursive partytioning 2012, 0-3. R package version, URL http://cran.r-project.org/package=party.
30. Cummings M, Myers D. Simple statistical models predict C-to-U edited sites in plant mitochondrial RNA. BMC Bioinformatics 2004, 5:132. 10.1186/1471-2105-5-132, 521485, 15373947.
31. Nicodemus KK, Malley J, Strobl C, Ziegler A. The behavior of random forest permutation-based variable importance measures under predictor correlation. BMC Bioinformatics 2010, 11:110. 10.1186/1471-2105-11-110, 2848005, 20187966.