VSURF: An R package for variable selection using random forests

R Journal

Volumn 7, Issue 2, 2015, Pages 19-33

  Genuer, Robin ^a,b   Poggi, Jean Michel ^c   Tuleau Malot, Christine ^d  

^a UNIVERSITÉ DE BORDEAUX   (France)

^b INRIA   (France)

^c UNIVERSITÉ PARIS SACLAY   (France)

^d UNIVERSITÉ CÔTE D'AZUR   (France)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84954146796     PISSN: None     EISSN: 20734859     Source Type: Journal    
DOI: 10.32614/rj-2015-018     Document Type: Article

References (43)

1. K. J. Archer and R. V. Kimes. Empirical characterization of random forest variable importance measures. Computational Statistics&Data Analysis, 52(4):2249-2260, 2008. [p20]
2. R. Azen and D. V. Budescu. The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods, 8(2):129-148, 2003. [p20]
3. A.-L. Boulesteix, S. Janitza, J. Kruppa, and I. R. König. Overview of random forest methodology and practical guidance with emphasis on computational biology and bioinformatics. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2(6):493-507, 2012. [p19]
4. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996. [p20]
5. L. Breiman. Random forests. Machine Learning, 45(1):5-32, 2001. [p19, 20]
6. L. Breiman and A. Cutler. Random forest manual. 2004. URL http://www.stat.berkeley.edu/~breiman/RandomForests/cc_manual.htm. [p20, 21]
7. L. Breiman, J. Friedman, R. Olshen, and C. Stone. Classification and Regression Trees. Chapman&Hall, New York, 1984. [p19]
8. P. Bushel, R. Wolfinger, and G. Gibson. Simultaneous clustering of gene expression data with clinical chemistry and pathological evaluations reveals phenotypic prototypes. BMC Systems Biology, 1(1):15, 2007. [p29]
9. J. M. Cadenas, M. Carmen Garrido, and R. Martínez. Feature subset selection filter-wrapper based on low quality data. Expert Systems with Applications, 40(16):6241-6252, 2013. [p20]
10. N. Chèze, J.-M. Poggi, and B. Portier. Partial and recombined estimators for nonlinear additive models. Statistical Inference for Stochastic Processes, 6(2):155-197, 2003. [p28]
11. R. Díaz-Uriarte. GeneSrF and varSelRF: A web-based tool and R package for gene selection and classification using random forest. BMC Bioinformatics, 8(1):328, 2007. [p20]
12. R. Díaz-Uriarte and S. Alvarez De Andres. Gene selection and classification of microarray data using random forest. BMC Bioinformatics, 7(1):3, 2006. [p20, 30, 31]
13. R. Genuer, J.-M. Poggi, and C. Tuleau. Random forests: Some methodological insights. 2008. arXiv:0811.3619. [p26]
14. R. Genuer, V. Michel, E. Eger, and B. Thirion. Random forests based feature selection for decoding fMRI data. In Proceedings of COMPSTAT'2010 - 19th International Conference on Computational Statistics, pages 1071-1078, 2010a. [p21]
15. R. Genuer, J.-M. Poggi, and C. Tuleau-Malot. Variable selection using random forests. Pattern Recognition Letters, 31(14):2225-2236, 2010b. [p19, 20, 21, 22, 23, 27]
16. L. Gidskehaug, E. Anderssen, A. Flatberg, and B. K. Alsberg. A framework for significance analysis of gene expression data using dimension reduction methods. BMC Bioinformatics, 8(1):346, 2007. [p29]
17. I. González, K.-A. Lê Cao, M. J. Davis, and S. Déjean. Visualising associations between paired 'omics' data sets. BioData Mining, 5(1):1-23, 2012. [p29, 30]
18. B. Gregorutti, B. Michel, and P. Saint-Pierre. Correlation and variable importance in random forests. 2013. arXiv:1310.5726. [p20, 21]
19. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003. [p20]
20. A. Hapfelmeier and K. Ulm. A new variable selection approach using random forests. Computational Statistics&Data Analysis, 60:50-69, 2012. [p20]
21. T. Hastie, R. Tibshirani, and J. H. Friedman. The Elements of Statistical Learning. Springer-Verlag, New York, 2001. [p19]
22. A. N. Heinloth, R. D. Irwin, G. A. Boorman, P. Nettesheim, R. D. Fannin, S. O. Sieber, M. L. Snell, C. J. Tucker, L. Li, G. S. Travlos, G. Vansant, P. E. Blackshear, R. W. Tennant, M. L. Cunningham, and R. S. Paules. Gene expression profiling of rat livers reveals indicators of potential adverse effects. Toxicological Sciences, 80(1):193-202, 2004. [p29]
23. T. Hothorn, K. Hornik, and A. Zeileis. Unbiased recursive partitioning: A conditional inference framework. Journal of Computational and Graphical Statistics, 15(3):651-674, 2006. [p19]
24. J. Khan, J. S. Wei, M. Ringner, L. H. Saal, M. Ladanyi, F. Westermann, F. Berthold, M. Schwab, C. R. Antonescu, C. Peterson, and P. S. Meltzer. Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nature Medicine, 7(6):673-679, 2001. [p30]
25. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 97(1):273-324, 1997. [p20]
26. M. B. Kursa and W. R. Rudnicki. Feature selection with the Boruta package. Journal of Statistical Software, 36(11):1-13, 2010. [p20, 29]
27. K.-A. Lê Cao and P. Chabrier. ofw: An R package to select continuous variables for multiclass classification with a stochastic wrapper method. Journal of Statistical Software, 28(9):1-16, 2008. [p20, 30]
28. K.-A. Lê Cao, D. Rossouw, C. Robert-Granié, and P. Besse. A sparse PLS for variable selection when integrating omics data. Statistical Applications in Genetics and Molecular Biology, 7(1), 2008. [p29]
29. K.-A. Lê Cao, I. Gonzalez, and S. Dejean. mixOmics: Omics Data Integration Project, 2015. URL https://CRAN.R-project.org/package=mixOmics. R package version 5.0-4, with key contributions from F. Rohart and B. Gautier and contributions from P. Monget, J. Coquery, F. Yao and B. Liquet. [p29]
30. F. Leisch and E. Dimitriadou. mlbench: Machine Learning Benchmark Problems, 2010. URL https://CRAN.R-project.org/package=mlbench. R package version 2.1-1. [p27]
31. A. Liaw and M.Wiener. Classification and regression by randomForest. R News, 2(3):18-22, 2002. [p19]
32. G. Louppe, L.Wehenkel, A. Sutera, and P. Geurts. Understanding variable importances in forests of randomized trees. In Advances in Neural Information Processing Systems, pages 431-439, 2013. [p21]
33. N. Meinshausen and P. Bühlmann. Stability selection. Journal of the Royal Statistical Society B, 72(4):417-473, 2010. [p27]
34. R. Nilsson, J. M. Peña, J. Björkegren, and J. Tegnér. Consistent feature selection for pattern recognition in polynomial time. Journal of Machine Learning Research, 8:589-612, 2007. [p21]
35. A. Peters, T. Hothorn, and B. Lausen. ipred: Improved predictors. R News, 2(2):33-36, 2002. [p20]
36. F. Scheipl. spikeSlabGAM: Bayesian variable selection, model choice and regularization for generalized additive mixed models in R. Journal of Statistical Software, 43(14):1-24, 2011. [p20]
37. C. Strobl, A.-L. Boulesteix, A. Zeileis, and T. Hothorn. Bias in random forest variable importance measures: Illustrations, sources and a solution. BMC Bioinformatics, 8(1):25, 2007. [p20]
38. C. Strobl, A.-L. Boulesteix, T. Kneib, T. Augustin, and A. Zeileis. Conditional variable importance for random forests. BMC Bioinformatics, 9(1):307, 2008. [p20]
39. V. Svetnik, A. Liaw, C. Tong, and T. Wang. Application of Breiman's random forest to modeling structure-activity relationships of pharmaceutical molecules. In Multiple Classifier Systems, pages 334-343. Springer, 2004. [p27]
40. T. Therneau, B. Atkinson, and B. Ripley. rpart: Recursive Partitioning and Regression Trees, 2015. URL https://CRAN.R-project.org/package=rpart. R package version 4.1-9. [p19]
41. A. Verikas, A. Gelzinis, and M. Bacauskiene. Mining data with random forests: A survey and results of new tests. Pattern Recognition, 44(2):330-349, 2011. [p19]
42. H. R. Wehrens, M. Johan, and P. Franceschi. Meta-statistics for variable selection: The R package BioMark. Journal of Statistical Software, 51(10):1-18, 2012. [p20]
43. J. Weston, A. Elisseeff, B. Schölkopf, and M. Tipping. Use of the zero norm with linear models and kernel methods. Journal of Machine Learning Research, 3:1439-1461, 2003. [p23]