Data mining in the life science swith random forest: A walk in the park or lost in the jungle?

Briefings in Bioinformatics

Volumn 14, Issue 3, 2013, Pages 315-326

  Touw, Wouter G ^a   Bayjanov, Jumamurat R ^b   Overmars, Lex ^a   Backus, Lennart ^b   Boekhorst, Jos ^c   Wels, Michiel ^c   Sacha van Hijum, A F T ^a,c  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^c NIZO FOOD RESEARCH   (Netherlands)

Author keywords

Conditional relationships; Local importance; Proximity; Random Forest; Variable importance; Variable interaction

Indexed keywords

ALGORITHM; ARTICLE; BIOMEDICINE; CONDITIONAL RELATIONSHIPS; DATA MINING; GENETICS; HUMAN; LOCAL IMPORTANCE; NEOPLASM; PROXIMITY; RANDOM FOREST; SINGLE NUCLEOTIDE POLYMORPHISM; VARIABLE IMPORTANCE; VARIABLE INTERACTION;

CONDITIONAL RELATIONSHIPS; LOCAL IMPORTANCE; PROXIMITY; RANDOM FOREST; VARIABLE IMPORTANCE; VARIABLE INTERACTION;

ALGORITHMS; BIOLOGICAL SCIENCE DISCIPLINES; DATA MINING; HUMANS; NEOPLASMS; POLYMORPHISM, SINGLE NUCLEOTIDE;

EID: 84871787691     PISSN: 14675463     EISSN: 14774054     Source Type: Journal    
DOI: 10.1093/bib/bbs034     Document Type: Article

References (114)

1. Ideker T, Galitski T, Hood L. A new approach to decoding life: systems biology. AnnuRev GenomicsHumGenet 2001;2: 343-72.
2. Kitano H. Systems biology: a brief overview. Science 2002; 295:1662-4.
3. Chuang H-Y, Hofree M, Ideker T. A decade of systems biology. AnnuRevCellDev Biol 2010;26:721-44.
4. Ghosh S, Matsuoka Y, Asai Y, et al. Software for systems biology: from tools to integrated platforms. Nat Rev Genet 2011;12:821-32.
5. Gehlenborg N, O-Donoghue SI, Baliga NS, et al. Visualization of omics data for systems biology. Nat Methods 2010;7:S56-68.
6. Larranaga P. Machine learning in bioinformatics. Brief Bioinform 2006;7:86-112.
7. Verikas A, Gelzinis A, Bacauskiene M. Mining data with random forests: a survey and results of new tests. Pattern Recognit 2011;44:330-49.
8. Breiman L. Random Forests. Mach Learn 2001;45:5-32.
9. Boser BE, Guyon IM, Vapnik VN. A training algorithm for optimal margin classifiers. In: Proceedings of the fifth annualworkshop on Computational learning theory -COLT -92,1992;144-52.
10. Cortes C, Vapnik V. Support-vector networks. Mach Learn 1995;20:273-97.
11. McCulloch WS, Pitts W. A logical calculus of the ideas immanent in nervous activity. BullMathBiophys 1943;5:115-33.
12. Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev 1958;65:386-408.
13. Rumelhart DE, Hinton GE, Williams RJ. Learning representations by back-propagating errors. Nature 1986;323: 533-36.
14. Friedman N, Geiger D, Goldszmidt M. Bayesian network classifiers. Mach Learn 1997;29:131-63.
15. Minsky M. Steps toward artificial intelligence. Proc IRE 1961;49:8-30.
16. Kleinbaum DG, Kupper LL, Chambless LE. Logistic regression analysis of epidemiologic data: theory and practice. Commun StatTheory 1982;11:485-547.
17. Fixt E, Hodges JL. Discriminatory analysis-nonparametric discrimination: consistency properties. Int Stat Rev 1989;57: 238-47.
18. Fischer RA. The use of multiple measurements in taxonomic problems. AnnHum Genet 1936;7:179-88.
19. Friedman JH. Regularized discriminant analysis. J Am Stat Assoc 1989;84:165-75.
20. Wold H. Soft modeling by latent variables: the nonlinear iterative partial least squares approach. Perspectives in Probability and Statistics, Papers inHonour ofM. S. Bartlett 1975.
21. Breiman L, Friedman JH, Olshen RA, et al. Classification and regression trees. TheWadsworth Statistics Probability Series 1984;19:368.
22. Hastie T, Tibshirani R, Friedman J. TheElements ofStatistical Learning: Data Mining, Inference, and Prediction. 2nd edn. New York: Springer-Verlag, 2009.
23. Tarca AL, Carey VJ, Chen X-wen, et al. Machine learning and its applications to biology. PLoS Comput Biol 2007;3: e116.
24. Statnikov A, Wang L, Aliferis CF. A comprehensive comparison of random forests and support vector machines for microarray-based cancer classification. BMC Bioinformatics 2008;9:319.
25. DyÝaz-Uriarte R, Alvarez de Andre's S. Gene selection and classification of microarray data using random forest. BMC Bioinformatics 2006;7:3.
26. Jiang P, Wu H, Wang W, et al. MiPred: classification of real and pseudo microRNA precursors using random forest prediction model with combined features. Nucleic Acids Res 2007;35:W339-44.
27. Pang H, Lin A, Holford M, et al. Pathway analysis using random forests classification and regression. Bioinformatics 2006;22:2028-36.
28. Bao L, Cui Y. Prediction of the phenotypic effects of non-synonymous single nucleotide polymorphisms using structural and evolutionary information. Bioinformatics 2005;21:2185-90.
29. Qi Y, Bar-Joseph Z, Klein-seetharaman J. Evaluation of different biological data and computational classification methods for use in protein interaction. Bioinformatics 2006; 500:490-500.
30. Bellman RE. RandCorporation Dynamic Programming. Princeton: Princeton University Press, 1957;342.
31. Somorjai RL, Dolenko B, Baumgartner R. Class prediction and discovery using gene microarray and proteomics mass spectroscopy data: curses, caveats, cautions. Bioinformatics 2003;19:1484-91.
32. Bureau A, Dupuis J, Falls K, et al. Identifying SNPs predictive of phenotype using random forests. Genet Epidemiol 2005;28:171-82.
33. Sampson DL, Parker TJ, Upton Z, et al. A comparison of methods for classifying clinical samples based on proteomics data: a case study for statistical and machine learning approaches. PLoS One 2011;6:e24973.
34. Moore JH, Asselbergs FW, Williams SM. Bioinformatics challenges for genome-wide association studies. Bioinformatics 2010;26:445-55.
35. Arumugam M, Raes J, Pelletier E, et al. Enterotypes of the human gut microbiome. Nature 2011;473:174-80.
36. Fusaro VA, Mani DR, Mesirov JP, et al. Prediction of high-responding peptides for targeted protein assays by mass spectrometry. Nat Biotechnol 2009;27:190-8.
37. Nicholson JK, Connelly J, Lindon JC, et al. Metabonomics: a platform for studying drug toxicity and gene function. Nat RevDrugDiscov 2002;1:153-61.
38. Goh C-S, Lan N, Douglas SM, et al. Mining the structural genomics pipeline: identification of protein properties that affect high-throughput experimental analysis. J Mol Biol 2004;336:115-30.
39. Chen X, Ishwaran H. Random forests for genomic data analysis. Genomics 2012;99:323-9.
40. Goldstein BA, Polley EC, Briggs FBS. Random forests for genetic association studies. StatAppl GenetMol Biol 2011;10: 1-34.
41. Breiman L, Cutler A. Random Forests. http://www.stat .berkeley.edu/breiman/RandomForests/.
42. Stone M. Cross-validatory choice and assessment of statistical predictions. JRoy Stat Soc BMet 1974;36:111-47.
43. Bayjanov JR, Molenaar D, Tzeneva V, Siezen RJ, van Hijum SAFT. PhenoLink - a web-tool for linking phenotype toomics data for bacteria: application to gene-trait matching for Lactobacillus plantarum strains. BMC Genomics 2012;13:170.
44. Liaw A, Wiener M. Classification and regression by randomForest. R News 2002;2:18-22.
45. R Development Core Team. R. ALanguage and Environment for Statistical Computing 2012.
46. Schwarz DF, Ko-nig IR, Ziegler A. On safari to Random Jungle: a fast implementation of Random Forests for high-dimensional data. Bioinformatics 2010;26:1752-8.
47. Zhang H, Wang M, Chen X. Willows: a memory efficient tree and forest construction package. BMC Bioinformatics 2009;10:130.
48. Frank E, Hall M, Trigg L, et al. Data mining in bioinformatics using Weka. Bioinformatics 2004;20:2479-81.
49. Alvarez S, Diaz-Uriarte R, Osorio A, etal. A predictor based on the somatic genomic changes of the BRCA1/BRCA2 breast cancer tumors identifies the non-BRCA1/BRCA2 tumors with BRCA1 promoter hypermethylation. Clin Cancer Res 2005;11:1146-53.
50. Briggs FBS, Bartlett SE, Goldstein BA, et al. Evidence for CRHR1 in multiple sclerosis using supervised machine learning and meta-analysis in 12,566 individuals. HumMol Genet 2010;19:4286-95.
51. Caporaso JG, Lauber CL, Costello EK, et al. Moving pictures of the human microbiome. Genome Biol 2011;12: R50.
52. Chen CCM, Schwender H, Keith J, etal. Methods for identifying snp interactions: a review on variations of logic regression, random forest and bayesian logistic regression. IEEE/ACM Trans Comput Biol Bioinf 2011;8: 1580-91.
53. Christensen BC, Houseman EA, Godleski JJ, et al. Epigenetic profiles distinguish pleural mesothelioma from normal pleura and predict lung asbestos burden and clinical outcome. Cancer Res 2009;69:227-34.
54. De Lobel L, Geurts P, Baele G, et al. A screening methodology based on Random Forests to improve the detection of gene-gene interactions. Eur J Hum Genet, 2010;18: 1127-32.
55. Dutilh BE, Jurgelenaite R, Szklarczyk R, et al. FACIL: fast and accurate genetic code inference and logo. Bioinformatics 2011;27:1929-33.
56. Lunetta KL, Hayward LB, Segal J, etal. Screening large-scale association study data: exploiting interactions using random forests. BMCGenet 2004;5:32.
57. Ma D, Xiao J, Li Y, et al. Feature importance analysis in guide strand identification of microRNAs. Comput Biol Chem 2011;35:131-6.
58. Meijerink M, van chemert S, Taverne N, et al. Identification of genetic loci in Lactobacillusplantarum that modulate the immune response of dendritic cells using ccomparative genome hybridization. PloS One 2010;5:e10632.
59. Ro-delsperger C, Guo G, Kolanczyk M, et al. Integrative analysis of genomic, functional and protein interaction data predicts long-range enhancer-target gene interactions. Nucleic Acids Res 2011;39:2492-502.
60. Roshan U, Chikkagoudar S, Wei Z, et al. Ranking causal variants and associated regions in genome-wide association studies by the support vector machine and random forest. Nucleic Acids Res 2011;39:e62.
61. Tsou JA, Galler JS, Siegmund KD, et al. Identification of a panel of sensitive and specific DNA methylation markers for lung adenocarcinoma. Mol Cancer 2007;6:70.
62. van chemert S, Meijerink M, Molenaar D, et al. Identification of Lactobacillus plantarum genes modulating the cytokine response of human peripheral blood mononuclear cells. BMCMicrobiol 2010;10:293.
63. Vingerhoets J, Tambuyzer L, Azijn H, et al. Resistance profile of etravirine: combined analysis of baseline genotypic and phenotypic data from the randomized, ccontrolled Phase III clinical studies. AIDS 2010;24:503-14.
64. Enot DP, Beckmann M, Draper J. On the interpretation of high throughput MS based metabolomics fingerprints with random forest. Metabolomics 2006;226-35..
65. Gupta S, Aires-de-Sousa J. Comparing the chemical spaces of metabolites and available chemicals: models of metabolite-likeness. Mol Divers 2007;11:23-36.
66. Pino Del Carpio D, Basnet RK, De Vos RCH, et al. Ccomparative methods for association studies: a case study on metabolite variation in a Brassica rapa core collection. PloS One 2011;6:e19624.
67. Finehout EJ, Franck Z, Choe LH, et al. Cerebrospinal fluid proteomic biomarkers for Alzheimer-s disease. Ann Neurol 2007;61:120-9.
68. Hettick JM, Kashon ML, Slaven JE, et al. Discrimination of intact mycobacteria at the strain level: a combined MALDI-TOF MS and biostatistical analysis. Proteomics 2006;6:6416-25.
69. Munro NP, Cairns DA, Clarke P, et al. Urinary biomarker profiling in transitional cell carcinoma. IntJCancer 2006;119: 2642-50.
70. Gunther EC, Stone DJ, Gerwien RW, et al. Prediction of clinical drug efficacy by classification of drug-induced genomic expression profiles in vitro. Proc Natl Acad Sci USA 2003;100:9608-13.
71. Guo L, Ma Y, Ward R, et al. Constructing molecular classifiers for the accurate prognosis of lung adenocarcinoma. ClinCancer Res 2006;12:3344-54.
72. Nannapaneni P, Hertwig F, Depke M, et al. Defining the structure of the general stress regulon of Bacillus subtilis using targeted microarray analysis and Random Forest classification. Microbiology 2012;158:696-707.
73. Riddick G, Song H, Ahn S, et al. Predicting in vitro drug sensitivity using Random Forests. Bioinformatics 2011;27: 220-4.
74. Tsuji S, Midorikawa Y, Takahashi T, et al. Potential responders to FOLFOX therapy for colorectal cancer by Random Forests analysis. BrJCancer 2011;1-7.
75. Wang X, Simon R. Microarray-based cancer prediction using single genes. BMC Bioinformatics 2011;12:391.
76. Wuchty S, Arjona D, Li A, et al. Prediction of associations between microRNAs and gene expression in glioma biology. PloS One 2011;6:e14681.
77. Bordner AJ. Predicting protein-protein binding sites in membrane proteins. BMC Bioinformatics 2009;10:312.
78. Chen X-wen, Jeong JC. Sequence-based prediction of protein interaction sites with an integrative method. Bioinformatics 2009;25:585-91.
79. Dybowski JN, Heider D, Hoffmann D. Prediction of co-receptor usage of HIV-1 from genotype. PLoS Comput Biol 2010;6:e1000743.
80. Han P, Zhang X, Norton RS, etal. Large-scale prediction of long disordered regions in proteins using random forests. BMC Bioinformatics 2009;10:8.
81. Heider D, Verheyen J, Hoffmann D. Predicting Bevirimat resistance of HIV-1 from genotype. BMC Bioinformatics 2010;11:37.
82. Hillenmeyer ME, Ericson E, Davis RW, et al. Systematic analysis of genome-wide fitness data in yeast reveals novel gene function and drug action. Genome Biol 2010;11:R30.
83. Li Y, Fang Y, Fang J. Predicting residue-residue contacts using random forest models. Bioinformatics 2011;1-7.
84. Li Y, Wen Z, Xiao J, et al. Predicting disease-associated substitution of a single amino acid by analyzing residue interactions. BMC Bioinformatics 2011;12:14.
85. Lin N, Wu B, Jansen R, et al. Information assessment on predicting protein-protein interactions. BMC Bioinformatics 2004;5:154.
86. Marino SR, Lin S, Maiers M, et al. Identification by random forest method of HLA class I amino acid substitutions associated with lower survival at day 100 in unrelated donor chematopoietic cell transplantation. Bone MarrowTransplant 2012;47:217-26.
87. Medema MH, Zhou M, van Hijum SAFT, etal. A predicted physicochemically distinct sub-proteome associated with the intracellular organelle of the anammox bacterium Kuenenia stuttgartiensis. BMCGenomics 2010;11:299.
88. Nayal M, Honig B. On the nature of cavities on protein surfaces: application to the identification of drug-binding sites. Proteins 2006;63:892-906.
89. Nimrod G, Szila-gyi A, Leslie C, et al. Identification of DNA-binding proteins using structural, electrostatic and evolutionary features. JMol Biol 2009;387:1040-53.
90. Radivojac P, Vacic V, Haynes C, et al. Identification, analysis, and prediction of protein ubiquitination sites. Proteins 2010;78:365-80.
91. Shi T, Seligson D, Belldegrun AS, et al. Tumor classification by tissue microarray profiling: random forest clustering applied to renal cell carcinoma. Mod Pathol 2005;18:547-57.
92. Slabbinck B, De Baets B, Dawyndt P, et al. Towards large-scale FAME-based bacterial species identification using machine learning techniques. Syst Appl Microbiol 2009;32:163-76.
93. Springer C, Adalsteinsson H, Young MM, et al. PostDOCK: a structural, empirical approach to scoring protein ligand ccomplexes. JMedChem 2005;48:6821-31.
94. Tognazzo S, Emanuela B, Rita FA, et al. Probabilistic classifiers and automated cancer registration: an exploratory application. J Biomed Inform 2009;42:1-10.
95. Wang H, Lin C, Yang F, et al. Hedged predictions for traditional Chinese chronic gastritis diagnosis with confidence machine. Comput BiolMed 2009;39:425-32.
96. Wiseman SM, Melck A, Masoudi H, et al. Molecular phenotyping of thyroid tumors identifies a marker panel for differentiated thyroid cancer diagnosis. Ann Surg Oncol 2008;15:2811-26.
97. Zhang G, Li H, Fang B. Discriminating acidic and alkaline enzymes using a random forest model with secondary structure amino acid composition. Process Biochem 2009; 44:654-60.
98. Kim Y, Wojciechowski R, Sung H, et al. Evaluation of random forests performance for genome-wide association studies in the presence of interaction effects. BMC Proc 2009;3:S64.
99. Segal M. Machine learning benchmarks and random forest regression. Technical Report, Center for Bioinformatics & Molecular Biostatistics, University of California, San Francisco, 2004;1-14.
100. Boulesteix A-L, Bender A, Lorenzo Bermejo J, et al. Random forest Gini importance favours SNPs with large minor allele frequency: impact, sources and recommendations. Brief Bioinform 2012;13:292-304.
101. Robnik-Sikonja M. Improving Random Forests. In: Boulicaut JF, et al, (ed). Machine Learning: ECML 2004 Proceedings, Vol. 3201. Berlin: Springer, 2004, 359-70.
102. Zhang H, Wang M. Search for the smallest random forest. Stat Interface 2009;2:381.
103. Gammerman A, Vovk V, Vapnik V. Learning by transduction. In: Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence,1998;148-55.
104. Strobl C, Boulesteix A-L, Zeileis A, et al. Bias in random forest variable importance measures: illustrations, sources and a solution. BMC Bioinformatics 2007;8:25.
105. Strobl C, Boulesteix A-L, Kneib T, et al. Conditional variable importance for random forests. BMC Bioinformatics 2008;9:307.
106. Hothorn T, Bu-hlmann P, Dudoit S, et al. Survival ensembles. Biostatistics 2006;7:355-73.
107. Hothorn T, Hornik K, Zeileis A. Unbiased recursive partitioning: a conditional inference framework. J Comput Graph Stat 2006;15:651-74.
108. Nicodemus KK, Malley JD. Predictor correlation impacts machine learning algorithms: implications for genomic studies. Bioinformatics 2009;25:1884-90.
109. Nicodemus KK, Malley JD, Strobl C, et al. The behaviour of random forest permutation-based variable importance measures under predictor correlation. BMC Bioinformatics 2010;11:110.
110. Nicodemus KK. Letter to the Editor: On the stability and ranking of predictors from random forest variable importance measures. Brief Bioinform 2011;12:369-73.
111. Wang M, Chen X, Zhang H. Maximal conditional chi-square importance in random forests. Bioinformatics 2010;26:831-7.
112. Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Stat 2001;29:1189-232.
113. Nason M, Emerson S, LeBlanc M. CARTscans: a tool for visualizing ccomplex models. J Comput Graph Stat 2004;13: 807-25.
114. Szklarczyk D, Franceschini A, Kuhn M, et al. The STRING database in 2011: functional interaction networks of proteins, globally integrated and scored. Nucleic Acids Res 2011;39:D561-8.