Statistical interpretation of machine learning-based feature importance scores for biomarker discovery

Bioinformatics

Volumn 28, Issue 13, 2012, Pages 1766-1774

  Huynh Thu, Vân Anh ^a   Saeys, Yvan ^b   Wehenkel, Louis ^a   Geurts, Pierre ^a  

^a UNIVERSITY OF LIÈGE   (Belgium)

^b GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL MARKER; TRANSCRIPTOME;

ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGY; EVALUATION; METHODOLOGY; STATISTICAL ANALYSIS;

ARTIFICIAL INTELLIGENCE; BIOLOGICAL MARKERS; COMPUTATIONAL BIOLOGY; DATA INTERPRETATION, STATISTICAL; TRANSCRIPTOME;

EID: 84864008355     PISSN: 13674803     EISSN: 14602059     Source Type: Journal    
DOI: 10.1093/bioinformatics/bts238     Document Type: Article

References (32)

1. Abeel, T. et al. (2010) Robust biomarker identification for cancer diagnosis with ensemble feature selection methods. Bioinformatics, 26, 392-398.
2. Alizadeh, A. et al. (2000) Distinct types of di?use large B-cell lymphoma identi{thorn}ed by gene expression pro{thorn}ling. Nature, 403, 503-511.
3. Altmann, A. et al. (2010) Permutation importance: a corrected feature importance measure. Bioinformatics, 26, 1340-1347.
4. Ambroise, C. and McLachlan, G.J. (2002) Selection bias in gene extraction on the basis of microarray gene-expression data. Proc. Nati. Acad. Sci., 99, 6562-6566.
5. Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Stat. Soci., Ser. B (Methodol.), 57, 289-300.
6. Boser, B.E. et al. (1992)Atraining algorithm for optimal margin classifiers. In Haussler, D. (ed.), Proceedings of the 5th Annual ACMWorkshop on Computational Learning Theory, Pittsburgh, ACM Press, pp. 144-152.
7. Breiman, L. (2001) Random forests. Mach. Learn., 45, 5-32.
8. Chang, C.-C. and Lin, C.-J. (2011) Libsvm: a library for support vector machines. ACM Trans. Intell. Syst. Technol., 2, 27:1-27:27.
9. Dhanasekaran, S. et al. (2001) Delineation of prognostic biomarkers in prostate cancer. Nature, 412, 822-826.
10. Fukunaga, K. and Hostetler, L. (1975) k-Nearest-neighbor Bayes-risk estimation. IEEE Trans. Inform. Theory, 21, 285-293.
11. Ge, Y. et al. (2003) Resampling-based multiple testing for microarray data analysis. Technical Report 633, Department of Statistics, University of California, Berkeley.
12. Ge, Y. et al. (2008) Some step-down procedures controlling the false discovery rate under dependence. Stati. Sin., 18, 881-904.
13. Geurts, P. et al. (2005) Proteomic mass spectra classification using decision tree based ensemble methods. Bioinformatics, 21, 3138-3145.
14. Geurts, P. et al. (2006) Extremely randomized trees. Mach. Learn., 36, 3-42.
15. Golub, T.R. et al. (1999) Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science, 286, 531-537.
16. Guyon, I. et al. (2002) Gene selection for cancer classification using support vector machines. Mach. Learn., 46, 389-422.
17. Hastie, T. et al. (2003) The Elements of Statistical Learning. Springer. New York.
18. He, Z. andYu, W. (2010) Stable feature selection for biomarker discovery. Computational Biology and Chemistry, 34, 215-225.
19. Huynh-Thu, V.A. et al. (2008) Exploiting tree-based variable importances to selectively identify relevant variables. JMLR:Workshop and Conference proceedings, Antwerp, 4, 60-73.
20. Pearl, J. (1988) Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
21. Rakotomamonjy, A. (2003) Variable selection using svm based criteria. J. Mach. Learn. Res., 3, 1357-1370.
22. Robnik-Sikonja, M. and Kononenko, I. (2003) Theoretical and empirical analysis of ReliefF and RReliefF. Mach. Learn. J., 53, 23-69.
23. Saeys, Y. et al. (2007) A review of feature selection techniques in bioinformatics. Bioinformatics, 23, 2507-2517.
24. Shipp, M. et al. (2002) Diffuse large b-cell lymphoma outcome prediction by geneexpression profiling and supervised machine learning. Nat. Med., 8, 68-74.
25. Singh, D. et al. (2002) Gene expression correlates of clinical prostate cancer behavior. Cancer Cell, 1, 203-209.
26. Smialowski, P. et al. (2010) Pitfalls of supervised feature selection. Bioinformatics, 26, 440-443.
27. Stoppiglia, H. et al. (2003) Ranking a random feature for variable and feature selection. J. Mach. Learn. Res., 3, 1399-1414.
28. Storey, J.D. and Tibshirani, R. (2003) Statistical significance for genomewide studies. Proc. Natl. Acad. Sci. USA, 100, 9440-9445.
29. Tuv, E. et al. (2009) Feature selection with ensembles, artificial variables, and redundancy elimination. J. Mach. Learn. Res., 10, 1341-1366.
30. Wang, Y. et al. (2005) Gene-expression profiles to predict distant metastasis of lymphnode-negative primary breast cancer. Lancet, 365, 671-679.
31. Westfall, P.H. andYoung, S.S. (1993) Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment. John Wiley & Sons, New York.
32. Zhang, C. et al. (2006) Significance of gene ranking for classification of microarray samples. IEEE/ACM Trans. Comput. Biol. Bioinform., 3, 1-9.