Deep feature selection: Theory and application to identify enhancers and promoters

Journal of Computational Biology

Volumn 23, Issue 5, 2016, Pages 322-336

  Li, Yifeng ^a,b   Chen, Chih Yu ^b   Wasserman, Wyeth W ^b  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

deep feature selection; deep learning; enhancer; promoter

Indexed keywords

ALGORITHM; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; ENHANCER REGION; HUMAN; NONLINEAR SYSTEM; PROMOTER REGION;

ALGORITHMS; COMPUTER SIMULATION; ENHANCER ELEMENTS, GENETIC; HUMANS; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PROMOTER REGIONS, GENETIC;

EID: 84969134763     PISSN: 10665277     EISSN: None     Source Type: Journal    
DOI: 10.1089/cmb.2015.0189     Document Type: Conference Paper

References (36)

1. Ackley D.H, Hinton G.E, and Sejnowski T.J. (1985). A learning algorithm for Boltzmann machines. Cogn. Sci. 9, 147-169.
2. Andersson R, Gebhard C, Miguel-Escalada I, et al. (2014). An atlas of active enhancers across human cell types and tissues. Nature. 507, 455-461.
3. Bengio Y, Courville A, and Vincent P. (2013). Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1798-1828.
4. Bergstra J, Breuleux O, Bastien F, et al. (2010). Theano: a CPU and GPU math expression compiler, 1-7. In van der Walt S, and Millman J, eds. Proceedings of the Python for Scientific Computing Conference (SciPy), Austin, Texas
5. Bradley P.S, and Mangasarian O.L. (1998). Feature selection via concave minimization and support vector machines, 82-90. In Shavlik J.W, ed. Proceedings of the Fifteenth International Conference on Machine Learning. Morgan Kaufmann Publishers Inc, California
6. Bredemeier-Ernst I, Nordheim A, and Janknecht R. (1997). Transcriptional activity and constitutive nuclear localization of the ETS protein Elf-1. FEBS Lett. 408, 47-51.
7. Breiman L. (2001). Random forests. Mach. Learn. 45, 5-32.
8. Cai X, Nie F, Huang H, et al. (2011). Multi-class l2, 1-norm support vector machine, 91-100. In 19th IEEE International Conference on Data Mining. IEEE, IEEE Press, Piscataway, NJ.
9. Efron B, Hastie T, Johnstone I, et al. (2004). Least angle regression. Ann. Stat. 32, 407-499.
10. Friedman J, Hastie T, and Tibshirani R. (2010). Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33, 1-22.
11. Goodfellow I.J, Courville A, and Bengio Y. (2012). Large-scale feature learning with spike-And-slab sparse coding. International Conference on Machine Learning (ICML), pp. 1439-1446.
12. Hinton G, and Salakhutdinov R. (2006). Reducing the dimensionality of data with neural networks. Science. 313, 504-507.
13. Hinton G.E, Osindero S, and Teh Y. (2006). A fast learning algorithm for deep belief nets. Neural Comput. 18, 1527-1554.
14. Ise W, Kohyama M, Schraml B.U, et al. (2011). The transcription factor BATF controls the global regulators of classswitch recombination in both B cells and T cells. Nat. Immunol. 12, 536-543.
15. Kong D, Ding C, and Huang H. (2011). Robust nonnegative matrix factorization using l21-norm, 673-682. In Berendt B, de Vries A, Fan W, et al. eds. Proceedings of the 20th ACM International Conference on Information and Knowledge Management. ACM Press, New York
16. Kratz A, Arner E, Saito R, et al. (2010). Core promoter structure and genomic context reflect histone 3 lysine 9 acetylation patterns. BMC Genomics. 11, 257.
17. LeCun Y, Bottou L, Bengio Y, et al. (1998). Gradient-based learning applied to document recognition. Proc. IEEE. 86, 2278-2324.
18. Lee B.S, Dekker J.D, Lee B.K, et al. (2013). The BCL11A transcription factor directly activates rag gene expression and V(D)J recombination. Mol. Cell Biol. 33, 1768-1781.
19. Li Y, and Ngom A. (2013). Classification approach based on non-negative least squares. Neurocomputing. 118, 41-57.
20. Li Y, and Wyeth W.W. (2015). DECRES: deep learning methods for identifying cis-regulatory elements and other applications. Available at: https://github.com/yifeng-li/DECRES
21. Liaw A, and Wiener M. (2002). Classification and regression by randomForest. R News 2, 18-22. Available at: http://.cran.r-project.org/web/packages/randomForest
22. LISA Lab. (2013). Deep learning tutorials. Available at: http://deeplearning.net/tutorial
23. Nair V, and Hinton G. (2010). Rectified linear units improve restricted Boltzmann machines. IEEE International Conference on Machine Learning (ICML), Haifa, Israel, pp. 807-814.
24. Nechanitzky R, Akbas D, Scherer S, et al. (2013). Transcription factor EBF1 is essential for the maintenance of B cell identity and prevention of alternative fates in committed cells. Nat. Immunol. 14, 867-875.
25. Nie F, Huang H, Cai X, et al. (2010). Efficient and robust feature selection via joint l2, 1-norms minimization, 1813-1821. In Lafferty J, Williams C, Shawe-Taylor J, et al. eds. Advances in Neural Information Processing Systems 23. Curran Associates Inc, New York
26. Pjanic M, Pjanic P, Schmid C, et al. (2011). Nuclear factor I revealed as family of promoter binding transcription activators. BMC Genomics. 12, 181.
27. Rebhan M, Chalifa-Caspi V, Prilusky J, et al. (1997). GeneCards: integrating information about genes, proteins and diseases. Trends Genet. 13, 163.
28. Sanders M. (2009). Sparse multi-class prediction based on the group lasso in multinomial logistic regression [Master?s thesis]. Delft University of Technology, The Netherlands
29. Shlyueva D, Stampfel G, and Stark A. (2014). Transcriptional enhancers: from properties to genome-wide predictions. Nat. Rev. Genet. 15, 272-286.
30. The ENCODE Project Consortium. (2012). An integrated encyclopedia of DNA elements in the human genome. Nature. 489, 57-74.
31. The FANTOM Consortium, The RIKEN PMI, and CLST (DGT). (2014). A promoter-level mammalian expression atlas. Nature. 507, 462-470.
32. Tibshirani R. (1996). Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. Series B Stat. Methodol. 58, 267-288.
33. Vakoc C.R, Sachdeva M.M, Wang H, et al. (2006). Profile of histone lysine methylation across transcribed mammalian chromatin. Mol. Cell. Biol. 26, 9185-9195.
34. Wang Y, Li X, and Hua H. (2014). H3K4me2 reliably defines transcription factor binding regions in different cells. Genomics. 103, 222-228.
35. Zhou V.M, Goren A, and Bernstein B.E. (2011). Charting histone modifications and the functional organization of mammalian genomes. Nat. Rev. Genet. 12, 7-18.
36. Zou H, and Hastie T. (2005). Regularization and variable selection via the elastic net. J. R. Stat. Soc. Series B Stat. Methodol. 67, 301-320.