Chromatin accessibility prediction via convolutional long short-term memory networks with k-mer embedding

Bioinformatics

Volumn 33, Issue 14, 2017, Pages i92-i101

  Min, Xu ^a,b   Zeng, Wanwen ^a,b   Chen, Ning ^a,b   Chen, Ting ^a,b,c   Jiang, Rui ^a,b  

^a TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b TSINGHUA UNIVERSITY   (China)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BIOLOGY; CELL LINE; CHROMATIN; HUMAN; METABOLISM; PROCEDURES; SOFTWARE;

CELL LINE; CHROMATIN; COMPUTATIONAL BIOLOGY; HUMANS; NEURAL NETWORKS (COMPUTER); SOFTWARE;

EID: 85024503304     PISSN: 13674803     EISSN: 14602059     Source Type: Journal    
DOI: 10.1093/bioinformatics/btx234     Document Type: Conference Paper

References (33)

1. Alipanahi, B. et al. (2015) Predicting the sequence specificities of DNA-and RNA-binding proteins by deep learning. Nat. Biotechnol., 33(8), 831-838.
2. Bengio, Y. et al. (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Netw., 5, 157-166.
3. Bengio, Y. et al. (2007). Greedy layer-wise training of deep networks. In: Advances in Neural Information Processing Systems (NIPS), 19, p.153-160.
4. Chollet, F. (2015). Keras. https://github.com/fchollet/keras.
5. Consortium, E.P. et al. (2004) The encode (encyclopedia of DNA elements) project. Science, 306, 636-640.
6. Crawford, G.E. et al. (2006) Genome-wide mapping of dnase hypersensitive sites using massively parallel signature sequencing (mpss). Genome Res., 16, 123-131.
7. Duchi, J. et al. (2011) Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res., 12, (Jul), 2121-2159.
8. Ghandi, M. et al. (2014) Enhanced regulatory sequence prediction using gapped k-mer features. PLoS Comput. Biol., 10, e1003711.
9. Harris, Z.S. (1954) Distributional structure. Word, 10, 146-162.
10. He, K. et al. (2014). Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 37, p.1904-1916.
11. Hinton, G.E., and Salakhutdinov, R.R. (2006) Reducing the dimensionality of data with neural networks. Science, 313, 504-507.
12. Hochreiter, S. (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int. J. Uncertain. Fuzz. Knowledge-Based Syst., 6, 107-116.
13. Hochreiter, S., and Schmidhuber, J. (1997) Long short-term memory. Neural Comput., 9, 1735-1780.
14. John, S. et al. (2011) Chromatin accessibility pre-determines glucocorticoid receptor binding patterns. Nature Genet., 43, 264-268.
15. Kelley, D.R. et al. (2016) Basset: learning the regulatory code of the accessible genome with deep convolutional neural networks. Genome Res., 26(7), 990-999.
16. Kim, Y. (2014). Convolutional neural networks for sentence classification. In: Conference on Empirical Methods on Natural Language Processing (EMNLP), Association for Computational Linguistics (ACL), pp.1746-1751.
17. Krizhevsky, A. et al. (2012). Imagenet classification with deep convolutional neural networks. In: Platt, J.C. et al. (eds) Advances in Neural Information Processing Systems, NIPS. Curran Associates, NY 12571. pp.1097-1105.
18. Le, Q.V., and Mikolov, T. (2014). Distributed representations of sentences and documents. In: ICML, Vol. 14, p.1188-1196.
19. Lee, D. et al. (2011) Discriminative prediction of mammalian enhancers from dna sequence. Genome Res., 21, 2167-2180.
20. Luong, M.-T. et al. (2015). Effective approaches to attention-based neural machine translation. In: Conference on Empirical Methods on Natural Language Processing (EMNLP), Association for Computational Linguistics (ACL), pp.1412-1421.
21. Maaten, L. v d., and Hinton, G. (2008) Visualizing data using t-SNE. J. Mach. Learn. Res., 9, (Nov), 2579-2605.
22. Mikolov, T. et al. (2013). Distributed representations of words and phrases and their compositionality. In: Burges, C.J.C. et al. (eds) Advances in Neural Information Processing Systems, NIPS. Curran Associates, NY 12571. pp. 3111-3119.
23. Min, X. et al. (2016). DeepEnhancer predicting enhancers by convolutional neural networks. In: IEEE International Conference on Bioinformatics and Biomedicine, IEEE, pp. 637-644.
24. Niwa, H. (2007) Open conformation chromatin and pluripotency. Genes Dev., 21, 2671-2676.
25. Pennington, J. et al. (2014). GloVe: global vectors for word representation. In: EMNLP, volume 14, p.1532-43.
26. Sønderby, S.K. et al. (2015). Convolutional LSTM networks for subcellular localization of proteins. In: International Conference on Algorithms for Computational Biology, p.68-80. Springer International Publishing.
27. Tai, K.S. et al. (2015). Improved semantic representations from tree-structured long short-term memory networks. In: Annual Meeting of the Association for Computational Linguistics, p.1556.
28. Tieleman, T., and Hinton, G. (2012). Lecture 6.5-rmsprop, COURSERA: Neural networks for machine learning, 4.
29. Vierstra, J. et al. (2014) Coupling transcription factor occupancy to nucleo-some architecture with DNase-flash. Nat. Methods, 11, 66-72.
30. Wang, Y. et al. (2016) Modeling the causal regulatory network by integrating chromatin accessibility and transcriptome data. Natl. Sci. Rev., 3(2), 240-251.
31. Wilson, D.R., and Martinez, T.R. (2003) The general inefficiency of batch training for gradient descent learning. Neural Netw., 16, 1429-1451.
32. Zeng, H. et al. (2016) Convolutional neural network architectures for predicting DNA-protein binding. Bioinformatics, 32, i121-i127.
33. Zhou, J., and Troyanskaya, O.G. (2015) Predicting effects of noncoding variants with deep learning-based sequence model. Nat. Methods, 12, 931-934.