From genotype to phenotype: augmenting deep learning with networks and systems biology

Current Opinion in Systems Biology

Volumn 15, Issue , 2019, Pages 68-73

  Gazestani, Vahid H ^a   Lewis, Nathan E ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTIFICIAL NEURAL NETWORK; DEEP LEARNING; GENE MUTATION; GENOTYPE; HUMAN; KNOWLEDGE; LEARNING ALGORITHM; PHENOTYPE; PREDICTION; REVIEW; SYSTEMS BIOLOGY;

EID: 85064803940     PISSN: None     EISSN: 24523100     Source Type: Journal    
DOI: 10.1016/j.coisb.2019.04.001     Document Type: Review

References (43)

1. Barabási, A.-L., Gulbahce, N., Loscalzo, J., Network medicine: a network-based approach to human disease. Nat Rev Genet, 12, 2011, 56.
2. Vidal, M., Cusick, M.E., Barabási, A.-L., Interactome networks and human disease. Cell 144 (2011), 986–998.
3. Wang, B., Mezlini, A.M., Demir, F., Fiume, M., Tu, Z., Brudno, M., Haibe-Kains, B., Goldenberg, A., Similarity network fusion for aggregating data types on a genomic scale. Nat Methods 11 (2014), 333–337.
4. Kitano, H., Systems biology: a brief overview. Science 295 (2002), 1662–1664.
5. Cowen, L., Ideker, T., Raphael, B.J., Sharan, R., Network propagation: a universal amplifier of genetic associations. Nat Rev Genet 18 (2017), 551–562.
6. Eduati, F., Mangravite, L.M., Wang, T., Tang, H., Bare, J.C., Huang, R., Norman, T., Kellen, M., Menden, M.P., Yang, J., et al. Prediction of human population responses to toxic compounds by a collaborative competition. Nat Biotechnol 33 (2015), 933–940.
7. Gazestani, V.H., Pramparo, T., Nalabolu, S., Kellman, B.P., Murry, S., Lopez, L., Pierce, K., Courchesne, E., Lewis, N.E., Transcriptional organization of autism spectrum disorder and its connection to ASD risk genes and phenotypic variation. bioRxiv, 2018, 435917.
8. Angermueller, C., Pärnamaa, T., Parts, L., Stegle, O., Deep learning for computational biology. Mol Syst Biol, 12, 2016, 878.
9. Wainberg, M., Merico, D., Delong, A., Frey, B.J., Deep learning in biomedicine. Nat Biotechnol, 36, 2018, 829.
10. Miotto, R., Wang, F., Wang, S., Jiang, X., Dudley, J.T., Deep learning for healthcare: review, opportunities and challenges. Briefings Bioinf 19 (2018), 1236–1246.
11. Min, S., Lee, B., Yoon, S., Deep learning in bioinformatics. Briefings Bioinf 18 (2017), 851–869.
12. Mamoshina, P., Vieira, A., Putin, E., Zhavoronkov, A., Applications of deep learning in biomedicine. Mol Pharm 13 (2016), 1445–1454.
13. Ching, T., Himmelstein, D.S., Beaulieu-Jones, B.K., Kalinin, A.A., Do, B.T., Way, G.P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M.M., Opportunities and obstacles for deep learning in biology and medicine. J R Soc Interface, 15, 2018, 20170387.
14. Michael, K.Y., Ma, J., Fisher, J., Kreisberg, J.F., Raphael, B.J., Ideker, T.J.C., Visible machine learning for biomedicine. Cell 173 (2018), 1562–1565.
15. Ma, J., Yu, M.K., Fong, S., Ono, K., Sage, E., Demchak, B., Sharan, R., Ideker, T., Using deep learning to model the hierarchical structure and function of a cell. Nat Methods 15 (2018), 290–298 This paper encodes the hierarchical structure of gene ontology tree in a DNN architecture to sucessfully predict effect of gene mutations on cell proliferation.
16. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444 This paper provides intuitive technical insights on the DNN models.
17. Goodfellow, I., Bengio, Y., Courville, A., Bengio, Y., Deep learning, vol. 1, 2016, MIT press, Cambridge.
18. Bengio, Y., Learning deep architectures for AI. Trends in Machine Learn 2 (2009), 1–127.
19. Hornik, K., Stinchcombe, M., White, H., Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks. Neural Network 3 (1990), 551–560.
20. LeCun, Y., Boser, B.E., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W.E., Jackel, L.D., Handwritten digit recognition with a back-propagation network. Advances in neural information processing systems, 1990, 396–404.
21. Alipanahi, B., Delong, A., Weirauch, M.T., Frey, B.J., Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning. Nat Biotechnol 33 (2015), 831–838.
22. Sharan, R., Ulitsky, I., Shamir, R., Network-based prediction of protein function. Mol Syst Biol, 3, 2007, 88.
23. Mostafavi, S., Ray, D., Warde-Farley, D., Grouios, C., Morris, Q., GeneMANIA: a real-time multiple association network integration algorithm for predicting gene function. Genome Biol, 9, 2008, S4.
24. Kipf, T.N., Welling, M., Semi-supervised classification with graph convolutional networks. arXiv. 2016 This paper introduces a simple, yet effective approach for encoding network structure in the architecture of DNNs.
25. Defferrard, M., Bresson, X., Vandergheynst, P., Convolutional neural networks on graphs with fast localized spectral filtering. Advances in neural information processing systems, 2016, 3844–3852.
26. Scarselli, F., Gori, M., Tsoi, A.C., Hagenbuchner, M., Monfardini, G., The graph neural network model. IEEE Trans Neural Netw 20 (2009), 61–80.
27. Gori, M., Monfardini, G., Scarselli, F., A new model for learning in graph domains. Neural networks, 2005. IJCNN'05. Proceedings. 2005 IEEE international joint conference on: IEEE, 2005, 729–734.
28. Hamilton, W., Ying, Z., Leskovec, J., Inductive representation learning on large graphs. Advances in neural information processing systems, 2017, 1024–1034 This paper introduces GraphSage in which a DNN is trained to predict the role of a gene based on its network neighbors.
29. Lin, C., Jain, S., Kim, H., Bar-Joseph, Z., Using neural networks for reducing the dimensions of single-cell RNA-Seq data. Nucleic Acids Res, 45, 2017, e156 This paper encodes the netowrk propagation layers in a DNN architecture to accurately predict a cell type and its state based on gene expression data.
30. Wang, D., Liu, S., Warrell, J., Won, H., Shi, X., Navarro, F.C.P., Clarke, D., Gu, M., Emani, P., Yang, Y.T., et al. Comprehensive functional genomic resource and integrative model for the human brain. Science, 2018, 362 This paper encodes a gene regulatory netowrk in the architecture of DNN to incorporate intermediate phenotypes (e.g., gene expression, tissue composition) in the learning procedure, resulting in an increased accuracy in predicting tissue status from genetic information.
31. Csete, M.E., Doyle, J.C., Reverse engineering of biological complexity. Science 295 (2002), 1664–1669.
32. Brenner, S., Sequences and consequences. Phil Trans Biol Sci 365 (2010), 207–212.
33. Donoho, D.L., High-dimensional data analysis: the curses and blessings of dimensionality. AMS math chall lect, 1, 2000, 32.
34. Meng, C., Zeleznik, O.A., Thallinger, G.G., Kuster, B., Gholami, A.M., Culhane, A.C., Dimension reduction techniques for the integrative analysis of multi-omics data. Briefings Bioinf 17 (2016), 628–641.
35. Subramanian, A., Tamayo, P., Mootha, V.K., Mukherjee, S., Ebert, B.L., Gillette, M.A., Paulovich, A., Pomeroy, S.L., Golub, T.R., Lander, E.S., et al. Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci U S A 102 (2005), 15545–15550.
36. Khatri, P., Sirota, M., Butte, A.J., Ten years of pathway analysis: current approaches and outstanding challenges. PLoS Comput Biol, 8, 2012, e1002375.
37. Poggio, T., Mhaskar, H., Rosasco, L., Miranda, B., Liao, Q., Why and when can deep-but not shallow-networks avoid the curse of dimensionality: a review. Int J Autom Comput 14 (2017), 503–519.
38. Mhaskar, H., Liao, Q., Poggio, T.A., When and why are deep networks better than shallow ones?. AAAI, 2017, 2343–2349.
39. Kulmanov, M., Khan, M.A., Hoehndorf, R., DeepGO: predicting protein functions from sequence and interactions using a deep ontology-aware classifier. Bioinformatics 34 (2017), 660–668.
40. Weiss, K., Khoshgoftaar, T.M., Wang, D., A survey of transfer learning. J Big Data, 3, 2016, 9.
41. Ruder, S., An overview of multi-task learning in deep neural networks. arXiv. 2017.
42. Shrikumar, A., Greenside, P., Kundaje, A., Learning important features through propagating activation differences. arXiv. 2017.
43. Chang, S., Han, W., Tang, J., Qi, G.-J., Aggarwal, C.C., Huang, T.S., Heterogeneous network embedding via deep architectures. Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, 2015, ACM, 119–128.