End-to-End Differentiable Learning of Protein Structure

Cell Systems

Volumn 8, Issue 4, 2019, Pages 292-301.e3

  AlQuraishi, Mohammed ^a  

^a HARVARD MEDICAL SCHOOL   (United States)

Author keywords

biophysics; co evolution; deep learning; geometric deep learning; homology modeling; machine learning; protein design; protein folding; protein structure prediction; structural biology

Indexed keywords

AMINO ACID SEQUENCE; ARTICLE; DEEP LEARNING; MACHINE LEARNING; MECHANICAL TORSION; MOLECULAR DYNAMICS; PRIORITY JOURNAL; PROTEIN CONFORMATION; PROTEIN FOLDING; PROTEIN SECONDARY STRUCTURE; PROTEIN STRUCTURE; SEQUENCE ALIGNMENT; MOLECULAR EVOLUTION; PROCEDURES; SEQUENCE ANALYSIS; SOFTWARE;

EVOLUTION, MOLECULAR; MACHINE LEARNING; PROTEIN FOLDING; SEQUENCE ANALYSIS, PROTEIN; SOFTWARE;

EID: 85064397545     PISSN: 24054712     EISSN: 24054720     Source Type: Journal    
DOI: 10.1016/j.cels.2019.03.006     Document Type: Article

References (52)

1. Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016). TensorFlow: a system for large-scale machine learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), pp. 265–283.
2. Adhikari, B., Bhattacharya, D., Cao, R., Cheng, J., CONFOLD: residue-residue contact-guided ab initio protein folding. Proteins 83 (2015), 1436–1449.
3. Alain, G., Bengio, Y., Understanding intermediate layers using linear classifier probes. Arxiv, 2016 arXiv:1610.01644v4 https://arxiv.org/abs/1610.01644.
4. AlQuraishi, M., Parallelized natural extension reference frame: parallelized conversion from internal to Cartesian coordinates. J. Comp. Chem. 40 (2019), 885–892.
5. AlQuraishi, M., ProteinNet: a standardized data set for machine learning of protein structure. Arxiv, 2019 arXiv:1902.00249v1 https://arxiv.org/abs/1902.00249.
6. Alva, V., Söding, J., Lupas, A.N., A vocabulary of ancient peptides at the origin of folded proteins. Elife, 4, 2015, e09410.
7. Aydin, Z., Thompson, J., Bilmes, J., Baker, D., and Noble, W.S. (2012). Protein torsion angle class prediction by a hybrid architecture of Bayesian and neural networks. In 13th International Conference on Bioinformatics and Computational Biology, pp 2012–2018.
8. Bernstein, F.C., Koetzle, T.F., Williams, G.J., Meyer, E.F., Brice, M.D., Rodgers, J.R., Kennard, O., Shimanouchi, T., Tasumi, M., The Protein Data Bank. A computer-based archival file for macromolecular structures. Eur. J. Biochem 80 (1977), 319–324.
9. Branden, C., Tooze, J., Introduction to Protein Structure. 1999, Garland Publishing Science.
10. Contreras-Moreira, B., Ezkurdia, I., Tress, M.L., Valencia, A., Empirical limits for template-based protein structure prediction: the CASP5 example. FEBS Lett. 579 (2005), 1203–1207.
11. Dawson, N.L., Lewis, T.E., Das, S., Lees, J.G., Lee, D., Ashford, P., Orengo, C.A., Sillitoe, I., CATH: an expanded resource to predict protein function through structure and sequence. Nucleic Acids Res. 45 (2017), D289–D295.
12. Dill, K.A., Dominant forces in protein folding. Biochemistry 29 (1990), 7133–7155.
13. Dill, K.A., MacCallum, J.L., The protein-folding problem, 50 years on. Science 338 (2012), 1042–1046.
14. Gajda, M.J., Pawlowski, M., Bujnicki, J.M., Protein structure prediction: from recognition of matches with known structures to recombination of fragments. Kolinski, A., (eds.) Multiscale Approaches to Protein Modeling, 2011, Springer, 231–254.
15. Gajda, M.J., Pawlowski, M., Bujnicki, J.M., Multiscale Approaches to Protein Modeling. 2011, Springer.
16. Gao, Y., Wang, S., Deng, M., Xu, J., Real-value and confidence prediction of protein backbone dihedral angles through a hybrid method of clustering and deep learning. Arxiv, 2017 arXiv:1712.07244v1 https://arxiv.org/abs/1712.07244v1.
17. Goodfellow, I., Bengio, Y., Courville, A., Deep Learning. 2016, The MIT Press.
18. Hochreiter, S., Schmidhuber, J., Long short-term memory. Neural Comput. 9 (1997), 1735–1780.
19. Hopf, T.A., Schärfe, C.P.I., Rodrigues, J.P.G.L.M., Green, A.G., Kohlbacher, O., Sander, C., Bonvin, A.M.J.J., Marks, D.S., Sequence co-evolution gives 3D contacts and structures of protein complexes. Elife, 3, 2014.
20. Hopf, T.A., Ingraham, J.B., Poelwijk, F.J., Schärfe, C.P.I., Springer, M., Sander, C., Marks, D.S., Mutation effects predicted from sequence co-variation. Nat. Biotech 35 (2017), 128–135.
21. Juan, D., de Pazos, F., Valencia, A., Emerging methods in protein co-evolution. Nat. Rev. Genet. 14 (2013), 249–261.
22. Koh, P.W., Liang, P., Understanding Black-box predictions via influence functions. Arxiv, 2017 arXiv:1703.04730v2 https://arxiv.org/abs/1703.04730.
23. Kryshtafovych, A., Monastyrskyy, B., Fidelis, K., CASP11 statistics and the prediction center evaluation system. Proteins 84 (2016), 15–19.
24. Kryshtafovych, A., Monastyrskyy, B., Fidelis, K., Moult, J., Schwede, T., Tramontano, A., Evaluation of the template-based modeling in CASP12. Proteins 86 (2018), 321–334.
25. Leaver-Fay, A., Tyka, M., Lewis, S.M., Lange, O.F., Thompson, J., Jacak, R., Kaufman, K., Renfrew, P.D., Smith, C.A., Sheffler, W., et al. ROSETTA3: an object-oriented software suite for the simulation and design of macromolecules. Meth. Enzymol 487 (2011), 545–574.
26. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444.
27. Li, H., Hou, J., Adhikari, B., Lyu, Q., Cheng, J., Deep learning methods for protein torsion angle prediction. BMC Bioinformatics, 18, 2017, 417.
28. Liu, T., Ish-Shalom, S., Torng, W., Lafita, A., Bock, C., Mort, M., Cooper, D.N., Bliven, S., Capitani, G., Mooney, S.D., et al.Biological and functional relevance of CASP predictions. Proteins 86 (2018), 374–386.
29. Liu, Y., Palmedo, P., Ye, Q., Berger, B., Peng, J., Enhancing evolutionary couplings with deep convolutional neural networks. Cell Syst 6 (2018), 65–74.
30. Lyons, J., Dehzangi, A., Heffernan, R., Sharma, A., Paliwal, K., Sattar, A., Zhou, Y., Yang, Y., Predicting backbone Cα angles and dihedrals from protein sequences by stacked sparse auto-encoder deep neural network. J. Comput. Chem. 35 (2014), 2040–2046.
31. Marks, D.S., Colwell, L.J., Sheridan, R., Hopf, T.A., Pagnani, A., Zecchina, R., Sander, C., Protein 3D structure computed from evolutionary sequence variation. PLoS One, 6, 2011, e28766.
32. Marx, D., Hutter, J., Ab Initio Molecular Dynamics: Basic Theory and Advanced Methods. 2012, Cambridge University Press.
33. Moult, J., Pedersen, J.T., Judson, R., Fidelis, K., A large-scale experiment to assess protein structure prediction methods. Proteins, 23, 1995 ii–iv.
34. Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., Tramontano, A., Critical assessment of methods of protein structure prediction (CASP)-round XII. Proteins 86 (2018), 7–15.
35. Nguyen, A., Yosinski, J., Clune, J., Multifaceted feature visualization: uncovering the different types of features learned by each neuron in deep neural networks. Arxiv, 2016 arXiv:1602.03616v2 https://arxiv.org/abs/1602.03616.
36. Ovchinnikov, S., Kim, D.E., Wang, R.Y.-R., Liu, Y., DiMaio, F., Baker, D., Improved de novo structure prediction in CASP11 by incorporating coevolution information into Rosetta. Proteins 84 (2016), 67–75.
37. Ovchinnikov, S., Park, H., Varghese, N., Huang, P.S., Pavlopoulos, G.A., Kim, D.E., Kamisetty, H., Kyrpides, N.C., Baker, D., Protein structure determination using metagenome sequence data. Science 355 (2017), 294–298.
38. Parsons, J., Holmes, J.B., Rojas, J.M., Tsai, J., Strauss, C.E.M., Practical conversion from torsion space to Cartesian space for in silico protein synthesis. J. Comput. Chem. 26 (2005), 1063–1068.
39. Perez, A., Morrone, J.A., Brini, E., MacCallum, J.L., Dill, K.A., Blind protein structure prediction using accelerated free-energy simulations. Sci. Adv, 2, 2016, e1601274.
40. Ponting, C.P., Russell, R.R., The natural history of protein domains. Annu. Rev. Biophys. Biomol. Struct 31 (2002), 45–71.
41. Ramachandran, G.N., Ramakrishnan, C., Sasisekharan, V., Stereochemistry of polypeptide chain configurations. J. Mol. Biol. 7 (1963), 95–99.
42. Schaarschmidt, J., Monastyrskyy, B., Kryshtafovych, A., Bonvin, A.M.J.J., Assessment of contact predictions in CASP12: co-evolution and deep learning coming of age. Proteins 86 (2018), 51–66.
43. Shrikumar, A., Greenside, P., and Kundaje, A. (2017). Learning important features through propagating activation differences. In ICML'17 Proceedings of the 34th International Conference on Machine Learning-Volume 70, pp. 3145–3153.
44. Simonyan, K., Vedaldi, A., Zisserman, A., Deep inside convolutional networks: visualising image classification models and saliency maps. Arxiv, 2013 arXiv:1312.6034v2 https://arxiv.org/abs/1312.6034.
45. Wang, S., Sun, S., Li, Z., Zhang, R., Xu, J., Accurate de novo prediction of protein contact map by ultra-deep learning model. PLoS Comput. Biol., 13, 2017, e1005324.
46. Xu, D., Zhang, Y., Ab initio protein structure assembly using continuous structure fragments and optimized knowledge-based force field. Proteins 80 (2012), 1715–1735.
47. Xu, J., Zhang, Y., How significant is a protein structure similarity with TM-score = 0.5?. Bioinformatics 26 (2010), 889–895.
48. Yang, J., Yan, R., Roy, A., Xu, D., Poisson, J., Zhang, Y., The I-TASSER suite: protein structure and function prediction. Nat. Methods 12 (2015), 7–8.
49. Zhang, Y., Skolnick, J., Scoring function for automated assessment of protein structure template quality. Proteins 57 (2004), 702–710.
50. Zhang, C., Mortuza, S.M., He, B., Wang, Y., Zhang, Y., Template-based and free modeling of I-TASSER and Quark pipelines using predicted contact maps in CASP12. Proteins 86 (2018), 136–151.
51. Zhao, F., Peng, J., Xu, J., Fragment-free approach to protein folding using conditional neural fields. Bioinformatics 26 (2010), i310–i317.
52. Zhou, Y., Duan, Y., Yang, Y., Faraggi, E., Lei, H., Trends in template/fragment-free protein structure prediction. Theor. Chem. Acc 128 (2011), 3–16.