Capturing non-local interactions by long short-term memory bidirectional recurrent neural networks for improving prediction of protein secondary structure, backbone angles, contact numbers and solvent accessibility

Bioinformatics

Volumn 33, Issue 18, 2017, Pages 2842-2849

  Heffernan, Rhys ^a   Yang, Yuedong ^a   Paliwal, Kuldip ^a   Zhou, Yaoqi ^a  

^a GRIFFITH UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

PROTEIN; SOLVENT;

ARTIFICIAL NEURAL NETWORK; BIOLOGY; CHEMISTRY; MACHINE LEARNING; MOLECULAR MODEL; PROCEDURES; PROTEIN SECONDARY STRUCTURE;

COMPUTATIONAL BIOLOGY; MACHINE LEARNING; MODELS, MOLECULAR; NEURAL NETWORKS (COMPUTER); PROTEIN STRUCTURE, SECONDARY; PROTEINS; SOLVENTS;

EID: 85026373829     PISSN: 13674803     EISSN: 14602059     Source Type: Journal    
DOI: 10.1093/bioinformatics/btx218     Document Type: Article

References (54)

1. Abadi,M. et al. (2016) Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv:1603.04467.
2. Adamczak,R. et al. (2004) Accurate prediction of solvent accessibility using neural networks-based regression. Proteins, 56, 753-767.
3. Ahmad,S. et al. (2003) Real value prediction of solvent accessibility from amino acid sequence. Proteins, 50, 629-635.
4. Altschul,S.F. et al. (1997) Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res, 25, 3389-3402.
5. Amodei,D. et al. (2015) Deep speech 2: End-to-end speech recognition in english and mandarin. arXiv:1512.02595.
6. Baldi,P. et al. (1999) Exploiting the past and the future in protein secondary structure prediction. Bioinformatics, 15, 937-946.
7. Dill,K.A., and MacCallum,J.L. (2012) The protein-folding problem, 50 years on. Science, 338, 1042-1046.
8. Dor,O., and Zhou,Y. (2007) Real-SPINE: an integrated system of neural networks for real-value prediction of protein structural properties. Protein, 68, 76-81.
9. Drozdetskiy,A. et al. (2015) JPred4: a protein secondary structure prediction server. Nucleic Acids Res., 43, W389-W394.
10. Faraggi,E. et al. (2012) SPINE X: improving protein secondary structure prediction by multistep learning coupled with prediction of solvent accessible surface area and backbone torsion angles. J. Comput. Chem., 33, 259-267.
11. Fauchère,J.L. et al. (1988) Amino acid side chain parameters for correlation studies in biology and pharmacology. Int. J. Pept. Protein Res., 32, 269-278.
12. Garg,A. et al. (2005) Real value prediction of solvent accessibility in proteins using multiple sequence alignment and secondary structure. Proteins, 61, 318-324.
13. Gibson,K.D., and Scheraga,H.A. (1967) Minimization of polypeptide energy. i. preliminary structures of bovine pancreatic ribonuclease s-peptide. Proc. Natl. Acad. Sci. USA, 58, 420-427.
14. Gilis,D., and Rooman,M. (1997) Predicting protein stability changes upon mutation using database-derived potentials: solvent accessibility determines the importance of local versus non-local interactions along the sequence. J. Mol. Biol., 272, 276-290.
15. Graves,A., and Schmidhuber,J. (2009) Offline handwriting recognition with multidimensional recurrent neural networks. In: Koller D., Schuurmans D., Bengio Y., and Bottou L., editors, Advances in Neural Information Processing Systems 21. Curran Associates, Inc., Red Hook, NY, p.545-552.
16. Hamelryck,T. (2005) An amino acid has two sides: a new 2D measure provides a different view of solvent exposure. Proteins, 59, 38-48.
17. Hanson,J. et al. (2017) Improving protein disorder prediction by deep bidirectional long short-term memory recurrent neural networks. Bioinformatics, 33, 685-692.
18. Heffernan,R. et al. (2015) Improving prediction of secondary structure, local backbone angles, and solvent accessible surface area of proteins by iterative deep learning. Sci. Rep., 5, 11476.
19. Heffernan, R. et al. (2016) Highly accurate sequence-based prediction of half-sphere exposures of amino acid residues in proteins. Bioinformatics, 32, 843-849.
20. Hochreiter,S., and Schmidhuber,J. (1997) Long short-term memory. Neural Comput., 9, 1735-1780.
21. Holbrook,S.R. et al. (1990) Predicting surface exposure of amino acids from protein sequence. Protein Eng., 3, 659-665.
22. Jones,D.T. (1999) Protein secondary structure prediction based on positionspecific scoring matrices. J. Mol. Biol., 292, 195-202.
23. Kabsch,W., and Sander,C. (1983) Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features. Biopolymers, 22, 2577-2637.
24. Kang,H.S. et al. (1993) Estimation and use of protein backbone angle probabilities. J Mol. Biol., 229, 448-460.
25. Kingma,D., and Ba,J. (2014) Adam: a method for stochastic optimization. arXiv:1412.6980.
26. Kinjo,A.R., and Nishikawa,K. (2006) CRNPRED: highly accurate prediction of one-dimensional protein structures by large-scale critical random networks. BMC Bioinformatics, 7, 401.
27. Kuang,R. et al. (2004) Protein backbone angle prediction with machine learning approaches. Bioinformatics, 20, 1612-1621.
28. LeCun,Y. et al. (2006) A tutorial on energy-based learning. In: Bakir, G., Hofman, T., Schölkopf, B., Smola, A., Taskar, B. (eds.) Predicting Structured Data. MIT Press, Cambridge.
29. Lee,B., and Richards,F.M. (1971) The interpretation of protein structures: estimation of static accessibility. J. Mol. Biol., 55, 379-400.
30. Lyons,J. et al. (2014) Predicting backbone ca angles and dihedrals from protein sequences by stacked sparse auto-encoder deep neural network. J. Comput. Chem., 35, 2040-2046.
31. Magnan,C.N., and Baldi,P. (2014) SSpro/ACCpro 5: almost perfect prediction of protein secondary structure and relative solvent accessibility using profiles, machine learning and structural similarity. Bioinformatics, 30, 2592-2597.
32. Mirabello,C., and Pollastri,G. (2013) Porter, PaleAle 4.0: high-accuracy prediction of protein secondary structure and relative solvent accessibility. Bioinformatics, 29, 2056-2058.
33. Pauling,L. et al. (1951) The structure of proteins: two hydrogen-bonded helical configurations of the polypeptide chain. Proc. Natl. Acad. Sci. USA, 37, 205-211.
34. Pollastri,G. et al. (2002a) Improving the prediction of protein secondary structure in three and eight classes using recurrent neural networks and profiles. Proteins, 47, 228-235.
35. Pollastri,G. et al. (2002b) Prediction of coordination number and relative solvent accessibility in proteins. Proteins, 47, 142-153.
36. Remmert,M. et al. (2012) HHblits: lightning-fast iterative protein sequence searching by HMM-HMMalignment. Nat. Methods, 9, 173-175.
37. Reva,B.A. et al. (1998) What is the probability of a chance prediction of a protein structure with an rmsd of 6A. Fold Des., 3, 141-147.
38. Rost,B. (2001) Review: protein secondary structure prediction continues to rise. J. Struct. Biol., 134, 204-218.
39. Rost,B., and Sander,C. (1994) Conservation and prediction of solvent accessibility in protein families. Proteins, 20, 216-226.
40. Schuster,M., and Paliwal,K.K. (1997) Bidirectional recurrent neural networks. IEEE Trans. Signal Process., 45, 2673-2681.
41. Song,J. et al. (2008) HSEpred: predict half-sphere exposure from protein sequences. Bioinformatics, 24, 1489-1497.
42. Srivastava,N. et al. (2014) Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res., 15, 1929-1958.
43. Sundermeyer,M. et al. (2012) LSTM neural networks for language modeling. In: Proceedings Interspeech. p.194-197.
44. Tuncbag,N. et al. (2009) Identification of computational hot spots in protein interfaces: combining solvent accessibility and inter-residue potentials improves the accuracy. Bioinformatics, 25, 1513-1520.
45. Wang,S. et al. (2016) Protein secondary structure prediction using deep convolutional neural fields. Sci. Rep., 6, 18962.
46. Wood,M.J., and Hirst,J.D. (2005) Protein secondary structure prediction with dihedral angles. Proteins, 59, 476-481.
47. Xiong,W. et al. (2016) Achieving human parity in conversational speech recognition. arXiv:1610.05256.
48. Xue,B. et al. (2008) Real-value prediction of backbone torsion angles. Proteins, 72, 427-433.
49. Yang,Y. et al. (2016) Sixty-five years of long march in protein secondary structure prediction: the final stretch? Brief. Bioinform., DOI: 10.1093/bib/bbw129.
50. Yaseen,A., and Li,Y. (2014) Context-based features enhance protein secondary structure prediction accuracy. J. Chem. Inf. Model., 54, 992-1002.
51. Yuan,Z. (2005) Better prediction of protein contact number using a support vector regression analysis of amino acid sequence. BMC Bioinformatics, 6, 248.
52. Yuan,Z., and Huang,B. (2004) Prediction of protein accessible surface areas by support vector regression. Proteins, 57, 558-564.
53. Zhou,Y., and Faraggi,E. (2010) Prediction of one-dimensional structural properties of proteins by integrated neural networks. In: Rangwala, R. and Karypis, G. (ed.) Introduction to Protein Structure Prediction, Chap. 4, John Wiley & Sons, Inc., Hoboken, NJ. p.45-74.
54. Zhou,Y. et al. (2011) Trends in template/fragment-free protein structure prediction. Theor. Chem. Acc., 128, 3-16.