Protein Secondary Structure Prediction Using Deep Convolutional Neural Fields

Scientific Reports

Volumn 6, Issue , 2016, Pages

  Wang, Sheng ^a,b   Peng, Jian ^c   Ma, Jianzhu ^a   Xu, Jinbo ^a  

^a TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

^c University of Illinois at Urbana Champaign ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PROTEIN;

ARTIFICIAL NEURAL NETWORK; BIOLOGY; CHEMISTRY; PROCEDURES; PROTEIN DATABASE; PROTEIN SECONDARY STRUCTURE; REPRODUCIBILITY;

COMPUTATIONAL BIOLOGY; DATABASES, PROTEIN; NEURAL NETWORKS (COMPUTER); PROTEIN STRUCTURE, SECONDARY; PROTEINS; REPRODUCIBILITY OF RESULTS;

EID: 84954113329     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep18962     Document Type: Article

References (79)

1. Baker, D. & Sali, A. Protein structure prediction and structural genomics. Science 294, 93-96 (2001).
2. Dill, K. A. & MacCallum, J. L. The protein-folding problem, 50 years on. Science 338, 1042-1046 (2012).
3. Petsko, G. A. & Ringe, D. Protein structure and function. (New Science Press, 2004).
4. Whittle, P. J. & Blundell, T. L. Protein structure-based drug design. Annu. Rev. Biophys. Biomol. Struct. 23, 349-375 (1994).
5. Schaffhausen, J. Advances in structure-based drug design. Trends Pharmacol. Sci. 33, 223 (2012).
6. Whisstock, J. C. & Lesk, A. M. Prediction of protein function from protein sequence and structure. Q. Rev. Biophys. 36, 307-340 (2003).
7. Lee, D., Redfern, O. & Orengo, C. Predicting protein function from sequence and structure. Nat. Rev. Mol. Cell Biol. 8, 995-1005 (2007).
8. Radivojac, P. et al. A large-scale evaluation of computational protein function prediction. Nat. Methods 10, 221-227 (2013).
9. Rost, B., Yachdav, G. & Liu, J. The predictprotein server. Nucleic Acids Res. 32, W321-W326 (2004).
10. Lin, K., Simossis, V. A., Taylor, W. R. & Heringa, J. A simple and fast secondary structure prediction method using hidden neural networks. Bioinformatics 21, 152-159 (2005).
11. Yoo, P. D., Zhou, B. B. & Zomaya, A. Y. Machine learning techniques for protein secondary structure prediction: an overview and evaluation. Current Bioinformatics 3, 74-86 (2008).
12. Faraggi, E., Zhang, T., Yang, Y., Kurgan, L. & Zhou, Y. SPINE X: improving protein secondary structure prediction by multistep learning coupled with prediction of solvent accessible surface area and backbone torsion angles. J. Comp. Chem. 33, 259-267 (2012).
13. Pauling, L., Corey, R. B. & Branson, H. R. The structure of proteins: two hydrogen-bonded helical configurations of the polypeptide chain. Proc. Natl. Acad. Sci. USA 37, 205-211 (1951).
14. Kabsch, W. & Sander, C. Dictionary of protein secondary structure: pattern recognition of hydrogen - bonded and geometrical features. Biopolymers 22, 2577-2637 (1983).
15. Myers, J. K. & Oas, T. G. Preorganized secondary structure as an important determinant of fast protein folding. Nat. Struct. Mol. Biol. 8, 552-558 (2001).
16. Källberg, M. et al. Template-based protein structure modeling using the RaptorX web server. Nature protocols 7, 1511-1522 (2012).
17. Zhang, Y. I-TASSER server for protein 3D structure prediction. BMC Bioinformatics 9, 40 (2008).
18. Simons, K. T., Kooperberg, C., Huang, E. & Baker, D. Assembly of protein tertiary structures from fragments with similar local sequences using simulated annealing and Bayesian scoring functions. J. Mol. Biol. 268, 209-225 (1997).
19. Holley, L. H. & Karplus, M. Protein secondary structure prediction with a neural network. Proc. Natl. Acad. Sci. USA 86, 152-156 (1989).
20. Qian, N. & Sejnowski, T. J. Predicting the secondary structure of globular proteins using neural network models. J. Mol. Biol. 202, 865-884 (1988).
21. Kneller, D., Cohen, F. & Langridge, R. Improvements in protein secondary structure prediction by an enhanced neural network. J. Mol. Biol. 214, 171-182 (1990).
22. Asai, K., Hayamizu, S. & Handa, K. I. Prediction of protein secondary structure by the hidden Markov model. Comput. Appl. Biosci. 9, 141-146 (1993).
23. Rost, B. & Sander, C. Prediction of protein secondary structure at better than 70% accuracy. J. Mol. Biol. 232, 584-599 (1993).
24. Jones, D. T. Protein secondary structure prediction based on position-specific scoring matrices. J. Mol. Biol. 292, 195-202 (1999).
25. Schmidler, S. C., Liu, J. S. & Brutlag, D. L. Bayesian segmentation of protein secondary structure. J. Comput. Biol. 7, 233-248 (2000).
26. Pollastri, G., Przybylski, D., Rost, B. & Baldi, P. Improving the prediction of protein secondary structure in three and eight classes using recurrent neural networks and profiles. Proteins: Struct. Funct. Bioinform. 47, 228-235 (2002).
27. Kim, H. & Park, H. Protein secondary structure prediction based on an improved support vector machines approach. Protein Eng. 16, 553-560 (2003).
28. Ward, J. J., McGuffin, L. J., Buxton, B. F. & Jones, D. T. Secondary structure prediction with support vector machines. Bioinformatics 19, 1650-1655 (2003).
29. Chu, W., Ghahramani, Z. & Wild, D. L. A graphical model for protein secondary structure prediction. Proceedings of the Twenty-first International Conference (ICML 2004), Banff, Alberta, Canada, July 4-8, 2004. ACM International Conference Proceeding Series, ACM 2004, 21 (2004).
30. Guo, J., Chen, H., Sun, Z. & Lin, Y. A novel method for protein secondary structure prediction using dual - layer SVM and profiles. Proteins: Struct. Funct. Bioinform. 54, 738-743 (2004).
31. Aydin, Z., Altunbasak, Y. & Borodovsky, M. Protein secondary structure prediction for a single-sequence using hidden semi-Markov models. BMC Bioinformatics 7, 178 (2006).
32. Im, I. G. Predicting Protein Secondary Structure Using Markov Chain Monte-Carlo Simulation. (ProQuest, 2008).
33. Wang, Z., Zhao, F., Peng, J. & Xu, J. Protein 8 - class secondary structure prediction using conditional neural fields. Proteomics 11, 3786-3792 (2011).
34. Magnan, C. N. & Baldi, P. SSpro/ACCpro 5: almost perfect prediction of protein secondary structure and relative solvent accessibility using profiles, machine learning and structural similarity. Bioinformatics 30, 2592-2597 (2014).
35. Zvelebil, M. J., Barton, G. J., Taylor, W. R. & Sternberg, M. J. Prediction of protein secondary structure and active sites using the alignment of homologous sequences. J. Mol. Biol. 195, 957-961 (1987).
36. Zhou, J. & Troyanskaya, O. Deep Supervised and Convolutional Generative Stochastic Network for Protein Secondary Structure Prediction. Proceedings of the 31th International Conference on Machine Learning, ICML 2014, Beijing, China, 21-26 June 2014. JMLR Proceedings 32, 745-753 (2014).
37. Baldi, P., Brunak, S., Frasconi, P., Soda, G. & Pollastri, G. Exploiting the past and the future in protein secondary structure prediction. Bioinformatics 15, 937-946 (1999).
38. Higgins, D. G. & Sharp, P. M. CLUSTAL: a package for performing multiple sequence alignment on a microcomputer. Gene 73, 237-244 (1988).
39. Edgar, R. C. MUSCLE: multiple sequence alignment with high accuracy and high throughput. Nucleic Acids Res. 32, 1792-1797 (2004).
40. Thompson, J. D., Higgins, D. G. & Gibson, T. J. CLUSTAL W: improving the sensitivity of progressive multiple sequence alignment through sequence weighting, position-specific gap penalties and weight matrix choice.Nucleic Acids Res. 22, 4673-4680 (1994).
41. Altschul, S. F. et al. Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res. 25, 3389-3402 (1997).
42. Maaten, L., Welling, M. & Saul, L. K. Hidden-unit conditional random fields. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, AISTATS 2011, Fort Lauderdale, USA, April 11-13, 2011. JMLR Proceedings 15, 479-488 (2011).
43. Hua, S. & Sun, Z. A novel method of protein secondary structure prediction with high segment overlap measure: support vector machine approach. J. Mol. Biol. 308, 397-407 (2001).
44. Spencer, M., Eickholt, J. & Cheng, J. A Deep Learning Network Approach to ab initio Protein Secondary Structure Prediction. IEEE/ACM Trans. Comput. Biol. Bioinform. 12, 103-112 (2015).
45. Hinton, G. E. & Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. Science 313, 504-507 (2006).
46. Hinton, G. Training products of experts by minimizing contrastive divergence. Neural Comput. 14, 1771-1800 (2002).
47. Drozdetskiy, A., Cole, C., Procter, J. & Barton, G. J. JPred4: a protein secondary structure prediction server. Nucleic Acids Res., gkv332 (2015).
48. Cuff, J. A., Clamp, M. E., Siddiqui, A. S., Finlay, M. & Barton, G. J. JPred: a consensus secondary structure prediction server. Bioinformatics 14, 892-893 (1998).
49. Zemla, A., Venclovas, Č., Fidelis, K. & Rost, B. A modified definition of Sov, a segment - based measure for protein secondary structure prediction assessment. Proteins: Struct. Funct. Bioinform. 34, 220-223 (1999).
50. Peng, J., Bo, L. & Xu, J. Conditional neural fields. Advances in Neural Information Processing Systems 22: 23rd Annual Conference on Neural Information Processing Systems 2009. Proceedings of a meeting held 7-10 December 2009, Vancouver, British Columbia, Canada. Curran Associates, Inc. 2009, 1419-1427 (2009).
51. Lee, H., Grosse, R., Ranganath, R. & Ng, A. Y. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. Proceedings of the 26th Annual International Conference on Machine Learning, ICML 2009, Montreal, Quebec, Canada, June 14-18, 2009. ACM International Conference Proceeding Series 382, ACM 2009, 609-616 (2009).
52. Lafferty, J., McCallum, A. & Pereira, F. C. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), Williams College, Williamstown, MA, USA, June 28 - July 1, 2001. Morgan Kaufmann 2001 (2001).
53. Wang, G. & Dunbrack, R. L. PISCES: a protein sequence culling server. Bioinformatics 19, 1589-1591 (2003).
54. Kryshtafovych, A. et al. Assessment of the assessment: evaluation of the model quality estimates in CASP10. Proteins: Struct. Funct. Bioinform. 82, 112-126 (2014).
55. Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T. & Tramontano, A. Critical assessment of methods of protein structure prediction (CASP) - round x. Proteins: Struct. Funct. Bioinform. 82, 1-6 (2014).
56. Sillitoe, I. et al. CATH: comprehensive structural and functional annotations for genome sequences. Nucleic Acids Res. 43, D376-D381 (2015).
57. Andreeva, A., Howorth, D., Chothia, C., Kulesha, E. & Murzin, A. G. SCOP2 prototype: a new approach to protein structure mining. Nucleic Acids Res. 42, D310-D314 (2014).
58. Andersen, C. A., Bohr, H. & Brunak, S. Protein secondary structure: category assignment and predictability. FEBS Lett. 507, 6-10 (2001).
59. Penel, S., Morrison, R. G., Dobson, P. D., Mortishire - Smith, R. J. & Doig, A. J.Length preferences and periodicity in β - strands. Antiparallel edge β - sheets are more likely to finish in non - hydrogen bonded rings. Protein Eng. 16, 957-961 (2003).
60. Sha, F. & Pereira, F. Shallow parsing with conditional random fields. HLT-NAACL 2003, Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, May 27 - June 1, Edmonton, Canada, 134-141 (2003).
61. Wang, S. B., Quattoni, A., Morency, L., Demirdjian, D. & Darrell, T. Hidden conditional random fields for gesture recognition. 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), 17-22 June 2006, New York, NY, USA. IEEE Computer Society 2006 2, 1521-1527 (2006).
62. Taskar, B., Guestrin, C. & Koller, D. Max-margin Markov networks. Advances in Neural Information Processing Systems 16 [Neural Information Processing Systems, NIPS 2003, December 8-13, 2003, Vancouver and Whistler, British Columbia, Canada]. MIT Press 2004 16, 25 (2004).
63. Joo, K., Lee, S. J. & Lee, J. Sann: Solvent accessibility prediction of proteins by nearest neighbor method. Proteins: Struct. Funct. Bioinform. 80, 1791-1797 (2012).
64. Faraggi, E., Xue, B. & Zhou, Y. Improving the prediction accuracy of residue solvent accessibility and real - value backbone torsion angles of proteins by guided - learning through a two - layer neural network. Proteins: Struct. Funct. Bioinform. 74, 847-856 (2009).
65. Kinjo, A. R., Horimoto, K. & Nishikawa, K. Predicting absolute contact numbers of native protein structure from amino acid sequence. Proteins: Struct. Funct. Bioinform. 58, 158-165 (2005).
66. Wang, S. & Zheng, W.-M. CLePAPS: fast pair alignment of protein structures based on conformational letters. J. Bioinf. Comput. Biol. 6, 347-366 (2008).
67. Wang, S. & Zheng, W.-M. Fast multiple alignment of protein structures using conformational letter blocks. Open Bioinformatics Journal 3, 69-83 (2009).
68. Wang, S., Ma, J., Peng, J. & Xu, J. Protein structure alignment beyond spatial proximity. Scientific reports 3 (2013).
69. Zheng, W.-M. The use of a conformational alphabet for fast alignment of protein structures. Bioinformatics Research and Applications, 331-342 (2008).
70. Cheng, J., Sweredoski, M. J. & Baldi, P. Accurate prediction of protein disordered regions by mining protein structure data. Data Min. Knowl. Disc. 11, 213-222 (2005).
71. Ward, J. J., McGuffin, L. J., Bryson, K., Buxton, B. F. & Jones, D. T. The DISOPRED server for the prediction of protein disorder. Bioinformatics 20, 2138-2139 (2004).
72. Dosztányi, Z., Csizmok, V., Tompa, P. & Simon, I. IUPred: web server for the prediction of intrinsically unstructured regions of proteins based on estimated energy content. Bioinformatics 21, 3433-3434 (2005).
73. Ma, J., Peng, J., Wang, S. & Xu, J. A conditional neural fields model for protein threading. Bioinformatics 28, i59-i66 (2012).
74. Ma, J., Wang, S., Zhao, F. & Xu, J. Protein threading using context-specific alignment potential. Bioinformatics 29, i257-i265 (2013).
75. Ma, J., Wang, S., Wang, Z. & Xu, J.MRFalign: protein homology detection through alignment of Markov random fields. PLoS Comp. Biol. 10, e1003500 (2014).
76. Benkert, P., Künzli, M. & Schwede, T. QMEAN server for protein model quality estimation. Nucleic Acids Res., gkp322 (2009).
77. Zhao, F. & Xu, J. A position-specific distance-dependent statistical potential for protein structure and functional study. Structure 20, 1118-1126 (2012).
78. Liu, D. C. & Nocedal, J. On the limited memory BFGS method for large scale optimization. Mathematical programming 45, 503-528 (1989).
79. Consortium, U. The universal protein resource (UniProt). Nucleic Acids Res. 36, D190-D195 (2008).