Evaluation of model quality predictions in CASP9

Proteins: Structure, Function and Bioinformatics

Volumn 79, Issue SUPPL. 10, 2011, Pages 91-106

  Kryshtafovych, Andriy ^a   Fidelis, Krzysztof ^a   Tramontano, Anna ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

CASP; Model quality assessment; Protein structure modeling; Protein structure prediction; QA

Indexed keywords

PROTEIN;

ACCURACY; ANALYTIC METHOD; ARTICLE; CORRELATION COEFFICIENT; INTERMETHOD COMPARISON; MODEL; PREDICTION; PRIORITY JOURNAL; PROTEIN ANALYSIS; PROTEIN STRUCTURE; QUALITY CONTROL; RANK SUM TEST; SCORING SYSTEM;

COMPUTATIONAL BIOLOGY; MODELS, MOLECULAR; PROTEIN CONFORMATION; PROTEINS; SOFTWARE;

EID: 80855131663     PISSN: 08873585     EISSN: 10970134     Source Type: Journal    
DOI: 10.1002/prot.23180     Document Type: Article

References (59)

1. Schwede T, Sali A, Honig B, Levitt M, Berman HM, Jones D, Brenner SE, Burley SK, Das R, Dokholyan NV, Dunbrack RL, Jr, Fidelis K, Fiser A, Godzik A, Huang YJ, Humblet C, Jacobson MP, Joachimiak A, Krystek SR, Jr, Kortemme T, Kryshtafovych A, Montelione GT, Moult J, Murray D, Sanchez R, Sosnick TR, Standley DM, Stouch T, Vajda S, Vasquez M, Westbrook JD, Wilson IA. Outcome of a workshop on applications of protein models in biomedical research. Structure 2009; 17: 151-159.
2. Moult J. Comparative modeling in structural genomics. Structure 2008; 16: 14-16.
3. Tramontano A. The role of molecular modelling in biomedical research. FEBS Lett 2006; 580: 2928-2934.
4. Krishnan L, Li X, Naraharisetty HL, Hare S, Cherepanov P, Engelman A. Structure-based modeling of the functional HIV-1 intasome and its inhibition. Proc Natl Acad Sci USA 2010; 107: 15910-15915.
5. Haider SM, Patel JS, Poojari CS, Neidle S. Molecular modeling on inhibitor complexes and active-site dynamics of cytochrome P450 C17, a target for prostate cancer therapy. J Mol Biol 2010; 400: 1078-1098.
6. Mokarzel-Falcon L, Padron-Garcia JA, Carrasco-Velar R, Berry C, Montero-Cabrera LA. In silico study of the human rhodopsin and meta rhodopsin II/S-arrestin complexes: impact of single point mutations related to retina degenerative diseases. Proteins 2008; 70: 1133-1141.
7. Raimondo D, Giorgetti A, Giorgetti A, Bosi S, Tramontano A. Automatic procedure for using models of proteins in molecular replacement. Proteins 2007; 66: 689-696.
8. Qian B, Raman S, Das R, Bradley P, McCoy AJ, Read RJ, Baker D. High-resolution structure prediction and the crystallographic phase problem. Nature 2007; 450: 259-264.
9. Mitrasinovic PM. Advances in the structure-based design of the influenza A neuraminidase inhibitors. Curr Drug Targets 2010; 11: 315-326.
10. Du QS, Huang RB, Wang SQ, Chou KC. Designing inhibitors of M2 proton channel against H1N1 swine influenza virus. PLoS ONE 2010; 5: e9388.
11. Gonzalez-Diaz H, Prado-Prado FJ, Garcia-Mera X, Alonso N, Abeijon P, Caamano O, Yanez M, Munteanu CR, Pazos Sierra A, Dea-Ayuela MA, Gomez-Munoz MT, Garijo MM, Sansano J, Ubeira FM. MIND-BEST: web server for drugs and target discovery; design, synthesis, and assay of MAO-B inhibitors and theoretic-experimental study of G3PD protein from Trichomona gallineae. J Proteome Res 2010.
12. Tuccinardi T, Botta M, Giordano A, Martinelli A. Protein kinases: docking and homology modeling reliability. J Chem Inf Model 2010; 50: 1432-1441.
13. Warner DF, Ndwandwe DE, Abrahams GL, Kana BD, Machowski EE, Venclovas C, Mizrahi V. Essential roles for imuA'- and imuB-encoded accessory factors in DnaE2-dependent mutagenesis in Mycobacterium tuberculosis. Proc Natl Acad Sci USA 2010; 107: 13093-13098.
14. Vilar S, Ferino G, Phatak SS, Berk B, Cavasotto CN, Costanzi S. Docking-based virtual screening for ligands of G protein-coupled receptors: not only crystal structures but also in silico models. J Mol Graph Model 2011; 29: 614-623.
15. Ye Y, Li Z, Godzik A. Modeling and analyzing three-dimensional structures of human disease proteins. Pac Symp Biocomput 2006: 439-450.
16. Jurenaite-Urbanaviciene S, Serksnaite J, Kriukiene E, Giedriene J, Venclovas C, Lubys A. Generation of DNA cleavage specificities of type II restriction endonucleases by reassortment of target recognition domains. Proc Natl Acad Sci USA 2007; 104: 10358-10363.
17. Brylinski M, Skolnick J. Comprehensive structural and functional characterization of the human kinome by protein structure modeling and ligand virtual screening. J Chem Inf Model 2010; 50: 1839-1854.
18. Adam B, Charloteaux B, Beaufays J, Vanhamme L, Godfroid E, Brasseur R, Lins L. Distantly related lipocalins share two conserved clusters of hydrophobic residues: use in homology modeling. BMC Struct Biol 2008; 8: 1.
19. Kryshtafovych A, Fidelis K. Protein structure prediction and model quality assessment. Drug Discov Today 2009; 14: 386-393.
20. Cozzetto D, Kryshtafovych A, Ceriani M, Tramontano A. Assessment of predictions in the model quality assessment category. Proteins 2007; 69 (Suppl 8): 175-183.
21. Cozzetto D, Kryshtafovych A, Tramontano A. Evaluation of CASP8 model quality predictions. Proteins 2009; 77 (Suppl 9): 157-166.
22. Kinch L, Shi S, Cheng H, Cong Q, Pei J, Schwede T, Grishin N. CASP9 target classification. Proteins, 2011; 79 (Suppl 10): 21-36.
23. Zemla A. LGA: a method for finding 3D similarities in protein structures. Nucleic Acids Res 2003; 31: 3370-3374.
24. Electronic Statistics Textbook.
25. Wilcox RR. Fundamentals of modern statistical methods: substantially improving power and accuracy. New York, NY: Springer; 2010. xvi, 249 p.
26. Zimmerman DW, Zumbo BD, Williams RH. Bias in estimation and hypothesis testing of correlation. Psicologica 2003; 24: 133-158.
27. Electronic Statistics Textbook.
28. Faller AJ. An average correlation-coefficient. J Appl Meteorol 1981; 20: 203-205.
29. Sheskin DJ. Handbook of parametric and nonparametric statistical procedures. Boca Raton: Chapman & Hall/CRC; 2007. 1776 p.
30. Lasko TA, Bhagwat JG, Zou KH, Ohno-Machado L. The use of receiver operating characteristic curves in biomedical informatics. J Biomed Inform 2005; 38: 404-415.
31. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29-36.
32. Matthews BW. Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochim Biophys Acta 1975; 405: 442-451.
33. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areasunder two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988; 44: 837-845.
34. The R development Core Team. R: a language and environment for statistical computing. Vienna: The R development Core Team; 2006.
35. http://ca.expasy.org/tools/pROC/. 2011.
36. Kryshtafovych A, Fidelis K, Moult J. CASP9 results compared to those of previous CASP experiments. Proteins, 2011; 79 (Suppl 10): 196-207.
37. Pieper U, Webb BM, Barkan DT, Schneidman-Duhovny D, Schlessinger A, Braberg H, Yang Z, Meng EC, Pettersen EF, Huang CC, Datta RS, Sampathkumar P, Madhusudhan MS, Sjolander K, Ferrin TE, Burley SK, Sali A. ModBase, a database of annotated comparative protein structure models, and associated resources. Nucleic Acids Res 2011; 39(Database issue): D465-D474.
38. Kiefer F, Arnold K, Kunzli M, Bordoli L, Schwede T. The SWISS-MODEL Repository and associated resources. Nucleic Acids Res 2009; 37(Database issue): D387-D392.
39. Castrignano T, De Meo PD, Cozzetto D, Talamo IG, Tramontano A. The PMDB Protein Model Database. Nucleic Acids Res 2006; 34(Database issue): D306-D309.
40. Adamczak R, Pillardy J, Vallat BK, Meller J. Fast geometric consensus approach for protein model quality assessment. J Comput Biol, 2011 Jan 18. {Epub ahead of print}.
41. Zhang Y, Skolnick J. Scoring function for automated assessment of protein structure template quality. Proteins 2004; 57: 702-710.
42. Eisenberg D, Luthy R, Bowie JU. VERIFY3D: assessment of protein models with three-dimensional profiles. Methods Enzymol 1997; 277: 396-404.
43. Ota M, Nishikawa K. Assessment of pseudo-energy potentials by the best-five test: a new use of the three-dimensional profiles of proteins. Protein Eng 1997; 10: 339-351.
44. Sippl MJ. Recognition of errors in three-dimensional structures of proteins. Proteins 1993; 17: 355-362.
45. Kalman M, Ben-Tal N. Quality assessment of protein model-structures using evolutionary conservation. Bioinformatics 2010; 26: 1299-1307.
46. Roche DB, Buenavista MT, Tetchner SJ, McGuffin LJ. The IntFOLD server: an integrated web resource for protein fold recognition, 3D model quality assessment, intrinsic disorder prediction, domain prediction and ligand binding site prediction. Nucleic Acids Res 2011 Jul;39 (Web Server issue): W171-6. Epub 2011 Mar 31.
47. Yang YD, Spratt P, Chen H, Park C, Kihara D. Sub-AQUA: real-value quality assessment of protein structure models. Protein Eng Des Sel 2010; 23: 617-632.
48. Pawlowski M, Gajda MJ, Matlak R, Bujnicki JM. MetaMQAP: a meta-server for the quality assessment of protein models. BMC Bioinform 2008; 9: 403.
49. McGuffin LJ. Prediction of global and local model quality in CASP8 using the ModFOLD server. Proteins 2009; 77 (Suppl 9): 185-190.
50. Cheng J, Wang Z, Tegge AN, Eickholt J. Prediction of global and local quality of CASP8 models by MULTICOM series. Proteins 2009; 77 (Suppl 9): 181-184.
51. McGuffin LJ, Roche DB. Rapid model quality assessment for protein structure predictions using the comparison of multiple models without structural alignments. Bioinformatics 2010; 26: 182-188.
52. Wang Z, Tegge AN, Cheng J. Evaluating the absolute quality of a single protein model using structural features and support vector machines. Proteins 2009; 75: 638-647.
53. Lundstrom J, Rychlewski L, Bujnicki J, Elofsson A. Pcons: a neural-network-based consensus predictor that improves fold recognition. Protein Sci 2001; 10: 2354-2362.
54. Larsson P, Skwark MJ, Wallner B, Elofsson A. Assessment of global and local model quality in CASP8 using Pcons and ProQ. Proteins 2009; 77: 167-172
55. Cristobal S, Zemla A, Fischer D, Rychlewski L, Elofsson A. A study of quality measures for protein threading models. BMC Bioinform 2001; 2: 5.
56. Larsson P, Wallner B, Lindahl E, Elofsson A. Using multiple templates to improve quality of homology models in automated homology modeling. Protein Sci 2008; 17: 990-1002.
57. Benkert P, Tosatto SC, Schwede T. Global and local model quality estimation at CASP8 using the scoring functions QMEAN and QMEANclust. Proteins 2009; 77 (Suppl 9): 173-180.
58. Benkert P, Kunzli M, Schwede T. QMEAN server for protein model quality estimation. Nucleic Acids Res 2009; 37(Web Server issue): W510-W514.
59. Benkert P, Tosatto SC, Schomburg D. QMEAN: a comprehensive scoring function for model quality assessment. Proteins 2008; 71: 261-277.