Threshold average precision (TAP-k): A measure of retrieval designed for bioinformatics

Bioinformatics

Volumn 26, Issue 14, 2010, Pages 1708-1713

  Carroll, Hyrum D ^a   Kann, Maricel G ^b   Sheetlin, Sergey L ^a   Spouge, John L ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

^b UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BIOLOGY; COMPUTER PROGRAM; FACTUAL DATABASE; INFORMATION RETRIEVAL; INTERNET; METHODOLOGY; RECEIVER OPERATING CHARACTERISTIC;

COMPUTATIONAL BIOLOGY; DATABASES, FACTUAL; INFORMATION STORAGE AND RETRIEVAL; INTERNET; ROC CURVE; SOFTWARE;

EID: 77954500920     PISSN: 13674803     EISSN: 14602059     Source Type: Journal    
DOI: 10.1093/bioinformatics/btq270     Document Type: Article

References (27)

1. Bamber, D. (1975) Area above ordinal dominance graph and area below receiver operating characteristic graph. J. Math. Psychol., 12, 387-415.
2. Berman, H. et al. (2007) The worldwide Protein Data Bank (wwPDB): ensuring a single, uniform archive of PDB data. Nucleic Acids Res., 35, D301-303.
3. Brenner, S.E. et al. (1998) Assessing sequence comparison methods with reliable structurally identified distant evolutionary relationships. Proc. Natl Acad. Sci. USA, 95, 6073-6078.
4. Chen, Z. (2003) Assessing sequence comparison methods with the average precision criterion. Bioinformatics, 19, 2456-2460.
5. Davis, J. and Goadrich, M. (2006) The Relationship Between Precision-Recall and ROC Curves. In Proceedings of the 23rd International Conference on Machine learning. ACM, Madison, Wisconsin, USA, pp. 233-240.
6. Eddy, S.R. (1998) Profile hidden Markov models. Bioinformatics, 14, 755-763.
7. Fawcett, T. (2006) An introduction to ROC analysis. Pattern Recognit. Lett., 27, 861-874.
8. Finn, R.D. et al. (2008) The Pfam protein families database. Nucleic Acids Res., 36, D281-D288.
9. Gonzalez, M. and Pearson, W. (2010) Homologous over-extension: a challenge for iterative similarity searches. Nucleic Acids Res., 38, 2177-2189.
10. Green, R.E. and Brenner, S.E. (2002) Bootstrapping and normalization for enhanced evaluations of pairwise sequence comparison. Proc. IEEE, 90, 1834-1847.
11. Gribskov, M. and Robinson, N.L. (1996) Use of receiver operating characteristic (ROC) analysis to evaluate sequence matching. Comput. Chem., 20, 25-33.
12. Hand, D.J. (2009) Measuring classifier performance: a coherent alternative to the area under the ROC curve. Mach. Learn., 77, 103-123.
13. Jones, C.E. et al. (2005) Automated methods of predicting the function of biological sequences using GO and BLAST. BMC Bioinformatics, 6, 272.
14. Kann, M.G. et al. (2007) The identification of complete domains within protein sequences using accurate E-values for semi-global alignment. Nucleic Acids Res., 35, 4678-4685.
15. Krishnamurthy, N. et al. (2007) FlowerPower: clustering proteins into domain architecture classes for phylogenomic inference of protein function, BMC Evol. Biol., 7 (Suppl. 1), S12.
16. Landgrebe, T.C.W. et al.(2006)Precision-recalloperatingcharacteristic(P-ROC)curves in imprecise environments. In Proceedings of 18th International Conference on Pattern Recognition, IEEE Computer Society, Los Alamitos, California, USA, pp. 123-127.
17. Liu, Y. and Shriberg, E. (2007) Comparing valuation metrics for sentence boundary detection. IEEE Int Conf. Acoust. Speech Signal Process., 185-188.
18. Marchler-Bauer, A. et al. (2007) CDD: a conserved domain database for interactive domain family analysis. Nucleic Acids Res., 35, D237-D240.
19. Pearson, W.R. and Sierk, M.L. (2005) The limits of protein sequence comparison? Curr. Opin. Struct. Biol., 15, 254-260.
20. Raychaudhuri, S. et al. (2002) Associating genes with gene ontology codes using a maximum entropy analysis of biomedical literature. Genome Res., 12, 203-214.
21. Schaffer, A.A. et al. (1999) IMPALA: matching a protein sequence against a collection of PSI-BLAST-constructed position-specific score matrices. Bioinformatics, 15, 1000-1011.
22. Schaffer, A.A. et al. (2001) Improving the accuracy of PSI-BLAST protein database searches with composition-based statistics and other refinements. Nucleic Acids Res., 29, 2994-3005.
23. Sierk, M.L. and Pearson, W.R. (2004) Sensitivity and selectivity in protein structure comparison. Protein Sci., 13, 773-785.
24. Swets, J.A. (1967) Effectiveness of Information Retrieval Methods. Bolt, Beranek, and Newman, Inc., Cambridge, MA.
25. Swets, J.A. (1988) Measuring the accuracy of diagnostic systems. Science, 240, 1285-1293.
26. Wass, M.N. and Sternberg, M.J.E. (2008) ConFunc - functional annotation in the twilight zone. Bioinformatics, 24, 798-806.
27. Wilbur, W.J. (1992) An information measure of retrieval performance. Inf. Syst., 17, 283-298.