Area under precision-recall curves for weighted and unweighted data

PLoS ONE

Volumn 9, Issue 3, 2014, Pages

  Keilwagen, Jens ^a   Grosse, Ivo ^b,c   Grau, Jan ^b  

^a INSTITUTE FOR EPIDEMIOLOGY AND PATHOGEN DIAGNOSTICS   (Germany)

^b MARTIN LUTHER UNIVERSITY HALLE WITTENBERG   (Germany)

^c GERMAN CENTRE FOR INTEGRATIVE BIODIVERSITY RESEARCH IDIV HALLE JENA LEIPZIG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION; CLASSIFIER; RECALL; ALGORITHM; AREA UNDER THE CURVE; DATA BASE; RECEIVER OPERATING CHARACTERISTIC; STATISTICS;

ALGORITHMS; AREA UNDER CURVE; DATABASES AS TOPIC; ROC CURVE; STATISTICS AS TOPIC;

EID: 84925136125     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0092209     Document Type: Article

References (28)

1. Zucchini W (2000) An Introduction to Model Selection. Journal of Mathematical Psychology 44: 41-61.
2. Baldi P, Brunak S, Chauvin Y, Andersen CAF, Nielsen H (2000) Assessing the accuracy of prediction algorithms for classification: An overview. Bioinformatics 16: 412-424.
3. Stehman SV (1997) Selecting and interpreting measures of thematic classification accuracy. Remote Sensing of Environment 62: 77-89.
4. Fawcett T (2004) ROC graphs: Notes and practical considerations for researchers. Technical report, HP Laboratories. URL http://www.hpl.hp. com/techreports/2003/HPL-2003-4.pdf.
5. Fawcett T (2006) An introduction to ROC analysis. Pattern Recognition Letters 27: 861-874.
6. Lobo JM, Jiménez-Valverde A, Real R (2008) AUC: A misleading measure of the performance of predictive distribution models. Global Ecology and Biogeography 17: 145-151.
7. Davis J, Goadrich M (2006) The relationship between Precision-Recall and ROC curves. In: ICML '06: Proceedings of the 23rd international conference on Machine learning. New York, NY, USA: ACM, 233-240. doi: Http://dx.doi. org/10.1145/1143844.1143874. URL http://dx.doi.org/10.1145/1143844. 1143874.
8. Bleakley K, Biau G, Vert JP (2007) Supervised reconstruction of biological networks with local models. Bioinformatics 23: I57-i65.
9. Aslam JA, Yilmaz E, Pavlu V (2005) A geometric interpretation of R-precision and its correlation with average precision. In: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval. New York, NY, USA: ACM, SIGIR '05, 573-574. doi: 10.1145/1076034.1076134. URL http://doi.acm.org/10.1145/1076034. 1076134.
10. Manning CD, Raghavan P, Schtze H (2008) Introduction to Information Retrieval. New York, NY, USA: Cambridge University Press.
11. Zheng S, Yuille A, Tu Z (2010) Detecting object boundaries using low-, mid-, and high-level information. Computer Vision and Image Understanding 114: 1055-1067.
12. Sonnenburg S, Schweikert G, Philips P, Behr J, Ratsch G (2007) Accurate splice site prediction using support vector machines. BMC Bioinformatics 8: S7.
13. Alexiou P, Maragkakis M, Papadopoulos GL, Reczko M, Hatzigeorgiou AG (2009) Lost in translation: An assessment and perspective for computational microRNA target identification. Bioinformatics 25: 3049-3055.
14. Poulter G, Rubin D, Altman R, Seoighe C (2008) Mscanner: A classifier for retrieving medline citations. BMC Bioinformatics 9: 108.
15. Ohsaki M, Abe H, Tsumoto S, Yokoi H, Yamaguchi T (2007) Evaluation of rule interestingness measures in medical knowledge discovery in databases. Artificial Intelligence in Medicine 41: 177-196.
16. Prechelt L, Malpohl G, Philippsen M (2002) Finding plagiarisms among a set of programs with jplag. Journal of Universal Computer Science 8: 1016-1038.
17. Goldberg AB, Fillmore N, Andrzejewski D, Xu Z, Gibson B, et al. (2009) May all your wishes come true: A study of wishes and how to recognize them. In: Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, NAACL '09, 263-271. URL http://dl.acm.org/citation.cfm?id = 1620754. 1620793.
18. Kekäläinen J, Järvelin K (2002) Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science and Technology 53: 1120-1129.
19. Martin D, Fowlkes C, Malik J (2004) Learning to detect natural image boundaries using local brightness, color, and texture cues. Pattern Analysis and Machine Intelligence, IEEE Transactions on 26: 530-549.
20. Grau J, Posch S, Grosse I, Keilwagen J (2013) A general approach for discriminative de novo motif discovery from high-throughput data. Nucleic Acids Research 41: E197.
21. Lockhart DJ, Winzeler EA (2000) Genomics, gene expression and DNA arrays. Nature 405: 827-836.
22. Yeo G, Burge CB (2004) Maximum Entropy Modeling of Short Sequence Motifs with Applications to RNA Splicing Signals. Journal of Computational Biology 11: 377-394.
23. Keilwagen J, Grau J, Posch S, Grosse I (2007) Recognition of splice sites using maximum conditional likelihood. In: Hinneburg A, editor, LWA: Lernen - Wissen - Adaption. 67-72.
24. Brodersen KH, Ong CS, Stephan KE, Buhmann JM (2010) The binormal assumption on precisionrecall curves. In: ICPR'10. 4263-4266.
25. Boyd K, Eng K, Page C (2013) Area under the precision-recall curve: Point estimates and confi-dence intervals. In: Blockeel H, Kersting K, Nijssen S, Z ? elezný F, editors, Machine Learning and Knowledge Discovery in Databases, Springer Berlin Heidelberg, volume 8190 of Lecture Notes in Computer Science. 451-466.
26. Boyd K, Davis J, Page D, Costa VS (2012) Unachievable region in precisionrecall space and its effect on empirical evaluation. In: ICML. icml.cc/Omnipress.
27. Weirauch MT, Cote A, Norel R, Annala M, Zhao Y, et al. (2013) Evaluation of methods for modeling transcription factor sequence specificity. Nature Biotechnology 31: 126-134.
28. Grau J, Keilwagen J, Gohr A, Haldemann B, Posch S, et al. (2012) Jstacs: A Java framework for statistical analysis and classi-cation of biological sequences. Journal of Machine Learning Research 13: 1967-1971.