The relationship between precision-recall and ROC curves

ACM International Conference Proceeding Series

Volumn 148, Issue , 2006, Pages 233-240

  Davis, Jesse ^a   Goadrich, Mark ^a  

^a University of Wisconsin Madison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BINARY DECISION DIAGRAMS; INTERPOLATION; OPTIMIZATION; PROBLEM SOLVING;

BINARY DECISION PROBLEMS; DATASETS; PRECISION-RECALL (PR); RECEIVER OPERATOR CHARACTERISTIC (ROC);

LEARNING SYSTEMS;

EID: 34250727580     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1143844.1143874     Document Type: Conference Paper

References (22)

1. Bockhorst, J., & Craven, M. (2005). Markov networks for detecting overlapping elements in sequence data. Neural Information Processing Systems 17 (NIPS). MIT Press.
2. Bradley, A. (1997). The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition, 30, 1145-1159.
3. Bunescu, R., Ge, R., Kate, R., Marcotte, E., Mooney, R., Ramani, A., & Wong, Y. (2004). Comparative Experiments on Learning Information Extractors for Proteins and their Interactions. Journal of Artificial Intelligence in Medicine, 139-155.
4. Cormen, T. H., Leiserson, Charles, E., & Rivest, R. L. (1990). Introduction to algorithms. MIT Press.
5. Cortes, C., & Mohri, M. (2003). AUC optimization vs. error rate minimization. Neural Information Processing Systems 15 (NIPS). MIT Press.
6. Davis, J., Burnside, E., Dutra, I., Page, D., Ramakrishnan, R., Costa, V. S., & Shavlik, J. (2005). View learning for statistical relational learning: With an application to mammography. Proceeding of the 19th International Joint Conference on Artificial Intelligence. Edinburgh, Scotland.
7. Drummond, C., & Holte, R. (2000). Explicitly representing expected cost: an alternative to ROC representation. Proceeding of Knowledge Discovery and Datamining (pp. 198-207).
8. Drummond, C., & Holte, R. C. (2004). What ROC curves can't do (and cost curves can). ROCAI (pp. 19-26).
9. Ferri, C., Flach, P., & Henrandez-Orallo, J. (2002). Learning decision trees using area under the ROC curve. Proceedings of the 19th International Conference on Machine Learning (pp. 139-146). Morgan Kaufmann.
10. Freund, Y., Iyer, R., Schapire, R., & Singer, Y. (1998). An efficient boosting algorithm for combining preferences. Proceedings of the 15th International Conference on Machine Learning (pp. 170-178). Madison, US: Morgan Kaufmann Publishers, San Francisco, US.
11. Goadrich, M., Oliphant, L., & Shavlik, J. (2004). Learning ensembles of first-order clauses for recall-precision curves: A case study in biomedical information extraction. Proceedings of the 14th International Conference on Inductive Logic Programming (ILP). Porto, Portugal.
12. Herschtal, A., & Raskutti, B. (2004). Optimising area under the ROC curve using gradient descent. Proceedings of the 21st International Conference on Machine Learning (p. 49). New York, NY, USA: ACM Press.
13. Joachims, T. (2005). A support vector method for multivariate performance measures. Proceedings of the 22nd International Conference on Machine Learning. ACM Press.
14. Kok, S., & Domingos, P. (2005). Learning the structure of Markov Logic Networks. Proceedings of 22nd International Conference on Machine Learning (pp. 441-448). ACM Press.
15. Macskassy, S., & Provost, F. (2005). Suspicion scoring based on guilt-by-association, collective inference, and focused data access. International Conference on Intelligence. Analysis.
16. Manning, C., & Schutze H. (1999). Foundations of statistical natural language processing. MIT Press.
17. Prati, R., & Flach, P. (2005). ROCCER: an algorithm for rule learning based on ROC analysis. Proceeding of the 19th International Joint Conference on Artificial Intelligence. Edinburgh, Scotland.
18. Provost, F., Fawcett, T., &: Kohavi, R. (1998). The case against accuracy estimation for comparing induction algorithms. Proceeding of the 15th International Conference on Machine Learning (pp. 445-453). Morgan Kaufmann, San Francisco, CA.
19. Raghavan, V., Bollmann, P., & Jung, G. S. (1989). A critical investigation of recall and precision as measures of retrieval system performance. ACM Trans. Inf. Syst., 7, 205-229.
20. Singla, P., & Domingos, P. (2005). Discriminative training of Markov Logic Networks. Proceedings of the 20th National Conference on Artificial Intelligene (AAAI) (pp. 868-873). AAAI Press.
21. Srinivasan, A. (2003). The Aleph Manual Version 4. http://web.comlab. ox.ac.uk/oucl/research/areas/machlearn/Aleph/.
22. Yan, L., Dodier, R., Mozer, M., & Wolniewicz, R. (2003). Optimizing classifier performance via the WilcoxonMann-Whitney statistics. Proceedings of the 20th International Conference on Machine Learning.