The ROC skeleton for multiclass ROC estimation

Pattern Recognition Letters

Volumn 31, Issue 9, 2010, Pages 949-958

  Landgrebe, Thomas C W ^a   Paclik, Pavel ^a  

^a PR Sys Design   (Netherlands)

Author keywords

Cost sensitive optimisation; Multiclass ROC; Operating characteristics; ROC analysis

Indexed keywords

COST-SENSITIVE; MULTI-CLASS; OPERATING CHARACTERISTICS; OPTIMISATIONS; ROC ANALYSIS;

CLASSIFIERS; COMPUTATIONAL COMPLEXITY; MESH GENERATION;

COST BENEFIT ANALYSIS;

EID: 77951110829     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2009.12.037     Document Type: Article

References (20)

1. Bourke C., Deng K., Scott S., Schapire R., and Vinodchandran N. On reoptimizing multiclass classifiers. Mach. Learn. 71 2-3 (2008) 219-242
2. Bradley A. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit. 30 7 (1997) 1145-1159
3. Duin, R., Juszcak, P., Paclik, P., Pekalska, E., de Ridder, D., Tax, D., 2004. Prtools, a matlab toolbox for pattern recognition, Delft University of Technology. .
4. Edwards D., Metz C., and Kupinski M. Ideal observers and optimal ROC hypersurfaces in N-class classification. IEEE Trans. Med. Imaging 23 7 (2004) 891-895
5. Everson R., and Fieldsend J. Multi-class ROC analysis from a multi-objective optimisation perspective. Pattern Recognition Lett. 27 (2005) Special Issue on ROC Analysis
6. Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters 27 (2005) 861-874 Special Issue on ROC Analysis
7. Ferri, C., Hernandez-Orallo, J., Salido, M., 2003. Volume under the roc surface for multi-class problems. In: Proc. 14th European Conf. on Machine Learning, pp. 108-120.
8. Lachiche, N., Flach, P., 2003. Improving accuracy and cost of two-class and multi-class probabilistic classifiers using ROC curves. In: Proc. 20th Internat. Conf. on Machine Learning, Washington, DC, pp. 416-423.
9. Landgrebe, T., Duin, R., 2005. On Neyman-Pearson optimisation for multiclass classifiers. In: Sixteenth Annual Symposium of the Pattern Recognition Assoc. of South Africa.
10. Landgrebe, T., Duin, R., 2006. A simplified extension of the area under the ROC to the multiclass domain. In: Seventeenth Annual Symposium of the Pattern Recognition Association of South Africa.
11. Landgrebe T., and Duin R. Approximating the multiclass ROC by pairwise analysis. Pattern Recognition Lett. 28 13 (2007) 1747-1758
12. Landgrebe T., and Duin R. Efficient multiclass ROC approximation by decomposition via confusion matrix perturbation analysis. IEEE Trans. Pattern Anal. Machine Intell. 30 5 (2008) 810-822
13. Li M., and Sethi I. Confidence-based classifier design. Pattern Recognition 39 (2006) 1230-1240
14. McDonald R. The mean subjective utility score, a novel metric for cost-sensitive classifier evaluation. Pattern Recognition Lett. 27 13 (2006) 1472-1477
15. Metz C. Basic principles of ROC analysis. Seminars in Nucl. Med. 3 4 (1978)
16. Murphy, P., Aha, D., 1992. UCI repository of machine learning databases. University of California, Department of Information and Computer Science. .
17. O'Brien, D., Gray, R., 2005. Improving classification performance by exploring the role of cost matrices in partitioning the estimated class probability space. In: Proc. ICML2005 Workshop on ROC Analysis in Machine Learning, Bonn, Germany.
18. Pacli{dotless}́k, P., Lai, C., Novovicova, J., Duin, R., 2008. Variance estimation for two-class and multi-class ROC analysis using operating point averaging. In: 19th International Conference on Pattern Recognition, Tampa, USA (ICPR2008).
19. Provost F., and Fawcett T. Robust classification for imprecise environments. Mach. Learn. 42 (2001) 203-231
20. Srinivasan, A., 1999. Note on the location of optimal classifiers in N-dimensional ROC space. Technical Report PRG-TR-2-99, Oxford University Computing Laboratory.