Measuring the performance of ordinal classification

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 25, Issue 8, 2011, Pages 1173-1195

  Cardoso, Jaime S ^a   Sousa, Ricardo ^a  

^a UNIVERSITY OF PORTO   (Portugal)

Author keywords

Classification; classification accuracy; evaluation measures; ordinal data; performance

Indexed keywords

CLASSIFICATION ACCURACY; CONFUSION MATRICES; ERROR COEFFICIENT; EVALUATION MEASURES; EXPERIMENTAL STUDIES; MISCLASSIFICATION ERROR; MULTI-CLASS CLASSIFICATION; ORDINAL CLASSIFICATION; ORDINAL DATA; PERFORMANCE; RELATIVE ORDER;

CLASSIFICATION (OF INFORMATION); PATTERN RECOGNITION; SOFTWARE ENGINEERING;

IMAGE RESOLUTION;

EID: 84855374161     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001411009093     Document Type: Article

References (24)

1. S. Baccianella, A. Esuli and F. Sebastiani, Evaluation measures for ordinal regression, Proc. Ninth Int. Conf. Intelligent Systems Design and Applications, 2009, pp. 283-287.
2. A. Ben-David, A lot of randomness is hiding in accuracy, Eng. Appl. AI 20(7) (2007) 875-885. (Pubitemid 47419312)
3. J. S. Cardoso and M. J. Cardoso, Towards an intelligent medical system for the aesthetic evaluation of breast cancer conservative treatment, Artif. Intell. Med. 40 (2007) 115-126. (Pubitemid 46805136)
4. J. S. Cardoso and J. F. Pinto da Costa, Learning to classify ordinal data: The data replication method, J. Mach. Learn. Res. 8 (2007) 1393-1429. (Pubitemid 47210277)
5. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines, 2001, Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
6. E. Frank and M. Hall, A simple approach to ordinal classification, Proc. 12th European Conf. Machine Learning (Springer-Verlag, 2001), pp. 145-156. (Pubitemid 33331065)
7. L. Gaudette and N. Japkowicz, Evaluation methods for ordinal classification, in Proc. 2nd Canadian Conf. Artificial Intelligence, eds. Y. Gao and N. Japkowicz, Lecture Notes in Computer Science (Springer, 2009), pp. 207-210.
8. T. J. Hastie and R. J. Tibshirani, Generalized Additive Models, Monographs on Statistics and Applied Probability, Vol. 43 (1990), pp. 297-318.
9. R. Herbrich, T. Graepel and K. Obermayer, Support vector learning for ordinal regression, Ninth Int. Conf. Artificial Neural Networks ICANN 1 (1999) 97-102. (Pubitemid 30519921)
10. L. Jiang, D. Wang, H. Zhang, Z. Cai and B. Huang, Using instance cloning to improve naive Bayes for ranking, Int. J. Patt. Recogn. Artif. Intell. 6 (2008) 1121-1140.
11. M. Kendall, A new measure of rank correlation, Biometrika 30 (1938) 81-89.
12. S. Kotsiantis and D. Kanellopoulos, Cascade generalisation for ordinal problems, Int. J. Artif. Intell. Soft Comput. 2 (2010) 46-57.
13. J. W. T. Lee and D.-Z. Liu, Induction of ordinal decision trees, Proc. Int. Conf. Machine Learning and Cybernetics 4 (2002) 2220-2224.
14. P. McCullagh, Regression models for ordinal data, J. Roy. Stat. Soc. Series B 42 (1980) 109-142.
15. J. F. Pinto da Costa, H. Alonso and J. S. Cardoso, The unimodal model for the classification of ordinal data, Neural Networks 21 (2008) 78-91.
16. J. Pinto da Costa, R. Sousa and J. S. Cardoso, An all-at-once unimodal SVM approach for ordinal classification, Proc. Ninth Int. Conf. Machine Learning and Applications (ICMLA 2010), 2010.
17. W. Press, B. Flannery, S. Teukolsky and W. Vetterling, Numerical Recipes in C: The Art of Scientific Computing (Cambridge University Press, Cambridge, 2002).
18. V. C. Raykar, R. Duraiswami and B. Krishnapuram, A fast algorithm for learning a ranking function from large-scale data sets, IEEE Trans. Patt. Anal. Mach. Intell. 30(7) (2008) 1158-1170.
19. A. Shashua and A. Levin, Ranking with largemarg in principle: Two approaches, Adv. Neural Inform. Process. Syst. 15, eds. Thrun and K. Obermayer (MIT Press, 2003), pp. 937-944.
20. C. Spearman, The proof and measurement of association between two things, American J. Psychol. 15 (1904) 72-101.
21. G. Tutz, Generalized semiparametrically structured ordinal models, Biometrics 59 (2003) 263-273. (Pubitemid 36750340)
22. S. Vanbelle and A. Albert, A note on the linearly weighted kappa coefficient for ordinal scales, Statist. Methodol. 6(2) (2009) 157-163.
23. W. Waegeman, Learning to Rank: a ROC-Based Graph-Theoretic Approach, Ph.D. thesis, Universiteit Gent, 2009.
24. W. Waegeman, B. De Baets and L. Boullart, A comparison of different ROC measures for ordinal regression, Proc. CML 2006 Workshop on ROC Analysis in Machine Learning (2006).