Towards maximizing the area under the ROC curve for multi-class classification problems

Proceedings of the National Conference on Artificial Intelligence

Volumn 1, Issue , 2011, Pages 483-488

  Tang, Ke ^a   Wang, Rui ^a   Chen, Tianshi ^b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

AREA UNDER THE ROC CURVE; BINARY CLASSIFICATION PROBLEMS; CLASS DISTRIBUTIONS; CLASSIFICATION SYSTEM; COST-SENSITIVE LEARNING; EMPIRICAL STUDIES; LEARNING PROBLEM; LEARNING TO RANK; MISCLASSIFICATION COSTS; MULTI-CLASS; MULTI-CLASS PROBLEMS; MULTICLASS CLASSIFICATION PROBLEMS; PERFORMANCE OF CLASSIFIER; RANKBOOST; SUB-PROBLEMS; TRAINING PROCESS;

LEARNING ALGORITHMS;

ARTIFICIAL INTELLIGENCE;

EID: 80055040243     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Asuncion, A., and Newman, D. 2007. UCI machine learning repository. http://www.ics.uci.edu/~mlearn/MLRepository.html.
2. Bourke, C.; Deng, K.; Scott, S. D.; and Vinodchandran, R. E. S. N. V. 2008. On reoptimizing multi-class classifiers. Machine Learning 71(2-3):219-242.
3. Cerquides, J., and Mantaras, R. L. D. 2005. Robust Bayesian linear classifier ensembles. In Proceedings of 16th European Conference on Machine Learning, 72-83.
4. Edwards, D. C.; Metz, C. E.; and Nishikawa, R. M. 2005. The hypervolume under the ROC hypersurface of "near-guessing" and "near- perfect" observers in N-class classification tasks. IEEE transactions on medical imaging 24(3):293-239.
5. Elkan, C. 2001. The Foundations of Cost-Sensitive Learning. In Proceedings of 17th International Joint Conference on Artificial Intelligence, 973-978.
6. Fawcett, T. 2006. An introduction to ROC analysis. Pattern Recognition Letters 27:861-874.
7. Fawcett, T. 2008. PRIE: a system for generating rulelists to maximize ROC performance. Data Mining and Knowledge Discovery 17:207-224.
8. Ferri, C.; Flach, P.; and Hernandez-Orallo, J. 2002. Learning decision trees using the area under the ROC curve. In Proceedings of 19th International Conference on Machine Learning, 139-146.
9. Ferri, C.; Hernández-orallo, J.; and Salido, M. A. 2003. Volume under the ROC Surface for Multi-class Problems. In Proceedings of 14th European Conference on Machine Learning, 108-120.
10. Freund, Y.; Iyer, R.; Schapire, R. E.; and Singer, Y. 2003. An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research 4(6):933-969.
11. Hand, D. J. 2001. A simple generalisation of the area under the ROC curve for multiple class classification problems. Machine Learning 45:171-186. (Pubitemid 33635984)
12. Hastie, T.; Tibshirani, R.; and Friedman, J. 2001. The Elements of Statistical Learning, Springer series in statistics. New York: Springer.
13. He, H. B., and Garcia, E. A. 2009. Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering 21(9):1263-1284.
14. Herschtal, A., and Raskutti, B. 2004. Optimising area under the ROC curve using gradient descent. In Proceedings of 21st International Conference on Machine Learning. New York, New York, USA: ACM Press.
15. Huang, J., and Ling, C. X. 2005. Using AUC and accuracy in evaluating learning algorithms. IEEE Transactions on Knowledge and Data Engineering 17(3):299-310. (Pubitemid 40320164)
16. Kubat, M., and Holte, R. 1998. Machine learning for the detection of oil spills in satellite radar images. Machine Learning 30(2-3):195-215.
17. Lachiche, N., and Flach, P. 2003. Improving accuracy and cost of two-class and multi-class probabilistic classifiers using ROC curves. In Proceedings of the 20th International Conference on Machine Learning, 416-423.
18. Landgrebe, T. C. W., and Duin, R. P. W. 2008. Efficient multiclass ROC approximation by decomposition via confusion matrix perturbation analysis. IEEE transactions on pattern analysis and machine intelligence 30(5):810-22. (Pubitemid 351486750)
19. Lu, X. F.; Ke, T.; and Yao, X. 2010. Evolving Neural Networks with Maximum AUC for Imbalanced Data Classification. In The 5th International Conference on Hybrid Artificial Intelligence Systems (HAIS2010), 335-342.
20. Maloof, M. A. 2003. Learning when data sets are imbalanced and when costs are unequal and unknown. In Working Notes of the ICML'03 Workshop on Learning from Imbalanced Data Sets.
21. Neher, R., and Srivastava, a. 2005. A Bayesian MRF framework for labeling terrain using hyperspectral imaging. IEEE Transactions on Geoscience and Remote Sensing 43(6):1363-1374.
22. Provost, F., and Domingos, P. 2003. Tree induction for probability-based ranking. Machine Learning 5:199-215.
23. Provost, F., and Fawcett, T. 2001. Robust classification for imprecise environments. Machine Learning 42:203-231. (Pubitemid 32188799)
24. Sikonja, M. R. 2004. Improving Random Forests. In Proceedings of 15th European Conference on Machine Learning, 359-370.
25. Srinivasan, A. 1999. Note on the location of optimal classifiers in n-dimensional ROC space. Technical Report PRG-TR-2-99, Oxford University.
26. Witten, I., and Frank, E. 2000. Data mining practical machine learning tools and techniques with JAVA implementations. Morgan Kaufmann Publishers.
27. Yan, L.; Dodier, R.; Mozer, M. C.; and Wolniewicz, R. 2003. Optimizing Classifier Performance via an Approximation to the Wilcoxon-Mann-Whitney Statistic. In Proceedings of the 20th International Conference on Machine Learning, 848-855.
28. Zhou, Z. H., and Liu, X. Y. 2006. On Multi-Class Cost-Sensitive Learning. In Proceedings of the 21st National Conference on Artificial Intelligence, 567-572.