On reoptimizing multi-class classifiers

Machine Learning

Volumn 71, Issue 2-3, 2008, Pages 219-242

  Bourke, Chris ^a   Deng, Kun ^a   Scott, Stephen D ^a   Schapire, Robert E ^b   Vinodchandran, N V ^a  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^b Princeton University   (United States)

Author keywords

Classifier reoptimization; Multi class classification; Receiver operator characteristic (ROC)

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); COST FUNCTIONS; ERROR ANALYSIS; OPTIMAL SYSTEMS;

CLASSIFIER REOPTIMIZATION; MULTI-CLASS CLASSIFICATION; RECEIVER OPERATOR CHARACTERISTIC (ROC);

LEARNING SYSTEMS;

EID: 43049101059     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-008-5056-8     Document Type: Article

References (25)

1. Abramson, M. A. (2005). Genetic algorithm and direct search toolbox. http://www.mathworks.com/.
2. Blake, C., & Merz, C. (2005). UCI repository of machine learning databases. http://www.ics.uci.edu/~mlearn/MLRepository.html.
3. Boyd, S., & Vandenberghe, L. (2004). Convex optimization. Cambridge: Cambridge University Press.
4. Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7, 1-30.
5. Deng, K., Bourke, C., Scott, S. D., & Vinodchandran, N. V. (2006). New algorithms for optimizing multi-class classifiers via ROC surfaces. In Proceedings of the ICML workshop on ROC analysis in machine learning (pp. 17-24).
6. Ferri, C., Hernández-Orallo, J., & Salido, M. (2003). Volume under the ROC surface for multi-class problems. In European conference on artificial intelligence (pp. 108-120).
7. Fieldsend, J., & Everson, R. (2005). Formulation and comparison of multi-class ROC surfaces. In Proceedings of the ICML workshop on ROC analysis in machine learning (pp. 41-48).
8. Grant, M., Boyd, S., & Ye, Y. (2006). Disciplined convex programming. In L. Liberti & N. Maculan (Eds.), Nonconvex Optimization and its Applications. Global optimization: From theory to implementation (pp. 155-210). Berlin: Springer. Available at http://www.stanford.edu/~boyd/cvx/.
9. Hand, D., & Till, R. (2001). A simple generalisation of the area under the ROC curve for multiple class classification problems. Machine Learning, 45, 171-186.
10. Hochberg, Y., & Tamhane, A. C. (1987). Multiple comparison procedures. New York: Wiley.
11. Kohli, R., Krishnamurti, R., & Mirchandani, P. (1994). The minimum satisfiability problem. SIAM Journal of Discrete Mathematics, 7, 275-283.
12. Lachiche, N., & Flach, P. (1999). 1BC: A first-order Bayesian classifier. In Proceedings of the 9th international workshop on inductive logic programming (pp. 92-103).
13. Lachiche, N., & Flach, P. (2003). Improving accuracy and cost of two-class and multi-class probabilistic classifiers using ROC curves. In Proceedings of the 20th international conference on machine learning (pp. 416-423).
14. Matsui, T. (1996). NP-hardness of linear multiplicative programming and related problems. Journal of Global Optimization, 9, 113-119.
15. MOSEK ApS (2005). The MOSEK optimization tools version 3.2. http://www.mosek.com/.
16. Mossman, D. (1999). Three-way ROCs. Medical Decision Making, 19(1), 78-89.
17. O'Brien, D. B., & Gray, R. M. (2005). Improving classification performance by exploring the role of cost matrices in partitioning the estimated class probability space. In Proceedings of the ICML Workshop on ROC Analysis in Machine Learning (pp. 79-86).
18. Provost, F. J., & Fawcett, T. (1997). Analysis and visualization of classifier performance: Comparison under imprecise class and cost distributions. In Proceedings of the third international conference on knowledge discovery and data mining (KDD-97) (pp. 43-48).
19. Provost, F. J., & Fawcett, T. (1998). Robust classification systems for imprecise environments. In Proceedings of the 15th national conference on artificial intelligence (AAAI) (pp. 706-713).
20. Provost, F. J., & Fawcett, T. (2001). Robust classification for imprecise environments. Machine Learning, 42, 203-231.
21. Rockafellar, R. (1970). Convex analysis (2nd edn.). Princeton: Princeton University Press.
22. Schölkopf, B., & Smola, A. J. (2001). Learning with kernels. Cambridge: MIT Press.
23. Srinivasan, A. (1999). Note on the location of optimal classifiers in n-dimensional ROC space (Technical Report PRG-TR-2-99). Oxford University Computing Laboratory, Oxford.
24. Stoer, I. J., & Witzgall, C. (1996). Convexity and optimization in finite dimensions. Berlin: Springer.
25. Witten, I. H., et al. (2005). Weka machine learning toolbox. http://www.cs.waikato.ac.nz/ml/weka/.