A framework for kernel-based multi-category classification

Journal of Artificial Intelligence Research

Volumn 30, Issue , 2007, Pages 525-564

  Hill, Simon I ^a   Doucet, Arnaud ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BENCHMARKING; COMPUTER ARCHITECTURE; OPTIMIZATION;

MULTI CATEGORY CLASSIFICATION; SUPPORT VECTOR CLASSIFICATION;

SUPPORT VECTOR MACHINES;

EID: 38349108477     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.2251     Document Type: Article

References (51)

1. Allwein, E. L., Schapire, R. E., & Singer, Y. (2001). Reducing multiclass to binary: A unifying approach for margin classifiers. Journal of Machine Learning Research, 1 (113-141).
2. Bartlett, P. L. (1998). The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network. IEEE Transactions on Information Theory, 44(2), 525-536.
3. Bartlett, P. L., Jordan, M. I., & McAuliffe, J. D. (2004). Large margin classifiers: Convex loss, low noise and convergence rates. Advances in Neural Information Processing Systems, 16.
4. Blake, C. L., & Merz, C. J. (1998). UCI repository of machine learning databases.. http://www.ics.uci.edu/~mlearn/MLRepository.html.
5. Blanz, V., Schölkopf, B., Bülthoff, H., Burges, C. J. C., Vapnik, V. N., & Vetter, T. (1996). Comparison of view-based object recognition algorithms using realistic 3D models. In von der Malsburg, C., von Seelen, W., Vorbrüggen, J. C., & Sendhoff, B. (Eds.), Artificial Neural Networks, Vol. 1112 of Springer Lecture Notes in Computer Science, pp. 251-256, Berlin.
6. Bredensteiner, E. J., & Bennett, K. P. (1999). Multicategory classification by support vector machines. Computational Optimizations and Applications, 12, 53-79.
7. Crammer, K., & Singer, Y. (2001a). On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, 2, 265-292.
8. Crammer, K., & Singer, Y. (2001b). Pranking with ranking. In Advances in Neural Information Processing, Vol. 14.
9. Cristianini, N., & Shawe-Taylor, J. (2000). An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods (1st edition). Cambridge University Press.
10. Dietterich, T., & Bakiri, G. (1995). Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research, 2, 263-286.
11. Elisseeff, A., Guermeur, Y., & Paugam-Moisy, H. (1999). Margin error and generalization capabilities of multi-class discriminant systems. Tech. rep. NC2-TR-1999-051-R, NeuroCOLT2.
12. Fung, G., & Mangasarian, O. L. (2001a). Multicategory proximal support vector machine classifiers. Tech. rep. 01-06, Data Mining Institute.
13. Fung, G., & Mangasarian, O. L. (2001b). Proximal support vector machine classifiers. In Proceedings KDD-2001, pp. 77-86, San Francisco.
14. Fürnkranz, J. (2002). Round robin classification. Journal of Machine Learning, 2, 721-747.
15. Guermeur, Y. (2000). Combining discriminant models with new multi-class SVMs. Tech. rep., NeuroCOLT2.
16. Guermeur, Y. (2002). Combining discriminant models with new multi-class SVMs. Pattern Analysis and Applications, 5, 168-179.
17. Hastie, T., & Tibshirani, R. (1998). Classification by pairwise coupling. In Michael, M. J. K., Jordan, I. & Solla, S. A. (Eds.), Advances in Neural Information Processing, Vol. 10, pp. 507-513. MIT Press.
18. Hastie, T., Tibshirani, R., & Friedman, J. (2001). The Elements of Statistical Learning. Springer.
19. Herbrich, R., Graepel, T., & Campbell, C. (2000a). Bayes point machines. Journal of Machine Learning Research, 1, 245-279.
20. Herbrich, R., Graepel, T., & Obermayer, K. (2000b). Large margin rank boundaries for ordinal regression. Advances in Large Margin Classifiers, 1, 115-132.
21. Hill, S. I. (2007). Notes on the generalisation performance and Fisher consistency of multicategory classifiers. Tech. rep. CUED/F-INFENG/TR.583, Engineering Dept, University of Cambridge.
22. Hill, S. I., & Doucet, A. (2005). A framework for kernel-based multi-category classification. Tech. rep. CUED/F-INFENG/TR.508, Engineering Dept., University of Cambridge.
23. Hsu, C.-W., & Lin, C.-J. (2002). A comparison of methods for multi-class support vector machines. IEEE Transactions on Neural Networks, 13, 415-425.
24. Keerthi, S. S., Shevade, S. K., Bhattacharyya, C., & Murthy, K. R. K. (2001). Improvements to Platt's SMO algorithm for SVM classifier design. Neural Computation, 13, 637-649.
25. Kindermann, J., Leopold, E., & Paaß, G. (2000). Multi-class classification with error correcting codes. In Leopold, E., & Kirsten, M. (Eds.), Treffen der GI-Fachgruppe 1.1.3 Maschinelles Lernen. GMD Report 114.
26. Kreßel, U. H.-G. (1999). Pairwise classification and support vector machines. In Schölkopf, B., Burges, C. J. C., & Smola, A. J. (Eds.), Advances in Kernel Methods: Support Vector Learning. MIT Press.
27. Lee, Y., Lin, Y., & Wahba, G. (2001). Multicategory support vector machines. Tech. rep. 1043, Department of Statistics, University of Wisconsin.
28. Lee, Y., Lin, Y., & Wahba, G. (2004). Multicategory support vector machines, theory, and application to the classification of microarray data and satellite radiance data. Journal of the American Statistical Association, 99, 659-672.
29. Mangasarian, O. L., & Musicant, D. R. (2001). Lagrangian support vector machines. Journal of Machine Learning Research, 1, 161-177.
30. Mayoraz, E., & Alpaydin, E. (1999). Support vector machines for multi-class classification. In Proceedings of the International Workshop on Artifical Neural Networks (IWANN99).
31. Paugam-Moisy, H., Elisseeff, A., & Guermeur, Y. (2000). Generalization performance of multiclass discriminant models..
32. Platt, J. C. (1999). Fast training of support vector machines using sequential minimal optimization. In Schölkopf, B., Burges, C. J. C., & Smola, A. J. (Eds.), Advances in Kernel Methods - Support Vector Learning, pp. 185-208. MIT Press, Cambridge, MA.
33. Platt, J. C., Cristianini, N., & Shawe-Taylor, J. (2000). Large margin DAGs for multiclass classification. In Solla, S. A., Lean, T. K., & Müller, K.-R. (Eds.), Advances in Neural Information Processing, Vol. 12, pp. 547-553. MIT Press.
34. Rennie, J. D. M., & Rifkin, R. (2001). Improving multiclass text classification with the support vector machine. Memo AIM-2001-026, Massachusetts Institute of Technology Artificial Intelligence Laboratory.
35. Rifkin, R., & Klautau, A. (2004). In defense of one-vs-all classification. Journal of Machine Learning Research, 5, 101-141.
36. Schölkopf, B., Burges, C. J. C., & Vapnik, V. N. (1995). Extracting support data for a given task. In Fayyad, U. M., & Uthurusamy, R. (Eds.), Proceedings, First International Conference on Knowledge Discovery and Data Mining, pp. 252-257, Menlo Park, CA. AAAI Press.
37. Schölkopf, B., & Smola, A. J. (2002). Learning with Kernels. MIT Press.
38. Sebald, D. J. (2000). Nonlinear Signal Processing for Digital Communications using Support Vector Machines and a New Form of Adaptive Decision Feedback Equalizer. Ph.D. thesis, University of Wisconsin-Madison.
39. Sebald, D. J., & Bucklew, J. A. (2001). Support vector machines and the multiple hypothesis test problem. IEEE Transactions on Signal Processing, 49(11), 2865-2872.
40. Sejnowski, T. J., & Rosenberg, C. R. (1987). Parallel networks that learn to pronounce English text.. Journal of Complex Systems, 1, 145-168.
41. Suykens, J. A. K., & Vandewalle, J. (1999). Multiclass least squares support vector machines. In Proceedings of the International Joint Conference on Neural Networks (IJCNN'99), Washington DC, USA.
42. Tewari, A., & Bartlett, P. L. (2007). On the consistency of multiclass classification methods. Journal of Machine Learning Research, 8, 1007-1025.
43. Van Gestel, T., Suykens, J. A. K., Baesens, B., Viaene, S., Vanthienen, J., Dedene, G., De Moor, B., & Vandewalle, J. (2001). Benchmarking least squares support vector machine classifiers. Machine Learning, 54(1), 5-32.
44. Van Gestel, T., Suykens, J. A. K., Lanckriet, G., Lambrechts, A., De Moor, B., & Vandewalle, J. (2002). Multiclass LS-SVMs: Moderated outputs and coding-decoding schemes. Neural Processing Letters, 15, 45-58.
45. Vapnik, V. N. (1998). Statistical Learning Theory. Wiley.
46. Wang, F., Vuurpijl, L. G., & Schomaker, L. R. B. (2000). Support vector machines for the classification of western handwritten capitals. In Schomaker, L. R. B., & Vuurpijl, L. G. (Eds.), Proceedings of the 7th International Workshop on Frontiers in Handwriting Recognition, pp. 167-176.
47. Weston, J. A. E. (1999). Extensions to the Support Vector Method. Ph.D. thesis, University of London.
48. Weston, J. A. E., & Watkins, C. (1999). Support vector machines for multi-class pattern recognition. In Proceedings of the 7th European Symposium On Artificial Neural Networks.
49. Williamson, R. C., Smola, A. J., & Schölkopf, B. (2001). Generalization performance of regularization networks and support vector machines via entropy numbers of compact operators. IEEE Transactions on Information Theory, 47(6), 2516-2532.
50. Zhang, T. (2004a). An infinity-sample theory for multi-category large margin classification. Advances in Neural Information Processing, 16.
51. Zhang, T. (2004b). Statistical analysis of some multi-category large margin classification. Journal of Machine Learning Research, 5, 1225-1251.