Statistical analysis of some multi-category large margin classification methods

Journal of Machine Learning Research

Volumn 5, Issue , 2004, Pages 1225-1251

  Zhang, Tong ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

CLASSIFICATION ERRORS; CLASSIFICATION METHODS; CONDITIONAL PROBABILITIES; LARGE MARGINS; MULTI-CATEGORY CLASSIFICATION; NATURAL EXTENSION; RISK MINIMIZATION; STATISTICAL PROPERTIES;

CLASSIFICATION (OF INFORMATION);

EID: 26944483874     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (28)

1. P. L. Bartlett, M. I. Jordan, and J. D. McAuliffe. Convexity, classification, and risk bounds. Technical Report 638, Statistics Department, University of California, Berkeley, 2003.
2. Gilles Blanchard, Olivier Bousquet, and Pascal Massart. Statistical performance of support vector machines. http://www.kyb.mpg.de/publications/pss/ps2731.ps, 2004.
3. Gilles Blanchard, Gabor Lugosi, and Nicolas Vayatis. On the rate of convergence of regularized boosting classifiers. Journal of Machine Learning Research, 4:861-894, 2003.
4. V. Blanz, V. Vapnik, and C. Burges. Multiclass discrimination with an extended support vector machine. Talk given at AT&T Bell Labs, 1995.
5. Koby Crammer and Yoram Singer. On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, 2:265-292, 2001.
6. Ilya Desyatnikov and Ron Meir. Data-dependent bounds for multi-category classification based on convex losses. In COLT, 2003.
7. J. Friedman, T. Hastie, and R. Tibshirani. Additive logistic regression: A statistical view of boosting. The Annals of Statistics, 28(2):337-407, 2000. With discussion.
8. W. Jiang. Process consistency for adaboost. The Annals of Statistics, 32:13-29, 2004. with discussion.
9. Y. Lee, Y. Lin, and G. Wahba. Multicategory support vector machines, theory, and application to the classification of microarray data and satellite radiance data. Journal of American Statistical Association, 99:67-81, 2004.
10. Yi Lin. Support vector machines and the bayes rule in classification. Data Mining and Knowledge Discovery, pages 259-275, 2002.
11. Yufeng Liu and Xiaotong Shen. On multicategory ψ-learning and support vector machine. Private Communication, 2004.
12. G. Lugosi and N. Vayatis. On the Bayes-risk consistency of regularized boosting methods. The Annals of Statistics, 32:30-55, 2004. with discussion.
13. E. Mammen and A. Tsybakov Smooth discrimination analysis. Annals of Statis., 27:1808-1829, 1999.
14. Shie Mannor, Ron Meir, and Tong Zhang. Greedy algorithms for classification - consistency, convergence rates, and adaptivity. Journal of Machine Learning Research, 4:713-741, 2003.
15. Ryan Rifkin and Aldebaro Klautau. In defense of one-vs-all classification. Journal of Machine Learning Research, 5:101-141, 2004.
16. Robert E. Schapire and Yoram Singer. Improved boosting algorithms using confidence-rated predictions. Machine Learning, 37:297-336, 1999.
17. B. Scholkopf and A. Smola. Learning with Kernels. MIT Press, Cambridge, 2002.
18. Clint Scovel and Ingo Steinwart. Fast rates for support vector machines. Technical Report LA-UR 03-9117, Los Alamos National Laboratory, 2003.
19. Ingo Steinwart. Support vector machines are universally consistent. J. Complexity, 18:768-791, 2002.
20. Ingo Steinwart. Sparseness of support vector machines. Journal of Machine Learning Research, 4:1071-1105, 2003.
21. Ingo Steinwart. Consistency of support vector machines and other regularized kernel machines. IEEE Transactions on Information Theory, 2004. to appear.
22. S. A. Van De Geer. Empirical Processes in M-estimation. Cambridge University Press, 2000.
23. Aad W. Van Der Vaart and Jon A. Wellner. Weak convergence and empirical processes. Springer Series in Statistics. Springer-Verlag, New York, 1996. ISBN 0-387-94640-3.
24. V. N. Vapnik. Statistical learning theory. John Wiley & Sons, New York, 1998.
25. Grace Wahba. Spline Models for Observational Data. CBMS-NSF Regional Conference series in applied mathematics. SIAM, 1990.
26. J. Weston and C. Watkins. Multi-class support vector machines. Technical Report CSD-TR-98-04, Royal Holloway, 1998.
27. Tong Zhang. Covering number bounds of certain regularized linear function classes. Journal of Machine Learning Research, 2:527-550, 2002.
28. Tong Zhang. Statistical behavior and consistency of classification methods based on convex risk minimization. The Annals of Statitics, 32:56-85, 2004. with discussion.