A sequential dual method for large scale multi-class linear svms

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2008, Pages 408-416

  Keerthi, S Sathiya ^a   Sundararajan, S ^a   Chang, Kai Wei ^b   Hsieh, Cho Jui ^b   Lin, Chih Jen ^b  

^a YAHOO RESEARCH   (United States)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Algorithams; Experimentation; Performance

Indexed keywords

ALGORITHAMS; CUTTING PLANES; DUAL METHODS; EXPERIMENTATION; LINEAR SUPPORT VECTOR MACHINES; MULTI CLASS; PERFORMANCE; STATE-OF-THE ARTS; TEXT CLASSIFICATIONS; TRAINING SETS;

GRADIENT METHODS; MINING; SUPPORT VECTOR MACHINES; TEXT PROCESSING;

INFORMATION MANAGEMENT;

EID: 65449123919     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1401890.1401942     Document Type: Conference Paper

References (25)

1. A. Bordes, L. Bottou, P. Gallinari, and J. Weston. Solving multiclass support vector machines with LaRank. In ICML, 2007.
2. B. E. Boser, I. Guyon, and V. Vapnik. A training algorithm for optimal margin classifiers. In COLT, 1992.
3. L. Bottou. Stochastic gradient descent examples, 2007. http://leon.bottou.org/projects/sgd.
4. M. Collins, A. Globerson, T. Koo, X. Carreras, and P. Bartlett. Exponentiated gradient algorithms for conditional random fields and max-margin Markov networks. JMLR, 2008. To appear.
5. K. Crammer and Y. Singer. On the learnability and design of output codes for multiclass problems. In COLT, 2000.
6. K. Crammer and Y. Singer. On the algorithmic implementation of multiclass kernel-based vector machines. JMLR, 2:265-292, 2001.
7. K. Crammer and Y. Singer. Ultraconservative online algorithms for multiclass problems. JMLR, 3:951-991, 2003.
8. R. Fletcher. Practical Methods of Optimization. John Wiley and Sons, 1987.
9. C.-J. Hsieh, K.-W. Chang, C.-J. Lin, S. S. Keerthi, and S. Sundararajan. A dual coordinate descent method for large-scale linear SVM. In ICML, 2008.
10. C.-W. Hsu and C.-J. Lin. A comparison of methods for multi-class support vector machines. IEEE TNN, 13(2):415-425, 2002.
11. T. Joachims. Making large-scale SVM learning practical. In B. Schölkopf, C. J. C. Burges, and A. J. Smola, editors, Advances in Kernel Methods - Support Vector Learning, Cambridge, MA, 1998. MIT Press.
12. T. Joachims. Training linear SVMs in linear time. In ACM KDD, 2006.
13. T. Joachims, T. Finley, and C.-N. J. Yu. Cutting plane training of structural SVMs. MLJ, 2008.
14. K. Lang. Newsweeder: Learning to filter netnews. In ICML, pages 331-339, 1995.
15. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, November 1998. MNIST database available at http://yann.lecun.com/exdb/anist/.
16. D. D. Lewis, Y. Yang, T. G. Rose, and F. Li. RCV1: A new benchmark collection for text categorization research. JMLR, 5:361-397, 2004.
17. C.-J. Lin. A formal analysis of stopping criteria of decomposition methods for support vector machines. IEEE TNN, 13(5):1045-1052, 2002.
18. Z.-Q. Luo and P. Tseng. On the convergence of coordinate descent method for convex differentiable minimization. JOTA, 72(1):7-35, 1992.
19. A. McCallum and K. Nigam. A comparison of event models for naive bayes text classification. In Proceedings of the AAAI'98 Workshop on Learning for Text categorization, 1998.
20. J. D. M. Rennie and R. Rifkin. Improving multiclass text classification with the Support Vector Machine. Technical Report AIM-2001-026, MIT, 2001.
21. R. Rifkin and A. Klautau. In defense of one-vs-all classification. JMLR, 5:101-141, 2004.
22. S. Shalev-Shwartz, Y. Singer, and N. Srebro. Pegasos: primal estimated sub-gradient solver for SVM. In ICML, 2007.
23. C. H. Teo, A. Smola, S. V. Vishwanathan, and Q. V. Le. A scalable modular convex solver for regularized risk minimization. In ACM KDD, 2007.
24. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun. Large margin methods for structured and interdependent output variables. JMLR, 2005.
25. J. Weston and C. Watkins. Multi-class support vector machines. In M. Verleysen, editor, Proceedings of ESANN99, Brussels, 1999. D. Facto Press.