NESVM: A fast gradient method for support vector machines

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2010, Pages 679-688

  Zhou, Tianyi ^a   Tao, Dacheng ^a   Wu, Xindong ^b,c  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^c University of Vermont   (United States)

Author keywords

1 norm; Continuation method; Hinge loss; Nesterov's method; Smooth; Support vector machines

Indexed keywords

CONTINUATION METHOD; CONVERGENCE RATES; EVENT RECOGNITION; HOMOTOPIES; INDOOR/OUTDOOR; LEAST SQUARE; LINE SEARCHES; LINEAR TIME COMPLEXITY; LIPSCHITZ CONSTANT; MATLAB CODE; MATRIX VECTOR MULTIPLICATION; NESTEROV'S METHOD; NON-DIFFERENTIABLE; NONLINEAR KERNELS; NUMBER OF ITERATIONS; OPTIMAL CONVERGENCE; SCENE CLASSIFICATION; SCENE RECOGNITION; SMOOTH; STEP SIZE; SVM MODEL; SVM SOLVERS;

ARTIFICIAL INTELLIGENCE; DATA MINING; GRADIENT METHODS; LINEAR PROGRAMMING; MATLAB; OPTIMIZATION; VECTORS;

SUPPORT VECTOR MACHINES;

EID: 79951751439     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2010.135     Document Type: Conference Paper

References (25)

1. T. Joachims, "Training linear svms in linear time," in The 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2006, pp. 217-226. (Pubitemid 44535518)
2. T. Joachims, T. Finley, and C.-N. Yu, "Cutting-plane training of structural svms," Machine Learning, vol. 77, no. 1, pp. 27-59, 2009.
3. S. Shalev-Shwartz, Y. Singer, and N. Srebro, "Pegasos: Primal estimated sub-gradient solver for svm," in The 24th Annual International Conference on Machine Learning (ICML), 2007, pp. 807-814.
4. S. Martin, "Training support vector machines using gilbert's algorithm," in The 5th IEEE International Conference on Data Mining (ICDM), 2005, pp. 306-313. (Pubitemid 47385707)
5. J. Kujala, T. Aho, and T. Elomaa, "A walk from 2-norm svm to 1-norm svm," in The 9th IEEE International Conference on Data Mining (ICDM), 2009, pp. 836-841.
6. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in kernel methods: support vector learning, 1999, pp. 185-208.
7. C.-C. Chang and C.-J. Lin, LIBSVM: a library for support vector machines, 2001, software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
8. K. Morik, P. Brockhausen, and T. Joachims, "Combining statistical learning with a knowledge-based approach - a case study in intensive care monitoring," in The 16th International Conference on Machine Learning (ICML), 1999, pp. 268-277.
9. C.-N. J. Yu and T. Joachims, "Training structural svms with kernels using sampled cuts," in The 14th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2008, pp. 794-802.
10. O. Chapelle, "Training a support vector machine in the primal," Neural Computation, vol. 19, no. 5, pp. 1155-1178, 2007.
11. Y.-J. Lee and O. L. Mangasarian, "SSVM: A smooth support vector machine," Computational Optimization and Applications, vol. 20, pp. 5-22, 2001.
12. V. N. Vapnik, The nature of statistical learning theory. Springer-Verlag New York, Inc., 1995.
13. K. P. Bennett and O. L. Mangasarian, "Robust linear programming discrimination of two linearly inseparable sets," Optimization Methods and Software, vol. 1, no. 1, pp. 23-34, 1992. (Pubitemid 23615796)
14. J. A. K. Suykens and J. Vandewalle, "Least squares support vector machine classifiers," Neural Processing Letters, vol. 9, no. 3, pp. 293-300, 1999.
15. J. Wang and J. Ye, "An accelerated gradient method for trace norm minimization," in The 26th International Conference on Machine Learning (ICML), 2009.
16. J. Liu, J. Chen, and J. Ye, "Large-scale sparse logistic regression," in The 15th ACM SIGKDD International Conference On Knowledge Discovery and Data Mining (KDD), 2009, pp. 547-556.
17. A. Asuncion and D. Newman, "UCI machine learning repository," 2007. [Online]. Available: http://www.ics.uci.edu/~mlearn/MLRepository.html
18. A. Quattoni and A. Torralba, "Recognizing indoor scenes," in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
19. L. Fei-Fei and P. Perona, "A bayesian hierarchical model for learning natural scene categories," in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2005, pp. 524-531.
20. L.-J. Li and L. Fei-Fei, "What, where and who? classifying event by scene and object recognition," in The 10th IEEE International Conference on Computer Vision (ICCV), 2007.
21. Y. Nesterov, "Smooth minimization of non-smooth functions," Mathematical Programming, vol. 103, no. 1, pp. 127-152, 2005. (Pubitemid 40537674)
22. R. Tibshirani, "Regression shrinkage and selection via the lasso," Journal of the Royal Statistical Society, Series B, vol. 58, pp. 267-288, 1994.
23. B. Efron, T. Hastie, L. Johnstone, and R. Tibshirani, "Least angle regression," Annals of Statistics, vol. 32, pp. 407-499, 2002. (Pubitemid 41250302)
24. J. Ye and T. Xiong, "Svm versus least squares svm," in The 11th International Conference on Artificial Intelligence and Statistics (AISTATS), 2007, pp. 640-647.
25. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng, "Nus-wide: A real-world web image database from national university of singapore," in ACM International Conference on Image and Video Retrieval (CIVR), 2009.