New primal SVM solver with linear computational cost for big data classifications

31st International Conference on Machine Learning, ICML 2014

Volumn 3, Issue , 2014, Pages 1883-1891

  Nie, Feiping ^a   Huang, Yizhen ^a   Wang, Xiaoqian ^a   Huang, Heng ^a  

^a University of Texas at Arlington   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIG DATA; CLASSIFICATION (OF INFORMATION); LAGRANGE MULTIPLIERS; PARALLEL ARCHITECTURES;

ALGORITHMIC COMPLEXITY; AUGMENTED LAGRANGE MULTIPLIERS; CLASSIFICATION TECHNIQUE; COMPUTATIONAL COSTS; DATA CLASSIFICATION; LARGE-SCALE DATASETS; STABLE PERFORMANCE; VECTOR MULTIPLICATION;

SUPPORT VECTOR MACHINES;

EID: 84919911040     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Bottou, Leon. Stochastic gradient descent examples, 2007. http://leon.bottou.org/projects/sgd.
2. Chang, Chih-Chung and Lin, Chih-Jen. Ijcnn 2001 challenge: Generalization ability and text decoding.In IJCNN, pp. 1031-1036, 2001.
3. Chang, Chih-Chung and Lin, Chih-Jen. LIBSVM: A library for support vector machines. ACM TIST, 2(3):27:1-27:27, 2011. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
4. Chang, Kai-Wei, Hsieh, Cho-Jui, and Lin, Chih-Jen. Coordinate descent method for large-scale L2-loss linear svm. JMLR, 9:1369-1398, 2008.
5. Collobert, R., Bengio, S., and Bengio, Y. A parallel mixture of svms for very large scale problems. Neural Computation, 14(5):1105-1114, 2002.
6. Duarte, M. and Hu, Y. H. Vehicle classification in distributed sensor networks. JPDC, 64(7):826-838, 2004.
7. Fan, Rong-En, Chang, Kai-Wei, Hsieh, Cho-Jui, Wang, Xiang-Rui, and Lin, Chih-Jen. Liblinear: A library for large linear classification. JMLR, 9:1871-1874, 2008.
8. Frank, A. and Asuncion, A. Uci machine learning repository, 2010. http://archive.ics.uci.edu/ml.
9. Gill, Philip E. and Robinson, Daniel P. A primal-dual augmented lagrangian. Computational Optimization and Applications, 51(1):1-25, 2012.
10. Hsieh, Cho-Jui, Chang, Kai-Wei, Keerthi, S. Sathiya, Sun- dararajan, S., and Lin, Chih-Jen. A dual coordinate descent method for large-scale linear svm. In ICML, pp. 408-415, 2008.
11. Hsu, Chih-Wei and Lin, Chih-Jen. A comparison of methods for multi-class support vector machines. IEEE TNN, 13(2):415-425, 2002.
12. Joachims, Thorsten. Training linear svms in linear time. In KDD, pp. 217-226, 2006.
13. Keerthi, S. Sathiya and DeCoste, Dennis. A modified finite newton method for fast solution of large scale linear svms. JMLR, 6:341-361, 2005.
14. Lin, Chih-Jen, Weng, Ruby C., and Keerthi, S. Sathiya. Trust region newton method for large-scale logistic regression. JMLR, 9:627-650, 2008.
15. Lin, Zhouchen, Chen, Minming, Wu, Leqin, and Ma, Yi. The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. 2009.
16. Mangasarian, O. L. and Musicant, David R. Lagrangian support vector machines. Journal of Machine Learning Research, 1:161-177, 2001.
17. Mangasarian, Olvi L. A finite newton method for classification. Optimization Methods and Software, 17(5):913-929, 2002.
18. Piatt, John C. Fast training of support vector machines using sequential minimal optimization. In Advances in Kernel Methods: Support Vector Learning, pp. 185-208, 1999.
19. Shalev-Shwartz, Shai, Singer, Yoram, and Srebro, Nathan. Pegasos: primal estimated subgradient solver for svm. In ICML, pp. C807-C814, 2007.
20. Smola, Alex J., Vishwanathan, S. V. N., and Le, Quoc. Bundle methods for machine learning. In NIPS, pp. 1377-1384, 2008.
21. Sonnenburg, Soeren, Franc, Vojtech, Yom-Tov, Elad, and Sebag, Michele. Pascal large scale learning challenge, 2008. http://largescale.ml.tu-berlin.de.
22. Teo, Choon Hui, Vishwanathan, S.V.N., Smola, Alex, and Le, Quoc V. Bundle methods for regularized risk minimization. JMLR, 11:311-365, 2010.
23. Wright, John, Ganesh, Arvind, Rao, Shankar, and Ma, Yi. Robust principal component analysis: exact recovery of corrupted low-rank matrices by convex optimization. In NIPS, pp. 2080-2088, 2009.
24. Zhang, Tong. Solving large scale linear prediction problems using stochastic gradient descent algorithms. In ICML, pp. 919-926, 2004.