Trading representability for scalability: Adaptive multi-hyperplane machine for nonlinear classification

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2011, Pages 24-32

  Wang, Zhuang ^a   Djuric, Nemanja ^b   Crammer, Koby ^c   Vucetic, Slobodan ^b  

^a SIEMENS CORPORATE RESEARCH   (United States)

^b Temple University   (United States)

^c TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Large scale learning; Nonlinear classification; Stochastic gradient descent; Support vector machines

Indexed keywords

DATA MINING; ERRORS; FORECASTING; GEOMETRY; ITERATIVE METHODS; SCALABILITY; STOCHASTIC SYSTEMS;

CLASSIFICATION ALGORITHM; ERROR RATE; KERNELIZATION; LARGE-SCALE LEARNING; LINEAR SUPPORT VECTOR MACHINES; NONLINEAR CLASSIFICATION; REPRESENTABILITY; STATE OF THE ART; STOCHASTIC GRADIENT DESCENT; SUPPORT VECTORS MACHINE;

SUPPORT VECTOR MACHINES;

EID: 80052651135     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2020408.2020420     Document Type: Conference Paper

References (28)

1. F. Aiolli and A. Sperduti. Multi-class classification with multi-prototype support vector machines. Journal of Machine Learning Research, 2005.
2. A. Bordes, L. Bottou, and P. Gallinari. Sgd-qn: careful quasi-newton stochastic gradient descent. Journal of Machine Learning Research, 2009.
3. A. Bordes, S. Ertekin, J. Weston, and L. Bottou. Fast kernel classifiers for online and active learning. Journal of Machine Learning Research, 2005.
4. C.-C. Chang and C.-J. Lin. Libsvm: a library for support vector machines, http://www.csie.ntu.edu.tw/cjlin/libsvm. 2001.
5. Y.-W. Chang, K.-W. C. C.-J. Hsie and, M. Ringgaard, and C.-J. Lin. Training and testing low-degree polynomial data mappings via linear svm. Journal of Machine Learning Research, 2010.
6. R. Collobert, F. Sinz, J. Weston, and L. Bottou. Trading convexity for scalability. In International Conference on Machine Learning, 2006.
7. Cortes and Vapnik. Support-vector networks. Machine Learning, 1995.
8. K. Crammer and Y. Singer. On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, 2001.
9. C.-J. Hsieh, K.-W. Chang, C.-J. Lin, S. S. Keerthi, and S. Sundararajan. A dual coordinate descent method for large-scale linear svm. In International Conference on Machine Learning, 2008.
10. T. Joachims. Training linear svms in linear time. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2006.
11. J. Kivinen, A. J. Smola, and R. C. Williamson. Online learning with kernels. IEEE Transactions on Signal Processing, 2002.
12. G. Loosli, S. Canu, and L. Bottou. Training invariant support vector machines using selective sampling. Large Scale Kernel Machines, Cam-bridge, MA, MIT Press, 2007.
13. J. Ma, L. K. Saul, S. Savage, and G. M. Voelker. Identifying suspicious urls: An application of large-scale online learning. In International Conference on Machine Learning, 2009.
14. J. Platt. Fast training of support vector machines using sequential minimal optimization. Advances in kernel methods - support vector learning, MIT Press, 1998.
15. J. Platt, N. Cristianini, and J. S. Taylor. Large margin dags for multiclass classification. In Advance in Nueral Information Processing Systems, 2000.
16. A. Rahimi and B. Recht. Random features for large-scale kernel machines. In Advance in Nueral Information Processing Systems, 2007.
17. S. Shalev-Shwartz and Y. Singer. Logarithmic regret algorithms for strongly convex repeated games (technical report). The Hebrew University, 2007.
18. S. Shalev-Shwartz, Y. Singer, and N. Srebro. Pegasos: primal estimated sub-gradient solver for svm. In International Conference on Machine Learning, 2007.
19. S. Sonnenburg and V. Franc. Coffin : a computational framework for linear svms. In International Conference on Machine Learning, 2010.
20. I. Steinwart. Sparseness of support vector machines. Journal of Machine Learning Research, 2003.
21. C. Teo, S. V. N. Vishwanathan, A. J. Smola, and Q. V. Le. Bundle methods for regularized risk minimization. Journal of Machine Learning Research, 2010.
22. I. W. Tsang, J. T. Kwok, and P.-M. Cheung. Core vector machines: fast svm training on very large data sets. Journal of Machine Learning Research, 2005.
23. S. V. N. Vishwanathan, A. J. Smola, and M. N.Murty. Simplesvm. In International Conference on Machine Learning, 2003.
24. Z. Wang, K. Crammer, and S.Vucetic. Multi-class pegasos on a budget. In International Conference on Machine Learning, 2010.
25. Z. Wang and S.Vucetic. Online training on a budget of support vector machines using twin prototypes. Statisitcal Analysis and Data Mining Journal, 2010.
26. H.-F. Yu, C.-J. Hsieh, K.-W. Chang, and C.-J. Lin. Large linear classification when data cannot fit in memory. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2010.
27. T. Zhang. Solving large scale linear prediction problems using stochastic gradient descent. In International Conference on Machine Learning, 2004.
28. Z. A. Zhu, W. Chen, G. Wang, C. Zhu, and Z. Chen. P-packsvm: parallel primal gradient descent kernel svm. In IEEE International Conference on Data Mining, 2009.