Nonconvex online support vector machines

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 33, Issue 2, 2011, Pages 368-381

  Ertekin, Şeyda ^a   Bottou, Léon ^b   Giles, C Lee ^c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b NEC LABORATORIES AMERICA   (United States)

^c PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

active learning.; nonconvex optimization; Online learning; support vector machines

Indexed keywords

ACTIVE LEARNING; DUALITY GAP; EXPERIMENTAL EVALUATION; FILTERING MECHANISM; GENERALIZATION PERFORMANCE; INTERMEDIATE MODEL; NOISY DATA CLASSIFICATION; NONCONVEX; NONCONVEX OPTIMIZATION; ONLINE LEARNING; ONLINE SUPPORT VECTOR MACHINES; RUNNING TIME; SPARSER MODELS; SUPPORT VECTOR; SVM ALGORITHM;

ALGORITHMS; CONVEX OPTIMIZATION; E-LEARNING; GEARS; OPTIMIZATION; VECTORS;

SUPPORT VECTOR MACHINES;

EID: 78650514073     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2010.109     Document Type: Article

References (23)

1. O. Bousquet and A. Elisseeff, "Stability and Generalization,"J. Machine Learning, vol. 2, pp. 499-526, 2002.
2. B. Schölkopf and A.J. Smola, Learning with Kernels: Support VectorMachines, Regularization, Optimization, and Beyond. MIT Press, 2002.
3. J. Shawe-Taylor and N. Cristianini, Kernel Methods for PatternAnalysis. Cambridge Univ. Press, 2004.
4. C. Cortes and V. Vapnik, "Support Vector Networks, " MachineLearning, vol. 20, pp. 273-297, 1995.
5. L. Mason, P.L. Bartlett, and J. Baxter, "Improved Generalizationthrough Explicit Optimization of Margins, " Machine Learning, vol. 38, pp. 243-255, 2000.
6. N. Krause and Y. Singer, "Leveraging the Margin More Carefully, " Proc. Int'l Conf. Machine Learning, p. 63, 2004.
7. F. Perez-Cruz, A. Navia-Vazquez, and A.R. Figueiras-Vidal, "Empirical Risk Minimization for Support Vector Classifiers, "IEEE Trans. Neural Networks, vol. 14, no. 2, pp. 296-303, Mar.2002.
8. D.S.L. Xu and K. Cramer, "Robust Support Vector MachineTraining via Convex Outlier Ablation, " Proc. 21st Nat'l Conf.Artificial Intelligence, 2006.
9. Y. Liu, X. Shen, and H. Doss, "Multicategory Learning andSupport Vector Machine: Computational Tools, " J. Computationaland Graphical Statistics, vol. 14, pp. 219-236, 2005.
10. L. Wang, H. Jia, and J. Li, "Training Robust Support VectorMachine with Smooth Ramp Loss in the Primal Space, "Neurocomputing, vol. 71, pp. 3020-3025, 2008.
11. A.L. Yuille and A. Rangarajan, "The Concave-Convex Procedure(CCCP), " Advances in Neural Information Processing Systems. MITPress, 2002.
12. R. Collobert, F. Sinz, J. Weston, and L. Bottou, "Trading Convexityfor Scalability, " Proc. Int'l Conf. Machine Learning, pp. 201-208, 2006.
13. A. Bordes, S. Ertekin, J. Weston, and L. Bottou, "Fast KernelClassifiers with Online and Active Learning, " J. Machine LearningResearch, vol. 6, pp. 1579-1619, 2005.
14. S. Ertekin, J. Huang, L. Bottou, and L. Giles, "Learning on theBorder: Active Learning in Imbalanced Data Classification, " Proc.ACM Conf. Information and Knowledge Management, pp. 127-136, 2007.
15. J.C. Platt, "Fast Training of Support Vector Machines UsingSequential Minimal Optimization, " Advances in Kernel Methods:Support Vector Learning, pp. 185-208, MIT Press, 1999.
16. S. Shalev-Shwartz and N. Srebro, "SVM Optimization: InverseDependence on Training Set Size, " Proc. Int'l Conf. MachineLearning, pp. 928-935, 2008.
17. S.S. Keerthi, S.K. Shevade, C. Bhattacharyya, and K.R.K. Murthy, "Improvements to Platt's SMO Algorithm for SVM ClassifierDesign, " Neural Computation, vol. 13, no. 3, pp. 637-649, 2001.
18. O. Chapelle, "Training a Support Vector Machine in the Primal, "Neural Computation, vol. 19, no. 5, pp. 1155-1178, 2007.
19. I. Steinwart, "Sparseness of Support Vector Machines, " J. MachineLearning Research, vol. 4, pp. 1071-1105, 2003.
20. G. Schohn and D. Cohn, "Less Is More: Active Learning withSupport Vector Machines, " Proc. Int'l Conf. Machine Learning, pp. 839-846, 2000.
21. T. Joachims, "Text Categorization with Support Vector Machines:Learning with Many Relevant Features, " Technical Report 23, Univ. Dortmund, 1997.
22. S. Tong and D. Koller, "Support Vector Machine Active Learningwith Applications to Text Classification, " J. Machine LearningResearch, vol. 2, pp. 45-66, 2001.
23. T. Glasmachers and C. Igel, "Second-Order SMO Improves SVMOnline and Active Learning, " Neural Computation, vol. 20, no. 2, pp. 374-382, 2008.