Incremental and decremental training for linear classification

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2014, Pages 343-352

  Tsai, Cheng Hao ^a   Lin, Chieh Yen ^a   Lin, Chih Jen ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

decremental learning; incremental learning; linear classification; warm start

Indexed keywords

EID: 84907025192     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2623330.2623661     Document Type: Conference Paper

References (19)

1. B. E. Boser, I. Guyon, and V. Vapnik. A training algorithm for optimal margin classifiers. In COLT, 1992.
2. L. Bottou and C.-J. Lin. Support vector machine solvers. In Large Scale Kernel Machines. 2007.
3. G. Cauwenberghs and T. Poggio. Incremental and decremental support vector machine learning. In NIPS. 2001.
4. C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM TIST, 2:27:1-27:27, 2011.
5. K.-W. Chang, C.-J. Hsieh, and C.-J. Lin. Coordinate descent method for large-scale L2-loss linear SVM. JMLR, 9:1369-1398, 2008.
6. O. Chapelle. Training a support vector machine in the primal. Neural Comput., 19:1155-1178, 2007.
7. C. Cortes and V. Vapnik. Support-vector network. MLJ, 20:273-297, 1995.
8. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. LIBLINEAR: A library for large linear classification. JMLR, 9:1871-1874, 2008.
9. S. Fine and K. Scheinberg. Incremental learning and selective sampling via parametric optimization framework for SVM. In NIPS. 2001.
10. C.-J. Hsieh, K.-W. Chang, C.-J. Lin, S. S. Keerthi, and S. Sundararajan. A dual coordinate descent method for large-scale linear SVM. In ICML, 2008.
11. M. Karasuyama and I. Takeuchi. Multiple incremental decremental learning of support vector machines. IEEE TNN, 21:1048-1059, 2010.
12. G. S. Kimeldorf and G. Wahba. A correspondence between Bayesian estimation on stochastic processes and smoothing by splines. Ann. Math. Stat., 41:495-502, 1970.
13. P. Laskov, C. Gehl, S. Krüger, and K.-R. Müller. Incremental support vector learning: Analysis, implementation and applications. JMLR, 7:1909-1936, 2006.
14. Z. Liang and Y. Li. Incremental support vector machine learning in the primal and applications. Neurocomputing, 72(10):2249-2258, 2009.
15. C.-J. Lin, R. C. Weng, and S. S. Keerthi. Trust region Newton method for large-scale logistic regression. JMLR, 9:627-650, 2008.
16. A. Shilton, M. Palaniswami, D. Ralph, and A. C. Tsoi. Incremental training of support vector machines. IEEE TNN, 16:114-131, 2005.
17. P.-W. Wang and C.-J. Lin. Iteration complexity of feasible descent methods for convex optimization. JMLR, 2014.
18. H.-F. Yu, F.-L. Huang, and C.-J. Lin. Dual coordinate descent methods for logistic regression and maximum entropy models. MLJ, 85:41-75, 2011.
19. G.-X. Yuan, C.-H. Ho, and C.-J. Lin. Recent advances of large-scale linear classification. PIEEE, 100:2584-2603, 2012.