An incremental learning algorithm for Lagrangian support vector machines

Pattern Recognition Letters

Volumn 30, Issue 15, 2009, Pages 1384-1391

  Duan, Hua ^a   Shao, Xiaojian ^b   Hou, Weizhen ^a   He, Guoping ^a   Zeng, Qingtian ^a  

^a SHANDONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b CHINA AGRICULTURAL UNIVERSITY   (China)

Author keywords

Incremental learning; Lagrangian; Online learning; Support vector machines

Indexed keywords

COMPUTATION TIME; COMPUTING PROCESS; CONVEX PROGRAMMING; INCREMENTAL LEARNING; INPUT SPACE; LAGRANGIAN; LINEAR CONVERGENCE; LINEAR SVM; MATRIX; ONLINE LEARNING; SOLVING ALGORITHM;

E-LEARNING; EDUCATION; GEARS; IMAGE RETRIEVAL; INTERNET; LAGRANGE MULTIPLIERS; MULTILAYER NEURAL NETWORKS; SUPPORT VECTOR MACHINES; VECTORS;

LEARNING ALGORITHMS;

EID: 70349135848     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2009.07.006     Document Type: Article

References (28)

1. Bradley P.S., and Mangasarian O.L. Massive data discrimination via linear support vector machines. Optimiz. Methods Software 13 (2000) 1-10
2. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Knowl. Discovery Data Mining 2 (1998) 121-167
3. Cauwenberghs G., and Poggio T. Incremental and decremental support vector machine learning. Adv. Neural Information Processing vol. 13 (2001), MIT Press
4. Chang, C.-C., Lin. C.-J., 2001. LIBSVM - A Library for Support Vector Machines. .
5. Cheng S.X., and Shih F.Y. An improved incremental training algorithm for support vector machines using active query. Pattern Recognition 40 (2007) 964-971
6. Cherkassky V., and Mulier F. Learning from Data - Concepts, Theory and Methods (1998), John Wiley and Sons, New York
7. Ferris, M.C., Munson, T.S., 2000. Interior point methods for massive support vector machines. Technical Report 00-05. Computer Sciences Department, University of Wisconsin, Madison.
8. Fung, G., Mangasarian, O.L., 2000. Data selection for support vector machine classifiers. Data Mining Institute Technical Report 00-02, February 2000. Proc. Sixth ACM SIGKDD Internat. Conf. on Knowledge Discovery and Data Mining, August 20-23, 2000.
9. Fung, G., Mangasarian, O.L., 2001. Proximal support vector machine classifiers. In: Provost, F., Srikant, R. (Eds.), Proc. KDD-2001: Knowledge Discovery and Data Mining, August 26-29, 2001, San Francisco, CA, New York, pp. 77-86.
10. Golub G.H., and Van Loan C.F. Matrix Computations. third ed. (1996), The John Hopkins University Press, Baltimore, Maryland
11. Joachims T. Estimating the generalization performance of a SVM efficiently. Proc. Internat. Conf. on Machine Learning (2000), Morgan Kaufmann, San Francisco
12. Klinkenberg R., and Joachims T. Detecting concept drift with support vector machines. Proc. Seventeenth Internat. Conf. on Machine Learning (ICML) (2000), Morgan Kaufmann, San Francisco
13. Lee, Y.-J., Mangasarian, O.L., 2000. RSVM: Reduced support vector machines. Technical Report 00-07. Data Mining Institute, Computer Sciences Department, University of Wisconsin, Madison.
14. Lee Y.-J., and Mangasarian O.L. SSVM: A smooth support vector machine. Comput. Optimiz. Appl. (2000)
15. Mangasarian O.L. Generalized support vector machines. In: Smola A., Bartlett P., Schölkopf B., and Schuurmans D. (Eds). Advances in Large Margin Classifiers (2000), MIT Press, Cambridge, MA 135-146
16. Fung,G., Mangasarian, O.L., 2002. Finite Newton method for Lagrangian support vector machine classification. Technical Report 02-01. Data Mining Institute, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin. .
17. Mangasarian O.L., and Musicant D.R. Successive overrelaxation for support vector machines. IEEE Trans. Neural Networks 10 (1999) 1032-1037
18. Mangasarian O.L., and Musicant D.R. Active support vector machine classification. Adv. Neural Inform. Process. Systems (2000)
19. Mangasarian O.L., and Musicant D.R. Lagrangian support vector machines. J. Machine Learn. Res. 1 (2001) 161-177
20. Mangasarian O.L., and Solodov M.V. Nonlinear complementarity as unconstrained and constrained minimization. Math. Program., Ser. B 62 (1993) 277-297
21. Peking University. Advanced Algebra. China High Education Press, Beijing, 1987.
22. Schlimmer J.C., and Fisher D.H. A case study of incremental concept induction. In: Kehler T., and Rosenschein S. (Eds). Proc. Fifth National Conf. on Artificial Intelligence vol. 1 (1986), Morgan Kaufmann, Philadelphia, San Mateo, CA 496-501
23. Schlimmer J.C., and Granger R.H. Incremental learning from noisy data. Machine Learn. 1 (1986) 317-354
24. Syed, N.A., Liu, H., Sung, K.K., 1999. Handling concept drifts in incremental learning with support vector machines. In: Proc. of ACM SIGKDD Internat. Conf. on Knowledge Discovery and Data Mining (KDD-99), San Diego, CA, USA.
25. Syed, N.A., Liu, H., Sung, K.K., 1999. Incremental learning with support vector machines. In: Proc. Int. Joint Conf. on Artificial Intelligence (IJCAI-99).
26. Utgoff, P.E., 1994. An improved algorithm for incremental induction decision trees. Technical Report 94-07, Department of Computer Science, University of Massachusetts, Amherst, MA 01003.
27. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer-Verlag, New York
28. Yuan Y.X., and Sun W.Y. Optimization Theories and Methods (1997), Science Press, Beijing