Incremental approximate matrix factorization for speeding up support vector machines

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn 2006, Issue , 2006, Pages 760-766

  Wu, Gang ^a   Chang, Edward ^a   Chen, Yen Kuang ^b   Hughes, Christoper ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b INTEL RESEARCH   (United States)

Author keywords

Interior Point Method; Matrix Factorization; Support Vector Machines

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; DATA MINING; DATA STORAGE EQUIPMENT; MATRIX ALGEBRA; OPTIMIZATION; PROBLEM SOLVING;

INCREMENTAL TRAINING ALGORITHM; INTERIOR POINT METHOD (IPM); MATRIX FACTORIZATION; SUPPORT VECTOR MACHINES;

LEARNING SYSTEMS;

EID: 33749570329     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1150402.1150500     Document Type: Conference Paper

References (28)

1. M. A. Aizerman, E. M. Braverman, and L. I. Rozonoer. Theoretical foundations of the potential function method in pattern recognition learning. Automation and Remote Control, 25:821-837, 1964.
2. F. R. Bach and M. I. Jordan. Predictive low-rank decomposition for kernel methods. In Proceedings of the 22nd International Conference on Machine Learning, 2005.
3. S. Boyd. Convex Optimization. Cambridge University Press, 2004.
4. L. Breiman. Bagging predictors. Machine Learning, 24(2): 123-140, 1996.
5. C. Cortes and V. Vapnik. Support-vector networks. Machine Learning, 20:273-297, 1995.
6. R. Courant and D. Hilbert. Method of Mathematical Physics, volume 1. Interscience Publishers, 1953.
7. M. C. Ferris and T. S. Munson. Interior-point methods for massive support vector machines. SIAM J. OPTIM., 13(3):783-804, 2003.
8. S. Fine and K. Scheinberg. Efficient svm training using low-rank kernel representations. Journal of Machine Learning Research, 2:243-264, December 2001.
9. G. Fung and O. L. Mangasarian. Proximal support vector machine classifiers. San Francisco, August 2001.
10. G. H. Golub and C. F. V. Loan. Matrix Computations. The Johns Hopkins University Press, 3 edition, 1996.
11. C. C. Gonzaga. Path-following methods for linear programming. SIAM Review, 34(2): 167-224, 1992.
12. H. P. Graf, E. Cosatto, L. Bottou, I. Dourdanovic, and V. Vapnik. Parallel support vector machines: The cascade svm. In Advances in NIPS 17, pages 521-528. 2005.
13. R. A. Horn and C. R. Johnson. Matrix Analysis. Cambridge University Press, Cambridge, 1990.
14. T. Joachims. Making large-scale svm learning practical Advances in Kernel Methods - Support Vector Learning, 1998.
15. T. Joachims. Transductive inference for text classification using support vector machines. International Conference on Machine Learning, 1999.
16. L. V. Kantorovich. Functional Analysis and Applied Mathematics. National Bureau of Standards, 1952. Translated from Russian by C. D. Benster.
17. Y.-J. Lee and O. L. Mangasarian. Rsvm: Reduced support vector machines. In First SIAM International Conference on Data Mining, Chicago, Apri 2001.
18. C. F. V. Loan and N. Pitslanis. Approximation with kronecker products. In Linear Algebra for Large Scale and Real-Time Applications, pages 293-314. Kluwer Academic Publisher, Dordrecht, 1993.
19. S. Mehrotra. On the implementation of a primal-dual interior point method. SIAM J. Optimization, 2:575-601, 1992.
20. J. Platt. Sequential minimal optimization: A fast algorithm for training support vector machines. Technical Report MSR-TR-98-14, Microsoft Research, 1998.
21. B. T. Polyak. Introduction to Optimization. Optimization Software, 1987. Translated from Russian.
22. D. Prokhorov. Ijcnn 2001 neural network competition, slide presentation in ijcnn'01, 2001.
23. I. W. Tsang, J. T. Kwok, and P.-M. Cheung. Core vector machines: Fast svm training on very large data sets. Journal of Machine Learning Research, 6:363-392, 2005.
24. V. Vapnik. The Nature of Statistical Learning Theory. Springer, New York, 1995.
25. G. Wu, Y.-K. Chen, C. Hughes, E. Chang, and P. Dubey. Parallelizing support vector machines. Technical report, 2005.
26. G. Wu, Z. Zhang, and E. Y. Chang. Kronecker factorization for speeding up kernel machines. In SIAM International Conference on Data Mining, 2005.
27. H. Yu, J. Yang, and J. Han. Classifying large data sets using svm with hierarchical clusters. 2003.
28. G. Zanghirati and L. Zanni. A parallel solver for large quadratic programs in training support vector machines. Parallel Comput., 29(4):535-551, 2003.