Efficient multiplicative updates for support vector machines

Society for Industrial and Applied Mathematics - 9th SIAM International Conference on Data Mining 2009, Proceedings in Applied Mathematics

Volumn 3, Issue , 2009, Pages 1212-1223

  Potluru, Vamsi K ^a   Plis, Sergey M ^a   Mørup, Morten ^b   Calhoun, Vincent D ^a   Lane, Terran ^a  

^a UNIVERSITY OF NEW MEXICO   (United States)

^b TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC CONVERGENCE; CLASSIFICATION PERFORMANCE; DATA SETS; KERNEL ADATRON ALGORITHMS; LEARNING RATES; MATRIX FACTORIZATIONS; MULTIPLICATIVE UPDATES; NATURAL EXTENSION; NONNEGATIVE MATRIX FACTORIZATION; OBJECTIVE FUNCTIONS; PARAMETER SETTING; QUADRATIC PROGRAMMING PROBLEMS; RAPID CONVERGENCE; SOFT MARGINS; TIGHT BOUND;

CLASSIFICATION (OF INFORMATION); FACTORIZATION; GEARS; LEARNING ALGORITHMS; LIGHT MEASUREMENT; MULTILAYER NEURAL NETWORKS;

SUPPORT VECTOR MACHINES;

EID: 73449144120     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Inderjit Dhillon and Suvrit Sra. Generalized nonnegative matrix approximations with Bregman divergences. In Y. Weiss, B. Schlkopf, and J. Piatt, editors, Ad-vances in Neural Information Processing Systems 18, pages 283-290. MIT Press, Cambridge, MA, 2006.
2. Chris Ding, Tao Li, and Michael I. Jordan. Convex and semi-nonnegative matrix factorizations. LBNL Tech Report 60428, 2006.
3. J. Eggert and E. Körner. Sparse coding and NMF. Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on, 4:2529-2533, 25-29 July 2004.
4. V. Franc, V. Hlavac, and M. Navara. Sequential coordinate-wise algorithm for the non-negative least squares problem. In Computer Analysis of Images and Patterns, page 407, 2005.
5. Thilo-Thomas Frieß, Nello Cristianini, and Colin Campbell. The Kernel-Adatron algorithm: a fast and simple learning procedure for support vector machines. In Proc. 15th International Conf. on Machine Learning, pages 188-196. Morgan Kaufmann, San Francisco, CA, 1998.
6. Vojislav Kecman, Michael Vogt, and Te Ming Huang. On the equality of kernel adatron and sequential minimal optimization in classification and regression tasks and alike algorithms for kernel machines. In ESANN, pages 215-222, 2003.
7. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy. A fast iterative nearest point algorithm for support vector machine classifier design. Neural Networks, IEEE Transactions on, 11(1):124-136, Jan 2000.
8. Daniel D. Lee and Sebastian H. Seung. Algorithms for non-negative matrix factorization. In NIPS, pages 556-562, 2000.
9. Chih-Jen Lin. Projected gradient methods for nonnegative matrix factorization. Neural Comp., 19(10):2756-2779, October 2007.
10. M. Mørup and L. H. Clemmensen. Multiplicative updates for the LASSO,. Machine Learning for Signal Processing, 2007 IEEE Workshop on, pages 33-38, 2007.
11. C. L. Blake D. J. Newman and C. J. Merz. UCI repository of machine learning databases, 1998.
12. E. Osuna, R. Freund, and F. Girosi. An improved training algorithm for support vector machines. Neural Networks for Signal Processing [1997] VII. Proceedings of the 1997 IEEE Workshop, pages 276-285, Sep 1997.
13. J. Platt. Sequential minimal optimization: A fast algorithm for training support vector machines, 1998.
14. Ruslan Salakhutdinov and Sam Roweis. Adaptive over-relaxed bound optimization methods. In Proceedings of the International Conference on Machine Learning, volume 20, pages 664-671, 2003.
15. Bernhard Schölkopf and Alexander J. Smola. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (Adaptive Computation and Machine Learning). The MIT Press, 2001.
16. Fei Sha, Lawrence K. Saul, and Daniel D. Lee. Multiplicative updates for large margin classifiers. In Proceedings of the Sixteenth Annual Conference on Computational Learning Theory (COLT), Washington D.C, USA, 2003.
17. Fei Sha, Lawrence K. Saul, and Daniel D. Lee. Multiplicative updates for nonnegative quadratic programming in support vector machines. In Sebastian Thrun Suzanna Becker and Klaus Obermayer, editors, Advances in Neural Information Processing Systems 15, Cambridge, MA, 2003. MIT Press.
18. Rafal Zdunek and Andrzej Cichocki. Fast nonnegative matrix factorization algorithms using projected gradient approaches for large-scale problems. Computational Intelligence and Neuroscience, page 13, 2008.