Double updating online learning

Journal of Machine Learning Research

Volumn 12, Issue , 2011, Pages 1587-1615

  Zhao, Peilin ^a   Hoi, Steven C H ^a   Jin, Rong ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b Michigan State University   (United States)

Author keywords

Classification; Kernel method; Maximum margin learning; Online learning; Support vector machines

Indexed keywords

EMPIRICAL EVALUATIONS; KERNEL METHODS; LEARNING PROCESS; MAXIMUM MARGIN; MISTAKE BOUNDS; MULTI-CLASS; ON-LINE LEARNING METHODS; ONLINE LEARNING; ONLINE LEARNING ALGORITHMS; SOURCE CODES; SUPPORT VECTOR;

LAKES; LEARNING ALGORITHMS; SUPPORT VECTOR MACHINES; VECTORS;

E-LEARNING;

EID: 79960148547     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. Antoine Bordes, Seyda Ertekin, Jason Weston, and Léon Bottou. Fast kernel classifiers with online and active learning. Journal of Machine Learning Research, 6:1579-1619, 2005.
2. Antoine Bordes, Léon Bottou, Patrick Gallinari, and Jason Weston. Solving multiclass support vector machines with larank. In Proceedings of the 24th International Conference on Machine learning (ICML'07), pages 89-96, 2007.
3. Stephen Boyd and Lieven Vandenberghe. Convex Optimization. Cambridge University Press, 2004.
4. Gert Cauwenberghs and Tomaso Poggio. Incremental and decremental support vector machine learning. In Advances in Neural Information Processing Systems 13 (NIPS), pages 409-415, 2000.
5. Giovanni Cavallanti, Nicoló Cesa-Bianchi, and Claudio Gentile. Tracking the best hyperplane with a simple budget perceptron. Machine Learning, 69(2-3):143-167, 2007.
6. Nicoló Cesa-Bianchi and Gabor Lugosi. Prediction, Learning, and Games. Cambridge University Press, 2006.
7. Nicoló Cesa-Bianchi, Alex Conconi, and Claudio Gentile. On the generalization ability of on-line learning algorithms. IEEE Trans. on Inf. Theory, 50(9):2050-2057, 2004.
8. Koby Crammer and Yoram Singer. On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, 2:265-292, 2001.
9. Koby Crammer and Yoram Singer. Ultraconservative online algorithms for multiclass problems. Journal of Machine Learning Research, 3:951-991, 2003.
10. Koby Crammer and Yoram Singer. Loss bounds for online category ranking. In Proceedings of the 18th Annual Conference on Learning Theory (COLT'05), pages 48-62, 2005.
11. Koby Crammer, Jaz S. Kandola, and Yoram Singer. Online classification on a budget. In Advances in Neural Information Processing Systems (NIPS), 2003.
12. Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer. Online passive-aggressive algorithms. Journal of Machine Learning Research, 7:551-585, 2006. (Pubitemid 43668115)
13. Koby Crammer, Mark Dredze, and Fernando Pereira. Exact convex confidence-weighted learning. In Advances in Neural Information Processing Systems (NIPS), pages 345-352, 2008.
14. Koby Crammer, Alex Kulesza, and Mark Dredze. Adaptive regularization of weight vectors. In Advances in Neural Information Processing Systems (NIPS), 2009.
15. Ofer Dekel, Shai Shalev-Shwartz, and Yoram Singer. The forgetron: A kernel-based perceptron on a budget. SIAM J. Comput., 37(5):1342-1372, 2008. ISSN 0097-5397.
16. Mark Dredze, Koby Crammer, and Fernando Pereira. Confidence-weighted linear classification. In Proceedings of the 25th International Conference on Machine Learning (ICML'08), pages 264-271, 2008.
17. Michael Fink, Shai Shalev-Shwartz, Yoram Singer, and Shimon Ullman. Online multiclass learning by interclass hypothesis sharing. In Proceedings of the 25th International Conference onMachine learning (ICML'06), pages 313-320, 2006.
18. Yoav Freund and Robert E. Schapire. Large margin classification using the perceptron algorithm. Mach. Learn., 37(3):277-296, 1999.
19. Claudio Gentile. A new approximate maximal margin classification algorithm. Journal of Machine Learning Research, 2:213-242, 2001.
20. Jyrki Kivinen and Manfred K. Warmuth. Additive versus exponentiated gradient updates for linear prediction. In Proceedings of the Twenty-Seventh Annual ACM Symposium on Theory of Computing (STOC'95), pages 209-218, 1995.
21. Jyrki Kivinen, Alex J. Smola, and Robert C.Williamson. Online learning with kernels. In Advances in Neural Information Processing Systems (NIPS), pages 785-792, 2001.
22. Yi Li and Philip M. Long. The relaxed online maximum margin algorithm. In Advances in Neural Information Processing Systems (NIPS), pages 498-504, 1999.
23. Francesco Orabona, Joseph Keshet, and Barbara Caputo. The projectron: a bounded kernel-based perceptron. In Proceedings of the Twenty-Fifth International Conference on Machine Learning (ICML'08), pages 720-727, 2008.
24. Frank Rosenblatt. The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65:386-407, 1958.
25. Shai Shalev-Shwartz. Online learning: theory, algorithms, and applications. In Ph.D thesis, 2007.
26. Shai Shalev-Shwartz and Yoram Singer. Online learning meets optimization in the dual. In Proceedings of the 19th Annual Conference on Learning Theory (COLT'06), pages 423-437, 2006.
27. Shai Shalev-Shwartz and Yoram Singer. A primal-dual perspective of online learning algorithms. Machine Learning, 69(2-3):115-142, 2007.
28. Vladimir N. Vapnik. Statistical Learning Theory. Wiley, 1998.
29. Jason Weston and Antoine Bordes. Online (and offline) on an even tighter budget. In Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics (AISTATS'05), pages 413-420, 2005.
30. Peilin Zhao, Steven C. H. Hoi, and Rong Jin. Duol: A double updating approach for online learning. In Advances in Neural Information Processing Systems 22 (NIPS), pages 2259-2267, 2009.