The forgetron: A kernel-based perceptron on a budget

SIAM Journal on Computing

Volumn 37, Issue 5, 2007, Pages 1342-1372

  Dekel, Ofer ^a   Shai, Shalev Shwartz ^a   Singer, Yoram ^b  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b GOOGLE INC   (United States)

Author keywords

Kernel methods; Learning theory; Online classification; The Perceptron algorithm

Indexed keywords

CLASSIFICATION ALGORITHMS; CLASSIFICATION TASKS; KERNEL FUNCTIONS; KERNEL METHODS; LEARNING PARADIGMS; LEARNING THEORY; MISTAKE BOUNDS; ONE HANDS; ONLINE ALGORITHMS; ONLINE CLASSIFICATION; PERCEPTRON; PERCEPTRON ALGORITHMS; REAL DATA SETS; RUNNING TIMES; THE PERCEPTRON ALGORITHM;

ALGORITHMS; BUDGET CONTROL;

LEARNING ALGORITHMS;

EID: 55249109544     PISSN: 00975397     EISSN: None     Source Type: Journal    
DOI: 10.1137/060666998     Document Type: Article

References (12)

1. N. CESA-BIANCHI AND C. GENTILE, Tracking the best hyperplane with a simple budget perception, in Learning Theory, Lecture Notes in Comput. Sci. 4005, Springcr-Verlag, Berlin, 2006, pp. 483-498.
2. K. CRAMMER, O. DEKEL, J. KESHET, S. SHALEV-SHWARTZ, AND Y. SINGER, Online passive aggressive algorithms. J. Mach. Learn. Res., 7 (2006), pp. 551-585.
3. K. CRAMMER, J. KANDOLA, AND Y. SINGER, Online classification on a budget, in Advances in Neural Information Processing Systems 16, The MIT Press, Cambridge, MA, 2004, pp. 225-232.
4. O. DEKEL, S. SHALEV-SHWARTZ, AND Y. SINGER, The Forgetron: A kernel-based perception on a fixed budget, in Advances in Neural Information Processing Systems 18, The MIT Press, Cambridge, MA, 2006, pp. 259-266.
5. C. GENTILE, A new approximate maximal margin classification algorithm, J. Mach. Learn. Res., 2 (2001), pp. 213-242.
6. D. P. HELMBOLD, J. KIVINEN, AND M. WARMUTH, Relative loss bounds for single neurons, IEEE Trans. Neural Networks, 10 (1999), pp. 1291-1304.
7. J. KIVINEN, A. J. SMOLA, AND R. C. WILLIAMSON, Online learning with kernels, IEEE Trans. Signal Process., 52 (2002), pp. 2165-2176.
8. J. KIVINEN AND M. WARMUTH, Exponentiated gradient versus gradient descent for linear predictors, Inform. and Comput., 132 (1997), pp. 1-64.
9. Y. LI AND P. M. LONG, The relaxed online maximum margin algorithm, Machine Learning, 46 (2002), pp. 361-387.
10. F. ROSENBLATT, The perception: A probabilistic model for information storage and organization in the brain. Psychological Review, 65 (1958), pp. 386-407.
11. V. N. VAPNIK, Statistical Learning Theory, John Wiley, New York, 1998.
12. J. WESTON, A. BORDES, AND L. BOTTOU, Online (and offline) on an even tighter budget, in Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, Barbados, 2005, pp. 413-420.