On regularization algorithms in learning theory

Journal of Complexity

Volumn 23, Issue 1, 2007, Pages 52-72

  Bauer, Frank ^a   Pereverzev, Sergei ^a   Rosasco, Lorenzo ^b,c  

^a UNIVERSITY OF GÖTTINGEN   (Germany)

^b JOHANN RADON INSTITUTE FOR COMPUTATIONAL AND APPLIED MATHEMATICS   (Austria)

^c UNIVERSITY OF GENOA   (Italy)

Author keywords

Learning theory; Non parametric statistics; Regularization theory

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; INVERSE PROBLEMS; ITERATIVE METHODS; MATHEMATICAL OPERATORS;

LEARNING THEORY; NON PARAMETRIC STATISTICS; REGULARIZATION THEORY; TIKHONOV REGULARIZATION;

LEARNING SYSTEMS;

EID: 33846829559     PISSN: 0885064X     EISSN: 10902708     Source Type: Journal    
DOI: 10.1016/j.jco.2006.07.001     Document Type: Article

References (33)

1. Aronszajn N. Theory of reproducing kernels. Trans. Amer. Math. Soc. 68 (1950) 337-404
2. P.L. Bartlett, M.J. Jordan, J.D. McAuliffe, Convexity, classification, and risk bounds, Technical Report 638, Department of Statistics, U.C. Berkeley, 2003.
3. Birman M.S., and Solomyak M. Double operators integrals in Hilbert spaces. Integral Equations Oper. Theory (2003) 131-168
4. N. Bissantz, T. Hohage, A, Munk, F. Ruymgaart, Convergence rates of general regularization methods for statistical inverse problems and applications, preprint, 2006.
5. Bousquet O., Boucheron S., and Lugosi G. Introduction to Statistical Learning Theory, Lectures Notes in Artificial Intelligence vol. 3176 (2004), Springer, Heidelberg, Germany, Wiley-Interscience Publication 169-207
6. O. Bousquet, S. Boucheron, G. Lugosi, Theory of classification: a survey of recent advances, ESAIM Probab. Statist. (2004), to appear.
7. A. Caponnetto, E. De Vito, Fast rates for regularized least-squares algorithm, Technical Report CBCL Paper 248/AI Memo 2005-033, Massachusetts Institute of Technology, Cambridge, MA, 2005.
8. A. Caponnetto, E. De Vito, Optimal rates for regularized least-squares algorithm, Foundation Comput. Math. (2005), accepted for publication.
9. A. Caponnetto, L. Rosasco, E. De Vito, A. Verri, Empirical effective dimensions and fast rates for regularized least-squares algorithm, Technical Report CBCL Paper 252/AI Memo 2005-019, Massachusetts Institute of Technology, Cambridge, MA, 2005.
10. C. Carmeli, E. De Vito, A. Toigo, Reproducing kernel Hilbert spaces and mercer theorem, eprint arXiv: math/0504071. Available at 〈http://arxiv.org〉, 2005.
11. Cucker F., and Smale S. On the mathematical foundations of learning. Bull. Amer. Math. Soc. (N.S.) 39 1 (2002) 1-49 (electronic)
12. E. De Vito, L. Rosasco, A. Caponnetto, Discretization error analysis for tikhonov regularization, Anal. Appl. (2005), to appear.
13. De Vito E., Rosasco L., Caponnetto A., De Giovannini U., and Odone F. Learning from examples as an inverse problem. J. Mach. Learning Res. 6 (2005) 883-904
14. R. DeVore, G. Kerkyacharian, D. Picard, V. Temlyakov, On mathematical methods of learning, Technical Report 2004:10, Industrial Mathematics Institute, Department of Mathematics University of South Carolina, retrievable at 〈http://www.math/sc/edu/imip/04papers/0410.ps〉, 2004.
15. Devroye L., Györfi L., and Lugosi G. A Probabilistic Theory of Pattern Recognition, Applications of Mathematics vol. 31 (1996), Springer, New York
16. Engl H.W., Hanke M., and Neubauer A. Regularization of Inverse Problems, Mathematics and its Applications vol. 375 (1996), Kluwer Academic Publishers Group, Dordrecht
17. Evgeniou T., Pontil M., and Poggio T. Regularization networks and support vector machines. Adv. Comp. Math. 13 (2000) 1-50
18. Györfi L., Kohler M., Krzyzak A., and Walk H. A Distribution-free Theory of Non-parametric Regression (1996), Springer Series in Statistics, New York
19. F. Hansen, Operator inequalities associated to Jensen's inequality, survey of "Classical Inequalities", pp. 67-i98.
20. Mathé P., and Pereverzev S. Moduli of continuity for operator monotone functions. Numer. Funct. Anal. Optim. 23 (2002) 623-631
21. Mathé P., and Pereverzev S. Geometry of linear ill-posed problems in variable Hilbert scale. Inverse Problems 19 (2003) 789-803
22. P. Mathé, S. Pereverzev, Regularization of some linear ill-posed problems with discretized random noisy data, Math. Comput. (2005), accepted for publication.
23. Pinelis I.F., and Sakhanenko A.I. Remarks on inequalities for probabilities of large deviations. Theory Probab. Appl. 30 1 (1985) 143-148
24. L. Rosasco, E. De Vito, A. Verri, Spectral methods for regularization in learning theory, Technical Report DISI-TR-05-18, DISI, Universitá degli Studi di Genova, Italy, retrievable at 〈http://www.disi.unige.it/person/RosascoL〉, 2005.
25. Rudin W. Functional Analysis, International Series in Pure and Applied Mathematics (1991), McGraw-Hill, Princeton
26. Schwartz L. Sous-espaces hilbertiens d'espaces vectoriels topologiques et noyaux associés (noyaux reproduisants). J. Analyse Math. 13 (1964) 115-256
27. S. Smale, D. Zhou, Learning theory estimates via integral operators and their approximations, submitted for publication, retrievable at 〈http://www.tti-c.org/smale.html〉, 2005.
28. S. Smale, D. Zhou, Shannon sampling ii: connections to learning theory, retrievable at 〈http://www.tti-c.org/smale.html〉, 2005, to appear.
29. Tsybakov A.B. Optimal aggregation of classifiers in statistical learning. Ann. Statist. 32 (2004) 135-166
30. van de Geer S.A. Empirical Process in M-Estimation, Cambridge Series in Statistical and Probabilistic Mathematics (2000), Cambridge University Press, Cambridge
31. van de Vaart S.W., and Wellner J.A. Weak Convergence and Empirical Process Theory, Springer Series in Statistics, New York, 1996 (1996), Springer, New York
32. Vapnik V.N. Statistical learning theory, Adaptive and Learning Systems for Signal Processing, Communications, and Control, Wiley, New York (1998), a Wiley-Interscience Publication
33. Y. Yao, L. Rosasco, A. Caponnetto, On early stopping in gradient descent learning, Constructive Approximation (2005), submitted for publication.