Approximation by neural networks and learning theory

Journal of Complexity

Volumn 22, Issue 1 SPEC. ISS., 2006, Pages 102-117

  Maiorov, V ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Entropy; Learning theory; Neural networks; Stochastic approximation

Indexed keywords

ESTIMATION; FUNCTIONS; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; NEURAL NETWORKS; RANDOM PROCESSES;

ACCURACY CONFIDENCE FUNCTION; LEARNING THEORY; STOCHASTIC APPROXIMATION;

PROBLEM SOLVING;

EID: 30344432717     PISSN: 0885064X     EISSN: 10902708     Source Type: Journal    
DOI: 10.1016/j.jco.2005.09.001     Document Type: Article

References (35)

1. M. Anthony, and P.L. Bartlett Neural Network Leaning, Theoretical Foundations 1999 Cambridge University Press Cambridge
2. P.L. Bartlett, O. Bousquet, S. Mendelson, Local Rademacher complexity, Ann. Statist. (2005) to appear.
3. M.S. Birman, and M.Z. Solomyak Piecewise polynomial approximations of functions of the classes W p α Mat. Sb. 73 1967 331 355 English translation in Math. USSR Sb (1967) 295-317. MR 36: 576
4. F. Cucker, and S. Smale On the mathematical foundations on learning Bull. Amer. Math. Soc. 39 2001 1 49
5. I. Daubechies Ten Lectures on Wavelets 1992 SIAM Press Philadelphia, PA
6. R. DeVore, G. Kerkyacharian, D. Picard, and V. Temlyakov On mathematical methods of learning IMI Preprints 10 2004 1 24
7. R. DeVore, G. Kerkyacharian, D. Picard, and V. Temlyakov Mathematical methods for supervised learning IMI Preprints 22 2004 1 51
8. L. Devroy, L. Györfy, and G. Lugosi A Probabilistic Theory of Pattern Recognition 1996 Springer New York
9. R.M. Dudley The sizes of compact subsets of Hilbert space and continuity of Gaussian processes J. Funct. Anal. 1 1967 290 330
10. T. Evgeniou, M. Pontil, and T. Poggio Regularization network and support vector machines Adv. Comput. Math. 13 2000 1 50
11. L. Györfy, Principles of Nonparametric Learning, International Centre for Mechanical Sciences, Courses and Lectures, No. 434.
12. L. Györfy, M. Kohler, A. Krzyzak, and H. Walk A Distribution-Free Theory of Nonparametric Regression 2002 Springer Berlin
13. D. Haussler Sphere packing numbers for subset of the Boolean n -cube with bounded Vapnik-Chervonenkis dimension J. Combin. Theory 69 1995 217 232
14. S. Helgason The Radon Transform 1980 Birkhäuser Boston
15. S. Konyagin, and V. Temlyakov Some error estimates in learning theory IMI Preprints 05 2004 1 18
16. S. Konyagin, and V. Temlyakov The entropy in learning theory, error estimates IMI Preprints 09 2004 1 25
17. G. Lugosi Pattern classification and learning theory Principles of Nonparametric Learning 2002 Springer Vena 5 62
18. V. Maiorov, Pseudo-dimension and entropy of manifolds formed by affine-invariant dictionary, Adv. Comput. Math., submitted for publication.
19. V. Maiorov, and R. Meir On the near optimality of the stochastic approximation of smooth functions by neural networks Adv. Comput. Math. 13 2000 79 103
20. V. Maiorov, and R. Meir On the optimality of networks approximation using incremental algorithms IEEE Trans. Neural Networks 11 2000 323 337
21. V. Maiorov, and R. Meir Lower bounds for multivariate approximation by affine-invariant dictionaries IEEE Trans. Inform. Theory 47 2001 1569 1575
22. V. Maiorov, and A. Pinkus Lower bounds for approximation by MLP neural networks Neurocomputing 25 1999 81 91
23. V. Maiorov, and J. Ratsaby On the value of partial information for learning from examples J. Complexity 13 1997 509 544
24. S. Mendelson, Learning relatively small classes, Proceedings of the 14th Annual Conference on Computational Learning Theory, 2001, pp. 273-288.
25. S. Mendelson, Geometric methods in the analysis of Glivenko-Cantelli classes, Proceedings of the 14th Annual Conference on Computational Learning Theory, 2001, pp. 256-272.
26. S. Mendelson, and R. Vershinin Entropy and the combinatorial dimension Invent. Math. 152 2003 37 55
27. A. Pinkus, Approximation Theory of the MLP Model in Neural Networks, Acta Numerica, Cambridge University Press, Cambridge, 1999, pp. 1-52.
28. T. Poggio, and S. Smale The mathematics of learning: dealing with data Manuscript 2003 1 16
29. M.J.D. Powell, The art of radial basis approximation in 1990, in: W.A. Light (Ed.), Advances in Numerical Analysis, vol. 2, Oxford University Press, Oxford, pp. 105-210.
30. S. Smale, in: V. Arnold, M. Atiyah, P. Lax, B. Vfzur (Eds.), Mathematical Problems for the next century, Mathematics: Frontiers and Perspectives, AMS, 2000, pp. 271-294. CMP 2000:13.
31. M. Talagrand Sharper bounds for Gaussian and empirical processes Ann. Probab. 22 1994 28 76
32. V.N. Temlyakov Optimal estimators in learning theory IMI Preprints 23 2004 1 29
33. V.N. Temlyakov Approximation in learning theory IMI Preprints 5 2005 1 43
34. V. Vapnik Statistical Learning Theory 1998 Wiley New York
35. V. Vapnik, and A. Chervonenkis Necessary and sufficient conditions for the uniform convergence of empirical means to their expectations Theory Probab. Appl. 3 1981 532 553