Pseudo-dimension and entropy of manifolds formed by affine-invariant dictionary

Advances in Computational Mathematics

Volumn 25, Issue 4, 2006, Pages 435-450

  Maiorov, V ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

entropy; Neural networks; Radial basis approximation; VC dimension

Indexed keywords

EID: 33748700419     PISSN: 10197168     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10444-004-7645-9     Document Type: Article

References (20)

1. M. Anthony and P.L. Bartlett, Neural Networks Learning: Theoretical Foundation (Cambridge Univ. Press, Cambridge, 1999).
2. P.L. Bartlett, V. Maiorov and R. Meir, Almost linear VC dimension bounds for piecewise polynomial networks, Neural Networks 10 (1998) 2159-2173.
3. M.D. Buhmann, Multivariate Approximation and Application, eds. N. Dyn et al. (Cambridge Univ. Press, Cambridge, 2001) pp. 25-43.
4. F. Cucker and S. Smale, On the mathematical foundations on learning, Bull. Amer. Math. Soc. 39 (2001) 1-49.
5. R. DeVore and G. Lorentz, Constructive Approximation (Springer, Berlin, 1991).
6. D. Haussler, Sphere packing numbers for subset of the Boolean n-cube with bounded Vapnik-Chervonenkis dimension, J. Combinatorical Theory 69 (1995) 217-232.
7. M. Karpinski and A. J. Macintyre, Polynomial bounds for VC dimension of sigmoidal neural networks, in: Proc. of the 27th ACM Symp. Thy. of Computing (1995) pp. 200-208.
8. V. Maiorov, Approximation by neural networks and learning theory, submitted.
9. V. Maiorov and R. Meir, Lower bounds for multivariate approximation by affine-invariant dictionaries, IEEE Trans. Inform. Theory 47 (2001) 1569-1575.
10. V. Maiorov and A. Pinkus, Lower bounds for approximation by MLP neural networks, Neurocomputing 25 (1999) 81-91.
11. S. Mendelson and R. Vershinin, Enropy and the combinatorial dimension, Inventiones Mathematicae 152 (2003) 37-55.
12. J. Milnor, On the Betti numbers of real varieties, Proc. Amer. Math. Soc. 15 (1964) 275-280.
13. I.G. Petrovskii and O.A. Oleinik, On the topology of real algebraic surfaces, Izv. Akad. Nauk SSSR Ser. Mat. 13 (1949) 389-402.
14. A. Pinkus, Approximation theory of the MLP model in neural networks, Acta Numerica (Cambridge Univ. Press, Cambridge, 1999) 1-52.
15. M.J.D. Powell, The of radial basis approximation in 1990, in: Advances in Numerical Analysis, Vol. 2, ed. W.A. Light (Oxford Univ. Press, Oxford) pp. 105-210.
16. S. Smale, Mathematical problems for the next century, in: Mathematics: Frontiers and Perspectives, eds. V. Arnold, M. Atiyah, P. Lax and B. Vfzur (AMS, Providence, RI, 2000) CMP 13 (2000) 271-294.
17. M. Talagrand, Vapnik-Chervonenkis type conditions and uniform Donsker classes of functions, Ann. Probab., to appear.
18. V. Vapnik and A. Chervonenkis, Necessary and sufficient conditions for the uniform convergence of empirical means to their expectations, Theory Probab. Appl. 3 (1981) 532-553.
19. M. Vidyasagar, A Theory of Learning and Generalization (Springer, London, 1997).
20. H.E. Warren, Lower bounds for approximation by nonlinear manifold, Trans. Amer. Math. Soc. 133 (1968) 167-178.