Model complexity of neural networks and integral transforms

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5768 LNCS, Issue PART 1, 2009, Pages 708-717

  Kůrková, Věra ^a  

^a INSTITUTE OF COMPUTER SCIENCE   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ERRORS; COMPUTATIONAL UNITS; INTEGRAL TRANSFORM; MODEL COMPLEXITY; MULTIVARIABLE FUNCTIONS; NETWORK COMPLEXITY; NONLINEAR APPROXIMATION; PERCEPTRON NETWORK; UPPER BOUND;

BACKPROPAGATION; INTEGRAL EQUATIONS; INTEGRODIFFERENTIAL EQUATIONS;

NEURAL NETWORKS;

EID: 70350217842     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-04274-4_73     Document Type: Conference Paper

References (21)

1. Carroll, S.M., Dickinson, B.W.: Construction of neural net using the radon transform. In: Proc. IJCN, vol. I, pp. 607-611 (1989)
2. Ito, Y.: Representation of functions by superpositions of a step or sigmoid function and their applications to neural network theory. Neural Networks 4, 385-394 (1991)
3. Park, J., Sandberg, I.: Universal approximation using radial-basis-function networks. Neural Computation 3, 246-257 (1991)
4. Park, J., Sandberg, I.: Approximation and radial basis function networks. Neural Computation 5, 305-316 (1993)
5. Jones, L.K.: A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training. Annals of Statistics 20, 608-613 (1992)
6. Barron, A.R.: Universal approximation bounds for superpositions of a sigmoidal function. IEEE Transactions on Information Theory 39, 930-945 (1993)
7. Girosi, F., Anzellotti, G.: Rates of convergence for Radial Basis Functions and neural networks. In: Mammone, R.J. (ed.) Artificial Neural Networks for Speech and Vision, pp. 97-113. Chapman & Hall, Boca Raton (1993)
8. Kůrková, V., Kainen, P.C., Kreinovich, V.: Estimates of the number of hidden units and variation with respect to half-spaces. Neural Networks 10, 1061-1068 (1997)
9. Kainen, P.C., Kůrková, V., Vogt, A.: A Sobolev-type upper bound for rates of approximation by linear combinations of Heaviside plane waves. J. of Approximation Theory 147, 1-10 (2007)
10. Kainen, P.C., Kůrková, V.: An integral upper bound for neural network approximation. Neural Computation (to appear, 2009)
11. Girosi, F.: Approximation error bounds that use VC-bounds. In: Proceedings of the International Conference on Artificial Neural Networks, Paris, pp. 295-302 (1995)
12. Kainen, P.C., Kůrková, V., Sanguineti, M.: Complexity of Gaussian radial basis networks approximating smooth functions. J. of Complexity 25, 63-74 (2009)
13. Kainen, P.C., Kůrková, V., Vogt, A.: Integral combinations of heavisides. Mathematische Nachrichten (to appear, 2009)
14. Pisier, G.: Remarques sur un résultat non publiédeB. Maurey. In: Séminaire d'Analyse Fonctionnelle 1980-1981, École Polytechnique, Centre de Mathématiques, Palaiseau, France, vol. I(12) (1981)
15. Darken, C., Donahue, M., Gurvits, L., Sontag, E.: Rate of approximation results motivated by robust neural network learning. In: Proceedings of the Sixth Annual ACM Conference on Computational Learning Theory, pp. 303-309. The Association for Computing Machinery, New York (1993)
16. Kůrková, V.: High-dimensional approximation and optimization by neural networks. In: Suykens, J., Horváth, G., Basu, S., Micchelli, C., Vandewalle, J. (eds.) Advances in Learning Theory: Methods, Models and Applications, ch. 4, pp. 69-88. IOS Press, Amsterdam (2003)
17. Kůrková, V., Sanguineti, M.: Error estimates for approximate optimization by the extended Ritz method. SIAM J. on Optimization 15, 461-487 (2005)
18. Yoshida, K.: Functional Analysis. Springer, Berlin (1965)
19. Kůrková, V., Savický, P., Hlaváč ková, K.: Representations and rates of approximation of real-valued Boolean functions by neural networks. Neural Networks 11, 651-659 (1998)
20. Friedman, A.: Learning and Soft Computing. Dover, New York (1982)
21. Rudin, W.: Real and Complex Analysis. MacGraw-Hill, New York (1974)