Nonparametric estimation and classification using radial basis function nets and empirical risk minimization

IEEE Transactions on Neural Networks

Volumn 7, Issue 2, 1996, Pages 475-487

  Krzyzak, Adam ^a,b   Linder, Tamás ^c   Lugosi, Gábor ^c  

^a IEEE

^b Civil and Environmental Engineering   (Canada)

^c BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; ERRORS; ESTIMATION; FUNCTIONS; MATHEMATICAL MODELS; MATRIX ALGEBRA; PROBABILITY;

BAYES-PARZEN DENSITY; NONLINEAR FUNCTION APPROXIMATION; NONPARAMETRIC ESTIMATION; RADIAL BASIS FUNCTION NETWORKS; VAPNIK-CHERVONENKIS APPROACH;

NEURAL NETWORKS;

EID: 0030109050     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.485681     Document Type: Article

References (38)

1. A. R. Barron, "Approximation and estimation bounds for artificial neural networks," in Proc. 4th Annu. Wkshp. Computa. Learning Theory, vol. 4, 1991, pp. 243-249.
2. _, "Universal approximation bounds for superpositions of a sigmoidal function," IEEE Trans. Inform. Theory, vol. 39, pp. 930-945, May 1993.
3. E. B. Baum and D. Haussler, "What size net gives valid generalization?" Neural Computa., vol. 1, pp. 151-160, 1989.
4. A. Blumer, A. Ehrenfeucht, D. Haussler, and M. K. Warmuth, "Learn-ability and the Vapnik-Chervonenkis dimension," J. ACM, vol. 36, pp. 929-965, 1989.
5. D. S. Broomhead and D. Lowe, "Multivariable functional interpolation and adaptive networks," Complex Syst., vol. 2, pp. 321-323, 1988.
6. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Networks, vol. 2, pp. 302-309, 1991.
7. T. M. Cover, "Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition," IEEE Trans. Electron. Comput., vol. 14, pp. 326-334, 1965.
8. C. Darken, M. Donahue, L. Gurvits, and E. Sontag, "Rate of approximation results motivated by robust neural network learning," in Proc. 6th Annu. Wkshp. Computa. Learning Theory, 1993, pp. 303-309.
9. L. Devroye, "Automatic pattern recognition.: A study of the probability of error," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-10, pp. 530-543, 1988.
10. L. Devroye and L. Györfi, Nonparametric Density Estimation: The L1 View. New York: Wiley, 1985.
11. 1 convergence of the kernel regression estimate," J. Statist. Planning Inference, vol. 23, pp. 71-82, 1989.
12. N. Dunford and J. T. Schwartz, Linear Operators, Part I. General Theory. New York: Interscience, 1957.
13. A. Faragó and G. Lugosi, "Strong universal consistency of neural network classifiers," IEEE Trans. Inform. Theory, vol. 39, pp. 1146-1151, July 1993.
14. F. Girosi and G. Anze Ilotti, "Rates of convergence for radial basis functions and neural networks," in Artificial Neural Networks for Speech and Vision, R. J. Mammone, Ed. London: Chapman and Hall, 1993, pp. 97-114.
15. U. Grenander, Abstract Inference. New York: Wiley, 1981.
16. E. J. Hartman, J. D. Keeler, and J. M. Kowalski, "Layered neural networks with Gaussian hidden units as universal approximations," Neural Computa., vol. 2, pp. 210-215, 1990.
17. D. Haussler, "Decision theoretic generalizations of the PAC model for neural net and other learning applications," Inform. Computa., vol. 100, pp. 78-150, 1992.
18. K. Hornik, S. Stinchocombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks, vol. 2, pp. 359-366, 1989.
19. L. K. Jones, "A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training," Annals Statist., vol. 20, pp. 608-613, Mar. 1992.
20. A. N. Kolmogorov and V. M. Tihomirov, "ε-entropy and ε-capacity of sets in function spaces," Translations Amer. Math. Soc., vol. 17, pp. 277-364, 1961.
21. G. Lugosi and K. Zieger, "Nonparametric estimation via empirical risk minimization," IEEE Trans. Inform. Theory, vol. 41, pp1 677-687, May 1995.
22. A. Macintyre and E. D. Sontag, "Finiteneness results for sigmoidal 'neural' networks," in Proc. 25th Annu. ACM Symp. Theory Computing, 1993, pp. 325-334.
23. J. Moody and J. Darken, "Fast learning in networks of locally-tuned processing units," Neural Computa., vol. 1, pp. 281-294, 1989.
24. J. Park and I. W. Sandberg, "Universal approximation using radial basis function networks," Neural Computa., vol. 3, pp. 246-257, 1991.
25. _, "Approximation and radial basis function networks," Neural Computa., vol. 5, pp. 305-316, 1993.
26. T. Poggio and F. Girosi, "A theory of networks for approximation and learning," Proc. IEEE, vol. 78, pp. 1481-1497, 1990.
27. D. Pollard, Convergence of Stochastic Processes. New York: Springer-Verlag, 1984.
28. _, Empirical Processes: Theory and Applications, NSF-CBMS Regional Conference Series in Probability and Statistics, Institute of Mathematical Statistics, 1990.
29. M. J. D. Powell, "Radial basis functions for multivariable interpolation: A review," in Algorithms for Approximation. Oxford, U.K.: Clarendon, 1987, pp. 143-167.
30. D. F. Specht. "Probabilistic neural networks," Neural Networks, vol. 3. pp. 109-118, 1990.
31. V. N. Vapnik and A. Y. Chervonenkis, "On the uniform convergence of relative frequencies of events to their probabilities," Theory Probability Applicat., vol. 16, pp. 264-280, 1971.
32. V. N. Vapnik, Estimation of Dependences Based on Empirical Data, New York: Springer-Verlag, 1982.
33. R. S. Wenocur and R. M. Dudley, "Some special Vapnik-Chervonenkis classes," Discrete Math., vol. 33, pp. 313-318, 1981.
34. R. L. Wheeden and A. Zygmund, Measure and Integral. New York: Marcel Dekker, 1977.
35. H. White, "Connectionist nonparametric regression: Multilayer feedforward networks that can learn arbitrary mappings," Neural Networks, vol. 3, pp. 535-549, 1990.
36. L. Xu, S. Klasa, and A. L. Yuille, "Recent advances on techniques static feedforward networks with supervised learning," Int. J. Neural Syst., vol. 3, pp. 253-290, 1992.
37. L. Xu, A. Krzyzak, and E. Oja, "Rival penalized competitive learning for clustering analysis, RBF net, and curve detection," IEEE Trans. Neural Networks, vol. 4, pp. 636-649, July 1993.
38. L. Xu, A. Krzyżak, and A. L. Yuille, "On radial basis function nets and kernel regression: Approximation ability, convergence rate, and receptive field size," Neural Networks, vol. 7, pp. 609-628, 1994.