On the approximation by neural networks with bounded number of neurons in hidden layers

Journal of Mathematical Analysis and Applications

Volumn 417, Issue 2, 2014, Pages 963-969

  Ismailov, Vugar E ^a  

^a INSTITUTE OF PHYSICS   (Azerbaijan)

Author keywords

Approximation; MLP model; Neural network; Sigmoidal function; Superposition

Indexed keywords

EID: 84899078982     PISSN: 0022247X     EISSN: 10960813     Source Type: Journal    
DOI: 10.1016/j.jmaa.2014.03.092     Document Type: Article

References (28)

1. Arnold V.I. On functions of three variables. Dokl. Akad. Nauk SSSR. Amer. Math. Soc. Transl. 1963, 28:51-54. English transl.:.
2. Barron A.R. Approximation and estimation bounds for artificial neural networks. Mach. Learn. 1994, 14:115-133.
3. Cao F., Xie T., Xu Z. The estimate for approximation error of neural networks: a constructive approach. Neurocomputing 2008, 71:626-630.
4. Chen T., Chen H. Approximation of continuous functionals by neural networks with application to dynamic systems. IEEE Trans. Neural Networks 1993, 4:910-918.
5. Chui C.K., Li X. Approximation by ridge functions and neural networks with one hidden layer. J. Approx. Theory 1992, 70:131-141.
6. Cybenko G. Approximation by superpositions of a sigmoidal function. Math. Control Signals Systems 1989, 2:303-314.
7. Fridman B.L. An improvement in the smoothness of the functions in A.N. Kolmogorov's theorem on superpositions. Dokl. Akad. Nauk SSSR 1967, 177:1019-1022. (in Russian).
8. Girosi F., Poggio T. Representation properties of networks: Kolmogorov's theorem is irrelevant. Neural Comput. 1989, 1:465-469.
9. Hecht-Nielsen R. Kolmogorov's mapping neural network existence theorem. Proc. Intl. Conf. Neural Networks ICNN 1987, vol. 3 1987, 11-14.
10. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks 1991, 4:251-257.
11. Ismailov V.E. On the representation by linear superpositions. J. Approx. Theory 2008, 151:113-125.
12. Ismailov V.E. Approximation by neural networks with weights varying on a finite set of directions. J. Math. Anal. Appl. 2012, 389:72-83.
13. Ito Y. Approximation of continuous functions on Rd by linear combinations of shifted rotations of a sigmoid function with and without scaling. Neural Networks 1992, 5:105-115.
14. Kahane J. Sur le theoreme de superposition de Kolmogorov. J. Approx. Theory 1975, 13:229-234. collection of articles dedicated to G.G. Lorentz on the occasion of his sixty-fifth birthday, III, (in French).
15. Khavinson S.Ya. Best Approximation by Linear Superpositions (Approximate Nomography). Transl. Math. Monogr. 1997, vol. 159. translated from the Russian manuscript by D. Khavinson, American Mathematical Society, Providence, RI, 175 pp.
16. Kolmogorov A.N. On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition. Dokl. Akad. Nauk SSSR 1957, 114:953-956. (in Russian).
17. Kůrkova V. Kolmogorov's theorem is relevant. Neural Comput. 1991, 3:617-622.
18. Kůrkova V. Kolmogorov's theorem and multilayer neural networks. Neural Networks 1992, 5:501-506.
19. Leshno M., Lin V.Ya., Pinkus A., Schocken S. Multilayer feedforward networks with a non-polynomial activation function can approximate any function. Neural Networks 1993, 6:861-867.
20. Lin V.Ya., Pinkus A. Fundamentality of ridge functions. J. Approx. Theory 1993, 75:295-311.
21. Lorentz G.G. Metric entropy, widths, and superpositions of functions. Amer. Math. Monthly 1962, 69:469-485.
22. Maiorov V., Pinkus A. Lower bounds for approximation by MLP neural networks. Neurocomputing 1999, 25:81-91.
23. Ostrand P.A. Dimension of metric spaces and Hilbert's problem $13$. Bull. Amer. Math. Soc. 1965, 71:619-622.
24. Pinkus A. Approximation theory of the MLP model in neural networks. Acta Numer. 1999, 8:143-195.
25. Sprecher D.A. On the structure of continuous functions of several variables. Trans. Amer. Math. Soc. 1965, 115:340-355.
26. Sprecher D.A. An improvement in the superposition theorem of Kolmogorov. J. Math. Anal. Appl. 1972, 38:208-213.
27. Sternfeld Y. Uniformly separating families of functions. Israel J. Math. 1978, 29:61-91.
28. Sternfeld Y. Dimension, superposition of functions and separation of points, in compact metric spaces. Israel J. Math. 1985, 50:13-53.