Approximation by series of sigmoidal functions with applications to neural networks

Annali di Matematica Pura ed Applicata

Volumn 194, Issue 1, 2015, Pages 289-306

  Costarelli, Danilo ^a   Spigler, Renato ^a  

^a ROMA TRE UNIVERSITY   (Italy)

Author keywords

Multiresolution approximation; Neural networks approximation; Order of approximation; Sigmoidal functions; Truncation error; Wavelet scaling functions

Indexed keywords

EID: 84926311345     PISSN: 03733114     EISSN: 16181891     Source Type: Journal    
DOI: 10.1007/s10231-013-0378-y     Document Type: Article

References (36)

1. Anastassiou, G.A.: Univariate hyperbolic tangent neural network approximation. Math. Comput. Model. 53(5–6), 1111–1132 (2011)
2. Anastassiou, G.A.: Multivariate hyperbolic tangent neural network approximation. Comput. Math. Appl. 61(4), 809–821 (2011)
3. Barron, A.R.: Universal approximation bounds for superpositions of a sigmoidal function. IEEE Trans. Inf. Theory 39(3), 930–945 (1993)
4. Brauer, F., Castillo Chavez, C.: Mathematical Models in Population Biology and Epidemiology. Springer, New York (2001)
5. Butzer, P.L., Nessel, R.J.: Fourier Analysis and Approximation. Birkhauser Verlag, Bassel and Academic Press, New York (1971)
6. Butzer, P.L., Splettstößer, W., Stens, R.L.: The sampling theorem and linear prediction in signal analysis. Jahresber. Deutsch. Math.-Verein 90, 1–70 (1988)
7. Buzhabadi, R., Effati, S.: A neural network approach for solving Fredholm integral equations of the second kind. Neural Comput. Appl. 21, 843–852 (2012)
8. Cao, F., Chen, Z.: The approximation operators with sigmoidal functions. Comput. Math. Appl. 58(4), 758–765 (2009)
9. Chen, H., Chen, T., Liu, R.: A constructive proof and an extension of Cybenko’s approximation theorem. In: Computing Science and Statistics, pp. 163–168. Springer, New York (1992)
10. Chen, D.: Degree of approximation by superpositions of a sigmoidal function. Approx. Theory Appl. 9(3), 17–28 (1993)
11. Chui, C.K.: An Introduction to Wavelets, Wavelet Analysis and its Applications 1. Academic Press Inc., Boston (1992)
12. Costarelli, D., Spigler, R.: Solving Volterra integral equations of the second kind by sigmoidal functions approximations, to appear in J. Integral Eq. Appl. 25(2) (2013)
13. Costarelli, D., Spigler, R.: Constructive approximation by superposition of sigmoidal functions. Anal. Theory Appl. 29(2), 169–196 (2013)
14. Costarelli, D., Spigler, R.: Approximation results for neural network operators activated by sigmoidal functions. Neural Netw. 44, 101–106 (2013)
15. Costarelli, D., Spigler, R.: Multivariate neural network operators with sigmoidal activation functions. Neural Netw. 48, 72–77 (2013)
16. Cybenko, G.: Approximation by superpositions of a sigmoidal function. Math. Control Signals Syst. 2, 303–314 (1989)
17. Daubechies, I.: Ten Lectures on Wavelets, Regional Conference Series in Applied Mathematics 61. Society for Industrial and Applied Mathematics, SIAM, Philadelphia (1992)
18. De Boor, C.: A Practical Guide to Spline, Applied Mathematical Sciences 27. Springer, New York (2001)
19. Gao, B., Xu, Y.: Univariant approximation by superpositions of a sigmoidal function. J. Math. Anal. Appl. 178, 221–226 (1993)
20. Hahm, N., Hong, B.: Approximation order to a function in (Formula presented.) by superposition of a sigmoidal function. Appl. Math. Lett. 15, 591–597 (2002)
21. Hritonenko, N., Yatsenko, Y.: Mathematical Modelling in Economics, Ecology and the Environment. Science Press, Beijing (2006)
22. Jones, L.K.: Constructive approximations for neural networks by sigmoidal functions, Technical Report Series 7. University of Lowell, Dep. of Mathematics (1988)
23. Lenze, B.: Constructive multivariate approximation with sigmoidal functions and applications to neural networks. In: Numer. Methods Approx. Theory, Birkhauser Verlag, Basel-Boston-Berlin, pp. 155–175 (1992)
24. Lewicki, G., Marino, G.: Approximation by superpositions of a sigmoidal function. Z. Anal. Anwendungen J. Anal. Appl. 22(2), 463–470 (2003)
25. Lewicki, G., Marino, G.: Approximation of functions of finite variation by superpositions of a sigmoidal function. Appl. Math. Lett. 17, 1147–1152 (2004)
26. Li, X.: Simultaneous approximations of multivariate functions and their derivatives by neural networks with one hidden layer. Neurocomputing 12, 327–343 (1996)
27. Li, X., Micchelli, C.A.: Approximation by radial bases and neural networks. Numer. Algorithms 25, 241–262 (2000)
28. Malek, A., Shekari Beidokhti, R.: Numerical solution for high order differential equations using a hybrid neural network—optimization method. Appl. Math. Comput. 183, 260–271 (2006)
29. Mallat, S.G.: Multiresolution approximations and wavelet orthonormal bases of (Formula presented.). Trans. Am. Math. Soc. 315, 69–87 (1989)
30. Meyer, Y.: Wavelets and Operators. Cambridge Studies in Advanced Mathematics 37, Cambridge (1992)
31. Mhaskar, H.N., Micchelli, C.A.: Approximation by superposition of sigmoidal and radial basis functions. Adv. Appl. Math. 13, 350–373 (1992)
32. Mhaskar, H.N., Micchelli, C.A.: Degree of approximation by neural and translation networks with a single hidden layer. Adv. Appl. Math. 16, 151–183 (1995)
33. Mhaskar, H.N.: Neural networks for optimal approximation of smooth and analytic functions. Neural Comput. 8, 164–177 (1996)
34. Pinkus, A.: Approximation theory of the MLP model in neural networks. Acta Numer. 8, 143–195 (1999)
35. Unser, M.: Ten good reasons for using spline wavelets. Wavelets Appl. Signal Image Process. 3169(5), 422–431 (1997)
36. Xiehua, S.: On the degree of approximation by wavelet expansions. Approx. Theory Appl. 14(1), 81–90 (1998)