Universal Approximation to Nonlinear Operators by Neural Networks with Arbitrary Activation Functions and Its Application to Dynamical Systems

IEEE Transactions on Neural Networks

Volumn 6, Issue 4, 1995, Pages 911-917

  Chen, Tianping ^a   Chen, Hong ^b  

^a FUDAN UNIVERSITY   (China)

^b SUN MICROSYSTEMS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; COMPUTATIONAL METHODS; COMPUTER SIMULATION; FUNCTIONS; IDENTIFICATION (CONTROL SYSTEMS); MATHEMATICAL OPERATORS; POLYNOMIALS; SET THEORY;

ARBITRARY ACTIVATION FUNCTIONS; BANACH SPACE; DYNAMICAL SYSTEMS; NONLINEAR OPERATORS; TAUBER WIENER FUNCTION;

NEURAL NETWORKS;

EID: 0029343809     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.392253     Document Type: Article

References (19)

1. A. Wieland and R. Leighten, “Geometric analysis of neural network capacity,” in Proc. IEEE First ICNN. 1, 1987, pp. 385-392.
2. B. Irie and S. Miyake, “Capacity of three-layered perceptrons,” in Proc. IEEE ICNN I, 1988, pp. 641-648.
3. G. Cybenko, “Approximation by superpositions of a sigmoidal function,” Math. Contr., Signals Syst., vol. 2, no. 4, pp. 303-314, 1989.
4. S. M. Carroll and B. W. Dickinson, “Construction of neural nets using radon transform,” in Proc. IJCNN Proc. I, 1989, pp. 607-611.
5. K. Funahashi, “On the approximate realization of continuous mappings by neural networks,” Neural Networks, vol. 2, pp. 183-192, 1989.
6. K. Hornik, M. Stinchcombe, and H. White, “Multi-layer feedforward networks are universal approximators,” Neural Networks, vol. 2, pp. 359-366, 1989.
7. K. Hornik, “Approximation capabilities of multilayer feedforward networks,” Neural Networks, vol. 4, pp. 251-257, 1991.
8. V. Y. Kreinovich, “Arbitrary nonlinearity is sufficient to represent all functions by neural networks: A theorem,” Neural Networks, vol. 4, pp. 381-383, 1991.
9. T. Chen, H. Chen, and R. Liu, “A constructive proof of Cybenko's approximation theorem and its extensions,” pp. 163-168 in Proc. 22nd Symp. Interface, East Lansing, Michigan, May 1990. Also submitted for publication.
10. I. W. Sandberg, “Approximation theorems for fiscrete-time systems,” IEEE Trans. Circuits Syst., vol. 38, no. 5, pp. 564-566, May 1991.
11. “Approximations for nonlinear functionals,” IEEE Trans. Circuits Syst., vol. 39, no. 1, pp. 65-67, Jan. 1992.
12. H. N. Mhaskar and C. A. Micchelli, “Approximation by superposition of sigmoidal and radial basis functions,” Advances Applied Mathematics, vol. 13, 350-373, 1992.
13. T. Chen and H. Chen, “Approximation to continuous functionals by neural networks with application to dynamical systems,” accepted by IEEE Trans. Neural Networks, vol. 4, no. 6, Nov. 1993.
14. E. M. Stein and G. Weiss, Introduction to Fourier Analysis on Euclidean Spaces. Princeton, NJ: Princeton Univ. Press, 1971.
15. E. M. Stein, Singular Integrals and Differentiability Properties of Functions. Princeton, NJ: Princeton Univ. Press, 1970.
16. J. Diedonne, Foundation of Modern Analysis. New York and London: Academic, 1969, p. 142.
17. K. S. Narendra and K. Parthasarathy, “Identification and control of dynamic systems using neural networks,” IEEE Trans. Neural Networks, vol. 1, pp. 4-27, 1990.
18. “Gradient methods for optimization of dynamical systems containing neural networks,” IEEE Trans. Neural Networks, vol. 2, pp. 252-262, 1991.
19. T. Chen, H. Chen, and R. Liu, “Approximation capability in CRn by multilayer feedforward networks and related problems,” IEEE Trans. Neural Networks, vol. 6, no. 1, Jan. 1995.