Multilayer perceptrons: Approximation order and necessary number of hidden units

IEEE Transactions on Neural Networks

Volumn 19, Issue 5, 2008, Pages 836-844

  Trenn, Stephan ^a  

^a ILMENAU UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Approximation; Multilayer perceptron (MLP); Necessary number of hidden units

Indexed keywords

APPROXIMATION THEORY; NONLINEAR SYSTEMS; POLYNOMIALS;

APPROXIMATION ORDER; MULTIVARIABLE FUNCTIONS; NECESSARY NUMBER OF HIDDEN UNITS;

MULTILAYER NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGY; NONLINEAR SYSTEM;

ALGORITHMS; BIOLOGY; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 44349150545     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.912306     Document Type: Article

References (18)

1. S. Haykin, Neural Networks, J. Griffin, Ed. New York: Macmillan, 1994.
2. M. Nørgaard, O. Ravn, N. Poulsen, and L. Hansen, Neural Networks for Modelling and Control of Dynamic Systems, ser. Advanced Textbooks in Control and Signal Processing, M. Grimble and M. Johnson, Eds. London, U.K.: Springer-Verlag, 2000.
3. F. Lewis, J. Huang, T. Parisini, D. Prokhorov, and D. Wunsch, "Guest editorial: Special issue on neural networks for feedback control systems," IEEE Trans. Neural Netw., vol. 18, no. pp. 969-972, Jul. 2007.
4. H. Strobel, Experimentelle Systemanalyse. Berlin, Germany: Akademie Verlag, 1975.
5. J. Wernstedt, Experimentelle Prozessanalvse. Berlin, Germany: Verlag Technik/Oldenbourg Verlag, 1989.
6. Sl Billings, H. Jamaluddin, and S. Chen, "Properties of neural networks with applications to modelling non-linear dynamics," Int. J. Control vol. 55, no. 1, pp. 193-224, 1992.
7. O. Otto, "Identifikation nichtlinearer Systeme mit künstlichen neuronalen Netzen," Automatisierungstechnik, vol. 43, no. 2, pp. 62-68, 1995.
8. A. Pinkus, "Approximation theory of the MLP model in neural network," Acta Numerica, vol. 9, pp. 143-195, 1999.
9. A. Barren, "Approximation and estimation bounds ior artificial neural networks," Mach. Learn., vol. 14, p. 115-133, 1994.
10. T. Ludermir, A. Yamazaki, and C. Zanchettin, "An optimization methodology for neural network weights and architectures," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1452-1459, Nov. 2006.
11. E. Tech, K. Tan, and C. Xiang, "Estimating the number ot hidden neurons in a feedforward network using the singular value decomposition," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1623-1629, Nov. 2006.
12. A. Pinkus, private, comminucation 2006.
13. H. Amann and J. Escher, Analysis II. Berlin, Germany: Birkhäuser Verlag, 1999.
14. H. Amann and J. Escher, Analysis I. Berlin, Germany: Birkhäuser Verlag, 1998.
15. H. Sagan, Space-Filling Curves, J. Ewing, F. Gehring, and P. Halmos, Eds. New York: Springer-Verlag, 1994.
16. S. Trenn, "Quatitative analysis of neural networks as universal function approximators," M.S. Diplomarbiet, Fakultät für Informatik und Automatisierung, Technishce Universität Ilmenau, Ilmenau, Germany, Sep. 2006.
17. J. Merker, Private communication 2006.
18. R. Abraham, J. Marsden, and T. Ratiu, Manifolds, Tensor Analysis and Applications, Ser. Applied Mathematical Sciences no. 75, F. John, J. Marsden, and L. Sirovich, Eds., 2nd ed. New York: Springer-Verlag, 1988.