Regularized greedy algorithms for network training with data noise

Computing (Vienna/New York)

Volumn 74, Issue 1, 2005, Pages 1-22

  Burger, M ^a,b   Hofinger, A ^a,b  

^a Johannes Kepler University Linz ^*

^b JOHANNES KEPLER UNIVERSITY LINZ   (Austria)

Author keywords

Data noise; Greedy approximation; Neural networks; Regularization; Training

Indexed keywords

DATA NOISE; GREEDY APPROXIMATION; NETWORK TRAINING; REGULARIZATION; SOBOLEV-SPACES;

ALGORITHMS; APPROXIMATION THEORY; ASYMPTOTIC STABILITY; CONVERGENCE OF NUMERICAL METHODS; PARAMETER ESTIMATION; PERTURBATION TECHNIQUES; PROBLEM SOLVING; SPURIOUS SIGNAL NOISE;

NEURAL NETWORKS;

EID: 13744264080     PISSN: 0010485X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00607-004-0081-3     Document Type: Article

References (14)

1. Barron, A. R.: Universal approximation bounds for superpositions of a sigmoidal function. IEEE Trans. Information Theory 39(3), 930-945 (1993).
2. Bodenhofer, U. Burger, M., Engl, H. W., Haslinger, J.: Regularized data-driven construction of fuzzy controller. J. Inverse Ill-posed Problems 10, 319-344 (2002).
3. Burger, M., Engl, H. W.: Training neural networks with noisy data as an ill-posed problem. Adv. Comput. Math. 13, 335-354 (2000).
4. Burger, M., Hofinger, A.: Regularized greedy algorithms for neural network training with data noise. SFB Report 03-4, Johannes-Kepler-University Linz, SFB "Numerical and Symbolic Scientific Computing," (2003).
5. Burger, M., Neubauer, A.: Analysis of Tikhonov regularization for function approximation by neural networks. Neural Networks 16, 79-90 (2003).
6. Dingankar, A. T., Sandberg, I. W.: A note on error bounds for approximation in inner product spaces. Circuits, Systems Signal Processing 15(4), 519-522 (1996).
7. Engl, H. W., Hanke, M., Neubauer, A.: Regularization of inverse problems. Dordrecht: Kluwer 1996.
8. Hofinger, A.: Iterative regularization and training of neural networks. Master's thesis, University of Linz 2003.
9. Hornik, K., Stinchcombe, M., White, H.: Multilayer feedforward networks are universal approximators. Neural Networks 2, 359-366 (1989).
10. Jones, L. K.: A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training. Ann. Stat. 20, 608-613 (1992).
11. Linde, W.: Infinitely divisible and stable measures on banach spaces. Leipzig: Teubner 1983.
12. Lions J. L., Magenes, E.: Non-homogeneous boundary value problems and applications, vol. 1. Berlin Heidelberg: Springer 1972.
13. Sjöberg, J., Zhang, Q., Ljung, L., Benveniste, A., Deylon, B., Glorennec, P.-Y., Hjalmarsson, H., Juditsky, A.: Nonlinear black-box modeling in system identification: a unified overview. Automatica 31 (12), 1691-1724 (1995).
14. Werner, D.: Funktionalanalysis. Berlin Heidelberg: Springer 1995.