Approximation schemes for functional optimization problems

Journal of Optimization Theory and Applications

Volumn 140, Issue 1, 2009, Pages 33-54

  Giulini, S ^a   Sanguineti, M ^a  

^a UNIVERSITY OF GENOA   (Italy)

Author keywords

Approximation schemes; Complexity of admissible solutions; Curse of dimensionality; Extended Ritz method; Functional optimization; Ritz method; Upper bounds on accuracy

Indexed keywords

APPROXIMATION THEORY;

APPROXIMATION SCHEME; COMPLEXITY OF ADMISSIBLE SOLUTION; CURSE OF DIMENSIONALITY; EXTENDED RITZ METHOD; FUNCTIONAL OPTIMIZATION; FUNCTIONAL OPTIMIZATION PROBLEM; RITZ METHODS; UPPER BOUND; UPPER BOUND ON ACCURACY;

OPTIMIZATION;

EID: 58149492837     PISSN: 00223239     EISSN: 15732878     Source Type: Journal    
DOI: 10.1007/s10957-008-9471-6     Document Type: Article

References (41)

1. Gelfand, I.M., Fomin, S.V.: Calculus of Variations. Prentice-Hall, Englewood Cliffs (1963)
2. V. Kůrková M. Sanguineti 2005 Error estimates for approximate optimization by the extended Ritz method SIAM J. Optim. 15 461 487
3. R. Zoppoli M. Sanguineti T. Parisini 2002 Approximating networks and extended Ritz method for the solution of functional optimization problems J. Optim. Theory Appl. 112 403 440
4. V. Kůrková M. Sanguineti 2002 Comparison of worst case errors in linear and neural network approximation IEEE Trans. Inf. Theory 48 264 275
5. Bellman, R.: Dynamic Programming. Princeton University Press, Princeton (1957)
6. A.R. Barron 1993 Universal approximation bounds for superpositions of a sigmoidal function IEEE Trans. Inf. Theory 39 930 945
7. L. Breiman 1993 Hinging hyperplanes for regression, classification, and function approximation IEEE Trans. Inf. Theory 39 999 1013
8. Girosi, F.: Regularization theory, radial basis functions and networks. In: Cherkassky, V., Friedman, J.H., Wechsler, H. (eds.) From Statistics to Neural Networks. Theory and Pattern Recognition Applications, Subseries F, pp. 166-187. Springer, Berlin (1994)
9. Girosi, F., Anzellotti, G.: Rates of convergence for radial basis functions and neural networks. In: Mammone, R.J. (ed.) Artificial Neural Networks for Speech and Vision, pp. 97-113. Chapman & Hall, London (1993)
10. F. Girosi M. Jones T. Poggio 1995 Regularization theory and neural networks architectures Neural Comput. 7 219 269
11. L.K. Jones 1992 A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training Ann. Stat. 20 608 613
12. P.C. Kainen V. Kůrková M. Sanguineti 2003 Minimization of error functionals over variable-basis functions SIAM J. Optim. 14 732 742
13. P.C. Kainen V. Kůrková M. Sanguineti 2008 Complexity of Gaussian radial basis networks approximating smooth functions J. Complex. 10.1016/j.jco.2008.08.001
14. Kůrková, V.: Dimension-independent rates of approximation by neural networks. In: Warwick, K., Kárný, M. (eds.) Computer-Intensive Methods in Control and Signal Processing: The Curse of Dimensionality, pp. 261-270. Birkhäuser, Boston (1997)
15. V. Kůrková M. Sanguineti 2001 Bounds on rates of variable-basis and neural-network approximation IEEE Trans. Inf. Theory 47 2659 2665
16. Kůrková, V., Sanguineti, M.: Geometric upper bounds on rates of variable-basis approximation, IEEE Trans. Inf. Theory (to appear)
17. H.N. Mhaskar 1996 Neural networks for optimal approximation of smooth and analytic functions Neural Comput. 8 164 177
18. Alessandri, A., Parisini, T., Sanguineti, M., Zoppoli, R.: Neural strategies for nonlinear optimal filtering. In: Proc. of IEEE Int. Conf. on Syst. Eng., Kobe, Japan, pp. 44-49 (1992)
19. Zoppoli, R., Parisini, T.: Learning techniques and neural networks for the solution of N-stage nonlinear nonquadratic optimal control problems. In: Isidori, A., Tarn, T.J. (eds.) Systems, Models and Feedback: Theory and Applications, pp. 193-210. Birkhäuser, Boston (1992)
20. Zoppoli, R., Parisini, T., Baglietto, M., Sanguineti, M.: Neural Approximations for Optimal Control and Decision. Springer, London (in preparation)
21. Dontchev, A.L., Zolezzi, T.: Well-Posed Optimization Problems. Lecture Notes in Mathematics, vol. 1543. Springer, Berlin (1993)
22. Pinkus, A.: n-Widths in Approximation Theory. Springer, New York (1986)
23. Haykin, S.: Neural Networks: A Comprehensive Foundation. MacMillan, New York (1994)
24. A. Alessandri M. Sanguineti 2005 Optimization of approximating networks for optimal fault diagnosis Optim. Methods Softw. 20 235 260
25. A. Alessandri C. Cervellera M. Sanguineti 2007 Functional optimal estimation problems and their approximate solution J. Optim. Theory Appl. 134 445 466
26. A. Alessandri C. Cervellera M. Sanguineti 2007 Design of asymptotic estimators: An approach based on neural networks and nonlinear programming IEEE Trans. Neural Netw. 18 86 96
27. Singer, I.: Best Approximation in Normed Linear Spaces by Elements of Linear Subspaces. Springer, Berlin (1970)
28. A. Alessandri M. Cuneo S. Pagnan M. Sanguineti 2007 A recursive algorithm for nonlinear least-squares problems Comput. Optim. Appl. 38 195 216
29. A. Alessandri M. Sanguineti M. Maggiore 2002 Optimization-based learning with bounded error for feedforward neural networks IEEE Trans. Neural Netw. 13 261 273
30. D.P. Bertsekas 1997 A new class of incremental gradient methods for least squares problems SIAM J. Optim. 7 913 926
31. Chow, T.W.S., Cho, S.-Y.: Neural Networks and Computing: Learning Algorithms and Applications. World Scientific, Singapore (2007)
32. A. Pinkus 1999 Approximation theory of the MLP model in neural networks Acta Numer. 8 143 196
33. M. Sanguineti 2008 Universal approximation by ridge computational models: A survey Open Appl. Math. J. 2 31 58
34. J. Park I.W. Sandberg 1991 Universal approximation using radial-basis-function networks Neural Comput. 3 2 246 257
35. Friedman, A.: Foundations of Modern Analysis. Dover, New York (1982)
36. Stein, E.M.: Harmonic Analysis: Real-Variable Methods, Orthogonality, and Oscillatory Integrals. Princeton University Press, Princeton (1993)
37. Courant, R.: Differential and Integral Calculus, vol. II. Wiley-Interscience, New York (1988)
38. Adams, R.A.: Sobolev Spaces. Academic Press, New York (1975)
39. Stein, E.M.: Singular Integrals and Differentiability Properties of Functions. Princeton University Press, Princeton (1970)
40. Lebedev, N.N.: Special Functions and Their Applications. Dover, New York (1972)
41. T. Zolezzi 2007 Condition numbers and Ritz type methods in unconstrained optimization Control Cybern. 36 811 822