Functional optimal estimation problems and their solution by nonlinear approximation schemes

Journal of Optimization Theory and Applications

Volumn 134, Issue 3, 2007, Pages 445-466

  Alessandri, A ^a   Cervellera, C ^b   Sanguineti, M ^a  

^a UNIVERSITY OF GENOA   (Italy)

^b INSTITUTE OF INTELLIGENT SYSTEMS FOR AUTOMATION   (Italy)

Author keywords

Infinite dimensional optimization; Low discrepancy sequences; Nonlinear approximation schemes; Nonlinear programming; Optimal estimation

Indexed keywords

APPROXIMATION THEORY; COST FUNCTIONS; DYNAMICAL SYSTEMS; FUNCTIONAL PROGRAMMING; NONLINEAR ANALYSIS; NONLINEAR DYNAMICAL SYSTEMS;

APPROXIMATION SCHEME; COST FUNCTIONALS; ESTIMATION ERRORS; INFINITE DIMENSIONAL; INFINITE-DIMENSIONAL OPTIMIZATION; LOW-DISCREPANCY SEQUENCES; NONLINEAR APPROXIMATION; NONLINEAR APPROXIMATION SCHEME; OPTIMAL ESTIMATIONS; OPTIMISATIONS;

NONLINEAR PROGRAMMING;

EID: 36049025849     PISSN: 00223239     EISSN: 15732878     Source Type: Journal    
DOI: 10.1007/s10957-007-9229-6     Document Type: Article

References (37)

1. Walcott, B.L., Corless, M.J., Zak, S.H.: Comparative study of nonlinear state-observation techniques. Int. J. Control 45, 2109-2132 (1987)
2. Misawa, E.A., Hedrick, J.K.: Nonlinear observers-a state-of-the-art survey. J. Dyn. Syst. Meas. Control 111, 344-352 (1989)
3. Jazwinski, A.H.: Stochastic Processes and Filtering Theory. Academic, New York (1970)
4. Carravetta, F., Germani, A., Raimondi, M.: Polynomial filtering of discrete-time linear systems with multiplicative state noise. IEEE Trans. Autom. Control 42, 1106-1126 (1997)
5. Alessandri, A., Parisini, T., Zoppoli, R.: Neural approximators for finite-memory state estimation. Int. J. Control 67, 275-302 (1997)
6. Alessandri, A., Baglietto, M., Parisini, T., Zoppoli, R.: A neural state estimator with bounded errors for nonlinear systems. IEEE Trans. Autom. Control 44, 2028-2042 (1999)
7. Alessandri, A., Cervellera, C., Sanguineti, M.: Design of asymptotic estimators: an approach based on neural networks and nonlinear programming. IEEE Trans. Neural Netw. 18, 86-96 (2007)
8. Alessandri, A., Sanguineti, M.: Input-output stability for optimal estimation problems. Int. Math. Forum 2, 593-617 (2007)
9. Kůrková, V., Sanguineti, M.: Bounds on rates of variable-basis and neural-network approximation. IEEE Trans. Inf. Theory 47, 2659-2665 (2001)
10. Kůrková, V., Sanguineti, M.: Comparison of worst-case errors in linear and neural network approximation. IEEE Trans. Inf. Theory 48, 265-275 (2002)
11. Kainen, P.C., Kůrková, V., Sanguineti, M.: Minimization of error functionals over variable-basis functions. SIAM J. Optim. 14, 732-742 (2003)
12. Zoppoli, R., Sanguineti, M., Parisini, T.: Approximating networks and the extended Ritz method for the solution of functional optimization problems. J. Optim. Theory Appl. 112, 403-439 (2002)
13. Kůrková, V., Sanguineti, M.: Error estimates for approximate optimization by the extended Ritz method. SIAM J. Optim. 15, 461-487 (2005)
14. Kůrková, V., Sanguineti, M.: Learning with generalization capability by kernel methods of bounded complexity. J. Complex. 21, 350-367 (2005)
15. Niederreiter, H.: Random Number Generation and Quasi-Monte Carlo Methods. SIAM, Philadelphia (1992)
16. Fang, K.-T., Wang, Y.: Number-Theoretic Methods in Statistics. Chapman & Hall, London (1994)
17. Cervellera, C., Muselli, M.: Deterministic design for neural network learning: an approach based on discrepancy. IEEE Trans. Neural Netw. 15, 533-544 (2004)
18. Cervellera, C., Muselli, M.: Efficient sampling in approximate dynamic programming algorithms. Comput. Optim. Appl. (to appear)
19. Cervellera, C., Chen, V.C., Wen, A.: Optimization of a large-scale water reservoir network by stochastic dynamic programming with efficient state space discretization. Eur. J. Oper. Res. 171, 1139-1151 (2006)
20. Khalil, H.K.: Nonlinear Systems. Prentice-Hall, Upper Saddle River (2002)
21. Xia, X., Gao, W.: On exponential observers for nonlinear systems. Syst. Control Lett. 11, 319-325 (1988)
22. ∞ Nonlinear filtering. Int. J. Robust Nonlinear Control 6, 281-296 (1996)
23. Leshno, M., Lin, Y.V., Pinkus, A., Schocken, S.: Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Netw. 6, 861-867 (1993)
24. Kůrková, V.: Approximation of functions by perceptron networks with bounded number of hidden units. Neural Netw. 8, 745-750 (1995)
25. Park, J., Sandberg, I.W.: Universal approximation using radial-basis-function networks. Neural Comput. 3, 246-257 (1991)
26. Girosi, F.: Regularization theory, radial basis functions and networks. In: From Statistics to Neural Networks. Theory and Pattern Recognition Applications, Subseries F, Computer and Systems Sciences, pp. 166-187. Springer, New York (1994)
27. Sussmann, H.J.: Uniqueness of the weights for minimal feedforward nets with a given input-output map. Neural Netw. 5, 589-593 (1992)
28. Adams, R.A., Fournier, J.J.F.: Sobolev Spaces, 2nd edn. Academic, Amsterdam (2003)
29. Daniel, J.W.: The Approximate Minimization of Functionals. Prentice-Hall, Englewood Cliffs (1971)
30. Gelfand, I.M., Fomin, S.V.: Calculus of Variations. Prentice-Hall, Englewood Cliffs (1963)
31. Kleinman, D.L., Athans, M.: The design of suboptimal linear time-varying systems. IEEE Trans. Autom. Control 13, 150-159 (1968)
32. Hammersley, J.M., Handscomb, D.C.: Monte Carlo Methods. Methuen, London (1964)
33. Chung, K.L.: An estimate concerning the Kolmogoroff limit distribution. Trans. Am. Math. Soc. 67, 36-50 (1949)
34. Bertsekas, D.P.: Nonlinear Programming. Athena Scientific, Belmont (2003), 2nd printing
35. Yu, S., Annaswamy, A.M.: Stable neural controllers for nonlinear dynamic systems. Automatica 34(5), 641-650 (1998)
36. Sobol', I.M.: The distribution of points in a cube and the approximate evaluation of integrals. USSR Comput. Math. Math. Phys. 7, 86-112 (1967)
37. Bobylev, N.A., Emel'yanov, S.V., Korovin, S.K.: Geometrical Methods in Variational Problems. Kluwer, Dordrecht (1999)