On the Relation between Discounted and Average Optimal Value Functions

Journal of Differential Equations

Volumn 148, Issue 1, 1998, Pages 65-99

  Grüne, Lars ^a  

^a GOETHE UNIVERSITY   (Germany)

Author keywords

Deterministic nonlinear optimal control; discounted optimal control; average optimal control; morse decomposition; viable sets; chain control sets; Control sets

Indexed keywords

EID: 0001893646     PISSN: 00220396     EISSN: None     Source Type: Journal    
DOI: 10.1006/jdeq.1998.3451     Document Type: Article

References (28)

1. Akin E. The General Topology of Dynamical Systems. Graduate Studies in Mathematics. 1:1993.
2. Arapostathis A., Borkar V., Fernandez-Gaucherand E., Ghosh M., Marcus S. Discrete-time controlled markov processes with average cost criterion: A survey. SIAM J. Control Optim. 31:1993;282-344.
3. Arisawa M. Le problème ergodique pour les équations de Hamilton-Jacobi-Bellman. 1996;Université Paris IX Dauphine.
4. Arisawa M. Some ergodic problems for Hamilton-Jacobi equations in Hilbert space. Differential Integral Equations. 9:1996;59-70.
5. Cannarsa P., Frankowska H. Some characterizations of optimal trajectories in control theory. SIAM J. Control Optim. 29:1991;1322-1347.
6. I. Capuzzo, Dolcetta, M. Falcone, Discrete dynamic programming and viscosity solutions of the Bellman equation, Ann. Inst. H. Poincaré, Anal. Non Linéaire, 6, 1989, 161, 184.
7. Dolcetta I. Capuzzo, Ishii H. Approximate solutions of the Bellman equation of deterministic control theory. Appl. Math. Optim. 11:1984;161-181.
8. Colonius F. Asymptotic behaviour of optimal control systems with low discount rates. Math. Oper. Res. 14:1989;309-316.
9. Colonius F., Kliemann W. Infinite time optimal control and periodicity. Appl. Math. Optim. 20:1989;113-130.
10. Colonius F., Kliemann W. Maximal and minimal Lyapunov exponents of bilinear control systems. J. Differential Equations. 101:1993;232-275.
11. Colonius F., Kliemann W. Some aspects of control systems as dynamical systems. J. Dynam. Differential Equations. 5:1993.
12. Colonius F., Kliemann W. Asymptotic null controllability of bilinear systems. Geometry in Nonlinear Control and Differential Inclusions. 1995;Banach Center Publ. Warsaw. p. 139-148.
13. Colonius F., Kliemann W. The Lyapunov spectrum of families of time varying matrices. Trans. Amer. Math. Soc. 348:1996;4389-4408.
14. F. Colonius, W. Kliemann, The Dynamics of Control, Birkhäuser, Basel.
15. Conley C. Isolated Invariant Sets and the Morse Index. CBMS Regional Conference Series. 38:1978;Am. Math. Soc.
16. Falcone M., Digrisolo A. An Approximation Scheme for Optimal Control Problems with State Constraints. 1992;Università degli Studi di Roma "La Sapienza"Dipartimento di Matematica "Guido Castelnuovo"
17. Grüne L. Discrete feedback stabilization of semilinear control systems. ESAIM: Control, Optimisation and Calculus of Variations. 1:1996;207.
18. Grüne L. Numerical stabilization of bilinear control systems. SIAM J. Control Optim. 34:1996;2024-2050.
19. Grüne L. An adaptive grid scheme for the discrete Hamilton-Jacobi-Bellman equation. Numer. Math. 75:1997;319-337.
20. Grüne L. Asymptotic controllability and exponential stabilization of nonlinear control systems at singular points. SIAM J. Control Optim. 1998.
21. Hurley M. Chain recurrence and attraction in non-compact spaces. Ergodic Theory Dyn. System. 11:1991;709-729.
22. Isidori A. Nonlinear Control Systems: An Introduction. 1989;Springer-Verlag, Berlin.
23. Lions P. L. Generalized Solutions of Hamilton-Jacobi Equations. 1982;Pitman, London.
24. Lions P. L. Neumann type boundary conditions for Hamilton-Jacobi Equations. Duke Math. J. 52:1985;793-820.
25. Simon B. Functional Integration and Quantum Physics. 1979;Academic Press, San Diego.
26. Soner H. M. Optimal control problems with state-space constraint I. SIAM J. Cont. Optim. 24:1986;552-561.
27. Wirth F. Convergence of the value functions of discounted infinite horizon optimal control problems with low discount rates. Math. Oper. Res. 18:1993;1006-1019.
28. Yushkevich A. A note on asymptotics of discounted value function and strong 0-discount optimality. Math. Methods Oper. Res. 44:1996;223-231.