Further results on the Bellman equation for optimal control problems with exit times and nonnegative Lagrangians

Systems and Control Letters

Volumn 50, Issue 1, 2003, Pages 65-79

  Malisoff, Michael ^a  

^a LOUISIANA STATE UNIVERSITY   (United States)

Author keywords

Asymptotics of trajectories; Fuller problem; Optimal control; Viscosity solutions

Indexed keywords

FUNCTIONS; LYAPUNOV METHODS; TRAJECTORIES; VISCOSITY;

BELLMAN EQUATION;

OPTIMAL CONTROL SYSTEMS;

EID: 0042623685     PISSN: 01676911     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-6911(03)00130-0     Document Type: Article

References (24)

1. Bardi M., Capuzzo-Dolcetta I. Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations. 1997;Birkhäuser, Boston.
2. Bardi M., Da Lio F. On the Bellman equation for some unbounded control problems. NoDEA Nonlinear Differential Equations Appl. 4:1997;491-510.
3. M. Bardi, T.E.S. Raghavan, T. Parthasarathy (Eds.), Stochastic and Differential Games: Theory and Numerical Methods, Birkhäuser, Boston, 1999.
4. Bardi M., Soravia P. Hamilton-Jacobi equations with singular boundary conditions on a free boundary and applications to differential games. Trans. Amer. Math. Soc. 325:1991;205-229.
5. Camilli F., Grüne L., Wirth F. A generalization of Zubov's method to perturbed systems. SIAM J. Control Optim. 40:2001;496-515.
6. Camilli F., Siconolfi A. Maximal subsolutions for a class of degenerate Hamilton-Jacobi problems. Indiana Univ. Math. J. 48:1999;1111-1131.
7. Cannarsa P., Da Prato G. Nonlinear optimal control with infinite horizon for distributed parameter systems and stationary Hamilton-Jacobi equations. SIAM J. Control Optim. 27:1989;861-875.
8. Clarke F., Ledyaev Yu., Stern R., Wolenski P. Nonsmooth Analysis and Control Theory. 1998;Springer, New York.
9. Da Lio F. On the Bellman equation for infinite horizon problems with unbounded cost functional. Appl. Math. Optim. 41:1999;171-197.
10. Desch W., Longemann H., Ryan E.P., Sontag E.D. Meagre functions and asymptotic behavior of dynamical systems. Nonlinear Analysis. 44:2001;1087-1109.
11. Fleming W.H., Soner H.M. Controlled Markov Processes and Viscosity Solutions. 1993;Springer, New York.
12. Malisoff M. Viscosity solutions of the Bellman equation for exit time optimal control problems with non-Lipschitz dynamics. ESAIM: Control Optim. Calculus of Variations. 6:2001;415-441.
13. Malisoff M. Viscosity solutions of the Bellman equation for exit time optimal control problems with vanishing Lagrangians. SIAM J. Control Optim. 40:2002;1358-1383.
14. M. Malisoff, Bounded-from-below solutions of the Hamilton-Jacobi equation for optimal control problems with exit times: vanishing Lagrangians, eikonal equations, and shape-from-shading, NoDEA Nonlinear Differential Equations Appl., to appear. (Preprint at http://www.math.lsu.edu/̃malisoff/research.html.).
15. M. Malisoff, Further results on Lyapunov functions and domains of attraction for perturbed asymptotically stable systems, Dynamics Continuous, Discrete Impulsive Syst. Ser. A: Math. Anal., to appear. (Preprint at http://www.math.lsu.edu/̃malisoff/research.html.).
16. M. Malisoff, H.J. Sussmann, Further results on the Bellman equation for exit time optimal control problems with nonnegative Lagrangians: The case of Fuller's problem, in: Proceedings of the 39th IEEE Conference on Decision and Control, Sydney, Australia, December 2000, pp. 2308-2310.
17. Piccoli B., Sussmann H. Regular synthesis and sufficient conditions for optimality. SIAM J. Control Optim. 39:2000;359-410.
18. Sontag E. Mathematical Control Theory. 2nd Edition:1998;Springer, New York.
19. Soravia P. Pursuit evasion problems and viscosity solutions of Isaacs equations. SIAM J. Control Opt. 31:1993;604-623.
20. Soravia P. Optimality principles and representation formulas for viscosity solutions of Hamilton-Jacobi equations I. equations of unbounded and degenerate control problems without uniqueness Adv. Differential Equations. 4:1999a;275-296.
21. Soravia P. Optimality principles and representation formulas for viscosity solutions of Hamilton-Jacobi equations II. equations of control problems with state constraints Differential Integral Equations. 12:1999b;275-293.
22. Sussmann H.J. A general theorem on local controllability. SIAM J. Control Optim. 25:1987;158-194.
23. H.J. Sussmann, From the Brachystochrone problem to the maximum principle, in: Proceedings of the 35th IEEE Conference on Decision and Control, IEEE, New York, 1996, pp. 1588-1594.
24. Zelikin M.I., Borisov V.F. Theory of Chattering Control with Applications to Astronautics, Robotics, Economics, and Engineering. 1994;Birkhäuser, Boston.