Deterministic near-optimal controls. Part II: Dynamic programming and viscosity solution approach

Mathematics of Operations Research

Volumn 21, Issue 3, 1996, Pages 655-674

  Zhou, Xun Yu ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Adjoint function; Feedback control; Hamiltonian; Near optimal control; Value function; Viscosity solution; superdifferential subdifferential

Indexed keywords

DIFFERENTIAL EQUATIONS; DYNAMIC PROGRAMMING; FEEDBACK CONTROL; FUNCTIONS; OPTIMIZATION; THEOREM PROVING;

DETERMINISTIC NEAR OPTIMAL CONTROLS; VERIFICATION THEOREM; VISCOSITY SOLUTION APPROACH;

OPTIMAL CONTROL SYSTEMS;

EID: 0030205390     PISSN: 0364765X     EISSN: None     Source Type: Journal    
DOI: 10.1287/moor.21.3.655     Document Type: Article

References (27)

1. Barron, E. N., R. Jensen (1986). The Pontryagin maximum principle from dynamic programming and viscosity solutions to first-order partial differential equations. Trans. Amer. Math. Soc. 298 635-641.
2. Bellman, R. (1957). Dynamic Programming, Princeton University Press, Princeton, NJ.
3. Berkovitz, L. D. (1974). Optimal Control Theory, Springer-Verlag, New York.
4. Cannarsa, P., H. Frankowska (1991). Some characterizations of optimal trajectories in control theory. SIAM J. Control Optim. 29 1322-1347.
5. Clarke, F. H. (1973). Necessary conditions for nonsmooth problems in optimal control and the calculus of variations, Ph.D. Thesis, University of Washington, St. Louis.
6. _ (1990). Optimization and Nonsmooth Analysis, SIAM, Philadelphia, PA.
7. _, R. B. Vinter (1987). The relationship between the maximum principle and dynamic programming. SIAM J. Control Optim. 25 1291-1311.
8. Crandall, M. G., P. L. Lions (1983). Viscosity solutions of Hamilton-Jacobi equations. Trans. Amer. Math. Soc. 277 1-42.
9. _, _ (1985). Hamilton-Jacobi equations in infinite dimensions. I. Uniqueness of viscosity solutions. J. Funct. Anal. 62 379-396.
10. Ekeland, I. (1974). On the variational principle. J. Math. Anal. Appl. 47 324-353.
11. _, G. Lebourg (1976). Generic Frechet differentiability and perturbed optimization in Banach space. Trans. Amer. Math. Soc. 224 193-216.
12. Fleming, W. H., R. W. Rishel (1975). Deterministic and Stochastic Optimal Controls, Springer-Verlag, New York.
13. _, H. M. Soner (1992). Controlled Markov Processes and Viscosity Solution, Springer-Verlag, New York.
14. Frankowska, H. (1989). Hamilton-Jacobi equations: Viscosity solutions and generalized gradients. J. Math. Anal. Appl. 141 21-26.
15. Gabasov, R., F. M. Kirillova, B. Sh. Mordukhovich (1983). The ε-maximum principle for suboptimal controls. Soviet Math. Dokl. 27 95-99.
16. Haussmann, U. G. (1992). A probabilistic approach to the generalized Hessian. Math. Oper. Res. 17 411-443.
17. _ (1994). Generalized solutions of the Hamilton-Jacobi equation of stochastic control. SIAM J. Control Optim. 32 728-743.
18. Lions, P. L. (1982). Generalized Solutions of Hamilton-Jacobi Equations, Pitman, London, England.
19. _ (1983). Optimal control of diffusion processes and Hamilton-Jacobi-Bellman equations, Part 2: Viscosity solutions and uniqueness. Comm. Partial Differential Equations 11 1229-1276.
20. Mordukhovich, B. Sh. (1988). Approximation Methods in Problems of Optimization and Control, Nauka, Moscow.
21. Pontryagin, M. L., V. G. Boltyanskii, R. V. Gamkrelidze, E. F. Mischenko (1962). The Mathematics Theory of Optimal Processes, Interscience, New York.
22. Sethi, S. P., Q. Zhang, X. Y. Zhou (1994). Hierarchical controls in stochastic manufacturing systems with convex costs. J. Optim. Theory Appl. 80 299-318.
23. _, X. Y. Zhou (1994). Dynamic stochastic jobshops and hierarchical controls. IEEE Trans. Automat. Control AC-39 2061-2076.
24. Zhou, X. Y. (1990). Maximum principle, dynamic programming, and their connection in deterministic control. J. Optim. Theory Appl. 65 363-373.
25. _ (1991). A unified treatment of maximum principle and dynamic programming in stochastic controls. Stochastics Stochastics Rep. 36 137-161.
26. _ (1993). Verification theorems within the framework of viscosity solutions. J. Math. Anal. Appl. 177 208-225.
27. _ (1995). Deterministic near-optimal controls. Part I: Necessary and sufficient conditions for near-optimality. J. Optim. Theory Appl. 85 473-488.