Max-plus summation of Fenchel-transformed semigroups for solution of nonlinear Bellman equations

Systems and Control Letters

Volumn 56, Issue 4, 2007, Pages 255-264

  McEneaney, William M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Dynamic programming; Fenchel transform; Hamilton Jacobi Bellman equations; Idempotent analysis; Legendre transform; Max plus algebra; Partial differential equations; Semiconvexity

Indexed keywords

ALGEBRA; COMPUTATIONAL METHODS; DYNAMIC PROGRAMMING; LAPLACE TRANSFORMS; MATHEMATICAL OPERATORS; PARTIAL DIFFERENTIAL EQUATIONS; PROBLEM SOLVING;

FENCHEL TRANSFORM; HAMILTON JACOBI BELLMAN EQUATIONS; IDEMPOTENT ANALYSIS; LEGENDRE TRANSFORM; MAX PLUS ALGEBRA; SEMICONVEXITY;

NONLINEAR EQUATIONS;

EID: 33847042707     PISSN: 01676911     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sysconle.2006.10.013     Document Type: Article

References (34)

1. M. Akian, S. Gaubert, V. Kolokoltsov, Set coverings and invertibility of functional Galois connections, in: G.L. Litvinov, V.P. Maslov (Eds.), Idempotent Mathematics and Mathematical Physics, Contemporary Math. 377 (2005) 19-51.
2. Akian M., Gaubert S., and Lakhoua A. A max-plus finite element method for solving finite horizon deterministic optimal control problems. Proceedings of the 16th International Symposium on Mathematical Theory of Networks and Systems (MTNS). Leuven (2004)
3. Baccelli F.L., Cohen G., Olsder G.J., and Quadrat J.-P. Synchronization and Linearity (1992), Wiley, New York
4. Bardi M., and Capuzzo-Dolcetta I. Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations (1997), Birkhauser, Boston
5. Butkovic P. Strong regularity of matrices-a survey of results. Discrete Math. 48 (1994) 45-68
6. Camilli F., Falcone M., Lanucara P., and Seghini A. A domain decomposition method for Bellman equations. Contemp. Math. 180 (1994) 477-483
7. Carlini E., Falcone M., and Ferretti R. An efficient algorithm for Hamilton-Jacobi equations in high dimensions. Comput. Visualization Sci. 7 (2004) 15-29
8. Clarke F.H. Optimization and Nonsmooth Analysis (1983), Wiley, New York
9. Cohen G., Gaubert S., and Quadrat J.-P. Duality and separation theorems in idempotent semimodules. Linear Algebra Appl. 379 (2004) 395-422
10. R.A. Cuninghame-Green, Minimax Algebra, Lecture Notes in Economics and Mathematical Systems, vol. 166, Springer, New York, 1979.
11. Dupuis P., and Boué M. Markov chain approximations for deterministic control problems with affine dynamics and quadratic cost in the control. SIAM J. Numer. Anal. 36 (1999) 667-695
12. Dupuis P., and Szpiro A. Convergence of the optimal feedback policies in a numerical method for a class of deterministic optimal control problems. SIAM J. Control Optim. 40 (2001) 393-420
13. Dupuis P., and Szpiro A. Second order numerical methods for first order Hamilton-Jacobi equations. SIAM J. Numer. Anal. 40 (2002) 113-118
14. Falcone M., and Ferretti R. Convergence analysis for a class of high-order semi-Lagrangian advection schemes. SIAM J. Num. Analysis 35 (1998) 909-940
15. Fleming W.H. Functions of Several Variables (1977), Springer, New York
16. Fleming W.H. Max-plus stochastic processes. Appl. Math. Optim. 49 (2004) 159-181
17. Fleming W.H., and McEneaney W.M. A max-plus based algorithm for an HJB equation of nonlinear filtering. SIAM J. Control Optim. 38 (2000) 683-710
18. Fleming W.H., and Soner H.M. Controlled Markov Process and Viscosity Solutions. second ed. (2006), Springer, New York
19. ∞Control to Nonlinear Systems: Control of Nonlinear Systems to Achieve Performance Objectives (1999), SIAM, Philadelphia
20. ∞control, in: Proceedings of the 38th IEEE Conference on Decision and Control, 1999, pp. 3011-3016.
21. Kushner H.J., and Dupuis P. Numerical Methods for Stochastic Control Problems in Continuous Time (1992), Springer, New York
22. Litvinov G.L., Maslov V.P., and Shpiz G.B. Idempotent functional analysis: an algebraic approach. Math. Notes 69 (2001) 696-729
23. Maslov V.P. On a new principle of superposition for optimization problems. Russian Math. Surveys 42 (1987) 43-54
24. ∞control. Math. Controls Signals Systems 11 (1998) 303-334
25. W.M. McEneaney, Error analysis of a max-plus algorithm for a first-order HJB equation, in: B. Pasik-Duncan (Ed.), Stochastic Theory and Control, Proceedings of a Workshop held in Lawrence, Kansas, October 18-20, 2001, Lecture Notes in Control and Information Sciences, Springer, Berlin, 2002, pp. 335-352.
26. ∞problems: basic concepts. IEEE Trans. Automat. Control 48 (2003) 1150-1163
27. ∞problems: error analysis. SIAM J. Control Optim. 43 (2004) 379-412
28. W.M. McEneaney, A curse-of-dimensionality-free numerical method for solution of certain HJB PDEs, SIAM J. Control Optim., to appear.
29. ∞value functions, Proceedings of the 37th IEEE Conference on Decision and Control, 1998, pp. 3506-3511.
30. R.T. Rockafellar, Conjugate Duality and Optimization, Regional Conference Series in Applied Mathematics, vol. 16, SIAM, Philadelphia, PA, 1974.
31. Rockafellar R.T., and Wets R.J. Variational Analysis (1997), Springer, New York
32. ∞control of nonlinear systems: differential games and viscosity solutions. SIAM J. Control Optim. 34 (1996) 1071-1097
33. ∞control. IEEE Trans. Automat. Control 37 (1992) 770-784
34. Wagneur E. Moduloids and pseudomodules, 1. Dimension theory. Discrete Math. 98 (1991) 57-73