Nonlinear optimal control via occupation measures and LMI-relaxations

SIAM Journal on Control and Optimization

Volumn 47, Issue 4, 2008, Pages 1643-1666

  Lasserre, Jean B ^a   Henrion, Didier ^b,c   Prieur, Christophe ^b   Trélat, Emmanuel ^d  

^a LAAS CNRS   (France)

^b UNIVERSITÉ DE TOULOUSE   (France)

^c CZECH TECHNICAL UNIVERSITY IN PRAGUE   (Czech Republic)

^d UNIVERSITÉ D'ORLÉANS   (France)

Author keywords

Measures; Moments; Nonlinear control; Optimal control; Semidefinite programming

Indexed keywords

CONTROL THEORY; INTERSECTIONS; LINEAR CONTROL SYSTEMS; LINEAR MATRIX INEQUALITIES; OPTIMAL SYSTEMS; POLYNOMIAL APPROXIMATION;

MEASURES; MOMENTS; NONLINEAR CONTROL; OPTIMAL CONTROL; SEMIDEFINITE PROGRAMMING;

NONLINEAR EQUATIONS;

EID: 55549140522     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/070685051     Document Type: Article

References (46)

1. E. J. ANDERSON AND P. NASH, Linear Programming in Infinite-Dimensional Spaces, John Wiley, Chichester, UK, 1987.
2. R. BEALS, B. GAVEAU, AND P. C. GREINER, Hamilton-Jacobi theory and the heat kernel on Heisenberg groups, J. Math. Pures Appl., 79 (2000), pp. 633-689.
3. C. BERG, The multidimensional moment problem and semigroups, Proc. Symp. Appl. Math., 37 (1987), pp. 110-124.
4. A. G. BHATT AND V. S. BORKAR, Occupation measures for controlled Markov processes: Characterization and optimality, Ann. Probab., 24 (1996), pp. 1531-1562.
5. O. BOKANOWSKI, S. MARTIN, R. MUNOS, AND H. ZIDANI, An anti-diffusive scheme for viability problems, Appl. Numer. Math., 56 (2006), pp. 1147-1162.
6. V. BORKAR, Convex analytic methods in Markov decision processes, in Handbook of Markov Decision Processes, E. A. Feinberg and A. Shwartz, eds., Kluwer Academic, Boston, MA, 2002, pp. 377-408.
7. R. W. BROCKETT, Asymptotic stability and feedback stabilization, in Differential Geometric Control Theory, R. W. Brockett, R. S. Millman, and H. J. Sussmann, eds., Birkhäuser, Boston, MA, 1983, pp. 181-191.
8. I. CAPUZZO-DOLCETTA AND P. L. LIONS, Hamilton-Jacobi equations with state constraints, Trans. Amer. Math. Soc., 318 (1990), pp. 643-683.
9. M. J. CHO AND R. H. STOCKBRIDGE, Linear programming formulation for optimal stopping problems, SIAM J. Control Optim., 40 (2002), pp. 1965-1982.
10. C. COATMÉLEC, Approximation et interpolation des fonctions différentiables de plusieurs variables, Ann. Sci. École Norm. Sup. (3), 83 (1966), pp. 271-341.
11. D. A. DAWSON, Qualitative behavior of geostochastic systems, Stochastic Process. Appl., 10 (1980), pp. 1-31.
12. W. H. FLEMING AND D. VERMES, Convex duality approach to the optimal control of diffusions, SIAM J. Control Optim., 27 (1989), pp. 1136-1155.
13. R. FLETCHER, Practical Methods of Optimization. Vol. 1. Unconstrained Optimization, John Wiley, Chichester, UK, 1980.
14. V. GAITSGORY AND S. ROSSOMAKHINE, Linear programming approach to deterministic long run average problems of optimal control, SIAM J. Control Optim., 44 (2006), pp. 2006-2037.
15. P. E. GILL, W. MURRAY, AND M. H. WRIGHT, Practical Optimization, Academic Press, London, New York, 1981.
16. R. F. HARTL, S. P. SETHI, AND R. G. VICKSON, A survey of the maximum principles for optimal control problems with state constraints, SIAM Rev., 37 (1995), pp. 181-218.
17. K. HELMES, S. RÖHL, AND R. H. STOCKBRIDGE, Computing moments of the exit time distribution for Markov processes by linear programming, Oper. Res., 49 (2001), pp. 516-530.
18. K. HELMES AND R. H. STOCKBRIDGE, Numerical comparison of controls and verification of optimality for stochastic control problems, J. Optim. Theory Appl., 106 (2000), pp. 107-127.
19. D. HENRION AND J. B. LASSERRE, Solving nonconvex optimization problems, IEEE Control Systems Mag., 24 (2004), pp. 72-83.
20. D. HERNANDEZ-HERNANDEZ, O. HERNÁNDEZ- LERMA, AND M. TAKSAR, The linear programming approach to deterministic optimal control problems, Appl. Math., 24 (1996), pp. 17-33.
21. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Discrete-Time Markov Control Processes: Basic Optimality Criteria, Springer-Verlag, New York, 1996.
22. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Approximation schemes for infinite linear programs, SIAM J. Optim., 8 (1998), pp. 973-988.
23. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Further Topics in Discrete-Time Markov Control Processes, Springer-Verlag, New York, 1999.
24. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, The linear programming approach, in Handbook of Markov Decision Processes, E. A. Feinberg and A. Shwartz, eds., Kluwer Academic, Boston, MA, 2002, pp. 377-408.
25. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Markov Chains and Invariant Probabilities, Birkhäuser Verlag, Basel, 2003.
26. M. W. HIRSCH, Differential Topology, Grad. Texts in Math. 33, Springer-Verlag, New York, 1976.
27. D. JACOBSON, M. LELE, AND J. L. SPEYER, New necessary conditions of optimality for control problems with state-variable inequality constraints, J. Math. Anal. Appl., 35 (1971), pp. 255-284.
28. J. L. KRIVINE, Anneaux préordonnés, J. Anal. Math., 12 (1964), pp. 307-326.
29. T. G. KURTZ AND R. H. STOCKBRIDGE, Existence of Markov controls and characterization of optimal Markov controls, SIAM J. Control Optim., 36 (1998), pp. 609-653.
30. J. B. LASSERRE, Global optimization with polynomials and the problem of moments, SIAM J. Optim., 11 (2001), pp. 796-817.
31. J. B. LASSERRE AND T. PRIÉTO-RUMEAU, SDP vs. LP relaxations for the moment approach in some performance evaluation problems, Stoch. Models, 20 (2004), pp. 439-456.
32. J. B. LASSERRE, T. PRIÉTO-RUMEAU, AND M. ZERVOS, Pricing a class of exotic options via moments and SDP relaxations, Math. Finance, 16 (2006), pp. 469-494.
33. J. B. LASSERRE, C. PRIEUR, AND D. HENRION, Nonlinear optimal control: Numerical approximations via moments and LMI relaxations, in Proceedings of the 44th IEEE Conference on Decision and Control, Sevilla, Spain, 2005, pp. 1648-1653.
34. H. MAURER, On optimal control problems with bounded state variables and control appearing linearly, SIAM J. Control Optim., 15 (1977), pp. 345-362.
35. J. NASH, The imbedding problem for Riemannian manifolds, Ann. of Math. (2), 63 (1956), pp. 20-63.
36. H. J. PESCH, A practical guide to the solution of real-life optimal control problems, Control Cybernet., 23 (1994), pp. 7-60.
37. L. S. PONTRYAGIN, V. G. BOLTYANSKIJ, R. V. GAMKRELIDZE, AND E. F. MISHCHENKO, The Mathematical Theory of Optimal Processes, John Wiley, New York, 1962.
38. C. PRIEUR AND E. TRÉLAT, Robust optimal stabilization of the Brockett integrator via a hybrid feedback, Math. Control Signals Systems, 17 (2005), pp. 201-216.
39. M. PUTINAR, Positive polynomials on compact semi-algebraic sets, Indiana. Univ. Math. J., 42 (1993), pp. 969-984.
40. K. SCHMÜDGEN, The K-moment problem for compact semi-algebraic sets, Math. Ann., 289 (1991), pp. 203-206.
41. H. M. SONER, Optimal control with state-space constraints I, SIAM J. Control Optim., 24 (1986), pp. 552-561.
42. J. STOER AND R. BULIRSCH, Introduction to Numerical Analysis, 3rd ed., Springer-Verlag, New York, 2002.
43. E. TRÉLAT, Contrôle optimal: Théorie et applications, Vuibert, Paris, 2005.
44. F.-H. VASILESCU, Spectral measures and moment problems, in Spectral Analysis and Its Applications, Theta Ser. Adv. Math. 2, Theta, Bucharest, 2003, pp. 173-215.
45. R. VINTER, Convex duality and nonlinear optimal control, SIAM J. Control Optim., 31 (1993), pp. 518-538.
46. O. VON STRYK AND R. BULIRSCH, Direct and indirect methods for trajectory optimization, Ann. Oper. Res., 37 (1992), pp. 357-373.