Linear programming approach to deterministic long run average problems of optimal control

SIAM Journal on Control and Optimization

Volumn 44, Issue 6, 2006, Pages 2006-2037

  Gaitsgory, Vladimir ^a   Rossomakhine, Sergey ^a  

^a UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

Author keywords

Averaging method; Linear programming; Long run average optimal control; Occupational measures; Singularly perturbed control systems

Indexed keywords

APPROXIMATION THEORY; FINITE ELEMENT METHOD; NUMERICAL METHODS; OPTIMAL CONTROL SYSTEMS; PROBLEM SOLVING;

AVERAGING METHOD; LONG RUN AVERAGE OPTIMAL CONTROL; OCCUPATIONAL MEASURES; SINGULARLY PERTURBED CONTROL SYSTEMS;

LINEAR PROGRAMMING;

EID: 33746046452     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/040616802     Document Type: Article

References (48)

1. O. ALVAREZ AND M. BARDI, Viscosity solutions methods for singular perturbations in deterministic and stochastic control, SIAM J. Control Optim., 40 (2001), pp. 1159-1188.
2. O. ALVAREZ AND M. BARDI, Singular perturbations of nonlinear degenerate parabolic PDEs: A general convergence result, Arch. Ration. Mech. Anal., 170 (2003), pp. 17-61.
3. B. D. O. ANDERSON AND P. V. KOKOTOVIC, Optimal control problems over large time intervals, Automatica, 23 (1987), pp. 355-363.
4. E. J. ANDERSON AND P. NASH, Linear Programming in Infinite-Dimensional Spaces, John Wiley, Chichester, 1987.
5. M. ARISAWA, H. ISHII, AND P.-L. LIONS, A characterization of the existence of solutions for Hamilton-Jacobi equations in ergodic control problems with applications, Appl. Math. Optim., 42 (2000), pp. 35-50.
6. Z. ARTSTEIN, An occupational measure solution to a singularly perturbed optimal control problem, Control Cybernet., 31 (2002), pp. 623-642.
7. Z. ARTSTEIN, Invariant measures and their projections in nonautonomous dynamical systems, Stoch. Dyn., 4 (2004), no. 3, pp. 439-459.
8. Z. ARTSTEIN AND V. GAITSGORY, The value function of singularly perturbed control systems, Appl. Math. Optim., 41 (2000), pp. 425-445.
9. J.-P. AUBIN AND H. FRANKOWSKA, Set-Valued Analysis, Birkhäuser Boston, Boston, MA, 1990.
10. M. BARDI AND I. CAPUZZO-DOLCETTA, Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations, Birkhäuser Boston, Boston, MA, 1997.
11. G. K. BASAK, V. S. BORKAR, AND M. K. GHOSH, Ergodic control of degenerate diffusions, Stoch. Anal, Appl., 15 (1997), pp. 1-17.
12. A. BENSOUSSAN, Perturbation Methods in Optimal Control, John Wiley, New York, 1989.
13. A. ARAPOSTATHIS, V. S. BORKAR, AND M. GHOSH, Ergodic Control of Diffusion Processes, Springer, Berlin, to appear.
14. D. A. CARLSON, A. B. HAURIE, AND A. LEIZAROWITZ, Optimal Control on Infinite Time Horizon, 2nd ed., Springer-Verlag, Berlin, 1991.
15. F. COLONIUS, Optimal Periodic Control, Lecture Notes in Math. 1313, Springer-Verlag, Berlin, 1988.
16. F. COLONIUS AND R. FABBRI, Controllability for systems with slowly varying parameters, ESAIM Control Optim. Calc. Var., 9 (2003), pp. 207-216.
17. F. COLONIUS AND W. KLIEMANN, Infinite time optimal control and periodicity, Appl. Math. Optim., 20 (1989), pp. 113-130.
18. G. B. DANTZIG, Linear Programming and Extensions, Princeton University Press, Princeton, NJ, 1963.
19. T. D. DONCHEV AND A. L. DONTCHEV, Singular perturbations in infinite-dimensional control systems, SIAM J. Control Optim., 42 (2003), pp. 1795-1812.
20. L. C. EVANS AND D. GOMES, Linear programming interpretations of Mother's variational principle, ESAIM Optim. Calc. Var., 8 (2002), pp. 693-702.
21. W. H. FLEMING AND H. M. SONER, Controlled Markov Processes and Viscosity Solutions, Springer-Verlag, New York, 1991.
22. H. FRANKOWSKA AND F. RAMPAZO, Filippov and Filippov-Wazewski's theorems on closed domains, J. Differential Equations, 161 (2000), pp. 449-478.
23. V. GAITSGORY, Control of Systems with Fast and Slow Motions, Nauka, Moscow, 1991 (in Russian).
24. V. GAITSGORY, Suboptimization of singularly perturbed control problems, SIAM J. Control Optim., 30 (1992), pp. 1228-1249.
25. V. GAITSGORY, Singularly perturbed control systems and periodic optimization, IEEE Trans. Automat. Control, 38 (1993), pp. 888-903.
26. V. GAITSGORY, On representation of the limit occupational measures set of a control system with applications to singularly perturbed control systems, SIAM J. Control Optim., 43 (2004), pp. 325-340.
27. V. GAITSGORY AND M. T. NGUYEN, Multiscale singularly perturbed control systems: Limit occupational measures sets and averaging, SIAM J. Control Optim., 41 (2002), pp. 954-974.
28. G. GRAMMEL, On nonlinear control systems with multiple time scales, J. Dyn. Control Systems, 10 (2004), pp. 11-28.
29. L. GRÜNE, On the relation between discounted and average optimal value functions, J. Differential Equations, 148 (1998), pp. 65-99.
30. K. HELMES AND R. H. STOCKBRIDGE, Numerical comparison of controls and verification of optimality for stochastic control problems, J. Optim. Theory Appl., 106 (2000), pp. 107-127.
31. O. HERNANDEZ-LERMA AND J. B. LASSERRE, Markov Chains and Invariant Probabilities, Birkhäuser-Verlag, Basel, 2003.
32. Y. KABANOV AND S. PERGAMENSHCHIKOV, Two-Scale Stochastic Systems, Springer-Verlag, Berlin, Heidelberg, 2003.
33. P. V. KOKOTOVIC, H. K. KHALIL, AND J. O'REILLY, Singular Perturbation Methods in Control-Analysis and Design, SIAM Classics in Appl. Math. 25, SIAM, Philadelphia, 1999.
34. H. J. KUSHNER, Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems, Birkhäuser Boston, Boston, MA, 1990.
35. H. J. KUSHNER AND P. G. DUPUIS, Numerical Methods for Stochastic Control Problems in Continuous Time, 2nd ed., Springer-Verlag, New York, 2001.
36. A. LEIZAROWITZ, Order reduction is invalid for singularly perturbed control problems with vector fast variables, Math. Control Signals Systems, 15 (2002), pp. 101-119.
37. J. G. LLAVONA, Approximation of Continuously Differentiate Functions, Math. Stud. 130, North-Holland, Amsterdam, 1986.
38. M. S. MENDIONDO AND R. H. STOCKBRIDGE, Approximation of infinite-dimensional linear programming problems which arise in stochastic control, SIAM J. Control Optim., 36 (1998), pp. 1448-1472.
39. S. D. NAIDU, Singular perturbations and time scales in control theory and applications: An overview, Dyn. Contin. Discrete Impuls. Syst., Ser. B Appl. Algorithms, 9 (2002), pp. 233-278.
40. R. E. O'MALLEY, JR., Singular perturbations and optimal control, in Mathematical Control Theory, W. A. Copel, ed., Lecture Notes in Math. 680, Springer-Verlag, Berlin, 1978, pp. 170-218.
41. M. QUINCAMPOIX AND F. WATBLED, Averaging method for discontinuous Mayer's problem of singularly perturbed control systems, Nonlinear Anal., 54 (2003), pp. 819-837.
42. J. E. RUBIO, Control and Optimization. The Linear Treatment of Nonlinear Problems, Manchester University Press, Manchester, 1985.
43. R. H. STOCKBRIDGE, Time-average control of a Martingale problem. Existence of a stationary solution, Ann. Prob., 18 (1990), pp. 190-205.
44. R. H. STOCKBRIDGE, Time-average control of a Martingale problem: A linear programming formulation, Ann. Prob., 18 (1990), pp. 206-217.
45. V. VELIOV, A generalization of Tichonov theorem for singularly perturbed differential inclusions, J. Dyn. Control Systems, 3 (1997), pp. 1-28.
46. A. VIGODNER, Limits of Singularly Perturbed Control Problems: Dynamical Systems Approach, Ph.D. Thesis, The Weizmann Institute of Science, Rehovot, Israel, 1995.
47. J. WARGA, Optimal Control of Differential and Functional Equations, Academic Press, New York, 1972.
48. G. G. YIN AND Q. ZHANG, Continuous-Time Markov Chains and Applications, A Singular Perturbation Approach, Springer, New York, 1997.