Adaptive dynamic programming for online solution of a zero-sum differential game

Journal of Control Theory and Applications

Volumn 9, Issue 3, 2011, Pages 353-360

  Vrabie, Draguna ^a   Lewis, Frank ^b  

^a UNITED TECHNOLOGIES RESEARCH CENTER   (United States)

^b UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

Approximate Adaptive dynamic programming; Game algebraic Riccati equation; Nash equilibrium; Zero sum differential game

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; ALGEBRAIC RICCATI EQUATIONS; APPROXIMATE/ADAPTIVE DYNAMIC PROGRAMMING; CONTINUOUS TIME; CONTROL ENGINEERING; CONTROL POLICY; DIFFERENTIAL GAMES; GAME PROBLEM; INFINITE HORIZONS; LINEAR DYNAMICS; LOAD DISTURBANCES; NASH EQUILIBRIUM; OFF-LINE METHODS; POWER SYSTEM CONTROLS; QUADRATIC COSTS; SYSTEM DYNAMICS;

ALGEBRA; ALGORITHMS; GAME THEORY; RICCATI EQUATIONS;

DYNAMIC PROGRAMMING;

EID: 79960443754     PISSN: 16726340     EISSN: 10008152     Source Type: Journal    
DOI: 10.1007/s11768-011-0166-4     Document Type: Article

References (21)

1. ∞Optimal Control and Related Minimax Design Problems. Boston: Birkhuser, 1995.
2. T. Basar, G. J. Olsder. Dynamic Noncooperative Game Theory (Classics in Applied Mathematics 23). 2nd ed. Philadelphia: SIAM, 1999.
3. ∞ control problems. IEEE Transactions on Automatic Control, 1989, 34(8): 831-847.
4. ∞Control Problem: A State Space Approach. New York: Prentice Hall, 1992.
5. ∞ optimization. Systems & Control Letters, 1988, 11(2): 85-91.
6. L. Cherfi, H. Abou-Kandil, H. Bourles. Iterative method for general algebraic Riccati equation. Proceedings of International Conference on Automatic Control and System Engineering, Cairo, Egypt, 2005: 85-88.
7. T. Damm. Rational Matrix Equations in Stochastic Control. Berlin: Springer-Verlag, 2004.
8. A. Lanzon, Y. Feng, B. D. O. Anderson, et al. Computing the positive stabilizing solution to algebraic Riccati equations with an indefinite quadratic term via a recursive method. IEEE Transactions on Automation Control, 2008, 53(10): 2280-2291.
9. ∞ state feedback control with input saturation. IEEE Transactions on Automatic Control, 2006, 51(12): 1989-1995.
10. ∞ control. Automatica, 2009, 45(4): 881-888.
11. ∞ control. IEEE Transactions on Automatic Control, 1992, 37(6): 770-784.
12. R. Sutton. Learning to predict by the method of temporal differences. Machine Learning, 1988, 3(1): 9-44.
13. P. J. Werbos. Approximate dynamic programming for real-time control and neural modeling. D. White, D. Sofge, eds. Handbook of Intelligent Control, Neural, Fuzzy, and, Adaptive Approaches, New York: van Nostrand, 1992: 493-525.
14. C. Watkins. Learning from Delayed Rewards. Ph. D. thesis. Cambridge, U. K.: Cambridge University, 1989.
15. Q. Wei, H. Zhang. A new approach to solve a class of continuous-time nonlinear quadratic zero-sum game using ADP. Proceedings of IEEE International Conference on Networking, Sensing and Control, New York: IEEE, 2008: 507-512.
16. D. Vrabie, M. Abu-Khalaf, F. L. Lewis, et al. Continuoustime ADP for linear systems with partially unknown dynamics. Proceedings of Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL), New York: IEEE, 2007: 247-253.
17. D. Vrabie, O. Pastravanu, F. L. Lewis, et al. Adaptive optimal control for continuous-time linear systems based on policy iteration. Automatica, 2009, 45(2): 477-484.
18. F. L. Lewis, V. L. Syrmos. Optimal Control. New York: John Wiley & Sons, 1995.
19. J. Speyer, D. Jacobson. Primer on Optimal Control Theory. Philadelphia: SIAM, 2010.
20. J. W. Brewer. Kronecker products and matrix calculus in system theory. IEEE Transactions on Circuit and System, 1978, 25(9): 772-781.
21. Y. Wang, R. Zhou, C. Wen. Robust load-frequency controller design for power systems. IEE Proceedings - C: Generation, Transmission, and Distribution, 1993, 140(1): 11-16.