Model-free approximate dynamic programming for continuous-time linear systems

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2009, Pages 5009-5014

  Lee, Jae Young ^a   Park, Jin Bae ^a   Choi, Yoon Ho ^b  

^a Yonsei University   (South Korea)

^b Kyonggi University   (South Korea)

Author keywords

Adaptive critics; Adaptive optimal control; Approximate dynamic programming; LQR

Indexed keywords

CONTINUOUS TIME SYSTEMS; DC MOTORS; ITERATIVE METHODS; LINEAR SYSTEMS; ONLINE SYSTEMS; OPTIMAL CONTROL SYSTEMS;

ADAPTIVE CRITIC; ADAPTIVE OPTIMAL CONTROL; APPROXIMATE DYNAMIC PROGRAMMING; APPROXIMATION PROPERTIES; CHEAP CONTROL PROBLEM; CONTINUOUS-TIME LINEAR SYSTEMS; NEAR-OPTIMAL SOLUTIONS; OPTIMAL CONTROL PROBLEM;

DYNAMIC PROGRAMMING;

EID: 77950824225     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2009.5400371     Document Type: Conference Paper

References (13)

1. J. Si, A. G. Barto, W. B. Powell, and D. Wunsch, Handbook of Learning and Approximate Dynamic Programming, Wiley-IEEE Press; 2004.
2. A. Al-Tamimi, M. Abu-Khalaf, and F. L. Lewis, "Adaptive critic designs for discrete-time zero-sum games with application to H∞ control," IEEE Trans. on Systems, Man, and Cybernetics-Part B, vol.37, no.1, pp. 240-247, 2007
3. A. Al-Tamimi, M. Abu-Khalaf, and F. L. Lewis,"Model-free Q-learning designs for discrete-time zero-sum games with application to H∞ control," Automatica, vol.43, no.3, pp. 473-481, 2007
4. A. Al-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof," IEEE Trans. on Systems, Man, and Cybernetics-Part B, vol.38, no.4, pp. 913-917, 2008.
5. S.B. Balakrishnan, J. Ding, and F. W. Lewis, "Issues on stability of ADP feedback controllers for dynamical systems," IEEE Trans. on Systems, Man, and Cybernetics-Part B, vol.38, no.4, pp. 913-917, 2008.
6. S. J. Bradtke and B. E. Ydstie, "Adaptive linear quadratic control using policy iteration," Proc. American Control Conference, Baltimore, Maryland, June, 1994.
7. X. Liu and S. N. Balakrishnan, "Convergence analysis of adaptive critic based optimal control," Proc. American Control Conference, Chicago, Illinois, June, 2000.
8. L. C. Baird III, "Reinforcement learning in continuous-time: advantage updating," IEEE World Congr. Computational Intelligence., IEEE International Conf. Neural Networks, Orlando, FL, vol.4, pp. 2448-2453, 1994.
9. K. Doya, "Reinforcement learning in continuous-time and space," Neural Computation, vol.12, no.1, pp. 219-245, 2000.
10. A. Jameson and R. E. O'Malley, "Cheap control of the time-invariant regulator," Applied Mathmatics and Optimization, vol.1, no.4, pp. 337-354, 1975
11. D. Vrabie, M. Abu-Khalaf, F. L. Lewis, and Y. Wang, "Continuous-time ADP for linear systems with partially unknown dynamics," Proc. the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning, pp. 247-253, 2007.
12. B. D. O. Anderson and J. B. Moore, Optimal Control: Linear Quadratic Methods, Englewood Cliffs, NJ: Prentice Hall, 1990.
13. H. K. Khalil, Nonlinear Systems,Prentice Hall, 2002.