Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals

ICCAS 2010 - International Conference on Control, Automation and Systems

Volumn , Issue , 2010, Pages 646-651

  Lee, Jae Young ^a   Park, Jin Bae ^a   Choi, Yoon Ho ^b  

^a Yonsei University   (South Korea)

^b Kyonggi University   (South Korea)

Author keywords

Adaptive control; Excitation condition; LQR; PE; Policy iteration; Reinforcement learning

Indexed keywords

ADAPTIVE CONTROL; EXCITATION CONDITIONS; LQR; PE; POLICY ITERATION;

CONTINUOUS TIME SYSTEMS; CONTROL; ITERATIVE METHODS; LINEAR SYSTEMS; NUMERICAL METHODS; OPTIMAL CONTROL SYSTEMS; OPTIMIZATION; REINFORCEMENT LEARNING;

ADAPTIVE CONTROL SYSTEMS;

EID: 78751528766     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. R. S. Sutton and A. G. Barto, Reinforcement Learning-An Introduction, MIT Press, Cambridge, Massachussetts, 1998.
2. W. B. Powell, Approximate Dynamic Programming: solving the curses of dimensionality, Wiley-Interscience, 2007.
3. S. J. Bradtke and B. E. Ydstie, "Adaptive linear quadratic control using policy iteration," Proc. American Control Conference, Baltimore, Maryland, June, 1994.
4. T. Landelius, "Reinforcement learning and distributed local model synthesis," Ph.D. dissertation, Sweden: Linkoping University, 1997.
5. ∞ control", IEEE Trans. Syst., Man, Cybern.-Part B, vol. 37, no. 1, pp. 240-247, 2007.
6. ∞ control", Automatica, vol. 43, no. 3, pp. 473-482, 2007.
7. J. Murray, C. Cox, G. Lendaris, and R. Saeks, "Adaptive dynamic programming," IEEE Trans. Syst., Man, Cybern.-Part B, vol. 32, no. 2, pp. 140-153, 2002.
8. ∞ state feedback control with input saturation," IEEE Trans. Automatic Control, vol. 51, no. 12, pp. 1989-1995, 2006.
9. D. Vrabie, O. Pastravanu, M. Abu-Khalaf, and F. L. Lewis, "Adaptive optimal control for continuous-time linear systems based on policy iteration," Automatica, vol. 45, no. 2, pp. 477-484, 2009.
10. W. Dong and J. A. Farrell, "Adaptive approximately optimal control of unknown nonlinear systems based on locally weighted learning," Conf. Decision and Control, Shanghai, 2009, pp. 345-350.
11. S. N. Balakrishnan, J. ding, and F. L. Lewis, "Issues on stability of ADP feedabck controllers for dynamical systems," IEEE Trans. Syst., Man, Cybern.-Part B, vol. 38, no. 4, pp. 913-917, 2008.
12. F. L. Lewis and D. Vrabie, "Reinforcement learning and adaptive dynamic programming for feedback control," IEEE circuits and systems magazine, vol. 9, no. 3, pp. 32-50, 2009.
13. B. D. O. Anderson and J. B. Moore, Optimal Control: Linear Quadratic Methods, Englewood Cliffs, NJ: Prentice Hall, 1989.
14. H. K. Khalil, Nonlinear Systems, Prentice Hall, 2002.
15. D. Kleinman, "On the iterative technique for Riccati equation computations," IEEE Trans. Automatic Control, vol. 13, no. 1, pp. 114-115, 1968.
16. G. Strang, Linear Algebra and Its Applications, California: Thomson Higher Education, 2006.