Robust Adaptive Dynamic Programming

Reinforcement Learning and Approximate Dynamic Programming for Feedback Control

Volumn , Issue , 2013, Pages 281-302

  Jiang, Yu ^a   Jiang, Zhong Ping ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

Asymptotic, stabilizing control laws uncertainties; Optimality, robust ADP for partial state; Robust ADP, robust ADP; Robust ADP for disturbance attenuation; Robust ADP, via off line on line learning

Indexed keywords

EID: 84877912324     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118453988.ch13     Document Type: Chapter

References (30)

1. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction, MIT Press, 1998.
2. P.J. Werbos. Beyond regression: new tools for prediction and analysis in the behavioural sciences, Ph.D. Thesis, Harvard University, 1972.
3. P.J. Werbos. Neural networks for control and system identification, Proceedings of IEEE Conference on Decision and Control, 260-265, 1989.
4. P.J. Werbos. A menu of designs for reinforcement learning over time, Neural Networks for Control, ed. W. T. Miller, R. S. Sutton, P. J. Werbos, Cambridge: MIT Press, 1991, pp 67-95.
5. P. J. Werbos. Approximate dynamic programming for real-time control and neural modeling, Handbook of Intelligent Control, ed. D.A. White and D.A. Sofge, New York: Van Nostrand Reinhold, 1992.
6. C. Watkins. Learning from delayed rewards, Ph.D. thesis, King's College of Cambridge, UK, 1989.
7. A. Al-Tamimi, F.L. Lewis, and M. Abu-Khalaf. Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control, Automatica, 43(3):473-481, 2007.
8. S.J. Bradtke, B.E. Ydstie, and A.G. Barto. Adaptive linear quadratic control using policy iteration, Proceedings of American Control Conference, 3:3475-3479, 1994.
9. Y. Jiang and Z. P. Jiang. Approximate dynamic programming for output feedback control, In Proceedings of the 29th Chinese Control Conference, 5815-5820, 2010.
10. Y. Jiang and Z. P. Jiang. Approximate dynamic programming for optimal stationary control with control-dependent noise, IEEE Transactions on Neural Networks, 22(12):2392-2398, 2011.
11. F. L. Lewis, K. G. Vamvoudakis. Reinforcement learning for partially observable dynamic processes: adaptive dynamic programming using measured output data, IEEE Transactions Systems, Man, and Cybernetics, Part B, SMCB-41(1):14-23, 2011.
12. D. Vrabie, O. Pastravanu, M. Abu-Khalaf, and F. L. Lewis. Adaptive optimal control for continuous-time linear systems based on policy iteration, Automatica, 45(2):477-484, 2009.
13. H. Zhang, Q. Wei, and D. Liu. An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games,Automatica, 47(1):207-214, 2011.
14. M. Krstic, I. Kanellakopoulos, and P. V. Kokotovic. Nonlinear and Adaptive Control Design, John Wiley & Sons, 1995.
15. E. D. Sontag. Further facts about input to state stabilization, IEEE Transactions on Automatic Control, AC-35(4):473-476, 1990.
16. E. D. Sontag and Y. Wang. On characterizations of the input-to-state stability property, Systems & Control Letters, 24:351-359, 1995.
17. Z. P. Jiang, A. R. Teel, and L. Praly. Small-gain theorem for ISS systems and applications, Mathematics of Control, Signals, and Systems, 7(2):95-120, 1994.
18. Z. P. Jiang, I. Mareels and Y. Wang. A Lyapunov formulation of the nonlinear small gain theorem for interconnected ISS systems, Automatica, 32(8):1211-1215, 1996.
19. A. Saberi, P. V. Kokotovic, and H. J. Sussmann. Global stabilization of partially linear composite systems, SIAM Journal on Control and Optimization, 2(6):1491-1503, 1990.
20. F.L. Lewis and V.L. Syrmos. Optimal Control, John Wiley & Sons, 1995.
21. D. Vrabie, F. Lewis. Adaptive dynamic programming algorithm for finding online the equilibrium solution of the two-player zero-sum differential game, The 2010 International Joint Conference on Neural Networks, 1-8, 2010.
22. H. K. Khalil. Nonlinear Systems, 3rd edition, Prentice-Hall, 2002.
23. D. Kleinman. On an iterative technique for Riccati equation computations, IEEE Transactions on Automatic Control, AC-13(1):114-115, 1969.
24. R. A. Horn and C. R. Johnson. Matrix Analysis, Cambridge University Press, NY, 1985.
25. Y. Jiang and Z. P. Jiang. Robust approximate dynamic programming and global stabilization with nonlinear dynamic uncertainties, Proceedings of the Joint 2011 IEEE Conference on Decision and Control and European Control Conference, Orlando, FL, 115-120, 2011.
26. P.J.Werbos. Intelligence in the brain: a theory of how it works and how to build it, Neural Networks, 22(3):200-212, 2009.
27. A. Isidori. Nonlinear Control Systems. Vol. II, Springer-Verlag, 1999.
28. Z. P. Jiang and L. Praly. Design of robust adaptive controllers for nonlinear systems with dynamic uncertainties, Automatica, 34(7):825-840, 1998.
29. Y.Wang, R. Zhou, and C.Wen. Robust load-frequency controller design for power systems, IEE Proceedings-Generation, Transmission and Distribution, 104(1):11-16, 1993.
30. M. Driels. Linear Control Systems Engineering. The McGraw-Hill Companies, Inc., 1996.