Robust adaptive dynamic programming with an application to power systems

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 7, 2013, Pages 1150-1156

  Jiang, Yu ^a   Jiang, Zhong Ping ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

Nonlinear uncertain systems; optimal control; reinforcement learning

Indexed keywords

COMPUTATIONAL ALGORITHM; CONTROLLER DESIGNS; DYNAMIC UNCERTAINTY; NON LINEAR CONTROL; NONLINEAR UNCERTAIN SYSTEMS; OPTIMAL CONTROLS; SUBOPTIMAL CONTROL; SYSTEM DYNAMICS;

CONTROLLERS; REINFORCEMENT LEARNING;

DYNAMIC PROGRAMMING;

EID: 84877914583     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2249668     Document Type: Article

References (32)

1. A. Al-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control," Automatica, vol. 43, no. 3, pp. 473-481, Jan. 2007. (Pubitemid 46209050)
2. J. Fu, H. He, and X. Zhou, "Adaptive learning and control for MIMO system based on adaptive dynamic programming," IEEE Trans. Neural Netw. , vol. 22, no. 7, pp. 1133-1148, Jul. 2011.
3. A. Isidori, Nonlinear Control Systems. New York, USA: Springer-Verlag, 1999.
4. Y. Jiang and Z. P. Jiang, "Robust adaptive dynamic programming," Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, F. L. Lewis and D. Liu, Eds. New York, USA: Wiley, 2012, pp. 281-302.
5. Y. Jiang and Z. P. Jiang, "Robust approximate dynamic programming and global stabilization with nonlinear dynamic uncertainties," in Proc. Joint IEEE Conf. Decision Control Eur. Control Conf. , Dec. 2011, pp. 115-120.
6. Y. Jiang and Z. P. Jiang, "Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics," Automatica, vol. 48, no. 10, pp. 2699-2704, 2012.
7. Y. Jiang and Z. P. Jiang, "Robust adaptive dynamic programming for large-scale systems with an application to multimachine power systems," IEEE Trans. Circuits Syst. II Exp. Briefs, vol. 59, no. 10, pp. 693-697, Oct. 2012.
8. Z. P. Jiang and L. Praly, "Design of robust adaptive controllers for nonlinear systems with dynamic uncertainties," Automatica, vol. 34, no. 7, pp. 825-840, 1998. (Pubitemid 128401031)
9. Z. P. Jiang, A. R. Teel, and L. Praly, "Small-gain theorem for ISS systems and applications," Math. Control Signals Syst. , vol. 7, no. 2, pp. 95-120, 1994.
10. H. K. Khalil, Nonlinear Systems, 3rd ed. Englewood Cliffs, NJ, USA: Prentice-Hall, 2002.
11. D. Kleinman, "On an iterative technique for Riccati equation computations," IEEE Trans. Autom. Control, vol. 13, no. 1, pp. 114-115, Feb. 1969.
12. M. Krstic, I. Kanellakopoulos, and P. V. Kokotovic, Nonlinear and Adaptive Control Design. New York, USA: Wiley, 1995.
13. P. Kundur, N. J. Balu, and M. G. Lauby, Power System stability and Control. New York, USA: McGraw-Hill, 1994.
14. P. A. Ioannou and J. Sun, Robust Adaptive Control. Upper Saddle River, NJ, USA: Prentice-Hall, 1996.
15. F. L. Lewis and V. L. Syrmos, Optimal Control. New York, USA: Wiley, 1995.
16. F. L. Lewis and D. Vrabie, "Reinforcement learning and adaptive dynamic programming for feedback control," IEEE Trans. Circuits Syst. Mag. , vol. 9, no. 3, pp. 32-50, Aug. 2009.
17. F. L. Lewis and K. G. Vamvoudakis, "Reinforcement learning for partially observable dynamic processes: Adaptive dynamic programming using measured output data," IEEE Trans. Syst. Man, Cybern. B, vol. 41, no. 1, pp. 14-23, Feb. 2011.
18. I. Mareels and J. W. Polderman, Adaptive Systems: An Introduction. Cambridge, MA, USA: Birkhäuser, 1996.
19. A. Saberi, P. V. Kokotovic, and H. J. Sussmann, "Global stabilization of partially linear composite systems," SIAM J. Control Optim. , vol. 2, no. 6, pp. 1491-1503, 1990.
20. E. D. Sontag, "Input to state stability: Basic concepts and results," Nonlinear and Optimal Control Theory, P. Nistri and G. Stefani, Eds. New York, USA: Springer-Verlag, 2007, pp. 163-220.
21. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.
22. G. Tao, Adaptive Control Design and Analysis. New York, USA:Wiley, 2003.
23. D. Vrabie, O. Pastravanu, M. Abu-Khalaf, and F. L. Lewis, "Adaptive optimal control for continuous-time linear systems based on policy iteration," Automatica, vol. 45, no. 2, pp. 477-484, Feb. 2009.
24. D. Vrabie and F. L. Lewis, "Adaptive dynamic programming algorithm for finding online the equilibrium solution of the two-player zero-sum differential game," in Proc. IEEE Joint Conf. Neural Netw. , Jul. 2010, pp. 1-8.
25. F. -Y. Wang, H. Zhang, and D. Liu, "Adaptive dynamic programming: An introduction," IEEE Comput. Intell. Mag. , vol. 4, no. 2, pp. 39-47, May 2009.
26. F. -Y. Wang, N. Jin, D. Liu, and Q. Wei, "Adaptive dynamic programming for finite horizon optimal control of discrete-time nonlinear systems with epsilon-error bound," IEEE Trans. Neural Netw. , vol. 22, no. 1, pp. 24-36, Jan. 2011.
27. P. J. Werbos, "Beyond regression: New tools for prediction and analysis in the behavior sciences," Ph. D. dissertation, Committee Appl. Math. Harvard Univ. , Cambridge, MA, USA, 1974.
28. P. J. Werbos, "Neural networks for control and system identification," in Proc. Conf. Decision Control, vol. 1. Dec. 1989. pp. 260-265.
29. P. J. Werbos, "A menu of designs for reinforcement learning over time," in Neural Networks for Control, W. T. Miller, R. S. Sutton, and P. J. Werbos, Eds. Cambridge, MA, USA: MIT Press, 1991, pp. 67-95.
30. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling," in Handbook of Intelligent Control, D. A. White and D. A. Sofge, Eds. New York, USA: Van Nostrand, 1992.
31. H. Xu, S. Jagannathan, and F. L. Lewis, "Stochastic optimal control of unknown linear networked control system in the presence of random delays and packet losses," Automatica, vol. 48, no. 6, pp. 1017-1030, Jun. 2012.
32. H. Zhang, Y. Luo, and D. Liu, "Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints," IEEE Trans. Neural Netw. , vol. 20, no. 9, pp. 1490-1503, Sep. 2009.