A boundedness result for the direct heuristic dynamic programming

Neural Networks

Volumn 32, Issue , 2012, Pages 229-235

  Liu, Feng ^a   Sun, Jian ^a   Si, Jennie ^b   Guo, Wentao ^a   Mei, Shengwei ^a  

^a TSINGHUA UNIVERSITY   (China)

^b Arizona State University   (United States)

Author keywords

Approximate dynamic programming (ADP); Direct heuristic dynamic programming (direct HDP); Lyapunov stability; Uniformly ultimately boundedness (UUB)

Indexed keywords

ADAPTIVE CRITIC DESIGNS; APPROXIMATE DYNAMIC PROGRAMMING; BOUNDEDNESS; COMPLEX CONTROL PROBLEMS; CONTINUOUS CONTROL; CONTINUOUS STATE; CONTROL SPACES; CRITIC NETWORK; DIRECT HEURISTIC DYNAMIC PROGRAMMING; DIRECT HEURISTIC DYNAMIC PROGRAMMING (DIRECT HDP); ESTIMATION ERRORS; INDUSTRIAL SCALE; LEARNING CONTROLLERS; LEARNING PARAMETERS; LYAPUNOV APPROACH; LYAPUNOV STABILITY;

CONTROL THEORY; CONTROLLERS; DYNAMIC PROGRAMMING;

HEURISTIC ALGORITHMS;

ACCURACY; ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; DIRECT HEURISTIC DYNAMIC PROGRAMMING; INTERMETHOD COMPARISON; LEARNING ALGORITHM; LINEAR SYSTEM; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NONLINEAR SYSTEM; ONLINE SYSTEM; PRIORITY JOURNAL; PROCESS DEVELOPMENT;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; NEURAL NETWORKS (COMPUTER); NEURONS; ONLINE SYSTEMS; PROGRAMMING, LINEAR;

EID: 84862811991     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2012.02.005     Document Type: Article

References (27)

1. Abu-Khalaf M., Lewis F.L. Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica 2005, 41(5):779-791.
2. Abu-Khalaf M., Lewis F.L. Neurodynamic programming and zerosum games for constrained control systems. IEEE Transactions on Neural Networks 2008, 19(7):1243-1252.
3. Abu-Khalaf M., Lewis F.L., Huang J. Policy iterations and the Hamilton-Jacobi-Isaacs equation for H∞ state feedback control with input saturation. IEEE Transactions on Automatic Control 2006, 51(12):1989-1995.
4. Balakrishnan S.N., Jie Ding, Lewis Frank L. Issues on stability of ADP feedback controllers for dynamical systems. IEEE Transactions on Systems, Man, and Cybernetics, Part B 2008, 38(4):913-917.
5. Barto A.G., Sutton R.S., Anderson C.W. Neuron like adaptive elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man, and Cybernetics 1983, 13:834-847.
6. Bellman R., Dreyfus S. Applied dynamic programming 1962, Princeton Univ. Press, Princeton, NJ.
7. Bradtke, S. J., Ydestie, B. E., & Barto, A. G. (1994). Adaptive linear quadratic control using policy iteration. In Proc. Amer. control conf. Baltimore, MD (pp. 3475-3476).
8. Enns R., Si J. Apache helicopter stabilization using neuro-dynamic programming. AIAA Journal of Guidance, Control, and Dynamics 2002, 25(1):19-25.
9. Enns R., Si J. Helicopter flight-control reconfiguration for main rotor actuator failures. AIAA Journal of Guidance, Control, and Dynamics 2003, 26(4):572-584.
10. Enns R., Si J. Helicopter trimming and tracking control using direct neural dynamic programming. IEEE Transactions on Neural Networks 2003, 14(4):929-939.
11. Ernst D., Glavic M., Wehenkel L. Power systems stability control: reinforcement learning framework. IEEE Transactions on Power Systems 2004, 19(1):427-435.
12. Igelnik B., Pao Y.H. Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Transactions on Neural Networks 1995, 6(6):1320-1329.
13. Landelius, T. (1997). Reinforcement learning and distributed local model synthesis. Ph.D. dissertation. Linkoping University. Sweden.
14. Lu C., Si J., Xie X. Direct heuristic dynamic programming method for power system stability enhancement. IEEE Transactions on Systems, Man, and Cybernetics, Part B 2008, 38(4):1008-1013.
15. Luenberger D.G. Introduction to dynamic systems 1979, Wiley, New York.
16. Prokhorov D.V., Santiago R.A., Wunsch D.C. Adaptive critic designs: a case study for neuron-control. Neural Networks 1995, 8(9):1367-1372.
17. Si J., Barto A., Powell W., et al. Handbook of learning and approximate dynamic programming: scaling up to the real world 2004, IEEE Press and John Wiley & Sons, New York.
18. Si J., Wang Y. Online learning control by association and reinforcement. IEEE Transactions on Neural Networks 2001, 12(2):264-276.
19. Sun, J., Liu, F., & Si, J. et al. (2011). Direct heuristic dynamic programming with augmented states. In Proceedings of international joint conference on neural networks (pp. 3112-3119).
20. Vamvoudakis, K. G., & Lewis, F. L. (2009). Online actor critic algorithm to solve the continuous-time infinite horizon optimal control problem. In Proceedings of international joint conference on neural networks (pp. 3180-3187).
21. Venayagamoorthy G.K., Harley R.G., Wunsch D.C. Dual heuristic programming excitation neurocontrol for generators in a multimachine power system. IEEE Transactions on Industry Applications 2003, 39(2):382-394.
22. Vrabie, D., & Lewis, F. L. (2009). Generalized policy iteration for continuous-time systems. In Proceedings of international joint conference on neural networks(pp. 3224-3231).
23. Watkins C.J.C.H., Dayan P. Q-learning. Machine Learning 1992, 8:279-292.
24. Werbos P. Advanced forecasting methods for global crisis warning and models of intelligence. General System Yearbook 1977, 22:25-38.
25. Werbos, P. J. (1989). Neural networks for control and system identification, In Proc. IEEE conf. decision control. Vol. 1, Tampa, FL. (pp. 260-265).
26. Werbos P.J. Approximate dynamic programming for real-time control and neural modeling. Handbook of intelligent control 1992, Van Nostrand Reinhold, New York, (Chapter 13). D.A. White, D.A. Sofge (Eds.).
27. Yang L., Si J., Tsakallis K., Rodriguez A. Direct heuristic dynamic programming for nonlinear tracking control with filtered tracking error. IEEE Transactions on Systems, Man, and Cybernetics, Part B 2009, 39(6):1617-1622.