Stability of direct heuristic dynamic programming for nonlinear tracking control using PID neural network

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2013, Pages

  Luo, Xiong ^a   Si, Jennie ^b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY BEIJING   (China)

^b Arizona State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIRECT HEURISTIC DYNAMIC PROGRAMMING; HIGH-PERFORMANCE CONTROLLERS; NEURAL NETWORKS (NNS); NON-LINEAR TRACKING CONTROL; NONLINEAR CONTROL PROBLEMS; SYSTEM NONLINEARITIES; TRACKING CONTROL PROBLEM; UNIFORMLY ULTIMATELY BOUNDEDNESS (UUB);

CONTROL THEORY; DESIGN; NEURAL NETWORKS; STABILITY; THREE TERM CONTROL SYSTEMS;

DYNAMIC PROGRAMMING;

EID: 84893557286     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2013.6707054     Document Type: Conference Paper

References (19)

1. R. Bellman, Dynamic Programming. Princeton University Press, Princeton, NJ, 1957.
2. F. Y. Wang, H. G. Zhang, and D. R. Liu, "Adaptive dynamic programming: An introduction, " IEEE Computational Intelligence Magazine, vol. 4, no. 2, pp. 39-47, May 2009.
3. W. B. Powell, Approximate Dynamic Programming: Solving the Curses of Dimensionality, 2nd edition. WileyBlackwell, Hoboken, NJ, 2011.
4. F. L. Lewis, D. Vrabie, and K. G. Vamvoudakis, "Reinforcement learning and feedback control: using natural decision methods to design optimal adaptive controllers, " IEEE Control Systems, vol. 32, no. 6, pp. 76-105, Dec. 2012.
5. F. L. Lewis and D. R. Liu, Reinforcement Learning and Approximate Dynamic Programming for Feedback Control. WileyIEEE, Hoboken, NJ, 2012.
6. P. J. Werbos, "Approximate dynamic programming for realtime control and neural modeling, " in Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches, vol. 15, Van Nostrand, New York, 1992, pp. 493-525.
7. J. Si, A. G. Barto, W. B. Powell, and D. Wunsch, Handbook of Learning and Approximate Dynamic Programming. Wiley, Hoboken, NJ, 2004.
8. R. Enns and J. Si, "Helicopter trimming and tracking control using direct neural dynamic programming, " IEEE Transactions on Neural Networks, vol. 14, no. 4, pp. 929-939, Jul. 2003.
9. P. He and S. Jagannathan, "Reinforcement learning neuralnetworkbased controller for nonlinear discretetime systems with input constraints, " IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 37, no. 2, pp. 425-436, Apr. 2007.
10. H. Zhang, Q. Wei, and Y. Luo, "A novel infinitetime optimal tracking control for a class discretetime nonlinear systems via the greedy iteration algorithm, " IEETE ransactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 38, no. 4, pp. 937-942, Aug. 2008.
11. L. Yang, J. Si, K. S. Tsakalis, and A. A. Rodriguez, "Direct heuristic dynamic programming for nonlinear tracking control with fliter tracking error, " IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 39, no. 6, pp. 1617-1622, Dec. 2009.
12. T. Dierks and S. Jagannathan, "Online optimal control of affine nonlinear discretetime systems with unknown internal dynamics by using timebased policy update, " IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 7, pp. 1118-1129, Jul. 2012.
13. D. R. Liu, D. Wang, D. B. Zhao, Q. L. Wei, and N. Jin, "Neuralnetwork based optimal control for a class of unknown discretetime nonlinear systems using globalized dual heuristic programming, " IEEE Transactions on Automation Science and Engineering, vol. 9, no. 3, pp. 628-634, Jul. 2012.
14. J. Si and Y. T. Wang, "Online learning control by association and reinforcement, " IEEE Transactions on Neural Networks, vol.12, no.2, pp. 264-276, Mar. 2001.
15. L. Yang, J. Si, K. Tsakallis, and A. Rodriguez, "Performance evaluation of direct heuristic dynamic programming using controltheoretic measures, " Journal of Intelligent and Robotic Systems: Theory and Applications, vol. 55, no. 23, pp. 177-201, Jul. 2009.
16. C. Lu, J. Si, and X. Xie, "Direct heuristic dynamic programming method for power system stability enhancement, " IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 38, no. 4, pp. 1008-1013, Aug. 2008.
17. J. Sun, F. Liu, J. Si, and S. Mei, "Direct heuristic dynamic programming with augmented states, " in Proceedings of International Joint Conference on Neural Networks, San Jose, California, USA, Jul. 2011, pp. 3112-3119.
18. F. W. Lewis, S. Jagannathan, and A. Yesildirak, Neural Networks Control of Robot Manipulators and Nonlinear Systems. Taylor & Francis, London, UK, 1998.
19. B. Igelnik and Y. H. Pao, "Stochastic choice of basis functions in adaptive function approximation and the functionallink net, " IEEE Transactions on Neural Networks, vol. 6, no. 6, pp. 1320-1329, Nov. 1995.