Direct heuristic dynamic programming based on an improved PID neural network

Journal of Control Theory and Applications

Volumn 10, Issue 4, 2012, Pages 497-503

  Sun, Jian ^a   Liu, Feng ^a   Si, Jennie ^b   Mei, Shengwei ^a  

^a TSINGHUA UNIVERSITY   (China)

^b Arizona State University   (United States)

Author keywords

Approximate dynamic programming (ADP); Direct heuristic dynamic programming (DHDP); Improved PID neural network (IPIDNN)

Indexed keywords

ACTION NETWORK; APPROXIMATE DYNAMIC PROGRAMMING; CART-POLE SYSTEM; CONTROL PERFORMANCE; CONTROL PROBLEMS; CONVERGENCE ISSUES; DIRECT HEURISTIC DYNAMIC PROGRAMMING; FULL STATE FEEDBACK; GRADIENT-DECENT ALGORITHM; LEARNING CONTROLLERS; LEARNING PROCESS; LEARNING TIME; ONLINE LEARNING ALGORITHMS; OPTIMALITY EQUATION; OUTPUT FEEDBACK CONTROLS; PID NEURAL NETWORK; REAL SYSTEMS; SYSTEM STATE;

LEARNING ALGORITHMS; STATE FEEDBACK;

DYNAMIC PROGRAMMING;

EID: 84868325663     PISSN: 16726340     EISSN: 10008152     Source Type: Journal    
DOI: 10.1007/s11768-012-0112-0     Document Type: Article

References (22)

1. R. Bellman, S. Dreyfus. Applied Dynamic Programming. Princeton, N J: Princeton University Press, 1962.
2. T. Borgers, R. Sarin. Learning through reinforcement and replicator dynamics. Economic Theory, 1997, 77(1): 1-17.
3. J. Dalton, S. N. Balakrishnan. Learning through reinforcement and replicator dynamics: A neighboring optimal adaptive critic for missile guidance. Mathmatics Computer Modeling, 1996, 23(1): 175-188.
4. P. Werbos. Advanced forecasting methods for global crisis warning and models of intelligence. General System Yearbook, 1977, 22(2): 25-38.
5. D. Kirk. Optimal Control Theory: An Introduction. Englewood Cliffs, NJ: Prentice-Hall, 1970.
6. J. Si, A. G. Barto, W. B. Powell, et al. Handbook of Learning and Approximate Dynamic ProgrammingScaling up to the Real World. New York: John Wiley & Sons, 2004.
7. S. N. Balakrishnan, J. Ding, F. L. Lewis. Issues on stability of adp feedback controllers for dynamical systems. IEEE Transactions on Systems, Man and Cybernetics, 2008, 38(4): 913-917.
8. F. L. Lewis, D. Vrabie. Reinforcement learning and adaptive dynamic programming for feedback control. IEEE Transactions on Circuits and Systems Magazine, 2009, 9(3): 32-50.
9. J. Si, Y. Wang. Reinforcement learning and adaptive dynamic programming for feedback control. IEEE Transactions on Neural Networks, 2001, 12(2): 264-276.
10. R. Enns, J. Si. Apache helicopter stabilization using neuro-dynamic programming. AIAA Journal of Guidance, Control, and Dynamics, 2002, 25(1): 19-25.
11. R. Enns, J. Si. Helicopter trimming and tracking control using direct neural dynamic programming. IEEE Transactions on Neural Networks, 2003, 14(4): 929-939.
12. C. Lu, J. Si, X. Xie. Direct heuristic dynamic programming method for power system stability enhancement. IEEE Transactions on System, Man and Cybernetics, Part B, 2008 (8): 1008-1013.
13. F. Wang, H. Zhang, D. Liu. Adaptive dynamic programming: an introduction. IEEE Transactions on Computational Intelligence Magazine, 2009, 4(2): 39-47.
14. H. Zhang, Q. Wei, Y. Luo. A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Transactions on System, Man and Cybernetics, 2008, 38(4): 937-942.
15. S. Ferrari, J. E. Steck, R. Chandramohan. Adaptive feedback control by constrained approximate dynamic programming. IEEE Transactions on System, Man and Cybernetics, 2008, 38(4): 982-987.
16. H. Shu. Study on the neural PID network cascade control system. Automation & Instrumentation, 1997, 5(1): 5-7.
17. H. Shu. PID neural network control for complex systems. Proceedings of the International Conference on Computational Intelligence for Modeling, Control and Automation. Amsterdam: IOS Press, 1999: 166-171.
18. H. Shu, Y. Pi. PID neural networks for time-delay systems. Proceedings of the 7th International Symposium on Process Systems Engineering. Keystone, Colorado, USA, 2000: 859-862.
19. L. Yang. Understanding and analyzing approximate dynamic programming with gradient-based framework and direct heuristic dynamic programming. A Dissertation Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy. Tempe, USA: Arizona State University, 2008: 62-93.
20. Y. Huang. Functional Analysis: An Introduction. Beijing: Science Press, 2009.
21. H. Robbins, S. Monro. LA stochastic approximation method. The Annals of Mathematical Statistics, 1951, 22(3): 400-407.
22. A. G. Barto, R. S. Sutton, C. W. Anderson. Neuron like adaptive elements that can solve difficult learning control problems. IEEE Transactions on System, Man and Cybernetics, 1983, 13(5): 834-847.