Near-optimal stabilization for a class of nonlinear systems with control constraint based on single network greedy iterative DHP algorithm

Zidonghua Xuebao/ Acta Automatica Sinica

Volumn 35, Issue 11, 2009, Pages 1436-1445

  Luo, Yan Hong ^a,b   Zhang, Hua Guang ^a,b   Cao, Ning ^b   Chen, Bing ^c  

^a KEY LABORATORY OF INTEGRATED AUTOMATION OF PROCESS INDUSTRY   (China)

^b NORTHEASTERN UNIVERSITY   (China)

^c QINGDAO UNIVERSITY   (China)

Author keywords

Constraint; Greedy iterative; Neural network; Nonquadratic functional; Optimal control

Indexed keywords

ACTION NETWORK; APPROXIMATE DYNAMIC PROGRAMMING; CONSTRAINED PROBLEM; CONSTRAINED SYSTEMS; CONTROL CONSTRAINT; DHP ALGORITHM; DUAL HEURISTIC PROGRAMMING; GREEDY ITERATIVE; HAMILTON-JACOBI-BELLMAN EQUATIONS; ITERATIVE ALGORITHM; OPTIMAL CONTROL POLICY; OPTIMAL CONTROL SCHEME; OPTIMAL CONTROLS; OPTIMAL STABILIZATION; SINGLE NETWORKS;

ALGORITHMS; DYNAMIC PROGRAMMING; HEURISTIC ALGORITHMS; HEURISTIC PROGRAMMING; ITERATIVE METHODS; NONLINEAR SYSTEMS; OPTIMIZATION; STABILIZATION; SYSTEMS ENGINEERING; TIME VARYING SYSTEMS;

NEURAL NETWORKS;

EID: 71949110048     PISSN: 02544156     EISSN: None     Source Type: Journal    
DOI: 10.3724/SP.J.1004.2009.01436     Document Type: Article

References (21)

1. Widrow B, Gupta N K, Maitra S. Punish/reward: learning with a critic in adaptive threshold systems. IEEE Transactions on Systems, Man, and Cybernetics, 1973, 3(5): 455-465
2. Barto A G, Sutton R S, Anderson C W. Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man, and Cybernetics, 1983, 13(5): 835-846
3. Werbos P J. Approximate dynamic programming for real-time control and neural modeling. Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches. New York: Van Nostrand Reinhold, 1992
4. Bertsekas D P, Tsitsiklis J N. Neuro-Dynamic Programming. MA: Athena Scientific, 1996
5. Prokhorov D V, Wunsch D C. Adaptive critic designs. IEEE Transactions on Neural Networks, 1997, 8(5): 997-1007
6. Si J, Wang Y T. Online learning control by association and reinforcement. IEEE Transactions on Neural Networks, 2001, 12(2): 264-276
7. Liu D R, Xiong X X, Zhang Y. Action-dependent adaptive critic designs. In: Proceedings of the International Joint Conference on Neural Networks. Washington D. C., USA: IEEE, 2001. 990-995
8. Murray J J, Cox C J, Lendaris G G, Saeks R. Adaptive dynamic programming. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 2002, 32(2): 140-153
9. Abu-Khalaf M, Lewis F L. Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica, 2005, 41(5): 779-791
10. Liu De-Rong. Approximate dynamic programming for self-learning control. Acta Automatica Sinica, 2005, 31(1): 13-18
11. Liu D R, Zhang H G. A neural dynamic programming approach for learning control of failure avoidance problems. International Journal of Intelligent Control and Systems, 2005, 10(1): 21-32
12. Padhi R, Unnikrishnan N, Wang X H, Balakrishnan S N. A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonliner systems. Neural Networks, 2006, 19(10): 1648-1660
13. Zhang H G, Wei Q L, Liu D R. On-line learning control for discrete nonlinear systems via an improved ADDHP method. In: Proceedings of the 4th International Symposium on Neural Networks. Nanjing, China: Springer-Verlag, 2007. 387-396
14. Al-Tamimi A, Lewis F L. Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. In: Proceedings of the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning. Hawaii, USA: IEEE, 2007. 38-43
15. Cheng T, Lewis F L, Abu-Khalaf M. Fixed-final-time-constrained optimal control of nonlinear systems using neural network HJB approach. IEEE Transactions on Neural Networks, 2007, 18(6): 1725-1736
16. Zhang H G, Wei Q L, Luo Y H. A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear system based on greedy HDP iteration algorithm. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2008, 38(4): 937-942
17. Baddeley B. Reinforcement learning in continuous time and space: interference and not ill conditioning is the main problem when using distributed function approximators. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2008, 38(4): 950-956
18. Wang F Y, Zhang H G, Liu D R. Adaptive dynamic programming: an introduction. IEEE Computational Intelligence Magazine, 2009, 4(2): 39-47
19. Chen Z, Jagannathan S. Generalized Hamilton-Jacobi-Bellman formulation-based neural network control of affine nonlinear discrete-time systems. IEEE Transactions on Neural Networks, 2008, 19(1): 90-106
20. Lyshevski S E. Nonlinear discrete-time systems: constrained optimization and application of nonquadratic costs. In: Proceedings of the American Control Conference. Philadelphia, USA: IEEE, 1998. 3699-3703
21. ∞ design for networked control systems with uncertainties. IEEE Transactions on Industrial Informatics, 2007, 3(4): 289-301