A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 4, 2008, Pages 937-942

  Zhang, Huanguang ^a   Wei, Qinglai ^a   Luo, Yanhong ^a  

^a NORTHEASTERN UNIVERSITY   (China)

Author keywords

Convergence; Greedy heuristic dynamic programming (HDP) iteration; Infinite time; Neural network; Optimal tracking control

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONTINUOUS TIME SYSTEMS; CONTROL SYSTEMS; CONVERGENCE OF NUMERICAL METHODS; DYNAMIC PROGRAMMING; HEURISTIC ALGORITHMS; HEURISTIC PROGRAMMING; ITERATIVE METHODS; MATHEMATICAL PROGRAMMING; MATHEMATICAL TRANSFORMATIONS; NAVIGATION; NEURAL NETWORKS; NONLINEAR SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING; SYSTEMS ENGINEERING;

CONVERGENCE; CONVERGENCE ANALYSIS; DISCRETE-TIME NON-LINEAR SYSTEMS; GREEDY HEURISTIC; GREEDY HEURISTIC DYNAMIC PROGRAMMING (HDP) ITERATION; INFINITE TIME; ITERATION ALGORITHMS; NEURAL NETWORK; OPTIMAL CONTROL POLICY; OPTIMAL REGULATION; OPTIMAL TRACKING; OPTIMAL TRACKING CONTROL; PERFORMANCE INDEX; PERFORMANCE INDEXES; REGULATION PROBLEMS; SYSTEM TRANSFORMATION; TIME-OPTIMAL; TRACKING PROBLEMS;

DISCRETE TIME CONTROL SYSTEMS;

ALGORITHM; ARTICLE; COMPUTER SIMULATION; FEEDBACK SYSTEM; NONLINEAR SYSTEM; SYSTEM ANALYSIS; SYSTEMS THEORY; THEORETICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; FEEDBACK; MODELS, THEORETICAL; NONLINEAR DYNAMICS; PROGRAMMING, LINEAR; SYSTEMS THEORY;

EID: 49049119493     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.920269     Document Type: Article

References (21)

1. Z. Aganovic and Z. Gajic, "The successive approximation procedure for finite-time optimal control of bilinear systems," IEEE Trans. Autom. Control, vol. 39, no. 9, pp. 1932-1935, Sep. 1994.
2. A. Al-Tamimi and F. L. Lewis, "Discrete-time nonlinear HJB solution using approximate dynamic programming: Convergence proof," in Proc. IEEE Symp. Approximate Dynam. Program. Reinforcement Learn., Apr. 2007, pp. 38-43.
3. R. Beard, "Improving the closed-loop performance of nonlinear systems," Ph.D. dissertation, Rensselaer Polytech. Inst., Troy, NY, 1995.
4. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
5. T. Cimen and S. P. Banks, "Nonlinear optimal tracking control with application to super-tankers for autopilot design," Automatica, vol. 40, no. 11, pp. 1845-1863, Nov. 2004.
6. S. Devasiad, D. Chen, and B. Paden, "Nonlinear inversion-based output tracking," IEEE Trans. Autom. Control, vol. 41, no. 7, pp. 930-942, Jul. 1996.
7. S. Ferrari and R. F. Stengel, "Online adaptive critic flight control," J. Guid. Control Dyn., vol. 27, no. 5, pp. 777-786, Sep./Oct. 2004.
8. D. Gao, G. Tang, and B. Zhang, "Approximate optimal tracking control for a class of nonlinear systems with disturbances," in Proc. 6th World Congr. Intell. Control Autom., Dalian, China, 2006, vol. 1, pp. 521-525.
9. I. J. Ha and E. G. Gilbert, "Robust tracking in nonlinear systems," IEEE Trans. Autom. Control, vol. AC-32, no. 9, pp. 763-771, Sep. 1987.
10. 2-gain optimization problem," Int. J. Control, vol. 72, no. 1, pp. 49-57, Jan. 1999.
11. N. Jin, D. Liu, T. Huang, and Z. Pang, "Discrete-time adaptive dynamic programming using wavelet basis function neural networks," in Proc. IEEE Symp. Approximate Dynam. Program. Reinforcement Learn., Apr. 2007, pp. 135-142.
12. D. Liu, X. Xiong, and Y. Zhang, "Action-dependent adaptive critic designs," in Proc. INNS-IEEE Int. Joint Conf. Neural Netw., Washington DC, Jul. 2001, vol. 2, pp. 990-995.
13. D. Liu and H. Zhang, "A neural dynamic programming approach for learning control of failure avoidance problems," Int. J. Intell. Control Syst., vol. 10, no. 1, pp. 21-32, Mar. 2005.
14. D. Liu, Y. Zhang, and H. Zhang, "A self-learning call admission control scheme for CDMA cellular networks," IEEE Trans. Neural Netw., vol. 16, no. 5, pp. 1219-1228, Sep. 2005.
15. T. W. Mclain, C. A. Bailry, and R. W. Beard, "Synthesis and experimental testing of a nonlinear optimal tracking controller," in Proc. IEEE Amer. Control Conf., Jun. 1999, vol. 4, pp. 2847-2851.
16. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive dynamic programming," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev. vol. 32, no. 2, pp. 140-153, May 2002.
17. Y.-M. Park, M.-S. Choi, and K. Y. Lee, "An optimal tracking neurocontroller for nonlinear dynamic systems," IEEE Trans. Neural Netw., vol. 7, no. 5, pp. 1009-1110, Sep. 1996.
18. D. V. Prokhorov and D. C. Wunsch, "Adaptive critic designs," IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 997-1007, Sep. 1997.
19. J. Si and Y.-T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 264-276, Mar. 2001.
20. M. L. Stefano, "Optimal design of PID regulators," Int. J. Control vol. 33, no. 4, pp. 601-616, 1981.
21. Q. Yang and S. Jagannathan, "Online reinforcement learning neural network controller design for nanomanipulation," in Proc. IEEE Symp. Approximate Dynam. Program. Reinforcement Learn., Apr. 2007, pp. 225-232.