Optimal tracking control scheme for discrete-time nonlinear systems with approximation errors

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7952 LNCS, Issue PART 2, 2013, Pages 1-10

  Wei, Qinglai ^a   Liu, Derong ^a  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Adaptive dynamic programming; generalized value iteration; neural networks; optimal control; reinforcement learning

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; APPROXIMATION ALGORITHMS; DISCRETE TIME CONTROL SYSTEMS; ITERATIVE METHODS; NAVIGATION; NEURAL NETWORKS; NONLINEAR SYSTEMS; REINFORCEMENT LEARNING;

ADAPTIVE DYNAMIC PROGRAMMING; APPROXIMATION ERRORS; CONVERGENCE ANALYSIS; CONVERGENCE CONDITIONS; DISCRETE-TIME NONLINEAR SYSTEMS; OPTIMAL CONTROLS; OPTIMAL TRACKING CONTROL; VALUE ITERATION;

DYNAMIC PROGRAMMING;

EID: 84880734826     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-39068-5_1     Document Type: Conference Paper

References (17)

1. Abu-Khalaf, M., Lewis, F.L.: Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica 41(5), 779-791 (2005) (Pubitemid 40352391)
2. Abu-Khalaf, M., Lewis, F.L., Huang, J.: Neurodynamic programming and zero-sum games for constrained control systems. IEEE Transactions on Neural Networks 19(7), 1243-1252 (2008)
3. ∞ control. IEEE Trans. Systems, Man, and Cybernetics-Part B: Cybernetics 37(7), 240-247 (2007) (Pubitemid 46358495)
4. Prokhorov, D.V., Wunsch, D.C.: Adaptive critic designs. IEEE Transactions on Neural Networks 8(5), 997-1007 (1997) (Pubitemid 127763331)
5. ∞ stochastic optimal design for unknown linear networked control system zero-sum games via Q-learning. In: 2011 IEEE International Symposium on Intelligent Control (ISIC), Singapore, pp. 198-203 (2011)
6. Liu, D., Zhang, Y., Zhang, H.: A self-learning call admission control scheme for CDMA cellular networks. IEEE Transactions on Neural Networks 16(5), 1219-1228 (2005) (Pubitemid 41444623)
7. Tan, F., Liu, D., Guan, X., Xing, S.: Trajectory tracking control of nonholonomic mobile robot system based on unfalsified control theory. Control and Decision 25(6), 1693-1697 (2010)
8. Wang, F., Jin, N., Liu, D., Wei, Q.: Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with e-error bound. IEEE Transactions on Neural Networks 22(1), 24-36 (2011)
9. Wang, D., Liu, D., Wei, Q.: Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach. Neurocomputing 78(1), 14-22 (2012)
10. Wei, Q., Liu, D.: Nonlinear multi-person zero-sum differential games using iterative adaptive dynamic programming. In: 30th Chinese Control Conference (CCC), Yantai, China, pp. 2456-2461 (2011)
11. Wei, Q., Liu, D.: An iterative e-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state. Neural Networks 32, 236-244 (2012)
12. Wei, Q., Zhang, H., Dai, J.: Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions. Neurocomputing 72(7-9), 1839-1848 (2009)
13. Werbos, P.J.: Advanced forecasting methods for global crisis warning and models of intelligence. General Systems Yearbook 22, 25-38 (1977)
14. Werbos, P.J.: A menu of designs for reinforcement learning over time. In: Miller, W.T., Sutton, R.S., Werbos, P.J. (eds.) Neural Networks for Control, pp. 67-95. MIT Press, Cambridge (1991)
15. Zhang, H., Wei, Q., Luo, Y: A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Transactions on System, Man, and cybernetics-Part B: Cybernetics 38(4), 937-942 (2008)
16. Zhang, H., Song, R., Wei, Q.: Optimal tracking control for a class of nonlinear discrete-time systems with time delays based on heuristic dynamic programming. IEEE Transactions on Neural Networks 22(12), 1851-1862 (2011)
17. Zhang, H., Wei, Q., Liu, D.: An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games. Automatica 47(1), 207-214 (2011)