Numerical adaptive learning control scheme for discrete-time non-linear systems

IET Control Theory and Applications

Volumn 7, Issue 11, 2013, Pages 1472-1486

  Wei, Qinglai ^a   Liu, Derong ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; ADAPTIVE LEARNING CONTROL; APPROXIMATION ERRORS; CONVERGENCE ANALYSIS; DISCRETE-TIME NONLINEAR SYSTEMS; NUMERICAL CONTROLLER; OPTIMAL CONTROL PROBLEM; STABILITY PROPERTIES;

LEARNING ALGORITHMS; NONLINEAR SYSTEMS; NUMERICAL CONTROL SYSTEMS; OPTIMAL CONTROL SYSTEMS; STABILITY;

ITERATIVE METHODS;

EID: 84883327795     PISSN: 17518644     EISSN: 17518652     Source Type: Journal    
DOI: 10.1049/iet-cta.2012.0486     Document Type: Article

References (39)

1. Padhi, R., Balakrishnan, S.N.: 'Optimal dynamic inversion control design for a class of nonlinear distributed parameter systems with continuous and discrete actuators', IET Control Theory Appl., 2007, 1, (6), pp. 1662-1671
2. Meng, D., Jia, Y., Du, J.: 'Robust iterative learning control design for uncertain time-delay systems based on a performance index', IET Control Theory Appl., 2010, 4, (5), pp. 759-772
3. Jiang, Q., Xi, H.S., Yin, B.Q.: 'Adaptive optimisation of timeout policy for dynamic power management based on semi-Markov control processes', IET Control Theory Appl., 2010, 4, (10), pp. 1945-1958
4. Iyasere, E., Salah, M., Dawson, D., Wagner, J., Tatlicioglu E.: 'Optimum seeking-based non-linear controller to maximise energy capture in a variable speed wind turbine', IET Control Theory Appl., 2012, 6, (4), pp. 526-532
5. Lewis, F.L., Syrmos, V.L.: 'Optimal control' (John Wiley, 1995)
6. Kushner, H.J.: 'Numerical algorithms for optimal controls for nonlinear stochastic systems with delays', IEEE Trans. Autom. Control, 2010, 55, (9), pp. 2170-2176
7. Younkin, G., Hesla, E.: 'Origin of numerical control', IEEE Ind. Appl. Mag., 2008, 14, (5), pp. 10-12
8. Zhang, C., Ordonez, R.: 'Numerical optimization-based extremum seeking control with application to ABS design', IEEE Trans. Autom. Control, 2007, 52, (3), pp. 454-467
9. Werbos, P.J.: 'Advanced forecasting methods for global crisis warning and models of intelligence', Gen. Syst. Yearb., 1977, 22, pp. 25-38
10. Werbos, P.J.: 'A menu of designs for reinforcement learning over time', in Miller W.T., Sutton R.S., Werbos P.J. (Eds): 'Neural networks for control' (MIT Press, 1991), pp. 67-95
11. Li, X.D., Xiao, T.F., Zheng H.X.: 'Adaptive discrete-time iterative learning control for non-linear multiple input multiple output systems with iteration-varying initial error and reference trajectory', IET Control Theory Appl., 2011, 5, (9), pp. 1131-1139
12. Liu, D., Zhang, Y., Zhang, H.: 'A self-learning call admission control scheme for CDMA cellular networks', IEEE Trans. Neural Netw., 2005, 16, (5), pp. 1219-1228
13. Wei, Q., Zhang, H., Dai, J.: 'Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions', Neurocomputing, 2009, 72, (7-9), pp. 1839-1848
14. Murray, J.J., Cox, C.J., Lendaris, G.G., Saeks, R.: 'Adaptive dynamic programming', IEEE Trans. Syst. Man Cybern. C, Appl. Rev., 2002, 32, (2), pp. 140-153
15. Wang, F., Zhang, H., Liu, D.: 'Adaptive dynamic programming: an introduction', IEEE Comput. Intell. Mag., 2009, 4, (2), pp. 39-47
16. Abu-Khalaf, M., Lewis, F.L.: 'Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach', Automatica, 2005, 41, (5), pp. 779-791
17. Lin, W.S., Chang, L.H., Yang, P.C.: 'Adaptive critic anti-slip control of wheeled autonomous robot', IET Control Theory Appl., 2007, 1, (1), pp. 51-57
18. Lewis, F.L., Vrabie, D.: 'Reinforcement learning and adaptive dynamic programming for feedback control', IEEE Circuits Syst. Mag., 2009, 9, (3), pp. 32-50
19. Wang, F., Jin, N., Liu, D., Wei, Q.: 'Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with ∈-error bound', IEEE Trans. Neural Netw., 2011, 22, (1), pp. 24-36
20. Beard, R.: 'Improving the closed-loop performance of nonlinear systems'. PhD thesis, Rensselaer Polytechnic Institute, Troy, New York, USA, 1995
21. Al-Tamimi, A., Lewis, F.L., Abu-Khalaf, M.: 'Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof', IEEE Trans. Syst. Man Cybern. B, Cybern., 2008, 38, (4), pp. 943-949
22. Wei, Q., Liu, D.: 'Adaptive dynamic programming with stable value iteration algorithm for discrete-time nonlinear systems'. Proc. Int. Joint Conf. Neural Networks, Brisbane, Australia, June 2012, pp. 1-6
23. Dierks, T., Jagannathan, S.: 'Online optimal control of affine nonlinear discrete-time systems with unknown internal dynamics by using timebased policy update', IEEE Trans. Neural Netw. Learn. Syst., 2012, 23, (7), pp. 1118-1129
24. Zhang, H., Wei, Q., Liu, D.: 'An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games', Automatica, 2011, 47, (1), pp. 207-214
25. Wei, Q., Liu, D.: 'An iterative ∈-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state', Neural Netw., 2012, 32, pp. 236-244
26. Zhang, H., Wei, Q., Luo, Y.: 'A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm', IEEE Trans. Syst. Man Cybern. B, Cybern., 2008, 38, (4), pp. 937-942
27. Lincoln, B., Rantzer, A.: 'Relaxing dynamic programming', IEEE Trans. Autom. Control, 2006, 51, (8), pp. 1249-1260
28. Zhang, H., Luo, Y., Liu, D.: 'The RBF neural network-based nearoptimal control for a class of discrete-time affine nonlinear systems with control constraint', IEEE Trans. Neural Netw., 2009, 20, (9), pp. 1490-1503
29. Jin, N., Liu, D., Huang, T., Pang, Z.: 'Discrete-time adaptive dynamic programming using wavelet basis function neural networks'. Proc. IEEE Symp. Approximate Dynamic Programming and Reinforcement Learning, Honolulu, USA, April 2007, pp. 135-142
30. Liu, D., Wang, D., Zhao, D., Wei, Q., Jin, N.: 'Neural-network-based optimal control for a class of unknown discrete-time nonlinear systems using globalized dual heuristic programming', IEEE Trans. Autom. Sci. Eng., 2012, 9, (3), pp. 628-634
31. Yang, Q., Jagannathan, S.: 'Reinforcement learning controller design for affine nonlinear discrete-time systems using online approximators', IEEE Trans. Syst. Man Cybern. B, Cybern., 2012, 42, (2), pp. 377-390
32. Liu, D., Wei, Q.: 'Finite-approximation-error based optimal control approach for discrete-time nonlinear systems', IEEE Trans. Syst. Man Cybern. B, Cybern., 2013, 43, (2), pp. 779-789
33. Wei, Q., Liu, D.: 'A new optimal control method for discrete-time nonlinear systems with approximation errors'. Proc. World Congress on Intelligent Control and Automation, Beijing, China, July 2012, pp. 185-190
34. Agricola, I., Friendrich, T.: 'Elementary geometry' (American Mathematical Society, 2008)
35. Navarro-Lopez, E.M.: 'Local feedback passivation of nonlinear discrete-time systems through the speed-gradient algorithm', Automatica, 2007, 43, (7), pp. 1302-1306
36. Sira-Ramirez, H.: 'Non-linear discrete variable structure systems in quasi-sliding mode', Int. J. Control, 1991, 54, (5), pp. 1171-1187
37. Si, J., Wang, Y.T.: 'On-line learning control by association and reinforcement', IEEE Trans. Neural Netw., 2001, 12, (2), pp. 264-276
38. Padhi, R., Unnikrishnan, N., Wang, X., Balakrishnan, S.N.: 'A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems', Neural Netw., 2006, 19, (10), pp. 1648-1660
39. Marks, I.I., Robert, J.: 'Introduction to Shannon sampling and interpolation theory' (Springer-Verlag, 1991)