Finite horizon optimal control of non-linear discrete-time switched systems using adaptive dynamic programming with ε-error bound

International Journal of Systems Science

Volumn 45, Issue 8, 2014, Pages 1683-1693

  Qin, Chunbin ^a,b   Zhang, Huaguang ^a   Luo, Yanhong ^a   Wang, Binrui ^c  

^a NORTHEASTERN UNIVERSITY   (China)

^b HENAN UNIVERSITY   (China)

^c CHINA JILIANG UNIVERSITY   (China)

Author keywords

adaptive dynamic programming; finite horizon; neural network; Non linear switched system; optimal control

Indexed keywords

CONTROL; ITERATIVE METHODS; NEURAL NETWORKS; OPTIMAL CONTROL SYSTEMS; SWITCHING SYSTEMS;

ADAPTIVE DYNAMIC PROGRAMMING; DISCRETE-TIME SWITCHED SYSTEM; FINITE HORIZON OPTIMAL CONTROL; FINITE HORIZONS; OPTIMAL CONTROL POLICY; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROLS; SWITCHED SYSTEM;

DYNAMIC PROGRAMMING;

EID: 84902878983     PISSN: 00207721     EISSN: 14645319     Source Type: Journal    
DOI: 10.1080/00207721.2012.748945     Document Type: Article

References (42)

1. Al-Tamimi, A., Lewis, F.L., and Abu-Khalaf, M. (2008), ' Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof' , IEEE Transactions on Systems,Man, and Cybernetics-Part B: Cybernetics, 38, 943-949.
2. Bertsekas, D.P., and Tsitsiklis, J.N. (1996), Neuro-Dynamic Programming, Belmont, MA: Athena Scientific.
3. Baotí c, M., Christophersen, F., and Morari, M. (2003), ' Infinite Time Optimal Control of Hybrid Systems With a Linear Performance Index' , in Proceedings of the 42nd IEEE Conference on Decision and Control, Maui, Hawaii, USA, December, pp. 3191-3196.
4. Bengea, S.C., and DeCarlo, R.A. (2003), 'Conditions for the Exis tence of a Solution to a Two-Switched/Hybrid Optimal Control Problem' , in IFAC Conference on Analysis and Design of Hybrid Systems, Saint Malo, France, June, pp. 419-424.
5. Borrelli, F., Baotí c, M., Bemporad, A., and Morari, M. (2005), ' Dynamic Programming for Constrained Optimal Control of Discrete-Time Linear Hybrid Systems' , Automatica, 41, 1709-1721.
6. Blackmore, L., Rajamanoharan, S., and Williams, B.C. (2008), 'Active Estimation for Jump Markov Linear Systems ' , IEEE Transactions on Automatic Control, 53, 2223-2236.
7. Costa, O.L.V., and Tuesta, E.F. (2003), 'Finite Horizon Quadr atic Optimal Control and a Separation Principle for Markovian Jump Linear Systems' , IEEE Transactions on Automatic Control, 48, 1836-1842.
8. Chai, T., Geng, Z.,Yue,H.,Wang, H., and Su,C. (2009), ' AHybrid Intelligent Optimal Control Method for Complex Flotation Process' , International Journal of Systems Science, 40, 945-960.
9. Cao, N., Zhang, H., Luo, Y, and Feng, D. (2012), 'Infinite Horizon Optimal Control of A ffine Nonlinear Discrete Switched Systems Using Two-Stage ApproximateDynamic Programming' , International Journal of Systems Science, 43, 1673-1682.
10. Du D.,Jiang B.,Shi P.,Zhou S.(2007) H∞ Filtering of Discrete-Time Switched Systems With State Delays via Switched Lyapunov Function Approach. IEEE Transactions on Automatic Control 52, 1520-1525.
11. Gao, H., Lam, J., andWang, C. (2006), ' Model Simplification for Switched Hybrid Systems' , Systems and Control Letters, 55, 1015-1021.
12. Jagannathan, S. (2006), Neural Network Control of Nonlinear Discrete-Time Systems, Boca Raton: CRC Press.
13. Jiang, B., Yang, H., and Shi, P. (2010), 'Switching Fault Tolerant Control Design via Global Dissipativity ' , International Journal of Systems Science, 41, 1003-1012.
14. Liberzon, D. (2003), Switc hing in Systems and Control, Boston, MA: Birkhauser.
15. Lincoln, B., and Rantzer, A. (2006), 'Relaxing Dynamic Programming ', IEEE Transactions on Automatic Control, 51, 1249-1260.
16. Lewis, F.L., and Vrabie, D. (2009), ' Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control' , IEEE Circuits and Systems Magazine, 9, 32-50.
17. Lian, J., Zhao, J., and Dimirovski, G. (2009), ' Robust H∞ Sliding Mode Control for a Class of Uncertain Switched Delay Systems' , International Journal of Systems Science, 40, 855-866.
18. Loxton, R.-C., Teo, K.-L., and Rehbock, V. (2009), 'Com putational Method for a Class of Switched System Optimal Control Problems' , IEEE Transactions on Automatic Control, 54, 2455-2460.
19. Murray, J.J., Cox, C.J., Lendaris, G.G., and Saeks, R. (2002), 'Ad aptive Dynamic Programming' , IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, 32, 140-153.
20. Ni, W., and Cheng, D. (2010), 'Control of Switched Linear SystemsWith Input Saturation ', International Journal of Systems Science, 41, 1057-1065.
21. Niu, B., and Zhao, J. (2012), 'Tracking Control for Output-Constrained Nonlinear Switched SystemsWi th a Barrier Lyapunov Function' , International Journal of Systems Science, DOI:10.1080/00207721.2011.652222.
22. Prokhorov, D.V., and Wunsch, D.C. (1997), 'Adaptive Critic Designs ', IEEE Transactions on Neural N etworks, 8, 997-1007.
23. Rantzer, A. (2005), 'On Approximate Dynamic Programming in Switching Systems ' , in Proceeding of the IEEE Conference on Decision and Control and the European Control Conference, Seville, Spain, pp. 1391-1396.
24. Sutton, R.S., and Barto, A.G. (1998), Reinforcement Learning: An Introduction, Cambridge, MA: MIT Press.
25. Si, J., and Wang, Y.T. (2001), 'On-Line Learning Control by Association and Reinforcement ', IEEE Transactions on Neural Networks, 12, 264-276.
26. Si, J., Barto, A.G., Powell, W.B., and Wunsch, D.C. (eds.) (2004), Handbook of Learning and Approximate Dynamic Programming, NewYork: Wiley-IEEE Press.
27. Seatzu, C., Corona, D., Giua, A., and Bempoard, A. (2006), 'Optimal Control of Continuous Time Switched Affine Systems ', IEEE Transactions on Automat ic Control, 51, 726-741.
28. Tong, Y., Zhang, L., Shi, P., and Wang, C. (2012), ' A Common Linear Copositive Lyapunov Function for Switched Positive Linear Systems With Commutable Subsystems' , International Journal of Systems Science, DOI:10.1080/00207721.2012.683830.
29. Werbos, P.J. (1992), ' Approximate Dynamic Programming for Real-Time Control and Neural Modeling' , in Handbook of Intelligent Control, eds. D.A. White and D.A. Sofge, New York: Van Nostrand Reinhold, pp. 493-525.
30. Wang, F.Y., Zhang, H., and Liu, D. (2009), 'Adaptive Dynamic Programming: An Introduction ', IEEE Computational Intelligence Magazine, 43, 9- 47.
31. Wang M.,Zhao J.,Dimirovski G.(2010) Output Tracking Control of Nonlinear Switched Cascade Systems Using a Variable Structure Control Method. International Journal of Control 83, 394-403.
32. Wang, M., Zhao, J., and Dimirovski, G. (2009), ' Stabilisation and L2-gainAnalysis for a Class of Uncertain Switched Nonlinear Systems' , International Journal of Systems Science, 40, 1077-1085.
33. Wa ng, F., Jin, N., Liu, D., and Wei, Q. (2011), ' Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems With -Error Bound' , IEEE Transactions on Neural Networks, 22, 24-36.
34. Xu, X.-P., and Antsaklis, P.-J. (2000), 'Optimal Control of Switched Systems: New Results and Open Problems ' , in Proceeding of the American Control Conference, Chicago, Illinois, pp. 2683-2687.
35. Xu, X.-P., and Antsaklis, P.-J. (2003), 'Results and Perspectives on ComputationalMethods forOptimal Control of Switched Systems ' , in Hybrid Systems: Computation and Control (HSCC), Berlin: Springer, pp. 540-555.
36. Xie, G., and Wang, L. (2003), 'Controllability and Stabilizability of Switched Linear-Systems ', Systems and Control Letters, 48, 135-155.
37. Xiang, W., and Xiao, J. (2013), 'Finite-Time Stability and Stabilisation for Switched Linear Systems ', International Journal of Systems Science, 44, 384-400.
38. Yue, D., and Han, Q. (2005), 'Delay-Dependent Exponential Stability of Stochastic Sys tems With Time-Varying Delay, Nonlinearity, and Markovian Switching' , IEEE Transactions on Automatic Control, 50, 217-222.
39. Zhang, H., Wei, Q., and Luo, Y. (2008), 'A Novel Infinite-Time Optimal Trackin g Control Scheme for a Class of Discrete-Time Nonlinear System Based on Greedy HDP Iteration Algorithm' , IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, 38, 937-942.
40. Zhang, H., Luo, Y., and Liu, D. (2009), ' Neural-Network-Based Near-Optimal Control for a Class of Discrete-Time Affine Nonlinear Systems With Control Constraints' , IEEE Transactions on Neural Networks, 20, 1490-1503.
41. Zhang, L., and Gao, H. (2010), ' Asynchronously Switched Control of Switched Linear Systems With Average Dwell Time' , Automatica, 46, 953-958.
42. Zhang, H., Cui, L., Zhang, X., and Luo, Y. (2011), 'Data-Driven Rob ust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method' , IEEE Transactions on Neural Networks, 22, 2226-2236.