Algorithm and stability of atc receding horizon control

2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, ADPRL 2009 - Proceedings

Volumn , Issue , 2009, Pages 28-35

  Zhang, Hongwei ^a   Huang, Jie ^a   Lewis, Frank L ^b  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

Adaptive terminal cost receding horizon control; Heuristic dynamic programming; Receding horizon control; Stability

Indexed keywords

ADAPTIVE TERMINAL COST RECEDING HORIZON CONTROL; CLOSED LOOP STABILITY; CONTROL LAWS; EXPONENTIALLY STABLE; FINITE HORIZONS; HEURISTIC DYNAMIC PROGRAMMING; INFINITE HORIZONS; OPEN LOOPS; OPTIMAL CONTROL PROBLEM; RECEDING HORIZON CONTROL; STABILITY CONDITION; STATE FEEDBACK CONTROL LAW; SUBOPTIMAL CONTROL; SYSTEM MATRICES; TERMINAL COSTS; TERMINAL STATE;

CONTROL THEORY; COSTS; DYNAMIC PROGRAMMING; FEEDBACK; HEURISTIC METHODS; HEURISTIC PROGRAMMING; NONLINEAR CONTROL SYSTEMS; PREDICTIVE CONTROL SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING; STATE FEEDBACK; SYSTEM STABILITY; SYSTEMS ENGINEERING;

MODEL PREDICTIVE CONTROL;

EID: 67650505616     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2009.4927522     Document Type: Conference Paper

References (40)

1. A. Al-Tamimi M. Abu-Khalaf, and F.L. Lewis. Adaptive critic designs for discrete-time zero-sum games with application to H? control. IEEE Transactions on Systems Man and Cybernetics, Part B-Cybernetics, 37(1):240-7, 2007. (Pubitemid 46358495)
2. A. Al-Tamimi F.L. Lewis, and M. Abu-Khalaf. Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Transactions on Systems Man and Cybernetics, Part B-Cybernetics, 38(4):943-949, 2008.
3. A.G. Barto, R.S. Sutton, and C.W. Anderson. Neuronlike elements that can solve difficult learning control problems. IEEE Transactions on Systems Man and Cybernetics, SMC-13(5):835-846, 1983. (Pubitemid 14138646)
4. D.P. Bertsekas and J.N. Tsitsiklis. Neuro-dynamic programming. Athena Scientific, Belmont, MA, 1996.
5. R.R. Bitmead, M. Gever, and V. Wertz. Adaptive optimal control : the thinking man's GPC. Prentice Hall, NY, 1990.
6. R.R. Bitmead and M. Gevers. Riccati difference and differential equations: convergence, monotonicity and stability. In S. Bittani, A.J. Laub, and J.C. Willems, editors, The Riccati Equation, pages 263-292. Springer-Verlag, NY, 1991.
7. C.T. Chen. Linear system theory and design. Holt, Rinehart and Winston, NY, 1984.
8. H. Chen and F. Allgöwer. A quasi-infinite horizon nonlinear model predictive control scheme with guaranteed stability. Automatica, 34(10):1205-1217, 1998. (Pubitemid 128431629)
9. L. Chisci, A. Lombardi, and E. Mosca. Dual-Receding Horizon Control of Constrained Discrete Time Systems. European Journal of Control, 2:278-285, 1996. (Pubitemid 126599291)
10. G. De Nicolao, L. Magni, and R. Scattolini. Stabilizing recedinghorizon control of nonlinear time-varying systems. IEEE Transactions on Automatic Control, 43(7):1030-1036, 1998. (Pubitemid 128737745)
11. G. Grimm, M.J. Messina, S.E. Tuna, and A.R. Teel. Model predictive control: for want of a local control Lyapunov function, all is not lost. IEEE Transactions on Automatic Control, 50(5):546-558, 2005. (Pubitemid 40784428)
12. R.A. Howard. Dynamic programming and Markov processes. MIT Press, Cambridge, MA, 1960.
13. A. Jadbabaie and J. Hauser. On the stability of receding horizon control with a general terminal cost. IEEE Transactions on Automatic Control, 50(5):674-678, 2005. (Pubitemid 40784441)
14. A. Jadbabaie, J. Yu, and J. Hauser. Unconstrained receding horizon control of nonlinear systems. IEEE Transactions on Automatic Control, 46(5):776-783, 2001. (Pubitemid 32534454)
15. S.S. Keerthi and E.G. Gilbert. Optimal infinite-horizon feedback laws for a general class of constrained discrete-time systems: stability and moving-horizon approximations. Journal of Optimization Theory and Applications, 57(2):265-293, 1988. (Pubitemid 18626351)
16. W.H. Kwon and A.E. Pearson. A modified quadratic cost problem and feedback stabilization of a linear system. IEEE Transactions on Automatic Control, 22(5):838-842, 1977. (Pubitemid 8557636)
17. W.H. Kwon and A.E. Pearson. On feedback stabilization of timevarying discrete linear systems. IEEE Transactions on Automatic Control, 23(3):479-481, 1978. (Pubitemid 8611322)
18. T. Landelius. Reinforcement learning and distributed local model synthesis. PhD thesis, Linköping University, Sweden, 1997.
19. J.W. Lee, W.H. Kwon, and J.H. Choi. On stability of constrained receding horizon control with finite terminal weighting matrix. Automatica, 34(12):1607-1612, 1998. (Pubitemid 128399371)
20. F.L. Lewis and V.L. Syrmos. Optimal control. John Wiley and Sons, NY, 2nd edition, 1995.
21. L. Magni and R. Sepulchre. Stability margins of nonlinear receding horizon control via inverse optimality. Systems and Control Letters, 32(4):241-245, 1997. (Pubitemid 127452039)
22. D.Q. Mayne, J.B. Rawlings, C.V. Rao, and P.O.M. Scokaert. Constrained model predictive control: stability and optimality. Automatica, 36(6):789-814, 2000. (Pubitemid 30587683)
23. H. Michalska and D.Q. Mayne. Robust receding horizon control of constrained nonlinear systems. IEEE Transactions on Automatic Control, 38(11):1623-1633, 1993.
24. M. Morari and J.H. Lee. Model predictive control: past, present and future. Computers and Chemical Engineering, 23:667-682, 1999. (Pubitemid 29210323)
25. T. Parisini and R. Zoppoli. A receding-horizon regulator for nonlinear systems and a neural approximation. Automatica, 31(10):1443-1451, 1995.
26. J.A. Primbs and V. Nevistić. Feasibility and stability of constrained finite receding horizon control. Automatica, 36(7):965-971, 2000. (Pubitemid 30866031)
27. S.J. Qin and T.A. Badgwell. A survey of industrial model predictive control technology. Control Engineering Practice, 11(7):733-764, 2003. (Pubitemid 36906334)
28. Z. Quan, S. Han, and W.H. Kwon. Stability-guaranteed horizon size for receding horizon control. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, E90-A(2):523-525, 2007. (Pubitemid 46279766)
29. W.J. Rugh. Linear system theory. Prentice Hall, Upper Saddle River, NJ, 2nd edition, 1996.
30. P.O.M Scokaert, D.Q.Mayne, and J.B. Rawlings. Suboptimal model predictive control (feasibility implies stability). IEEE Transactions on Automatic Control, 44(3):648-654, 1999. (Pubitemid 29290750)
31. J. Si, A.G. Barto, W. Powell, and D.C. Wunsch. Handbook of learning and approximate dynamic programming. Wiley-Interscience, Hoboken, NJ, 2004.
32. R.S. Sutton. Learning to predict by the methods of temporal differences. Machine Learning, 3(1):9-44, 1988.
33. D. Vrabie, M. Abu-Khalaf F.L. Lewis, and Y. Wang. Continuous-time ADP for linear systems with partially unknown dynamics. In IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning, pages 247-253, 2007. (Pubitemid 47431392)
34. C. Watkins. Learning from delayed rewards. PhD thesis, Cambridge University, Cambridge, England, 1989.
35. P.J. Werbos. The elements of intelligence. Cybernetica (Namur), 3, 1968.
36. P.J. Werbos. Advanced forecasting methods for global crisis warning and models of intelligence. General Systems Yearbook, 22:25-38, 1977.
37. P.J. Werbos. Changes in global policy analysis procedures suggested by new methods of optimization. Policy Analysis and Information Systems, 3(1):27-52, 1979.
38. P.J. Werbos. Building and understanding adaptive systems - a statistical numerical approach to factory automation and brain research. IEEE Transactions on Systems Man and Cybernetics, 17(1):7-20, 1987. (Pubitemid 17549283)
39. P.J. Werbos. A menu of designs for reinforcement learning over time. In W.T. Miller, R.S. Sutton, and P.J. Werbos, editors, Neural Networks for Control, pages 67-95. MIT Press, Cambridge, MA, 1990.
40. P.J. Werbos. Approximate dynamic programming for real-time control and neural modeling. In D.A. White and D.A. Sofge, editors, Handbook of Intelligent Control, pages 493-525. Van Nostrand Reinhold, NY, 1992.