Optimal tracking control for linear discrete-time systems using reinforcement learning

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2013, Pages 3845-3850

  Kiumarsi Khomartash, Bahare ^a   Lewis, Frank L ^b   Naghibi Sistani, Mohammad Bagher ^a   Karimpour, Ali ^a  

^a FERDOWSI UNIVERSITY OF MASHHAD   (Iran)

^b UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

Algebraic riccati equation; Linear quadratic tracker; Policy iteration; Reinforcement learning

Indexed keywords

ALGEBRA; DIGITAL CONTROL SYSTEMS; DISCRETE TIME CONTROL SYSTEMS; ITERATIVE METHODS; NAVIGATION; NUMBER THEORY; REINFORCEMENT LEARNING; RICCATI EQUATIONS;

ALGEBRAIC RICCATI EQUATIONS; LINEAR DISCRETE-TIME SYSTEMS; LINEAR QUADRATIC TRACKERS; OPTIMAL CONTROL SOLUTION; OPTIMAL TRACKING CONTROL; POLICY ITERATION; REFERENCE TRAJECTORIES; SIMULATION EXAMPLE;

LEARNING ALGORITHMS;

EID: 84902308118     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2013.6760476     Document Type: Conference Paper

References (18)

1. F. L. Lewis, D. Vrabie, and V. Syrmos, Optimal Control. New York: John Wiley, 2012.
2. W. B. Powell, Approximate Dynamic Programming: Solving the Curses of Dimensionality. John Wiley, 2009.
3. R. S. Sutton, and A. G. Barto, Reinforcement learning-an introduction. Cambridge, MT: MIT Press, 1998.
4. J. Si. A. Barto, W. Powell, and D. Wunch, Handbook of Learning and Approximate Dynamic Programming. Wiley, 2004.
5. D. P. Bertsekas, and J. N. Tsitsiklis, Neuro-dynamic programming. MA: Athena Scientific, 1996.
6. A. AI-Tamimi, F. L. Lewis, and M. Abu-If, "Model-free Qlearning designs for linear discrete-time zero-sum games with application to Hifiit control, " Automatica, vol. 43, no. 3, pp. 473-481, Mar. 2007.
7. P. E, d . J, "Ei force et Ierieur Inetwork based controller for nonlinear discrete-time systems with input co trit, " IEEE Trans. Systems, Man, and Cybernetics-Part B: Cybernetics, vol. 37, no. 2, pp. 425-436, Apr. 2007.
8. Z. C Eu, d . J tu " Eer lized ilto-Jacobi-Bellman formulation-based neural network control of affine nonlinear discrete tiete, " IEEE Trans. Neural Networks, vol. 19, no. 1, pp.90-106, Jan. 2008.
9. P. J. Erbo, "NeurIetwor for control dte identification, " Proc. 28th IEEE Conf. Decision and Control, pp. 260-265, Dec, 1989.
10. P. J. Werbos, A menu of designs for reinforcement learning over time. In Neural Networks for Control. W. T. Miller, R.S. Sutton, & P. J. Werbos. (Eds.). Cambridge, MA: MIT Press, pp. 67-95, 1991.
11. P. J. Werbos, Approximate dynamic programming for real-time control and neural modeling. In D. A. White, & D. A. Sofge (Eds.), Handbook of intelligent control. New York: Van Nostrand Reinhold, 1992.
12. F. L. Lewid, D. Vrbie, " Ei force etIerid dtive dicrori for feedbc control, " IEEE Circuit Syst. Mag., vol. 9, no. 3, pp. 32-50, Sep, 2009.
13. H. G. Zhang, Y. H. Luo, and D. Liu, "NeurIetwor-based nearoptimal control for a class of discrete-time affine nonlinear systems wit control cotrit, " IEEE Trans. Neural Networks, vol. 20, no. 9, pp. 1490-1503, Sep, 2009.
14. F. L. Lewis, and K. Vamvoudakis, "Reinforcement learning or partially observable dynamic processes: Adaptive dynamic programming using measured output data, " IEEE Trans. Systems, Man, and Cybernetics-Part B: Cybernetics, vol. 41, no. 1, pp. 14-23, Feb, 2011.
15. A. Ewer, "A itertive tecique for tecouttio of steady ttei for tedicretetiIe ultor, " IEEE Trans. Automatic Control, vol. 16, no. 4, pp. 382-384, Aug, 1971.
16. F. L. Lewi, D. Vrbied Vvoudi, " Ei force et learning and feedback control using natural decision methods to design tiIdtive controller, " IEEE Syst. Mag., vol. 32, no. 6, pp.76-105, Nov, 2012.
17. Moridite, "Uiver Iroitio of unknown mapping and its derivatives using multilayer feedforward etwor, " Neur I Networ, vol., . 551-560, 1990.
18. A. AI-Tamimi, F. L. Lewis, and M. Abu-If, "Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof, " IEEE Trans. Systems, Man, and Cybernetics Part B: Cybernetics, vol. 38, no. 4, pp. 943-949, Aug, 2008.