Generalized Policy Iteration for continuous-time systems

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 3224-3231

  Vrabie, Draguna ^a   Lewis, Frank L ^a  

^a UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE CONTROLLERS; APPROXIMATE DYNAMIC PROGRAMMING; CONTINUOUS-TIME FORMULATION; CT SYSTEM; INTERNAL DYNAMICS; ITERATIVE PROCESS; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROL SOLUTION; POLICY EVALUATION; POLICY ITERATION; SIMULATION RESULT; VALUE FUNCTIONS; VALUE ITERATION;

ADAPTIVE CONTROL SYSTEMS; ALGORITHMS; DYNAMIC PROGRAMMING; NEURAL NETWORKS; NONLINEAR CONTROL SYSTEMS; OPTIMAL CONTROL SYSTEMS; SYSTEMS ENGINEERING;

CONTINUOUS TIME SYSTEMS;

EID: 70449448940     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5178964     Document Type: Conference Paper

References (25)

1. M Abu-Khalaf, F. L. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach", Automatica, vol. 41, no. 5, pp. 779-791, 2005.
2. M. Abu-Khalaf, F. L. Lewis, Huang, J., "Policy Iterations and the Hamilton-Jacobi-Isaacs equation for H-infmity state-feedback control with input saturation, " IEEE Transactions on Automatic Control, pp. 1989-1995, December, 2006.
3. A. Al-Tamimi, F. L. Lewis, M. Abu-Khalaf, "Model-Free Q-Learning Designs for Discrete-Time Zero-Sum Games with Application to H-Infinity Control", Automatica, Vol. 43, pp. 473-481, 2007.
4. A. Al-Tamimi, M. Abu-Khalaf, F. L. Lewis, "Adaptive Critic Designs for Discrete-Time Zero-Sum Games With Application to H-infinity Control", IEEE Trans. on Sys., Man, and Cyb -B, Vol. 37, No. l, February, 2007.
5. S. J. Bradtke, B. E. Ydestie, A. G. Barto, "Adaptive linear quadratic control using policy iteration, " Proceedings of the American Control Conference, pp. 3475-3476, Baltmore, Maryland, June, 1994
6. R. Beard, G. Saridis, J. Wen, "Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation", Automatica, vol. 33, no. 12, pp. 2159-2177, 1997.
7. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, MA, 1996.
8. K. Doya, "Reinforcement Learning In Continuous Time and Space", Neural Computation, 12 (1), pp. 219-245, 2000.
9. T. Hanselmann, L. Noakes, and A. Zaknich, "Continuous-time adaptive critics", IEEE Transactions on Neural Networks, 18 (3), 631-647, 2007.
10. K. Hornik, M. Stinchcombe, H. White, "Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks", Neural Networks, 3, pp. 551-560, 1990.
11. R. J. Leake, Ruey-Wen Liu, "Construction of Suboptimal Control Sequences", J. SIAM Control, 5 (1), 1967.
12. F. L. Lewis, V. L. Syrmos, Optimal Control, John Wiley, 1995.
13. D. Kleinman, "On an iterative technique for Riccati equation computations", IEEE Trans. on Automatic Control, vol. 13, pp. 114-115, February, 1968.
14. T. Landelius, Reinforcement Learning and Distributed Local Model Synthesis, PhD Dissertation, Linkoping University, Sweden, 1997.
15. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive dynamic programming", IEEE Trans. on Systems, Man and Cybernetics, vol. 32, no. 2, pp 140-153, 2002.
16. D. Prokhorov, D. Wunsch, "Adaptive critic designs, " IEEE Trans. on Neural Networks, vol. 8, no 5, pp. 997-1007, 1997.
17. J. Si, A. Barto, W. Powell, D. Wunsch, Handbook of Learning and Approximate Dynamic Programming, John Wiley, New Jersey, 2004.
18. nd Edition, 2003.
19. R. S. Sutton, A. G. Barto, Reinforcement Learning mdash; An Introduction, MIT Press, Cambridge, Massachusetts, 1998.
20. J. N. Tsitsiklis, "On the convergence of optimistic policy iteration", Journal of Machine Learning Research, 3, pp. 59-72, 2002.
21. D. Vrabie, F. Lewis, "Adaptive optimal control algorithm for continuous-time nonlinear systems based on policy iteration", IEEE Proc. CDC'08, IEEE, 2008.
22. D. Vrabie, O. Pastravanu, F. Lewis, M. Abu-Khalaf, "Adaptive optimal control for continuous-time linear systems based on policy iteration", Automatica (to be published), doi:10.1016/j.automatica.2008.08.017.
23. P. J. Werbos, Beyond Regression: New Tools for Prediction and Analysis in the Behavior Sciences, Ph. D. Thesis, 1974.
24. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling, " Handbook of Intelligent Control, ed. D. A. White and D. A. Sofge, New York: Van Nostrand Reinhold, 1992.
25. P. Werbos, "Neural networks for control and system identification", IEEE Proc. CDC'89, IEEE, 1989.