Adaptive optimal control algorithm for continuous-time nonlinear systems based on policy iteration

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2008, Pages 73-79

  Vrabie, D ^a   Lewis, F L ^a  

^a UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS TIME SYSTEMS; ITERATIVE METHODS; NONLINEAR CONTROL SYSTEMS; ONLINE SYSTEMS; OPTIMAL CONTROL SYSTEMS; STATE FEEDBACK;

ADAPTIVE CONTROL SCHEMES; ADAPTIVE OPTIMAL CONTROL; CONTINUOUS TIME NONLINEAR SYSTEMS; OPTIMAL ADAPTIVE CONTROLS; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROL SOLUTION; OPTIMAL STATE FEEDBACK CONTROL; UNKNOWN NONLINEAR SYSTEMS;

ADAPTIVE CONTROL SYSTEMS;

EID: 63049136575     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2008.4738955     Document Type: Conference Paper

References (22)

1. M. Abu-Khalaf and F. L. Lewis, "Nearly Optimal Control Laws for Nonlinear Systems with Saturating Actuators Using a Neural Network HJB Approach", Automatica, 41(5), 779-791, 2005.
2. R. Beard, G. Saridis, and J. Wen, "Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation", Automatica, 33(12), 2159-2177, 1997.
3. L. C. Baird III, "Reinforcement Learning in Continuous Time: Advantage Updating", Proc. Of ICNN, Orlando FL, June 1994.
4. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, MA, 1996.
5. K. Doya, "Reinforcement Learning In Continuous Time and Space", Neural Computation, 12(1), 219-245, 2000.
6. T. Hanselmann, L. Noakes, and A. Zaknich, "Continuous-Time Adaptive Critics", IEEE Transactions on Neural Networks, 18(3), 631-647, 2007.
7. K. Hornik, M. Stinchcombe and H. White, "Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks", Neural Networks, 3, 551-560, 1990.
8. R. A. Howard, Dynamic Programming and Markov Processes, MIT Press, Cambridge, Massachusetts, 1960.
9. J. Huang, and C. F. Lin, "Numerical approach to computing nonlinear H∞ control laws", Journal of Guidance, Control and Dynamics, 18(5), 989-994, 1995.
10. P. Ioannou and B. Fidan, Adaptive Control Tutorial, SIAM, Advances in Design and Control, PA, 2006.
11. D. E. Kirk, Optimal Control Theory - an introduction, Dover Pub. Inc., Mineola, New York, 2004.
12. D. Kleinman, "On an Iterative Technique for Riccati Equation Computations", IEEE Trans. on Automatic Control, 13, 114-115, 1968.
13. A. N. Kolmogorov and S. V. Fomin, Elements of the Theory of Functions and Functional Analysis, Dover Pub. Inc., Mineola, New York, 1999.
14. M. Krstic and H. Deng, Stabilization of Nonlinear Uncertain Systems, Springer, 1998.
15. H. W. J. Lee, K. L. Teo, W. R. Lee and S. Wang "Construction of suboptimal feedback control for chaotic systems using B-splines with optimally chosen knot points", International Journal of Bifurcation and Chaos, 11(9), 2375-2387, 2001.
16. F. L. Lewis, V. L. Syrmos, Optimal Control, John Wiley, 1995.
17. Z. H. Li and M. Krstic, "Optimal design of adaptive tracking controllers for nonlinear systems", Proc. of ACC, 1191-1197, 1997.
18. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive Dynamic Programming", IEEE Trans. on Systems, Man and Cybernetics, 32(2), 140-153, 2002.
19. D. Prokhorov and D. Wunsch, "Adaptive critic designs," IEEE Trans. on Neural Networks, 8(5), 997-1007, 1997.
20. J. J. Slotine and W. Li, Applied Nonlinear Control, New Jersey: Prentice-Hall, Inc, 1991.
21. D. Vrabie, O. Pastravanu, F. L. Lewis, "Policy Iteration for Continuous-time Systems with Unknown Internal Dynamics", Proceedings of MED, 2007.
22. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling," Handbook of Intelligent Control, ed. D.A. White and D.A. Sofge, New York: Van Nostrand Reinhold, 1992.