Online synchronous policy iteration method for optimal control

Recent Advances in Intelligent Control Systems

Volumn , Issue , 2009, Pages 357-374

  Vamvoudakis, Kyriakos G ^a   Lewis, Frank L ^a  

^a UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79953132013     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-1-84882-548-2_14     Document Type: Chapter

References (21)

1. M. Abu-Khalaf, F. L. Lewis, Nearly Optimal Control Laws for Nonlinear Systems with Saturating Actuators Using a Neural Network HJB Approach, Automatica, vol. 41, no. 5, pp. 779-791, 2005.
2. L. C. Baird III, Reinforcement Learning in Continuous Time: Advantage Updating, Proc. Of ICNN, Orlando FL, June 1994.
3. R. Beard, G. Saridis, J. Wen, Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation, Automatica, vol. 33, no. 12, pp. 2159-2177, 1997.
4. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, MA, 1996.
5. J. W. Curtis, R. W. Beard, Successive Collocation: An Approximation to Optimal Nonlinear Control, IEEE Proc. ACC01, IEEE, 2001.
6. K. Doya, Reinforcement Learning In Continuous Time and Space, Neural Computation, 12(1), 219-245, 2000.
7. W. M. Haddad and V. Chellaboina, Nonlinear Dynamical Systems and Control: A Lyapunov-Based Approach., Princeton, NJ: Princeton University Press, 2008.
8. T. Hanselmann, L. Noakes, and A. Zaknich, Continuous-Time Adaptive Critics, IEEE Transactions on Neural Networks, 18(3), 631-647, 2007.
9. R. A. Howard, Dynamic Programming and Markov Processes, MIT Press, Cambridge, Massachusetts, 1960.
10. D. Kleinman, On an Iterative Technique for Riccati Equation Computations, IEEE Trans. on Automatic Control, vol. 13, pp. 114-115, February, 1968.
11. F. L. Lewis, K. Liu, and A. Yesildirek, Neural Net Controller with Guaranteed Tracking Performance, IEEE Transactions on Neural Networks, vol. 6, no. 3, pp. 703-715, 1995.
12. F. L. Lewis, V. L. Syrmos, Optimal Control, John Wiley, 1995.
13. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, Adaptive Dynamic Programming, IEEE Trans. on Systems, Man and Cybernetics, vol. 32, no. 2, pp 140-153, 2002.
14. D. Prokhorov, D. Wunsch, Adaptive critic designs, IEEE Trans. on Neural Networks, vol. 8, no 5, pp. 997-1007, 1997.
15. J. Si, A. Barto, W. Powel, D. Wunch, Handbook of Learning and Approximate Dynamic Programming, John Wiley, New Jersey, 2004.
16. R. S. Sutton, A. G. Barto, Reinforcement Learning - An Introduction, MIT Press, Cambridge, Massachusetts, 1998.
17. D. Vrabie, F. Lewis, Adaptive Optimal Control Algorithm for Continuous-Time Nonlinear Systems Based on Policy Iteration, IEEE Proc. CDC08, IEEE, 2008 (Accepted).
18. D. Vrabie, O. Pastravanu, F. Lewis, M. Abu-Khalaf, Adaptive Optimal Control for Continuous-Time Linear Systems Based on Policy Iteration, Automatica (to appear).
19. P. J. Werbos, Beyond Regression: New Tools for Prediction and Analysis in the Behavior Sciences, Ph. D. Thesis, 1974.
20. P. J. Werbos, Approximate dynamic programming for real-time control and neural modeling, Handbook of Intelligent Control, ed. D. A. White and D. A. Sofge, New York: Van Nostrand Reinhold, 1992.
21. P. J. Werbos, Neural networks for control and system identification, IEEE Proc. CDC89, IEEE, 1989.