Continuous-time ADP for linear systems with partially unknown dynamics

Proceedings of the 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, ADPRL 2007

Volumn , Issue , 2007, Pages 247-253

  Vrabie, Draguna ^a   Abu Khalaf, Murad ^a   Lewis, Frank L ^a   Wang, Youyi ^b  

^a UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Adaptive critics; Approximate dynamic programming; Policy iterations; V learning

Indexed keywords

ADAPTIVE ALGORITHMS; CONTINUOUS TIME SYSTEMS; LINEAR SYSTEMS; OPTIMAL CONTROL SYSTEMS; PROBLEM SOLVING;

ADAPTIVE CRITICS; ALGEBRAIC RICCATI EQUATION (ARE); APPROXIMATE DYNAMIC PROGRAMMING; POLICY ITERATIONS;

DYNAMIC PROGRAMMING;

EID: 34548721141     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2007.368195     Document Type: Conference Paper

References (17)

1. Baird, L., "Reinforcement Learning in Continuous Time: Advantage Updating," Proceedings of the International Conference on Neural Networks, Orlando, FL, June 1994.
2. Bradtke S. J., B. E. Ydestie, A. G. Barto, "Adaptive linear quadratic control using policy iteration", Proceedings of the American Control Conference, pp. 3475-3476, Baltmore, Myrland, June, 1994.
3. Brewer J. W., "Kronecker Products and Matrix Calculus in System Theory", IEEE Trans. on Circuit and System, Vol. CAS-25, No. 9, 1978.
4. Callier, F. M., C. A. Desoer, Linear Systems Theory, Springer-Verlag, New York, 1991.
5. Doya, K., "Reinforcement Learning in Continuous Time and Space," Neural Computation, vol. 12, pp. 219-245, MIT Press, 2000.
6. Ferrari, S., R. Stengel, "An Adaptive Critic Global Controller," Proceedings of the American Control Conference, pp. 2665-2670, Anchorage, AK, 2002.
7. Kleinman D., "On an Iterative Technique for Riccati Equation Computations", IEEE Trans. on Automatic Control, February, 1968.
8. Landelius, T., Reinforcement Learning and Distributed Local Model Synthesis, PhD Dissertation, Linköping University, 1997.
9. nd Edition, New York,1995.
10. Liu, X., S. N. Balakrishnan, "Convergence Analysis of Adaptive Critic Based Optimal Control", Proceedings of the American Control Conference, pp. 1929-1933, Chicago, IL, 2000.
11. Murray J. J., C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive Dynamic Programming", IEEE Trans. on Systems, Man and Cybernetics, Vol. 32, No. 2, pp 140-153, 2002.
12. Si J., A. Barto, W. Powel, D. Wunch, Handbook of Learning and Approximate Dynamic Programming, John Wiley, New Jersey, 2004.
13. Sutton, R., "Learning to predict by the method of temporal differences," Machine Learning, 3:9-44, 1988.
14. Watkins, C., Learning from Delayed Rewards, Ph.D. Thesis, Cambridge University, Cambridge, England, 1989.
15. Werbos, P., Beyond Regression: New Tools for Prediction and Analysis in the Behavior Sciences, Ph.D. Thesis, Committee on Appl. Math. Harvard Univ., 1974.
16. White, D., D. Sofge, Eds., Handbook of Intelligent Control, Neural, Fuzzy, and, Adaptive Approaches, New York: Van Nostrand, 1992.
17. Wang, Y., R. Zhou, C. Wen, "Robust load-frequency controller design for power systems", IEE Proc.-C, Vol. 140, No. 1, 1993.