A reinforcement learning-based scheme for adaptive optimal control of linear stochastic systems

Proceedings of the American Control Conference

Volumn , Issue , 2008, Pages 57-62

  Wee, Chin Wong ^a   Lee, Jay H ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SYSTEMS; CONTROL SYSTEMS; DECISION MAKING; KETONES; LINEAR SYSTEMS; PROBLEM SOLVING; REINFORCEMENT; REINFORCEMENT LEARNING; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC PROGRAMMING;

ADAPTIVE CONTROLLER DESIGN; ADAPTIVE OPTIMAL CONTROL; CLOSED-LOOP PERFORMANCE; CONTINUOUS VARIABLES; CONVERGENCE RESULTS; ENVIRONMENTAL INTERACTIONS; LINEAR STOCHASTIC SYSTEMS; OPTIMAL POLICIES; ORDER-REDUCTION; STOCHASTIC SYSTEMS;

ADAPTIVE CONTROL SYSTEMS;

EID: 52449107590     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACC.2008.4586466     Document Type: Conference Paper

References (17)

1. Steven J. Bradtke, B. Erik Ydstie, and Andrew G. Barto. Adaptive linear quadratic control using policy iteration. In Proceedings of the American Control Conference, pages 3475-3476, 1994.
2. R.S. Sutton, A.G. Barto, and R.J. Williams. Reinforcement learning is direct adaptive optimal control. In Proceedings of the 1991 American Control Conference, Boston, Massachusetts, 1991.
3. C.J. Watkins. Learning from Delayed Rewards. PhD thesis, Cambridge University, 1989.
4. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT-Press, 1998.
5. Richard E. Bellman. Dynamic Programming. Princeton University Press, Princeton, NJ, 1957.
6. T. Landelius. Reinforcement Learning and Distributed Local Model Synthesis. PhD thesis, Linkoping University, Sweden, 1997.
7. Asama Al-Tamimi, Frank L. Lewis, and Murad Abu-Khalaf. Model-free q-learning designs for linear discrete-time zero-sum games with application to h-infinity control. Automatica, 43:473-481, 2007.
8. S. Hagen and B. Krose. Linear quadratic regulation using reinforcement learning. In Belgian-Dutch Conference on Machine Learning, pages 39-46, 1998.
9. S. H.G. ten Hagen. Continuous State Space Q-Learning for Control of Nonlinear Systems. PhD thesis, University of Amsterdam, 2001.
10. L. Ljung. System Identification: Theory for the User. PTR Prentice Hall, Upper Saddle River, N.J, 2nd edition, 1999.
11. M.H. Hsiao, J.K. Huang, and D.E. Cox. Journal of Dynamic Systems, Measurement and Control, 118(2):366-372, 1996.
12. Joe Qin. An overview of subspace identification. Computers and Chemical Engineering, 30:1502-1513, 2006.
13. Goro Obinata and Brian D.O. Anderson. Model Reduction for Control System Design. Springer, 2000.
14. D. Bertsekas. Dynamic Programming and Optimal Control. Athena Scientific, 2000.
15. Steven Bradtke. Incremental Dynamic Programming for On-Line Adaptive Optimal Control. PhD thesis, University of Massachusetts, Amherst, 1994.
16. G. Goodwin and K. Sin. Adaptive Filtering Prediction and Control. 1984.
17. Dale E. Seborg, Thomas F. Edgar, and Duncan A. Mellichamp. Process Dynamics and Control. Wiley, 2nd edition, 2003.