Learning continuous-action control policies

2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, ADPRL 2009 - Proceedings

Volumn , Issue , 2009, Pages 169-176

  Pazis, Jason ^a   G Lagoudakis, Michail ^a  

^a TECHNICAL UNIVERSITY OF CRETE   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POLICIES; ACTION SPACES; BINARY DECISION; CONTINUOUS STATE; CONTINUOUS STATE SPACE; CONTROL POLICY; DISCRETIZATION; EFFICIENT METHOD; INVERTED PENDULUM; LEAST SQUARE; POLICY ITERATION; Q-LEARNING; REAL-WORLD PROBLEM; STOCHASTIC PROCESS;

DYNAMIC PROGRAMMING; EDUCATION; REINFORCEMENT; REINFORCEMENT LEARNING; SYSTEMS ENGINEERING;

LEARNING ALGORITHMS;

EID: 67650505310     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2009.4927541     Document Type: Conference Paper

References (17)

1. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. Cambridge, Massachusetts: The MIT Press, 1998.
2. C. J. C. H. Watkins, "Learning from delayed rewards," Ph.D. dissertation, Cambridge University, Cambridge, United Kingdom, 1989.
3. D. Ernst, P. Geurts, and L. Wehenkel, "Tree-based batch mode reinforcement learning," Journal of Machine Learning Research, Vol. 6, pp. 503-556, 2005. (Pubitemid 40958851)
4. D. Ormoneit and Ś. Sen, "Kernel-based reinforcement learning," Machine Learning, Vol. 49, no. 2-3, pp. 161-178, 2002. (Pubitemid 34325684)
5. M. G. Lagoudakis and R. Parr, "Least-squares policy iteration," Journal of Machine Learning Research, Vol. 4, pp. 1107-1149, 2003.
6. J. G. Proakis and M. Salehi, Communication Systems Engineering. Prentice Hall, 2001.
7. C. Gaskett, D. Wettergreen, and E. Zelinsky, "Q-learning in continuous state and action spaces," in Proceedings of the 12th Australian Joint Conference on Artificial Intelligence. Springer-Verlag, 1999, pp. 417-428.
8. H. M. Gross, V. Stephan, and M. Krabbes, "A neural field approach to topological reinforcement learning in continuous action spaces," in Proceedings of the International Joint Conference on Neural Networks, 1998, pp. 1992-1997.
9. T. Strösslin and W. Gerstner, "Reinforcement learning in continuous state and action space," in International Conference on Artificial Neural Networks, 2003.
10. C. Touzet, "Neural reinforcement learning for behaviour synthesis," Robotics and Autonomous Systems, Vol. 22, pp. 251-281, 1997. (Pubitemid 127398213)
11. A. Lazaric, M. Restelli, and A. Bonarini, "Reinforcement learning in continuous action spaces through sequential monte carlo methods," in Advances in Neural Information Processing Systems 20. Cambridge, MA: MIT Press, 2008, pp. 833-840.
12. A. O. Esogbue and W. E. Hearnes, "A learning algorithm for the control of continuous action set-point regulator systems," Journal of Computational Analysis and Applications, Vol. 1, no. 2, pp. 121-234, 1999.
13. B. Sallans and G. E. Hinton, "Reinforcement learning with factored states and actions," Journal of Machine Learning Research, Vol. 5, pp. 1063-1088, 2004.
14. J. C. Santamaría, R. S. Sutton, and A. Ram, "Experiments with reinforcement learning in problems with continuous state and action spaces," Adaptive Behavior, Vol. 6, pp. 163-218, 1998.
15. M. Riedmiller, "Application of a self-learning controller with continuous control signals based on the DOE-approach," in Proceedings of the European Symposium on Neural Networks, 1997.
16. H. O. Wang, K. Tanaka, and M. F. Griffin, "An approach to fuzzy control of nonlinear systems: Stability and design issues," IEEE Transactions on Fuzzy Systems, Vol. 4, no. 1, pp. 14-23, 1996. (Pubitemid 126782417)
17. J. Randløv and P. Alstrøm, "Learning to drive a bicycle using reinforcement learning and shaping," in Proceedings of The Fifteenth International Conference on Machine Learning, 1998, pp. 463-471.