Reinforcement learning in continuous action spaces through sequential Monte Carlo methods

Advances in Neural Information Processing Systems 20 - Proceedings of the 2007 Conference

Volumn , Issue , 2007, Pages

  Lazaric, Alessandro ^a   Restelli, Marcello ^a   Bonarini, Andrea ^a  

^a POLITECNICO DI MILANO   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ALGORITHMS; LEARNING ALGORITHMS; REINFORCEMENT LEARNING;

ACTION SPACES; CONTINUOUS ACTIONS; CONTINUOUS STATE; CONTINUOUS STATE SPACE; FAST METHODS; REAL WORLD DOMAIN; REINFORCEMENT LEARNING ALGORITHMS; REINFORCEMENT LEARNINGS; SEQUENTIAL MONTE CARLO METHODS; VALUE FUNCTIONS;

IMPORTANCE SAMPLING;

EID: 85161968592     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. M. Sanjeev Arulampalam, Simon Maskell, Neil Gordon, and Tim Clapp. A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Trans. on Signal Processing, 50(2):174-188, 2002. (Pubitemid 34291500)
2. Leemon C. Baird and A. Harry Klopf. Reinforcement learning with high-dimensional, continuous actions. Technical Report WL-TR-93-117, Wright-Patterson Air Force Base Ohio: Wright Laboratory, 1993.
3. D.P. Bertsekas and J.N. Tsitsiklis. Neural Dynamic Programming. Athena Scientific, Belmont, MA, 1996.
4. Chris Gaskett, DavidWettergreen, and Alexander Zelinsky. Q-learning in continuous state and action spaces. In Australian Joint Conference on Artificial Intelligence, pages 417-428, 2003.
5. L. Jouffe. Fuzzy inference system learning by reinforcement methods. IEEE Trans. on Systems, Man, and Cybernetics-PART C, 28(3):338-355, 1998. (Pubitemid 128748635)
6. H. Kimura and S. Kobayashi. Reinforcement learning for continuous action using stochastic gradient ascent. In 5th Intl. Conf. on Intelligent Autonomous Systems, pages 288-295, 1998.
7. V. R. Konda and J. N. Tsitsiklis. Actor-critic algorithms. SIAM Journal on Control and Optimization, 42(4):1143-1166, 2003.
8. J. S. Liu and E. Chen. Sequential monte carlo methods for dynamical systems. Journal of American Statistical Association, 93:1032-1044, 1998.
9. Jose Del R. Millan, Daniele Posenato, and Eric Dedieu. Continuous-action q-learning. Machine Learning, 49:247-265, 2002. (Pubitemid 34325689)
10. Jan Peters and Stefen Schaal. Policy gradient methods for robotics. In Proceedings of the IEEE International Conference on Intelligent Robotics Systems (IROS), pages 2219-2225, 2006. (Pubitemid 46928224)
11. J. C. Santamaria, R. S: Sutton, and A. Ram. Experiments with reinforcement learning in problems with continuous state and action spaces. Adaptive Behavior, 6:163-217, 1998. (Pubitemid 127175211)
12. Alexander A. Sherstov and Peter Stone. Function approximation via tile coding: Automating parameter choice. In SARA 2005, LNAI, pages 194-205. Springer Verlag, 2005.
13. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
14. Hado van Hasselt and MarcoWiering. Reinforcement learning in continuous action spaces. In 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, pages 272-279, 2007. (Pubitemid 47431396)