Approximating the value function for continuous space reinforcement learning in robot control

IEEE International Conference on Intelligent Robots and Systems

Volumn 1, Issue , 2002, Pages 1062-1067

  Buck, Sebastian ^a   Beetz, Michael ^a   Schmitt, Thorsten ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; MATHEMATICAL MODELS; MOBILE ROBOTS; MOTION CONTROL; NEURAL NETWORKS; STATE SPACE METHODS;

CONTINUOUS SPACE VALUE FUNCTION; REINFORCEMENT LEARNING; ROBOT CONTROL;

ROBOT LEARNING;

EID: 0036453749     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. M. Asada, S. Tawaratsumida, and K. Hosoda: Purposive Behavior Acquisition for a Real Robot by Vision-Based Reinforcement Learning. Machine Learning Journal, 23:279-303, 1996.
2. J. Barraquand, B. Langlois, and J. Latombe: Numerical potential field techniques for robot path planning. IEEE Transactions on Systems, Man, Cybernetics, 22(2):224-241, March/April 1992.
3. D. Bertsekas, and J. Tsitsiklis: Neuro-Dynamic Programming. Athena Scientific, Belmont MA, 1996.
4. J. Boyan and A. Moore: Generalization in Reinforcement Learning: Safely approximating the value function. In Tesauro, G., D. S. Touretzky, and T. K. Leen (eds.), Advances in Neural Information Processing Systems 7 (NIPS). MIT Press, 1995.
5. S. Buck, M. Beetz, and T. Schmitt: M-ROSE: A Multi Robot Simulation Environment for Learning Cooperative Behavior. In H. Asama, T. Arai, T. Fukuda, and T. Hasegawa (eds.): Distributed Autonomous Robotic Systems 5, Springer Verlag, 2002.
6. K. Doya: Reinforcement Learning In Continuous Time and Space. Neural Computation, 12, 219-245, 2000.
7. J. Forbes and D. Andre: Real-time reinforcement learning in continuous domains. AAAI Spring Symposium on Real-Time Autonomous Systems. 2000.
8. Z. Kalmar, C. Szepesvari, and A. Lorincz: Module Based Reinforcement Learning for a Real Robot. Proceedings of the 6th European Workshop on Learning Robots, Lecture Notes in AI. 1998.
9. A. McCallum: Reinforcement Learning with Selective Perception and Hidden State. PhD thesis, 1995.
10. A. Moore and C. Atkeson: The Parti-game Algorithm for Variable Resolution Reinforcement Learning in Multidimensional State-spaces. Machine Learning Journal, 21(3):199-233, 1995.
11. R. Munos and A. Moore: Barycentric Interpolators for Continuous Space & Time Reinforcement Learning, Advances in Neural Information Processing Systems 11, May 1999.
12. M. Riedmiller and A. Merke: Karlsruhe Brainstormers - a reinforcement learning approach to robotic soccer II. In 5th International Workshop on RoboCup, Lecture Notes in Artificial Intelligence, 2001, Springer Verlag.
13. M. Riedmiller and H. Braun: A direct adaptive method for faster backpropagation learning: the Rprop algorithm, Proceedings of the ICNN, San Francisco, 1993.
14. W.D. Smart and L.P. Kaelbling: Practical Reinforcement Learning in Continuous Spaces. In Proceedings of the Seventeenth International Conference on Machine Learning, pp. 903-910, 2000.
15. P. Stone and R. Sutton: Scaling Reinforcement Learning toward RoboCup Soccer. Eighteenth International Conference on Machine Learning, 2001.
16. R.S. Sutton and A.G. Barto: Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
17. M. Takeda, T. Nakamura, and T. Ogasawara: Continuous Valued Q-learning Method Able to Incrementally Refine State Space. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, 2001.
18. S. Thrun and A. Schwartz: Issues in Using Function Approximation for Reinforcement Learning. In M. Mozer, P. Smolensky, D. Touretzky, J. Elman, and A. Weigend, editors, Proceedings of the Connectionist Models Summer School, pp. 255-263, Hillsdale, NJ, 1993.
19. C.J. Watkins and P. Dayan: Q-learning. Machine Learning Journal, 8:279-292, 1992.
20. P. Werbos: A menu of designs for reinforcement learning over time. In Neural Networks for Control, W.T. Miller, R.S. Sutton, and P.J. Werbos, editors, pp. 67-95, MIT Press, MA, USA, 1990.