Speeding up reinforcement learning using manifold representations: Preliminary results

IJCAI 2005 Workshop on Reasoning with Uncertainty in Robotics, RUR 2005

Volumn , Issue , 2005, Pages 62-77

  Glaubius, Robert ^a   Namihira, Motoi ^a   Smart, William D ^a  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS STATE SPACE; PLANNING UNDER UNCERTAINTY; ROBOT SYSTEM;

ARTIFICIAL INTELLIGENCE; REINFORCEMENT LEARNING; ROBOTICS;

ROBOT PROGRAMMING;

EID: 84883103659     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. J. S. Albus. A new approach to manipulator control: The cerebellar model articulation controller (CMAC). Journal of Dynamic Systems, Measurement and Control, pages 220-227, 1975.
2. C. Boutilier, R. Dearden, and M. Goldszmidt. Stochastic dynamic programming with factored representations. Artificial Intelligence, 121(1-2):49-107, 2000.
3. J. A. Boyan and A. W. Moore. Generalization in reinforcement learning: Safely approximating the value function. In G. Tesauro, D. S. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems, volume 7, pages 369-376, 1995.
4. R. Glaubius and W. D. Smart. Manifold representations for value-function approximation. In Working Notes of the Workshop on Markov Decision Processes, AAAI 2004, San Jose, California, USA, 2004.
5. R. Glaubius and W. D. Smart. Manifold representations for continuous-state reinforcement learning. Technical Report WUCSE-2005-19, Department of Computer Science and Engineering, Washington University in St. Louis, 2005.
6. C. M. Grimm and J. F. Hughes. Modeling surfaces of arbitrary topology using manifolds. Computer Graphics, 29(2), 1995. Proceedings of SIGGRAPH '95.
7. T. Lane and A. Wilson. Toward a topological theory of relational reinforcement learning for navigation tasks. In Proceedings of the Eighteenth International Florida Artificial Intelligence Research Society Conference (FLAIRS-2005), 2005.
8. A. McGovern, D. Precup, B. Ravindran, S. Singh, and R. S. Sutton. Hierarchical optimal control of MDPs. In Proceedings of the Tenth Yale Workshop on Adaptive and Learning Systems, pages 186-191, 1998.
9. A. Moore and C. Atkeson. Prioritized sweeping: Reinforcement learning with less data and less real time. Machine Learning, 13:103-130, 1993.
10. R. Munos and A. Moore. Variable resolution discretization for high-Accuracy solutions of optimal control problems. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJCAI '99), pages 1348-1355, 1999.
11. W. D. Smart and L. P. Kaelbling. Practical reinforcement learning in continuous spaces. In Proceedings of the Seventeenth International Conference on Machine Learning (ICML-2000), pages 903-910, 2000.
12. P. Stone and R. S. Sutton. Scaling reinforcement learning toward robocup soccer. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML-2001), 2001.
13. R. S. Sutton. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems, volume 8, pages 1038-1044, 1996.
14. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. Adaptive Computations and Machine Learning. The MIT Press, Cambridge, MA, 1998.
15. G. J. Tesauro. Practical issues in temporal difference learning. Machine Learning, 8(3/4):257-277, 1992.
16. S. Thrun and A. Schwartz. Finding structure in reinforcement learning. In Advances in Neural Information Processing Systems 7. MIT Press., 1995.
17. C. J. C. H. Watkins and P. Dayan. Q-learning. Machine Learning, 8:279-292, 1992.