Learning to behave in space: A qualitative spatial representation for robot navigation with reinforcement learning

International Journal on Artificial Intelligence Tools

Volumn 17, Issue 3, 2008, Pages 465-482

  Frommberger, Lutz ^a  

^a UNIVERSITY OF BREMEN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AGENTS; EDUCATION; NAVIGATION; NAVIGATION SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOTICS; STABILIZERS (AGENTS);

ABSTRACTION MECHANISMS; APPLIED (CO); LANDMARK (CO); METRICS (CO); MOVING DIRECTION; NAVIGATION BEHAVIORS; RELATIVE POSITIONING; ROBOT NAVIGATION; SPATIAL REPRESENTATIONS; STRUCTURAL KNOWLEDGE; UNKNO WN ENVIRONMENTS;

KNOWLEDGE REPRESENTATION;

EID: 46249125542     PISSN: 02182130     EISSN: None     Source Type: Journal    
DOI: 10.1142/S021821300800400X     Document Type: Conference Paper

References (19)

1. Lutz Frommberger. A generalizing spatial representation for robot navigation with reinforcement learning. In Proceedings of the Twentieth International Florida Artificial Intelligence Research Society Conference (FLAIRS-2007), pages 586-591, Key West, FL, May 2007. AAAI Press.
2. Sebastian Thrun and Anton Schwartz. Finding structure in reinforcement learning. In G. Tesauro, D. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems: Proceedings of the 1994 Conference, volume 7. MIT Press, Cambrige, MA, 1995.
3. Terran Lane and Andrew Wilson. Toward a topological theory of relational reinforcement learning for navigation tasks. In Proceedings of the Eighteenth International Florida Artificial Intelligence Research Society Conference (FLAIRS-2005), 2005.
4. Arthur P. S. Braga and Aluizio F. R. Araújo. A topological reinforcement learning agent for navigation. Neural Computing and Applications, 12:220-236, 2003.
5. Robert Glaubius, Motoi Namihira, and William D. Smart. Speeding up reinforcement learning using manifold representations: Preliminary results. In Proceedings of the IJCAI Workshop "Reasoning with Uncertainty in Robotics", Edinburgh, Scotland, July 2005.
6. Sridhar Mahadevan and Mauro Maggioni. Value function approximation with diffusion wavelets and laplacian eigenfunctions. In Y. Weiss, B. Schölkopf, and J. Platt, editors, Advances in Neural Information Processing Systems: Proceedings of the 2005 conference, volume 18, pages 843-850. MIT Press, Cambridge, MA, 2006.
7. Matthew E. Taylor and Peter Stone. Cross-domain transfer for reinforcement learning. In Proceedings of the Twenty Fourth International Conference on Machine Learning (ICML 2007), Corvallis, Oregon, June 2007.
8. Lisa Torrey, Jude Shavlik, Trevor Walker, and Richard Maclin. Skill acquisition via transfer learning and advice taking. In Proceedings of the Seventeenth European Conference on Machine Learning (ECML'06), pages 425-436, Berlin, Germany, September 2006.
9. Dídac Busquets, Ramon López de Mántaras, Cales Sierra, and Thomas G. Dietterich. Reinforcement learning for landmark-based robot navigation. In Proceedings of the Autonomous Agents and Multiagent Systems Conference (AAMAS 2002), pages 841-843, Bologna, Italy, 2002.
10. Benjamin Kuipers. The spatial semantic hierarchy. Artificial Intelligence, 119:191-233, 2000.
11. Ralf Röhrig. Repräsentation und Verarbeitung von qualitativem Orientierungswissen. PhD thesis, University of Hamburg, 1998.
12. George D. Konidaris. A framework for transfer in reinforcement learning. In Proceedings of the ICML-06 Workshop on Structural Knowledge Transfer for Machine Learning, Pittsburgh, PA, USA, June 2006.
13. Christoph Schlieder. Reasoning about ordering. In Proceedings bof COSIT'95, volume 988 of Lecture Notes in Computer Science, pages 341-349. Springer, Berlin, Heidelberg, 1995.
14. S. D. Whitehead and D. H. Ballard. Learning to perceive and act by trial and error. Machine Learning, 7(l):45-83, 1991.
15. Paul Crook and Gillian Hayes. Learning in a state of confusion: Perceptual aliasing in grid world navigation. In Proceedings of Towards Intelligent Mobile Robots (TIMR 2003), UWE, Bristol, August 2003.
16. Amitabha Mukerjee and Gene Joe. A qualitative model for space. In Proceedings of the Eighth National Conference on Artificial Intelligence (AAAI), pages 721-727, Boston, MA, August 1990. Morgan Kaufmann.
17. Roop K. Goyal and Max J. Egenhofer. Consistent queries over cardinal directions across different levels of detail. In A. M. Tjoa, R. Wagner, and A. Al-Zobaidie, editors, Proceedings of the 11th International Workshop on Database and Expert System Applications, pages 867-880, Greenwich, UK, September 2000. IEEE Computer Society.
18. Richard S. Sutton. Generalization in reinforcement learning: Successful examples using sparse tile coding. In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems: Proceedings of the 1995 Conference, volume 8, pages 1038-1044. MIT Press, Cambrige, MA, 1996.
19. Christopher Watkins. Learning from Delayed Rewards. PhD thesis, Cambridge University, 1989.