Symbol acquisition for task-level planning

AAAI Workshop - Technical Report

Volumn WS-13-12, Issue , 2013, Pages 9-15

  Konidaris, George ^a   Kaelbling, Leslie Pack ^a   Lozano Perez, Tomas ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACT REPRESENTATION; CONTINUOUS STATE SPACE; REINFORCEMENT LEARNING AGENT; SYMBOLIC REPRESENTATION;

REINFORCEMENT LEARNING;

EID: 84898878959     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Amir, E., and Chang, A. 2008. Learning partially observable deterministic action models. Journal of Artificial Intelligence Research 33:349-402.
2. Barto, A., and Mahadevan, S. 2003. Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems 13:41-77.
3. Burridge, R.; Rizzi, A.; and Koditschek, D. 1999. Sequential composition of dynamically dextrous robot behaviors. International Journal of Robotics Research 18(6):534-455.
4. Cambon, S.; Alami, R.; and Gravot, F. 2009. A hybrid approach to intricate motion, manipulation and task planning. International Journal of Robotics Research 28(1):104-126.
5. Choi, J., and Amir, E. 2009. Combining planning and motion planning. In Proceedings of the IEEE International Conference on Robotics and Automation, 4374-4380.
6. Dean, T., and Givan, R. 1997. Model minimization in Markov decision processes. In In Proceedings of the Fourteenth National Conference on Artificial Intelligence, 106-111.
7. Dornhege, C.; Gissler, M.; Teschner, M.; and Nebel, B. 2009. Integrating symbolic and geometric planning for mobile manipulation. In IEEE International Workshop on Safety, Security and Rescue Robotics.
8. Drescher, G. 1991. Made-Up Minds: A Constructivist Approach to Artificial Intelligence. MIT Press.
9. Džeroski, S.; De Raedt, L.; and Driessens, K. 2001. Relational reinforcement learning. Machine learning 43(1):7-52. (Pubitemid 32286614)
10. Fikes, R., and Nilsson, N. 1971. STRIPS: a new approach to the application of theorem proving to problem solving. Artificial Intelligence 2:189-208.
11. Ghallab, M.; Nau, D.; and Traverso, P. 2004. Automated planning: theory and practice. Morgan Kaufmann.
12. Hall, M.; Frank, E.; Holmes, G.; Pfahringer, B.; Reutemann, P.; and Witten, I. 2009. The WEKA data mining software: An update. SIGKDD Explorations 11(1):10-18.
13. Hart, S. 2009. The Development of Hierarchical Knowledge in Robot Systems. Ph.D. Dissertation, University of Massachusetts Amherst.
14. Huber, M. 2000. A hybrid architecture for hierarchical reinforcement learning. In Proceedings of the 2000 IEEE International Conference on Robotics and Automation, 3290-3295.
15. Kaelbling, L., and Lozano-Pérez, T. 2011. Hierarchical planning in the Now. In Proceedings of the IEEE Conference on Robotics and Automation.
16. Kocsis, L., and Szepesvári, C. 2006. Bandit based monte-carlo planning. In Proceedings of the 17th European Conference on Machine Learning, 282-293.
17. Konidaris, G., and Barto, A. 2007. Building portable options: Skill transfer in reinforcement learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence.
18. Konidaris, G., and Barto, A. 2009a. Efficient skill learning using abstraction selection. In Proceedings of the Twenty First International Joint Conference on Artificial Intelligence.
19. Konidaris, G., and Barto, A. 2009b. Skill discovery in continuous reinforcement learning domains using skill chaining. In Advances in Neural Information Processing Systems 22, 1015-1023.
20. Kruger, N.; Geib, C.; Piater, J.; Petrick, R.; Steedman, M.; Wörgötter, F.; Ude, A.; Asfour, T.; Kraft, D.; Omrčen, D.; Agostini, A.; and Dillmann, R. 2011. Object-action complexes: Grounded abstractions of sensory-motor processes. Robotics and Autonomous Systems 59:740-757.
21. Lang, T.; Toussaint, M.; and Kersting, K. 2012. Exploration in relational domains for model-based reinforcement learning. Journal of Machine Learning Research 13:3691-3734.
22. Lozano-Perez, T.; Mason, M.; and Taylor, R. 1984. Automatic synthesis of fine-motion strategies for robots. International Journal of Robotics Research 3(1):3-24. (Pubitemid 14582596)
23. Malcolm, C., and Smithers, T. 1990. Symbol grounding via a hybrid architecture in an autonomous assembly system. Robotics and Autonomous Systems 6(1-2): 123-144. (Pubitemid 20698149)
24. Modayil, J., and Kuipers, B. 2008. The initial development of object knowledge by a learning robot. Robotics and Autonomous Systems 56(11):879-890.
25. Mourão, K.; Zettlemoyer, L.; Patrick, R.; and Steedman, M. 2012. Learning strips operators from noisy and incomplete observations. In Proceedings of Conference on Uncertainty in Articial Intelligence.
26. Mugan, J., and Kuipers, B. 2012. Autonomous learning of high-level states and actions in continuous environments. IEEE Transactions on Autonomous Mental Development 4(1):70-86.
27. Munos, R., and Moore, A. 1999. Variable resolution discretization for high-accuracy solutions of optimal control problems. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, 1348-1355.
28. Nguyen, H., and Kemp, C. 2011. Autonomous active learning of task-relevant features for mobile manipulation. In The RSS 2011 Workshop on Mobile Manipulation: Learning to Manipulate.
29. Nilsson, N. 1984. Shakey the robot. Technical report, SRI International.
30. Pasula, H.; Zettlemoyer, L.; and Kaelbling, L. 2007. Learning symbolic models of stochastic domains. Journal of Artificial Intelligence Research 29:309-352. (Pubitemid 47477595)
31. Powley, E.; Whitehouse, D.; and Cowling, P. 2012. Monte carlo tree search with macro-actions and heuristic route planning for the physical travelling salesman problem. In Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games, 234-241.
32. Precup, D. 2000. Temporal Abstraction in Reinforcement Learning. Ph.D. Dissertation, Department of Computer Science, University of Massachusetts Amherst.
33. Quinlan, J. 1993. C4.5: programs for machine learning, volume 1. Morgan Kaufmann.
34. Schmill, M.; Oates, T.; and Cohen, P. 2000. Learning planning operators in real-world, partially observable environments. In Proceedings of the Fifth International Conference on Artificial Intelligence Planning and Scheduling, 245-253.
35. Sorg, J., and Singh, S. 2010. Linear options. In Proceedings of the Ninth International Conference on Autonomous Systems and Multiagent Systems, 31-38.
36. Sutton, R.; Precup, D.; and Singh, S. 1999. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112(1-2):181-211. (Pubitemid 32079890)
37. Tedrake, R. 2009. LQR-Trees: Feedback motion planning on sparse randomized trees. In Proceedings of Robotics: Science and Systems, 18-24.
38. Wolfe, J.; Marthi, B.; and Russell, S. J. 2010. Combined Task and Motion Planning for Mobile Manipulation. In Proceedings of the Twentieth International Conference on Automated Planning and Scheduling, 254-258.