Combining declarative, procedural, and predictive knowledge to generate, execute, and optimize robot plans

Robotics and Autonomous Systems

Volumn 56, Issue 11, 2008, Pages 967-979

  Stulp, Freek ^a   Beetz, Michael ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Action models; Experience based learning; Reasoning about actions; Robot plan execution

Indexed keywords

CONTROL THEORY; INFORMATION THEORY; MOTORS; OPTIMIZATION; ROBOTICS; ROBOTS;

ACTION MODELS; EXPERIENCE-BASED LEARNING; REASONING ABOUT ACTIONS; ROBOT PLAN EXECUTION;

CONTROL SYSTEMS;

EID: 53849109145     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2008.08.011     Document Type: Article

References (42)

1. Arkin R. Behavior Based Robotics (1998), MIT Press, Cambridge, MA
2. Barto A., and Mahadevan S. Recent advances in hierarchical reinforcement learning. Discrete Event Systems 13 1-2 (2003) 41-77
3. M. Beetz, T. Belker, XFRMLearn - A system for learning structured reactive navigation plans, in: Proceedings of the 8th International Symposium on Intelligent Robotic Systems, 2000
4. Beetz M., Schmitt T., Hanek R., Buck S., Stulp F., Schröter D., and Radig B. The AGILO robot soccer team - Experience-based learning and probabilistic reasoning in autonomous robot control. Autonomous Robots 17 1 (2004) 55-77
5. T. Belker, Plan projection, execution, and learning for mobile robot control, Ph.D. Thesis, Department of Applied Computer Science, University of Bonn, 2004
6. T. Belker, M. Hammel, J. Hertzberg, Learning to optimize mobile robot navigation based on htn plans, in: Proceedings of the International Conference on Robotics and Automation, ICRA, 2003
7. T. Belker, M. Hammel, J. Hertzberg, Plan projection under the appeal robot control architecture, in: Proceedings of the 8th Conference on Autonomous Intelligent Systems, IAS, 2004
8. A. Bouguerra, L. Karlsson, Symbolic probabilistic-conditional plans execution by a mobile robot, in: IJCAI-05 Workshop: Reasoning with Uncertainty in Robotics, RUR-05, 2005
9. Brock O., and Khatib O. Elastic strips: A framework for motion generation in human environments. International Journal of Robotics Research 21 12 (2002) 1031-1052
10. Buck S., Beetz M., and Schmitt T. M-ROSE: A multi robot simulation environment for learning cooperative behavior. In: Asama H., Arai T., Fukuda T., and Hasegawa T. (Eds). Distributed Autonomous Robotic Systems 5. Lecture Notes in Artificial Intelligence, LNAI (2002), Springer-Verlag
11. S. Buck, M. Riedmiller, Learning situation dependent success rates of actions in a RoboCup scenario, in: Pacific Rim International Conference on Artificial Intelligence, 2000
12. S. Cambon, F. Gravot, R. Alami, A robot task planner that merges symbolic and geometric reasoning., in: Proceedings of the 16th European Conference on Artificial Intelligence, ECAI, 2004
13. P. Carpenter, P.F. Riley, M. Veloso, G. Kaminka, Integration of advice in an action-selection architecture, in: Proceedings of the RoboCup Symposium, 2002
14. Cavaco S., Anderson S., Allen J., Castro-Caldas A., and Damasio H. The scope of preserved procedural memory in amnesia. Brain 127 (2004) 1853-1867
15. S. Coradeschi, A. Saffiotti, Perceptual anchoring of symbols for action, in: Proceedings of the International Joint Conference on Artificial Intelligence, IJCAI, 2001
16. A. Dearden, Y. Demiris, Learning forward models for robotics, in: Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, IJCAI, 2005
17. M. Fox, J. Gough, D. Long, Using learned action models in execution monitoring, in: Proceedings of UK Planning and Scheduling SIG, 2006
18. Fox M., and Long D. PDDL2.1: An extension of PDDL for expressing temporal planning domains. Journal of Artificial Intelligence Research 20 (2003) 61-124
19. K.Z. Haigh, Situation-dependent learning for interleaved planning and robot execution, Ph.D. Thesis, School of Computer Science, Carnegie Mellon University, 1998
20. S. Hart, S. Ou, J. Sweeney, R. Grupen, A framework for learning declarative structure, in: RSS-06 Workshop: Manipulation for Human Environments, 2006
21. Haruno M., Wolpert D.M., and Kawato M. MOSAIC model for sensorimotor learning and control. Neural Computation 13 (2001) 2201-2220
22. G. Infantes, F. Ingrand, M. Ghallab, Learning behavior models for robot execution control, in: Proceedings of the 17th European Conference on Artificial Intelligence, ECAI, 2006
23. M. Isik, F. Stulp, G. Mayer, H. Utz, Coordination without negotiation in teams of heterogeneous robots, in: Proceedings of the RoboCup Symposium, 2006
24. Jacobs R.A., and Jordan M.I. Learning piecewise control strategies in a modular neural network. IEEE Transactions on Systems, Man and Cybernetics 23 3 (1993) 337-345
25. A. Kirsch, M. Beetz, Training on the job - Collecting experience with hierarchical hybrid automata, in: J. Hertzberg, M. Beetz, R. Englert (Eds.), Proceedings of the 30th German Conference on Artificial Intelligence, KI-2007, 2007
26. T. Kollar, N. Roy, Using reinforcement learning to improve exploration trajectories for error minimization, in: Proceedings of the International Conference on Robotics and Automation, ICRA, 2006
27. Matarić M. Behavior-based robotics as a tool for synthesis of artificial behavior and analysis of natural behavior. Trends in Cognitive Science 2 3 (1998) 82-87
28. D. McDermott, The formal semantics of processes in PDDL, in: Proceedings of the ICAPS Workshop on PDDL, 2003
29. J. Nakanishi, R. Cory, M. Mistry, J. Peters, S. Schaal, Comparative experiments on task space control with redundancy resolution, in: IEEE International Conference on Intelligent Robots and Systems, IROS, 2005
30. R. Quinlan, Learning with continuous classes, in: A. Adams, L. Sterling (Eds.), Proceedings of the 5th Australian Joint Conference on Artificial Intelligence, 1992
31. M. Ryan, M. Pendrith, RL-TOPs: An architecture for modularity and re-use in reinforcement learning, in: Proceedings 15th International Conference on Machine Learning, ICML, 1998
32. M.R.K. Ryan, Hierarchical reinforcement learning: A hybrid approach, Ph.D. Thesis, University of New South Wales, School of Computer Science and Engineering, 2004
33. Schaal S., and Schweighofer N. Computational motor control in humans and robots. Current Opinion in Neurobiology 15 (2005) 675-682
34. M.D. Schmill, T. Oates, P.R. Cohen, Learning planning operators in real-world, partially observable environments, in: Proceedings of the 5th International Conference on Artificial Intelligence Planning Systems, ICAPS, 2000
35. Scoville W.B., and Milner B. Loss of recent memory after bilateral hippocampal lesions. Journal of Neurology, Neurosurgery and Psychiatry 20 (1957) 11-21
36. G. Simmons, Y. Demiris, Biologically inspired optimal robot arm control with signal-dependent noise, in: Proceedings of IEEE International Conference on Intelligent Robots and Systems, IROS, 2004
37. F. Stulp, Tailoring robot actions to task contexts using action models, Ph.D. Thesis, Technische Universität München, 2007
38. F. Stulp, M. Isik, M. Beetz, Implicit coordination in robotic teams using learned prediction models, in: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA, 2006
39. Vijayakumar S., D'Souza A., and Schaal S. Incremental online learning in high dimensions. Neural Computation 17 12 (2005) 2602-2634
40. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques. 2nd ed. (2005), Morgan Kaufmann, San Francisco
41. Wolpert D., and Ghahramani Z. Computational principles of movement neuroscience. Nature Neuroscience Supplement 3 (2000) 1212-1217
42. Younes H.L.S., and Simmons R.G. VHPOP: Versatile heuristic partial order planner. Journal of Artificial Intelligence Research 20 (2003) 405-430