Refining the execution of abstract actions with learned action models

Journal of Artificial Intelligence Research

Volumn 32, Issue , 2008, Pages 487-523

  Stulp, Freek ^a   Beetz, Michael ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION MAKING; ROBOTS;

ACTION EXECUTION; ACTION MODELS; ACTION SEQUENCES; COURSE OF ACTION; PERFORMANCE MODEL; ROBOT ACTIONS; SEARCH SPACES; SPECIFIC TASKS;

ABSTRACTING;

EID: 52249100592     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.2479     Document Type: Article

References (72)

1. Arkin, R. (1998). Behavior based Robotics. MIT Press, Cambridge, Ma.
2. Aström, K. J., & Murray, R. M. (2008). Feedback Systems: An Introduction for Scientists and Engineers, chap. Supplement on optimization-based control. Princeton University Press.
3. Barto, A., & Mahadevan, S. (2003). Recent advances in hierarchical reinforcement learning. Discrete event systems, 13(1-2), 41-77.
4. Beetz, M., & Belker, T. (2000). XFRMLearn - a system for learning structured reactive navigation plans. In Proceedings of the 8th International Symposium on Intelligent Robotic Systems.
5. Beetz, M. (2000). Concurrent Reactive Plans: Anticipating and Forestalling Execution Failures, Vol. LNAI 1772 of Lecture. Notes in Artificial Intelligence. Springer Publishers.
6. Beetz, M. (2001). Structured Reactive Controllers. Journal of Autonomous Agents and Multi-Agent Systems. Special Issue: Best Papers of the International Conference on Autonomous Agents '99, 4, 25-55.
7. Beetz, M., Schmitt, T., Hanek, R., Buck, S., Stulp, F., Schröter, D., & Radig, B. (2004). The AGILO robot soccer team - experience-based learning and probabilistic reasoning in autonomous robot control. Autonomous Robots, 17(1), 55-77.
8. Belker, T. (2004). Plan Projection, Execution, and Learning for Mobile Robot Control. Ph.D. thesis, Department of Applied Computer Science, University of Bonn.
9. Bellingham, J., Richards, A., & How, J. P. (2002). Receding horizon control of autonomous aerial vehicles. In Proceedings of the 2002 American Control Conference, Vol. 5, pp. 3741-3746.
10. Benson, S. (1995). Inductive learning of reactive action models. In International Conference on Machine Learning (ICML), pp. 47-54.
11. Bertram, D., Kuffner, J., Dillmann, R., & Asfour, T. (2006). An integrated approach to inverse kinematics and path planning for redundant manipulators. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 1874-1879.
12. Bouguerra, A., & Karlsson, L. (2005). Symbolic probabilistic- conditional plans execution by a mobile robot. In IJCAI-05 Workshop: Reasoning with Uncertainty in Robotics (RUR-05).
13. Brock, O., & Khatib, O. (1999). Elastic Strips: A framework for integrated planning and execution. In Proceedings of the International Symposium on Experimental Robotics, pp. 329-338.
14. Buck, S., Beetz, M., & Schmitt, T. (2002a). M-ROSE: A Multi Robot Simulation Environment for Learning Cooperative Behavior. In Asama, H., Arai, T., Fukuda, T., & Hasegawa, T. (Eds.), Distributed Autonomous Robotic Systems 5, Lecture Notes in Artificial Intelligence, LNAI. Springer-Verlag.
15. Buck, S., Beetz, M., & Schmitt, T. (2002b). Reliable Multi Robot Coordination Using Minimal Communication and Neural Prediction. In Beetz, M., Hertzberg, J., Ghallab, M., & Pollack, M. (Eds.), Advances in Plan-based Control of Autonomous Robots. Selected Contributions of the Dagstuhl Seminar "Plan-based Control of Robotic Agents", Lecture Notes in Artificial Intelligence. Springer.
16. Buck, S., & Riedmiller, M. (2000). Learning situation dependent success rates of actions in a RoboCup scenario. In Pacific Rim International Conference on Artificial Intelligence, p. 809.
17. Cambon, S., Gravot, F., & Alami, R. (2004). A robot task planner that merges symbolic and geometric reasoning.. In Proceedings of the 16th European Conference on Artificial Intelligence (ECAI), pp. 895-899.
18. Clement, B. J., Durfee, E. H., & Barrett, A. C. (2007). Abstract reasoning for planning and coordination. Journal of Artificial Intelligence Research, 28, 453-515.
19. Coradeschi, S., & Saffiotti, A. (2001). Perceptual anchoring of symbols for action. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pp. 407-416.
20. Dean, T., & Wellmann, M. (1991). Planning and Control. Morgan Kaufmann Publishers.
21. Dearden, A., & Demiris, Y. (2005). Learning forward models for robotics. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI), pp. 1440-1445.
22. Dietterich, T. G. (2000). Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research, 13, 227-303.
23. Fox, M., & Long, D. (2003). PDDL2.1: An extension of PDDL for expressing temporal planning domains.. Journal of Artificial Intelligence Research, 20, 61-124.
24. Fox, M., Ghallab, M., Infantes, G., & Long, D. (2006). Robot introspection through learned hidden markov models. Artificial Intelligence, 170(2), 59-113.
25. Gabel, T., Hafner, R., Lange, S., Lauer, M., & Riedmiller, M. (2006). Bridging the gap: Learning in the RoboCup simulation and midsize league. In Proceedings of the 7th Portuguese Conference on Automatic Control.
26. Gerkey, B., Vaughan, R. T., & Howard, A. (2003). The Player/Stage Project: Tools for multirobot and distributed sensor systems. In Proceedings of the 11th International Conference on Advanced Robotics (ICAR), pp. 317-323.
27. Ginsberg, M. L. (1989). Universal planning: an (almost) universally bad idea. AI Magazine, 10(4), 40-44.
28. Goldberg, D. E. (1989). Genetic Algorithms in Search, Optimization and Machine Learning. Kluwer Academic Publishers.
29. Haigh, K. Z. (1998). Situation-Dependent Learning for Interleaved Planning and Robot Execution. Ph.D. thesis, School of Computer Science, Carnegie Mellon University.
30. Harris, C. M., & Wolpert, D. M. (1998). Signal-dependent noise determines motor planning. Nature, 394(20), 780-784.
31. Hart, S., Ou, S., Sweeney, J., & Grupen, R. (2006). A framework for learning declarative structure. In Workshop on Manipulation for Human Environments, Robotics: Science, and Systems.
32. Haruno, M., Wolpert, D. M., & Kawato, M. (2001). MOSAIC model for sensorimotor learning and control. Neural Computation, 13, 2201-2220.
33. Haruno, M., Wolpert, D. M., & Kawato, M. (1999). Multiple paired forward-inverse models for human motor learning and control. In Proceedings of the 1998 conference on Advances in neural information processing systems II, pp. 31-37, Cambridge, MA, USA. MIT Press.
34. Hoffmann, J., & Düffert, U. (2004). Frequency space representation and transitions of quadruped robot gaits. In Proceedings of the 27th Australasian computer science conference (ACSC), pp. 275-278.
35. Infantes, G., Ingrand, F., & Ghallab, M. (2006). Learning behavior models for robot execution control. In Proceedings of the 17th European Conference on Artificial Intelligence (ECAI), pp. 678-682.
36. Isik, M., Stulp, F., Mayer, G., & Utz, H. (2006). Coordination without negotiation in teams of heterogeneous robots. In Proceedings of the RoboCup Symposium, pp. 355-362.
37. Jacobs, R. A., & Jordan, M. I. (1993). Learning piecewise control strategies in a modular neural network. IEEE Transactions on Systems, Man and Cybernetics, 23(3), 337-345.
38. Jaeger, H., & Christaller, T. (1998). Dual dynamics: Designing behavior systems for autonomous robots. Artificial Life and Robotics, 2(3), 108-112.
39. Jordan, M. I., & Rumelhart, D. E. (1992). Forward models: Supervised learning with a distal teacher. Cognitive Science, 16, 307-354.
40. Kirsch, A., & Beetz, M. (2007). Training on the job - collecting experience with hierarchical hybrid automata. In Hertzberg, J., Beetz, M., & Englert, R. (Eds.), Proceedings of the 30th German Conference on Artificial Intelligence (RI-2007), pp. 473-476.
41. Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., & Osawa, E. (1997). RoboCup: The robot world cup initiative. In Proceedings of the first international conference on autonomous agents (AGENTS), pp. 340-347.
42. Kollar, T., & Roy, N. (2006). Using reinforcement learning to improve exploration trajectories for error minimization. In Proceedings of the International Conference on Robotics and Automation (ICRA), pp. 3338-3343.
43. Koska, W. (2006). Optimizing autonomous service robot plans by tuning unbound action parameters. Master's thesis, Technische Universiät München.
44. Kovar, L., & Gleicher, M. (2003). Flexible automatic motion blending with registration curves. In Proceedings of the 2003 ACM SIG GRAPH/Eurographics symposium on computer animation (SCA), pp. 214-224.
45. Müller, A., Beetz, M. (2006). Designing and implementing a plan library for a simulated household robot. In Beetz, M., Rajan, K., Thielscher, M., & Rusu, R. B. (Eds.), Cognitive Robotics: Papers from the AAAI Workshop, Technical Report WS-06-03, pp. 119-128, Menlo Park, California. American Association for Artificial Intelligence.
46. Nakanishi, J., Cory, R., Mistry, M., Peters, J., & Schaal, S. (2005). Comparative experiments on task space control with redundancy resolution. In IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 3901-3908.
47. Nilsson, N. J. (1984). Shakey the robot. Tech. rep. 323, AI Center, SRI International.
48. Nilsson, N. J. (1994). Teleo-reactive programs for agent control. Journal of Artificial Intelligence Research, 1, 139-158.
49. Perlin, K. (1995). Real time responsive animation with personality. IEEE Transactions on Visualization and Computer Graphics, 1(1), 5-15.
50. th Australian Joint Conference on Artificial Intelligence, pp. 343-348.
51. Russell, S., & Norvig, P. (2003). Artificial Intelligence - A Modern Approach. Prentice Hall, Upper Saddle River, New Jersey.
52. Ryan, M., & Pendrith, M. (1998). RL-TOPs: an architecture for modularity and re-use in reinforcement learning. In Proceedings 15th International Conference on Machine Learning (ICML), pp. 481-487.
53. Saffiotti, A., Ruspini, E. H., & Konolige, K. (1993). Blending reactivity and goal-directedness in a fuzzy controller. In Proceedings of the IEEE International Conference on Fuzzy Systems, pp. 134-139, San Francisco, California. IEEE Press.
54. Schaal, S., & Schweighofer, N. (2005). Computational motor control in humans and robots. Current Opinion in Neurobiology, 15, 675-682.
55. Schmill, M. D., Oates, T., & Cohen, P. R. (2000). Learning planning operators in real-world, partially observable environments. In Proceedings of the 5th International Conference on Artificial Intelligence Planning Systems (ICAPS), pp. 246-253.
56. Shahaf, D., & Amir, E. (2006). Learning partially observable action schemas.. In Proceedings of the 21st National Conference on Artificial Intelligence (AAAI).
57. Simmons, G., & Demiris, Y. (2004). Biologically inspired optimal robot arm control with signal-dependent noise. In Proceedings of IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 491-496.
58. Smith, D., Frank, J., & Jonsson, A. (2000). Bridging the gap between planning and scheduling. Knowledge Engineering Review, 15(1), 47-83.
59. Stulp, F. (2007). Tailoring Robot Actions to Task Contexts using Action Models. Ph.D. thesis, Technische Universität München.
60. Stulp, F., & Beetz, M. (2005). Optimized execution of action chains using learned performance models of abstract actions. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI).
61. Stulp, F., Isik, M., & Beetz, M. (2006). Implicit coordination in robotic teams using learned prediction models. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 1330-1335.
62. Stulp, F., Koska, W., Maldonado, A., & Beetz, M. (2007). Seamless execution of action sequences. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 3687-3692.
63. Sussman, G. J. (1973). A computational model of skill acquisition. Ph.D. thesis, Massachusetts Institute of Technology.
64. Thrun, S. et al. (2006). Stanley, the robot that won tFhe DARPA grand challenge. Journal of Field Robotics, 23(9), 661-692.
65. Todorov, E., Li, W., & Pan, X. (2005). From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators. Journal of Robotic Systems, 22(11), 691-710.
66. Uno, Y., Wolpert, D. M., Kawato, M., & Suzuki, R. (1989). Formation and control of optimal trajectory in human multijoint arm movement - minimum torque-change model. Biological Cybernetics, 61(2), 89-101.
67. Utz, H., Kraetzschmar, G., Mayer, G., & Palm, G. (2005). Hierarchical behavior organization. In Proceedings of the 2005 International Conference on Intelligent Robots and Systems (IROS), pp. 2598-2605.
68. Wimmer, M., Stulp, F., Pietzsch, S., & Radig, B. (2008). Learning local objective functions for robust face model fitting. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 30(8). to appear.
69. Witten, I. H., & Frank, E. (2005). Data Mining: Practical machine learning tools and techniques (2nd edition). Morgan Kaufmann, San Francisco.
70. Wolpert, D., & Ghahramani, Z. (2000). Computational principles of movement neuroscience. Nature Neuroscience Supplement, 3, 1212-1217.
71. Wolpert, D. M., & Flanagan, J. (2001). Motor prediction. Current Biology, 11(18), 729-732.
72. Younes, H. L. S., & Simmons, R. G. (2003). VHPOP: Versatile heuristic partial order planner. Journal of Artificial Intelligence Research, 20, 405-430.