An Integrated Approach of Learning, Planning, and Execution

Journal of Intelligent and Robotic Systems: Theory and Applications

Volumn 29, Issue 1, 2000, Pages 47-78

  García Marit́nez, Ramón ^a   Borrajo, Daniel ^b  

^a UNIVERSIDAD DE BUENOS AIRES   (Argentina)

^b UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

REINFORCEMENT LEARNING;

COMPUTER ARCHITECTURE; PROBLEM SOLVING; ROBOTICS;

LEARNING SYSTEMS;

EID: 0342918631     PISSN: 09210296     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1008134010576     Document Type: Article

References (41)

1. Ashish, N., Knoblock, C., and Levy, A.: 1997, Information gathering plans with sensing actions, in: S. Steel (ed.), Proc. of the 4th European Conf. on Planning, Toulouse, France, pp. 15-27.
2. Barbehenn, M. and Hutchinson, S.: 1991, An integrated architecture for learning and planning in robotic domains, Sigart Bulletin 2(4), 29-33.
3. Bennet, S. W. and DeJong, G.: 1996, Real world robotics: Learning to plan for a robust execution, Machine Learning 23(2/3), 121-162.
4. Borrajo, D. and Veloso, M.: 1997, Lazy incremental learning of control knowledge for efficiently obtaining quality plans, AI Rev. J. Special Issue on Lazy Learning 11(1-5), 371-405.
5. Boutilier, C., Dearden, R., and Goldszmidt, M.: 1995, Exploiting structure in policy construction, in: Proc. of the 14th Internat. Joint Conf. on Artificial Intelligence (IJCAI-95), Montreal, Quebec, Canada, pp. 1104-1111.
6. Brooks, R. A.: 1986, A roboust layered control system for a mobile robot, IEEE J. Robotics Automat. 2(1), 14-23.
7. Calistri-Yeh: 1990, Classifying and detecting plan-based misconceptions for robust plan recognition, PhD Thesis, Department of Computer Science, Brown University.
8. Carbonell, J. G. and Gil, Y.: 1990, Learning by experimentation: The operator refinement method', in: R. S. Michalski and Y. Kodratoff (eds.), Machine Learning: An Artificial Intelligence Approach, Vol. III, Palo Alto, CA: Morgan Kaufmann, pp. 191-213.
9. Cassandra, A., Kaebling, L., and Littman, M.: 1994, Acting optimally in partially observable stochastic domains, in: Proc. of the American Association of Artificial Intelligence (AAAI-94), pp. 1023-1028.
10. Christiansen, A.: 1992, Automatic acquisition of task theories for robotic manipulation, PhD Thesis, School of Computer Science, Carnegie-Mellon University, Pittsburgh, PA.
11. Dean, T. and Givan, R.: 1997, Model minimization in Markov decision processes, in: Proc. of the American Association of Artificial Intelligence (AAAI-97).
12. Falkenhainer, B.: 1990, A unified approach to explanation and theory formation, in: J. Shrager and L. P. (eds), Computational Models of Scientific Discovery and Theory Formation, Morgan Kaufmann.
13. Fernández, F. and Borrajo, D.: 1999, Vector quantization applied to reinforcement learning, in: M. Veloso (ed.), Working notes of the IJCAI'99 3rd Internat. Workshop on Robocup, Stockholm, Sweden, pp. 97-102.
14. Fikes, R. E., Hart, P. E., and Nilsson, N. J.: 1972, Learning and executing generalized robot plans, Artificial Intelligence 3, 251-288.
15. Fikes, R. E. and Nilsson, N. J.: 1971, STRIPS: A new approach to the application of theorem proving to problem solving, Artificial Intelligence 2, 189-208.
16. Fritz, W., García-Martínez, R., Blanqué, J., Rama, A., Adobbati, R., and Samo, M.: 1989, The autonomous intelligent system, Robotics Autonom. Systems 5(2), 109-125.
17. García-Martínez, R. and Borrajo, D.: 1996, Unsupervised machine learning embedded in autonomous intelligent systems, in: Proc. of the 14th IASTED Internat. Conf. on Applied Informatics, Innsbruck, Austria, pp. 71-73.
18. García-Martínez, R. and Borrajo, D.: 1997, Planning, learning, and executing in autonomous systems, in: S. Steel (ed.), Recent Advances in AI Planning, 4th European Conf. on Planning, ECP'97, Toulouse, France, pp. 208-220.
19. García-Martínez, R. and Borrajo, D.: 1998, Learning in unknown environments by knowledge sharing, in: J. Demiris and A. Birk (eds.), Proc. of the 7th European Workshop on Learning Robots, EWLR'98, Edinburgh, Scotland, pp. 22-32.
20. García-Martínez, R.: 1993, Heuristic theory formation as a machine learning method, in: Proc. of the VI Internat. Symposium on Artificial Intelligence, México, pp. 294-298.
21. García-Martínez, R.: 1997, Un Modelo de aprendizaje por observación en planificación, PhD Thesis, Facultad de Informática, Universidad Politécnica de Madrid.
22. Hayes-Roth, F.: 1983, Using proofs and refutations to learn from experience, in: R. S. Michalski, J. G. Carbonell, and T. M. Mitchell (eds.), Machine Learning, An Artificial Intelligence Approach, Palo Alto, CA, Tioga Press, pp. 221-240.
23. Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., and Osawa, E.: 1995, RoboCup: The robot world cup initiative, in: Proc. of the IJCAI-95 Workshop on Entertainment and AI/Life, pp. 19-24.
24. Klingspor V., Morik, K. J., and Rieger, A. D.: 1996, Learning concepts from sensor data of a mobile robot, Machine Learning 23(2/3), 305-000.
25. Langley, P.: 1983, Learning effective search heuristics, in: Proc. of the 8th Internat. Joint Conf. on Artificial Intelligence, Los Altos, CA, pp. 419-421.
26. Lin, L.-J.: 1993, 'Scaling-up reinforcement learning for robot control, in: Proc. of the 10th Internat. Conf. on Machine Learning, Amherst, MA, pp. 182-189.
27. Mahavedan, S. and Connell, J.: 1992, Automatic programming of behavior-based robots using reinforcement learning, Artificial Intelligence 55, 311-365.
28. 2 in the RoboCup domain, in: H. Kitano (ed.), RoboCup-97: Robot Soccer World Cup I, pp. 475-483.
29. Minton, S.: 1988, Learning Effective Search Control Knowledge: An Explanation-Based Approach, Boston, MA, Kluwer Academic, Dordrecht.
30. Mitchell, T.: 1977, Version spaces: A candidate elimination approach to rule learning, in: Proc. of the 5th IJCAI, MIT, Cambridge, MA, pp. 305-310.
31. Safra, S. and Tennenholtz, M.: 1994, On planning while learning, J. Artificial Intell. Res. 2, 111-129.
32. Salzberg, S.: 1985, Heuristics for inductive learning, in: Proc. of the 9th Internat. Joint Conf. on Artificial Intelligence, Los Angeles, CA, pp. 603-609.
33. Shen, W.: 1993, Discovery as autonomous learning from enviroment, Machine Learning 12, 143-165.
34. Simmons, R. and Mitchell, T. M.: 1989, A task control architecture for mobile robots, in: Working Notes of the AAAi Spring Symposium on Robot Navigation.
35. Stone, P. and Veloso, M. M.: 1998, Towards collaborative and adversarial learning: A case study in robotic soccer, Internat. J. Human-Comput. Systems 48.
36. Sutton, R.: 1990, Integrated architectures for learning, planning, and reacting based on approximating dynamic programming, in: Proc. of the 7th Internat. Conf. on Machine Learning, Austin, TX, pp. 216-224.
37. Tan, M.: 1993, Multi-agent reinforcement learning: Independent vs. cooperative agents, in: Proc. of the 10th Internat. Conf. on Machine Learning, Amherst, MA, pp. 330-337.
38. Veloso, M.: 1994, Planning and Learning by Analogical Reasoning, Springer, Berlin.
39. Veloso, M., Carbonell, J., Pérez, A., Borrajo, D., Fink, E., and Blythe, J.: 1995, Integrating planning and learning: The PRODIGY architecture, J. Experim. Theoret. AI 7, 81-120.
40. Wang, X.: 1996, Planning while learning operators, in: B. Drabble (ed.), Proc. of the 3rd Internat. Conf. on Artificial Intelligence Planning Systems (AIPS'96), Edinburgh, Scotland, pp. 229-236.
41. Watkins, C. J. C. H. and Dayan, P.: 1992, Technical note: Q-learning, Machine Learning 8(3/4), 279-292.