Representation of behavioral history for learning in nonstationary conditions

Robotics and Autonomous Systems

Volumn 29, Issue 2, 1999, Pages 187-200

  Michaud, François ^a   Matarić, Maja J ^b  

^a UNIVERSITÉ DE SHERBROOKE   (Canada)

^b University of Southern California ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MATHEMATICAL MODELS;

BEHAVIORAL HISTORY REPRESENTATION; MULTIROBOT SYSTEMS; NONSTATIONARY CONDITIONS;

ROBOT LEARNING;

EID: 0033348437     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0921-8890(99)00051-2     Document Type: Article

References (28)

1. P.E. Agre, The dynamic structure of everyday life, Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, 1988.
2. M. Asada, E. Uchibe, S. Noda, S. Tawaratsumida, K. Hosoda, Coordination of multiple behaviors acquired by a vision-based reinforcement learning, in: Proceedings of the IEEE/RSJ/GI International Conference on Intelligent Robots and Systems, Munich, Germany, 1994.
3. R.A. Brooks, A robust layered control system for a mobile robot, IEEE Journal of Robotics and Automation RA-2 (1) (1986) 14-23.
4. Brooks R.A. Intelligence without representation. Artificial Intelligence. 47:1991;139-159.
5. R.A. Brooks, MARS: Multiple Agency Reactivity System, Technical Report, IS Robotics, 1996.
6. A. Cassandra, L.P. Kaelbling, J.A. Kurien, Acting under uncertainty: Discrete bayesian models for mobile-robot navigation, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Osaka, Japan, 1996.
7. Dorigo M., Colombetti M. Robot shaping: Developing autonomous agents through learning. Artificial Intelligence. 71(2):1994;321-370.
8. D. Floreano, F. Mondada, Evolution of homing navigation in a real mobile robot, in: IEEE Transactions on Systems, Man, and Cybernetics 26 (3) (1996) 396-407.
9. D. Goldberg, M.J. Matarić, Interference as a tool for designing and evaluating multi-robot controllers, in: Proceedings of the National Conference on Artificial Intelligence (AAAI-97), Providence, RI, 1997, pp. 637-642.
10. Kaelbling L.P., Littman M.L., Moore A.W. Reinforcement learning: A survey. Journal of Artificial Intelligence Research. 4:1996;237-285.
11. S. Koenig, R.G. Simmons, Unsupervised learning of probabilistic models for robot navigation, in: Proceedings of the IEEE International Conference on Robotics and Automation, Minneapolis, MN, 1996.
12. P. Maes, The dynamics of action selection, in: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI-89), Detroit, MI, 1989, pp. 991-997.
13. P. Maes, R.A. Brooks, Learning to coordinate behaviors, in: Proceedings of the National Conference on Artificial Intelligence (AAAI-90), Boston, MA, vol. 2, 1990, pp. 796-802.
14. Mahadevan S., Connell J. Automatic programming of behavior-based robots using reinforcement learning. Artificial Intelligence. 55:1992;311-365.
15. Mahadevan S., Kaelbling L.P. The National Science Foundation Workshop on Reinforcement Learning: Summary and observations. AI Magazine. 17(4):1996;89-97.
16. M.J. Matarić, Behavior-based control: Examples from navigation, learning, and group behavior, Journal of Experimental and Theoretical Artificial Intelligence 9 (2-3) (1997).
17. M.J. Matarić, Reinforcement learning in the multi-robot domain, Autonomous Robots 4 (1) (1997).
18. A.K. McCallum, Learning to use selective attention and short-term memory in sequential tasks, in: From Animals to Animats: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, MIT Press, Cape Cod, 1996, pp. 315-324.
19. A.K. McCallum, Reinforcement learning with selective perception and hidden state, Ph.D. Thesis, Department of Computer Science, University of Rochester, 1996.
20. F. Michaud, G. Lachiver, C.T. Le Dinh, A new control architecture combining reactivity, deliberation and motivation for situated autonomous agent, in: From Animals to Animats: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, MIT Press, Cape Cod, 1996, pp. 245-254.
21. F. Michaud, M.J. Matarić, Learning from history for behavior-based mobile robots in non-stationary conditions, Machine Learning 31 (1998) 141-167; Autonomous Robots 5 (1998) 335-354; Joint Special Issue on Learning in Autonomous Robots.
22. F. Michaud, M.J. Matarić, Learning from history for behavior-based mobile robots in non-stationary conditions, Machine Learning 31 (1998) 141-167; Autonomous Robots 5 (1998) 335-354; Joint Special Issue on Learning in Autonomous Robots.
23. R. Parr, S. Russell, Approximating optimal policies for partially observable stochastic domains, in: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI-95), Montréal, Québec, 1995, pp. 1088-1094.
24. Ram A., Santamaria J.C. Multistrategy learning in reactive control systems for autonomous robotic navigation. Informatica. 17(4):1993;347-369.
25. S. Russell, Machine learning, in: M.A. Boden (Ed.), Handbook of Perception and Cognition, Academic Press, vol. 14, Academic Press, New York, 1996, Chapter 4.
26. S. Russell, P. Norvig, Artificial Intelligence: A Modern Approach, Prentice-Hall, Englewood Cliffs, NJ, 1995.
27. S.P. Singh, T. Jaakkola, M.I. Jordan, Learning without state-estimation in partially observable Markovian decision process, in: Proceedings of the 13th International Conference on Machine Learning, 1996.
28. R.S. Sutton, A.G. Barto, Reinforcement Learning: An Introduction, MIT Press/Bradford Books, Cambridge, MA, 1998.