A reinforcement learning approach to fail-safe design for multiple space robots - Cooperation mechanism without communication and negotiation schemes

Advanced Robotics

Volumn 17, Issue 1, 2003, Pages 21-39

  Takadama, Keiki ^a,b   Matsumoto, Shuichi ^c   Nakasuka, Shinichi ^d   Shimohara, Katsunori ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^c JAPAN AEROSPACE EXPLORATION AGENCY   (Japan)

^d UNIVERSITY OF TOKYO   (Japan)

Author keywords

Cooperation without communication and negotiation; Deadlock; Fail safe design; Multiagent based architecture; Multiple space robots; Reinforcement learning

Indexed keywords

COMPUTER SIMULATION; COSTS; MULTI AGENT SYSTEMS; ROBOT LEARNING;

MULTIPLE SPACE ROBOTS;

ROBOTS;

EID: 0037287344     PISSN: 01691864     EISSN: None     Source Type: Journal    
DOI: 10.1163/156855303321125604     Document Type: Article

References (20)

1. S. Yuta and S. Premvuti, Coordinating autonomous and centralized decision making to active cooperative behaviors between multiple mobile robots, in: Proc. IEEE Int. Workshop on Intelligent Robots and Systems, pp. 1566-1575 (1992).
2. K. Asama, H. Ozaki, A. Itakura, A. Matsumoto, Y. Ishida and I. Endo, Collision avoidance among multiple mobile robots based on rules and communication, in: Proc. IEEE Int. Workshop on Intelligent Robots and Systems, pp. 1215-1220 (1991).
3. L. E. Parker, ALLIANCE: an architecture for fault tolerant, cooperative control of heterogeneous mobile robots, in: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 776-783 (1994).
4. M. J. Mataric, Reward functions for accelerated learning, in: Proc. 11th Int. Conf. on Machine Learning, pp. 181-189 (1994).
5. S. Sen, M. Sekaran and J. Hole, Learning to coordinate without sharing information, in: Proc. 11th Natl. Conf. on Artificial Intelligence, pp. 426-431 (1991).
6. K. Takadama, H. Kasahara, L. Huang, M. Watabe, H. Ii, K. Shimohara and S. Nakasuka, Organizational learning agents for task scheduling in space crew and robot operations, in: Proc. 5th Int. Symp. on Artificial Intelligence, Robotics and Automation in Space, pp. 561-568 (1999).
7. S. J. Russell and P. Norving, Artificial Intelligence: A Modern Approach. Prentice-Hall, Englewood Cliffs, NJ (1995).
8. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading, MA (1989).
9. R. S. Sutton and A. G. Bart, Reinforcement Learning-An Introduction. MIT Press, Cambridge, MA (1998).
10. J. H. Holland, Properties of the bucket brigade algorithm, in: Proc. 1st Int. Conf. on Genetic Algorithms, pp. 1-7 (1985).
11. C. J. C. H. Watkins and P. Dayan, Technical note: Q-learning, Machine Learning 8, 55-68 (1992).
12. J. J. Grefenstette, Credit assignment in rule discovery systems based on genetic algorithms, Machine Learning 3, 225-245 (1988).
13. R. L. Riolo, Bucket brigade performance: long sequence of classifiers, in: Proc. 2nd Int. Conf. on Genetic Algorithms, pp. 184-195 (1987).
14. R. E. Smith and D. E. Goldberg, Variable default hierarchy separation in a classifier system, in: Foundation of Genetic Algorithms, pp. 148-167. Morgan Kaufman, San Mateo, CA (1991).
15. S. Arai and K. Sycara, Effective learning approach for planning and scheduling in multi-agent domain, in: Proc. 6th Int. Conf. of the Society for Adaptive Behavior, pp. 507-516 (2000).
16. K. Takadama, S. Nakasuka and K. Shimohara, Robustness in organizational-learning oriented classifier system, J. Soft Comput. 6 (3-4), 229-239 (2002).
17. S. Matsumoto, Y. Wakabayashi and Y. Watanabe, System design of the Hyper-OSV (Orbital Servicing Vehicle), in: Proc. 10th Workshop on Astrodynamics and Flight Mechanics (2000).
18. H. Ueno, Y. Wakabayashi and S. Marsumoto, Reconfigurable on-orbit experimental testbed by using brachiate manipulators, in: Proc. 44th Conf. on Space Science and Technology (2000).
19. K. Takadama, K. Hajiri, T. Nomura, M. Okada, S. Nakasuka and K. Shimohara, Learning model for adaptive behaviors as an organized group of swarm robots, Int. J. Artificial Life Robotics 2 (3), 123-128 (1998).
20. H. Kasahara, K. Takadama, S. Nakasuka and K. Shimohara, A troubleshooting mechanism based on an organizational learning model for multiple robots, in: Proc. 1998 Int. Technical Conf. on Circuits Systems, Computer and Communications, pp. 1023-1026 (1998).