A machine-learning approach to multi-robot coordination

Engineering Applications of Artificial Intelligence

Volumn 21, Issue 3, 2008, Pages 470-484

  Wang, Ying ^a   de Silva, Clarence W ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Autonomous robots; Cooperative control; Genetic algorithms; Intelligent transportation; Multi agent systems; Multi robot systems; Q learning

Indexed keywords

COMPUTER SIMULATION; GENETIC ALGORITHMS; INTELLIGENT ROBOTS; MULTI AGENT SYSTEMS; PROBLEM SOLVING;

DYNAMIC ENVIRONMENT; PROBABILISTIC ARBITRATOR;

REINFORCEMENT LEARNING;

EID: 43549119106     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2007.05.006     Document Type: Article

References (37)

1. In: Arai T., Pagello E., and Parker L.E. (Eds). Guest editorial: advances in multirobot systems. IEEE Transactions on Robotics and Automation 18 5 (2002) 655-661
2. Astrom K.J., and Wittenmark B. Adaptive Control. second ed (1994), Addison-Wesley, Menlo Park, CA
3. Cao Y.U., Fukunaga A.S., and Kahng A.B. Cooperative mobile robotics: antecedents and directions. Autonomous Robots 4 1 (1997) 7-27
4. Craig J.J. Introduction to Robotics: Mechanics and Control (2005), Pearson Prentice-Hall, Upper Saddle River, NJ
5. Ferch M., and Zhang J. Learning cooperative grasping with the graph representation of a state-action space. Robotics and Autonomous Systems 38 2002 (2002) 183-195
6. Huntsberger T., Pirjanian P., et al. CAMPOUT: a control architecture for tightly coupled coordination of multirobot systems for planetary surface exploration. IEEE Transactions on Systems, Man and Cybernetics-Part A 33 5 (2003) 550-559
7. Inoue, Y., Tohge, T., Iba, H., 2004. Object transportation by two humanoid robots using cooperative learning. In: Proceedings of the Congress on Evolutionary Computation (CEC 2004), Portland, OR, 2004, pp. 1201-1208.
8. Ito K., and Gofuku A. Hybrid autonomous control for multi mobile robots. Advanced Robotics 18 1 (2004) 83-99
9. Jones, C., Mataric, M.J., 2004. Automatic synthesis of communication-based coordinated multi-robot systems. In: Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, 2004, pp. 381-387.
10. Karray F.O., and de Silva C.W. Soft Computing and Intelligent Systems Design (2004), Pearson Addison Wesley, New York
11. Kumar M., and Garg D.P. Sensor-based estimation and control of forces and moments in multiple cooperative robots. Journal of Dynamic Systems, Measurement, and Control, Transactions of the ASME 126 2004 (2004) 276-283
12. Littman M.L. Value-function reinforcement learning in Markov games. Journal of Cognitive Systems Research 2 1 (2001) 55-66
13. Liu J., and Wu J. Multi-Agent Robotic Systems (2001), CRC Press, Boca Raton, FL
14. Martinson, E., Arkin, R.C., 2003. Learning to role-switch in multi-robot systems. In: Proceedings of the 2003 IEEE International Conference on Robotics and Automation, Taipei, Taiwan, 2003, pp. 2727-2734.
15. Martinson, E., Stoytchev, A., Arkin, R.C., 2002. Robot behavioral selection using Q-learning. In: Proceedings of the 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems, EPFL, Lausanne, Switzerland, 2002, pp. 970-977.
16. Mataric M.J. Reinforcement learning in the multi-robot domain. Autonomous Robots 4 1 (1997) 73-83
17. Mitchell T.M. Machine Learning (1997), McGraw-Hill, New York
18. Miyata N., Ota J., Arai T., and Asama H. Cooperative transport by multiple mobile robots in unknown static environments associated with real-time task assignment. IEEE Transactions on Robotics and Automation 18 10 (2002) 769-780
19. Nolfi S., and Floreano D. Learning and evolution. Autonomous Robots 7 1 (1999) 89-113
20. Parker L.E. ALLIANCE: an architecture for fault tolerant multirobot cooperation. IEEE Transactions on Robotics and Automation 14 2 (1998) 220-240
21. Parker L.E. Lifelong adaptation in heterogeneous multi-robot teams: response to continual variation in individual robot performance. Autonomous Robots 8 2000 (2000) 239-267
22. Pereira G., Campos M., and Kumar V. Decentralized algorithms for multi-robot manipulation via caging. The International Journal of Robotics Research 23 7-8 (2004) 783-795
23. Rus, D., Donald, B., Jennings, J., 1995. Moving furniture with teams of autonomous robots. In: Proceedings of the IEEE/RSJ International Conference on Human Robot Interaction and Cooperative Robots, Pittsburgh, PA, 1995, pp. 235-242.
24. Schenker P.L., Huntsberger T., et al. Planetary rover developments supporting MARS exploration, sample return and future human-robotic colonization. Autonomous Robots 14 2003 (2003) 103-126
25. Stone P., and Veloso M. Layered approach to learning client behaviors in the ROBOCUP soccer server. Applied Artificial Intelligence 12 2-3 (1998) 165-188
26. Stone P., and Veloso M. Multiagent systems: a survey from a machine learning perspective. Autonomous Robots 8 3 (2000) 345-383
27. Stroupe, A., Huntsberger, T., et al., 2005. Behavior-based multi-robot collaboration for autonomous construction tasks. In: Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmont, Alta., Canada, 2005, pp. 1989-1994.
28. Sugar, T., Desai, J.P., Kumar, V., et al., 2001. Coordination of multiple mobile manipulators. In: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, Seoul, Korea, 2001, pp. 3022-3027.
29. Sugar T.G., and Kumar V. Control of cooperating mobile manipulators. IEEE Transactions on Robotics and Automation 18 1 (2002) 94
30. Wang, Y., de Silva, C.W., 2005. An object transportation system with multiple robots and machine learning. In: Proceedings of the 2005 American Control Conference (ACC 2005), Portland, OR, pp. 1371-1376.
31. Wang, Y., de Silva, C.W., 2006a. Multi-robot box-pushing: single-agent Q-learning vs. team Q-learning. In: Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Beijing, China, pp. 3694-3699.
32. Wang, Y., de Silva, C.W., 2006b. Extend single-agent reinforcement learning approach to a multi-robot cooperative task in an unknown dynamic environment. In: Proceedings of the IEEE 2006 International Joint Conference on Neural Networks (IJCNN), Vancouver, Canada, pp. 10098-10104.
33. Wang, Z., Takano, Y., Hirata, Y., et al., 2004. A pushing leader based decentralized control method for cooperative object transportation. In: Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, pp. 1035-1040.
34. Wang, Z., Hirata, Y., Kosuge, K., 2005. An algorithm for testing object caging condition by multiple mobile robots. In: Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmont, Alta., Canada, pp. 2664-2669.
35. Yamada S., and Saito J. Adaptive action selection without explicit communication for multi-robot box-pushing. IEEE Transactions on Systems, Man and Cybernetics 31 3 (2001) 398-404
36. Yamashita A., Arai T., Ota J., et al. Motion planning of multiple mobile robots for cooperative manipulation and transportation. IEEE Transactions on Robotics and Automation 19 2 (2003) 223-237
37. Yang, E., Gu, D., 2004. Multiagent reinforcement learning for multi-robot systems: a survey. Technical Report. 〈http://robotics.usc.edu/~maja/teaching/cs584/papers/yang04multiagent.pdf〉.