Multi-robot task allocation through vacancy chain scheduling

Robotics and Autonomous Systems

Volumn 57, Issue 6-7, 2009, Pages 674-687

  Dahl, Torbjørn S ^a   Matarić, Maja ^b   Sukhatme, Gaurav S ^b  

^a UNIVERSITY OF GLAMORGAN   (United Kingdom)

^b University of Southern California ^*  (United States)

Author keywords

Multi robot task allocation; Reinforcement learning

Indexed keywords

ALLOCATION PATTERNS; EXPERIMENTAL EVIDENCES; FEASIBLE SOLUTIONS; FORMAL MODELS; GROUP DYNAMICS; HIGH-FIDELITY SIMULATIONS; MULTI-ROBOT SYSTEMS; MULTI-ROBOT TASK ALLOCATION; OPTIMAL ALLOCATIONS; P-COMPLETE PROBLEMS; PERFORMANCE EFFECTS; RESOURCE DISTRIBUTIONS; ROBOT INTERACTIONS;

DYNAMICS; EDUCATION; INDUSTRIAL ROBOTS; MULTIPURPOSE ROBOTS; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOT APPLICATIONS; VACANCIES;

ROBOTICS;

EID: 67349110438     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2008.12.001     Document Type: Article

References (41)

1. Brucker P. Scheduling Algorithms. 2nd ed. (1998), Springer Verlag, Berlin, Germany
2. Arkin R.C. Behaviors-based Robotics (1998), MIT Press, Cambridge, MA
3. Matarić M.J. Reinforcement learning in the multi-robot domain. Autonomous Robots 4 1 (1997) 73-83
4. Chase I.D., Weissburg M., and Dewitt T.H. The vacancy chain process: A new mechanism of resource distribution in animals with application to hermit crabs. Animal Behavior 36 (1988) 1265-1274
5. Gerkey B.P., and Matarić M.J. A formal analysis and taxonomy of task allocation in multi-robot systems. International Journal of Robotics Research 23 9 (2004) 939-954
6. Botelho S., and Alami R. M+: A scheme for multi-robot cooperation through negotiated task allocation and achievement. Proceedings of the 1999 IEEE International Conference on Robotics and Automation, ICRA'99 (1999), IEEE Press, Detroit, MI 1234-1239
7. Gerkey B.P., and Matarić M.J. Sold!: Auction methods for multi-robot coordination. IEEE Transactions on Robotics and Automation 18 5 (2002) 758-768
8. Werger B.B., and Matarić M.J. Broadcast of local eligibility for multi-target observation. In: Parker L.E., Bekey G., and Barhen J. (Eds). Proceedings of the 5th International Symposium on Distributed, Autonomous Robotic Systems, DARS'00. Distributed Autonomous Robotic Systems vol. 4 (2000), Springer, Knoxville, TN 347-356
9. L.E. Parker, L-ALLIANCE: Task-oriented multi-robot learning in behavior-based systems, Advanced Robotics, in: Selected Papers from IROS'96 11 (4), 1997, pp. 305-322 (special issue)
10. N. Kaldra, D. Ferguson, A. Stentz, Hoplites: A market-based framework for planned tight coordination in multirobot teams, in: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005, pp. 1170-1177
11. T. Lemaire, R. Alami, S. Lacroix, A distributed task allocation scheme in multi-uav context, in: Proceedings of the 2004 IEEE International Conference on Robotics and Automation, New Orleans, LA, 2004, pp. 3622-3627
12. Decker K. TAEMS: A framework for environment centered analysis and design of coordination mechanisms. In: O'Hare G., and Jennings N. (Eds). Foundations of Distributed Artificial Intelligence (1996), Wiley Inter-Science 429-448 (Chapter 16)
13. Zhang W., and Dietterich T.G. A reinforcement learning approach to job-shop scheduling. Proceedings of the 14th International Joint Conference on Artificial Intelligence, IJCAI'95 (1995), Morgan Kaufmann, Montréal, Canada 1114-1120
14. Zomaya A.Y., Clements M., and Olariu S. A framework for reinforcement-based scheduling in parallel processor systems. IEEE Transactions On Parallel and Distributed Systems 9 3 (1998) 249-259
15. Brauer W., and Weiß G. Multi-machine scheduling- A multi-agent learning approach. Proceedings of the 3rd International Conference on Multi-Agent Systems, ICMAS'98 (1998), IEEE Press, Paris, France 42-48
16. Blum C., and Sampels M. Ant colony optimization for fop shop scheduling: A case study on different pheromone representations. Proceedings of the 2002 Congress on Evolutionary Computing, CEC'02 (2002), IEEE Press, Honolulu, Hawaii 1558-1563
17. Tangamchit P., Dolan J.M., and Khosla P.K. Learning-based task allocation in decentralized multirobot systems. In: Parker L.E., Bekey G., and Barhen J. (Eds). Proceedings of the 5th International Symposium in Distributed Autonomous Robotic Systems, DARS'00. Distributed Autonomous Robotic Systems vol. 4 (2000), Springer, Knoxville, TN 381-390
18. Dahl T.S., Matarić M.J., and Sukhatme G.S. Multi-robot task-allocation through vacancy chains. Proceedings of the 2003 IEEE International Conference on Robotics and Automation, ICRA'03 (2003), IEEE Press, Taipei, Taiwan 2293-2298
19. T.H. Labella, M. Dorigo, J.-L. Deneubourg, Self-organized task allocation in a group of robots, in: Proceedings of the 7th International Symposium on Distributed Autonomous Robotic Systems, DARS'04, Toulouse, France, 2004, pp. 371-380
20. Lerman K., Galstyan A., Martinoli A., and Ijspeert A.J. A macroscopic analytical model of collaboration in distributed robotic systems. Artificial Life 7 4 (2001) 375-393
21. Myerson R.B. Game Theory: Analysis of Conflict (1991), Harvard University Press, Cambridge, MA
22. Littman M.L. Markov games as a framework for multi-agent reinforcement learning. In: Cohen W.W., and Hirsh H. (Eds). Proceedings of the 11th International Conference on Machine Learning, ICML'94 (1994), Morgan Kaufmann, New Brunswick, NJ 157-193
23. Bowling M. Convergence and no-regret in multiagent learning. In: Saul L.K., Weiss Y., and Bottou L. (Eds). Proceedings of the Annual Conference on Neural Information Processing Systems, NIPS'04, December 13-18, 2004, Vancouver, Canada. Advances in Neural Information Processing Systems vol. 17 (2005), MIT Press, Cambridge, MA 209-216
24. Goldberg D., and Matarić M.J. Learning multiple models for reward maximization. In: Langley P. (Ed). Proceedings of the 17th International Conference on Machine Learning, ICML'00 (2000), Morgan Kaufmann, Stanford, CA 319-326
25. Balch T.R., Khan Z., and Veloso M.M. Automatically tracking and analyzing the behavior of live insect colonies. In: Müller J.P., Andre E., Sen S., and Frasson C. (Eds). Proceedings of the Fifth International Conference on Autonomous Agents, Agents'01 (2001), ACM Press, Montreal, Canada 521-528
26. K. Han, M.M. Veloso, Automated robot behavior recognition applied to robotic soccer, in: Proceedings of the 9th International Symposium on Robotics Research, ISRR'99, Snowbird, Utah, 1999, pp. 199-204
27. Yan H., and Matarić M.J. General spatial features for analysis of multi-robot and human activities from raw position data. Proceedings of the 2002 IEE/RSJ International Conference on Intelligent Robots and Systems, IROS'02 (2002), IEEE Press, Lausanne, Switzerland 2770-2775
28. Seth A.K. Modeling group foraging: Individual suboptimality, interference, and a kind of matching. Adaptive Behavior 9 2 (2001) 67-91
29. M.J. Matarić, Interaction and intelligent behavior, Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, 1994
30. Jung B., and Sukhatme G.S. Tracking targets using multiple robots: The effect of environment occlusion. Autonomous Robots 13 3 (2002) 191-205
31. Holland O., and Melhuish C. Stigmergy, self-organization and sorting in collective robotics. Artificial Life 5 2 (1999) 173-202
32. Sutton R.S., Precup D., and Singh S. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112 (1999) 181-211
33. Dahl T.S., Matarić M.J., and Sukhatme G.S. Adaptive spatio-temporal organization in groups of robots. Proceedings of the 2002 IEE/RSJ International Conference on Intelligent Robots and Systems, IROS'02 (2002), IEEE Press, Lausanne, Switzerland 1044-1049
34. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, MA
35. Balch T.R. The impact of diversity on performance in multi-robot foraging. In: Etzioni O., Müller J.P., and Bradshaw J.M. (Eds). Proceedings of the Third International Conference on Autonomous Agents, Agents'99 (1999), ACM Press, Seattle, WA 92-99
36. Goldberg D., and Matarić M.J. Design and evaluation of robust behavior-based controllers for distributed multi-robot collection tasks. In: Balch T.R., and Parker L.E. (Eds). Robot Teams: From Diversity to Polymorphism (2001), A K Peters Ltd. 315-244
37. Ostergaard E., Sukhatme G.S., and Matarić M.J. Emergent bucket brigading-A simple mechanism for improving performance in multi-robot constrained-space foraging tasks. Proceedings of the 5th International Conference on Autonomous Agents, Agents'01 (2001), ACM Press, Montreal, Canada 29-30
38. Gerkey B.P., Vaughan R.T., Støy K., Howard A., Sukhatme G.S., and Matarić M.J. Most valuable player: A robot device server for distributed control. Proceedings of the 2001 IEE/RSJ International Conference on Intelligent Robots and Systems, IROS'01 (2001), IEEE Press, Wailea, Hawaii 1226-1231
39. Howard A. Relaxation on a mesh: A formalism for generalized localization. Proceedings of the 2001 IEE/RSJ International Conference on Intelligent Robots and Systems, IROS'01 (2001), IEEE Press, Wailea, Hawaii 1055-1060
40. Low K.H., Leow W.K., and Ang M.H. Task allocation via self-organizing swarm coalitions in distributed mobile sensor network. In: McGuinness D.L., and Ferguson G. (Eds). Proceedings of the 19th National Conference on Artificial Intelligence, AAAI-04 (2004), AAAI Press/MIT Press, San Jose, CA 28-33
41. Cormen T.H., Leiserson C.E., Rivest R.L., and Stein C. Introduction to Algorithms. 2nd ed. (2001), MIT Press, Cambridge, Massachusetts