Planning for decentralized control of multiple robots under uncertainty

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2015-June, Issue June, 2015, Pages 1241-1248

  Amato, Christopher ^a   Konidaris, George ^b   Cruz, Gabriel ^c   Maynor, Christopher A ^d   How, Jonathan P ^d   Kaelbling, Leslie P ^c  

^a University of New Hampshire   (United States)

^b Duke University   (United States)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGRICULTURAL ROBOTS; BEHAVIORAL RESEARCH; COOPERATIVE COMMUNICATION; DECENTRALIZED CONTROL; DECISION MAKING; INDUSTRIAL ROBOTS; MARKOV PROCESSES; MULTIPURPOSE ROBOTS; ROBOT LEARNING; ROBOTICS; SIGNALING;

ALGORITHMIC FRAMEWORK; CO-OPERATIVE BEHAVIORS; COMMUNICATION POLICIES; DIRECT COMMUNICATIONS; MULTI-ROBOT SYSTEMS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; PROBABILISTIC FRAMEWORK; SENSOR INFORMATIONS;

ROBOT PROGRAMMING;

EID: 84938248915     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2015.7139350     Document Type: Conference Paper

References (31)

1. S. Thrun, W. Burgard, and D. Fox, Probabilistic Robotics (Intelligent Robotics and Autonomous Agents). The MIT Press, 2005.
2. C. Amato, G. Chowdhary, A. Geramifard, N. K. Ure, and M. J. Kochenderfer, "Decentralized control of partially observable Markov decision processes," in Proc. of the 52nd IEEE Conf. on Decision and Control, 2013.
3. A. Mahajan, "Optimal decentralized control of coupled subsystems with control sharing," IEEE Transactions on Automatic Control, vol. 58, 2013.
4. D. S. Bernstein, R. Givan, N. Immerman, and S. Zilberstein, "The complexity of decentralized control of Markov decision processes," Mathematics of Operations Research, vol. 27, no. 4, 2002.
5. F. A. Oliehoek, "Decentralized POMDPs," in Reinforcement Learning: State of the Art, ser. Adaptation, Learning, and Optimization, M. Wiering and M. van Otterlo, Eds. Springer, 2012, vol. 12.
6. L. P. Kaelbling, M. L. Littman, and A. R. Cassandra, "Planning and acting in partially observable stochastic domains," Artificial Intelligence, vol. 101, 1998.
7. C. Amato, G. Konidaris, and L. P. Kaelbling., "Planning with macroactions in decentralized POMDPs," in Proc. 13th Int. Conf. on Autonomous Agents and Multiagent Systems, 2014.
8. J. Bohren, "SMACH," http://wiki. ros. org/smach/, 2010.
9. C. Amato, J. S. Dibangoye, and S. Zilberstein, "Incremental policy generation for finite-horizon DEC-POMDPs," in Proc. 19th Int. Conf. on Automated Planning and Scheduling, 2009.
10. J. S. Dibangoye, C. Amato, O. Buffet, and F. Charpillet, "Optimally solving Dec-POMDPs as continuous-state MDPs," in Proc. 24th Int. Joint Conf. on Artificial Intelligence, 2013.
11. F. A. Oliehoek, M. T. J. Spaan, C. Amato, and S. Whiteson, "Incremental clustering and expansion for faster optimal planning in Dec-POMDPs," Journal of Artificial Intelligence Research, vol. 46, 2013.
12. J. S. Dibangoye, C. Amato, A. Doniec, and F. Charpillet, "Producing efficient error-bounded solutions for transition independent decentralized MDPs," in Proc. 12th Int. Conf. on Autonomous Agents and Multiagent Systems, 2013.
13. F. S. Melo and M. Veloso, "Decentralized MDPs with sparse interactions," Artificial Intelligence, 2011.
14. R. Nair, P. Varakantham, M. Tambe, and M. Yokoo, "Networked distributed POMDPs: A synthesis of distributed constraint optimization and POMDPs," in Proc. 20th National Conf. on Artificial Intelligence, 2005.
15. P. Velagapudi, P. R. Varakantham, K. Sycara, and P. Scerri, "Distributed model shaping for scaling to decentralized POMDPs with hundreds of agents," in Proc. 10th Int. Conf. on Autonomous Agents and Multiagent Systems, 2011.
16. T. Balch and R. C. Arkin, "Behavior-based formation control for multirobot teams," IEEE Transactions on Robotics and Automation, vol. 14, no. 6, 1998.
17. C. Kube and E. Bonabeau, "Cooperative transport by ants and robots," Robotics and Autonomous Systems, vol. 30, no. 1-2, 2000.
18. R. Beckers, O. Holland, and J.-L. Deneubourg, "From local actions to global tasks: Stigmergy and collective robotics," in Artificial life IV, vol. 181, 1994.
19. I. Rekleitis, V. Lee-Shue, A. P. New, and H. Choset, "Limited communication, multi-robot team based coverage," in Proc. IEEE Int. Conf. on Robotics and Automation, vol. 4. IEEE, 2004.
20. R. S. Sutton, D. Precup, and S. Singh, "Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning," Artificial Intelligence, vol. 112, no. 1, 1999.
21. J. Kober, J. A. Bagnell, and J. Peters, "Reinforcement learning in robotics: A survey," The Int. Journal of Robotics Research, vol. 32, no. 11, 2013.
22. S. Seuken and S. Zilberstein, "Memory-bounded dynamic programming for DEC-POMDPs," in Proc. 20th Int. Joint Conf. on Artificial Intelligence, 2007.
23. M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, and A. Y. Ng, "ROS: An open-source robot operating system," in ICRA Workshop on Open Source Software, vol. 3, no. 3. 2, 2009.
24. L. E. Parker, "ALLIANCE: An architecture for fault tolerant multirobot cooperation," IEEE Transactions on Robotics and Automation, vol. 14, no. 2, 1998.
25. A. W. Stroupe, R. Ravichandran, and T. Balch, "Value-based action selection for exploration and dynamic target observation with robot teams," in Proc. Int. Conf. on Robotics and Automation, vol. 4. IEEE, 2004.
26. C. Belta, A. Bicchi, M. Egerstedt, E. Frazzoli, E. Klavins, and G. J. Pappas, "Symbolic planning and control of robot motion [grand challenges of robotics]," Robotics & Automation Magazine, IEEE, vol. 14, no. 1, 2007.
27. S. G. Loizou and K. J. Kyriakopoulos, "Automatic synthesis of multiagent motion tasks based on LTL specifications," in Proc. 43rd IEEE Conf. on Decision and Control, 2004.
28. M. B. Dias and A. T. Stentz, "A comparative study between centralized, market-based, and behavioral multirobot coordination approaches," in Proc. IEEE Int. Conf. on Intelligent Robots and Systems, vol. 3, 2003.
29. B. Gerkey and M. Mataríc, "A formal analysis and taxonomy of task allocation in multi-robot systems," Int. Journal of Robotics Research, vol. 23, no. 9, 2004.
30. N. Kalra, D. Ferguson, and A. T. Stentz, "Hoplites: A market-based framework for planned tight coordination in multirobot teams," in Proc. Int. Conf. on Robotics and Automation, 2005.
31. R. Emery-Montemerlo, G. Gordon, J. Schneider, and S. Thrun, "Game theoretic control for robot teams," in Proc. Int. Conf. on Robotics and Automation, 2005.