Learning based semi-autonomous control for robots in urban search and rescue

2012 IEEE International Symposium on Safety, Security, and Rescue Robotics, SSRR 2012

Volumn , Issue , 2012, Pages

  Liu, Yugang ^a   Nejat, Goldie ^a   Doroodgar, Barzin ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

hierarchical reinforcement learning; rescue robots; semi autonomous control; urban search and rescue

Indexed keywords

CLUTTERED SCENES; HIERARCHICAL REINFORCEMENT LEARNING; RESCUE ROBOT; ROBOT EXPLORATION; SEMI-AUTONOMOUS CONTROL; SEMI-AUTONOMOUS ROBOTS; URBAN SEARCH AND RESCUE; VICTIM IDENTIFICATIONS;

CONTROLLERS; REINFORCEMENT LEARNING; ROBOTICS;

ROBOTS;

EID: 84879622024     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SSRR.2012.6523902     Document Type: Conference Paper

References (19)

1. Casper, J., Micire, M. and Murphy, R. "Issues in intelligent robots for search and rescue," in Proc. of SPIE, pp. 292-302, 2000.
2. Murphy, R. "Activities of rescue robots at the World Trade Center from 11-21 September 2001," IEEE Robotics and Automation Magazine, vol. 11, pp. 50-61, 2004.
3. Murphy, R., Tadokoro, S., Nardi, D, Jacoff, A, Fiorini, P, Choset, H. and Erkmen, A. "Search and Rescue Robotics," Springer Handbook of Robotics, Siciliano, B., Khatib, O. Eds. Berlin: pp. 1151-1173, 2008.
4. Guizzo, E. "Japan Earthquake: Robots help search for survivors," IEEE Spectrum. Available: http://spectrum.ieee.org/automaton/ robotics/industrial-robots/japan-eart hquake-robots-help-search-for-survivors, 2011.
5. Casper, J. and Murphy, R. "Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center," IEEE Trans. on Systems, Man and Cybernetics-part B, vol. 33, pp. 367-385, 2003.
6. Bruemmer, D., Boring, R., Few, D., Marble, J. and Walton, M. "I call shotgun! an evaluation of mixed-initiative control for novice users of a search and rescue robot," in Proc. of IEEE Int. Conf. on Systems, Man and Cybernetics, pp. 2847-2852, 2004.
7. Murphy, R and Sprouse, J. "Strategies for searching an area with semi-autonomous mobile robots," in Proc. of Robotics for Challenging Environments, pp. 15-21, 1996.
8. Finzi, A. and Orlandini, A. "Human-robot interaction through mixed-initiative planning for rescue and search rovers," Springer Advances in Artificial Intelligence, Bandini, S. and Manzoni, S. Eds. Berlin/Heidelberg. 3673: 483-494, 2005.
9. Velagapudi P., Scerri P., Sycara K., Wang H., Lewis M. and Wang J. "Scaling effects in multi-robot control," in Proc. of IEEE Int. Conf. on Intelligent Robots and Systems, pp. 2121-2126, 2008.
10. Lewis M., Wang H., Chien S., Scerri P., Velagapudi P., Sycara K. and Kane B. "Teams organization and performance in multi-human/multi-robot teams," in Proc. of IEEE Int. Conf. on Systems Man and Cybernetics, pp. 1617-1623, 2010.
11. Doroodgar, B., Ficocelli, M., Mobedi, B. and Nejat, G. "The search for survivors: cooperative human-robot interaction in search and rescue environments using semi-autonomous robots," in Proc. of IEEE Int. Conf. on Robotics and Automation, pp. 2858-2863, 2010.
12. Doroodgar, B. and Nejat, G. "A hierarchical reinforcement learning based control architecture for semi-autonomous rescue robots in cluttered environments," in Proc. of IEEE Conf. on Automation Science and Engineering, pp. 948-953, 2010.
13. Jeni, L., Istenes, Z., Szemes, P. and Hashimoto, H.. "Robot navigation framework based on reinforcement learning for intelligent space," in Proc. of Int. Conf. on Human Syst. Interactions, pp. 761-766, 2008.
14. Makar, R., Mahadevan, S. and Ghavamzadeh, M. "Hierarchical multi-agent reinforcement learning," in Proc. of Int. Conf. on Autonomous Agents, pp. 246-253, 2001.
15. Stone, P. and Sutton, R. "Scaling reinforcement learning toward RoboCup Soccer," in Proc. of Int. Conf. on Machine Learning, pp. 537-544, 2001.
16. Dietterich, D. "Hierarchical reinforcement learning with MAXQ value function decomposition," Journal of Artificial Intelligence Research, vol. 13, pp. 227-303, 2000.
17. Yamauchi, B. "A Frontier-Based Approach for Autonomous Exploration," in Proc. of IEEE Int. Symp. on Computational Intelligence in Robotics and Automation, Monterey, CA, pp. 146-151, 1997.
18. Singh, S., Jaakkola, T., Littman, M. and Szepesvari, C. "Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms," Machine Learning, vol. 39, pp. 287-308, 2000.
19. Zhang, Z., Nejat, G., Guo, H. and Huang, P. "A novel 3D sensory system for robot-assisted mapping of cluttered urban search and rescue environments," Intelligent Service Robotics," vol. 4, pp. 119-134, 2011.