Sequential Q-learning with kalman filtering for multirobot cooperative transportation

IEEE/ASME Transactions on Mechatronics

Volumn 15, Issue 2, 2010, Pages 261-268

  Wang, Ying ^a,b   De Silva, Clarence W ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b NINGBO UNIVERSITY   (China)

Author keywords

Decision making; Multirobot systems; Q learning

Indexed keywords

COOPERATIVE TRANSPORTATION; CREDIT ASSIGNMENT; DISTRIBUTED Q-LEARNING; EXPERIMENTAL SYSTEM; KALMAN-FILTERING; LEARNING PROCESS; MULTI-ROBOT COOPERATION; MULTI-ROBOT DOMAINS; MULTI-ROBOT SYSTEMS; MULTIROBOTS; Q-LEARNING; Q-LEARNING ALGORITHMS; Q-VALUES; SINGLE-AGENT;

DECISION MAKING; INDUSTRIAL ROBOTS; KALMAN FILTERS; SOFTWARE PROTOTYPING;

LEARNING ALGORITHMS;

EID: 77950596388     PISSN: 10834435     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMECH.2009.2024681     Document Type: Article

References (17)

1. T. Arai, E. Pagello, and L. E. Parker, "Guest editorial: Advances in multirobot systems," IEEE Trans. Robot. Autom., vol.18, no.5, pp. 655-661, Oct. 2002.
2. N. Miyata, J. Ota, T. Arai, and H. Asama, "Cooperative transport by multiple mobile robots in unknown static environments associated with real-time task assignment," IEEE Trans. Robot. Autom., vol.18, no.5, pp. 769-780, Oct. 2002.
3. T. Huntsberger, P. Pirjanian, A. Trebi-Ollennu et al., "Campout: A control architecture for tightly coupled coordination of multi-robot systems for planetary surface exploration," IEEE Trans. Syst., Man, Cybern., vol.33, no.5, pp. 550-559, Sep. 2003.
4. S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 2002.
5. E. Martison and R. C. Arkin, "Learning to role-switch in multi-robot systems," in Proc. 2003 IEEE Int. Conf. Robot. Autom, Taipei, Taiwan, pp. 2727-2734.
6. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
7. Y. Wang and C. W. de Silva, "Multi-robot box-pushing: Single-agent Q-learning vs. teamQ-learning," in Proc. 2006 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Beijing, China, pp. 3694-3699.
8. M. L. Littman, "Value-function reinforcement learning in Markov games," J. Cogn. Syst. Res., vol.2, no.1, pp. 55-66, 2001.
9. M. L. Littman, "Markov games as a framework for multi-agent reinforcement learning," in Proc. 11th Int. Conf. Mach. Learn. (ML 1994), New Brunswick, NJ, pp. 157-163.
10. E. Yang and D. Gu. (2004). "Multiagent reinforcement learning for multi-robot systems: A survey," Tech. Rep., Univ. Essex, Colchester, U.K. [Online]. Available: http://robotics.usc.edu/?maja/teaching/cs584/ papers/yang04multiagent.pdf
11. X. Yuan and S. X. Yang, "Multirobot-based nanoassembly planning with automated path generation," IEEE/ASME Trans. Mechatronics, vol.12, no.3, pp. 352-356, Jun. 2007.
12. D. Sun and J. K. Mills, "Manipulating rigid payloads with multiple robots using complaint grippers," IEEE/ASME Trans.Mechatronics, vol.7, no.1, pp. 23-34, Mar. 2002.
13. W.-T. Lo, Y. Liu, I. H. Eihajj, N. Xi, Y.Wang, and T. Fukuda, "Cooperative teleoperation of a multirobot system with force reflection via Internet," IEEE/ASME Trans. Mechatronics, vol.9, no.4, pp. 661-670, Dec. 2004. (Pubitemid 40181620)
14. Y.Wang and C.W. de Silva, "A machine learning approach to multi-robot coordination," Eng. Appl. Artif. Intell., vol.21, no.3, pp. 470-484, 2008.
15. Y.-H. Chang, T. Ho, and L. P. Kaelbling, "All learning is local: Multi-agent learning in global reward games," presented at the Neural Inf. Process. Syst. (NIPS), Whistler, BC, Canada, 2003.
16. R. E. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME, J. Basic Eng., vol.82, ser. D, pp. 35-45, 1960.
17. H. Lang, Y. Wang, and C. W. de Silva, "Mobile robot localization and object pose estimation using optical encoder, vision and laser sensors," in Proc. IEEE Int. Conf. Autom. Logistics, Qingdao, China, Sep. 2008, pp. 617-622.