Design of semi-decentralized control laws for distributed-air-jet micromanipulators by reinforcement learning

2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009

Volumn , Issue , 2009, Pages 3277-3283

  Matignon, Laëtitia ^a   Laurent, Guillaume J ^a   Le Fort Piat, Nadine ^a  

^a UNIVERSITÉ DE FRANCHE COMTÉ   (France)

Author keywords

[No Author keywords available]

Indexed keywords

AIR JET; DECENTRALIZED CONTROL LAW; DESIGN CONTROL; DISTRIBUTED SYSTEMS; MACHINE-LEARNING; MANIPULATION SYSTEM; REINFORCEMENT LEARNING CONTROL; REINFORCEMENT LEARNING METHOD;

INTELLIGENT ROBOTS; LEARNING ALGORITHMS; MULTI AGENT SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING;

DECENTRALIZED CONTROL;

EID: 76249101087     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2009.5353902     Document Type: Conference Paper

References (21)

1. K. Verbeeck, A. Nowé, J. Parent, and K. Tuyls, "Exploring selfish reinforcement learning in repeated games with stochastic rewards," Autonomous Agents and Multi-Agent Systems, vol. 14, no. 3, pp. 239-269, 2007.
2. K. Tumer and A. Agogino, "Distributed agent-based air traffic flow management," in AAMAS '07: Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems. New York, NY, USA: ACM, 2007, pp. 1-8.
3. D. Wolpert, J. Sill, and K. Tumer, "Reinforcement learning in distributed domains: Beyond team games," in Proceedings of the Seventeenth IJCAI, 2001.
4. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. The MIT Press, Cambridge, 1998.
5. K.-F. Böhringer, B. R. Donald, R. Mihailovich, and N. C. MacDonald, "Sensorless manipulation using massively parallel microfabricated actuator arrays," in Proc. of IEEE ICRA, San Diego, CA, May 1994, pp. 826-833.
6. M. Ataka, B. Legrand, L. Buchaillot, D. Collard, and H. Fujita, "Design, fabrication and operation of two dimensional conveyance system with ciliary actuator arrays," IEEE/ASME Transactions on-Mechatronics, vol. 14, pp. 119-125, 2009.
7. Y. Fukuta, Y.-A. Chapuis, Y. Mita, and H. Fujita, "Design, fabrication and control of mems-based actuator arrays for air-flow distributed micromanipulation," Journal of Micro-Electro-Mechanical Systems, 2006.
8. S. Konishi and H. Fujita, "A conveyance system using air flow based on the concept of distributed micro motion systems," Journal of Micro-Electro-Mechanical Systems, vol. 3, no. 2, pp. 54-58, 1994.
9. K.-F. Bohringer, B. Randall, D. Noel, and C. Macdonald, "What programmable vector fields can (and cannot) do: Force field algorithms for mems and vibratory parts feeders," in Proc. of IEEE ICRA, 1996, pp. 822-829.
10. L. Panait and S. Luke, "Cooperative multi-agent learning: The state of the art," Autonomous Agents and Multi-Agent Systems, vol. 11, no. 3, pp. 387-434, 2005.
11. C. Claus and C. Boutilier, "The dynamics of reinforcement learning in cooperative multiagent systems." in Proceedings of the Fifteenth National Conference on Artificial Intelligence, 1998, pp. 746-752.
12. M. Lauer and M. Riedmiller, "An algorithm for distributed reinforcement learning in cooperative multi-agent systems," in Proc. of the International Conference on Machine Learning. Morgan Kaufmann, 2000, pp. 535-542. [Online]. Available: citeseer.ist.psu.edu/lauer00algorithm.html
13. C. Watkins and P. Dayan, "Technical note: Q-learning," Machine Learning, vol. 8, pp. 279-292, 1992.
14. M. Tan, "Multiagent reinforcement learning: Independent vs. cooperative agents," in 10th International Conference on Machine Learning, 1993, pp. 330-337.
15. L. Matignon, G. J. Laurent, and N. L. Fort-Piat, "A study of fmq heuristic in cooperative multi-agent games," in Proceedings of the Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS), Workshop 10: Multi-Agent Sequential Decision Making in Uncertain Multi-Agent Domains., 2008.
16. S. Sen and M. Sekaran, "Individual learning of coordination knowledge," JETAI, vol. 10, no. 3, pp. 333-356, 1998.
17. L. Busoniu, R. Babuska, and B. D. Schutter, "Decentralized reinforcement learning control of a robotic manipulator," in Proceedings of the 9th International Conference on Control, Automation, Robotics and Vision (ICARCV 2006), Singapore, Dec. 2006, pp. 1347-1352.
18. Y. Wang and C. W. de Silva, "Multi-robot box-pushing: Single-agent q-learning vs. team q-learning," in Proc. of IROS, 2006, pp. 3694-3699.
19. H. Guo and Y. Meng, "Dynamic correlation matrix based multi-q learning for a multi-robot system," in IROS, 2008, pp. 840-845.
20. C. J. Watkins, "Learning from delayed rewards," Ph.D. dissertation, Cambridge University, Cambridge, England, 1989.
21. L. Matignon, G. J. Laurent, and N. Le Fort-Piat, "Improving reinforcement learning speed for robot control," in Proc. of the IEEE International Conference on Intelligent Robots and Systems, Beijing, China, Oct. 9-15 2006.