Learning to control a real micropositioning system in the STM-Q framework

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2005, Issue , 2005, Pages 4569-4574

  Adda, Cédric ^a   Laurent, Guillaume J ^a   Le Fort Piat, Nadine ^a  

^a FEMTO ST INSTITUTE   (France)

Author keywords

Microrobotics; Model based algorithm; Real robot learning; Reinforcement learning

Indexed keywords

ACTUATORS; ALGORITHMS; MATHEMATICAL MODELS; POSITION CONTROL; RANDOM PROCESSES; ROBOTS;

MICROROBOTICS; MODEL BASED ALGORITHM; REAL ROBOT LEARNING; REINFORCEMENT LEARNING;

LEARNING SYSTEMS;

EID: 33846163751     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2005.1570824     Document Type: Conference Paper

References (20)

1. Wolfgang Zesch and Ronald S.Fearing. Alignment of microparts using force controlled pushing. In Proc. of the SPIE Conf. on Microrobotics and Micromanipulation, volume 3519, pages 148-156, Boston, Massachusetts, november 1998.
2. C. Baur, A. Bugacov, B.E. Koel, A. Madhukar, N. Montoya, T.R. Ramachandran, A.A.G. Requicha, R. Resch, and P. Will. Nanoparticle manipulation by mechanical pushing: underlying phenomena and real-time monitoring. Nanotechnology, 9:360-364, 1998.
3. Theil L. Hansen, A. Kühle, A.H. Sørensen, J. Bohr, and P.E. Lindelof. A technique for positioning nanoparticles using an atomic force microscope. Nanotechnology, 9:337-342, 1998.
4. R. Resch, D. Lewis, S. Meltzer, N. Montoya, B.E. Koel, A. Madhukar, A.A.G. Requicha, and P. Will. Manipulation of gold nanoparticles in liquid environnements using scanning force microscopy. Ultramicroscopy, 82:135-139, 2000.
5. W.H. Huang. Control strategies for fine positioning via tapping. In Proc. of the IEEE International Symposium on Assembly and Task Planning, 2003.
6. C. Guoliang and H. Xinhan. Research on vacuum micro-gripper of intelligent micromanipulation robots. In Proc. of the IEEE Int. Conference on Robotics and Biomimetics, august, 2004.
7. M.A. Peshkin and A.C. Sanderson. The motion of a pushed, sliding workpiece. IEEE Journal on Robotics and Automation, 4(6):569-598, 1988.
8. Sridhar Mahadevan. Machine learning for robots: A comparison of different paradigms. In Workshop on Towards Real Autonomy, IEEE/RSJ International Conference on Intelligent Robots and Systems, Osaka, Japan, 1996.
9. Sridhar Mahadevan and Jonathan Connell. Automatic programming of behavior-based robots using reinforcement learning. Artificial Intelligence, (55):311-365, 1992.
10. Minoru Asada, Shoichi Noda, Sukoya Tawaratsumida, and Koh Hosoda. Purposive behavior acquisition for a real robot by vision-based reinforcement learning. Machine Learning, 23(2-3):279-303, 1996.
11. Guillaume J. Laurent and Emmanuel Piat. Learning to control real systems with parallel dyna-q. In Proc. of the Sixth European Workshop On Reinforcement Learning, pages 45-46, Nancy, France, September 4-5 2003.
12. Christopher G. Atkeson and Stefan Schaal. Learning tasks from a single demonstration. In Proc. of the IEEE International Conference on Robotics and Automation, volume 2, pages 1706-1712, 1997.
13. William D. Smart. Making Reinforcement Learning Work on Real Robots. PhD thesis, Department of Computer Science, Brown University, May 2002.
14. Lin Long-Ji. Self-improving reactive agents based on reinforcement learning, planning and teaching. Machine Learning, 8:293-321, 1992.
15. Stefan Schaal, Chris Atkeson, and Sethu Vijayakumar. Real time robot learning with locally weighted statistical learning. In Proc. of the IEEE International Conference on Robotics and Automation, volume 1, pages 288-293, San Francisco, California, 2000.
16. Bir Bhanu, Pat Leang, Chris Cowden, Yingquiang Lin, and Mark Patterson. Real-time robot learning. In Proc. of the IEEE International Conference on Robotics and Automation, Seoul, May 2001.
17. M. Carreras, P. Ridao, and A. El-Fakdi. Semi-online neural-q learning for real-time robot learning. In Proc. of the International Conference on Intelligent Robots and Systems, pages 662-667, Las Vegas, USA, October 2003.
18. Richard S. Sutton. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. In Proc. of the Seventh International Conference on Machine Learning, pages 216-224, San Mateo, CA, 1990. Morgan Kaufmann.
19. Andrew W. Moore and Christopher G. Atkeson. Prioritized sweeping: Reinforcement learning with less data and less real time. Machine Learning, 13, 1993.
20. Christopher J.C.H. Watkins. Learning from Delayed Rewards. PhD thesis, Cambridge University, Cambridge, England, 1989.