Interaction learning for dynamic movement primitives used in cooperative robotic tasks

Robotics and Autonomous Systems

Volumn 61, Issue 12, 2013, Pages 1450-1459

  Kulvicius, Tomas ^a   Biehl, Martin ^c   Aein, Mohamad Javad ^a   Tamosiunaite, Minija ^a,b   Wörgötter, Florentin ^a  

^a UNIVERSITY OF GÖTTINGEN   (Germany)

^b VYTAUTAS MAGNUS UNIVERSITY   (Lithuania)

^c UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

Author keywords

Hebbian learning; Interactive agents; Obstacle avoidance

Indexed keywords

ADAPTIVE SENSORS; COGNITIVE COMPONENTS; COOPERATIVE ROBOTICS; DYNAMIC MOVEMENT PRIMITIVES; HEBBIAN LEARNING; INTERACTIVE AGENTS; LEARNING MECHANISM; MOVEMENT CONTROL;

COLLISION AVOIDANCE; DYNAMICS; SENSORS; SENSORY FEEDBACK;

ROBOTICS;

EID: 84887228302     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2013.07.009     Document Type: Article

References (45)

1. J.A. Ijspeert, J. Nakanishi, S. Schaal, Movement imitation with nonlinear dynamical systems in humanoid robots, in: Proc. 2002 IEEE Int. Conf. Robotics and Automation, 2002, pp. 1398-1403.
2. S. Schaal, P. Mohajerian, and J.A. Ijspeert Dynamics systems vs. optimal control - a unifying view Progress in Brain Research 165 2007 425 445
3. S.M. Khansari-Zadeh, A. Billard, BM: an iterative method to learn stable non-linear dynamical systems with gaussian mixture models, in: Proc. 2010 IEEE Int. Conf. Robotics and Automation, 2010, pp. 2381-2388.
4. S.M. Khansari-Zadeh, A. Billard, Imitation learning of globally stable non-linear point-to-point robot motions using nonlinear programming, in: Proc. 2010 IEEE Int. Conf. Intelligent Robots and Systems, 2010, pp. 2676-2683.
5. S.M. Khansari-Zadeh, and A. Billard Learning stable non-linear dynamical systems with gaussian mixture models IEEE Transactions on Robotics 27 2011 943 957
6. B. Nemec, and A. Ude Action sequencing using dynamic movement primitives Robotica 30 5 2012 837 846
7. T. Kulvicius, K.J. Ning, M. Tamosiunaite, and F. Wörgötter Joining movement sequences: modified dynamic movement primitives for robotics applications exemplified on handwriting IEEE Transactions on Robotics 28 1 2012 145 157 10.1109/TRO.2011.2163863
8. D.-H. Park, H. Hoffmann, P. Pastor, S. Schaal, Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields, in: Proc. 8th IEEE-RAS Int. Conf. Humanoid Robots, 2008, pp. 91-98.
9. H. Hoffmann, P. Pastor, D.-H. Park, S. Schaal, Biologically-inspired dynamical systems for movement generation: automatic real-time goal adaptation and obstacle avoidance, in: Proc. 2009 IEEE Int. Conf. Robotics and Automation, 2009, pp. 1534-1539.
10. N. Ratliff, M. Zucker, J.A. Bagnell, S. Srinivasa, Chomp: gradient optimization techniques for efficient motion planning, in: Proc. 2009 IEEE Int. Conf. Robotics and Automation, 2009, pp. 489-494.
11. S. Calinon, I. Sardellitti, D.G. Caldwell, Learning-based control strategy for safe human-robot interaction exploiting task and robot redundancies, in: Proc. 2010 IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2010, pp. 249-254.
12. A.S. Phung, J. Malzahn, F. Hoffmann, T. Bertram, Get out of the way - obstacle avoidance and learning by demonstration for manipulation, in: Proc. 11th IFAC World Congress, 2011, pp. 11514-11519.
13. M. Mühlig, M. Gienger, and J.J. Steil Interactive imitation learning of object movement skills Autonomous Robots 32 2 2012 97 114
14. T. Matsubara, S.-H. Hyon, and J. Morimoto Learning parametric dynamic movement primitives from multiple demonstrations Neural Networks 24 5 2011 493 500
15. S.-M. Khansari-Zadeh, and A. Billard A dynamical system approach to realtime obstacle avoidance Autonomous Robots 32 2012 433 454
16. O. Krömer, R. Detry, J. Piater, J. Peters, Adapting preshaped grasping movements using vision descriptors, in: Proc. 11th Int. Conf. Simulation of Adaptive Behavior: from Animals to Animats, 2010, pp. 156-166.
17. P. Pastor, L. Righetti, M. Kalakrishnan, S. Schaal, Online movement adaptation based on previous sensor experiences, in: Proc. 2011 IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2011, pp. 365-371.
18. L. Righetti, J.A. Ijspeert, Programmable central pattern generators: an application to biped locomotion control, in: Proc. 2006 IEEE Int. Conf. Robotics and Automation, 2006, pp. 1585-1590.
19. S. Degallier, L. Righetti, L. Natale, F. Nori, G. Metta, J.A. Ijspeert, A modular bio-inspired architecture for movement generation for the infant-like robot iCub, in: Proc. 2nd IEEE RAS/EMBS Int. Conf. Biomedical Robotics and Biomechatronics, 2008, pp. 795-800.
20. S. Degallier, C.P. Santos, L. Righetti, J.A. Ijspeert, Movement generation using dynamical systems: a humanoid robot performing a drumming task, in: Proc. 6th IEEE-RAS Int. Conf. Humanoid Robots, 2006, pp. 512-517.
21. J. Kober, B. Mohler, J. Peters, Learning perceptual coupling for motor primitives, in: Proc. 2008 IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2008, pp. 834-839.
22. J.A. Ijspeert, J. Nakanishi, S. Schaal, Learning attractor landscapes for learning motor primitives, in: Proc. 15th Advances in Neural Information Processing Systems, 2003, pp. 1547-1554.
23. S. Schaal, J. Peters, J. Nakanishi, J.A. Ijspeert, Learning movement primitives, in: Proc. 2003 Int. Symp. Robotics Research, 2004, pp. 561-572.
24. B. Porr, and F. Wörgötter Isotropic sequence order learning in a closed loop behavioural system Philosophical Transactions of the Royal Society A: Mathematical Physical and Engineering Sciences 361 2003 2225 2244
25. D.O. Hebb The Organization of Behavior 1949 Wiley & Sons New York
26. Kuka Robot Systems. http://www.kuka-robotics.com.
27. B. Nemec, M. Tamosiunaite, F. Woergoetter, A. Ude, Task adaptation through exploration and action sequencing, in: Proc. 9th IEEE-RAS Int. Conf. Humanoid Robots, 2009, pp. 610-616.
28. A. Ude, A. Gams, T. Asfour, and J. Morimoto Task-specific generalization of discrete and periodic dynamic movement primitives IEEE Transactions on Robotics 26 2010 800 815
29. A. Gams, M. Do, A. Ude, T. Asfour, R. Dillmann, On-line periodic movement and force-profile learning for adaptation to new surfaces, in: Proc. 10th IEEE-RAS Int. Conf. Humanoid Robots, 2010, pp. 560-565.
30. J. Peters, and S. Schaal Reinforcement learning of motor skills with policy gradients Neural Networks 21 4 2008 682 697
31. E. Theodorou, J. Buchli, S. Schaal, Reinforcement learning of motor skills in high dimensions: a path integral approach, in: Proc. 2010 IEEE Int. Conf. Robotics and Automation, 2010, pp. 2397-2403.
32. P. Kormushev, S. Calinon, D.G. Caldwell, Robot motor skill coordination with EM-based reinforcement learning, in: Proc. 2010 IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2010, pp. 3232-3237.
33. M. Tamosiunaite, B. Nemec, A. Ude, and F. Wörgötter Learning to pour combining goal and shape learning for dynamic movement primitives Robotics and Autonomous Systems 59 11 2011 910 922
34. J. Kober, and J. Peters Policy search for motor primitives in robotics Machine Learning 84 1-2 2011 171 203
35. M. Uchiyama, and P. Dauchez Symmetric kinematic formulation and non-master/slave coordinated control of two-arm robots Advanced Robotics 7 4 1993 361 383
36. E. Nakano, S. Ozaki, T. Ishida, I. Kato, Cooperational control of the anthropomorphous manipulator 'MELARM', in: Proc. 4th Int. Symp. Industrial Robots, 1974, pp. 251-260.
37. S. Fujii, S. Kurono, Coordinated computer control of a pair of manipulators, in: Proc. IFTOMM World Congr., 1975, pp. 411-417.
38. M. Uchiyama, N. Iwasawa, K. Hakomori, Hybrid position/force control for coordination of a two-arm robot, in: Proc. IEEE Int. Conf. Robotics and Automation, vol. 4, 1987, pp. 1242-1247.
39. F. Caccavale, P. Chiacchio, A. Marino, and L. Villani Six-DOF impedance control of dual-arm cooperative manipulators IEEE/ASME Transactions on Mechatronics 13 5 2008 576 586
40. T. Tsumugiwa, R. Yokogawa, K. Hara, Variable impedance control with virtual stiffness for human-robot cooperative task (human-robot cooperative peg-in-hole task), in: Proc. 41st SICE Ann. Conf., vol. 4, 2002, pp. 2329-2334.
41. E. Gribovskaya, A. Kheddar, A. Billard, Motion learning and adaptive impedance for robot control during physical interaction with humans, in: Proc. IEEE Int. Conf. Robots and Automation, 2011, pp. 4326-4332.
42. O. Khatib Real-time obstacle avoidance for manipulators and mobile robots International Journal of Robotics Research 5 1 1986 90 98
43. A.A. Maciejewski, and C.A. Klein Obstacle avoidance for kinematically redundant manipulators in dynamically varying environments International Journal of Robotics Research 4 3 1985 109 117
44. S.H. Strogatz Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering first ed. 2001 Westview Press
45. P.A. Tipler, and G. Mosca Physics for Scientists and Engineers: Standard Version fifth ed. 2003 W.H. Freeman