On-line learning and modulation of periodic movements with nonlinear dynamical systems

Autonomous Robots

Volumn 27, Issue 1, 2009, Pages 3-23

  Gams, Andrej ^a   Ijspeert, Auke J ^b   Schaal, Stefan ^c   Lenarčič, Jadran ^a  

^a JO EF STEFAN INSTITUTE   (Slovenia)

^b EPFL   (Switzerland)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Adaptive frequency oscillators; Dynamic movement primitives; Learning by imitation; Modulating learned trajectory

Indexed keywords

ADAPTIVE FREQUENCY; ADAPTIVE FREQUENCY OSCILLATORS; DYNAMIC ENVIRONMENTS; DYNAMIC MOVEMENT PRIMITIVES; FUNDAMENTAL FREQUENCIES; INPUT SIGNAL; LAYERED SYSTEMS; LEARNING BY IMITATION; MODULATING LEARNED TRAJECTORY; MULTIPLE DIMENSIONS; NONSTATIONARY SIGNALS; ONLINE LEARNING; PERIODIC SIGNAL; PERIODIC TASKS; PERIODIC TRAJECTORIES; SECOND LAYER; WAVE FORMS;

DEMONSTRATIONS; LEARNING ALGORITHMS; MODULATION; NONLINEAR DYNAMICAL SYSTEMS; OSCILLATORS (ELECTRONIC); ROBOTS; SIGNAL PROCESSING; TRAJECTORIES;

DYNAMICAL SYSTEMS;

EID: 67651002795     PISSN: 09295593     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10514-009-9118-y     Document Type: Article

References (42)

1. Buchli, J., & Ijspeert, A. (2004). A simple, adaptive locomotion toy-system. In S. Schaal, A. Ijspeert, A. Billard, S. Vijayakumar, J. Hallam, & J. Meyer (Eds.), From animals to animats 8. Proceedings of the eighth international conference on the simulation of adaptive behavior (SAB'04) (pp. 153-162). Cambridge: MIT.
2. J. Buchli L. Righetti A. Ijspeert 2006 Engineering entrainment and adaptation in limit cycle systems-from biological inspiration to applications in robotics Biological Cybernetics 95 6 645 664 (Pubitemid 44949005)
3. Bullock, D., & Grossberg, S. (1989). VITE and FLETE: neural modules for trajectory formation and postural control. In W. Hersberger (Ed.), Volitional control (pp. 253-297). Amsterdam: Elsevier.
4. Calinon, S., Guenter, F., & Billard, A. (2007). On learning, representing and generalizing a task in a humanoid robot. IEEE Transactions on Systems, Man and Cybernetics, Part B, Special issue on robot learning by observation, demonstration and imitation, 37(2), 286-298. (Pubitemid 46523219)
5. A. Crespi A. Badertscher A. Guignard 2005 AmphiBot I: An amphibious snake-like robot Robotics and Autonomous Systems 50 4 163 175 (Pubitemid 40266173)
6. Drumwright, E., Jenkins, O. C., & Mataric, M. (2004). Exemplar-based primitives for humanoid movement classification and control. In Proceedings of the 2004 IEEE international conference on robotics and automation (ICRA 2004), pp. 140-145.
7. A. Fod M. Mataric O. C. Jenkins 2002 Automated derivation of primitives for movement classification Autonomous Robots 12 1 39 54 (Pubitemid 34156621)
8. A. Gams L. Zlajpah J. Lenarcic 2007 Imitating human acceleration of a gyroscopic device Robotica 25 4 501 509 (Pubitemid 47131396)
9. Grimes, D., Rashid, D., & Rao, R. (2006). Learning nonparametric models for probabilistic imitation. In NIPS, pp. 521-528.
10. Guenter, F., Hersch, M., Calinon, S., & Billard, A. (2007). Reinforcement learning for imitating constrained reaching movements. RSJ Advanced Robotics, Special Issue on Imitative Robots, 21(13), 1521-1544. (Pubitemid 47529845)
11. C. M. Harris D. M. Wolpert 1998 Signal-dependent noise determines motor planning Nature 394 6695 780 784 10.1038/29528
12. Hersch, M., Guenter, F., Calinon, S., & Billard, A. (2008). Dynamical system modulation for robot learning via kinesthetic demonstrations. IEEE Transactions on Robotics.
13. A. Ijspeert J. Hallam D. Willshaw 1999 Evolving swimming controllers for a simulated lamprey with inspiration from neurobiology Adaptive Behavior 7 2 151 172 (Pubitemid 129722447)
14. Ijspeert, A., Nakanishi, J. & Schaal, S. (2002a). Learning attractor landscapes for learning motor primitives. In Advances in neural information processing systems 15 (NIPS2002).
15. Ijspeert, A., Nakanishi, J., & Schaal, S. (2002b). Learning rhythmic movements by demonstration using nonlinear oscillators. In Proceedings of the IEEE/RSJ Int. Conference on Intelligent Robots and Systems (IROS2002) (pp. 958-963). (Pubitemid 35437931)
16. Ijspeert, A., Nakanishi, J., & Schaal, S. (2002c). Movement imitation with nonlinear dynamical systems in humanoid robots. In IEEE International Conference on Robotics and Automation (ICRA2002) (pp. 1398-1403). (Pubitemid 34916443)
17. A. J. Ijspeert 2008 Central pattern generators for locomotion control in animals and robots: a review Neural Networks 21 4 642 653 (Pubitemid 351799963)
18. T. Inamura I. Toshima H. Tanie Y. Nakamura 2004 Embodied symbol emergence based on mimesis theory International Journal of Robotic Research 23 4-5 363 377
19. Kawamura, S., & Fukao, N. (1994). Interpolation for input torque patterns obtained through learning control. In Proceedings of the third international conference on automation, robotics and computer vision (ICARCV'94).
20. Kawato, M. (1996). Trajectory formation in arm movements: minimization principles and procedures. In H. Zelaznik (Ed.), Advance in motor learning and control (pp. 225-259). Champaign: Human Kinetics Publisher.
21. O. Khatib 1986 Real-time obstacle avoidance for manipulators and mobile robots International Journal of Robotic Research 5 1 90 98 (Pubitemid 16546612)
22. P. Li R. Horowitz 1999 Passive velocity field control of mechanical manipulators IEEE Transactions on Robotics and Automation 15 4 751 763
23. Ljung, L., & Söderström, T. (1986). Theory and Practice of Recursive Identification. Cambridge: MIT.
24. W. Maass T. Natschläger H. Markram 2002 Real-time computing without stable states: A new framework for neural computation based on perturbations Neural Computation 14 11 2531 2560
25. M. Mataric 1998 Behavior-based robotics as a tool for synthesis of artificial behavior and analysis of natural behavior Trends in Cognitive Science 2 3 82 87 (Pubitemid 28396471)
26. Mezger, J. W. I., & Giese, M. (2005). Trajectory synthesis by hierarchical spatio-temporal correspondence: comparison of different methods. In APGV '05: Proceedings of the 2nd symposium on Applied perception in graphics and visualization (pp. 25-32). New York: ACM. (Pubitemid 43004908)
27. H. Miyamoto S. Schaal F. Gandolfo Y. Koike R. Osu E. Nakano Y. Wada M. Kawato 1996 A Kendama learning robot based on bi-directional theory Neural Networks 9 1281 1302 (Pubitemid 26413052)
28. Mussa-Ivaldi, F. (1997). Nonlinear force fields: a distributed system of control primitives for representing and learning movements. In IEEE International Symposium on Computational Intelligence in Robotics and Automation (pp. 84-90). Los Alamitos: IEEE, Computer Society.
29. J. Nishii 1998 A learning model for oscillatory networks Neural Networks 11 2 249 257 (Pubitemid 28231471)
30. Okada, M., Tatani, K., & Nakamura, Y. (2002). Polynomial design of the nonlinear dynamics for the brain-like information processing of whole body motion. In Proceedings of ICRA 2002 (Vol. 2, pp. 1410-1415). IEEE. (Pubitemid 34916445)
31. R. W. Paine J. Tani 2004 Motor primitive and sequence self-organization in a hierarchical recurrent neural network Neural Networks 17 1291 1309 (Pubitemid 39539543)
32. Righetti, L., & Ijspeert, A. (2006). Programmable central pattern generators: an application to biped locomotion control. In Proceedings of the 2006 IEEE international conference on robotics and automation (pp. 1585-1590). (Pubitemid 44940296)
33. L. Righetti J. Buchli A. Ijspeert 2006 Dynamic Hebbian learning in adaptive frequency oscillators Physica D 216 2 269 281
34. B. Rohrer N. Hogan 2003 Avoiding spurious submovement decompositions: a globally optimal algorithm Biological Cybernetics 89 3 190 199
35. S. Schaal 1999 Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences 3 233 242 (Pubitemid 29261903)
36. S. Schaal C. Atkeson 1998 Constructive incremental learning from only local information Neural Computation 10 2047 2084 (Pubitemid 128464295)
37. S. Schaal P. Mohajerian A. Ijspeert 2007 Dynamics systems vs. optimal control a unifying view Progress in Brain Research 165 425 445 (Pubitemid 47513886)
38. Simard, P., & LeCun, Y. (1991). Reverse TDNN: an architecture for trajectory generation. In NIPS (pp. 579-588).
39. J. Tani M. Ito 2003 Self-organization of behavioral primitives as multiple attractor dynamics: A robot experiment IEEE Transactions on Systems, Man, and Cybernetics 33 4 481 488
40. T. Tsuji Y. Tanaka P. Morasso V. Sanguineti M. Kaneko 2002 Bio-mimetic trajectory generation of robots via artificial potential field with time base generator Systems, Man and Cybernetics, Part C, IEEE Transactions on 32 4 426 439
41. Ude, A., Riley, M., Nemec, B., Kos, A., Asfour, T., & Cheng, G. (2007). Synthesizing goal-directed actions from a library of example movements. In IEEE-RAS/RSJ international conference on humanoid robots (Humanoids 2007).
42. P. Zegers M. Sundareshan 2003 Trajectory generation and modulation using dynamic neural networks IEEE Transactions on Neural Networks 14 3 520 533