Learning non-linear multivariate dynamics of motion in robotic manipulators

International Journal of Robotics Research

Volumn 30, Issue 1, 2011, Pages 80-117

  Gribovskaya, E ^a   Khansari Zadeh, S M ^a   Billard, A ^a  

^a EPFL   (Switzerland)

Author keywords

Gaussian mixture model and regression; learning by imitation; Non linear autonomous dynamical systems; robot programming by demonstration

Indexed keywords

ACCELERATION PROFILES; EXPERIMENTAL COMPARISON; GAUSSIAN MIXTURE MODEL; LEARNING BY IMITATION; MANIPULATION TASK; MIXTURE OF GAUSSIANS; NON-LINEAR; NON-LINEAR MOTIONS; PROGRAMMING BY DEMONSTRATION; RE-PLANNING; REAL TIME PERFORMANCE; RECENT TRENDS; ROBOT MOTION; ROBOT PROGRAMMING BY DEMONSTRATION; ROBOTIC MANIPULATORS; ROBOTIC PLATFORMS; SPATIO-TEMPORAL; SPECIFIC VELOCITIES; STATE-OF-THE-ART METHODS;

DEMONSTRATIONS; DYNAMICAL SYSTEMS; DYNAMICS; ENCODING (SYMBOLS); ESTIMATION; HUMAN COMPUTER INTERACTION; IMAGE SEGMENTATION; LINEAR CONTROL SYSTEMS; MANIPULATORS; PROGRAMMABLE ROBOTS; ROBOTICS;

ROBOT PROGRAMMING;

EID: 78651513325     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364910376251     Document Type: Article

References (92)

1. Admiraal, M. and Kusters, M. (2004). Modeling kinematics and dynamics of human arm movements. Motor Control, 5: 312-338.
2. Aleotti, J., Caselli, S. and Reggiani, M. (2005). Evaluation of virtual fixtures for a robot programming by demonstration interface. Transactions on Systems, Man, and Cybernetics, 35 (4). 536-545.
3. Andersson, R. (1989). Aggressive trajectory generator for a robot ping-pong player. IEEE Control Systems Magazine, 9: 15-21.
4. Aoki, M. (1990). State Space Modeling of Time Series. Berlin, Springer.
5. Atkeson, C., Moore, S., and Schaal. S. (1997). Locally weighted learning. Artificial Intelligence Review, 11: 11-73.
6. Attias, H. (1999). Inferring parameters and structure of latent variable models by variational Bayes. Uncertainty in Artificial Intelligence.
7. Attias, H. (1999). Inferring parameters and structure of latent variable models by variational Bayes. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, Vol. 2 (1).
8. Bai, X., Yang, X.-S. and Li, H. (2007). Estimates of the region of attraction of continuous-time cascade systems. Journal of Mathematical Control and Information, 24 (4). 483-491.
9. Bellman, R. (1957). Dynamic Programming. Princeton, NJ, Princeton University Press.
10. Berret, B., Darlot, C., Jean, J., Pozzo, T., Papaxanthis, C., and Gauthier, J.-P. (2008). The inactivation principle: mathematical solutions minimizing the absolute work and biological implications for the planning of arm movements. Journal of Computational Biology, 4 ( 10 ).
11. Billard, A., Calinon, S., Dillmann, R. and Schaal, S. (2008). Robot Programming by Demonstration (Handbook of Robotics, vol. 59). Cambridge, MA, MIT Press.
12. Bizzi, E., Accornero, N., Chapple, W. and Hogan, N. (1984). Posture control and trajectory formation during arm movement. The Journal of Neuroscience, 4: 2738-2744.
13. Brock, O., Kuffner, J. and Xiao, J. (2008). Motion for manipulation tasks. Handbook of Robotics. Berlin, Springer-Verlag.
14. Buhmann, M.D. (2003). Radial Basis Functions: Theory and Implementations. Cambridge, Cambridge University Press.
15. Bullock, D. and Grossberg, S. (1988). Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. Psychological Review, 95: 49-90.
16. Calinon, S. and Billard, A. (2007). What is the teacher's role in robot programming by demonstration? Toward benchmarks for improved learning. Interaction Studies, 8 (3). 441-464.
17. Calinon, S. and Billard, A. (2008). A probabilistic programming by demonstration framework handling constraints in joint space and task space. Proceedings of the International Conference of Intelligent Robots and Systems.
18. Calinon, S., Guenter, F. and Billard, A. (2007). On learning, representing and generalizing a task in a humanoid robot. IEEE Transactions on Systems, Man and Cybernetics, Part B, 37 (2). 286-298. (Pubitemid 46523219)
19. Carroll, T.L. (2007). A nonlinear dynamics method for signal identification. Chaos, 17: 023109.1-023109.7.
20. Chamroukhi, F., Same, A., Govaert, G. and Aknin, P. (2009). Time series modelling by a regression approach based on a latent process. Neural Networks, 22: 593-602.
21. Coates, A., Abbeel, P. and Ng, A. (2008). Learning for control from multiple demonstrations. Proceedings of the International Conference on Machine Learning.
22. Crutchfield, J.P. and McNamara, B.S. (1987). Equations of motion from a data series. Complex Systems, 1: 417-452.
23. d'Avella, A., Saltiel, P. and Bizzi, E. (2003). Combinations of muscle synergies in the construction of a natural motor behavior. Nature Neuroscience, 6: 300-308.
24. d'Avella, A. and Tresch, M. (2002). Modularity in the Motor System: Decomposition of Muscle Patterns as Combinations of Time-varying Synergies (Advances in Neural Information Processing Systems, Vol. 14). Cambridge, MA, MIT Press.
25. Deisenroth, M., Rasmussen, C. and Peters, J. (2009). Gaussian process dynamic programming. Neurocomputing, 72: 1508-1524.
26. Demiris, Y. and Khadhouri, B. (2006). Hierarchical attentive multiple models for execution and recognition of actions. Robotics and Autonomous Systems, 54: 361-369.
27. Dempster, A., Laird, N. and Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39: 1-38.
28. Diankov, R. and Kuffner, J. (2007). Randomized statistical path planning. Proceedings of IEEE/RSJ International Conference on Robots and Systems (IROS).
29. Dixon, K. and Khosla, P. (2004). Trajectory representation using sequenced linear dynamical systems. Proceedings of International Conference on Robotics and Automation, Vol. 4, pp. 3925-3930.
30. Flash, T. and Hogan, N. (1985). The coordination of arm movements: an experimentally confirmed mathematical model. Journal of Neuroscience, 5 (7). 1688-1703.
31. Genesio, R., Tartaglia, M. and Vicino., A. (1985). On the estimation of asympototic stability regions: state of the art and new proposals. IEEE Transaction on Automatic Control, 30 (8). 747-755.
32. Giesl, P. (2008). Construction of a local and global Lyapunov function using radial basis functions. Journal of Applied Mathematics, 73 (5). 782-802.
33. Giszter, S.F., Mussa-Ivaldi, F.A. and Bizzi, E. (1993). Convergent force fields organized in the frog's spinal cord. The Journal of Neuroscience, 13 (2). 467-491.
34. Gribovskaya, E. and Billard, A. (2008). Combining dynamical systems control and programming by demonstration for teaching discrete bimanual coordination tasks to a humanoid robot. IEEE/ASM International Conference on Human-Robot Interaction.
35. Gribovskaya, E. and Billard, A. (2009). Learning nonlinear dynamics of motion for position and orientation control of robotic manipulators. 9th IEEE-RAS International Conference on Humanoid Robots.
36. Guenter, F., Hersch, M., Calinon, S. and Billard, A. (2007). Reinforcement learning for imitating constrained reaching movements. RSJ Advanced Robotics, 21 (13). 1521-1544.
37. Hardle, W. (1991). Smoothing Techniques with Implementation in Statistics. New York, Springer.
38. Harris, C. and Wolpert, D. (1998). Signal-dependent noise determines motor planning. Nature, 394: 780-784.
39. Hersch, M. and Billard, A. (2008). Reaching with multi-referential dynamical systems. Autonomous Robots, 25: 71-83.
40. Hersch, M., Guenter, F., Calinon, S. and Billard, A. (2008). Dynamical system modulation for robot learning via kinesthetic demonstrations. IEEE Transactions on Robotics, 1: 1463-1467.
41. Hinrichsen, D. and Pritchard, A.J. (2000). Mathematical Systems Theory. Berlin, Springer.
42. Hoffmann, H., Pastor, P., Park, D.-H. and Schaal, S. (2009). Biologically-inspired dynamical systems for movement generation: automatic real-time goal adaptation and obstacle avoidance. Proceedings of International Conference on Robotics and Automation.
43. Hsu, P., Hauser, J. and Sastry, S. (1989). Dynamic control of redundant manipulators. Journal of Robotic Systems, 6 (2). 133-148.
44. Hwang, J.-H., Arkin, R. and Kwon, D.-S. (2003). Mobile robots at your fingertip: bezier curve on-line trajectory generation for supervisory control. Proceedings IEEE/RSJ International Conference on Intelligent Robotics and Systems, Vol. 2, pp. 1444-1449.
45. Ijspeert, A. and Crespi, A. (2007). Online trajectory generation in an amphibious snake robot using a Lamprey-like central pattern generator model. Proceedings of International Conference on Robotics and Automation, Vol. 1, pp. 262-268.
46. Ijspeert, A., Nakanishi, J., and Schaal, S. (2001). Trajectory formation for imitation with nonlinear dynamical systems. Proceedings of International Conference on Intelligent Robots and Systems, Vol. 2, pp. 752-757.
47. Ijspeert, A., Nakanishi, J. and Schaal, S. (2002). Learning rhythmic movements by demonstration using nonlinear oscillators. Proceedings of International Conference on Intelligent Robots and Systems, pp. 958-963.
48. Kang, T., He, J. and Tillery, S. (2005). Determining natural arm configuration along a reaching trajectory. Journal of Experimental Brain Research, 352-361.
49. Kelso, J.A.S. (1995). Dynamic Patterns: The Self-organization of Brain and Behavior. Cambridge, MA, MIT Press.
50. Khalil, H. (1996). Nonlinear Systems. Upper Saddle River, NJ, Prentice Hall.
51. Khatib, O. (1987). A unified approach for motion and force control of robot manipulators: the operational space formulation. IEEE Journal of Robotics and Automation, 3 (1). 43-53.
52. Kuffner, J., Kagami, S., Nishiwaki, K., Inaba, M. and Inoue, H. (2002). Dynamically-stable motion planning for humanoid robots. Autonomous Robots, 12 (1). 105-118.
53. Kulic, D., Takano, W. and Nakamura, Y. (2008). Incremental learning, clustering and hierarchy formation of whole body motion patterns using adaptive hidden Markov chains. The International Journal of Robotics Research, 27 (7). 761-784.
54. Lee, E.T.Y. (1986). Comments on some b-spline algorithms. Computing, 36: 229-238.
55. Lim, R.K., Phan, M.Q. and Longman, R.W. (1998). State-space System Identification with Identified Hankel Matrix. Technical Report No. 3045, Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, NJ.
56. Ljung, L. (2004). State of the art in linear system identification: time and frequency domain methods. Proceedings of the American Control Conference, Vol. 1, pp. 650-661.
57. Loccufier, M. and Noldus, E. (2000). A new trajectory reversing method for estimating stability regions of autonomous nonlinear systems. Nonlinear Dynamics, 21 (3). 265-288.
58. McLahlan, G. and Peel, D. (2000). Finite Mixture Models. New York, Wiley.
59. Moore, A. (1990). Efficient Memory-based Learning for Robot Control. PhD Thesis, University of Cambridge.
60. Muller, H.-G. (1988). Nonparametric Regression Analysis of Longitudinal Data. Berlin, Springer.
61. Nakanishi, J., Cory, R., Mistry, M., Peters, J. and Schaal, S. (2005). Comparative experiments on task space control with redundancy resolution. Proceedings of International Conference on Intelligent Robots and Systems.
62. Nguyen-Tuong, D., Seeger, M., and Peters, J. (2008). Local Gaussian process regression for real time online model learning and control. Proceedings of the Conference on Advances in Neural Information Processing Systems.
63. Park, D.-H., Hoffman, A., Pastor, P. and Schaal, S. (2008). Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields. Proceeding of the IEEE International Conference on Humanoid Robotics.
64. Park, J. and Sandberg, I. (1991). Universal approximation using radial-basis-function networks. Neural Computation, 3 (2). 246-257.
65. Pastor, P., Hoffmann, H., Asfour, T. and Schaal, S. (2009). Learning and generalization of motor skills by learning from demonstration. Proceedings of International conference on Robotics and Automation.
66. Peters, J. and Schaal, S. (2008). Learning to control in operational space. The International Journal of Robotic Research, 27 (2). 197-212.
67. Petreska, B. and Billard, A. (2009). Movement curvature planning through force field internal models. Biological Cybernetics, 331-350.
68. Priestley, M. (1980). State-dependent models: a general approach to non-linear time series analysis. Journal of Time Series Analysis, 1: 47-71.
69. Righetti, L., Buchli, J. and Ijspeert, A. (2006). Dynamic hebbian learning in adaptive frequency oscillators. Physica D, 216 (2). 269-281.
70. Schaal, S. and Atkeson, C. (1994). Robot juggling: implementation of memory-based learning. IEEE Control Systems Magazine, 14 (1). 57-71.
71. Schaal, S. and Atkeson, C.G. (1998). Constructive incremental learning from only local information. Neural Computation, 10 (8). 2047-2084.
72. Schaal, S., Ijspeert, A. and Billard, A. (2003). Computational Approaches to Motor Learning by Imitation. Philosophical Transactions: Biological Sciences, 358 (1431). 537-547.
73. Schaal, S., Kotosaka, S. and Sternard, D. (2001). Nonlinear dynamical systems as movement primitives. Proceedings of the International Conference on Humanoid Robotics.
74. Schaal, S., Mohajerian, P. and Ijspeert, A. (2007). Dynamics systems vs. optimal control a unifying view. Progress in Brain Research, 165: 425-445.
75. Schoner, G. and Santos, C. (2001). Control of movement time and sequential action through attractor dynamics: a simulation study demonstration object perception and coordination. Symposium on Intelligent Robotic Systems.
76. Shadmehr, R., Smith, M. and Krakauer, W. (2010). Error correction, sensory prediction, and adaptation in mirror control. Annual Reviews of Neuroscience. 33: 89-109.
77. Sternad, D. and Schaal, D. (1999). Segmentation of endpoint trajectories does not imply segmented control. Experimental Brain Research, 124: 118-136.
78. Sung, H.G. (2004). Gaussian Mixture Regression. PhD Thesis, Rice Univercity, Houston, TX.
79. Tedrake, R., Manchester, I., Tobenkin, M. and Roberts, J. (2010). LQR-trees: feedback motion planning via sums of squares verification. The International Journal of Robotics Research, 29 (8). 1038-1052.
80. Todorov, E. and Jordan, M.I. (2002). Optimal feedback control as a theory of motor coordination. Nature Neuroscience, 5 (11). 1226-1235.
81. Tomohisa, H., Haddad, W.M. and Naira, H. (2008). Neural network adaptive control for a class of nonlinear uncertain dynamical systems with asymptotic stability guarantees. IEEE Transactions on Neural Networks, 19: 80-90.
82. Travis, D., Thumati, B.T. and Jagannathan, S. (2009). Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence. Neural Networks, 22: 851-860.
83. Ude, A., Atkeson, C. and Riley, M. (2004). Programming full-body movements for humanoid robots by observation. Robotics and Autonomous Systems, 47: 93-108.
84. Vijayakumar, S. and Schaal, S. (2000). Locally weighted projection regression: incremental real time learning in high dimensional space. Proceedings of the International Conference on Machine Learning, pp. 1079-1086.
85. Vivani, P. and Terzuolo, C. (1982). Trajectory determines movement dynamics. Neuroscience, 7: 431-437.
86. Wang, S., Luo, H., Yue, C. and Liao, X. (2008). Parameter identification of chaos system based on unknown parameter observer. Physics Letters A, 372: 2603-2607.
87. Wei, H. and Amari, S. (2008). Dynamics of learning near singularities in radial basis function networks. Neural Networks, 21: 981-1005.
88. Xie, N. and Leung, H. (2005). Blind identification of autoregressive system using chaos. IEEE Transactions on Circuits and Systems, 52: 1953-1965.
89. Yamane, K., Kuffner, J. and Hodgins, J. (2004). Synthesizing animations of human manipulation tasks. ACM Transactions on Graphics, 23 (3). 532-539.
90. Yokoi, K., Yoshida, E. and Sanada, H. (2009). Unified motion planning of passing under obstacles with humanoid robots. Proceedings of International Conference on Robotics and Automation, pp. 1185-1190.
91. Yoshida, E., Poirier, M., Laumond, J., Kanoun, O., Lamiraux, F., Alami, R. and Yokoi, K. (2008). Whole-body motion planning for pivoting based manipulation by humanoids. Proceedings of IEEE International Conference on Robotics and Automation.
92. Zöllner, R., Asfour, T. and Dillmann, R. (2004). Programming by demonstration: dual-arm manipulation tasks for humanoid robots. Proceedings of the International Conference on Intelligent Robots and Systems.