On-line regression algorithms for learning mechanical models of robots: A survey

Robotics and Autonomous Systems

Volumn 59, Issue 12, 2011, Pages 1115-1129

  Sigaud, Olivier ^a   Salan, Camille ^a   Padois, Vincent ^a  

^a SORBONNE UNIVERSITÉ   (France)

Author keywords

Adaptive and learning systems; Adaptive control; Mechanical models

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; E-LEARNING; LEARNING SYSTEMS; MACHINE DESIGN; ROBOTS; SURVEYS;

ADAPTIVE CONTROL; KINEMATICS AND DYNAMICS; MACHINE LEARNING COMMUNITIES; MECHANICAL DESIGN; MECHANICAL MODEL; ONLINE MODELING; PHYSICAL INTERACTIONS; REGRESSION ALGORITHMS;

LEARNING ALGORITHMS;

EID: 80053576494     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2011.07.006     Document Type: Article

References (121)

1. O. Sigaud, and J. Peters Introduction O. Sigaud, J. Peters, From Motor Learning to Interaction Learning in Robots 2010 Springer 1 12 (Chapter 1)
2. M. Zinn, O. Khatib, B. Roth, and J.K. Salisbury Playing it safe IEEE Robotics and Automation Magazine 2004 12 21
3. W. Chung, L.-C. Fu, and S.-H. Hsu Motion control B. Siciliano, O. Khatib, Handbook of Robotics 2008 Springer 133 159 (Chapter 6)
4. R. Featherstone, and D.E. Orin Dynamics B. Siciliano, O. Khatib, Handbook of Robotics 2008 Springer 35 65 (Chapter 2)
5. B. Siciliano, L. Sciavicco, L. Villani, and G. Oriolo Robotics: Modelling, Planning and Control 2008 Springer Verlag
6. L. Ljung System Identification: Theory for the User 1986 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
7. D. Nguyen-Tuong, and J. Peters Model learning for robot control: a survey Cognitive Processing 2011 1 22
8. M. Hoffmann, H. Marques, A. Arieta, H. Sumioka, M. Lungarella, and R. Pfeifer Body schema in robotics: a review IEEE Transactions on Autonomous Mental Development 2 2010 304 324
9. M. Jagersand Image-based predictive display for high dof uncalibrated tele-manipulation using affine and intensity subspace models Advanced Robotics 14 2001 683 701 (Pubitemid 32432090)
10. N. Mansard, M. Lopes, J. Santos-Victor, F. Chaumette, Jacobian learning methods for tasks sequencing in visual servoing, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 2006, pp. 42844290. (Pubitemid 46928599)
11. J. Sturm, C. Plagemann, and W. Burgard Unsupervised body scheme learning through self-perception IEEE International Conference on Robotics and Automation 2008 IEEE 3328 3333
12. M. Hersch, E. Sauser, and A. Billard Online learning of the body schema International Journal of Humanoid Robotics 5 2008 161 181
13. R. Martinez-Cantin, M. Lopes, L. Montesano, Body schema acquisition through active learning, in: IEEE International Conference on Robotics and Automation, 2010, pp. 18601866.
14. C. Salan, V. Padois, O. Sigaud, Control of redundant robots using learned models: an operational space control approach, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2009, pp. 878885.
15. A. Ben Israel, and T.N.E. Greville Generalized Inverses: Theory and Applications 2nd ed. 2003 Springer
16. O. Khatib, Dynamic control of manipulators in operational space, in: Sixth CISM-IFToMM Congress on Theory of Machines and Mechanisms, 1983, pp. 11281131.
17. F. Rosenblatt The perceptron: a probabilistic model for information storage and organization in the brain Psychological Review 65 1958 386 408
18. T. Kohonen Self-Organizing Maps 2001 Springer Berlin
19. G. Cybenko Approximation by superpositions of a sigmoidal function Mathematics of Control, Signals, and Systems, MCSS 2 1989 303 314
20. M. Butz, O. Herbort, and J. Hoffmann Exploiting redundancy for flexible behavior: unsupervised learning in a modular sensorimotor control architecture Psychological Review 114 2007 1015 1046
21. M. Jordan, and D. Rumelhart Forward models: supervised learning with a distal teacher Cognitive Science: A Multidisciplinary Journal 16 1992 307 354
22. F. Pourboghrat, Neural networks for learning inverse-kinematics of redundant manipulators, in: 32nd Midwest Symposium on Circuits and Systems, vol. 2, 1989, pp. 760762.
23. J. Barhen, S. Gulati, and M. Zak Neutral learning of constrained nonlinear transformations Computer 22 1989 67 76
24. Z. Ahmad, A. Guez, On the solution to the inverse kinematic problem, in: IEEE International Conference on Robotics and Automation, vol. 3, 1990, pp. 16921697.
25. S. Lee, R. Kil, Robot kinematic control based on bidirectional mapping neural network, in: International Joint Conference on Neural Networks, vol. 3, 1990, pp. 327335.
26. M. Brwer, and H. Cruse A network model for the control of the movement of a redundant manipulator Biological Cybernetics 62 1990 549 555 (Pubitemid 20222259)
27. L. Nguyen, R. Patel, K. Khorasani, Neural network architectures for the forward kinematics problem in robotics, in: International Joint Conference on Neural Networks, vol. 3, 1990, pp. 393399.
28. L.H. Sang, M.-C. Han, The estimation for forward kinematic solution of Stewart platform using the neural network, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 1, 1999, pp. 501506.
29. H. Sadjadian, H.D. Taghirad, Numerical methods for computing the forward kinematics of a redundant parallel manipulator, in: IEEE Conference on Mechatronics and Robotics, Aachen, Germany, 2004, pp. 557562.
30. V.R. Barretto, A.F.R. Araujo, and H.J. Ritter Self-organizing feature maps for modeling and control of robotic manipulators Journal of Intelligent and Robotic Systems 36 2003 407 450
31. J. Walter, and K. Schulten Implementation of self-organizing neural networks for visuo-motor control of an industrial robot IEEE Transactions on Neural Networks 4 1993 86 96
32. D. Wang, A. Zilouchian, Solutions of kinematics of robot manipulators using a kohonen self-organizing neural network, in: IEEE International Symposium on Intelligent Control, 1997, pp. 251255.
33. H.J. Ritter, T.M. Martinetz, and K.J. Schulten Topology-conserving maps for learning visuo-motor-coordination Neural Networks 2 1989 159 168
34. T. Martinetz, H. Ritter, and K. Schulten Three-dimensional neural net for learning visuomotor coordination of a robot arm IEEE Transactions on Neural Networks 1 1990 131 136 (Pubitemid 20689517)
35. S. Kumar, P. Premkumar, A. Dutta, and L. Behera Visual motor control of a 7dof redundant manipulator using redundancy preserving learning network Robotica 28 2010 795 810
36. F. Flentge Locally weighted interpolating growing neural gas IEEE Transactions on Neural Networks 17 2006 1382 1392
37. G. Sun, B. Scassellati, Reaching through learned forward model, in: 4th IEEE/RAS International Conference on Humanoid Robots, Los Angeles, USA, vol. 1, 2004, pp. 93112. (Pubitemid 40514256)
38. G. Sun, and B. Scassellati A fast and efficient model for learning to reach International Journal of Humanoid Robotics 2 2005 391 414
39. D.E. Whitney Resolved motion rate control of manipulators and human prostheses IEEE Transactions on ManMachine Systems 10 1969 47 53
40. S. Lin, and A.A. Goldenberg Neural-network control of mobile manipulators IEEE Transactions on Neural Networks 12 2001 1121 1133 (Pubitemid 32981754)
41. C.G. Atkeson, Using locally weighted regression for robot learning, in: IEEE International Conference on Robotics and Automation, vol. 2, 1991, pp. 958963.
42. D. Cohn, Z. Ghahramani, and M. Jordan Active learning with statistical models Journal of Artificial Intelligence Research 4 1996 129 145 (Pubitemid 126646151)
43. S. Schaal, C.G. Atkeson, Receptive field weighted regression, Tech. Rep. TR-H-209, ART Human Inf. Process. Lab., Kyoto, Japan, 1997.
44. S. Schaal, S. Vijayakumar, C.G. Atkeson, Local dimensionality reduction, in: Advances in neural information processing systems, 1998, pp. 633639.
45. H. Wold Soft modelling by latent variables: the non-linear iterative partial least squares (NIPALS) approach Perspectives in Probability and Statistics 1975 117 142
46. L. Elden Partial least-squares vs. Lanczos bidiagonalization-I: analysis of a projection method for multiple regression Computational Statistics and Data Analysis 46 2004 11 31 (Pubitemid 38572624)
47. S. Vijayakumar, S. Schaal, Locally weighted projection regression: an o(n) algorithm for incremental real time learning in high dimensional space, in: International Conference on Machine Learning, 2000, pp. 10791086.
48. S. Schaal, C.G. Atkeson, and S. Vijayakumar Scalable techniques from nonparametric statistics for real time robot learning Applied Intelligence 17 2002 49 60 (Pubitemid 34789897)
49. S. Vijayakumar, A. D'Souza, S. Schaal, LWPR: a scalable method for incremental online learning in high dimensions, Technical Report, Edinburgh University Press, 2005.
50. S. Klanke, S. Vijayakumar, and S. Schaal A library for locally weighted projection regression Journal of Machine Learning Research 9 2008 623 626
51. A. D'Souza, S. Vijayakumar, S. Schaal, Learning inverse kinematics, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 1, 2001, pp. 298303. (Pubitemid 34683669)
52. M. Kawato Internal models for motor control and trajectory planning Current Opinion in Neurobiology 9 1999 718 727
53. S. Vijayakumar, S. Schaal, Local dimensionality reduction for locally weighted learning, in: IEEE International Symposium on Computational Intelligence in Robotics and Automation, 1997, pp. 220225.
54. J. Peters, and S. Schaal Learning to control in operational space International Journal of Robotics Research 27 2008 197 212 (Pubitemid 351169714)
55. J. Sun de la Cruz, D. Kulic, and W. Owen Learning inverse dynamics for redundant manipulator control International Conference on Autonomous and Intelligent Systems 2010 Springer 1 6
56. D. Mitrovic, S. Klanke, and S. Vijayakumar Adaptive optimal control for redundantly actuated arms From Animals to Animats 10: 10th International Conference on Simulation of Adaptive Behavior Sab 2008, Osaka, Japan, July 712, 2008, Proceedings 2008 Springer 93
57. W. Li, Optimal Control for Biological Movement, Ph.D. Thesis, University of California, San Diego, 2006.
58. J.H. Holland Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence 1975 University of Michigan Press Ann Arbor, MI
59. R. Sutton, and A. Barto Reinforcement Learning 1998 MIT Press
60. D.E. Goldberg Genetic Algorithms in Search, Optimization and Machine Learning 1989 Addison-Wesley Boston, MA, USA
61. S.W. Wilson Classifier fitness based on accuracy Evolutionary Computation 3 1995 149 175
62. M.V. Butz, D. Goldberg, and P. Lanzi Computational complexity of the XCS classifier system Foundations of Learning Classifier Systems vol. 51 2005 91 125
63. S.W. Wilson Function approximation with a classifier system Genetic and Evolutionary Computation Conference 2001 Morgan Kaufmann San Francisco, California, USA 974 981
64. S.W. Wilson Classifiers that approximate functions Natural Computing 1 2002 211 234
65. M.V. Butz, and O. Herbort Context-dependent predictions and cognitive arm control with XCSF Conference on Genetic and Evolutionary Computation 2008 ACM 1357 1364
66. B. Widrow, and M. Hoff Adaptive switching circuits Western Electronic Show and Convention 1960 96 104
67. M.V. Butz, T. Kovacs, P.L. Lanzi, and S.W. Wilson Toward a theory of generalization and learning in XCS IEEE Transactions on Evolutionary Computation 8 2004 28 46
68. M.V. Butz, D.E. Goldberg, and K. Tharakunnel Analysis and improvement of fitness exploitation in XCS: bounding models, tournament selection, and bilateral accuracy Evolutionary Computation 11 2003 239 277 (Pubitemid 37106808)
69. T. Kovacs, Deletion schemes for classifier systems, in: Genetic and Evolutionary Computation Conference, Orlando, Florida, 1999, pp. 329336.
70. M.V. Butz, and D. Goldberg Bounding the population size in XCS to ensure reproductive opportunities Genetic and Evolutionary Computation vol. 2724 2003 Springer-Verlag 1844 1856
71. M. Butz, G. Pedersen, and P. Stalph Learning sensorimotor control structures with XCSF: redundancy exploitation and dynamic control Conference on Genetic and Evolutionary Computation 2009 ACM 1171 1178
72. P. Stalph, M. Butz, and G. Pedersen Controlling a four degree of freedom arm in 3D using the XCSF learning classifier system KI 2009: Advances in Artificial Intelligence 2009 193 200
73. H. Drucker, C. Burges, L. Kaufman, A. Smola, and V. Vapnik Support vector regression machines Advances in Neural Information Processing Systems 1997 155 161
74. A.J. Smola, and B. Schölkopf A tutorial on support vector regression Statistics and Computing 14 2004 199 222 (Pubitemid 39063488)
75. D. Nguyen-Tuong, J. Peters, Incremental sparsification for real-time online model learning, in: International Conference on Artificial Intelligence and Statistics, vol. 9, 2010, pp. 557564.
76. J. Suykens, and J. Vandewalle Least squares support vector machine classifiers Neural Processing Letters 9 1999 293 300
77. J. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle Least Squares Support Vector Machines 2002
78. M. Fumagalli, A. Gijsberts, S. Ivaldi, L. Jamone, G. Metta, L. Natale, F. Nori, and G. Sandini Learning to exploit proximal force sensing: a comparison approach O. Sigaud, J. Peters, From Motor to Interaction Learning in Robots 2010 Springer 149 167
79. B. Schölkopf, A. Smola, R. Williamson, and P. Bartlett New support vector algorithms Neural Computation 12 2000 1207 1245
80. C. Chang, C. Lin, LIBSVM: a library for support vector machines, 2001. Software available at: http://www.csie.ntu.edu.tw/cjlin/libsvm.
81. D. Nguyen-Tuong, J. Peters, M. Seeger, B. Schölkopf, Learning inverse dynamics: a comparison, in: European Symposium on Artificial Neural Networks, 2008.
82. T. Cederborg, M. Li, A. Baranes, P.-Y. Oudeyer, Incremental local online Gaussian mixture regression for imitation learning of multiple tasks, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2010. pp. 267274.
83. Y. Choi, S.Y. Cheong, N. Schweighofer, Local online support vector regression for learning control, in: International Symposium on Computational Intelligence in Robotics and Automation, 2007, pp. 1318. (Pubitemid 47515060)
84. J. Ma, J. Theiler, and S. Perkins Accurate on-line support vector regression Neural Computation 15 2003 2683 2703 (Pubitemid 37206931)
85. R. Rifkin, G. Yeo, and T. Poggio Regularized least-squares classification NATO Science Series Sub Series III Computer and Systems Sciences 190 2003 131 154
86. A. Rahimi, and B. Recht Random features for large-scale kernel machines Advances in Neural Information Processing Systems 2008 1177 1184
87. A. Gijsberts, G. Metta, Incremental learning of robot dynamics using random features, in: IEEE International Conference on Robotics and Automation, 2010, pp. 951956.
88. C.K.I. Williams, Prediction with Gaussian processes: from linear regression to linear prediction and beyond, Technical Report NCRG/97/012, Neural Computing Research Group, 1997.
89. J. Quionero Candela, and C.E. Rasmussen A unifying view of sparse approximate Gaussian process regression Journal of Machine Learning Research 6 2005 1939 1959 (Pubitemid 41798128)
90. D. Grollman, O.C. Jenkins, Sparse incremental learning for interactive robot control policy estimation, in: IEEE International Conference on Robotics and Automation, 2008, pp. 33153320.
91. F. Woods, D. Grollman, K. Heller, O.C. Jenkins, M. Black, Incremental Nonparametric Bayesian Regression, Technical Report, Brown University Department of Computer Science, 2008.
92. E. Meeds, and S. Osindero An alternative infinite mixture of Gaussian process experts Advances in Neural Information Processing Systems 2006 MIT Press 883 890
93. D. Nguyen-Tuong, J. Peters, Local Gaussian processes regression for real-time model-based robot control, in: IEEE/RSJ International Conference on Intelligent Robot Systems, 2008. pp. 380385.
94. D. Nguyen-Tuong, M. Seeger, and J. Peters Model learning with local Gaussian process regression Advanced Robotics 23 2009 2015 2034
95. D. Nguyen-Tuong, M. Seeger, and J. Peters Real-time local Gaussian processes model learning O. Sigaud, J. Peters, From Motor to Interaction Learning in Robots 2010 Springer 193 207
96. Y. Engel, S. Mannor, and R. Meir The kernel recursive least-squares algorithm IEEE Transactions on Signal Processing 52 2004 2275 2285
97. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm Journal of the Royal Statistical Society. Series B 39 1977 1 38
98. Z. Ghahramani, and S.T. Roweis Learning nonlinear dynamical systems using an EM algorithm Advances in Neural Information Processing Systems 1999 MIT Press 599 605
99. S. Calinon Robot Programming by Demonstration 2009 EPFL, CRC Press
100. A. Angeli, D. Filliat, S. Doncieux, and J. Meyer Fast and incremental method for loop-closure detection using bags of visual words IEEE Transactions on Robotics 24 2008 1027 1037
101. M. Lopes, B. Damas, A learning framework for generic sensory-motor maps, in: IEEE/RSJ International Conference on Intelligent Robot Systems, 2007, pp. 15331540.
102. B.D. Argall, S. Chernova, M. Veloso, and B. Browning A survey of robot learning from demonstration Robotics and Autonomous Systems 57 2009 469 483
103. A.H. Sayed Adaptive Filters 2008 Wiler-IEEE Press
104. 2008. http://homepages.inf.ed.ac.uk/svijayak/software/LWPR/.
105. P. Stalph, J. Rubinsztajn, O. Sigaud, M. Butz, A comparative study: Function approximation with LWPR and XCSF, in: 13th International Workshop on Advances in Learning Classifier Systems, 2010.
106. 2009. http://www.coboslab.psychologie.uniwuerzburg.de/code/.
107. Y. Shen, A. Ng, and M. Seeger Fast Gaussian process regression using kd-trees Advances in Neural Information Processing Systems 2006 1225
108. R. Grupen, T. Henderson, and I. McCammon A survey of general-purpose manipulation The International Journal of Robotics Research 8 1989 38
109. A. Bicchi Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity IEEE Transactions on Robotics and Automation 16 2000 652 662 (Pubitemid 32191243)
110. K. Kaneko, K. Harada, F. Kanehiro, Development of multi-fingered hand for life-size humanoid robots, in: IEEE International Conference on Robotics and Automation, 2008, pp. 913920. (Pubitemid 350140301)
111. D. Nguyen-Tuong, J. Peters, Using model knowledge for learning inverse dynamics, in: IEEE International Conference on Robotics and Automation, 2010.
112. J. Sun de la Cruz, D. Kuli, and W. Owen Online incremental learning of inverse dynamics incorporating prior knowledge International Conference on Autonomous and Intelligent Systems 2011 Springer 167 176
113. S. Ulbrich, V. Ruiz de Angulo, T. Asfour, C. Torras, R. Dillmann, Rapid learning of humanoid body schemas with kinematic Bezier maps, in: IEEE-RAS International Conference on Humanoid Robots, 2009, pp. 431438.
114. P. Robbel, Active Learning in Motor Control, Master's Thesis, University of Edinburgh, UK, 2005.
115. R. Saegusa, G. Metta, G. Sandini, Active learning for sensorimotor coordinations of autonomous robots, in: Human System Interaction, 2009, pp. 701706.
116. A. Baranes, and P.-Y. Oudeyer R-IAC: robust intrinsically motivated exploration and active learning IEEE Transactions on Autonomous Mental Development 1 2009 155 169
117. A. Baranes, P.-Y. Oudeyer, Maturationally-constrained competence-based intrinsically motivated learning, in: IEEE International Conference on Development and Learning, 2010.
118. G. Petkos, M. Toussaint, and S. Vijayakumar Learning multiple models of non-linear dynamics for control under varying contexts International Conference on Artificial Neural Networks ICANN 2006 Springer 898 907 (Pubitemid 44561739)
119. G. Petkos, S. Vijayakumar, Load estimation and control using learned dynamics models, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007, pp. 15271532.
120. K.M.A. Chai, C.K.I. Williams, S. Klanke, and S. Vijayakumar Multi-task Gaussian process learning of robot inverse dynamics Advances in Neural Information Processing Systems 2009
121. D.-Y. Yeung, Y. Zhang, Learning inverse dynamics by Gaussian process regression under the multi-task learning framework, in: The Path to Autonomous Robots, 2009, pp. 131142.