Learning and reproduction of gestures by imitation

IEEE Robotics and Automation Magazine

Volumn 17, Issue 2, 2010, Pages 44-54

  Calinon, Sylvain ^a,b   D'Halluin, Florent ^b   Sauser, Eric L ^a,b,c   Caldwell, Darwin G ^d   Billard, Aude G ^b  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b EPFL   (United States)

^c UNIVERSITY OF SHEFFIELD   (United Kingdom)

^d KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

Gaussian mixture regression; Hidden Markov Model; Learning by imitation; Robot programming by demonstration

Indexed keywords

CROSSING MOTIONS; DEGREES OF FREEDOM; GAUSSIAN MIXTURE REGRESSION; GAUSSIAN MIXTURES; HUMAN MOTIONS; HUMANOID ROBOT; PROBABILISTIC APPROACHES; ROBOT PROGRAMMING BY DEMONSTRATION; ROBUST MODELS; STATE-OF-THE-ART APPROACH; TABLE TENNIS RACKET;

ANTHROPOMORPHIC ROBOTS; DEMONSTRATIONS; EXPERIMENTS; GAUSSIAN DISTRIBUTION; HIDDEN MARKOV MODELS; PROGRAMMABLE ROBOTS; REGRESSION ANALYSIS;

ROBOT PROGRAMMING;

EID: 77953328215     PISSN: 10709932     EISSN: None     Source Type: Journal    
DOI: 10.1109/MRA.2010.936947     Document Type: Article

References (33)

1. A. Billard, S. Calinon, R. Dillmann, and S. Schaal, "Robot programming by demonstration," in Handbook of Robotics, B. Siciliano and O. Khatib, Eds. Secaucus, NJ, USA: Springer-Verlag, 2008, pp. 1371-1394.
2. B. Argall, S. Chernova, M. Veloso, and B. Browning, "A survey of robot learning from demonstration," Robot. Auton. Syst., vol.57, no.5, pp. 469-483, 2009.
3. J. Nakanishi, J. Morimoto, G. Endo, G. Cheng, S. Schaal, and M. Kawato, "Learning from demonstration and adaptation of biped locomotion," Robot. Auton. Syst., vol.47, no.2-3, pp. 79-91, 2004.
4. M. Nicolescu and M. Mataric, "Natural methods for robot task learning: Instructive demonstrations, generalization and practice," in Proc. Int. Joint Conf. on Autonomous Agents and Multiagent Systems (AAMAS), Melbourne, Australia, 2003, pp. 241-248.
5. J. Saunders, C. Nehaniv, and K. Dautenhahn, "Teaching robots by moulding behavior and scaffolding the environment," in Proc. ACM SIGCHI/ SIGART Conf. on Human-Robot Interaction (HRI), Salt Lake City, Utah, USA, Mar. 2006, pp. 118-125.
6. M. Pardowitz, R. Zoellner, S. Knoop, and R. Dillmann, "Incremental learning of tasks from user demonstrations, past experiences and vocal comments," IEEE Trans. Syst. Man Cybern., Part B, vol.37, no.2, pp. 322-332, 2007.
7. S. Ekvall and D. Kragic, "Learning task models from multiple human demonstrations," in Proc. IEEE Int. Symp. Robot and Human Interactive Communication (RO-MAN), Hatfield, U.K., Sept. 2006, pp. 358-363.
8. A. Alissandrakis, C. Nehaniv, and K. Dautenhahn, "Correspondence mapping induced state and action metrics for robotic imitation," IEEE Trans. Syst. Man Cybern., Part B, vol.37, no.2, pp. 299-307, 2007.
9. B. Argall, B. Browning, and M. Veloso, "Learning robot motion control with demonstration and advice-operators," in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), Sept. 2008, pp. 399-404.
10. J. Aleotti and S. Caselli, "Robust trajectory learning and approximation for robot programming by demonstration," Robot. Auton. Syst., vol.54, no.5, pp. 409-413, 2006.
11. A. Ude, "Trajectory generation from noisy positions of object features for teaching robot paths," Robot. Auton. Syst., vol.11, no.2, pp. 113-127, 1993.
12. S. Calinon and A. Billard, "Statistical learning by imitation of competing constraints in joint space and task space," Adv. Robot., vol.23, no.15, pp. 2059-2076, 2009.
13. A. Ijspeert, J. Nakanishi, and S. Schaal, "Trajectory formation for imitation with nonlinear dynamical systems," in Proc. IEEE Int. Conf. on Intelligent Robots and Systems (IROS), 2001, pp. 752-757.
14. T. Inamura, I. Toshima, and Y. Nakamura, "Acquiring motion elements for bidirectional computation of motion recognition and generation," in Experimental Robotics VIII, vol.5, B. Siciliano and P. Dario, Eds. New York: Springer-Verlag, 2003, pp. 372-381.
15. D. Grimes, R. Chalodhorn, and R. Rao, "Dynamic imitation in a humanoid robot through nonparametric probabilistic inference," in Proc. Robotics: Science and Systems (RSS), 2006, pp. 1-8.
16. D. Kulic, W. Takano, and Y. Nakamura, "Incremental learning, clustering and hierarchy formation of whole body motion patterns using adaptive hidden Markov chains," Int. J. Robot. Res., vol.27, no.7, pp. 761-784, 2008.
17. L. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol.77, no.2, pp. 257-285, Feb. 1989.
18. Z. Ghahramani and M. Jordan, "Supervised learning from incomplete data via an EM approach," in Advances in Neural Information Processing Systems, vol.6, J. D. Cowan, G. Tesauro, and J. Alspector, Eds. San Mateo, CA: Morgan Kaufmann, 1994, pp. 120-127.
19. M. Muehlig, M. Gienger, S. Hellbach, J. Steil, and C. Goerick, "Tasklevel imitation learning using variance-based movement optimization," in Proc. IEEE Int. Conf. on Robotics and Automation (ICRA), 2009.
20. S. Schaal and C. Atkeson, "Constructive incremental learning from only local information," Neural Computat., vol.10, no.8, pp. 2047-2084, 1998.
21. S. Vijayakumar, A. D'souza, and S. Schaal, "Incremental online learning in high dimensions," Neural Computat., vol.17, no.12, pp. 2602-2634, 2005.
22. D. Nguyen-Tuong and J. Peters, "Local Gaussian process regression for real-time model-based robot control," in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2008, pp. 380-385.
23. M. Hersch, F. Guenter, S. Calinon, and A. Billard, "Dynamical system modulation for robot learning via kinesthetic demonstrations," IEEE Trans. Robot., vol.24, no.6, pp. 1463-1467, 2008.
24. M. Khansari and A. Billard, "BM: An iterative method to learn stable non-linear dynamical systems with Gaussian mixture models," in Proc. IEEE Int. Conf. on Robotics and Automation (ICRA), Anchorage, Alaska, USA, May 2010.
25. D. Bullock and S. Grossberg, "Neural dynamics of planned arm movements: Emergent invariants and speed-accuracy properties during trajectory formation," Psychol. Rev., vol.95, no.1, pp. 49-90, 1988.
26. N. Hogan, "Adaptive control of mechanical impedance by coactivation of antagonist muscles," IEEE Trans. Automat. Contr., vol.29, no.8, pp. 681-690, 1984.
27. N. Tsagarakis, G. Metta, G. Sandini, D. Vernon, R. Beira, F. Becchi, L. Righetti, J. Santos-Victor, A. Ijspeert, M. Carrozza, and D. Caldwell, "iCub: The design and realization of an open humanoid platform for cognitive and neuroscience research," Adv. Robot., vol.21, no.10, pp. 1151-1175, 2007. (Pubitemid 47186904)
28. G. Schwarz, "Estimating the dimension of a model," Ann. Stat., vol.6, no.2, pp. 461-464, 1978.
29. A. Billard, "Robota: Clever toy and educational tool," Robot. Auton. Syst., vol.42, no.3-4, pp. 259-269, 2003.
30. A. Gams, A. Ijspeert, S. Schaal, and J. Lenarcic, "On-line learning and modulation of periodic movements with nonlinear dynamical systems," Auton. Robots, vol.27, no.1, pp. 3-23, 2009.
31. J. Buchli, L. Righetti, and A. Ijspeert, "Frequency analysis with coupled nonlinear oscillators," Phys. D: Nonlinear Phenom., vol.237, pp. 1705-1718, Aug. 2008.
32. S. Calinon, E. Sauser, A. Billard, and D. Caldwell, "Evaluation of a probabilistic approach to learn and reproduce gestures by imitation," in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), Anchorage, Alaska, USA, May 2010.
33. S. Calinon, F. D'halluin, D. Caldwell, and A. Billard, "Handling of multiple constraints and motion alternatives in a robot programming by demonstration framework," in Proc. IEEE-RAS Intl. Conf. Humanoid Robots (Humanoids), Paris, France, Dec. 2009, pp. 582-588.