Imitation learning of positional and force skills demonstrated via kinesthetic teaching and haptic input

Advanced Robotics

Volumn 25, Issue 5, 2011, Pages 581-603

  Kormushev, Petar ^a   Calinon, Sylvain ^a   Caldwell, Darwin G ^a  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

haptics; Imitation learning; kinesthetic teaching; physical human robot interaction; programming by demonstration

Indexed keywords

HAPTICS; IMITATION LEARNING; KINESTHETIC TEACHING; PHYSICAL HUMAN-ROBOT INTERACTION; PROGRAMMING BY DEMONSTRATION;

DEMONSTRATIONS; DYNAMICAL SYSTEMS; HUMAN COMPUTER INTERACTION; MAN MACHINE SYSTEMS; MANIPULATORS; ROBOT PROGRAMMING;

HUMAN ROBOT INTERACTION;

EID: 79953082800     PISSN: 01691864     EISSN: 15685535     Source Type: Journal    
DOI: 10.1163/016918611X558261     Document Type: Article

References (29)

1. A. Billard, S. Calinon, R. Dillmann and S. Schaal, Robot programming by demonstration, in:Handbook of Robotics , B. Siciliano and O. Khatib (Eds), pp. 1371-1394. Springer, Secaucus, NJ (2008).
2. B. D. Argall, S. Chernova, M. Veloso and B. Browning, A survey of robot learning from demonstration, Robotics Autonomous Syst. 57, 469-483 (2009).
3. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA (1998).
4. T. Salter, K. Dautenhahn and R. te Boekhorst, Learning about natural human-robot interaction styles, Robotics Autonomous Syst. 54, 127-134 (2006). (Pubitemid 43113309)
5. A. L. Thomaz, M. Berlin and C. Breazeal, An embodied computational model of social referencing, in: Proc. IEEE Int. Workshop on Robot and Human Interactive Communication, Nashville, TN, pp. 591-598 (2005). (Pubitemid 44144447)
6. K. J. Rohlfing, J. Fritsch, B. Wrede and T. Jungmann, How can multimodal cues from childdirected interaction reduce learning complexity in robots?, Adv. Robotics 20, 1183-1199 (2006). (Pubitemid 44671142)
7. A. De Santis, B. Siciliano, A. De Luca and A. Bicchi, An atlas of physical human-robot interaction, Mech. Mach. Theory 43, 253-270 (2008). (Pubitemid 351163313)
8. P. Kormushev, S. Calinon and D. G. Caldwell, Robot motor skill coordination with EM-based reinforcement learning, in: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Taipei, pp. 3232-3237 (2010).
9. P. Zukow-Goldring, Caregivers and the education of the mirror system, in: Proc. Int. Conf. on Development and Learning, La Jolla, CA, pp. 96-103 (2004).
10. N. J. Hodges and I. M. Franks, Modelling coaching practice: The role of instruction and demonstration, Sports Sci. 20, 793-811 (2002).
11. R. Horn and A. M. Williams, Observational learning: Is it time we took another look?, in:Skill Acquisition in Sport: Research, Theory and Practice , A. M. Williams and N. J. Hodges (Eds), pp. 175-206. Routledge, London (2004).
12. N. Otero, J. Saunders, K. Dautenhahn and C. L. Nehaniv, Teaching robot companions: The role of scaffolding and event structuring, Connect. Sci. 20, 111-134 (2008).
13. S. Calinon and A. Billard, Statistical learning by imitation of competing constraints in joint space and task space, Adv. Robotics 23, 2059-2076 (2009).
14. P. Evrard, E. Gribovskaya, S. Calinon, A. Billard and A. Kheddar, Teaching a collaborative task using teleoperation, in: Proc. IEEE-RAS Int. Conf. on Humanoid Robots, Paris, pp. 399-404 (2009).
15. A. Albu-Schaeffer, S. Haddadin, C. Ott, A. Stemmer, T. Wimboeck and G. Hirzinger, The DLR lightweight robot-design and control concepts in human environments, Ind. Robot 34, 376-385 (2007). (Pubitemid 47283169)
16. A. De Luca and L. Ferrajoli, Exploiting robot redundancy in collision detection and reaction, in: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Nice, pp. 3299-3305 (2008).
17. J.-O. Kim, M. Wayne and P. K. Khosla, Exploiting redundancy to reduce impact force, J. Intell. Robotic Syst. 9, 273-290 (1994).
18. M. Howard, S. Klanke, M. Gienger, C. Goerick and S. Vijayakumar, Methods for learning control policies from variable-constraint demonstrations, in:From Motor Learning to Interaction Learning in Robots , O. Sigaud and J. Peters (Eds), pp. 253-291. Springer, Heidelberg (2010).
19. A. J. Ijspeert, J. Nakanishi and S. Schaal, Trajectory formation for imitation with nonlinear dynamical systems, in: Proc. IEEE Int. Conf. on Intelligent Robots and Systems, Maui, HI, pp. 752-757 (2001). (Pubitemid 34683739)
20. S. Schaal, P. Mohajerian and A. J. Ijspeert, Dynamics systems vs. optimal control a unifying view, Prog. Brain Res. 165, 425-445 (2007). (Pubitemid 47513886)
21. H. Hoffmann, P. Pastor, D. H. Park and S. Schaal, Biologically-inspired dynamical systems for movement generation: Automatic real-time goal adaptation and obstacle avoidance, in: Proc. IEEE Int. Conf. on Robotics and Automation, Kobe, pp. 2587-2592 (2009).
22. S. Calinon, F. D'halluin, D. G. Caldwell and A. G. Billard, Handling of multiple constraints and motion alternatives in a robot programming by demonstration framework, in: Proc. IEEE-RAS Int. Conf. on Humanoid Robots, Paris, pp. 582-588 (2009).
23. S. Calinon, F. D'halluin, E. L. Sauser, D. G. Caldwell and A. G. Billard, Learning and reproduction of gestures by imitation: An approach based on hidden Markov model and Gaussian mixture regression, IEEE Robotics Automat. Mag. 17, 44-54 (2010).
24. M. Khansari and A. G. Billard, BM: An iterative method to learn stable non-linear dynamical systems with Gaussian mixture models, in: Proc. IEEE Int. Conf. on Robotics and Automation, Anchorage, AK, pp. 2381-2388 (2010).
25. R. Featherstone and D. E. Orin, Dynamics, in:Handbook of Robotics , B. Siciliano and O. Khatib (Eds), pp. 35-65. Springer, Secaucus, NJ (2008).
26. S. Calinon, I. Sardellitti and D. G. Caldwell, Learning-based control strategy for safe human-robot interaction exploiting task and robot redundancies, in: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Taipei, pp. 249-254 (2010).
27. J. S. Dai, P. M. Taylor, H. Liu and H. Lin, Folding algorithms and mechanisms synthesis for robotic ironing, Int. J. Clothing Sci. Technol. 16, 204-214 (2004). (Pubitemid 38517214)
28. J. Maitin-Shepard, M. Cusumano-Towner, J. Lei and P. Abbeel, Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding, in: Proc. IEEE Int. Conf. on Robotics and Automation, Anchorage, AK, pp. 2308-2315 (2010).
29. J. S. Dai, P. M. Taylor, P. Sanguanpiyapan and H. Lin, Trajectory and orientation analysis of the ironing process for robotic automation, Int. J. Clothing Sci. Technol. 16, 215-226 (2004). (Pubitemid 38517215)