Keyframe-based Learning from Demonstration: Method and Evaluation

International Journal of Social Robotics

Volumn 4, Issue 4, 2012, Pages 343-355

  Akgun, Baris ^a   Cakmak, Maya ^a   Jiang, Karl ^a   Thomaz, Andrea L ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Human Robot Interaction; Humanoid robotics; Kinesthetic teaching; Learning from Demonstration

Indexed keywords

ANTHROPOMORPHIC ROBOTS; DEMONSTRATIONS; MAN MACHINE SYSTEMS;

BETWEEN CLUSTERS; HUMANOID ROBOT; HUMANOID ROBOTICS; KINESTHETIC TEACHINGS; LEARNING FROM DEMONSTRATION; LEARNING SKILLS; MOUSE GESTURE; ORDERED SET;

HUMAN ROBOT INTERACTION;

EID: 84868033442     PISSN: 18754791     EISSN: 18754805     Source Type: Journal    
DOI: 10.1007/s12369-012-0160-0     Document Type: Article

References (28)

1. Abbeel P, Ng AY (2004) Apprenticeship learning via inverse reinforcement learning. In: Proceedings of the twenty-first international conference on machine learning. ACM Press, New York.
2. Akgun B, Cakmak M, Wook Yoo J, Thomaz LA (2011) Augmenting kinesthetic teaching with keyframes. In: ICML workshop on new developments in imitation learning.
3. Akgun B, Cakmak M, Wook Yoo J, Thomaz LA (2012) Trajectories and keyframes for kinesthetic teaching: a human-robot interaction perspective. In: CM/IEEE intl conference on human-robot interaction (HRI).
4. Amor HB, Berger E, Vogt D, Jun B (2009) Kinesthetic bootstrapping: teaching motor skills to humanoid robots through physical interaction. In: Lecture notes in computer science. Advances in artificial intelligence, vol 58. Springer, Berlin, pp 492-499.
5. Argall B, Chernova S, Browning B, Veloso M (2009) A survey of robot learning from demonstration. Robot Auton Syst 57(5): 469-483.
6. Billard A, Calinon S, Guenter F (2006) Discriminative and adaptive imitation in uni-manual and bi-manual tasks. Robot Auton Syst 54(5): 370-384.
7. Bitzer S, Howard M, Vijayakumar S (2010) Using dimensionality reduction to exploit constraints in reinforcement learning. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 3219-3225.
8. Calinon S, Billard A (2007) What is the teacher's role in robot programming by demonstration? Toward benchmarks for improved learning. Interaction Studies 8(3): 441-464.
9. Calinon S, Billard A (2009) Statistical learning by imitation of competing constraints in joint space and task space. Adv Robot 23(15): 2059-2076.
10. Calinon S, Guenter F, Billard A (2007) On learning, representing and generalizing a task in a humanoid robot. IEEE Trans Syst Man Cybern, Part B, Cybern 37(2): 286-298. Special issue on robot learning by observation, demonstration and imitation.
11. Eddy S (1998) Profile hidden Markov models. Bioinformatics 14(9): 755-763.
12. Flash T, Hogan N (1985) The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5(7): 1688-1703.
13. Gribovskaya E, Billard A (2009) Learning nonlinear multi-variate motion dynamics for real-time position and orientation control of robotic manipulators. In: Proceedings of IEEE-RAS international conference on humanoid robots.
14. Halit C, Capin T (2011) Multiscale motion saliency for keyframe extraction from motion capture sequences. Comput Animat Virtual Worlds 22(1): 3-14.
15. Hersch M, Guenter F, Calinon S, Billard A (2008) Dynamical system modulation for robot learning via kinesthetic demonstrations. IEEE Trans Robot 24(6): 1463-1467.
16. Hsiao K (2006) Imitation learning of whole-body grasps. In: IEEE/RJS international conference on intelligent robots and systems (IROS), pp 5657-5662.
17. Khansari-Zadeh SM, Billard A (2011) Learning stable non-linear dynamical systems with Gaussian mixture models. IEEE Trans Robot 27(5): 943-957.
18. Lipman D, Carrillo H (1988) The multiple sequence alignment problem in biology. SIAM J Appl Math 48: 1073-1082.
19. Liu Y, Zhou F, Liu W, De la Torre F, Liu Y (2010) Unsupervised summarization of rushes videos. In: Proceedings of the international conference on multimedia, MM '10. ACM Press, New York, pp 751-754.
20. Lowe D (1987) Three-dimensional object recognition from single two-dimensional images. Artif Intell 31(3): 355-395.
21. Miyamoto H, Schaal S, Gandolfo F, Gomi H, Koike Y, Osu R, Nakano E, Wada Y, Kawato M (1996) A Kendama learning robot based on bi-directional theory. Neural Netw 9: 1281-1302.
22. Nair N, Sreenivas T (2007) Joint decoding of multiple speech patterns for robust speech recognition. In: IEEE workshop on automatic speech recognition understanding, ASRU, pp 93-98. doi: 10. 1109/ASRU. 2007. 4430090.
23. Parent R (2002) Computer animation: algorithms and techniques. Morgan Kaufmann series in computer graphics and geometric modeling. Morgan Kaufmann, San Mateo.
24. Pastor P, Hoffmann H, Asfour T, Schaal S (2009) Learning and generalization of motor skills by learning from demonstration. In: IEEE intl conference on robotics and automation.
25. Ratliff N, Ziebart B, Peterson K, Bagnell JA, Hebert M, Dey AK, Srinivasa S (2009) Inverse optimal heuristic control for imitation learning. In: Proc AISTATS, pp 424-431.
26. Todorov E, Jordan M (1998) Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. J Neurophysiol 80(2): 696-714.
27. Wada Y, Kawato M (1993) A neural network model for arm trajectory formation using forward inverse dynamics models. Neural Netw 6: 919-932.
28. Weiss A, Igelsboeck J, Calinon S, Billard A, Tscheligi M (2009) Teaching a humanoid: a user study on learning by demonstration with hoap-3. In: Proceedings of the IEEE symposium on robot and human interactive communication (RO-MAN), pp 147-152.