A syntactic approach to robot imitation learning using probabilistic activity grammars

Robotics and Autonomous Systems

Volumn 61, Issue 12, 2013, Pages 1323-1334

  Lee, Kyuhwa ^a   Su, Yanyu ^a   Kim, Tae Kyun ^a   Demiris, Yiannis ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Activity representation; Probabilistic grammars; Robot imitation learning

Indexed keywords

ACTIVITY REPRESENTATION; HIERARCHICAL STRUCTURES; HUMAN DEMONSTRATIONS; IMITATION LEARNING; NUMBER OF SAMPLES; PROBABILISTIC GRAMMARS; ROBOT IMITATIONS; SYNTACTIC APPROACH;

ANTHROPOMORPHIC ROBOTS; EXPERIMENTS; ROBOT LEARNING;

SYNTACTICS;

EID: 84887241176     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2013.08.003     Document Type: Article

References (47)

1. A. Billard, S. Calinon, R. Dillmann, and S. Schaal Robot Programming by Demonstration (Chapter 59) 2008 Springer
2. Y. Kuniyoshi, M. Inaba, and H. Inoue Learning by watching: extracting reusable task knowledge from visual observation of human performance T. Robotics and Automation 10 1994 799 822
3. R. Dillmann Teaching and learning of robot tasks via observation of human performance Robotics and Autonomous Systems 47 2-3 2004 109 116
4. S. Schaal Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences 3 6 1999 233 242
5. M. Asada, M. Ogino, S. Matsuyama, and J. Ooga Imitation learning based on visuo-somatic mapping Experimental Robotics IX 2006 269 278
6. K. Dautenhahn, and C. Nehaniv The agent-based perspective on imitation Imitation in Animals and Artifacts 2002 1 40
7. J. Demiris, and G. Hayes Imitation as a dual-route process featuring predictive and learning components; a biologically plausible computational model K. Dautenhahn, C. Nehaniv, Imitation in Animals and Artifacts (Chapter 13) 2002 327 361
8. S. Calinon, F. Guenter, A. Billard, Goal-directed imitation in a humanoid robot, in: IEEE International Conference on Robotics and Automation, 2005, pp. 299-304.
9. D.C. Bentivegna, C.G. Atkeson, G. Cheng, Learning similar tasks from observation and practice, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2006, pp. 2677-2683.
10. K. Lee, J. Lee, A. Thomaz, A. Bobick, Effective robot task learning by focusing on task-relevant objects, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, USA, 2009, pp. 2551-2556.
11. C. Chao, M. Cakmak, A.L. Thomaz, Towards grounding concepts for transfer in goal learning from demonstration, in: IEEE International Conference on Development and Learning, Vol. 2, 2011, pp. 1-6.
12. D. Baldwin, and J. Baird Discerning intentions in dynamic human action Trends in Cognitive Sciences 5 4 2001 171 178
13. A. Woodward, J. Sommerville, and J. Guajardo How infants make sense of intentional action Intentions and Intentionality: Foundations of Social Cognition 2001 149 169
14. A. Billard, S. Calinon, and F. Guenter Discriminative and adaptive imitation in uni-manual and bi-manual tasks Robotics and Autonomous Systems 54 5 2006 370 384
15. T. Asfour, P. Azad, F. Gyarfas, and R. Dillmann Imitation learning of dual-arm manipulation tasks in humanoid robots International Journal of Humanoid Robotics 5 2 2008 183 202
16. Y. Wu, Y. Demiris, Towards one shot learning by imitation for humanoid robots, in: IEEE International Conference on Robotics and Automation, 2010, pp. 2889-2894.
17. D. Nguyen-tuong, and J. Peters Local gaussian process regression for real time online model learning and control Advances in Neural Information Processing Systems 2008 1193 1200
18. S. Gurbuz, T. Shimizu, G. Cheng, Real-time stereo facial feature tracking: mimicking human mouth movement on a humanoid robot head, in: IEEE-RAS International Conference on Humanoid Robots, 2005, pp. 363-368.
19. H. Soh, Y. Su, and Y. Demiris Online spatio-temporal Gaussian process experts with application to tactile classification IEEE/RSJ International Conference on Intelligent Robots and Systems 2012 4489 4496
20. Y. Demiris, and B. Khadhouri Hierarchical attentive multiple models for execution and recognition of actions Robotics and Autonomous Systems 54 5 2006 361 369
21. M. Ryoo, J. Aggarwal, Robust human-computer interaction system guiding a user by providing feedback, in: International Joint Conferences on Artificial Intelligence, 2007, pp. 2850-2855.
22. Y. Ivanov, and A. Bobick Recognition of visual activities and interactions by stochastic parsing IEEE Transactions on Pattern Analysis and Machine Intelligence 22 2000 852 872
23. K. Lee, Y. Demiris, Towards incremental learning of task-dependent action sequences using probabilistic parsing, in: IEEE International Conference on Development and Learning, Vol. 2, Frankfurt, Germany, 2011, pp. 1-6.
24. C. de la Higuera A bibliographical study of grammatical inference Pattern Recognition 38 9 2005 1332 1348
25. Y. Aloimonos, G. Guerra-Filho, and A. Ogale The language of action: a new tool for human-centric interfaces H. Aghajan, J. Augusto, R. Delgado, Human Centric Interfaces for Ambient Intelligence 2009 95 131
26. C. Nevill-Manning, and I. Witten Identifying hierarchical structure in sequences: a linear-time algorithm Journal of Artificial Intelligence Research 7 1997 67 82
27. Z. Solan, D. Horn, E. Ruppin, and S. Edelman Unsupervised learning of natural languages Proceedings of the National Academy of Sciences 102 33 2005 11629 11634
28. A. Stolcke, and S. Omohundro Inducing probabilistic grammars by Bayesian model merging Grammatical Inference and Applications 862 1994 106 118
29. K. Kitani, S. Yoichi, and A. Sugimoto Recovering the basic structure of human activities from noisy video-based symbol strings International Journal of Pattern Recognition and Artificial Intelligence 22 08 2008 1621 1646
30. K. Lee, T.K. Kim, Y. Demiris, Learning action symbols for hierarchical grammar induction, in: The 21st International Conference on Pattern Recognition, Tsukuba Science City, Japan, 2012, pp. 3778-3782.
31. A. Ogale, A. Karapurkar, and Y. Aloimonos View-invariant modeling and recognition of human actions using grammars Dynamical Vision 2007 115 126
32. M. Nicolescu, M. Mataric, Natural methods for robot task learning: instructive demonstrations, generalization and practice, in: International Joint Conference on Autonomous Agents and Multiagent Systems, 2003, pp. 241-248.
33. P. Langley, S. Stromsten, Learning context-free grammars with a simplicity bias, in: The European Conference on Machine Learning, Vol. 1810, 2000, pp. 220-228.
34. C. Nevill-Manning, and I. Witten On-line and off-line heuristics for inferring hierarchies of repetitions in sequences Proceedings of the IEEE 88 11 2002 1745 1755
35. F. Zhou, F. Torre, J. Hodgins, Aligned cluster analysis for temporal segmentation of human motion, in: IEEE International Conference on Automatic Face & Gesture Recognition, 2008, pp. 1-7.
36. Y. Sakakibara, M. Brown, R. Hughey, S. Mian, K. Sjölander, R.C. Underwood, and D. Haussler Recent methods for RNA modeling using stochastic context-free grammars Combinatorial Pattern Matching 1994 Springer 289 306
37. Y. Shan, R.I. McKay, R. Baxter, H. Abbass, D. Essam, and H. Nguyen Grammar model-based program evolution Congress on Evolutionary Computation 2004, Vol. 1 CEC2004 2004 IEEE 478 485
38. G. Metta, G. Sandini, D. Vernon, L. Natale, and F. Nori The iCub humanoid robot: an open platform for research in embodied cognition Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems 2008 ACM 50 56
39. G. Bradski The Opencv library Doctor Dobbs Journal 25 11 2000 120 126
40. U. Pattacini, F. Nori, L. Natale, G. Metta, G. Sandini, An experimental evaluation of a novel minimum-jerk cartesian controller for humanoid robots, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2010, pp. 1668-1674.
41. Y. Su, Y. Wu, K. Lee, Z. Du, Y. Demiris, Robust grasping for an under-actuated anthropomorphic hand under object position uncertainty, in: IEEE-RAS International Conference on Humanoid Robots, Osaka, Japan, 2012, pp. 719-725.
42. A. Fod, M. Mataric, and O. Jenkins Automated derivation of primitives for movement classification Autonomous Robots 12 1 2002 39 54
43. C. Chang, and C. Lin LIBSVM: a library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 3 2011 1 27
44. C.-Y. Chiu, S.-P. Chao, M.-Y. Wu, S.-N. Yang, and H.-C. Lin Content-based retrieval for human motion data Journal of Visual Communication and Image Representation 15 3 2004 446 466
45. M. Lopes, and J. Santos-Victor Visual learning by imitation with motor representations IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 35 3 2005 438 449
46. D. Moore, I. Essa, Recognizing multitasked activities from video using stochastic context-free grammar, in: AAAI/IAAI, 2002, pp. 770-776.
47. R.E. Fikes, and N.J. Nilsson STRIPS: a new approach to the application of theorem proving to problem solving Artificial Intelligence 2 3 1972 189 208