Is imitation learning the route to humanoid robots?

Trends in Cognitive Sciences

Volumn 3, Issue 6, 1999, Pages 233-242

  Schaal, Stefan ^a,b  

^a University of Southern California   (United States)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; EXPERIMENTAL MODEL; IMITATION; LEARNING; MOTOR CONTROL; MOVEMENT PERCEPTION; NONHUMAN; REVIEW; ROBOTICS;

EID: 0033151712     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1364-6613(99)01327-3     Document Type: Review

References (90)

1. Sciavicco, L. and Siciliano, B. (1996) Modeling and Control of Robot Manipulators, McGraw-Hill
2. Hirai, K. (1998) Current and future perspective of Honda humanoid robot, in Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems, Grenoble, France, pp. 500-508, IEEE
3. Hirai, K. et al. (1998) The development of Honda humanoid robot, in IEEE International Conference on Robotics and Automation, Leuven, Belgium, pp. 1321-1326, IEEE
4. Kaelbling, L.P., Littman, M.L. and Moore, A.W. (1996) Reinforcement learning: a survey J. Artif. Intell. Res. 4, 237-285
5. Sutton, R.S. and Barto, A.G. (1998) Reinforcement Learning: An Introduction, MIT Press
6. Sutton, R.S. (1988) Learning to predict by the methods of temporal differences Machine Learn. 3, 9-44
7. Atkeson, C.G. and Schaal, S. (1997) Learning tasks from a single demonstration, in IEEE International Conference on Robotics and Automation (ICRA97), pp. 1706-1712, IEEE
8. Byrne, R.W. and Russon, A.E. Learning by imitation: a hierachical approach Behav. Brain Sci. (in press)
9. Tomasello, M., Kruger, A.C. and Ranter, H.H. (1993) Cultural learning Behav. Brain Sci. 16, 495-552
10. Romanes, G.J. and Darwin, C. (1884) Mental Evolution in Animals, Appleton & Co.
11. Thorndike, E.L. (1898) Animal intelligence: an experimental study of the associative process in animals Psychol. Rev. Monogr. 2, 551-553
12. Piaget, J. (1951) Play, Dreams, and Imitation in Childhood, W.W. Norton
13. Meltzoff, A.N. and Moore, M.K. (1977) Imitation of facial and manual gestures by human neonates Science 198, 74-78
14. Meltzoff, A.N. and Moore, M.K. (1983) Newborn infants imitate adult facial gestures Child Dev. 54, 702-709
15. Byrne, R. (1995) The Thinking Ape, Oxford University Press
16. Tomasello, M., Savage-Rumbaugh, S. and Kruger, A.C. (1993) Imitative learning of actions on objects by children, chimpanzees, and enculturated chimpanzees Child Dev. 64, 1688-1705
17. Abravanel, E. (1991) Does immediate imitation influence long-term memory for observed actions? J. Exp. Child Psychol. 51, 235-244
18. Weeks, D.L., Hall, A.K. and Anderson, L.P. (1996) A comparison of imitation strategies in observational learning of action patterns J. Motor. Behav. 28, 348-358
19. Mataric, M.J. and Pomplun, M. (1998) Fixation behavior in observation and imitation of human movement Cognit Brain Res. 7, 191-202
20. Turvey, M.T. (1977) Preliminaries to a theory of action with reference to vision, in Perceiving, Acting, and Knowing: Toward an Ecological Psychology (Shaw, R. and Bransford, J., eds), pp. 253-257, Erlbaum
21. Kugler, P.N. and Turvey, M.T. (1987) Information, Natural Law, and the Self-Assembly of Rhythmic Movement, Erlbaum
22. Bertenthal, B.I. (1996) Origins and early development of perception, action, and representation Annu. Rev. Psychol. 47, 431-459
23. Meltzoff, A.N. and Moore, M.K. (1995) Infant's understanding of people and things: from body imitation to folk psychology, in The Body and The Self (Bermüdez, J.L., Marcel, A. and Eilan, N., eds), pp. 43-69, MIT Press
24. Meltzoff, A.N. and Moore, M.K. (1997) Explaining facial imitation: a theoretical model Early Development and Parenting 6, 179-192
25. Bishop, C.M. (1995) Neural Networks for Pattern Recognition, Oxford University Press
26. Rizzolatti, G. et al. (1996) Premotor cortex and the recognition of motor actions Cognit. Brain Res. 3, 131-141
27. Perrett, D.I. et al. (1990) Social signals analysed at the single cell level: someone is looking at me, something touched me, something moved! Int. J. Comp. Psychol. 4, 25-55
28. van Essen, D.C. and Maunsell, J.H.R. (1983) Hierarchical organization and functional streams in the visual cortex Trends Neurosci. 6, 370-375
29. Perrett, D.I. et al. (1985) Visual analysis of body movements by neurones in the temporal cortex of the macaque monkey: a preliminary report Behav. Brain Res. 16, 153-170
30. Perrett, D.I. et al. (1989) Frameworks of analysis for the neural representation of animate objects and actions J. Exp. Biol. 146, 87-113
31. Qram, M.W. and Perrett, D.I. (1996) Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey J. Neurophysiol. 76, 109-129
32. Hietanen, J.K. and Perrett, D.I. (1996) Motion sensitive cells in the macaque superior temporal polysensory area: response discrimination between self-generated and externally generated pattern motion Behav. Brain Res. 76, 155-167
33. Rizzolatti, G. et al. (1988) Functional organization of inferior area 6 in the macaque monkey: II. Area F5 and the control of distal movements Exp. Brain Res. 71, 491-507
34. Jeannerod, M. et al. (1995) Grasping objects: the cortical mechanisms of visuomotor transformation Trends Neurosci. 18, 314-320
35. Murata, A. et al. (1997) Object representation in the ventral premotor cortex (area F5) of the monkey/ Neurophysiol. 78, 2226-2230
36. Arbib, M.A. (1981) Perceptual structures and distributed motor control, in Handbook of Physiology, Section 2: The Nervous System (Vol. II, Motor Control, Part 1) (Brooks, V.B., ed.), pp. 1449-1480, American Physiological Society
37. di Pellegrino, G. et al. (1992) Understanding motor events: a neurophysiological study Exp. Brain Res. 91, 176-180
38. Decety, J. et al. (1994) Mapping motor representations with positron emission tomography Nature 371, 600-602
39. Fadiga, L. et al. (1995) Motor facilitation during action observation: a magnetic stimulation study J. Neurophysiol. 73, 2608-2611
40. Decety, J. (1996) Do imagined and executed actions share the same neural substrate? Cognit. Brain Res. 3, 87-93
41. Rizzolatti, G. and Arbib, M.A. (1998) Language within our g rasp Trends Neurosci. 21, 188-194
42. Gallese, V. and Goldman, A. (1998) Mirror neurons and the simulation theory of mind-reading Trends Cognit. Sci. 2, 493-501
43. Miall, R.C. and Wolpert, D.M. (1996) Forward models for physiological motor control Neural Networks 9, 1265-1285
44. Sakata, H. et al. (1992) Hand-movement related neurons of the posterior parietal cortex of the monkey: their role in visual guidance of hand movements, in Control of Arm Movement in Space (Caminiti, R., Johnson, P.B. and Burnod, Y., eds), pp. 185-198, Springer-Verlag
45. Arbib, M.A. and Rizzolatti, G. (1996) Neural expectations: a possible evolutionary path from manual skills to language Commun. Cognit. 29, 393-424
46. Rizzolatti, G. et al. (1996) Localization of grasp representations in humans by PET: 1. Observation versus execution Exp. Brain Res. 111, 246-252
47. Grafton, ST. et al. (1996) Localization of grasp representations in humans by positron emission tomography: 2. Observation compared with imagination Exp. Brain Res. 112, 103-111
48. Lozano-Pérez, T. (1982) Task-planning, in Robot Planning: Motion and Control (Brady, M. et al., eds), pp. 473-498, MIT Press
49. Dufay, B. and Latombe, J.C. (1984) An approach to automatic robot programming based on inductive learning Int. J. Robotics Res. 3, 89-101
50. Levas, A. and Self ridge, M. (1984) A user-friendly high-level robot teaching system, in International Conference on Robotics and Automation, Altanta, GA, pp. 413-416
51. Segre, A.B. and DeJong, G. (1985) Explanation-based manipulator learning: acquisition of planning ability through observation, in International Conference on Robotics and Automation, pp. 555-560
52. Segre, A.M. (1988) Machine Learning of Robot Assembly Plans, Kluwer Academic Publishers
53. Kuniyoshi, Y., Inaba, M. and Inoue, H. (1989) Teaching by showing: generating robot programs by visual observation of human performance, in Proceedings of the International Symposium of Industrial Robots, pp. 119-126
54. Kuniyoshi, Y., Inaba, M. and Inoue, H. (1994) Learning by watching: extracting reusable task knowledge from visual observation of human performance IEEE Trans. Robotics Automation 10, 799-822
55. Ikeuchi, K., Kawade, M. and Suehiro, T. (1993) Assembly task recognition with planar, curved and mechanical contacts, in Proceedings IEEE International Conference on Robotics and Automation, Atlanta, GA, pp. 688-693, IEEE
56. Tung, C.P. and Kak, A.C. (1995) Automatic learning of assembly task using a DataGlove system, IEEE/RSJ International Conference on Intelligent Robots and Systems, Pittsburgh, PA, pp. 1-8, IEEE/RSJ
57. Dillmann, R., Kaiser, M. and Dde, A. (1995) Acquisition of elementary robot skills from human demonstration, in International Symposium on Intelligent Robotic Systems (SIRS'95), Pisa, Italy, pp. 1-38
58. Pook, P.K. and Ballard, D.H. (1993) Recognizing teleoperated manipulations. Proceedings IEEE International Conference on Robotics and Automation, Atlanta, GA, pp. 913-918
59. Hovland, G.E., Sikka, P. and McCarragher, B.J. (1996) Skill acquisition from human demonstration using a hidden Markov Model, in IEEE International Conference on Robotics and Automation, Minneapolis, MN, pp. 2706-2711, IEEE
60. Grudic, G.Z. and Lawrence, P.D. (1996) Human-to-robot skill transfer using the SPORE approximation, in IEEE International Conference on Robotics and Automation, Minneapolis, MN, pp. 2962-2967, IEEE
61. Demiris, J. et al. (1997) Deferred imitation of human head movements by an active stereo vision head, in IEEE International Workshop on Robot Human Communication, Sendai, Japan, pp. 45-51, IEEE
62. Sternad, D. and Schaal, D. (1999) Segmentation of endpoint trajectories does not imply segmented control Exp. Brain Res. 124, 118-136
63. Sutton, R.S. et al. Improved switching among temporally abstract actions. Advances in Neural Information Processing Systems (Vol. 11), MIT Press (in press)
64. Schaal, S. and Sternad, D. (1998) Programmable pattern generators, in Proceedings of 3rd International Conference on Computational Intelligence in Neuroscience, Research Triangle Park, NC, pp. 48-51
65. Aboaf, E.W., Drucker, S.M. and Atkeson, C.G. (1989) Task-level robot learing: juggling a tennis ball more accurately, in Proceedings of IEEE Interational Conference on Robotics and Automation, Scottsdale, Arizona, pp. 331-348, IEEE
66. Wolpert, D.M. (1997) Computational approaches to motor control Trends Cognit. Sci. 1, 209-216
67. Wolpert, D.M. and Kawato, M. (1998) Multiple paired forward and inverse models for motor control Neural Networks 11, 1317-1329
68. Widrow, B. and Smith, F.W. (1964) Pattern recognizing control systems, in 7963 Computer and Information Sciences (COINS) Symposium Proceedings, pp. 288-317, Spartan
69. Nechyba, M.C. and Xu, Y. (1995) Human skill transfer: neural networks as learners and teachers, in IEEE/RSJ International Conference on Intelligence Robots and Systems, Pittsburgh, PA, pp. 314-319, IEEE/RSJ
70. Lin, L-J. (1991) Programming robots using reinforcement learning and teaching, in Proceedings of theNinth National Conference on Artificial Intelligence, pp. 781-786
71. Hayes, G. and Demiris, J. (1994) A robot controller using learning by imitation, in Proceedings of the 2nd International Symposium on Intelligent Robotic Systems, Grenoble, France (Borkowski, A. and Crowley. J.L., eds), pp. 198-204, LIFTA-IMAG
72. Dautenhahn, K. (1995) Getting to know each other: artificial social intelligence for autonomous robots Robotics and Autonomous Systems 16, 333-356
73. Miyamoto, H. et al. (1996) A Kendama learning robot based on bidirectional theory Neural Networks 9, 1281-1302
74. Miyamoto, H. and Kawato, M. (1998) A tennis serve and upswing learning robot based on bi-directional theory Neural Networks 11, 1331-1344
75. Schaal, S. (1997) Learning from demonstration, in Advances in Neural Information Processing Systems (Vol. 9) (Mozer, M.C., Jordan, M. and Petsche, T., eds), pp. 1040-1046, MIT Press
76. Wolpert, D.M., Miall, R.C. and Kawato, M. (1998) Internal models in the cerebellum Trends Cognit. Sci. 2, 338-347
77. Atkeson, C.G. and Schaal, S. (1997) Robot learning from demonstration, in International Conference on Machine Learning, pp. 11-73
78. Wada, Y. and Kawato, M. (1995) A theory for cursive handwriting based on the minimization principle Biol. Cybern. 73, 3-13
79. Dayan, P. et al. (1995) The Helmholtz machine Neural Comput. 7, 889-904
80. Murray-Smith, R. and Johanson, T.A. (1998) Multiple Model Approaches to Modelling and Control, Taylor & Francis
81. Demiris, J. and Hayes, G. (1999) Active and passive routes to imitation in Proceedings of the AISB '99 Symposium of Imitation in Animals and Artifacts, pp. 81-87, AISB
82. Fagg, A.M. and Arbib, M.A. (1998) Modeling parietal-premotor interactions in primate control of grasping Neural Networks 11, 1277-1303
83. Weigend, A.S., Mangeas, M. and Srivastava, A.N. (1995) Nonlinear gated experts for time series: discovering regimes and avoiding overfitting Int. J. Neural Syst. 6, 373-399
84. Cacciatore, T.W. and Nowlan, S.J. (1994) Mixtures of controllers for jump linear and non-linear plants, in Advances in Neural Information Processign Systems (Vol. 6) (Cowen, J.D., Tesauro, G. and Alspector, J., eds), pp. 719-726,
85. Morgan Kaufmann SBPawelzik, K., Kohlmorgen, J. and Müller, K.R. (1996) Annealed competition of experts for a segmentation and classification of switching dynamics Neural Comput. 8, 340-356
86. Kawato, M. (1996) Bi-directional theory approach to integration, in Attention and Performance, Vol. XVI (Konczak, J. and Thelen, E., eds), pp. 335-367, MIT Press
87. Beer, R.D. et al. (1998) Bio-robotic approaches to the study of motor systems Curr. Opin. Neurobiol. 8, 777-782
88. Brooks, R.A. et al. The Cog Project: building a humanoid robot. Lecture Notes in Computer Science, Springer-Verlag (in press)
89. Korno, A. et al. (1997) Development of a humanoid robot Saika, in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'97), pp. 805-810, IEEE
90. Kikuchi, H. et al. (1998) Controlling gaze of humanoid in communication with human. International Conference on Intelligent Robots and Systems, Victoria, BC, pp. 255-260