Learning from and about others: Towards using imitation to bootstrap the social understanding of others by robots

Artificial Life

Volumn 11, Issue 1-2, 2005, Pages 31-62

  Breazeal, Cynthia ^a   Buchsbaum, Daphna ^a   Gray, Jesse ^a   Gatenby, David ^a   Blumberg, Bruce ^a  

^a MIT MEDIA LAB   (United States)

Author keywords

Facial imitation; Human robot interaction; Learning to imitate; Theory of mind

Indexed keywords

ARTIFICIAL INTELLIGENCE; BEHAVIORAL RESEARCH; COGNITIVE SYSTEMS; COMPUTER SIMULATION; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; MAN MACHINE SYSTEMS; MATHEMATICAL MODELS; ROBOT LEARNING; SENSORY PERCEPTION;

BIOLOGICALLY INSPIRED MECHANISMS; FACIAL IMITATION; HUMAN ROBOT INTERACTION; IMITATIVE INTERACTIONS; SOCIAL LEARNING; THEORY OF MIND;

INTELLIGENT ROBOTS;

COMPREHENSION; HUMAN; IMITATION; INFANT; INSTRUMENTATION; LEARNING; METHODOLOGY; PHYSIOLOGY; REVIEW; ROBOTICS; SOCIAL BEHAVIOR;

COMPREHENSION; HUMANS; IMITATIVE BEHAVIOR; INFANT; LEARNING; ROBOTICS; SOCIAL BEHAVIOR;

EID: 15444371391     PISSN: 10645462     EISSN: None     Source Type: Journal    
DOI: 10.1162/1064546053278955     Document Type: Article

References (86)

1. Ambrose, R., Savely, R., Bluethmann, W., Huber, E., & Kottenkamp, D. (2003). The automation of an astronaut's humanoid assistant. In Proceedings of the IEEE/RAS International Conference on Humanoid Robots (Humanoids '03).
2. Atkeson, C., & Schaal, S. (1997). Learning tasks from single demonstration. In IEEE International Conference on Robotics and Automation (ICRA 97) (pp. 1706-1712). Piscataway, NJ: IEEE.
3. Atkeson, C., & Schaal, S. (1997). Robot learning from demonstration. In International Conference on Machine Learning (pp. 12-20). San Francicsco: Morgan Kaufmann.
4. Baldwin, D., & Moses, J. (1994). Early understanding of referential intent and attentional focus: Evidence from language and emotion. In C. Lewis & P. Mitchell (Eds.), Children's early understanding of mind (pp. 133-156). New York: Erlbaum.
5. Baron-Cohen, S. (1991). Precursors to a theory of mind: Understanding attention in others. In A. Whiten (Ed.), Natural Theories of Mind (pp. 233-250). Oxford, UK: Blackwell Press.
6. Billard, A., & Dautenhahn, K. (1998). Grounding communication in autonomous robots: An experimental study. Robotics and Autonomous Systems, 24(1-2), 71-81.
7. Billard, A, Dautenhahn, K., & Hayes, G. (1998). Experiments on human-robot communication with Robota, an imitative learning and communicating doll robot. In Proceedings of Socially Situated Intelligence Workshop as part of the Fifth Conference of the Simulation of Adaptive Behavior. Center for Policy Modeling technical report series, CPM-98-38.
8. Billard, A. (2002). Imitation: A means to enhance learning of a synthetic proto-language in an autonomous robot. In K. Dantenhahn & C. Nehaniv (Eds.), Imitation in animals and artifacts (pp. 281-310). Cambridge, MA: MIT Press.
9. Billard, A., & Schaal, S. (2001). A connectionist model for on-line learning by imitation. In Proceedings of the 2001 IEEE-RSJ International Conference on Intelligent Robots and Systems. Piscataway, NJ: IEEE/RSJ.
10. Bizzi, E., Mussa-Ivaldi, F. A., & Giszter, S. (1991). Computations underlying the execution of movement: A biological perspective. Science, 253, 287-291.
11. Blumberg, B., Downie, M., Ivanov, Y., Berlin, M., Johnson, M., & Tomlinson, B. (2002). Integrated learning for interactive synthetic characters. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '02) (pp. 417-426). New York: ACM Press.
12. Breazeal, C., & Scassellati, B. (2003). Robots that imitate humans. Trends in Cognitive Sciences, 6, 481-487.
13. Breazeal, C., & Scassellati, B. (1999). A context-dependent attention system for a social robot. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJCAI 99) (pp. 1146-1151).
14. Breazeal, C., Edsinger, A., Fitzpatrick, P., & Scassellati, B. (2001). Active vision systems for sociable robots. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 31(5), 443-453.
15. Breazeal, C. (1999). Imitation as social exchange between humans and robots. In Proceedings of AISB-99 Workshop on Imitation in Animals and Artifacts.
16. Breazeal, C. (2002). Designing sociable robots. Cambridge, MA: MIT Press.
17. Breazeal, C. (2003). Emotion and sociable humanoid robots. International Journal of Human Computer Studies, 59, 119-155.
18. Breazeal, C., Brooks, A., Gray, J., Hoffman, G., Lee, H., Lieberman, J., Lockerd, A., & Chilongo, D. (2004). Tutelage and collaboration for humanoid robots. International Journal of Humanoid Robotics, 1 2), 315-348.
19. Burke, R., Isla, D., Downie, M., Ivanov, Y., & Blumberg, B. (2001). Creature smarts: The art and architecture of a virtual brain. In Proceedings of the 2001 Computer Game Developers Conference.
20. Butterworth, G. (1991). The ontogeny and phylogeny of joint visual attention. In A. Whiten (Ed.), Natural theories of mind (pp. 223-232). Oxford, UK: Blackwell.
21. Campos, J., & Stenberg, C. (1981). Perception, appraisal, and emotion: The onset of social referencing. In M. Lamb, & L. Sherrod (Eds.), Infant social cognition (pp. 273-314). Hillsdale, NJ: Erlbaum.
22. Cao, X., & Guo, B. (2002). Real time tracking and imitation of facial expression. In Proceedings of SPIE International Conference on Imaging and Graphics.
23. Damasio, A. (1994). Descartes' error: Emotion, reason, and the human brain. New York: Putnam.
24. Dautenhahn, K. (1995). Getting to know each other - Artificial social intelligence for autonomous robots. Robotics and Autonomous Systems 16, 333-356.
25. Davies, M., & Stone, T. (1995). Mental simulation. Oxford, UK: Blackwell.
26. Demiris, J., & Hayes, G. (1996). Imitative learning mechanisms in robots and humans. In Proceedings of the Fifth European Workshop on Learning Robots (pp. 9-16).
27. Demiris, J., & Hayes, G. (2002). Imitation as a dual-route process featuring predictive and learning components: A biologically plausible computational model. In K. Dautenhahn, & C. L. Nehaniv (Eds.), Imitation in animals and artifacts (pp. 321-361). Cambridge, MA: MIT Press.
28. Downie, M. (2000). Behavior, animation, and music: The music and movement of synthetic characters. Master's thesis, MIT Program in Media Arts and Sciences, Cambridge, MA.
29. Ekman, P. (1992). Are there basic emotions?. Psychological Review, 99(3), 550-553.
30. Ekman, P., & Oster, H. (1982). Review of research, 1970 to 1980. In P. Ekman (Ed.), Emotion in the human face (pp. 147-174). Cambridge, UK: Cambridge University Press.
31. Feinman, S. (1982). Social referencing in infancy. Merrill-Palmer Quarterly, 28, 445-470.
32. Feinman, S., Roberts, D., Hsieh, K.-F., Sawyer, D., & Swanson, K. (1992). A critical review of social referencing in infancy. In S. Feinman (Ed.), Social referencing and the social construction of reality in infancy (pp. 15-54). New York: Plenum Press.
33. Fod, A., Matarić, M., & Jenkins, O. C. (2002). Automated derivation of primitives for movement classification. Autonomous Robots, 12(1), 39-54.
34. Fong, T., Nourbakshsh, I., & Dautenhahn, K. (2002). A survey of social robots. Robotics and Autonomous Systems, 42, 143-166.
35. Frijda, N. (1994). Emotions require cognitions, even in simple ones. In P. Ekman, & R. Davidson (Eds.), The nature of emotion (pp. 197-202). New York: Oxford University Press.
36. Gallese, V., & Goldman, A. (1998). Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences, 2(12), 493-501.
37. Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain, 119, 593-609.
38. Goldman, A. (2001). Desire, intention, and the simulation theory. In F. Malle, L. Moses, & D. Baldwin (Eds.), Intention and intentionality (pp. 207-224). Cambridge, MA: MIT Press.
39. Gordon, R. (1986). Folk psychology as simulation. Mind and Language 1, 158-171.
40. Hara, F., & Kobayashi, H. (1996). A face robot able to recognize and produce facial expression. In Proceedings of the International Conference on Intelligent Robots and Systems, pp. 1600-1607.
41. Hayes, G., & Demiris, J. (1994). A robot controller using learning by imitation. In Proceedings of the Second International Symposium on Intelligent Robots and Systems (pp. 198-204). LIFTA-IMAG.
42. Heal, J. (2003). Understanding other minds from the inside. In E. Sosa, J. Dancy, J. Haldane, G. Harman, F. Jackson, & W. G. Lucan (Eds.), Mind, reason and imagination (pp. 28-44). Cambridge, UK: Cambridge University Press.
43. Hornik, R., Risenhoover, N., & Gunnar, M. (1987). The effects of maternal positive, neutral, and negative affective communications on infant responses to new toys. Child Development, 58, 937-944.
44. Hornik, R., & Gunnar, M. (1988). A descriptive analysis of infant social referencing. Child Development, 59, 626-634.
45. Hovland, G., Sikka, P., & Mc Carragher, B. (1996). Skill acquisition from human demonstration using a hidden Markov model. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '96) (pp. 2706-2711). Piscataway, NJ: IEEE.
46. Izard, C. (1977). Human emotions. New York: Plenum Press.
47. Izard, C. (1993). Four systems for emotion activation: Cognitive and noncognitive processes. Psychological Review, 100, 68-90.
48. Izard, C. (1994). Cognition is one of four types of emotion activating systems. In P. Ekman, & R. Davidson (Eds.), The nature of emotion (pp. 203-208). New York: Oxford University Press.
49. Jenkins, O. C., & Matari M. (2000). Primitive-based movement classification for humanoid imitation (Tech. Report IRIS-00-385). University of Southern California, Institute for Robotics and Intelligent Systems.
50. Kozima, H. (1998). Attention-sharing and behavior-sharing in human-robot communication. In IEEE International Workshop on Robot and Human Communication (ROMAN-98) (pp. 9-14).
51. Klinnert, M., Campos, J., Source, J., Emde, R., & Svejda, M. (1983). Emotions as behavior regulators: Social referencing in infancy. In R. Plutchik, & H. Kellerman (Eds.), The emotions (vol 2, pp. 57-86). New York: Academic Press.
52. Kuniyoshi, Y., Inaba, M., & Inoue, H. (1994). Learning by watching: Extracting reuseable task knowledge from visual observation of human performance. IEEE Transactions on Robotics and Automation, 10 799-822.
53. Matarić, M., Zordan, V. B., & Masson, Z. (1998). Movement control methods for complex, dynamically simulated agents: Adonis dances the Macarena. In Proceedings of the Second International Conference on Autonomous Agents (pp. 317-324). Minneapolis, MN: ACM Press.
54. Matarić, M. (2002). Sensory-motor primitives as a basis for imitation: Linking perception to action and biology to robotics. In K. Dautenhahn, & C. Nehaniv (Eds.), Imitation in animals and artifacts (pp. 391-422). Cambridge, MA: MIT Press.
55. Maurer, D. (1993). Neonatal synesthesia: Implications for the processing of speech and faces. In B. de Boysson-Bardies, S. de Schonen, P. Jusczik, P. MacNeilage, & J. Morton (Eds.), Developmental neurocognition: Speech and face processing in the first year of life (pp. 109-124). New York: Kluwer Academic.
56. Meltzoff, A. (1996). The human infant as imitative generalist: A 20-year progress report on infant imitation with implications for comparative psychology. In B. Galef, & C. Heyes (Eds.), Social learning in animals: The roots of culture (pp. 347-370). New York: Academic Press.
57. Meltzoff, A. (1995). Understanding the intensions of others: Re-enactment of intended acts by 18-month-old children. Developmental Psychology, 31, 838-850.
58. Meltzoff, A. (1988). Infant imitation after a 1-week delay: Long-term memory for novel acts and multiple stimuli. Developmental Psychology 24, 470-476.
59. Meltzoff, A., & Decety, J. (2003). What imitation tells us about social cognition: A rapprochement between developmental psychology and cognitive neuroscience. Philosophical Transactions of the Royal Society of London B, 358, 491-500.
60. Meltzoff, A., & Gopnik, A. (1993). The role of imitation in understanding persons and developing a theory of mind. In S. Baron-Cohen, H. Tager-Flusberg, & D. J. Cohen (Eds.), Understanding other minds, perspectives from autism (pp. 335-366). Oxford, UK: Oxford University Press.
61. Meltzoff, A., & Brooks, R. (2001). "Like me" as a building block for understanding other minds: Bodily acts, attention, and intention. In F. Malle, L. Moses, & D. Baldwin (Eds.), Intention and intentionality (pp. 171-191). Cambridge, MA: MIT Press.
62. Meltzoff, A., & Moore, M. K. (1997). Explaining facial imitation: A theoretical model. Early Development and Parenting, 6, 179-192.
63. Meltzoff, A., & Moore, M. K. (1994). Imitation, memory and the representation of persons. Infant Behavior and Development, 17 83-99.
64. Miyamoto, H., & Kawato, M. (1998). A tennis serve and upswing learning robot based on bi-directional theory. Neural Networks, 11, 1131-1344.
65. Miyamoto, H., Schaal, S., Gandolfo, F., Gomi, H., Koike, Y., Osu, R., Nakano, E., Wada, Y., & Kawato, M. (1996). A Kendama learning robot based on bi-directional theory. Neural Networks, 9, 1181-1302.
66. Oztop, E., & Arbib, M. (2002). Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics, 87 116-140.
67. Plutchik, R. (1984). Emotions: A general psychoevolutionary theory. In K. Sherer, & P. Elkman (Eds.), Approaches to emotion (pp. 197-219). Hillsdale, NJ: Erlbaum.
68. Plutchik, R. (1991). The emotions. Lanham, MD: University Press of America.
69. Premack, D., & Woodruff, G. (1978). Does the chimpanzee have a theory of mind? Behavioral and Brain Sciences, 1(4), 515-526.
70. Prinz, W. (1990). A common coding approach to perception and action. In O. Neumann, & W. Prinz (Eds.), Relationships between perception and action (pp. 167-201). Berlin: Springer-Verlag.
71. Rao, R., & Meltzoff, A. (2003). Imitation learning in infants and robots: Towards probabilistic computational models. In Proceedings of Artificial Intelligence and Simulation of Behavior (AISB): Cognition in machines and animals. Aberystwith: SSAISB.
72. Rizzolatti, G., Fadiga, L., Gallese, V., & Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Cognitive Brain Research 3, 131-141.
73. Scassellati, B. (1999). Imitation and mechanisms of joint attention: A developmental structure for building social skills on a humanoid robot. In C. Nehaniv (Ed.), Computation for metaphors, analogy and agents Springer Lecture Notes in Artificial Intelligence, Volume 1562, 176-195.
74. Scassellati, B. (2000). Foundations for a theory of mind for a humanoid robot. PhD thesis, Department of Electrical Engineering and Computer Science, MIT, Cambridge, MA.
75. Scassellati, B. (2002). Theory of mind for a humanoid robot. Autonomous Robots, 12(1), 13-24.
76. Schaal, S. (1997). Learning from demonstration. In M. Mozer, M. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems (vol 9, pp. 1040-1046). Cambridge, MA: MIT Press.
77. Schaal, S. (1999). Is imitation learning the route to humanoid robots?. Trends in Cognitive Sciences, 3, 233-242.
78. Scherer, K. (1994). Evidence for both universality and cultural specificity of emotion elicitation. In P. Ekman, & R. Davidson (Eds.), The nature of emotion (pp. 172-175). New York: Erlbaum.
79. Strack, F., Martin, L., & Stepper, S. (1988). Inhibiting and facilitating conditions of the human smile: A nonobtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology, 54, 768-777.
80. Trevarthen, C. (1979). Communication and cooperation in early infancy: A description of primary intersubjectivity. In M. Bullowa (Ed.), Before speech: The beginning of interpersonal communication (pp. 321-348). Cambridge, UK: Cambridge University Press.
81. Uzgiris, I., & Kruper, J. (1992). The links between imitation and social referencing. In S. Feinman (Ed.), Social referencing and the social construction of reality (pp. 115-148). New York: Plenum Press.
82. Walden, T., & Ogan, T. (1988). The development of social referencing. Child Development, 59, 1230-1240.
83. Weber, S., Matarić, M., & Jenkins, O. C. (2000). Experiments in imitation using perceptuo-motor primitives. In C. Sierra, M. Gini, & J. Rosenschein (Eds.), Proceedings of the Fourth International Conference on Autonomous Agents (pp. 136-137). Barcelona, Spain: ACM Press.
84. Whiten, A., & Byrne, W. (1997). Machiavellian intelligence II: Extensions and evaluations. Cambridge, UK: Cambridge University Press.
85. Williams, J., Whiten, A., Suddendorf, T., & Perrett, D. (2001). Imitation, mirror neurons and autism. Neuroscience and Biobehavioral Reviews, 25, 285-295.
86. Wolpert, D., & Kawato, M. (1998). Multiple paired forward and inverse models for motor control. Neural Networks, 11, 1317-1329.