The challenges of joint attention

Interaction Studies

Volumn 7, Issue 2, 2006, Pages 135-169

  Kaplan, Frédéric ^a   Hafner, Verena V ^b  

^a SONY COMPUTER SCIENCE LABORATORY   (France)

^b TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Developmental timeline; Epigenetic robotics; Joint attention; Joint intention

Indexed keywords

EID: 34047265438     PISSN: 15720373     EISSN: 15720381     Source Type: Journal    
DOI: 10.1075/is.7.2.04kap     Document Type: Article

References (108)

1. Andry, P., Gaussier, P., Moga, S., Banquet, J., and Nadel, J. (2001). Learning and communication in imitation: an autonomous robot perspective. IEEE Transaction on Systems, Man and Cybernetics, Part A : Systems and Humans, 31(5):431-444.
2. Arbib, M. (2003). The handbook of brain theory and neural networks. MIT press: Cambridge, MA.
3. Asch, S. (1952). Social Psychology. Prentice-Hall.
4. Ashby, W. (1960). Design for a brain. Chapman and Hall: London.
5. Baird, J. and Baldwin, D. (2001). Making sense of human behavior: Action parsing and intentional inference. In Malle, F., Moses, L., and Baldwin, D., editors, Intentions and Intentionality, Chapter 9. MIT Press, Cambridge, MA.
6. Baldassarre, G., Nolfi, S., and Parisi, D. (2002). Evolving mobile robots able to display collective behavior. Artificial Life, 9:255-267.
7. Baldwin, D., Markram, E., and Melartin, R. (1993). Infants' ability to draw inferences about nonobvious object properties: Evidence from exploratory play. Child Development, 64:711-728.
8. Baron-Cohen, S. (1997). Mindblindness: an essay on autism and theory of mind. MIT Press, Boston, MA, USA.
9. Barto, A., Singh, S., and Chentanez, N. (2004). Intrinsically motivated learning of hierarchical collections of skills. In Proceedings of the 3rd International Conference on Development and Learning (ICDL 2004), Salk Institute, San Diego.
10. Bertenthal, B. (1996). Origins and early development of perception, action and representation. Annual review of psychology, 47:431-59.
11. Billard, A., Epars, Y., Calinon, S., Cheng, G., and Schaal, S. (2004). Discovering optimal imitation strategies. Robotics and Autonomous System, 47(2-3):67-77.
12. Breazeal, C. (2002). Designing sociable robots. Bradford book -MIT Press: Cambridge, MA.
13. Breazeal, C. and Scassellati, B. (2002). Robots that imitate humans. Trends in cognitive sciences, 16(11):481-487.
14. Butterworth, G. (1995). Origins of mind in perception and action. In Moore, C. and Dunham, P., editors, Joint attention: its origins and role in development, pages 29-40. Lawrence Erlbaum Associates.
15. Butterworth, G. and Jarrett, N. (1991). What minds have in common is space: Spatial mechanisms serving joint visual attention in infancy. British Journal of Developmental Psychology, 9:55-72.
16. Butterworth, G. E. and Cochran, E. (1980). Towards a mechanism of joint visual attention in human infancy. International Journal of Behavioural Development, 3:253-272.
17. Carlson, E. and Triesch, J. (2003). A computational model of the emergence of gaze following. In Bowman, H. and Labiouse, C., editors, Progress in Neural Processing. World Scientific.
18. Carpenter, M., Akhtar, N., and Tomasello, M. (1998). Fourteen through eighteen month old infants differentially imitate intentional and accidental actions. Infant behavior and development, 21:315-330.
19. Cheney, D. and Seyfarth, R. M. (1990). How monkeys see the world. University of Chicago Press.
20. Cohn, D., Atlas, L., and Ladner, R. (1994). Improving generalization with active learning. Machine Learning, 15(2):201-221.
21. Coradeschi, S. and Saffiotti, A. (2003). An introduction to the anchoring problem. Robotics and Autonomous Systems, 43:85-96.
22. Corbetta, M. and Shulman, G. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nature Reviews Neuroscience, 3:201-215.
23. Dautenhahn, K. and Nehaniv, C. (2002). Imitation in animals and artifacts. MIT Press, Cambridge, MA.
24. Desrochers, S., Morisette, P., and Ricard, M. (1995). Two perspectives on pointing in infancy. In Moore, C. and Dunham, P., editors, Joint Attention: its origins and role in development, pages 85-101. Lawrence Erlbaum Associates.
25. d'Este, C. (2004). Sharing meaning with machines. In Berthouze, L., Kozima, H., Prince, C., Sandini, G., Stojanov, G., Metta, G., and Balkenius, C., editors, Proceeding of the fourth international workshop on epigenetic robotics: Modeling cognitive development in robotic systems, Lund university cognitive studies 117, pages 111-114.
26. Dignum, F. and Conte, R. (1997). Intentional agents and goal formation. In LNCS 1365: Proceedings of the 4th International Workshop on Intelligent Agents IV, Agent Theories, Architectures, and Languages, pages 231-243, London, UK. Springer-Verlag.
27. Dominey, P. (2003). Learning grammatical constructions from narrated video events for human-robot interaction. In Proceedings of the IEEE humanoid robotics conference, Karlsruhe, Germany.
28. Doya, K., Samejima, K., Katagiri, K., and Kawato, M. (2002). Multiple model-based reinforcement learning. Neural computation, 14:1347-1369.
29. Drescher, G. L. (1991). Made-up minds. The MIT Press, Cambridge: MA.
30. Fedorov, V. (1972). Theory of Optimal Experiment. Academic Press: New York, NY.
31. Floreano, D. and Mondada, F. (1998). Evolutionary neurocontrollers for autonomous mobile robots. Neural Networks, 11:1461-1478.
32. Floreano, D. and Urzelai, J. (2001). Evolution of plastic control networks. Autonomous Robots, 11:311-317.
33. Fox Keller, E. (1995). Refiguring Life: Metaphors of Twentieth Century Biology. Columbia University Press.
34. Frye, D. (1991). The origins of intention in infancy. In Frye, D. and Moore, C., editors, Children's theories of mind, pages 15-38. Lawrence Erlbaum Associates: Hillsdale, NJ.
35. Gallese, V., Fogassi, L., Fadiga, L., and Rizzolatti, G. (2002). Action representation and the inferior parietal lobule. In Prinz, W. and Hommel, B., editors, Attention and performance XIX, pages 247-266. Oxford University Press, Oxford, UK.
36. Gallese, V. and Lakoff, G. (2005). The brain's concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22:455-479.
37. Gergely, G. (2003). What should a robot learn from an infant? Mechanisms of action interpretation and observational learning in infancy. Connection Science, 15(4):191-209.
38. Hafner, V. and Kaplan, F. (2005). Learning to interpret pointing gestures: experiments with four-legged autonomous robots. In S. Wermter, G. Palm, M. Elshaw (Eds.), Biomimetic Neural Learning for Intelligent Robots. Intelligent Systems, Cognitive Robotics, and Neuroscience. (Lecture Notes in Artificial Intelligence; 3575) (pp. 225-234). Berlin: Springer.
39. Hafner, V. and Kaplan, F. (2005). Interpersonal maps and the body correspondence problem. In Demiris, Y., Dautenhahn, K., and Nehaniv, C., editors, Proceedings of the Third International Symposium on Imitation in Animals and Artifacts, pages 48-53, Hertfordshire, UK.
40. Harnad, S. (1990). The symbol grounding problem. Physica D, 40:335-346.
41. Herrmann, J., Pawelzik, K., and Geisel, T. (2000). Learning predicitve representations. Neurocomputing, 32-33:785-791.
42. Hobson, P. (2002). The cradle of thought: challenging the origins of thinking. MacMillan: London, UK.
43. Huang, X. and Weng, J. (2002). Novelty and reinforcement learning in the value system of developmental robots. In Prince, C., Demiris, Y., Marom, Y., Kozima, H., and Balkenius, C., editors, Proceedings of the 2nd international workshop on Epigenetic Robotics : Modeling cognitive development in robotic systems, pages 47-55. Lund University Cognitive Studies 94.
44. Ikegami, T. and Iizuka, H. (2003). Joint attention and dynamics repertoire in coupled dynamical recognizers. In Dautenhahn, K. and Nehaniv, C., editors, Proceedings of the Second International Symposium on Imitation in Animals and Artifacts, pages 125-130, Aberystwyth, UK.
45. Imai, M., Ono, T., and Ishiguro, H. (2003). Physical relation and expression: Joint attention for human-robot interaction. EEE Transaction on Industrial Electronics, 50(4):636-643.
46. Ito, M. and Tani, J. (2004). On-line imitative interaction with a humanoid robot using a dynamic neural network model of a mirror system. Adaptive behavior, 12(2):93-115.
47. Jasso, H., Triesch, J., and Teuscher, C. (2004). Gaze following in the virtual living room. In Palm, G. and Wermter, S., editors, Proceedings of the KI2004 Workshop on Neurobotics.
48. Kaplan, F. (2004). Who is afraid of the humanoid? Investigating cultural differences in the acceptance of robots. International Journal of Humanoid Robotics, 1(3):465-480.
49. Kaplan, F. (2005). Les machines apprivoisees: comprendre les robots de loisir. Vuibert, Paris.
50. Kaplan, F. and Oudeyer, P.-Y. (2003). Motivational principles for visual know-how development. In Prince, C., Berthouze, L., Kozima, H., Bullock, D., Stojanov, G., and Balkenius, C., editors, Proceedings of the 3rd international workshop on Epigenetic Robotics : Modeling cognitive development in robotic systems, pages 73-80. Lund University Cognitive Studies 101.
51. Kaplan, F. and Oudeyer, P.-Y. (2004). Maximizing learning progress: an internal reward system for development. In Iida, F., Pfeifer, R., Steels, L., and Kuniyoshi, Y., editors, Embodied Artificial Intelligence, LNCS 3139, pages 259-270. Springer-Verlag: London, UK.
52. Kaplan, F. and Oudeyer, P.-Y. (2005). The progress-drive hypothesis: an interpretation of early imitation. In Dautenhahn, K. and Nehaniv, C., editors, Models and mechanisms of imitation and social learning: Behavioural, social and communication dimensions. Cambridge University Press. to appear.
53. Kaplan, F., Oudeyer, P.-Y., Kubinyi, E., and Miklosi, A. (2002). Robotic clicker training. Robotics and Autonomous Systems, 38(3-4):197-206.
54. Kaye, K. (1982). The mental and social life of babies. University of Chicago Press: Chicago.
55. Kozima, H. and Yano, H. (2001). A robot that learns to communicate with human caregivers. In Balkenius, C., Zlatev, J., Kozima, H., Dautenhahn, K., and Breazeal, C., editors, Proceedings of the First International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems, Lund University Cognitive Studies 85, pages 47-52.
56. Lindblom, J. and Ziemke, T. (2003). Social situatedness of natural and artificial intelligence: Vygotsky and beyond. Adaptive Behavior, 11:79-96.
57. Marshall, J., Blank, D., and Meeden, L. (2004). An emergent framework for self-motivation in developmental robotics. In Proceedings of the 3rd International Conference on Development and Learning (ICDL 2004), Salk Institute, San Diego.
58. Meltzoff, A. (1995). Understanding the intentions of others: Re-enactment of intended acts by 18-month-old children. Developmental Psychology, 31:838-850.
59. Meltzoff, A. and Gopnick, A. (1993). The role of imitation in understanding persons and developing a theory of mind. In S. Baron-Cohen, H. T.-F. and D.Cohen, editors, Understanding other minds, pages 335-366. Oxford University Press: Oxford, England.
60. Minsky, M. (1975). A framework for representing knowledge. In Wiston, P., editor, The psychology of computer vision, pages 211-277. Mc Graw Hill: New York.
61. Moore, C. and Corkum, V. (1994). Social understanding at the end of the first year of life. Developmental Review, 14:349-372.
62. Nadel, J. (2002). Imitation and imitation recognition: Functional use of imitation in preverbal infants and nonverbal children with autism. In A.Meltzoff and Prinz, W., editors, The imitative mind: development, evolution and brain bases, pages 42-62. Cambridge University Press: Cambridge, UK.
63. Nagai, Y., Asada, M., and Hosoda, K. (2002). A developmental approach accelerates learning of joint attention. In Proceedings of the Second International Conference on Development and Learning (ICDL 02), pages 277-282.
64. Nagai, Y., Hosoda, K., Morita, A., and Asada, M. (2003). A constructive model for the development of joint attention. Connection Science, 15(4):211-229.
65. Newson, J. (1979). The growth of shared understandings between infant and caregiver, pages 207-222. Cambridge University Press, Cambridge, UK.
66. Nolfi, S. and Floreano, D. (1999). Learning and evolution. Autonomous robots, 7(1):89-113.
67. Nolfi, S. and Parisi, D. (1997). Learning to adapt to changing environments in evolving neural networks. Adaptive Behavior, 5(1):75-98.
68. Nothdurft, H. (1993). The role of features in preattentive vision: comparison of orientation, motion and color cues. Vision Research, 33(14):1937-58.
69. Oudeyer, P.-Y., Kaplan, F., Hafner, V. V., and Whyte, A. (2005). The playground experiment: Task-independent development of a curious robot. In Bank, D. and Meeden, L., editors, Proceedings of the AAAI Spring Symposium on Developmental Robotics, 2005, pages 42-47, Stanford, California.
70. Piaget, J. (1952). The origins of intelligence in children. Norton, New York, NY.
71. Poulin-Dubois, D. (1999). Infants distinction between animate and inanimate objects : The origins of naive psychology. In Rochat, P., editor, Early Social Cognition. Erlbaum.
72. Povinelli, D. (2001). On the possibilities of detecting intentions prior to understanding them. In Malle, F., Moses, L., and Baldwin, D., editors, Intentions and Intentionality, Chapter 11. MIT Press.
73. Premack, D. (1990). The infant's theory of self-propelled objects. Cognition, 36:1-16.
74. Quinn, M. (2001). Evolving communication without dedicated communication channels. In Kelemen, J. and Sozik, P., editors, Proceeding of the european conference on artifical life, Lectures Notes in Computer Science 2159, pages 357-366, London, UK. Springer-Verlag.
75. Quinn, M., Smith, L., Mayley, G., and Husbands, P. (2003). Evolving controllers for a homogeneous system of physical robots: Structured cooperation with minimal sensors. Philosophical Transactions of the Royal Society of London, Series A: Mathematical, Physical and Engineering Sciences, 361:2321-2344.
76. Repacholi, B. and Gopnik, A. (1997). Early reasoning about desires: Evidence from 14-and 18-month-olds. Developmental Psychology, 33:12-21.
77. Rizzolatti, G., Fogassi, L., and Gallese, V. (2001). Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Neuroscience Reviews, 2:661-670.
78. Rochat, P., Morgan, R., and Carpenter, M. (1997). Young infants' sensitivity to movement information specifying social causality. Cognitive Development, 12(4):441-465.
79. Roy, D. and Pentland, A. (2002). Learning words from sights and sounds: A computational model. Cognitive science, 26:113-146.
80. Scassellati, B. (1999). Imitation and mechanisms of joint attention: A developmental structure for building social skills on a humanoid robot. In Computation for metaphors, analogy and agents, LNAI 1562. Springer Verlag, London, UK.
81. Schaal, S. (1999). Is imitation learning the route to humanoid robots? Trends in cognitive sciences, 3(6):233-242.
82. Schaffer, H. (1977). Early interactive development in studies of mother-infant interaction. In Proceedings of Loch Lomonds Symposium, pages 3-18, New York. Academic Press.
83. Schank, R. and Abelson, R. (1977). Scripts, plans, goals and understanding: An inquiry into human knowledge structures. Lawrence Erlbaum Associates: Hillsdale, NJ.
84. Schmidhuber, J. (1991). Curious model-building control systems. In Proceeding International Joint Conference on Neural Networks, volume 2, pages 1458-1463, Singapore. IEEE.
85. Siegel, D. (1999). The developing mind : Toward a neurobiology of interpersonal experience. The Guildford press, New York, NY.
86. Sinha, P. (1996). Perceiving and recognizing three-dimensional forms. PhD thesis, Massachusetts Institute of Technology.
87. Siskind, J. M. (2001). Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic. Journal of Artificial Intelligence Research, 15:31-90.
88. Sperber, D., Premack, D., and Premack, A. (1994). Causal cognition: a multidisciplinary debate. Oxford University Press, Oxford, UK.
89. Steels, L. (2003). Evolving grounded communication for robots. Trends in Cognitive Science, 7(7):308-312.
90. Steels, L. and Kaplan, F. (1999). Collective learning and semiotic dynamics. In Floreano, D., Nicoud, J.-D., and Mondada, F., editors, Advances in Artificial Life (ECAL 99), Lecture Notes in Artificial Intelligence 1674, pages 679-688, Berlin. Springer-Verlag.
91. Steels, L. and Kaplan, F. (2000). Aibo's first words: The social learning of language and meaning. Evolution of Communication, 4(1):3-32.
92. Steels, L., Kaplan, F., McIntyre, A., and Van Looveren, J. (2002). Crucial factors in the origins of word-meaning. In Wray, A., editor, The Transition to Language, Chapter 12, pages 252-271. Oxford University Press: Oxford, UK.
93. Stern, D. (1985). The interpersonal world of the infant. Basic books: New York, NY.
94. Sutton, R., Precup, D., and Singh, S. (1999). Between mdpss and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112:181-211.
95. Tani, J. and Nolfi, S. (1999). Learning to perceive the world as articulated : An approach for hiearchical learning in sensory-motor systems. Neural Network, 12:1131-1141.
96. Taylor, K. and Stein, J. (1999). Attention, intention and salience in the posterior parietal cortex. Neurocomputing, 26-27:901-910.
97. Thrun, S. (1995). Exploration in active learning. In Arbib, M., editor, Handbook of Brain Science and Neural Networks. MIT Press, Cambridge, MA.
98. Tomasello, M. (1995). Joint attention as social cognition. In Moore, C. and Dunham, P., editors, Joint attention: its origins and role in development, pages 103-130. Lawrence Erlbaum Associates.
99. Tomasello, M., Call, J., and Hare, B. (2003). Chimpanzees understand psychological states: the question is which ones and to what extend. Trends in Cognitive Science, 7:153-156.
100. Tomasello, M., Carptenter, M., Call, J., Behne, T., and Moll, H. (2004). Understanding and sharing intentions: the origins of cultural cognition. Behavioral and Brain Sciences (in press).
101. Trevarthen, C. (1979). Instincts for human understanding and for cultural cooperation: Development in infancy. In von Cranach, M., Foppa, K., Lepenes, W., and Ploog, D., editors, Human ethology: Claims and limits of a new discipline. Cambridge University Press: Cambridge, UK.
102. Wellman, H. and Phillips, A. (2001). Developing intentional understandings. In Malle, F., Moses, L., and Baldwin, D., editors, Intentions and Intentionality, Chapter 6. MIT Press, Cambridge, MA.
103. Weng, J., McClelland, J., Pentland, A., Sporns, O., Stockman, I., Sur, M., and Thelen, E. (2001). Autonomous mental development by robots and animals. Science, 291:599-600.
104. Wiener, N. (1961). Cybernetics or control and communication in the animal and the machine. The MIT Press: Cambridge, MA.
105. Woodward, A. (1999). Infants ability to distinguish between purposeful and nonpurposeful behaviors. Infants behavior and development, 22(2):145-160.
106. Woodward, A., Phillips, A., and Spelke, E. (1993). Infants expectations about the motion of animate versus inanimate objects. In Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society, Hillsdale, NJ. Lawrence Erlbaum Associates.
107. Ziemke, T. (2002). On the epigenesis of meaning in robots and organisms: Could a humanoid robot develop a human(oid) umwelt? Sign systems studies, 30(1):101-110.
108. Zlatev, J. (2002). Meaning = life (+ culture): An outline of a unified biocultural theory of meaning. Evolution of communication, 4(2):255-299.