I reach faster when i see you look: Gaze effects in human-human and human-robot face-to-face cooperation

Frontiers in Neurorobotics

Volumn , Issue MAY, 2012, Pages

  Boucher, Jean David ^a   Pattacini, Ugo ^b   Lelong, Amelie ^c   Bailly, Gerard ^c   Elisei, Frederic ^c   Fagel, Sascha ^c   Dominey, Peter Ford ^a   Ventre Dominey, Jocelyne ^a  

^a UNIVERSITÉ DE LYON   (France)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^c GIPSA LAB   (France)

Author keywords

Cooperation; Gaze; Human human interaction; Human robot interaction

Indexed keywords

ARTICLE; ASSOCIATION; COOPERATION; EXPERIMENTAL STUDY; GAZE; HUMAN; HUMAN HUMAN COOPERATION; HUMAN INTERACTION; HUMAN RELATION; HUMAN ROBOT FACE TO FACE COOPERATION; INTERPERSONAL COMMUNICATION; LABELING INDEX; MEASUREMENT; MEDICAL INSTRUMENTATION; MEDICAL TECHNOLOGY; NATURAL ENVIRONMENT; NEUROROBOTICS; PREDICTION; RESPONSE TIME; ROBOTICS; SPEECH; TASK PERFORMANCE;

EID: 84861880897     PISSN: None     EISSN: 16625218     Source Type: Journal    
DOI: 10.3389/fnbot.2012.00003     Document Type: Article

References (50)

1. Argyle, M., and Cook, M. (1976). Gaze and Mutual Gaze. Oxford: Cambridge University Press.
2. Bailly, G., Raidt, S., and Elisei, E (2010). Gaze, conversational agents and face-to-face communication. Speech Commun. 52,598-612.
3. Berez, A. L. (2007). Eudico linguistic annotator (Elan). Lang. Document. Conserv. 1,283-289.
4. Boersma, P., and Weenink, D. (2007). Praat: Doing Phonetics by Computer (Version 5.1.08) (Computer Program). Available at: http://www.praat.org/ [retrieved June 28, 2009].
5. Boucher, J.-D., Ventre-Dominey, J., Fagel, S., Bailly, G., and Dominey, P. E (2010). "Facilitative effects of communicative gaze and speech in human-robot cooperation," in ACM Workshop on Affective Interaction in Natural Environments (AFFINE), ed. G. Castellano (New York: ACM), 71-74.
6. Bull, P., and Connelly, G. (1985). Body movement and emphasis in speech. J. Nonverbal Behav. 9, 169-187.
7. Calder, A. J., Beaver, J. D., Winston, J. S., Dolan, R. J., Jenkins, R., Eger, E., and Henson, R. N. A. (2007). Separate coding of different gaze directions in the superior temporal sulcus and inferior parietal lobule. Curr. Biol. 17,205.
8. Chambers, C. G., Tanenhaus, M. K., Eberhard, K. M., Filip, H., and Carlson, G. N. (2002). Circumscribing referential domains during realtime language comprehension. J. Mem. Lang. 47, 30-49.
9. Chaminade, T., and Cheng, G. (2009). Social cognitive neuroscience and humanoid robotics. J. Physiol. Paris 103,286-295.
10. Collier, G. (1985). Emotional Expression. Hillsdale: Lawrence Erlbaum.
11. de Gelder, B. (2006). Towards the neuro-biology of emotional body language. Nat. Rev. Neurosci. 7,242-249.
12. de Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 3475-3484.
13. Dominey, P. F., and Warneken, E (2011). The basis of shared intentions in human and robot cognition. New Ideas Psychol. 29, 260-274.
14. Fagel, S., Bailly, G., Elisei, F., and Lelong, A. (2010). "On the importance of eye gaze in a face-to-face collaborative task," in ACM Workshop on Affective Interaction in Natural Environments (AFFINE) (Firenze), 81-85.
15. Goossens, H. H., and Van Opstal, A. J. (1997). Human eye-head coordination in two dimensions under different sensorimotor conditions. Exp. Brain Res. 114,542-560.
16. Hadar, U., Steiner, T. J., Grant, E. C., and Rose, E C. (1983). Kinematics of head movements accompanying speech during conversation. Hum. Mov. Sci. 2, 35-46.
17. Hanna, J., and Brennan, S. (2007). Speakers' eye gaze disambiguates referring expressions early during face-to-face conversation. J. Mem. Lang. 57, 596-615.
18. Hellwig, B., Uytvanck, D. V., and Huls-bosch, M. (2010). ELAN - Linguistic Annotator. Manual, Version 3.9.0. Nijmegen: Max Planck Institute for Psycholinguistics.
19. Heylen, D. (2006). Head gestures, gaze and the principles of conversational structure. Int. J. HR 3, 241-267.
20. Hudson, M., Liu, C. H., and Jellema, T. (2009) Anticipating intentional actions: the effect of eye gaze direction on the judgment of head rotation. Cognition 112, 423-434.
21. Ito, K., and Speer, S. R. (2006). "Immediate effects of intonational prominence in a visual search task," in Proceedings of Speech Prosody, Dresden, 261-264.
22. Jonides, J. (1981). "Voluntary versus automatic control over the mind's eye's movement," in Attention and Performance IX, Vol. 9, eds J. B. Long and A. D. Baddeley (Hillsdale: Erlbaum), 187-203.
23. Kendon, A. (1967). Some functions of gaze-direction in social interaction. Acta Psychol. (Amst.) 26, 22-63.
24. Kendon, A. (1983). Gesture and Speech: How they Interact, Vol. 11. Beverly Hills: Sage Publications, 13-45.
25. Lallee, S., Lemaignan, S., Lenz, A., Mel-huish, C., Natale, L., Skachek, S., Zant, T. V D., Warneken, F., and Dominey, P. E (2010a) "Towards a platform independent cooperative human-robot interaction system: I. perception," in The 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, 2010, Taipei.
26. Lallee, S., Madden, C., Hoen, M., and Dominey, P. E (2010b). Linking language with embodied and teleological representations of action for humanoid cognition. Front. Neurorobot. 4:8. doi:10.3389/fnbot.2010.00008
27. Langton, S. R., Watt, R. J., and Bruce, V (2000). Do the eyes have it? Cues to the direction of social attention. Trends Cogn. Sci. (Regul. Ed.) 4, 50-59.
28. Langton, S. R. H., and Bruce, V. (1999). Reflexive visual orienting in response to the social attention of others. Vis. Cogn. 6, 541-567.
29. Lee, J., Marsella, S., Traum, D., and Gratch, J. (2007). "The Rickel gaze model: a window on the mind of a virtual human," in Proceedings of the 7thInternational Conference on Intel-ligentVirtualAgents (IVA-2007). Lecture Notes in Computer Science, Vol. 4722, eds C. Pelachaud, J.-C. Martin, E. André, G. Chollet, K. Karpouzis and D. Pelé, September 17-19, Paris, 296-303.
30. Maricchiolo, F., Bonaiuto, M., and Gnisci, A. (2005). "Hand gestures in speech: studies of their roles in social interaction," in Proceedings of the Conference of the International Society for Gesture Studies, Lyon.
31. McClave,E. (2000). Linguistic functions of head movements in the context of speech. J. Pragmat. 32, 855-878.
32. Meeren, H. K., van Heijnsbergen, C. C., and de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proc. Natl Acad. Sci. U.S.A. 102, 16518-16523.
33. Neider, M. B., Chen, X., Dickinson, C. A., Brennan, S. E., and Zelinsky, G. J. (2010). Coordinating spatial referencing using shared gaze. Psychon. Bull. Rev. 17, 718-724.
34. Pattacini, U. (2010). Modular Cartesian Controllers for Humanoid Robots: Design and Implementation on the iCub. Ph.D. dissertation, RBCS, Isti-tuto Italiano di Tecnologia, Genoa.
35. Pelachaud, C., Badler, N. I., and Steed-man, M. (1996). Generating facial expressions for speech. Cogn. Sci. 20, 146.
36. Perrett, D., Hietanen, J., Oram, M., Benson, P., and Rolls, E. (1992). Organization and functions of cells responsive to faces in the temporal cortex (and discussion). Philos. Trans. R. Soc. Lond. B Biol. Sci. 335, 23-30.
37. Pourtois, G., Sander, D., Andres, M., Grandjean, D., Reveret, L., Olivier, E., and Vuilleumier, P. (2004).
38. Puce, A., Allison, T., Bentin, S., Gore, J. C., and McCarthy, G. (1998). Temporal cortex activation in humans viewing eye and mouth movements. J. Neurosci. 18,2188-2199.
39. Ricciardelli, P., Betta, E., Pruner, S., and Turatto, M. (2009). Is there a direct link between gaze perception and joint attention behaviours? Effects of gaze contrast polarity on oculomotor behaviour. Exp. Brain Res. 194, 347-357.
40. Ricciardelli, P., Bonfiglioli, C., Iani, C., Rubichi, S., and Nicoletti, R. (2007). Spatial coding and central patterns: is there something special about the eyes? Can. J. Exp. Psychol. 61, 79-90.
41. Ricciardelli, P., Bricolo, E., Aglioti, S. M., and Chelazzi, L. (2002). My eyes want to look where your eyes are looking: exploring the tendency to imitate another individual's gaze. Neuroreport 13, 2259-2264.
42. Ricciardelli, P., and Driver, J. (2008). Effects of head orientation on gaze perception: how positive congru-ency effects can be reversed. Q. J. Exp. Psychol. (Hove) 61, 491-504.
43. Salvucci, D. D., and Goldberg, J. H. (2000). "Identifying fixations and saccades in eye-tracking protocols," in Proceedings of the Eye Tracking Research and Applications Symposium (NewYork:ACM Press), 71-78.
44. Sidner, C., Lee, C., Kidd, C., Lesh, N., and Rich, C. (2005). Explorations in engagement for humans and robots. Artif Intell. 166, 140-164.
45. Staudte, M., and Crocker, M. (2009). "Visual attention in spoken HRI," in HRI '09, San Diego.
46. Tomasello,M. (2008). Origins of Human Communication. Boston: MIT Press.
47. Tomasello, M., Carpenter, M., Call, J., Behne, T., and Moll, H. (2005). Understanding and sharing intentions: the origins of cultural cognition. Behav. Brain Sci. 28, 675-691; discussion 691-735.
48. van de Riet, W. A., Grezes, J., and de Gelder, B. (2009). Specific and common brain regions involved in the perception of faces and bodies and the representation of their emotional expressions. Soc. Neurosci. 4, 101-120.
49. Warneken, F., Chen, F., and Tomasello, M. (2006). Cooperative activities in young children and chimpanzees. Child Dev. 77, 640-663.
50. Wätcher, A., and Biegler, L. T. (2006). On the implementation of a primal-dual interior point filter line search algorithm for large-scale nonlinear programming. Math. Program. 106, 25-57.