Eyes on the mind: Investigating the influence of gaze dynamics on the perception of others in real-time social interaction

Frontiers in Psychology

Volumn 3, Issue DEC, 2012, Pages

  Pfeiffer, Ulrich J ^a,b   Schilbach, Leonhard ^a,c   Jording, Mathis ^a   Timmermans, Bert ^a   Bente, Gary ^d   Vogeley, Kai ^a,b  

^a UNIVERSITY HOSPITAL OF COLOGNE   (Germany)

^b FORSCHUNGSZENTRUM JÜLICH   (Germany)

^c MAX PLANCK INSTITUTE FOR NEUROLOGICAL RESEARCH   (Germany)

^d UNIVERSITY OF COLOGNE   (Germany)

Author keywords

Agency; Eye tracking; Gaze following; Joint attention; Mentalizing; Shared attention; Social interaction

Indexed keywords

EID: 84874577725     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00537     Document Type: Article

References (62)

1. Argyle, M., and Cook, M. (1976). Gaze and Mutual Gaze. Cambridge, UK: Cambridge University Press.
2. Auvray, M., Lenay, C., and Stewart, J. (2009). Perceptual interactions in a minimalist virtual environment. New Ideas Psychol. 27, 32-47.
3. Bailenson, J. N., Blascovich, J., Beall, A. C., and Loomis, J. M. (2003). Interpersonal distance in immersive virtual environments. Pers. Soc. Psychol. Bull. 29, 819-833.
4. Bandura, A. (1989). Human agency in social cognitive theory. Am. Psychol. 44, 1175-1184.
5. Baron-Cohen, S., Richler, J., Bisarya, D., Gurunathan, N., and Wheel-wright, S. (2003). The systemizing quotient: an investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. Philos. Trans. R. Soc. Lond. B Biol. Sci. 358, 361-374.
6. Baron-Cohen, S., and Wheelwright, S. (2004). The empathy quotient: an investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. J. Autism Dev. Disord. 34, 163-175.
7. Bayliss, A. P., Frischen, A., Fenske, M. J., and Tipper, S. P. (2007). Affective evaluations of objects are influenced by observed gaze direction and emotional expression. Cognition 104, 644-653.
8. Bayliss, A. P., Murphy, E., Naughtin, C. K., Kritikos, A., Schilbach, L., and Becker, S. I. (2012). "Gaze Leading": initiating simulated joint attention influences eye movements and choice behavior. J. Exp. Psychol. Gen. [Epub ahead of print].
9. Bayliss, A. P., Paul, M. A., Cannon, P. R., and Tipper, S. P. (2006). Gaze cuing and affective judgments of objects: I like what you look at. Psychon. Bull. Rev. 13, 1061-1066.
10. Becchio, C., Sartori, L., and Castiello, U. (2010). Toward you: the social side of actions. Curr. Dir. Psychol. Sci. 19, 183-188.
11. Bellani, M., Fornasari, L., Chittaro, L., and Brambilla, P. (2011). Virtual reality in autism: state of the art. Epidemiol. Psychiatr. Sci. 20, 235-238.
12. Bente, G., Rüggenberg, S., Krämer, N. C., and Eschenburg, F. (2008). Avatar-mediated networking: increasing social presence and interpersonal trust in net-based collaborations. Hum. Commun. Res. 34, 287-318.
13. Biederman, I. (1972). Perceiving real-world scenes. Science 177, 77-80.
14. Bohil, C. J., Alicea, B., and Biocca, F. A. (2011). Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci. 12, 752-762.
15. Buehner, M. J., and Humphreys, G. R. (2009). Causal binding of actions to their effects. Psychol. Sci. 20, 1221-1228.
16. Carletta, J., Hill, R. L., Nicol, C., Taylor, T., de Ruiter, J. P., and Bard, E. G. (2010). Eyetracking for two-person tasks with manipulation of a virtual world. Behav. Res. Methods 42, 254-265.
17. Carpenter, M., Nagell, K., and Tomasello, M. (1998). Social cognition, joint attention, and communicative competence from 9 to 15 months of age. Monogr. Soc. Res. Child Dev. 63, i-vi, 1-143.
18. Clark, H. H. (1996). Using Language, 2nd Edn. Cambridge: Cambridge University Press.
19. Dale, R., Kirkham, N. Z., and Richardson, D. C. (2011). The dynamics of reference and shared visual attention. Front. Psychol. 2:355. doi:10.3389/fpsyg.2011.00355
20. de Vignemont, F., and Fourneret, P. (2004). The sense of agency: a philosophical and empirical review of the "Who" system. Conscious. Cogn. 13, 1-19.
21. Einav, S., and Hood, B. M. (2008). Tell-tale eyes: children's attribution of gaze aversion as a lying cue. Dev. Psychol. 44, 1655-1667.
22. Emery, N. J. (2000). The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci. Biobehav. Rev. 24, 581-604.
23. Franck, N., Daprati, E., Michel, F., Saoud, M., Daléry, J., Marie-Cardine, M., et al. (1998). Gaze discrimination is unimpaired in schizophrenia. Psychiatry Res. 81, 67-75.
24. Frischen, A., Bayliss, A. P., and Tipper, S. P. (2007). Gaze cueing of attention: visual attention, social cognition, and individual differences. Psychol. Bull. 133, 694-724.
25. Frith, C. D., and Frith, U. (2006). The neural basis of mentalizing. Neuron 50, 531-534.
26. Gibson, J. J., and Pick, A. D. (1963). Perception of another person's looking behavior. Am. J. Psychol. 76, 386-394.
27. Gopnik, A., Slaughter, V., and Meltzoff, A. (1994). "Changing your views: how understanding visual perception can lead to a new theory of the mind," in Children's Early Understanding of Mind: Origins and Development, eds C. Lewis and P. Mitchell (Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.), 157-181.
28. Grynszpan, O., Simonin, J., Martin, J.-C., and Nadel, J. (2012). Investigating social gaze as an action-perception online performance. Front. Hum. Neurosci. 6:94. doi:10.3389/fnhum.2012.00094
29. Haggard, P., Clark, S., and Kalogeras, J. (2002). Voluntary action and conscious awareness. Nat. Neurosci. 5, 382-385.
30. Hietanen, J. K., Leppänen, J. M., Peltola, M. J., Linna-aho, K., and Ruuhiala, H. J. (2008). Seeing direct and averted gaze activates the approach-avoidance motivational brain systems. Neuropsychologia 46, 2423-2430.
31. Kaplan, F., and Hafner, V. V. (2006). The challenges of joint attention. Interact. Stud. 7, 135-169.
32. Lahiri, U., Warren, Z., and Sarkar, N. (2011). Design of a gaze-sensitive virtual social interactive system for children with autism. IEEETrans. Neural Syst. Rehabil. Eng. 19, 443-452.
33. Liu, X., Powell, D. K., Wang, H., Gold, B. T., Corbly, C. R., and Joseph, J. E. (2007). Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. J. Neurosci. 27, 4587-4597.
34. Loomis, J. M., Blascovich, J. J., and Beall, A. C. (1999). Immersive virtual environment technology as a basic research tool in psychology. Behav. Res. Methods Instrum. Comput. 31, 557-564.
35. Mason, M. F., Tatkow, E. P., and Macrae, C. N. (2005). The look of love: gaze shifts and person perception. Psychol. Sci. 16, 236-239.
36. Moll, H., and Tomasello, M. (2007). Cooperation and human cognition: the Vygotskian intelligence hypothesis. Philos. Trans. R. Soc. Lond. B Biol. Sci. 362, 639-648.
37. Mundy, P., and Newell, L. (2007). Attention, joint attention, and Social Cognition. Curr. Dir. Psychol. Sci. 16, 269-274.
38. Neider, M. B., Chen, X., Dickinson, C. A., Brennan, S. E., and Zelinsky, G. J. (2010). Coordinating spatial referencing using shared gaze. Psychon. Bull. Rev. 17, 718-724.
39. Nettle, D., and Liddle, B. (2008). Agreeableness is related to social-cognitive, but not social-perceptual, theory of mind. Eur. J. Pers. 22, 323-335.
40. Pacherie, E. (2012). "The phenomenology of joint action: self-agency vs. joint-agency," in Joint Attention: New Developments, ed. A. See-mann (Cambridge, MA: MIT Press), 343-389.
41. Pfeiffer, U. J., Timmermans, B., Bente, G., Vogeley, K., and Schilbach, L. (2011). A non-verbal turing test: differentiating mind from machine in gaze-based social interaction. PLoS ONE 6:e27591. doi:10.1371/journal.pone.0027591
42. Povinelli, D. J., and Eddy, T. J. (1996). Chimpanzees: joint visual attention. Psychol. Sci. 7, 129-135.
43. Redcay, E., Dodell-Feder, D., Pearrow, M. J., Mavros, P. L., Kleiner, M., Gabrieli, J. D. E., et al. (2010). Live face-to-face interaction during fMRI: a new tool for social cognitive neuroscience. Neuroimage 50, 1639-1647.
44. Saslow, M. G. (1967). Effects of components of displacement-step stimuli upon latency for saccadic eye movement. J. Opt. Soc. Am. 57, 1024-1029.
45. Schilbach, L., Eickhoff, S. B., Cieslik, E. C., Kuzmanovic, B., and Vogeley, K. (2011). Shall we do this together Social gaze influences action control in a comparison group, but not in individuals with high-functioning autism. Autism 16, 151-162.
46. Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., et al. (in press). Toward a second-person neuroscience. Behav. Brain Sci.
47. Schilbach, L., Wilms, M., Eickhoff, S. B., Romanzetti, S., Tepest, R., Bente, G., et al. (2010). Minds made for sharing: initiating joint attention recruits reward-related neurocircuitry. J. Cogn. Neurosci. 22, 2702-2715.
48. Scholl, B., and Tremoulet, P. (2000). Perceptual causality and animacy. Trends Cogn. Sci. (Regul. Ed.) 4, 299-309.
49. Senju, A., and Johnson, M. H. (2009). Atypical eye contact in autism: models, mechanisms and development. Neurosci. Biobehav. Rev. 33, 1204-1214.
50. Shepherd, S. V. (2010). Following gaze: gaze-following behavior as a window into social cognition. Front. Integr. Neurosci. 4:5. doi:10.3389/fnint.2010.00005.
51. Staudte, M., and Crocker, M. W. (2011). Investigating joint attention mechanisms through spoken human-robot interaction. Cognition 120, 268-291.
52. Stern, D. N. (1974). The goal and structure of mother-infant play. J. Am. Acad. Child Psychiatry 13, 402-421.
53. Synofzik, M., Vosgerau, G., and Newen, A. (2008). Beyond the comparator model: a multifactorial two-step account of agency. Conscious. Cogn. 17, 219-239.
54. Tarr, M. J., and Warren, W. H. (2002). Virtual reality in behavioral neuro-science and beyond. Nat. Neurosci. 5, 1089-1092.
55. Taylor, B. A., and Hoch, H. (2008). Teaching children with autism to respond to and initiate bids for joint attention. J. Appl. Behav. Anal. 41, 377-391.
56. Tomasello, M., Carpenter, M., Call, J., Behne, T., and Moll, H. (2005). Understanding and sharing intentions: the origins of cultural cognition. Behav. Brain Sci. 28, 675-691; discussion 691-735.
57. van der Weiden, A., Veling, H., and Aarts, H. (2010). When observing gaze shifts of others enhances object desirability. Emotion 10, 939-943.
58. Vogeley, K., and Bente, G. (2010). "Artificial humans": psychology and neuroscience perspectives on embodiment and nonverbal communication. Neural. Netw. 23, 1077-1090.
59. von der Pütten, A. M., Krämer, N. C., Gratch, J., and Kang, S.-H. (2010). "It doesn't matter what you are!" Explaining social effects of agents and avatars. Comput. Human Behav. 26, 1641-1650.
60. Williams, J. A., Burns, E. L., and Harmon, E. A. (2009). Insincere utterances and gaze: eye contact during sarcastic statements. Percept. Mot. Skills 108, 565-572.
61. Wilms, M., Schilbach, L., Pfeiffer, U., Bente, G., Fink, G. R., and Vogeley, K. (2010). It's in your eyes - using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. Soc. Cogn.Affect. Neurosci. 5,98-107.
62. Yang, Q., Bucci, M. P., and Kapoula, Z. (2002). The latency of saccades, vergence, and combined eye movements in children and in adults. Invest. Ophthalmol. Vis. Sci. 43, 2939-2949.