The eye contact effect in request and emblematic hand gestures

European Journal of Neuroscience

Volumn 39, Issue 5, 2014, Pages 841-851

  Ferri, Francesca ^a   Busiello, Marianna ^b   Campione, Giovanna C ^a   De Stefani, Elisa ^a   Innocenti, Alessandro ^a,d   Romani, Gian Luca ^b   Costantini, Marcello ^b   Gentilucci, Maurizio ^a,c  

^a UNIVERSITY OF PARMA   (Italy)

^b UNIVERSITY OF CHIETI   (Italy)

^c ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^d UNIVERSITY OF MILAN   (Italy)

Author keywords

Communicative gestures; Functional magnetic resonance imaging; Gesture representation; Social gaze; Social intention

Indexed keywords

ADULT; ARTICLE; BOLD SIGNAL; BRAIN FUNCTION; BRAIN MAPPING; CONTROLLED STUDY; EMBLEMATIC GESTURE; EYE CONTACT; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GESTURE; HEMISPHERIC DOMINANCE; HUMAN; HUMAN EXPERIMENT; MALE; NONVERBAL COMMUNICATION; NORMAL HUMAN; PRIORITY JOURNAL; REQUEST GESTURE; VISUAL INFORMATION; VISUAL STIMULATION;

COMMUNICATIVE GESTURES; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GESTURE REPRESENTATION; SOCIAL GAZE; SOCIAL INTENTION;

ADULT; BRAIN; BRAIN MAPPING; CUES; FEMALE; FUNCTIONAL LATERALITY; GESTURES; HAND; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGE PROCESSING, COMPUTER-ASSISTED; INTERPERSONAL RELATIONS; MAGNETIC RESONANCE IMAGING; MALE; YOUNG ADULT;

EID: 84896723589     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/ejn.12428     Document Type: Article

References (72)

1. Adams, R.B. & Kleck, R.E. (2005) Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion, 5, 3-11.
2. Adolphs, R. (2009) The social brain: neural basis of social knowledge. Annu. Rev. Psychol., 60, 693-716.
3. Allison, T., Puce, A. & McCarthy, G. (2000) Social perception from visual cues: role of the STS region. Trends Cogn. Sci., 4, 267-278.
4. Barten, S. (1979) The development of gesture. In Smith, N. & Franklin, M. (Eds), Symbolic Functioning in Childhood. Wiley, New York, pp. 139-151.
5. Bartha, L., Brenneis, C., Schocke, M., Trinka, E., Köylü, B., Trieb, T., Kremser, C., Jaschke, W., Bauer, G., Poewe, W. & Benke, T. (2003) Medial temporal lobe activation during semantic language processing: fMRI findings in healthy left- and right-handers. Brain Res. Cogn. Brain Res., 17, 339-346.
6. Bookheimer, S. (2002) Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. Annu. Rev. Neurosci., 25, 151-188.
7. Brancucci, A., Lucci, G., Mazzatenta, A. & Tommasi, L. (2009) Asymmetries of the human social brain in the visual, auditory and chemical modalities. Philos. T. Roy. Soc. B., 364, 895-914.
8. Brothers, L., Ring, B. & Kling, A. (1990) Response of neurons in the macaque amygdala to complex social stimuli. Behav. Brain Res., 41, 199-213.
9. Cassell, J., McNeill, D. & McCullough, K.-E. (1999) Speech-gesture mismatches: evidence for one underlying representation of linguistic and nonlinguistic information. Pragmatics Cogn., 7, 1-34.
10. Castiello, U. (2003) Understanding other people's actions: intention and attention. J. Exp. Psychol. Human, 29, 416-430.
11. Chaminade, T., Zecca, M., Blakemore, S.J., Takanishi, A., Frith, C.D., Micera, S., Dario, P., Rizzolatti, G., Gallese, V. & Umiltà, M.A. (2010) Brain response to a humanoid robot in areas implicated in the perception of human emotional gestures. PLoS ONE, 5, e11577.
12. Christie, J. & Klein, R. (1995) Familiarity and attention: does what we know affect what we notice? Mem. Cognition, 23, 547-550.
13. Dale, A.M. (1999) Optimal experimental design for event-related fMRI. Hum. Brain Mapp., 8, 109-114.
14. Decety, J. & Grèzes, J. (1999) Neural mechanisms subserving the perception of human actions. Trends Cogn. Sci., 3, 172-178.
15. Decety, J. & Sommerville, J.A. (2003) Shared representations between self and other: a social cognitive neuroscience view. Trends Cogn. Sci., 7, 527-533.
16. Dick, A.S., Goldin-Meadow, S., Hasson, U., Skipper, J.I. & Small, S.L. (2009) Co-speech gestures influence neural activity in brain regions associated with processing semantic information. Hum. Brain Mapp., 30, 3509-3526.
17. Ethofer, T., Gschwind, M. & Vuilleumier, P. (2011) Processing social aspects of human gaze: a combined fMRI-DTI study. NeuroImage, 55, 411-419.
18. Ferri, F., Stoianov, I.P., Gianelli, C., D'Amico, L., Borghi, A.M. & Gallese, V. (2010) When action meets emotions: how facial displays of emotion influence goal-related behavior. PLoS ONE, 5, e13126.
19. Ferri, F., Campione, G.C., Dalla Volta, R., Gianelli, C. & Gentilucci, M. (2011) Social requests and social affordances: how they affect the kinematics of motor sequences during interactions between conspecifics. PLoS ONE, 6, e15855.
20. Fincham, J.M., Carter, C.S., van Veen, V., Stenger, V.A. & Anderson, J.R. (2002) Neural mechanisms of planning: a computational analysis using event-related fMRI. Proc. Natl. Acad. Sci. USA, 99, 3346-3351.
21. Friston, K.J., Ashburner, J., Frith, C.D., Poline, J.B., Heather, J.D. & Frackowiak, R.S.J. (1995) Spatial registration and normalization of images. Hum. Brain Mapp., 3, 165.
22. Friston, K.J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M.D. & Turner, R. (1998) Event-related fMRI: characterizing differential responses. NeuroImage, 7, 30-40.
23. Galati, G., Committeri, G., Spitoni, G., Aprile, T., Di Russo, F., Pitzalis, S. & Pizzamiglio, L. (2008) A selective representation of the meaning of actions in the auditory mirror system. NeuroImage, 40, 1274-1286.
24. Galati, G., Committeri, G., Pitzalis, S., Pelle, G., Patria, F., Fattori, P. & Galletti, C. (2011) Intentional signals during saccadic and reaching delays in the human posterior parietal cortex. Eur. J. Neurosci., 34, 1871-1885.
25. Gallagher, H.L. & Frith, C.D. (2004) Dissociable neural pathways for the perception and recognition of expressive and instrumental gestures. Neuropsychologia, 42, 1725-1736.
26. Gentilucci, M. & Dalla Volta, R. (2008) Spoken language and arm gestures are controlled by the same motor control system. Q. J. Exp. Psychol., 61, 944-957.
27. Gentilucci, M., Dalla Volta, R. & Gianelli, C. (2008) When the hands speak. J. Physiol. Paris, 102, 21-30.
28. George, N. & Conty, L. (2008) Facing the gaze of others. Clin. Neurophysiol., 38, 197-207.
29. Grèzes, J., Costes, N. & Decety, J. (1998) Top-down effect of strategy on the perception of human biological motion: a PET investigation. Cogn. Neuropsychol., 15, 553-582.
30. Hagoort, P. (2005) On Broca, brain, and binding: a new framework. Trends Cogn. Sci., 9, 416-423.
31. Hari, R. & Kujala, M.V. (2009) Brain basis of human social interaction: from concepts to brain imaging. Physiol. Rev., 89, 453-479.
32. Harris, A. & Aguirre, G.K. (2010) Neural tuning for face wholes and parts in human fusiform gyrus revealed by FMRI adaptation. J. Neurophysiol., 104, 336-345.
33. Haxby, J.V., Hoffman, E.A. & Gobbini, M.I. (2000) The distributed human neural system for face perception. Trends Cogn. Sci., 4, 223-233.
34. Innocenti, A., De Stefani, E., Bernardi, N.F., Campione, G.C. & Gentilucci, M. (2012) Gaze direction and request gesture in social interactions. PLoS ONE, 7, e36390.
35. Itier, R.J. & Batty, M. (2009) Neural bases of eye and gaze processing: the core of social cognition. Neurosci. Biobehav. R., 33, 843-863.
36. Johnson, M.H., Griffin, R., Csibra, G., Halit, H., Farroni, T., de Haan, M., Tucker, L.A., Baron-Cohen, S. & Richards, J. (2005) The emergence of the social brain network: evidence from typical and atypical development. Dev. Psychopathol., 17, 599-619.
37. Kanwisher, N., McDermott, J. & Chun, M.M. (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci., 17, 4302-4311.
38. Kendon, A. (1997) Gesture. Annu. Rev. Anthropol., 26, 109-128.
39. Kendon, A. (2004) Gesture: Visible Action as Utterance. Cambridge University Press, Cambridge.
40. Kriegeskorte, N., Simmons, W.K., Bellgowan, P.S. & Baker, C.I. (2009) Circular analysis in systems neuroscience: the dangers of double dipping. Nat. Neurosci., 12, 535-540.
41. Kuperberg, G.R., West, W.C., Lakshmanan, B.M. & Goff, D. (2008) Functional magnetic resonance imaging reveals neuroanatomical dissociations during semantic integration in schizophrenia. Biol. Psychiat., 64, 407-418.
42. Kurth, F., Zilles, K., Fox, P.T., Laird, A.R. & Eickhoff, S.B. (2010) A link between the systems: functional differentiation and integration within the human insula revealed by meta-analysis. Brain Struct. Funct., 214, 519-534.
43. Lindenberg, R., Uhlig, M., Scherfeld, D., Schlaug, G. & Seitz, R.J. (2012) Communication with emblematic gestures: shared and distinct neural correlates of expression and reception. Hum. Brain Mapp., 33, 812-823.
44. Liu, J., Harris, A. & Kanwisher, N. (2010) Perception of face parts and face configurations: an FMRI study. J. Cognitive Neurosci., 22, 203-211.
45. Mazziotta, J.C., Toga, A.W., Evans, A., Fox, P. & Lancaster, J. (1995) A probabilistic atlas of the human brain: theory and rationale for its development. The International Consortium for Brain Mapping (ICBM). NeuroImage, 2, 89-101.
46. McNeill, D. (1992) Hand and Mind: what Gestures Reveal about Thought. University of Chicago Press, Chicago, IL.
47. McNeill, D. (2000) Language and Gesture. Cambridge University Press, New York.
48. McNeill, D. (2005) Gesture and Thought. University of Chicago Press, Chicago, IL.
49. Mesulam, M.M. (1998) From sensation to cognition. Brain, 121, 1013-1052.
50. Montgomery, K.J., Isenberg, N. & Haxby, J.V. (2007) Communicative hand gestures and object-directed hand movements activated the mirror neuron system. Soc. Cogn. Affect. Neur., 2, 114-122.
51. Newman-Norlund, R.D., Noordzij, M.L., Meulenbroek, R.G. & Bekkering, H. (2007a) Exploring the brain basis of joint action: co-ordination of actions, goals and intentions. Soc. Neur., 2, 48-65.
52. Newman-Norlund, R.D., van Schie, H.T., van Zuijlen, A.M. & Bekkering, H. (2007b) The mirror neuron system is more active during complementary compared with imitative action. Nat. Neurosci., 10, 817-818.
53. Newman-Norlund, R.D., Bosga, J., Meulenbroek, R.G. & Bekkering, H. (2008) Anatomical substrates of cooperative joint-action in a continuous motor task: virtual lifting and balancing. NeuroImage, 41, 169-177.
54. Noordzij, M.L., Newman-Norlund, S.E., de Ruiter, J.P., Hagoort, P., Levinson, S.C. & Toni, I. (2009) Brain mechanisms underlying human communication. Front. Hum. Neurosci., 3, 14.
55. Nummenmaa, L., Passamonti, L., Rowe, J., Engell, A.D. & Calder, A.J. (2010) Connectivity analysis reveals a cortical network for eye gaze perception. Cereb. Cortex, 20, 1780-1787.
56. Oldfield, R.C. (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia, 9, 97-113.
57. Peigneux, P., Van der Linden, M., Garraux, G., Laureys, S., Degueldre, C., Aerts, J., Del Fiore, G., Moonen, G., Luxen, A. & Salmon, E. (2004) Imaging a cognitive model of apraxia: the neural substrate of gesture-specific cognitive processes. Hum. Brain Mapp., 21, 119-142.
58. Pelphrey, K.A. & Morris, J.P. (2006) Brain mechanisms for interpreting the actions of others from biological-motion cues. Curr. Dir. Psychol. Sci., 15, 136-140.
59. Pitcher, D., Dilks, D.D., Saxe, R.R., Triantafyllou, C. & Kanwisher, N. (2011a) Differential selectivity for dynamic versus static information in face-selective cortical regions. NeuroImage, 56, 2356-2363.
60. Pitcher, D., Walsh, V. & Duchaine, B. (2011b) The role of the occipital face area in the cortical face perception network. Exp. Brain Res., 209, 481-493.
61. Sabbagh, M.A. (1999) Communicative intentions and language: evidence from right-hemisphere damage and autism. Brain Lang., 70, 29-69.
62. Sartori, L., Becchio, C., Bulgheroni, M. & Castiello, U. (2009) Modulation of the action control system by social intention: unexpected social requests override preplanned action. J. Exp. Psychol. Human, 35, 1490-1500.
63. Schippers, M.B., Roebroeck, A., Renken, R., Nanetti, L. & Keysers, C. (2010) Mapping the information flow from one brain to another during gestural communication. Proc. Natl. Acad. Sci. USA, 107, 9388-9393.
64. Senju, A. & Johnson, M.H. (2009) The eye contact effect: mechanisms and development. Trends Cogn. Sci., 13, 127-134.
65. Skipper, J.I., Goldin-Meadow, S., Nusbaum, H.C. & Small, S.L. (2009) Gestures orchestrate brain networks for language understanding. Curr. Biol., 19, 661-667.
66. Townsend, J.T. & Ashby, F.G. (1983) The Stochastic Modeling of Elementary Psychological Processes. Cambridge University Press, Cambridge.
67. Villarreal, M., Fridman, E.A., Amengual, A., Falasco, G., Gerschcovich, E.R., Ulloa, E.R. & Leiguarda, R.C. (2008) The neural substrate of gesture recognition. Neuropsychologia, 46, 2371-2382.
68. Wicker, B., Michel, F., Henaff, M.A. & Decety, J. (1998) Brain regions involved in the perception of gaze: a PET study. NeuroImage, 8, 221-227.
69. Willems, R.M., Ozyürek, A. & Hagoort, P. (2007) When language meets action: the neural integration of gesture and speech. Cereb. Cortex, 17, 2322-2333.
70. Worsley, K.J. & Friston, K.J. (1995) Analysis of fMRI time-series revisited - again. NeuroImage, 2, 173-181.
71. Wurm, M.F. & Schubotz, R.I. (2012) Squeezing lemons in the bathroom: contextual information modulates action recognition. NeuroImage, 59, 1551-1559.
72. Xu, J., Gannon, P.J., Emmorey, K., Smith, J.F. & Braun, A.R. (2009) Symbolic gestures and spoken language are processed by a common neural system. Proc. Natl. Acad. Sci. USA, 106, 20664-20669.