Early binding of gaze, gesture, and emotion: Neural time course and correlates

Journal of Neuroscience

Volumn 32, Issue 13, 2012, Pages 4531-4539

  Conty, Laurence ^a,b   Dezecache, Guillaume ^b   Hugueville, Laurent ^d   Grèzes, Julie ^b,c  

^a UNIVERSITÉ PARIS 8   (France)

^b ECOLE NORMALE SUPÉRIEURE   (France)

^c Centre de NeuroImagerie de Recherche   (France)

^d SORBONNE UNIVERSITÉ   (France)

Author keywords

[No Author keywords available]

Indexed keywords

AMYGDALOID NUCLEUS; ARTICLE; ASSOCIATION; BEHAVIOR; ELECTROENCEPHALOGRAPHY; EMOTION; FACIAL EXPRESSION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GAZE; GESTURE; HUMAN; HUMAN EXPERIMENT; INTERPERSONAL COMMUNICATION; MALE; NORMAL HUMAN; PERCEPTION; PREMOTOR CORTEX; PRIORITY JOURNAL;

ADULT; AMYGDALA; BRAIN MAPPING; BRAIN WAVES; CUES; EMOTIONS; EVOKED POTENTIALS, VISUAL; FACIAL EXPRESSION; FEMALE; GESTURES; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MOTOR CORTEX; PHOTIC STIMULATION; SOCIAL PERCEPTION; TIME FACTORS; VISUAL PERCEPTION;

EID: 84859062071     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.5636-11.2012     Document Type: Article

References (84)

1. Adams RB Jr, Kleck RE (2003) Perceived gaze direction and the processing of facial displays of emotion. Psychol Sci 14:644-647.
2. Adolphs R (1999) Social cognition and the human brain. Trends Cogn Sci 3:469-479.
3. Adolphs R (2002) Neural systems for recognizing emotion. Curr Opin Neurobiol 12:169-177.
4. Amaral DG, Price JL (1984) Amygdalo-cortical projections in the monkey (Macaca fascicularis). J Comp Neurol 230:465-496.
5. Amaral DG, Behniea H, Kelly JL (2003) Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey. Neuroscience 118:1099-1120.
6. Ashley V, Vuilleumier P, Swick D (2004) Time course and specificity of event-related potentials to emotional expressions. Neuroreport 15:211-216.
7. Avendano C (1983) A fine structural study of the cells that proliferate in the partially denervated dentate gyrus of the rat. Anat Embryol (Berl) 166:317-332.
8. Batty M, Taylor MJ (2003) Early processing of the six basic facial emotional expressions. Brain Res Cogn Brain Res 17:613-620.
9. Blau VC, Maurer U, Tottenham N, McCandliss BD (2007) The face-specific N170 component is modulated by emotional facial expression. Behav Brain Funct 3:7.
10. Bourgeois P, Hess U (2008) The impact of social context on mimicry. Biol Psychol 77:343-352.
11. Caetano G, Jousmäki V, Hari R (2007) Actor's and observer's primary motor cortices stabilize similarly after seen or heard motor actions. Proc Natl Acad Sci USA 104:9058-9062.
12. Catmur C, Mars RB, Rushworth MF, Heyes C (2011) Making mirrors: premotor cortex stimulation enhances mirror and counter-mirror motor facilitation. J Cogn Neurosci 23:2352-2362.
13. Chartrand TL, Bargh JA (1999) The chameleon effect: the perceptionbehavior link and social interaction. J Pers Soc Psychol 76:893-910.
14. Cisek P (2007) Cortical mechanisms of action selection: the affordance competition hypothesis. Philos Trans R Soc Lond B Biol Sci 362:1585-1599.
15. Conty L, Grèzes J (2012) Look at me, I'll remember you: the perception of self-relevant social cues enhances memory and right hippocampal activity. Hum Brain Mapp. Advance online publication. Retrieved February 5, 2012. doi:10.1002/hbm.21366.
16. Conty L, N'Diaye K, Tijus C, George N (2007) When eye creates the contact! ERP evidence for early dissociation between direct and averted gaze motion processing. Neupsychologia 45:3024-3037.
17. Cooke DF, Graziano MS (2004) Sensorimotor integration in the precentral gyrus: polysensory neurons and defensive movements. J Neurophysiol 91:1648-1660.
18. Cristinzio C, N-Diaye K, Seeck M, Vuilleumier P, Sander D (2010) Integration of gaze direction and facial expression in patients with unilateral amygdala damage. Brain 133:248-261.
19. Csibra G (2007) Action mirroring and action interpretation: an alternative account. In: Sensorimotor foundations of higher cognition. Attention and performance (Haggard P, Rosetti Y, and Kawato M, eds), pp 435-459. Oxford, UK: Oxford UP.
20. Csibra G, Gergely G (2007) "Obsessed with goals": functions and mecha-nisms of teleological interpretation of actions in humans. Acta Psychol (Amst) 124:60-78.
21. Decety J, Chaminade T (2003) When the self represents the other: a new cognitive neuroscience view on psychological identification. Conscious Cogn 12:577-596.
22. Dimberg U (1986) Facial reactions to fear-relevant and fear-irrelevant stimuli. Biol Psychol 23:153-161.
23. Dimberg U, Ohman A (1983) The effects of directional facial cues on electrodermal conditioning to facial stimuli. Psychophysiology 20:160-167.
24. Eimer M, Holmes A (2007) Event-related brain potential correlates of emotional face processing. Neuropsychologia 45:15-31.
25. Emery NJ, Amaral DG (2000) The role of the amygdala in primate social cognition. In: Cognitive neuroscience of emotion (Lane RD, Nadel L, eds), pp 156-191. New York: Oxford UP.
26. Emery NJ, Capitanio JP, Mason WA, Machado CJ, Mendoza SP, Amaral DG (2001) The effects of bilateral lesions of the amygdala on dyadic social interactions in rhesus monkeys (Macaca mulatta). Behav Neurosci 115:515-544.
27. Feinstein JS, Adolphs R, Damasio A, Tranel D (2011) The human amygdala and the induction and experience of fear. Curr Biol 21:34-38.
28. Frijda NH (1986) The emotions. London: Cambridge UP.
29. Gallese V (2006) Intentional attunement: a neurophysiological perspective on social cognition and its disruption in autism. Brain Res 1079:15-24.
30. Gangopadhyay N, Schilbach L (2011) Seeing minds: a neurophilosophical investigation of the role of perception-action coupling in social perception. Soc Neurosci. doi:10.1080/17470919.2011.633754.
31. Gerbella M, Belmalih A, Borra E, Rozzi S, Luppino G (2011) Cortical connections of the anterior (F5a) subdivision of the macaque ventral premotor area F5. Brain Struct Funct 216:43-65.
32. Graziano MS, Cooke DF (2006) Parieto-frontal interactions, personal space, and defensive behavior. Neuropsychologia 44:845-859.
33. Grèzes J, Decety J (2001) Functional anatomy of execution, mental simulation, observation, and verb generation of actions: a meta-analysis. Hum Brain Mapp 12:1-19.
34. Grèzes J, Adenis MS, Pouga L, Chadwick M, Armony J (2011) Who are you angry with? The influence of self-relevance on anger processing. Presented at the 17th Annual Meeting of the Organization for Human Brain Mapping, Quebec City, Quebec, Canada, June 26-30.
35. Hadjikhani N, Hoge R, Snyder J, de Gelder B (2008) Pointing with the eyes: the role of gaze in communicating danger. Brain Cogn 68:1-8.
36. Haxby JV, Hoffman EA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Sci 4:223-233.
37. Hess U, Kleck RE (2007) Looking at you or looking elsewhere: the influence of head orientation on the signal value of emotional facial expressions. Motiv Emot 31:137-144.
38. Hoffman KL, Gothard KM, Schmid MC, Logothetis NK (2007) Facialexpression and gaze-selective responses in the monkey amygdala. Curr Biol 17:766-772.
39. Jeannerod M (1994) The representing brain: neural correlates of motor intention and imagery. Behav Brain Sci 17:187-245.
40. Keysers C, Gazzola V (2007) Integrating simulation and theory of mind: from self to social cognition. Trends Cogn Sci 11:194-196.
41. Kilner JM, Marchant JL, Frith CD (2006) Modulation of the mirror system by social relevance. Soc Cogn Affect Neurosci 1:143-148.
42. Kilner JM, Friston KJ, Frith CD (2007) The mirror-neuron system: a Bayesian perspective. Neuroreport 18:619-623.
43. Klucharev V, Sams M (2004) Interaction of gaze direction and facial expressions processing: ERP study. Neuroreport 15:621-625.
44. Krolak-Salmon P, Hénaff MA, Vighetto A, Bertrand O, Mauguière F (2004) Early amygdala reaction to fear spreading in occipital, temporal, and frontal cortex: a depth electrode ERP study in human. Neuron 42:665-676.
45. Lakin JL, Chartrand TL (2003) Using nonconscious behavioral mimicry to create affiliation and rapport. Psychol Sci 14:334-339.
46. LeDoux JE (2000) Emotion circuits in the brain. Annu Rev Neurosci 23:155-184.
47. Luppino G, Matelli M, Camarda R, Rizzolatti G (1993) Corticocortical connections of area F3 (SMA-proper) and area F6 (pre-SMA) in the macaque monkey. J Comp Neurol 338:114-140.
48. Nishitani N, Hari R (2002) Viewing lip forms: cortical dynamics. Neuron 36:1211-1220.
49. N-Diaye K, Sander D, Vuilleumier P (2009) Self-relevance processing in the human amygdala: gaze direction, facial expression, and emotion intensity. Emotion 9:798-806.
50. Passingham RE (1993) The frontal lobes and volontary action. Oxford, UK: Oxford UP.
51. Pichon S, de Gelder B, Grèzes J (2008) Emotional modulation of visual and motor areas by dynamic body expressions of anger. Soc Neurosci 3:199-212.
52. Pichon S, de Gelder B, Grèzes J (2009) Two different faces of threat. Comparing the neural systems for recognizing fear and anger in dynamic body expressions. Neuroimage 47:1873-1883.
53. Pichon S, de Gelder B, Grèzes J (2012) Threat prompts defensive brain responses independently of attentional control. Cereb Cortex 22:274-285.
54. Pourtois G, Vuilleumier P (2006) Dynamics of emotional effects on spatial attention in the human visual cortex. Prog Brain Res 156:67-91.
55. Pourtois G, Spinelli L, Seeck M, Vuilleumier P (2010) Temporal precedence of emotion over attention modulations in the lateral amygdala: intracranial ERP evidence from a patient with temporal lobe epilepsy. Cogn Affect Behav Neurosci 10:83-93.
56. Puce A, Smith A, Allison T (2000) ERPs by viewing facial movements. Cogn Neuropsychol 17:221-239.
57. Rigato S, Farroni T, Johnson MH (2010) The shared signal hypothesis and neural responses to expressions and gaze in infants and adults. Soc Cogn Affect Neurosci 5:88-97.
58. Ritter P, Villringer A (2006) Simultaneous EEG-fMRI. Neurosci Biobehav Rev 30:823-838.
59. Rizzolatti G, Fogassi L, Gallese V (2001) Neurophysiological mechanisms underlying the understanding and imitation of action. Nat Rev Neurosci 2:661-670.
60. Rotshtein P, Richardson MP, Winston JS, Kiebel SJ, Vuilleumier P, Eimer M, Driver J, Dolan RJ (2010) Amygdala damage affects event-related potentials for fearful faces at specific time windows. Hum Brain Mapp 31:1089-1105.
61. Rozzi S, Calzavara R, Belmalih A, Borra E, Gregoriou GG, Matelli M, Luppino G (2006) Cortical connections of the inferior parietal cortical convexity of the macaque monkey. Cereb Cortex 16:1389-1417.
62. Rushworth MF, Johansen-Berg H, Gobel SM, Devlin JT (2003) The left parietal and premotor cortices: motor attention and selection. Neuroimage 20 [Suppl 1]:S89-S100.
63. Sander D, Grandjean D, Kaiser S, Wehrle T, Scherer KR (2007) Interaction effects of perceived gaze direction and dynamic facial expression: evidence for appraisal theories of emotion. Eur J Cogn Psychol 19:470-480.
64. Sato W, Kochiyama T, Uono S, Yoshikawa S (2010) Amygdala integrates emotional expression and gaze direction in response to dynamic facial expressions. Neuroimage 50:1658-1665.
65. Schilbach L (2010) A second-person approach to other minds. Nat Rev Neurosci 11:449.
66. Schilbach L, Wohlschlaeger AM, Kraemer NC, Newen A, Shah NJ, Fink GR, Vogeley K (2006) Being with virtual others: neural correlates of social interaction. Neuropsychologia 44:718-730.
67. Schilbach L, Eickhoff SB, Mojzisch A, Vogeley K (2008) What's in a smile? Neural correlates of facial embodiment during social interaction. Soc Neurosci 3:37-50.
68. Schilbach L, Eickhoff SB, Cieslik E, Shah NJ, Fink GR, Vogeley K (2011) Eyes on me: an fMRI study of the effects of social gaze on action control. Soc Cogn Affect Neurosci 6:393-403.
69. Schupp HT, Ohman A, Junghöfer M, Weike AI, Stockburger J, Hamm AO (2004) The facilitated processing of threatening faces: an ERP analysis. Emotion 4:189-200.
70. Sinigaglia C, Rizzolatti G (2011) Through the looking glass: self and others. Conscious Cogn 20:64-74.
71. Strauss MM, Makris N, Aharon I, Vangel MG, Goodman J, Kennedy DN, Gasic GP, Breiter HC (2005) fMRI of sensitization to angry faces. Neuroimage 26:389-413.
72. Tkach D, Reimer J, Hatsopoulos NG (2007) Congruent activity during action and action observation in motor cortex. J Neurosci 27:13241-13250.
73. Tomassini V, Jbabdi S, Klein JC, Behrens TE, Pozzilli C, Matthews PM, Rushworth MF, Johansen-Berg H (2007) Diffusion-weighted imaging tractography-based parcellation of the human lateral premotor cortex identifies dorsal and ventral subregions with anatomical and functional specializations. J Neurosci 27:10259-10269.
74. Van den Stock J, Tamietto M, Sorger B, Pichon S, Grèzes J, de Gelder B (2011) Cortico-subcortical visual, somatosensory, and motor activationsfor perceiving dynamic whole-body emotional expressions with and without striate cortex (V1). Proc Natl Acad Sci USA 108:16188-16193.
75. van Heijnsbergen CC, Meeren HK, Grèzes J, de Gelder B (2007) Rapid detection of fear in body expressions, an ERP study. Brain Res 1186:233-241.
76. Vlamings PH, Goffaux V, Kemner C (2009) Is the early modulation of brain activity by fearful facial expressions primarily mediated by coarse low spatial frequency information? J Vis 9:12 11-13.
77. Wang Y, Newport R, Hamilton AF (2011) Eye contact enhances mimicry of intransitive hand movements. Biol Lett 7:7-10.
78. Williams LM, Gordon E (2007) Dynamic organization of the emotional brain: responsivity, stability, and instability. Neuroscientist 13:349-370.
79. Wilms M, Schilbach L, Pfeiffer U, Bente G, Fink GR, Vogeley K (2010) It's in your eyes: using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. Soc Cogn Affect Neurosci 5:98-107.
80. Wilson M, Knoblich G (2005) The case for motor involvement in perceiving conspecifics. Psychol Bull 131:460-473.
81. Wolpert DM, Flanagan JR (2001) Motor prediction. Curr Biol 11: R729-R732.
82. Wolpert DM, Doya K, Kawato M (2003) A unifying computational framework for motor control and social interaction. Philos Trans R Soc Lond B Biol Sci 358:593-602.
83. Yabar Y, Johnston L, Miles L, Peace V (2006) Implicit behavioral mimicry: investigating the impact of group membership. J Nonverbal Behav 30:97-113.
84. Zaki J, Ochsner K (2009) The need for a cognitive neuroscience of naturalistic social cognition. Ann NY Acad Sci 1167:16-30