Supramodal representation of emotions

Journal of Neuroscience

Volumn 31, Issue 38, 2011, Pages 13635-13643

  Klasen, Martin ^a,b   Kenworthy, Charles A ^c   Mathiak, Krystyna A ^a,b   Kircher, Tilo T J ^d   Mathiak, Klaus ^a,b,e  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b JARA Translational Brain Medicine   (Germany)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

^d PHILIPPS UNIVERSITY MARBURG   (Germany)

^e FORSCHUNGSZENTRUM JÜLICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ANGER; ANTERIOR CINGULATE; ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; BASAL GANGLION; CAUDATE NUCLEUS; CEREBELLUM; COMPUTER SYSTEM; CONGRUENT EMOTION; CONTROLLED STUDY; EMOTION; EVOKED RESPONSE; FACIAL EXPRESSION; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GUSTATORY CORTEX; HAPPINESS; HUMAN; HUMAN EXPERIMENT; INCONGRUENT EMOTION; INFERIOR FRONTAL GYRUS; INSULA; INTRAPARIETAL SULCUS; MALE; MIDDLE FRONTAL GYRUS; OCCIPITAL CORTEX; PARIETAL CORTEX; PARIETAL LOBE; POSTERIOR CINGULATE; PRECUNEUS; PREFRONTAL CORTEX; PRIORITY JOURNAL; SUPERIOR TEMPORAL GYRUS; SUPERIOR TEMPORAL SULCUS; TEMPORAL CORTEX; THALAMUS; VENTRAL POSTERIOR CINGULATE; VISUAL STIMULATION; VOCAL EMOTION; WORKING MEMORY;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; CHOICE BEHAVIOR; COMPUTER SIMULATION; EMOTIONS; FACIAL EXPRESSION; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, SHORT-TERM; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; VISUAL PERCEPTION;

EID: 80052983908     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2833-11.2011     Document Type: Article

References (52)

1. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A (2004) Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat Neurosci 7:1190-1192.
2. Bushara KO, Hanakawa T, Immisch I, Toma K, Kansaku K, Hallett M (2003) Neural correlates of crossmodal binding. Nat Neurosci 6:190-195.
3. Calvert GA, Thesen T (2004) Multisensory integration: methodological approaches and emerging principles in the human brain. J Physiol Paris 98:191-205.
4. Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol 10:649-657.
5. Campbell R, Dodd B, Burnham D (1998) Hearing by eye II: advances in the psychology of speech-reading and audio-visual speech. Hove, UK: Psychology Press.
6. Chen YH, Edgar JC, Holroyd T, Dammers J, Thönnessen H, Roberts TP, Mathiak K (2010) Neuromagnetic oscillations to emotional faces and prosody. Eur J Neurosci 31:1818-1827.
7. de Gelder B, Vroomen J (2000) The perception of emotions by ear and by eye. Cogn Emot 14:289-311.
8. de Gelder B, Böcker KB, Tuomainen J, Hensen M, Vroomen J (1999) The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses. Neurosci Lett 260:133-136.
9. Dolan RJ, Morris JS, de Gelder B (2001) Crossmodal binding of fear in voice and face. Proc Natl Acad Sci U S A 98:10006-10010.
10. Dyck M, Winbeck M, Leiberg S, Chen Y, Gur RC, Mathiak K (2008) Recognition profile of emotions in natural and virtual faces. PLoS One 3:e3628.
11. Dyck M, Winbeck M, Leiberg S, Chen Y, Mathiak K (2010) Virtual faces as a tool to study emotion recognition deficits in schizophrenia. Psychiatry Res 179:247-252.
12. Ethofer T, Anders S, Erb M, Droll C, Royen L, Saur R, Reiterer S, Grodd W, Wildgruber D (2006a) Impact of voice on emotional judgment of faces: an event-related fMRI study. Hum Brain Mapp 27:707-714.
13. Ethofer T, Pourtois G, Wildgruber D (2006b) Investigating audiovisual integration of emotional signals in the human brain. Prog Brain Res 156:345-361.
14. Fuhrmann Alpert G, Hein G, Tsai N, Naumer MJ, Knight RT (2008) Temporal characteristics of audiovisual information processing. J Neurosci 28:5344-5349.
15. Ghazanfar AA, Logothetis NK (2003) Facial expressions linked to monkey calls. Nature 423:937-938.
16. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK (2005) Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci 25:5004-5012.
17. Ghazanfar AA, Chandrasekaran C, Logothetis NK (2008) Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J Neurosci 28:4457-4469.
18. Kerns JG, Cohen JD, MacDonald AW 3rd, Cho RY, Stenger VA, Carter CS (2004) Anterior cingulate conflict monitoring and adjustments in control. Science 303:1023-1026.
19. Killgore WD, Yurgelun-Todd DA (2007) The right hemisphere and valence hypotheses: could they both be right (and sometimes left)? Soc Cogn Affect Neurosci 2:240-250.
20. King AJ, Palmer AR (1985) Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Exp Brain Res 60:492-500.
21. Kotz SA, Meyer M, Alter K, Besson M, von Cramon DY, Friederici AD (2003) On the lateralization of emotional prosody: an event-related functional MR investigation. Brain Lang 86:366-376.
22. Kreifelts B, Ethofer T, Grodd W, Erb M, Wildgruber D (2007) Audiovisual integration of emotional signals in voice and face: an event-related fMRI study. Neuroimage 37:1445-1456.
23. Kreifelts B, Ethofer T, Huberle E, Grodd W, Wildgruber D (2010) Association of trait emotional intelligence and individual fMRI activation patterns during the perception of social signals from voice and face. Hum Brain Mapp 31:979-991.
24. Majerus S, Bastin C, Poncelet M, Van der Linden M, Salmon E, Collette F, Maquet P (2007) Short-term memory and the left intraparietal sulcus: focus of attention? Further evidence from a face short-term memory paradigm. Neuroimage 35:353-367.
25. Mar RA (2011) The neural bases of social cognition and story comprehension. Annu Rev Psychol 10:103-134.
26. Massaro DW, Egan PB (1996) Perceiving affect from the voice and the face. Psychon Bull Rev 3:215-221.
27. Mathiak K, Weber R (2006) Toward brain correlates of natural behavior: fMRI during violent video games. Hum Brain Mapp 27:948-956.
28. Miller LM, D'Esposito M (2005) Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci 25:5884-5893.
29. Müller VI, Habel U, Derntl B, Schneider F, Zilles K, Turetsky BI, Eickhoff SB (2011) Incongruence effects in crossmodal emotional integration. Neuroimage 54:2257-2266.
30. Nichols T, Brett M, Andersson J, Wager T, Poline JB (2005) Valid conjunction inference with the minimum statistic. Neuroimage 25:653-660.
31. Phan KL, Wager T, Taylor SF, Liberzon I (2002) Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI. Neuroimage 16:331-348.
32. Pollmann S, Maertens M (2005) Shift of activity from attention to motorrelated brain areas during visual learning. Nat Neurosci 8:1494-1496.
33. Pourtois G, de Gelder B, Vroomen J, Rossion B, Crommelinck M (2000) The time-course of intermodal binding between seeing and hearing affective information. Neuroreport 11:1329-1333.
34. Pourtois G, Debatisse D, Despland PA, de Gelder B (2002) Facial expressions modulate the time course of long latency auditory brain potentials. Brain Res Cogn Brain Res 14:99-105.
35. Pourtois G, de Gelder B, Bol A, Crommelinck M (2005) Perception of facial expressions and voices and of their combination in the human brain. Cortex 41:49-59.
36. Remedios R, Logothetis NK, Kayser C (2009) Monkey drumming reveals common networks for perceiving vocal and nonvocal communication sounds. Proc Natl Acad Sci U S A 106:18010-18015.
37. Robins DL, Hunyadi E, Schultz RT (2009) Superior temporal activation in response to dynamic audio-visual emotional cues. Brain Cogn 69:269-278.
38. Ross ED (1981) The aprosodias: functional-anatomic organization of the affective components of language in the right hemisphere. Arch Neurol 38:561-569.
39. Sander D, Grafman J, Zalla T (2003) The human amygdala: an evolved system for relevance detection. Rev Neurosci 14:303-316.
40. Schmitz TW, Johnson SC (2007) Relevance to self: a brief review and framework of neural systems underlying appraisal. Neurosci Biobehav Rev 31:585-596.
41. Stein BE, Meredith MA (1993) Merging of the senses. Cambridge, MA: MIT.
42. Stein BE, Stanford TR (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9:255-266.
43. Stein BE, Wallace MT (1996) Comparisons of cross-modality integration in midbrain and cortex. Prog Brain Res 112:289-299.
44. Sugihara T, Diltz MD, Averbeck BB, Romanski LM (2006) Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. J Neurosci 26:11138-11147.
45. Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain. New York: Thieme Medical Publishers.
46. Thönnessen H, Boers F, Dammers J, Chen YH, Norra C, Mathiak K (2010) Early sensory encoding of affective prosody: neuromagnetic tomography of emotional category changes. Neuroimage 50:250-259.
47. van Atteveldt N, Formisano E, Goebel R, Blomert L (2004) Integration of letters and speech sounds in the human brain. Neuron 43:271-282.
48. Vogt BA (2005) Pain and emotion interactions in subregions of the cingulate gyrus. Nat Rev Neurosci 6:533-544.
49. Vogt BA, Vogt L, Laureys S (2006) Cytology and functionally correlated circuits of human posterior cingulate areas. Neuroimage 29:452-466.
50. Wallraven C, Breidt M, Cunningham DW Bülthoff H. (2008) Evaluating the perceptual realism of animated facial expressions ACM TAP; 4:1-20.
51. Wildgruber D, Ackermann H, Kreifelts B, Ethofer T (2006) Cerebral processing of linguistic and emotional prosody: fMRI studies. Prog Brain Res 156:249-268.
52. Yang TT, Menon V, Eliez S, Blasey C, White CD, Reid AJ, Gotlib IH, Reiss AL (2002) Amygdalar activation associated with positive and negative facial expressions. Neuroreport 13:1737-1741.