Cerebral integration of verbal and nonverbal emotional cues: Impact of individual nonverbal dominance

NeuroImage

Volumn 61, Issue 3, 2012, Pages 738-747

  Jacob, Heike ^a   Kreifelts, Benjamin ^a   Brück, Carolin ^a   Erb, Michael ^b   Hösl, Franziska ^b   Wildgruber, Dirk ^a  

^a UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

^b UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Emotional communication; Facial expression; FMRI; Nonverbal; Prosody

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ARTICLE; ASSOCIATION; AUDITORY DISCRIMINATION; AUDITORY STIMULATION; BRAIN FUNCTION; BRAIN REGION; CEREBRAL INTEGRATION; CONTROLLED STUDY; DOMINANCE BEHAVIOR; ELECTROENCEPHALOGRAM; EMOTIONALITY; FACIAL EXPRESSION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM FACE AREA; HUMAN; HUMAN EXPERIMENT; INSULA; MALE; MESENCEPHALON; NEUROIMAGING; NONVERBAL COMMUNICATION; NORMAL HUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; SIGNAL TRANSDUCTION; STIMULUS RESPONSE; TEMPORAL CORTEX; VERBAL BEHAVIOR; VISUAL DISCRIMINATION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AMYGDALA; BRAIN; BRAIN MAPPING; CEREBROVASCULAR CIRCULATION; COMMUNICATION; CUES; DOMINANCE, CEREBRAL; EMOTIONS; EXPRESSED EMOTION; FACIAL EXPRESSION; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; PHOTIC STIMULATION; PREFRONTAL CORTEX; SPEECH; TEMPORAL LOBE; VOICE; YOUNG ADULT;

EID: 84861199241     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2012.03.085     Document Type: Article

References (61)

1. Allison T., Ginter H., McCarthy G., Nobre A.C., Puce A., Luby M., Spencer D.D. Face recognition in human extrastriate cortex. J. Neurophysiol. 1994, 71:821-825.
2. Allison T., McCarthy G., Nobre A., Puce A., Belger A. Human extrastriate visual cortex and the perception of faces, words, numbers, and colors. Cereb. Cortex 1994, 4:544-554.
3. Amodio D.M., Frith C.D. Meeting of minds: the medial frontal cortex and social cognition. Nat. Rev. Neurosci. 2006, 7:268-277.
4. Anderson A.K., Christoff K., Stappen I., Panitz D., Ghahremani D.G., Glover G., Gabrieli J.D., Sobel N. Dissociated neural representations of intensity and valence in human olfaction. Nat. Neurosci. 2003, 6:196-202.
5. App B., McIntosh D.N., Reed C.L., Hertenstein M.J. Nonverbal channel use in communication of emotion: how may depend on why. Emotion 2011, 11:603-617.
6. Argyle M., Salter V., Nicholson H., Williams M., Burgess P. The communication of inferior and superior attitudes by verbal and non-verbal signals. Br. J. Soc. Clin. Psychol. 1970, 9:222-231.
7. Argyle M., Alkema F., Gilmour R. The communication of friendly and hostile attitudes by verbal and non-verbal signals. Eur. J. Soc. Psychol. 1971, 1:385-402.
8. Belin P. Voice processing in human and non-human primates. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2006, 361:2091-2107.
9. Belin P., Zatorre R.J., Lafaille P., Ahad P., Pike B. Voice-selective areas in human auditory cortex. Nature 2000, 403:309-312.
10. Boersma P. Praat, a system for doing phonetics by computer. Glot Int. 2001, 5:341-345.
11. Bradley M.M., Lang P.J. Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 1994, 25:49-59.
12. Brück C., Kreifelts B., Wildgruber D. Emotional voices in context: a neurobiological model of multimodal affective information processing. Phys. Life Rev. 2011, 8:383-403.
13. Nonverbal Communications: The Unspoken Dialogue 1989, Harper & Row, New York. J.K. Burgoon, D.B. Buller, W.G. Woodall (Eds.).
14. Campanella S., Belin P. Integrating face and voice in person perception. Trends Cogn. Sci. 2007, 11:535-543.
15. Davila Ross M., Owren M.J., Zimmermann E. Reconstructing the evolution of laughter in great apes and humans. Curr. Biol. 2009, 19:1106-1111.
16. Davila Ross M., Owren M.J., Zimmermann E. The evolution of laughter in great apes and humans. Commun. Integr. Biol. 2010, 3:191-194.
17. De Gelder B., Bertelson P. Multisensory integration, perception and ecological validity. Trends Cogn. Sci. 2003, 7:460-467.
18. Phonetic Processing: The Dynamics of Speech 1977, Charles E. Merill Publishing Company, Columbus. D. Dew, P.J. Jensen (Eds.).
19. Epstein R., Harris A., Stanley D., Kanwisher N. The parahippocampal place area: recognition, navigation, or encoding?. Neuron 1999, 23:115-125.
20. Ernst M.O., Bülthoff H.H. Merging the senses into a robust percept. Trends Cogn. Sci. 2004, 8:162-169.
21. Friston K.J., Worsley K.J., Frackowiak R.S.J., Mazziotta J.C., Evans A.C. Assessing the significance of focal activations using their spatial extent. Hum. Brain Mapp. 1993, 1:210-220.
22. Friston K.J., Glaser D.E., Henson R.N., Kiebel S., Phillips C., Ashburner J. Classical and Bayesian inference in neuroimaging: applications. Neuroimage 2002, 16:484-512.
23. Geisser S., Greenhouse S.W. An extension of box's results on the use of the F distribution in multivariate analysis. Ann. Math. Stat. 1958, 29:885-891.
24. Grossmann T., Striano T., Friederici A.D. Crossmodal integration of emotional information from face and voice in the infant brain. Dev. Sci. 2006, 9:309-315.
25. Hamann S., Mao H. Positive and negative emotional verbal stimuli elicit activity in the left amygdala. Neuroreport 2002, 13:15-19.
26. Haxby J.V., Hoffman E.A., Gobbini M.I. The distributed human neural system for face perception. Trends Cogn. Sci. 2000, 4:223-233.
27. Hegstrom T. Message impact: what percentage is nonverbal?. West. J. Speech Commun. 1979, 43:134-142.
28. Herbert C., Ethofer T., Anders S., Junghofer M., Wildgruber D., Grodd W., Kissler J. Amygdala activation during reading of emotional adjectives-an advantage for pleasant content. Soc. Cogn. Affect. Neurosci. 2009, 4:35-49.
29. Hornak J., Bramham J., Rolls E.T., Morris R.G., O'Doherty J., Bullock P.R., Polkey C.E. Changes in emotion after circumscribed surgical lesions of the orbitofrontal and cingulate cortices. Brain 2003, 126:1691-1712.
30. Jacob, H., Kreifelts, B., Brück, C., Nizielski, S., Schütz, A., Wildgruber, D., submitted for publication. Nonverbal signals speak up: Association of Perceptual Nonverbal Dominance and Emotional Intelligence.
31. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 1997, 17:4302-4311.
32. Kreifelts B., Ethofer T., Grodd W., Erb M., Wildgruber D. Audiovisual integration of emotional signals in voice and face: an event-related fMRI study. Neuroimage 2007, 37:1445-1456.
33. Kreifelts B., Ethofer T., Shiozawa T., Grodd W., Wildgruber D. Cerebral representation of non-verbal emotional perception: fMRI reveals audiovisual integration area between voice- and face-sensitive regions in the superior temporal sulcus. Neuropsychologia 2009, 47:3059-3066.
34. Kreifelts B., Ethofer T., Huberle E., Grodd W., Wildgruber D. Association of trait emotional intelligence and individual fMRI-activation patterns during the perception of social signals from voice and face. Hum. Brain Mapp. 2010, 31:979-991.
35. Lamm C., Singer T. The role of anterior insular cortex in social emotions. Brain Struct. Funct. 2010, 214:579-591.
36. Locke J. Neural specializations for language: a developmental perspective. Semin. Neurosci. 1992, 4:425-431.
37. Maldjian J.A., Laurienti P.J., Kraft R.A., Burdette J.H. An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 2003, 19:1233-1239.
38. McBride G. Interactions and the Control of Behavior. Organization of behavior in face-to-face interaction 1975, 415-423. Mouton & Co. A. Kendon, R.M. Harris, M.R. Key (Eds.).
39. The Acquisition of Language: The Study of Developmental Psycholinguistics 1970, Harper & Row, New York. D. McNeill (Ed.).
40. Mehrabian A., Ferris S.R. Inference of attitudes from nonverbal communication in two channels. J. Consult. Psychol. 1967, 31:248-252.
41. Mehrabian A., Wiener M. Decoding of inconsistent communications. J. Pers. Soc. Psychol. 1967, 6:109-114.
42. Meyer M., Baumann S., Wildgruber D., Alter K. How the brain laughs. Comparative evidence from behavioral, electrophysiological and neuroimaging studies in human and monkey. Behav. Brain Res. 2007, 182:245-260.
43. Noller P. Video primacy-a further look. J. Nonverbal Behav. 1985, 9:28-47.
44. Ochsner K.N., Knierim K., Ludlow D.H., Hanelin J., Ramachandran T., Glover G., Mackey S.C. Reflecting upon feelings: an fMRI study of neural systems supporting the attribution of emotion to self and other. J. Cogn. Neurosci. 2004, 16:1746-1772.
45. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
46. Panksepp J., Burgdorf J. "Laughing" rats and the evolutionary antecedents of human joy?. Physiol. Behav. 2003, 79:533-547.
47. Pitcher D., Dilks D.D., Saxe R.R., Triantafyllou C., Kanwisher N. Differential selectivity for dynamic versus static information in face-selective cortical regions. Neuroimage 2011, 56:2356-2363.
48. Puce A., Allison T., Gore J.C., McCarthy G. Face-sensitive regions in human extrastriate cortex studied by functional MRI. J. Neurophysiol. 1995, 74:1192-1199.
49. Ross E.D., Monnot M. Neurology of affective prosody and its functional-anatomic organization in right hemisphere. Brain Lang. 2008, 104:51-74.
50. Schirmer A., Kotz S.A. Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing. Trends Cogn. Sci. 2006, 10:24-30.
51. Schultz J., Pilz K.S. Natural facial motion enhances cortical responses to faces. Exp. Brain Res. 2009, 194:465-475.
52. Sergent J., Ohta S., MacDonald B. Functional neuroanatomy of face and object processing. A positron emission tomography study. Brain 1992, 115(Pt. 1):15-36.
53. Sergerie K., Chochol C., Armony J.L. The role of the amygdala in emotional processing: a quantitative meta-analysis of functional neuroimaging studies. Neurosci. Biobehav. Rev. 2008, 32:811-830.
54. Tzourio-Mazoyer N., Landeau B., Papathanassiou D., Crivello F., Etard O., Delcroix N., Mazoyer B., Joliot M. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 2002, 15:273-289.
55. Vuilleumier P., Pourtois G. Distributed and interactive brain mechanisms during emotion face perception: evidence from functional neuroimaging. Neuropsychologia 2007, 45:174-194.
56. Vuilleumier P., Armony J.L., Driver J., Dolan R.J. Effects of attention and emotion on face processing in the human brain: an event-related fMRI study. Neuron 2001, 30:829-841.
57. Wiethoff S., Wildgruber D., Grodd W., Ethofer T. Response and habituation of the amygdala during processing of emotional prosody. Neuroreport 2009, 20:1356-1360.
58. Wildgruber D., Ackermann H., Kreifelts B., Ethofer T. Cerebral processing of linguistic and emotional prosody: fMRI studies. Prog. Brain Res. 2006, 156:249-268.
59. Wildgruber D., Ethofer T., Grandjean D., Kreifelts B. A cerebral network model of speech prosody comprehension. Int. J. Speech Lang. Pathol. 2009, 11:277-281.
60. Winston J.S., O'Doherty J., Dolan R.J. Common and distinct neural responses during direct and incidental processing of multiple facial emotions. Neuroimage 2003, 20:84-97.
61. Worsley K.J., Marrett S., Neelin P., Vandal A.C., Friston K.J., Evans A.C. A unified statistical approach for determining significant signals in images of cerebral activation. Hum. Brain Mapp. 1996, 4:58-73.