Congruence of happy and sad emotion in music and faces modifies cortical audiovisual activation

NeuroImage

Volumn 54, Issue 4, 2011, Pages 2973-2982

  Jeong, Jeong Won ^a,b   Diwadkar, Vaibhav A ^a   Chugani, Carla D ^c   Sinsoongsud, Piti ^a,b   Muzik, Otto ^a,b   Behen, Michael E ^a,b   Chugani, Harry T ^a   Chugani, Diane C ^a,b  

^a WAYNE STATE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b CHILDREN'S HOSPITAL OF MICHIGAN   (United States)

^c FLORIDA GULF COAST UNIVERSITY   (United States)

Author keywords

Face image; FMRI; Fusiform gyrus; Happy sad congruence; Music; Superior temporal gyrus

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; BORDERLINE STATE; CONTROLLED STUDY; EMOTION; FACIAL EXPRESSION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM GYRUS; HUMAN; HUMAN EXPERIMENT; MALE; MUSIC; NEUROMODULATION; NORMAL HUMAN; PRIORITY JOURNAL; RECOGNITION; SCHIZOPHRENIA; SUPERIOR TEMPORAL GYRUS; VISUAL INFORMATION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; BRAIN; BRAIN MAPPING; EMOTIONS; FACIAL EXPRESSION; FEMALE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MUSIC; PHOTIC STIMULATION; YOUNG ADULT;

EID: 78650925884     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.11.017     Document Type: Article

References (38)

1. Adolphs R. Neural systems for recognizing emotion. Curr. Opin. Neurobiol. 2002, 12:169-177.
2. Baumgartner T., Lutz K., Schmidt C.F., Jäncke L. The emotional power of music: how music enhances the feeling of affective pictures. Brain Res. 2006, 1075:151-164.
3. Blau V., Van Atteveldt N., Formisano E., Goebel R., Blomert L. Task-irrelevant visual letters interact with the processing of speech sounds in heteromodal and unimodal cortex. Eur. J. Neurosci. 2008, 28:500-509.
4. Calvert G.A., Brammer M.J., Bullmore E.T., Campbell R., Iversen D.D., David A.S. Response amplification in sensory-specific cortices during crossmodal binding. NeuroReport 1999, 10:2619-2623.
5. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 2000, 10:649-657.
6. Calvert G.A., Hansen P.C., Iversen S.D., Brammer M.J. Detection of audio-visual integration sites in humans by application of electo-physiological criteria to the BOLD effect. Neuroimage 2001, 14:427-438.
7. Campanella S., Belin P. Integrating face and voice in person perception. Trends Cogn. Sci. 2007, 11:535-543.
8. Collignon O., Girard S., Gosselin F., Roy S., Saint-Amour D., Lassonde M., Lepore F. Audio-visual integration of emotion expression. Brain Res. 2008, 1242:126-135.
9. de Gelder B., Bertelson P. Multisensory integration, perception and ecological validity. Trends Cogn. Sci. 2003, 7:460-467.
10. de Gelder B., Vroomen J. The perception of emotions by ear and eye. Cogn. Emotion 2000, 14:321-324.
11. de Gelder B., Vroomen J., de Jong S.J., Masthoff E.D., Trompenaars F.J., Hodiamont P. Multisensory integration of emotional faces and voices in schizophrenics. Schizophr. Res. 2005, 1:195-203.
12. Doehrmann O., Weigelt S., Altmann C.F., Kaiser J., Naumer M.J. Audiovisual functional magnetic resonance imaging adaptation reveals multisensory integration effects in object-related sensory cortices. J. Neurosci. 2010, 30:3370-3379.
13. Dolan R.J., Morris J.S., de Gelder G. Crossmodal binding of fear in voice and face. Proc. Natl Acad. Sci. USA 2001, 98:10006-10010.
14. Eldar E., Ganor O., Admon R., Bleich A., Hendler T. Feeling the real world: limbic response to music depends on related content. Cereb. Cortex 2007, 17:2828-2840.
15. Erwin R.J., Gur R.C., Gur R.E., Skolnick B., Mawhinney-Hee M., Smailis J. Facial emotion discrimination 1: task construction and behavioral findings in normal subjects. Psychiatry Res. 1992, 42:231-240.
16. Ethofer T., Anders S., Erb M., Royen L., Saur R., Reiterer S., Grodd W., Wildgruber D. Impact of voice on emotional judgment of faces: an event-related fMRI study. Hum. Brain Mapp. 2006, 27:707-714.
17. Gabrielsson A. Emotions in strong experiences with music. Music and Emotion. Theory and Research 2002, 432-449. Oxford University Press, New York. P.N. Juslin, J.A. Sloboda (Eds.).
18. Gagnon L., Peretz I. Mode and tempo relative contributions to "happy-sad" judgements in equitone melodies. Cogn. Emotion 2003, 17:25-40.
19. Grill-Spector K., Henson R., Martin A. Repetition and the brain: neural models of stimulus-specific effects. Trends Cogn. Sci. 2006, 10:14-23.
20. Gur R.C., Schroeder L., Turner T., McGrath C., Chan R.M., Turetsky B.I., Alsop D., Maldjian J., Gur R.E. Brain activation during facial emotion processing. Neuroimage 2002, 16:651-662.
21. Haxby J.V., Hoffman E.A., Gobbini M.I. The distributed human neural system for face perception. Trends Cogn. Sci. 2000, 4:223-233.
22. Hertrich I., Dietrich S., Ackermann H. Cross-modal interactions during perception of audiovisual speech and nonspeech signals: an fMRI study. J. Cogn. Neurosci. 2010, 23:221-237.
23. Koenigsberg H.W., Siever L.J., Lee H., Pizzarello S., New A.S., Goodman M., Cheng H., Flory J., Prohovnik I. Neural correlates of emotion processing in borderline personality disorder. Psychiatry Res. 2009, 172:192-199.
24. Lipscomb S.D., Kendall R.A. Perceptual judgement of the relationship between musical and visual components in film. Psychomusicology 1994, 13:60-98.
25. Logeswaran N., Bhattacharya J. Crossmodal transfer of emotion by music. Neurosci. Lett. 2009, 455:129-133.
26. Massaro D.W., Egan P.B. Perceiving affect from the voice and the face. Psychon. Bull. Rev. 1996, 3:215-221.
27. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264:746-748.
28. Mitterschiffthaler M.T., Fu C.H.Y., Dalton J.A., Andrew C.M., Williams S.C.R. A functional MRI study of happy and sad states induced by classical music. Hum. Brain Mapp. 2007, 28:1150-1162.
29. Nielsen F.Å. The Brede database: a small database for functional neuroimaging. 9th international conference on functional mapping of the human brain, New York, NY 2003.
30. Peretz I., Gaudreau D., Bonnel A.M. Exposure effects on music preference and recognition. Mem. Cogn. 1998, 26:884-902.
31. Pourtois G., de Gelder B., Bol A., Crommelinck M. Perception of facial expression and voices and of their combination in the human brain. Cortex 2005, 41:49-59.
32. Rigg M. An experiment to determine how accurately college students can interpret the intended meanings of musical compositions. J. Exp. Psychol. 1937, 21:223-229.
33. Summerfield C., Trittschuh E.H., Monti J.M., Mesulam M.M., Egner T. Neural repetition suppression reflects fulfilled perceptual expectations. Nat. Neurosci. 2008, 11:1004-1006.
34. Talairach J., Tournoux P. Co-planar stereotaxic atlas of the human brain 1988, Thieme, New York.
35. Van Atteveldt N.M., Formisano E., Goebel R., Blomert L. Integration of letters and speech sounds in the human brain. Neuron 2004, 43:271-282.
36. Van Atteveldt N.M., Formisano E., Goebel R., Blomert L. Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage 2007, 36:1345-1360.
37. Van Atteveldt N.M., Blau V.C., Blomert L., Goebel R. fMR-adaptation indicates selectivity to audiovisual content congruency in distributed clusters in human superior temporal cortex. BMC Neurosci. 2010, 11:11.
38. Van den Stock J., Peretz I., Grézes J., de Gelder B. Instrumental music influences recognition of emotional body language. Brain Topogr. 2009, 21:216-220.