Emotional valence and spatial congruency differentially modulate crossmodal processing: An fMRI study

Frontiers in Human Neuroscience

Volumn 8, Issue AUG, 2014, Pages

  Wolf, Dhana ^a,b   Schock, Lisa ^a,b   Bhavsar, Saurabh ^a,b   Demenescu, Liliana R ^a,b   Sturm, Walter ^a,c   Mathiak, Klaus ^a,b  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b FORSCHUNGSZENTRUM JÜLICH   (Germany)

^c UNIVERSITY HOSPITAL RWTH AACHEN   (Germany)

Author keywords

Attention; Auditory cortex; Crossmodal spatial cueing; Hemodynamic mismatch response; Spatial congruency; Valence

Indexed keywords

ADULT; ARTICLE; ATTENTION; ATTENTION MODULATION; AUDIOVISUAL ATTENTION; AUDITORY CORTEX; AUDITORY STIMULATION; BRAIN FUNCTION; CROSSMODAL PROCESSING; DICHOTIC LISTENING; EMOTION; EMOTIONAL VALENCE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEMISPHERIC DOMINANCE; HEMODYNAMICS; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; STIMULUS; VISUAL FIELD; VISUAL STIMULATION;

EID: 84908248600     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00659     Document Type: Article

References (52)

1. Alexandrov, Y. I., Klucharevb, V., and Sams, M. (2007). Effect of emotional context in auditory-cortex processing. Int. J. Psychophysiol. 65, 261-271. doi: 10.1016/j.ijpsycho.2007.05.004
2. Alho, K., Medvedev, S. V., Pakhomov, S. V., Roudas, M. S., Tervaniemi, M., Reinikainen, K., et al. (1999). Selective tuning of the left and right auditory cortices during spatially directed attention. Brain Res. Cogn. Brain Res. 7, 335-341. doi: 10.1016/s0926-6410(98)00036-6
3. Alho, K., Winkler, I., Escera, C., Huotilainen, M., Virtanen, J., Jääskeläinen, I. P., et al. (1998). Processing of novel sounds and frequency changes in the human auditory cortex: magnetoencephalographic recordings. Psychophysiology 35, 211-224. doi: 10.1111/1469-8986.3520211
4. Armony, J. L., and Dolan, R. J. (2001). Modulation of auditory neural responses by a visual context in human fear conditioning. Neuroreport 12, 3407-3411. doi: 10.1097/00001756-200110290-00051
5. Calvert, G. A., and Campbell, R. (2003). Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci. 15, 57-70. doi: 10.1162/089892903321107828
6. Danckert, J., and Ferber, S. (2006). Revisiting unilateral neglect. Neuropsychologia 44, 987-1006. doi: 10.1016/j.neuropsychologia.2005.09.004
7. Demaree, H. A., Everhart, D. E., Youngstrom, E. A., and Harrison, D. W. (2005). Brain lateralization of emotional processing: historical roots and a future incorporating "dominance". Behav. Cogn. Neurosci. Rev. 4, 3-20. doi: 10.1177/1534582305276837
8. Domínguez-Borràs, J., Trautmann, S.-A., Erhard, P., Fehr, T., Herrmann, M., and Escera, C. (2009). Emotional context enhances auditory novelty processing in superior temporal gyrus. Cereb. Cortex 19, 1521-1529. doi: 10.1093/cercor/bhn188
9. Dyck, M., Winbeck, M., Leiberg, S., Chen, Y., Gur, R. C., and Mathiak, K. (2008). Recognition profile of emotions in natural and virtual faces. PLoS One 3:e3628. doi: 10.1371/journal.pone.0003628
10. Eastwood, J. D., Smilek, D., and Merikle, P. M. (2001). Differential attentional guidance by unattended faces expressing positive and negative emotion. Percept. Psychophys. 63, 1004-1013. doi: 10.3758/bf03194519
11. Eckert, M. A., Kamdar, N. V., Chang, C. E., Beckmann, C. F., Greicius, D., and Menon, V. (2008). A cross-modal system linking primary auditory and visual cortices: evidence from intrinsic fMRI connectivity analysis. Hum. Brain Mapp. 29, 848-857. doi: 10.1002/hbm.20560
12. Eimer, M., and Driver, J. (2001). Crossmodal links in endogenous and exogenous spatial attention: evidence from event-related brain potential studies. Neurosci. Biobehav. Rev. 25, 497-511. doi: 10.1016/s0149-7634(01)00029-x
13. Fenske, M. J., and Eastwood, J. D. (2003). Modulation of focused attention by faces expressing emotion: evidence from flanker tasks. Emotion 3, 327-343. doi: 10.1037/1528-3542.3.4.327
14. Fox, E., Russo, R., Bowles, R., and Dutton, K. (2001). Do threatening stimuli draw or hold visual attention in subclinical anxiety? J. Exp. Psychol. Gen. 130, 681-700. doi: 10.1037/0096-3445.130.4.681
15. Fusar-Poli, P., Placentino, A., Carletti, F., Allen, P., Landi, P., Abbamonte, M., et al. (2009). Laterality effect on emotional faces processing: ALE meta-analysis of evidence. Neurosci. Lett. 452, 262-267. doi: 10.1016/j.neulet.2009.01.065
16. Hsieh, P.-J., Colas, J. T., and Kanwisher, N. (2012). Spatial pattern of BOLD fMRI activation reveals cross-modal information in auditory cortex. J. Neurophysiol. 107, 3428-3432. doi: 10.1152/jn.01094.2010
17. Kayser, C., Petkov, C. I., Augath, M., and Logothetis, N. K. (2005). Integration of touch and sound in auditory cortex. Neuron 48, 373-384. doi: 10.1016/j.neuron.2005.09.018
18. Kayser, C., Petkov, C. I., Augath, M., and Logothetis, N. K. (2007). Functional imaging reveals visual modulation of specific fields in auditory cortex. J. Neurosci. 27, 1824-1835. doi: 10.1523/jneurosci.4737-06.2007
19. Mathiak, K., Hertrich, I., Lutzenberger, W., and Ackermann, H. (2000). Encoding of temporal speech features (formant transients) during binaural and dichotic stimulus application: a whole-head magnetencephalography study. Brain Res. Cogn. Brain Res. 10, 125-131. doi: 10.1016/s0926-6410(00)00035-5
20. Mathiak, K., Hertrich, I., Zvyagintsev, M., Lutzenberger, W., and Ackermann, H. (2005). Selective influences of cross-modal spatial-cues on preattentive auditory processing: a whole-head magnetoencephalography study. Neuroimage 28, 627-634. doi: 10.1016/j.neuroimage.2005.06.030
21. Mathiak, K., Rapp, A., Kircher, T. T. J., Grodd, W., Hertrich, I., Weiskopf, N., et al. (2002). Mismatch responses to randomized gradient switching noise as reflected by fMRI and whole-head magnetoencephalography. Hum. Brain Mapp. 16, 190-195. doi: 10.1002/hbm.10041
22. Mazza, V., Turatto, M., Rossi, M., and Umiltà, C. (2007). How automatic are audiovisual links in exogenous spatial attention? Neuropsychologia 45, 514-522. doi: 10.1016/j.neuropsychologia.2006.02.010
23. McDonald, J. J., Teder-Sälejärvi, W. A., Di Russo, F., and Hillyard, S. A. (2003). Neural substrates of perceptual enhancement by cross-modal spatial attention. J. Cogn. Neurosci. 15, 10-19. doi: 10.1162/089892903321107783
24. Menning, H., Ackermann, H., Hertrich, I., and Mathiak, K. (2005). Spatial auditory attention is modulated by tactile priming. Exp. Brain Res. 164, 41-47. doi: 10.1007/s00221-004-2212-7
25. Näätänen, R. (1995). The mismatch negativity: a powerful tool for cognitive neuroscience. Ear Hear. 16, 6-18. doi: 10.1097/00003446-199502000-00002
26. Näätänen, R., Paavilainen, P., Alho, K., Reinikainen, K., and Sams, M. (1989). Do event-related potentials reveal the mechanism of the auditory sensory memory in the human brain? Neurosci. Lett. 98, 217-221. doi: 10.1016/0304-3940(89)90513-2
27. Näätänen, R., Pakarinen, S., Teemu, R., and Rika, T. (2004). The mismatch negativity (MMN): towards the optimal paradigm. Clin. Neurophysiol. 115, 140-144. doi: 10.1016/j.clinph.2003.04.001
28. Oldfield, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97-113. doi: 10.1016/0028-3932(71)90067-4
29. Petit, L., Simon, G., Joliot, M., Andersson, F., Bertin, T., Zago, L., et al. (2007). Right hemisphere dominance for auditory attention and its modulation by eye position: an event related fMRI study. Restor. Neurol. Neurosci. 25, 211-225.
30. Phillips, C., Pellathy, T., Marantz, A., Yellin, E., Wexler, K., Poeppel, D., et al. (2000). Auditory cortex accesses phonological categories: an MEG mismatch study. J. Cogn. Neurosci. 12, 1038-1055. doi: 10.1162/08989290051137567
31. Plank, T., Rosengarth, K., Song, W., Ellermeier, W., and Greenlee, M. W. (2012). Neural correlates of audio-visual object recognition: effects of implicit spatial congruency. Hum. Brain Mapp. 33, 797-811. doi: 10.1002/hbm.21254
32. Posner, M. I. (1980). Orienting of attention. Q. J. Exp. Psychol. 32, 3-25. doi: 10.1080/00335558008248231
33. Rowe, G., Hirsh, J. B., and Anderson, A. K. (2007). Positive affect increases the breadth of attentional selection. Proc. Natl. Acad. Sci. U S A 104, 383-388. doi: 10.1073/pnas.0605198104
34. Sams, M., Paavilainen, P., Alho, K., and Näätänen, R. (1985). Auditory frequency discrimination and event-related potentials. Electroencephalogr. Clin. Neurophysiol. 62, 437-448. doi: 10.1016/0168-5597(85)90054-1
35. Santos, A., Mier, D., Kirsch, P., and Meyer-Lindenberg, A. (2011). Evidence for a general face salience signal in human amygdala. Neuroimage 54, 3111-3116. doi: 10.1016/j.neuroimage.2010.11.024
36. Schock, L., Bhavsar, S., Demenescu, L. R., Sturm, W., and Mathiak, K. (2013). Does valence in the visual domain influence the spatial attention after auditory deviants? Exploratory data. Front. Behav. Neurosci. 7:6. doi: 10.3389/fnbeh.2013.00006
37. Schock, L., Dyck, M., Demenescu, L. R., Edgar, J. C., Hertrich, I., Sturm, W., et al. (2012). Mood modulates auditory laterality of hemodynamic mismatch responses during dichotic listening. PLoS One 7:e31936. doi: 10.1371/journal.pone.0031936
38. Schröger, E. (1996). A neural mechanism for involuntary attention shifts to changes in auditory stimulation. J. Cogn. Neurosci. 8, 527-539. doi: 10.1162/jocn.1996.8.6.527
39. Sestieri, C., Di Matteo, R., Ferretti, A., Del Gratta, C., Caulo, M., Tartaro, A., et al. (2006). "What" versus "where" in the audiovisual domain: an fMRI study. Neuroimage 33, 672-680. doi: 10.1016/j.neuroimage.2006.06.045
40. Skouras, S., Gray, M., Critchley, H., and Koelsch, S. (2013). FMRI scanner noise interaction with affective neural processes. PLoS One 8:e80564. doi: 10.1371/journal.pone.0080564
41. Spence, C., and Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Percept. Psychophys. 59, 1-22. doi: 10.3758/bf03206843
42. Sugimoto, S., Nittono, H., and Hori, T. (2007). Visual emotional context modulates brain potentials elicited by unattended tones. Int. J. Psychophysiol. 66, 1-9. doi: 10.1016/j.ijpsycho.2007.05.007
43. Surakka, V., Tenhunen-Eskelinen, M., Hietanen, J. K., and Sams, M. (1998). Modulation of human auditory information processing by emotional visual stimuli. Brain Res. Cogn. Brain Res. 7, 159-163. doi: 10.1016/s0926-6410(98)00021-4
44. Teder-Sälejärvi, W. A., Di Russo, F., McDonald, J. J., and Hillyard, S. A. (2005). Effects of spatial congruity on audio-visual multimodal integration. J. Cogn. Neurosci. 17, 1396-1409. doi: 10.1162/0898929054985383
45. van Atteveldt, N. M., Formisano, E., Goebel, R., and Blomert, L. (2007). Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage 36, 1345-1360. doi: 10.1016/j.neuroimage.2007.03.065
46. Wager, T. D., Phan, K. L., Liberzon, I., and Taylor, S. F. (2003). Valence, gender and lateralization of functional brain anatomy in emotion: a meta-analysis of findings from neuroimaging. Neuroimage 19, 513-531. doi: 10.1016/s1053-8119(03)00078-8
47. Wang, J., Nicol, T., Skoe, E., Sams, M., and Kraus, N. (2009). Emotion modulates early auditory response to speech. J. Cogn. Neurosci. 21, 2121-2128. doi: 10.1162/jocn.2008.21147
48. Ward, L. M., McDonald, J. J., and Lin, D. (2000). On asymmetries in cross-modal spatial attention orienting. Percept. Psychophys. 62, 1258-1264. doi: 10.3758/bf03212127
49. Wittchen, H. U., Wunderlich, U., Gruschwitz, S., and Zaudig, M. (1997). SKID-I. Strukturiertes Klinisches Interview für DSM-IV. Achse I: Psychische Störungen. Interviewheft. Göttingen: Hogrefe.
50. Yamashita, H., Okamoto, Y., Morinobu, S., Yamawaki, S., and Kähkönen, S. (2005). Visual emotional stimuli modulation of auditory sensory gating studied by magnetic P50 suppression. Eur. Arch. Psychiatry Clin. Neurosci.255, 99-103. doi: 10.1007/s00406-004-0538-6
51. Zvyagintsev, M., Nikolaev, A. R., Sachs, O., and Mathiak, K. (2011). Early attention modulates perceptual interpretation of multisensory stimuli. Neuroreport 22, 586-591. doi: 10.1097/WNR.0b013e32834901f3
52. Zvyagintsev, M., Nikolaev, A. R., Thönnessen, H., Sachs, O., Dammers, J., and Mathiak, K. (2009). Spatially congruent visual motion modulates activity of the primary auditory cortex. Exp. Brain Res. 198, 391-402. doi: 10.1007/s00221-009-1830-5