Processing of multisensory spatial congruency can be dissociated from working memory and visuo-spatial attention

European Journal of Neuroscience

Volumn 26, Issue 6, 2007, Pages 1681-1691

  Zimmer, Ulrike ^a,b   Macaluso, Emiliano ^a  

^a IRCCS FONDAZIONE SANTA LUCIA   (Italy)

^b DUKE UNIVERSITY   (United States)

Author keywords

Attention; fMRI; Human; Multisensory; Space

Indexed keywords

ADULT; ARTICLE; ATTENTION; BRAIN DEPTH STIMULATION; BRAIN REGION; CONTROLLED STUDY; DEPTH PERCEPTION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MALE; NORMAL HUMAN; OCCIPITAL CORTEX; PRIORITY JOURNAL; VISUAL STIMULATION; WORKING MEMORY;

ADULT; ATTENTION; COGNITION; DATA INTERPRETATION, STATISTICAL; EYE MOVEMENTS; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, SHORT-TERM; MENTAL RECALL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; SPACE PERCEPTION; TOUCH;

EID: 34548661686     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2007.05784.x     Document Type: Article

References (66)

1. Amedi, A., Malach, R., Hendler, T., Peled, S. Zohary, E. (2001) Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci., 4, 324 330.
2. Astafiev, S.V., Shulman, G.L., Stanley, C.M., Snyder, A.Z., Van Essen, D.C. Corbetta, M. (2003) Functional organization of human intraparietal and frontal cortex for attending, looking, and pointing. J. Neurosci., 23, 4689 4699.
3. Beer, A.L. Roder, B. (2005) Attending to visual or auditory motion affects perception within and across modalities: an event-related potential study. Eur. J. Neurosci., 21, 1116 1130.
4. Calvert, G.A. (2001) Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb. Cortex, 11, 1110 1123.
5. Calvert, G.A., Brammer, M.J., Bullmore, E.T., Campbell, R., Iversen, S.D. David, A.S. (1999) Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport, 10, 2619 2623.
6. Calvert, G.A., Campbell, R. Brammer, M.J. (2000) Evidence from functional magnetic resonance imaging of cross-modal binding in the human heteromodal cortex. Curr. Biol., 10, 649 657.
7. Cappe, C. Barone, P. (2005) Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur. J. Neurosci., 22, 2886 2902.
8. Chambers, C.D., Stokes, M.G. Mattingley, J.B. (2004) Modality-specific control of strategic spatial attention in parietal cortex. Neuron, 44, 925 930.
9. DeFockert, J.W., Rees, G., Frith, C.D. Lavie, N. (2001) The role of working memory in visual selective attention. Science, 291, 1803 1806.
10. Degerman, A., Rinne, T., Pekkola, J., Autti, T., Jaaskelainen, I.P., Sams, M. Alho, K. (2007) Human brain activity associated with audiovisual perception and attention. Neuroimage, 34, 1683 1691.
11. Duhamel, J.R., Colby, C.L. Goldberg, M.E. (1998) Ventral intraparietal area of the macaque: congruent visual and somatic response properties. J. Neurophysiol., 79, 126 136.
12. Eimer, M. Driver, J. (2000) An event-related brain potential study of cross-modal links in spatial attention between vision and touch. Psychophysiology, 37, 697 705.
13. Eimer, M. Van Velzen, J. (2002) Cross-modal links in spatial attention are mediated by supramodal control processes: evidence from event-related potentials. Psychophysiology, 39, 437 449.
14. Ernst, M.O. Banks, M.S. (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429 433.
15. Falchier, A., Clavagnier, S., Barone, P. Kennedy, H. (2002) Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci., 22, 5749 5759.
16. Foxe, J.J., Morocz, I.A., Murray, M.M., Higgins, B.A., Javitt, D.C. Schroeder, C.E. (2000) Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res. Cogn. Brain Res., 10, 77 83.
17. Foxe, J.J. Schroeder, C.E. (2005) The case for feedforward multisensory convergence during early cortical processing. Neuroreport, 16, 419 423.
18. Foxe, J.J., Simpson, G.V., Ahlfors, S.P. Saron, C.D. (2005) Biasing the brain's attentional set: I. Cue driven deployments of intersensory selective attention. Exp. Brain Res., 166, 370 392.
19. Foxe, J.J., Wylie, G.R., Martinez, A., Schroeder, C.E., Javitt, D.C., Guilfoyle, D., Ritter, W. Murray, M.M. (2002) Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J. Neurophysiol., 88, 540 543.
20. Friston, K.J., Holmes, A.P., Price, C.J., Buchel, C. Worsley, K.J. (1999) Multisubject fMRI studies and conjunction analyses. Neuroimage, 10, 385 396.
21. Fu, K.M., Johnston, T.A., Shah, A.S., Arnold, L., Smiley, J., Hackett, T.A., Garraghty, P.E. Schroeder, C.E. (2003) Auditory cortical neurons respond to somatosensory stimulation. J. Neurosci., 23, 7510 7515.
22. Ghazanfar, A.A. Schroeder, C.E. (2006) Is neocortex essentially multisensory? Trends Cogn. Sci., 10, 278 285.
23. Giard, M.H. Peronnet, F. (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci., 11, 473 490.
24. Gondan, M. Roeder, B. (2006) A new method for detecting interactions between the senses in event-related potentials. Brain Res., 1073-1074, 389 397.
25. Graziano, M.S. (1999) Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. Proc. Natl Acad. Sci. USA, 96, 10418 10421.
26. Kastner, S., Pinsk, M.A., De Weerd, P., Desimone, R. Ungerleider, L.G. (1999) Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron, 22, 751 761.
27. Kayser, C., Petkov, C.I., Augath, M. Logothetis, N.K. (2005) Integration of touch and sound in auditory cortex. Neuron, 20, 373 384.
28. Kennett, S., Eimer, M., Spence, C. Driver, J. (2001) Tactile-visual links in exogenous spatial attention under different postures: convergent evidence from psychophysics and ERPs. J. Cogn. Neurosci., 13, 462 478.
29. Kennett, S., Spence, C. Driver, J. (2002) Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture. Percept. Psychophys., 64, 1083 1094.
30. Komura, Y., Tamura, R., Uwano, T., Nishijo, H. Ono, T. (2005) Auditory thalamus integrates visual inputs into behavioral gains. Nat. Neurosci., 8, 1203 1209.
31. Ladavas, E., di Pellegrino, G., Farne, A. Zeloni, G. (1998) Neuropsychological evidence of an integrated visuotactile representation of peripersonal space in humans. J. Cogn. Neurosci., 10, 581 589.
32. Lavie, N. (2005) Distracted and confused?: selective attention under load. Trends Cogn. Sci., 9, 75 82.
33. Linden, D.E., Bittner, R.A., Muckli, L., Waltz, J.A., Kriegeskorte, N., Goebel, R., Singer, W. Munk, M.H. (2003) Cortical capacity constraints for visual working memory: dissociation of fMRI load effects in a fronto-parietal network. Neuroimage, 20, 1518 1530.
34. Macaluso, E. Driver, J. (2001) Spatial attention and cross-modal interactions between vision and touch. Neuropsychologia, 39, 1304 1316.
35. Macaluso, E., Frith, C.D. Driver, J. (2000) Modulation of human visual cortex by cross-modal spatial attention. Science, 289, 1206 1208.
36. Macaluso, E., Frith, C.D. Driver, J. (2002) Directing attention to locations and to sensory modalities: multiple levels of selective processing revealed with PET. Cereb. Cortex, 12, 357 368.
37. Macaluso, E., Frith, C.D. Driver, J. (2005) Multisensory stimulation with or without saccades: fMRI evidence for cross-modal effects on sensory-specific cortices that reflect multisensory location-congruence rather than task-relevance. Neuroimage, 26, 414 425.
38. Mao, L., Zhou, B., Zhou, W. Han, S. (2007) Neural correlates of covert orienting of visual spatial attention along vertical and horizontal dimensions. Brain Res., 1136, 142 153.
39. McDonald, J.J., Teder-Salejarvi, W.A., Di Russo, F. Hillyard, S.A. (2003) Neural substrates of perceptual enhancement by cross-modal spatial attention. J. Cogn. Neurosci., 15, 10 19.
40. Meienbrock, A., Naumer, M.J., Doehrmann, O., Singer, W. Muckli, L. (2007) Retinotopic effects during spatial audio-visual integration. Neuropsychologia, 45, 531 539.
41. Meredith, M.A. (2002) On the neuronal basis for multisensory convergence: a brief overview. Brain Res. Cogn. Brain Res., 14, 31 40.
42. Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E. Foxe, J.J. (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res., 14, 115 128.
43. Noesselt, T., Hillyard, S.A., Woldorff, M.G., Schoenfeld, A., Hagner, T., Jancke, L., Tempelmann, C., Hinrichs, H. Heinze, H.J. (2002) Delayed striate cortical activation during spatial attention. Neuron, 35, 575 587.
44. Otten, L.J., Alain, C. Picton, T.W. (2000) Effects of visual attentional load on auditory processing. Neuroreport, 11, 875 880.
45. Penny, W. Holmes, A. (2004) Random effects analysis. In Frackowiak, R.S.J., Friston, K., Frith, C., Dolan, R., Price, C., Zeki, S., Ashburner, J. Penny, W. (Eds), The Human Brain Function, 2nd Edn. Elsevier, San Diego, pp. 843 851.
46. Rees, G., Frith, C.D. Lavie, N. (1997) Modulating irrelevant motion perception by varying attentional load in an unrelated task. Science, 278, 1616 1619.
47. Rees, G., Frith, C. Lavie, N. (2001) Processing of irrelevant visual motion during performance of an auditory attention task. Neuropsychologia, 39, 937 949.
48. Rockland, K.S. (2004) Connectional neuroanatomy: the changing scene. Brain Res., 1000, 60 63.
49. Rockland, K.S. Ojima, H. (2003) Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol., 50, 19 26.
50. Rypma, B., Prabhakaran, V., Desmond, J.E., Glover, G.H. Gabrieli, J.D. (1999) Load-dependent roles of frontal brain regions in the maintenance of working memory. Neuroimage, 9, 216 226.
51. Sathian, K., Zangaladze, A., Hoffman, J.M. Grafton, S.T. (1997) Feeling with the mind's eye. Neuroreport, 8, 3877 3881.
52. Schroeder, C.E., Smiley, J., Fu, K.G., McGinnis, T., O'Connell, M.N. Hackett, T.A. (2003) Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. Int. J. Psychophysiol., 50, 5 17.
53. Schwartz, S., Vuilleumier, P., Hutton, C., Maravita, A., Dolan, R.J. Driver, J. (2005) Attentional load and sensory competition in human vision: modulation of fMRI responses by load at fixation during task-irrelevant stimulation in the peripheral visual field. Cereb. Cortex, 15, 770 786.
54. Shomstein, S. Yantis, S. (2004) Control of attention shifts between vision and audition in human cortex. J. Neurosci., 24, 10702 10706.
55. Soto-Faraco, S. Spence, C. (2002) Modality-specific auditory and visual temporal processing deficits. Q. J. Exp. Psychol. A, 55, 23 40.
56. Spence, C., Nicholls, M.E., Gillespie, N. Driver, J. (1998) Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision. Percept. Psychophys., 60, 544 557.
57. Stein, B.E. Meredith, M.A. (1993) The Merging of the Senses. MIT Press, Cambridge. MA.
58. Talsma, D. Woldorff, M.G. (2005) Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J. Cogn. Neurosci., 17, 1098 1114.
59. Teder-Salejarvi, W.A., Di Russo, F., McDonald, J.J. Hillyard, S.A. (2005) Effects of spatial congruity on audio-visual multimodal integration. J. Cogn. Neurosci., 17, 1396 1409.
60. Teder-Salejarvi, W.A., McDonald, J.J., Di Russo, F. Hillyard, S.A. (2002) An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res. Cogn. Brain Res., 14, 106 114.
61. Teder-Salejarvi, W.A., Munte, T.F., Sperlich, F. Hillyard, S.A. (1999) Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An event-related brain potential study. Brain Res. Cogn. Brain Res., 8, 327 343.
62. Tellinghuisen, D.J. Nowak, E.J. (2003) The inability to ignore auditory distractors as a function of visual task perceptual load. Percept. Psychophys., 65, 817 828.
63. Tong, F. (2003) Primary visual cortex and visual awareness. Nat. Rev. Neurosci., 4, 219 229.
64. Worsley, K.J., Marrett, S., Neelin, P., Vandal, A.C., Friston, K.J. Evans, A.C. (1996) A unified statistical approach for determining significant signals in images of cerebral activation. Hum. Brain Mapp., 4, 58 73.
65. Yi, D.J., Woodman, G.F., Widders, D., Marois, R. Chun, M.M. (2004) Neural fate of ignored stimuli: dissociable effects of perceptual and working memory load. Nat. Neurosci., 7, 992 996.
66. Zhang, M., Weisser, V.D., Stilla, R., Prather, S.C. Sathian, K. (2004) Multisensory cortical processing of object shape and its relation to mental imagery. Cogn. Affect Behav. Neurosci., 4, 251 259.