Object-based attention is multisensory: Co-activation of an object's representations in ignored sensory modalities

European Journal of Neuroscience

Volumn 26, Issue 2, 2007, Pages 499-509

  Molholm, Sophie ^a,b   Martinez, Antigona ^a   Shpaner, Marina ^a,b   Foxe, John J ^a,b  

^a NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

^b CITY COLLEGE OF NEW YORK   (United States)

Author keywords

Auditory; ERPs; Human; Visual

Indexed keywords

ADULT; ARTICLE; AUDITORY MEMORY; CONTROLLED STUDY; ELECTROPHYSIOLOGY; EVENT RELATED POTENTIAL; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SENSORY STIMULATION; VISUAL FIELD;

ACOUSTIC STIMULATION; ADULT; ATTENTION; DATA INTERPRETATION, STATISTICAL; ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY; FEMALE; FORM PERCEPTION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MALE; PHOTIC STIMULATION; REACTION TIME; VISUAL PERCEPTION;

EID: 34447650278     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2007.05668.x     Document Type: Article

References (43)

1. Amedi, A., von, K.K., van Atteveldt, N.M., Beauchamp, M.S. Naumer, M.J. (2005) Functional imaging of human crossmodal identification and object recognition. Exp. Brain Res., 166, 559 571.
2. Beauchamp, M.S., Lee, K.E., Argall, B.D. Martin, A. (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron, 41, 809 823.
3. Bertelson, P. Radeau, M. (1981) Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept. Psychophys., 29, 578 584.
4. Busse, L., Roberts, K.C., Crist, R.E., Weissman, D.H. Woldorff, M.G. (2005) The spread of attention across modalities and space in a multisensory object. Proc. Natl Acad. Sci. USA, 102, 18751 18756.
5. Cappe, C. Barone, P. (2005) Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur. J. Neurosci., 22, 2886 2902.
6. Corbetta, M., Miezin, F.M., Dobmeyer, S., Shulman, G.L. Petersen, S.E. (1990) Attentional modulation of neural processing of shape, color, and velocity in humans. Science, 248, 1556 1559.
7. Davis, G., Driver, J., Pavani, F. Shepherd, A. (2000) Reappraising the apparent costs of attending to two separate visual objects. Vis. Res., 40, 1323 1332.
8. Desimone, R. Duncan, J. (1995) Neural mechanisms of selective visual attention. Annu. Rev. Neurosci., 18, 193 222.
9. Duncan, J. (2006) EPS Mid-Career Award 2004: brain mechanisms of attention. Q. J. Exp. Psychol. (Colchester), 59, 2 27.
10. Easton, R.D., Srinivas, K. Greene, A.J. (1997) Do vision and haptics share common representations? Implicit and explicit memory within and between modalities. J. Exp. Psychol. Learn. Mem. Cogn., 23, 153 163.
11. Egly, R., Driver, J. Rafal, R.D. (1994) Shifting visual attention between objects and locations. evidence from normal and parietal lesion subjects. J. Exp. Psychol. General, 123, 161 177.
12. Eimer, M. Driver, J. (2001) Crossmodal links in endogenous and exogenous spatial attention: evidence from event-related brain potential studies. Neurosci. Biobehav. Rev., 25, 497 511.
13. Eimer, M., van, V.J. Driver, J. (2002) Cross-modal interactions between audition, touch, and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations. J. Cogn. Neurosci., 14, 254 271.
14. Ernst, M.O. Bulthoff, H.H. (2004) Merging the senses into a robust percept. Trends Cogn. Sci., 8, 162 169.
15. Fabiani, M., Kazmerski, V.A., Cycowicz, Y.M. Friedman, D. (1996) Naming norms for brief environmental sounds: effects of age and dementia. Psychophysiology, 33, 462 475.
16. Falchier, A., Clavagnier, S., Barone, P. Kennedy, H. (2002) Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci., 22, 5749 5759.
17. Felleman, D.J. VanEssen, D.C. (1991) Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex, 1, 1 47.
18. Foxe, J.J. Schroeder, C.E. (2005) The case for feedforward multisensory convergence during early cortical processing. Neuroreport, 16, 419 423.
19. Foxe, J.J., Simpson, G.V., Ahlfors, S.P. Saron, C.D. (2005) Biasing the brain's attentional set. I. Cue Driven Deployments of Intersensory Selective Attention. Exp. Brain Res., 166, 370 392.
20. Giard, M.H. Peronnet, F. (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci., 11, 473 490.
21. Gomez-Ramirez, M., Higgins, B.A., Rycroft, J.A., Owen, G.N., Mahoney, J., Shpaner, M. Foxe, J.J. (2007) The deployment of intersensory selective attention: a high-density electrical mapping study of the effects of theanine. Clin. Neuropharmacol., 30, 25 38.
22. Greene, A.J., Easton, R.D. LaShell, L.S. (2001) Visual-auditory events: cross-modal perceptual priming and recognition memory. Conscious Cogn., 10, 425 435.
23. Guthrie, D. Buchwald, J.S. (1991) Significance testing of difference potentials. Psychophysiology, 28, 240 244.
24. Hansen, J.C. Hillyard, S.A. (1980) Endogenous brain potentials associated with selective auditory attention. Electroencephalogr. Clin. Neurophysiol., 49, 277 290.
25. Hauk, O., Shtyrov, Y. Pulvermuller, F. (2006) The sound of actions as reflected by mismatch negativity: rapid activation of cortical sensory-motor networks by sounds associated with finger and tongue movements. Eur. J. Neurosci., 23, 811 821.
26. Hillyard, S.A. Anllo-Vento, L. (1998) Event-related brain potentials in the study of visual selective attention. Proc. Natl Acad. Sci. USA, 95, 781 787.
27. Hillyard, S.A., Simpson, G.V., Woods, D.L., Van Voorhis, S.T. Munte, T.F. (1984) Event-related brain potentials and selective attention to different modalities. In Reinoso-Suarez, F., (Ed), Cortical Integration. Ravel Press, New York, pp. 395 414.
28. Hillyard, S.A., Vogel, E.K. Luck, S.J. (1998) Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. Philos. Trans. R. Soc. Lond. B Biol. Sci., 353, 1257 1270.
29. James, T.W., Humphrey, G.K., Gati, J.S., Servos, P., Menon, R.S. Goodale, M.A. (2002) Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia, 40, 1706 1714.
30. Johnson, J.A. Zatorre, R.J. (2005) Attention to simultaneous unrelated auditory and visual events. behavioral and neural correlates. Cereb. Cortex, 15, 1609 1620.
31. Martinez, A., Teder-Salejarvi, W., Vazquez, M., Molholm, S., Foxe, J.J., Di Javitt, D.C.R.F., Worden, M.S. Hillyard, S.A. (2006) Objects are highlighted by spatial attention. J. Cogn. Neurosci., 18, 298 310.
32. Molholm, S., Ritter, W., Javitt, D.C. Foxe, J.J. (2004) Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb. Cortex, 14, 452 465.
33. Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E. Foxe, J.J. (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res., 14, 115 128.
34. O'Craven, K.M., Downing, P.E. Kanwisher, N. (1999) fMRI evidence for objects as the units of attentional selection. Nature, 401, 584 587.
35. Pulvermuller, F. Hauk, O. (2006) Category-specific conceptual processing of color and form in left fronto-temporal cortex. Cereb. Cortex, 16, 1193 1201.
36. Pulvermuller, F., Shtyrov, Y. Ilmoniemi, R. (2005) Brain signatures of meaning access in action word recognition. J. Cogn. Neurosci., 17, 884 892.
37. Rockland, K.S. Ojima, H. (2003) Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol., 50, 19 26.
38. Schoenfeld, M.A., Tempelmann, C., Martinez, A., Hopf, J.M., Sattler, C., Heinze, H.J. Hillyard, S.A. (2003) Dynamics of feature binding during object-selective attention. Proc. Natl Acad. Sci. USA, 100, 11806 11811.
39. Schroeder, C.E. Foxe, J. (2005) Multisensory contributions to low-level, 'unisensory' processing. Curr. Opin. Neurobiol., 15, 454 458.
40. Snodgrass, J.G. Vanderwart, M. (1980) A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. J. Exp. Psychol. [Hum. Learn.], 6, 174 215.
41. Spence, C. Driver, J. (1996) Audiovisual links in endogenous covert spatial attention. J. Exp. Psychol. Hum. Percept. Perform., 22, 1005 1030.
42. Stein, B.E. Meredith, M.A. (1993) The Merging of the Senses. The MIT Press, Cambrige, MA.
43. Talsma, D., Doty, T.J. Woldorff, M.G. (2007) Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? Cereb. Cortex, 17, 679 690.