Multisensory congruency as a mechanism for attentional control over perceptual selection

Journal of Neuroscience

Volumn 29, Issue 37, 2009, Pages 11641-11649

  Van Ee, Raymond ^a   Van Boxtel, Jeroen J A ^b   Parker, Amanda L ^c   Alais, David ^c  

^a UTRECHT UNIVERSITY   (Netherlands)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c UNIVERSITY OF SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; AUDITORY STIMULATION; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; PERCEPTION; PRIORITY JOURNAL; SELECTIVE ATTENTION; SOUND DETECTION; STIMULUS RESPONSE; TACTILE STIMULATION; TOUCH; VISION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ATTENTION; AUDITORY PERCEPTION; CHOICE BEHAVIOR; FEMALE; GENERALIZATION (PSYCHOLOGY); HUMANS; MALE; PHOTIC STIMULATION; PSYCHOPHYSICS; REACTION TIME; TOUCH; VISUAL PERCEPTION;

EID: 70349129953     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0873-09.2009     Document Type: Article

References (76)

1. Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14:257-262. (Pubitemid 38215356)
2. Alais D, Morrone C, Burr D (2006) Separate attentional resources for vision and audition. Proc Biol Sci 273:1339-1345. (Pubitemid 47308753)
3. Amedi A, Malach R, Pascual-Leone A (2005) Negative BOLD differentiates visual imagery and perception. Neuron 48:859-872. (Pubitemid 41759435)
4. Bidet-Caulet A, Fischer C, Besle J, Aguera PE, Giard MH, Bertrand O (2007) Effects of selective attention on the electrophysiological representation of concurrent sounds in the human auditory cortex. J Neurosci 27:9252-9261. (Pubitemid 47358208)
5. Blake R, Logothetis NK (2002) Visual competition. Nat Rev Neurosci 3:13-21.
6. Blaser E, Sperling G, Lu ZL (1999) Measuring the amplification of attention. Proc Natl Acad Sci U S A 96:11681-11686.
7. Bonnel AM, Hafter ER (1998) Divided attention between simultaneous auditory and visual signals. Percept Psychophys 60:179-190. (Pubitemid 128455763)
8. Boynton GM (2005) Attention and visual perception. Curr Opin Neurobiol 15:465-469.
9. Brosch M, Selezneva E, Scheich H (2005) Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. J Neurosci 25:6797-6806. (Pubitemid 41023147)
10. Brouwer GJ, van Ee R (2006) Endogenous influences on perceptual bistability depend on exogenous stimulus characteristics. Vision Res 46:3393-3402.
11. Budinger E, Heil P, Hess A, Scheich H (2006) Multisensory processing via early cortical stages: connections of the primary auditory cortical field with other sensory systems. Neuroscience 143:1065-1083. (Pubitemid 44827516)
12. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SC, McGuire PK, Woodruff PW, Iversen SD, David AS (1997) Activation of auditory cortex during silent lip reading. Science 276:593-596. (Pubitemid 27193683)
13. Carrasco M, Ling S, Read S (2004) Attention alters appearance. Nat Neurosci 7:308-313.
14. Chong SC, Blake R (2006) Exogenous attention and endogenous attention influence initial dominance in binocular rivalry. Vision Res 46:1794-1803.
15. Chong SC, Tadin D, Blake R (2005) Endogenous attention prolongs dominance durations in binocular rivalry. J Vis 5:1004-1012. (Pubitemid 43078794)
16. Degerman A, Rinne T, Pekkola J, Autti T, Jääskeläinen IP, Sams M, Alho K (2007) Human brain activity associated with audiovisual perception and attention. Neuroimage 34:1683-1691. (Pubitemid 46187088)
17. Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57:11-23.
18. Driver J, Spence C (1998) Attention and crossmodal construction of space. Trends Cogn Sci 2:254-262.
19. Erkelens CJ, Regan D (1986) Human ocular vergence movements induced by changing size and disparity. J Physiol 379:145-169.
20. Foxe JJ, Schroeder CE (2005) The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16:419-423.
21. Fujisaki W, Shimojo S, Kashino M, Nishida S (2004) Recalibration of audiovisual simultaneity. Nat Neurosci 7:773-778.
22. Ghazanfar AA, Schroeder CE (2006) Is neocortex essentially multisensory? Trends Cogn Sci 10:278-285.
23. Gilbert CD, Sigman M (2007) Brain states: top-down influences in sensory processing. Neuron 54:677-696. (Pubitemid 46850795)
24. Gutfreund Y, Zheng W, Knudsen EI (2002) Gated visual input to the central auditory system. Science 297:1556-1559. (Pubitemid 34971003)
25. Guttman SE, Gilroy LA, Blake R (2005) Hearing what the eyes see. Psychol Sci 16:228-235.
26. Hancock S, Andrews TJ (2007) The role of voluntary and involuntary attention in selecting perceptual dominance during binocular rivalry. Perception 36:288-298.
27. Helmholtz H (1866) Handbuch der Physiologischen Optik. Hamburg: Voss.
28. Hol K, Koene A, van Ee R (2003) Attention-biased multi-stable surface perception in three-dimensional structure-from-motion. J Vis 3:486-498. (Pubitemid 39047387)
29. Hupé J-M, Joffo LM, Pressnitzer D (2008) Bistability for audiovisual stimuli: perceptual decision is modality specific. J Vis 8:1.1-15.
30. Ichikawa M, Masakura Y (2006) Auditory stimulation affects apparent motion. Jpn Psychol Res 48:91-101. (Pubitemid 43838990)
31. Kanai R, Tsuchiya N, Verstraten FA (2006) The scope and limits of top-down attention in unconscious visual processing. Curr Biol 16:2332-2336. (Pubitemid 44821836)
32. Kanai R, Sheth BR, Verstraten FA, Shimojo S (2007) Dynamic perceptual changes in audiovisual simultaneity. PLoS One 2:e1253. (Pubitemid 351663857)
33. Kayser C, Logothetis NK (2007) Do early sensory cortices integrate cross-modal information? Brain structure and function 212:121-132.
34. Klink PC, van Ee R, Nijs MM, Brouwer GJ, Noest AJ, van Wezel RJA (2008) Early interactions between neuronal adaptation and voluntary control determine perceptual choices in bistable vision. J Vis 8:16.1-18.
35. Lack LC (1978) Selective attention and the control of binocular rivalry. The Hague, The Netherlands: Mouton.
36. Lakatos P, Chen CM, O'Connell MN, Mills A, Schroeder CE (2007) Neuronal Oscillations and multisensory Interaction in primary auditory cortex. Neuron 53:279-292. (Pubitemid 46074398)
37. Lakatos P, Karmos G, Mehta AD, Ulbert I, Schroeder CE (2008) Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 320:110-113.
38. Lamme VA, Roelfsema PR (2000) The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci 23:571-579.
39. Leopold DA, Logothetis NK (1999) Multistable phenomena: changing views in perception. Trends Cogn Sci 3:254-264.
40. Levelt WJM (1965) On binocular rivalry. Assen, The Netherlands: Royal van Gorcum.
41. Macaluso E, Driver J (2005) Multisensory spatial interactions: a window onto functional integration in the human brain. Trends Neurosci 28:264-271. (Pubitemid 41556911)
42. Maier JX, Ghazanfar AA (2007) Looming biases in monkey auditory cortex. J Neurosci 27:4093-4100.
43. Melcher D, Papathomas TV, Vidnyánszky Z (2005) Implicit attentional selection of bound visual features. Neuron 46:723-729. (Pubitemid 40733128)
44. Meng M, Tong F (2004) Can attention selectively bias bistable perception? Differences between binocular rivalry and ambiguous figures. J Vis 4:539-551. (Pubitemid 39047454)
45. Mozolic JL, Hugenschmidt CE, Peiffer AM, Laurienti PJ (2008) Modality-specific selective attention attenuates multisensory integration. Exp Brain Res 184:39-52.
46. Neuhoff JG (2001) An adaptive bias in the perception of looming auditory motion. Ecol Psychol 13:87-110. (Pubitemid 33266963)
47. Noest AJ, van Ee R, Nijs MM, van Wezel RJA (2007) Percept-choice sequences driven by interrupted ambiguous stimuli: a low-level neural model. J Vis 7:10.1-14.
48. O'Leary A, Rhodes G (1984) Cross-modal effects on visual and auditory object perception. Percept Psychophys 35:565-569.
49. Paffen CL, Alais D, Verstraten FA (2006) Attention speeds binocular rivalry. Psychol Sci 17:752-756.
50. Parker AL, Alais D (2006) Auditory modulation of binocular rivalry. J Vis 6:855.
51. Parker A, Alais D (2007) A bias for looming stimuli to predominate in binocular rivalry. Vision Res 47:2661-2674. (Pubitemid 47379814)
52. Peterson MA, Hochberg J (1983) Opposed-set measurement procedure: a quantitative analysis of the role of local cues and intention in form perception. J Exp Psychol: Hum Percept Perform 9:183-193.
53. Pressnitzer D, Hupé JM (2006) Temporal dynamics of auditory and visual bistability reveal common principles of perceptual organization. Curr Biol 16:1351-1357. (Pubitemid 43996887)
54. Reynolds JH, Chelazzi L (2004) Attentional modulation of visual processing. Annu Rev Neurosci 27:611-647.
55. Sekuler R, Sekuler AB, Lau R (1997) Sound alters visual motion perception. Nature 385:308. (Pubitemid 27053094)
56. Senkowski D, Schneider TR, Foxe JJ, Engel AK (2008) Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci 31:401-409.
57. Shiffrin RM, Grantham DW (1974) Can attention be allocated to sensory modalities? Percept Psychophys 15:460-474.
58. Shimojo S, Shams L (2001) Sensory modalities are not separate modalities: plasticity and interactions. Curr Opin Neurobiol 11:505-509. (Pubitemid 32739179)
59. Shinn-Cunningham BG (2008) Object-based auditory and visual attention. Trends Cogn Sci 12:182-186.
60. Shomstein S, Yantis S (2004) Control of attention shifts between vision and audition in human cortex. J Neurosci 24:10702-10706. (Pubitemid 39557644)
61. Slotnick SD, Yantis S (2005) Common neural substrates for the control and effects of visual attention and perceptual bistability. Brain Res Cogn Brain Res 24:97-108.
62. Soto-Faraco S, Morein-Zamir S, Kingstone A (2005) On audiovisual spatial synergy: the fragility of the phenomenon. Percept Psychophys 67:444-457. (Pubitemid 40979060)
63. Spence C, Nicholls ME, Driver J (2001) The cost of expecting events in the wrong sensory modality. Percept Psychophys 63:330-336. (Pubitemid 33610252)
64. Suzuki S, Peterson MA (2000) Multiplicative effects of intention on the perception of bistable apparent motion. Psychol Sci 11:202-209.
65. Tong F (2003) Primary visual cortex and visual awareness. Nat Rev Neurosci 4:219-229.
66. Toppino TC (2003) Reversible-figure perception: mechanisms of intentional control. Percept Psychophys 65:1285-1295.
67. Treue S, Martínez Trujillo JC (1999) Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399:575-579. (Pubitemid 29279175)
68. Treue S, Maunsell JH (1996) Attentional modulation of visual motion processing in cortical areas MT and MST. Nature 382:539-541. (Pubitemid 26260695)
69. Van der Burg E, Olivers CN, Bronkhorst AW, Theeuwes J (2008) Pip and pop: nonspatial auditory signals improve spatial visual search. J Exp Psychol Hum Percept Perform 34:1053-1065.
70. van Ee R, van Dam LC, Brouwer GJ (2005) Voluntary control and the dynamics of perceptual bi-stability. Vision Res 45:41-55.
71. van Ee R, Noest AJ, Brascamp JW, van den Berg AV (2006) Attentional control over either of the two competing percepts of ambiguous stimuli revealed by a two-parameter analysis: means don't make the difference. Vision Res 46:3129-3141. (Pubitemid 44061913)
72. van Noorden LPAS (1975) Temporal coherence in the perception of tone sequences. PhD thesis. Institute of Perception Research, Eindhoven, The Netherlands.
73. Wade NJ, de Weert CM (1986) Binocular rivalry with rotary and radial motions. Perception 15:435-442.
74. Wannig A, Rodríguez V, Freiwald WA (2007) Attention to surfaces modulates motion processing in extrastriate area MT. Neuron 54:639-651. (Pubitemid 46778968)
75. Witten IB, Knudsen EI (2005) Why seeing is believing: merging auditory and visual worlds. Neuron 48:489-496.
76. Womelsdorf T, Anton-Erxleben K, Pieper F, Treue S (2006) Dynamic shifts of visual receptive fields in cortical area MT by spatial attention. Nat Neurosci 9:1156-1160. (Pubitemid 44306309)