Cross-modal spatial cueing of attention influences visual perception

The Neural Bases of Multisensory Processes

Volumn , Issue , 2011, Pages 509-527

  McDonald, John J ^a   Green, Jessica J ^b   Störmer, Viola S ^c   Hillyard, Steven A ^d  

^a SIMON FRASER UNIVERSITY   (Canada)

^b YALE UNIVERSITY   (United States)

^c MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85059444598     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (94)

1. Boring, E. G. 1929. A history of experimental psychology. New York: Appleton-Century.
2. Broadbent, D. E. 1958. Perception and communication. London: Pergamon Press.
3. Cairney, P. T. 1975. The complication experiment uncomplicated. Perception 4: 255-265.
4. Calvert, G. A., R. Campbell, and M. J. Brammer. 2000. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 10: 649-657.
5. Carrasco, M. 2006. Covert attention increases contrast sensitivity: Psychophysical, neurophysiological, and neuroimaging studies. In Progress in Brain Research, Volume 154, Part 1: Visual Perception. Part I. Fundamentals of Vision: Low and Mid-level Processes in Perception, ed. S. Martinez-Conde, S. L. Macknik, L. M. Martinez, J. M. Alonso, and P. U. Tse, 33-70. Amsterdam: Elsevier.
6. Carrasco, M., S. Ling, and S. Read. 2004. Attention alters appearance. Nature Neuroscience 7: 308-313.
7. Carver, R. A., and V. Brown. 1997. Effects of amount of attention allocated to the location of visual stimulus pairs on perception of simultaneity. Perception & Psychophysics 59: 534-542.
8. Cherry, C. E. 1953. Some experiments on the recognition of speech with one and two ears. Journal of the Acoustical Society of America 25: 975-979.
9. Corbetta, M., and G. L. Shulman. 2002. Control of goal-directed and stimulus-driven attention in the brain. Nature Reviews Neuroscience 3: 201-215.
10. Dennett, D. 1991. Consciousness explained. Boston: Little, Brown & Co.
11. Deutsch, J. A., and D. Deutsch. 1963. Attention: Some theoretical considerations. Psychological Review 70: 80-90.
12. Doesburg, S. M., J. J. Green, J. J. McDonald, and L. M. Ward. 2009. From local inhibition to long-range inte-gration: A functional dissociation of alpha-band synchronization across cortical scales in visuospatial attention. Brain Research 1303: 97-110.
13. Driver, J., and T. Noesselt. 2008. Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57: 11-23.
14. Driver, J., and C. Spence. 2004. Crossmodal spatial attention: Evidence from human performance. In Crossmodal space and crossmodal attention, ed. C. Spence and J. Driver, 179-220. Oxford: Oxford Univ. Press.
15. Dufour, A. 1999. Importance of attentional mechanisms in audiovisual links. Experimental Brain Research 126: 215-222.
16. Eimer, M., J. van Velzen, and J. Driver. 2002. Cross-modal interactions between audition, touch, and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations. Journal of Cognitive Neuroscience 14: 254-271.
17. Eimer, M., and E. Schröger. 1998. ERP effects of intermodal attention and cross-modal links in spatial atten-tion. Psychophysiology 35: 313-327.
18. Eriksen, C. W., and J. E. Hoffman. 1972. Temporal and spatial characteristics of selective encoding from visual displays. Perception & Psychophysics 12: 201-204.
19. Farah, M. J., A. B. Wong, M. A. Monheit, and L. A. Morrow. 1989. Parietal lobe mechanisms of spatial atten-tion-modality-specific or supramodal. Neuropsychologia 27: 461-470.
20. Fechner, G. T. 1882. Revision der Hauptpunkte der Psychophysik. Leipzig: Breitkopf & Härtel.
21. Folk, C. L., R. W. Remington, and J. C. Johnston. 1992. Involuntary covert orienting is contingent on atten-tional control settings. Journal of Experimental Psychology: Human Perception and Performance 18: 1030-1044.
22. Foxe, J. J., and C. E. Schroeder. 2005. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16: 419-423.
23. Fukuda, K., and E. K. Vogel, 2009. Human variation in overriding attentional capture. Journal of Neuroscience 29: 8726-8733.
24. Fuller, S., R. Z. Rodriguez, and M. Carrasco. 2008. Apparent contrast differs across the vertical meridian: Visual and attentional factors. Journal of Vision 8: 1-16.
25. Green, D. M., and J. A. Swets. 1966. Signal detection theory and psychophysics. New York: Wiley.
26. Green, J. J., and J. J. McDonald. 2008. Electrical neuroimaging reveals timing of attentional control activity in human brain. PLoS Biology 6: e81.
27. Heinze, H. J., G. R. Mangun, and S. A. Hillyard. 1990. Visual event-related potentials index perceptual accu-racy during spatial attention to bilateral stimuli. In Psychophysiological Brain Research, ed. C. Brunia et al., 196-202. Tilburg, The Netherlands: Tilburg Univ. Press.
28. Heinze, H. J., G. R. Mangun, W. Burchert et al. 1994. Combined spatial and temporal imaging of brain activity during visual selective attention in humans. Nature 372: 543-546.
29. Helmholtz, H. V. 1866. Treatise on psychological optics, 3rd ed., Vols. 2 & 3. Rochester: Optical Society of America.
30. Hillyard, S. A., G. V. Simpson, D. L. Woods, S. Vanvoorhis, and T. F. Münte. 1984. Event-related brain poten-tials and selective attention to different modalities. In Cortical Integration, ed. F. Reinoso-Suarez and C. Ajmone-Marsan, 395-414. New York: Raven Press.
31. James, W. 1890. The principles of psychology. New York: Henry Holt.
32. LaBerge, D. 1995. Attentional processing: The brain's art of mindfulness. Cambridge, MA: Harvard Univ. Press.
33. Ling, S., and M. Carrasco. 2007. Transient covert attention does alter appearance: A reply to Schneider 2006. Perception & Psychophysics 69: 1051-1058.
34. Lu, Z. L., and B. A. Dosher. 1998. External noise distinguishes attention mechanisms. Vision Research 38: 1183-1198.
35. Luce, P. A. 1986. A computational analysis of uniqueness points in auditory word recognition. Perception & Psychophysics 39: 155-158.
36. Luck, S. J., H. J. Heinze, G. R. Mangun, and S. A. Hillyard. 1990. Visual event-related potentials index focussed attention within bilateral stimulus arrays: II. Functional dissociation of P1 and N1 components. Electroencephalography and Clinical Neurophysiology 75: 528-542.
37. Luck, S. J., S. A. Hillyard, M. Mouloua, and H. L. Hawkins. 1996. Mechanisms of visual-spatial attention: Resource allocation or uncertainty reduction? Journal of Experimental Psychology: Human Perception and Performance 22: 725-737.
38. Luck, S. J., S. A. Hillyard, M. Mouloua, M. G. Woldorff, V. P. Clark, and H. L. Hawkins. 1994. Effects of spa-tial cuing on luminance detectability: Psychophysical and electrophysiological evidence for early selec-tion. Journal of Experimental Psychology: Human Perception and Performance 20: 887-904.
39. Macaluso, E., C. D. Frith, and J. Driver. 2000. Modulation of human visual cortex by crossmodal spatial atten-tion. Science 289: 1206-1208.
40. McDonald, J. J., and J. J. Green. 2008. Isolating event-related potential components associated with voluntary control of visuo-spatial attention. Brain Research 1227: 96-109.
41. McDonald, J. J., W. A. Teder-Sälejärvi, F. Di Russo, and S. A. Hillyard. 2003. Neural substrates of perceptual enhancement by cross-modal spatial attention. Journal of Cognitive Neuroscience 15: 10-19.
42. McDonald, J. J., W. A. Teder-Sälejärvi, F. Di Russo, and S. A. Hillyard. 2005. Neural basis of auditory-induced shifts in visual time-order perception. Nature Neuroscience 8: 1197-1202.
43. McDonald, J. J., W. A. Teder-Sälejärvi, D. Heraldez, and S. A. Hillyard. 2001. Electrophysiological evidence for the "missing link" in crossmodal attention. Canadian Journal of Experimental Psychology 55: 141-149.
44. McDonald, J. J., W. A. Teder-Sälejärvi, and S. A. Hillyard. 2000. Involuntary orienting to sound improves visual perception. Nature 407: 906-908.
45. McDonald, J. J., and L. M. Ward. 1999. Spatial relevance determines facilitatory and inhibitory effects of audi-tory covert spatial orienting. Journal of Experimental Psychology: Human Perception and Performance 25: 1234-1252.
46. McDonald, J. J., and L. M. Ward. 2000. Involuntary listening aids seeing: Evidence from human electrophysiol-ogy. Psychological Science 11: 167-171.
47. Meredith, M. A., J. W. Nemitz, and B. E. Stein. 1987. Determinants of multisensory integration in superior colliculus neurons: 1. Temporal factors. Journal of Neuroscience 7: 3215-3229.
48. Meredith, M. A., and B. E. Stein. 1996. Spatial determinants of multisensory integration in cat superior col-liculus neurons. Journal of Neurophysiology 75: 1843-1857.
49. Mishra, J., A. Martinez, T. J. Sejnowski, and S. A. Hillyard. 2007. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. Journal of Neuroscience 27: 4120-4131.
50. Mishra, J., A. Martinez, and S. A. Hillyard. 2010. Effect of attention on early cortical processes associated with the sound-induced extra flash illusion. Journal of Cognitive Neuroscience 22: 1714-1729.
51. Pashler, H. E. 1998. The psychology of attention. Cambridge, MA: MIT Press.
52. Posner, M. I. 1978. Chronometric explorations of mind. Hillsdale, NJ: Lawrence Erlbaum.
53. Posner, M. I., Y. Cohen, and R. D. Rafal. 1982. Neural systems control of spatial orienting. Philosophical Transactions of the Royal Society of London Series B-Biological Sciences 298: 187-198.
54. Posner, M. I., and M. E. Raichle 1994. Images of mind. New York: W. H. Freeman.
55. Posner, M. I., J. A. Walker, F. J. Friedrich, and R. D. Rafal. 1984. Effects of parietal injury on covert orienting of attention. Journal of Neuroscience 4: 1863-1874.
56. Prime, D. J., J. J. McDonald, J. Green, and L. M. Ward. 2008. When cross-modal spatial attention fails. Canadian Journal of Experimental Psychology 62: 192-197.
57. Prinzmetal, W., V. Long, and J. Leonhardt. 2008. Involuntary attention and brightness contrast. Perception & Psychophysics 70: 1139-1150.
58. Prinzmetal, W., C. McCool, and S. Park. 2005. Attention: Reaction time and accuracy reveal different mecha-nisms. Journal of Experimental Psychology: General 134: 73-92.
59. Rhodes, G. 1987. Auditory attention and the representation of spatial information. Perception & Psychophysics 42: 1-14.
60. Santangelo, V., and C. Spence. 2008. Crossmodal attentional capture in an unspeeded simultaneity judgement task. Visual Cognition 16: 155-165.
61. Schneider, K. A., and D. Bavelier. 2003. Components of visual prior entry. Cognitive Psychology 47: 333-366.
62. Schneider, K. A., and M. Komlos. 2008. Attention biases decisions but does not alter appearance. Journal of Vision 8: 1-10.
63. Schroeder, C. E., and J. Foxe. 2005. Multisensory contributions to low-level, 'unisensory" processing. Current Opinion in Neurobiology 15: 454-458.
64. Shaw, M. L. 1982. Attending to multiple sources of information: 1.The integration of information in decision-making. Cognitive Psychology 14: 353-409.
65. Shaw, M. L. 1984. Division of attention among spatial locations: A fundamental difference between detection of letters and detection of luminance increments. In Attention and Performance X, ed. H. Bouma and D. G. Bouwhui, 109-121. Hillsdale, NJ: Erlbaum.
66. Shimojo, S., S. Miyauchi, and O. Hikosaka. 1997. Visual motion sensation yielded by non-visually driven attention. Vision Research 37: 1575-1580.
67. Shiu, L. P., and H. Pashler. 1994. Negligible effect of spatial precueing on identification of single digits. Journal of Experimental Psychology: Human Perception and Performance 20: 1037-1054.
68. Shore, D. I., C. Spence, and R. M. Klein. 2001. Visual prior entry. Psychological Science 12: 205-212.
69. Smith, P. L. 2000. Attention and luminance detection: Effects of cues, masks, and pedestals. Journal of Experimental Psychology: Human Perception and Performance 26: 1401-1420.
70. Smith, P. L., and R. Ratcliff. 2009. An integrated theory of attention and decision making in visual signal detec-tion. Psychological Review 116: 283-317.
71. Soto-Faraco, S., J. McDonald, and A. Kingstone. 2002. Gaze direction: Effects on attentional orienting and crossmodal target responses. Poster presented at the annual meeting of the Cognitive Neuroscience Society, San Francisco, CA.
72. Spence, C. J., and J. Driver. 1994. Covert spatial orienting in audition-exogenous and endogenous mecha-nisms. Journal of Experimental Psychology: Human Perception and Performance 20: 555-574.
73. Spence, C., and J. Driver. 1997. Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics 59: 1-22.
74. Spence, C., and J. J. McDonald. 2004. The crossmodal consequences of the exogenous spatial orienting of attention. In The handbook of multisensory processing, ed. G. A. Calvert, C. Spence, and B. E. Stein, 3-25. Cambridge, MA: MIT Press.
75. Spence, C., J. J. McDonald, and J. Driver. 2004. Exogenous spatial cuing studies of human crossmodal atten-tion and multisensory integration. In Crossmodal space and crossmodal attention, ed. C. Spence and J. Driver, 277-320. Oxford: Oxford Univ. Press.
76. Sperling, G., and B. A. Dosher. 1986. Strategy and optimization in human information processing. In Handbook of Perception and Human Performance, ed. K. R. Boff, L. Kaufman, and J. P. Thomas, 1-65. New York: Wiley.
77. Stein, B. E., and M. A. Meredith 1993. The merging of the senses. Cambridge, MA: MIT Press.
78. Stein, B. E., T. R. Stanford, R. Ramachandran, T. J. Perrault, and B. A. Rowland. 2009. Challenges in quantify-ing multisensory integration: Alternative criteria, models, and inverse effectiveness. Experimental Brain Research 198: 113-126.
79. Stelmach, L. B., and C. M. Herdman. 1991. Directed attention and perception of temporal-order. Journal of Experimental Psychology: Human Perception and Performance 17: 539-550.
80. Stevens, H. C. 1904. A simple complication pendulum for qualitative work. American Journal of Psychology 15: 581.
81. Stone, J. V., N. M. Hunkin, J. Porrill et al. 2001. When is now? Perception of simultaneity. Proceedings of the Royal Society of London Series B: Biological Sciences 268: 31-38.
82. Störmer, V. S., J. J. McDonald, and S. A. Hillyard. 2009. Cross-modal cueing of attention alters appearance and early cortical processing of visual stimuli. PNAS 106: 22456-22461.
83. Talsma, D., and M. G. Woldorff. 2005. Selective attention and multisensory integration: Multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience 17: 1098-1114.
84. Tassinari, G., S. Aglioti, L. Chelazzi, A. Peru, and G. Berlucchi. 1994. Do peripheral non-informative cues induce early facilitation of target detection. Vision Research 34: 179-189.
85. Teder-Sälejärvi, W. A., T. F. Münte, F. J. Sperlich, and S. A. Hillyard. 1999. Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An event-related brain potential study. Cognitive Brain Research 8: 327-343.
86. Titchener, E. N. 1908. Lectures on the elementary psychology of feeling and attention. New York: The MacMillan Company.
87. Treisman, A., and G. Geffen. 1967. Selective attention: Perception or response? Quarterly Journal of Experimental Psychology 19: 1-18.
88. Vibell, J., C. Klinge, M. Zampini, C. Spence, and A. C. Nobre. 2007. Temporal order is coded temporally in the brain: Early event-related potential latency shifts underlying prior entry in a cross-modal temporal order judgment task. Journal of Cognitive Neuroscience 19: 109-120.
89. Ward, L. M., J. J. McDonald, and N. Golestani. 1998. Cross-modal control of attention shifts. In Visual atten-tion, ed. R. D. Wright, 232-268. New York: Oxford Univ. Press.
90. Ward, L. M., J. J. McDonald, and D. Lin. 2000. On asymmetries in cross-modal spatial attention orienting. Perception & Psychophysics 62: 1258-1264.
91. Watt, R. J. 1991. Understanding vision. San Diego, CA: Academic Press.
92. Worden, M. S., J. J. Foxe, N. Wang, and G. V. Simpson. 2000. Anticipatory biasing of visuospatial attention indexed by retinotopically specific-band electroencephalography increases over occipital cortex. Journal of Neuroscience 20 (RC63): 1-6.
93. Wright, R. D., and L. M. Ward. 2008. Orienting of attention. New York: Oxford Univ. Press.
94. Wundt, W. 1874. Grundzüge der physiologischen psychologies [Foundations of physiological psychology]. Leipzig, Germany: Wilhelm Engelmann.