Cross-modal cueing in audiovisual spatial attention

Attention, Perception, and Psychophysics

Volumn 77, Issue 7, 2015, Pages 2356-2376

  Blurton, Steven P ^a,b   Greenlee, Mark W ^a   Gondan, Matthias ^b  

^a UNIVERSITY OF REGENSBURG   (Germany)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Attention; Math modeling; Multisensory processes; Space based

Indexed keywords

ADULT; ASSOCIATION; ATTENTION; FEMALE; HEARING; HUMAN; PHYSIOLOGY; REACTION TIME; VISION; YOUNG ADULT;

ADULT; ATTENTION; AUDITORY PERCEPTION; CUES; FEMALE; HUMANS; REACTION TIME; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84944351591     PISSN: 19433921     EISSN: 1943393X     Source Type: Journal    
DOI: 10.3758/s13414-015-0920-7     Document Type: Article

References (68)

1. Awh, E., Belopolsky, A. V., & Theeuwes, J. (2012). Top-down versus bottom-up attentional control: a failed theoretical dichotomy. Trends in Cognitive Sciences, 16, 437–443.
2. Bashinski, H. S., & Bacharach, V. R. (1980). Enhancement of perceptual selectivity as the result of selectively attending to spatial locations. Perception & Psychophysics, 28, 241–248.
3. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B, 57, 289–300.
4. Bertelson, P., Vroomen, J., de Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62, 321–332.
5. Blurton, S. P., Greenlee, M. W., & Gondan, M. (2014). Multisensory processing of redundant information in go/no-go and choice responses. Attention, Perception, & Psychophysics, 76, 1212–1233.
6. Buchtel, H. A., & Butter, C. M. (1988). Spatial attention shifts: implications for the role of polysensory mechanisms. Neuropsychologia, 26, 499–509.
7. Carrasco, M., Penpeci-Talgar, C., & Eckstein, M. (2000). Spatial covert attention increases contrast sensitivity across the CSF: support for signal enhancement. Vision Research, 40, 1203–1215.
8. Carrasco, M., Ling, S., & Read, S. (2004). Attention alters appearance. Nature Neuroscience, 7, 308–313.
9. Dosher, B. A., & Lu, Z.-L. (2000). Noise exclusion in spatial attention. Psychological Science, 11, 139–146.
10. Diederich, A. (1995). Intersensory facilitation of reaction time: evaluation of counter and diffusion coactivation models. Journal of Mathematical Psychology, 39, 197–215.
11. Diederich, A., & Colonius, H. (1987). Intersensory facilitation in the motor component? Psychological Research, 49, 23–29.
12. Driver, J., & Spence, C. (1998). Attention and the cross-modal construction of space. Trends in Cognitive Sciences, 2, 254–262.
13. Eimer, M. (2001). Crossmodal links in spatial attention between vision, audition and touch: evidence from event-related brain potentials. Neuropsychologia, 39, 1292–1303.
14. Eimer, M., & Schröger, E. (1998). ERP effects of intermodal attention and cross-modal links in spatial attention. Psychophysiology, 35, 313–327.
15. Eriksen, C. W. (1988). A source of error in attempts to distinguish coactivation from separate activation in the perception of redundant targets. Perception & Psychophysics, 44, 191–193.
16. Fairhall, S. L., & Macaluso, E. (2009). Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites. European Journal of Neuroscience, 29, 1247–1257.
17. Farah, M. J., Wong, A. B., Monheit, M. A., & Morrow, L. M. (1989). Parietal lobe mechanisms of spatial attention: modality specific or supramodal? Neuropsychologia, 27, 461–470.
18. Feintuch, U., & Cohen, A. (2002). Visual attention and coactivation of response decisions for freatures from different dimensions. Psychological Science, 13, 361–369.
19. Gondan, M. (2009). Testing the race model inequality in redundant stimuli with variable onset asychrony. Journal of Experimental Psychology: Human Perception and Performance, 35, 575–579.
20. Gondan, M. (2010). A permutation test for the race model inequality. Behavior Research Methods, 42, 23–28.
21. Gondan, M., Blurton, S. P., Hughes, F., & Greenlee, M. W. (2011). Effects of spatial and selective attention on basic multisensory integration. Journal of Experimental Psychology: Human Perception and Performance, 37, 1887–1897.
22. Gondan, M., & Fimm, B. (2013). Simple correction methods for task completion times contaminated by errors, outliers and omissions. Paper presented at the annual meeting of the Society of Mathematical Psychology, Potsdam, Germany.
23. Gondan, M., Götze, C., & Greenlee, M. W. (2010). Redundancy gains in simple responses and go/no-go tasks. Attention, Perception, & Psychophysics, 72, 1692–1709.
24. Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York, NY: Wiley.
25. Hershenson, M. (1962). Reaction time as a measure of intersensory facilitation. Journal of Experimental Psychology, 63, 289–293.
26. Jonides, J. (1981). Voluntary vs. automatic control over the mind’s eye’s movement. In J. Long & A. Baddeley (Eds.), Attention and performance IX (pp. 187–203). Hillsdale, NJ: Erlbaum Associates Inc.
27. Kalbfleisch, J. D., & Prentice, R. L. (2002). The statistical analysis of failure time data. New York: Wiley.
28. Kiesel, A., Miller, J., & Ulrich, R. (2007). Systematic biases and Type I error accumulation in tests of the race model inequality. Behavior Research Methods, 39, 539–551.
29. Koch, S. H., Weir, C., Westenskow, D., Gondan, M., Agutter, J., Haar, M.,⋯Staggers, N. (2013). Evaluation of the effect of information integration in displays for ICU nurses on situation awareness and task completion time: A prospective randomized controlled study. International Journal of Medical Informatics, 82, 665–675.
30. Koelewijn, T., Bronkhorst, A., & Theeuwes, J. (2010). Attention and the multiple stages of multisensory integration: A review of audiovisual studies. Acta Psychologica, 134, 372–384.
31. Kristjánsson, Á., & Nakayama, K. (2003). A primitive memory system for the deployment of transient attention. Perception & Psychophysics, 65, 711–724.
32. Lansman, M., Farr, S., & Hunt, E. (1984). Expectancy and dual-task interference. Journal of Experimental Psychology: Human Perception and Performance, 10, 195–204.
33. Liu, T., Fuller, S., & Carrasco, M. (2006). Attention alters the appearance of motion coherence. Psychonomic Bulletin & Review, 13, 1091–1096.
34. Lu, Z.-L., & Dosher, B. A. (1998). External noise distinguishes attention mechanisms. Vision Research, 38, 1183–1198.
35. Luce, R. D. (1986). Response times. Their role in inferring mental organization. New York: Oxford University Press.
36. McDonald, J. J., Teder-Sälejärvi, W. A., Heraldez, D., & Hillyard, S. A. (2001). Electrophysiological evidence for the missing link in crossmodal attention. Canadian Journal of Experimental Psychology, 55, 141–149.
37. Miller, J. (1982). Divided attention: Evidence for coactivation with redundant signals. Cognitive Psychology, 14, 247–279.
38. Miller, J. (1986). Timecourse of coactivation in bimodal divided attention. Perception & Psychophysics, 40, 331–343.
39. Miller, J., Beutinger, D., & Ulrich, R. (2009). Visuospatial attention and redundancy gain. Psychological Research, 73, 254–262.
40. Mordkoff, J. T., & Danek, R. H. (2011). Dividing attention between color and shape revisited: redundant targets coactivate only when parts of the same perceptual object. Attention, Perception, & Psychophysics, 73, 103–112.
41. Mordkoff, T., & Yantis, S. (1993). Dividing attention between color and shape: Evidence for coactivation. Perception & Psychophysics, 53, 357–366.
42. Müller, H. J., & Rabbitt, P. M. A. (1989). Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption. Journal of Experimental Psychology: Human Perception and Performance, 15, 315–330.
43. Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32, 3–25.
44. Posner, M. I., & Cohen, Y. (1984). Components of visual orienting. In H. Bouma & D. Bouwhuis (Eds.), Attention and performance X (pp. 531–556). London: Lawrence Earlbaum Associates Ltd.
45. Posner, M. I., Nissen, M. J., & Ogden, W. C. (1978). Attended and unattended processing modes: The role of set for spatial location. In H. L. Pick (Ed.), Modes of perceiving and processing information (pp. 137–157). New York, NY: Wiley.
46. Posner, M. I., Snyder, C. R. R., & Davidson, B. J. (1980). Attention and the detection of signals. Journal of Experimental Psychology: General, 109, 160–174.
47. Posner, M. I., Inhoff, A. W., Friedrich, F. J., & Cohen, A. (1987). Isolating attentional systems: a cognitive-anatomical analysis. Psychobiology, 15, 107–121.
48. Prime, D. J., McDonald, J. J., Green, J., & Ward, L. M. (2008). When cross-modal attention fails. Canadian Journal of Experimental Psychology, 62, 192–197.
49. Raab, D. H. (1962). Statistical facilitation of simple reaction times. Transactions of the New York Academy of Sciences, 24, 574–590.
50. Schröter, H., Ulrich, R., & Miller, J. (2007). Effects of redundant auditory stimuli on reaction time. Psychonomic Bulletin & Review, 14, 39–44.
51. Schwarz, W. (1994). Diffusion, superposition, and the redundant targets effect. Journal of Mathematical Psychology, 38, 504–520.
52. Schwarz, W. (2006). On the relationship between the redundant signals effect and temporal order judgments: parametric data and a new model. Journal of Experimental Psychology: Human Perception and Performance, 32, 558–573.
53. Spence, C., & Driver, J. (1994). Covert spatial orienting in audition: Exogenous and endogenous mechanisms facilitate sound localization. Journal of Experimental Psychology: Human Perception and Performance, 20, 555–574.
54. Spence, C., & Driver, J. (1996). Audiovisual links in endogenous covert spatial attention. Journal of Experimental Psychology: Human Perception and Performance, 22, 1005–1030.
55. Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59, 1–22.
56. Spence, C., McDonald, J., & Driver, J. (2004). Exogenous spatial cueing studies of human crossmodal attention and multisensory integration. In C. Spence & J. Driver (Eds.), Crossmodal space and crossmodal attention. New York, NY: Oxford University Press.
57. Talsma, D., & Kok, A. (2002). Intermodal spatial attention differs between vision and audition: an event-related potential analysis. Psychophysiology, 39, 689–706.
58. Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends in Cognitive Science, 14, 400–410.
59. Talsma, D., & Woldorff, M. G. (2005). Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience, 17, 1098–1114.
60. Theeuewes, J. (1991). Exogenous and endogenous control of attention: The effect of visual onsets and offsets. Perception & Psychophysics, 49, 83–90.
61. Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008). Pip and pop: nonspatial auditory signals improve visual search. Journal of Experimental Psychology: Human Perception and Performance, 34, 1053–1065.
62. Vroomen, J., Bertelson, P., & de Gelder, B. (2001). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception & Psychophysics, 63, 651–659.
63. Wagenmakers, E.-J., van der Maas, H. L. J., & Grasman, R. P. P. P. (2007). An EZ-diffusion model for response time and accuracy. Psychonomic Bulletin & Review, 14, 3–22.
64. Ward, L. M. (1994). Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention. Canadian Journal of Experimental Psychology, 48, 242–259.
65. Ward, L. M., McDonald, J. J., & Lin, D. (2000). On asymmetries in cross-modal spatial attention orienting. Perception & Psychophysics, 62, 1258–1264.
66. Welch, R. B., & Warren, D. H. (1986). Intersensory interactions. In K. R. Boff, L. Kaufman, & J. P. Thomas (Eds.), Handbook of perception and human performance (pp. 25/1–25/36). New York: Wiley.
67. Yantis, S., & Jonides, J. (1984). Abrupt visual onsets and selective attention: evidence from visual search. Journal of Experimental Psychology: Human Perception and Performance, 10, 601–621.
68. Zou, H., Müller, H. J., & Shi, Z. (2012). Non-spatial sounds regulate eye movements and enhance visual search. Journal of Vision, 12, 1–18.