Sound speeds vision through preparation, not integration

Journal of Experimental Psychology: Human Perception and Performance

Volumn 39, Issue 6, 2013, Pages 1612-1624

  Los, Sander A ^a   Van der Burg, Erik ^b  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Intersensory facilitation; Multisensory integration; Temporal preparation

Indexed keywords

ADULT; ARTICLE; FEMALE; HEARING; HUMAN; MALE; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; TIME; VISION;

ADULT; AUDITORY PERCEPTION; FEMALE; HUMANS; MALE; MODELS, PSYCHOLOGICAL; PSYCHOMOTOR PERFORMANCE; TIME FACTORS; VISUAL PERCEPTION;

EID: 84878962894     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0032183     Document Type: Article

References (87)

1. Alais, D., & Burr, D. (2004). The ventriloquist effect results from nearoptimal bimodal integration. Current Biology, 14, 257-262.
2. Bell, A. H., Meredith, M. A., Van Opstal, A. J., & Munoz, D. P. (2006). Stimulus intensity modifies saccadic reaction time and visual response latency in the superior colliculus. Experimental Brain Research, 174, 53-59. doi:10.1007/s00221-006-0420-z
3. Bernstein, I. H. (1970). Can we see and hear at the same time? Acta Psychologica, Amsterdam, 33, 21-35. doi:10.1016/0001- 6918(70)90119-8
4. Bernstein, I. H., Clark, M. H., & Edelstein, B. A. (1969). Intermodal effects in choice reaction time. Journal of Experimental Psychology, 81, 405- 407. doi:10.1037/h0027750
5. Bernstein, I. H., Rose, R., & Ashe, V. M. (1970). Energy integration in intersensory facilitation. Journal of Experimental Psychology, 86, 196- 203. doi:10.1037/h0029958
6. Bertelson, P., & Aschersleben, G. (1998). Automatic visual bias of perceived auditory location. Psychonomic Bulletin & Review, 5, 482-489. doi:10.3758/BF03208826
7. Bertelson, P., & Tisseyre, F. (1969). The time course of preparation: Confirmatory results with visual and auditory warning signals. Acta Psychologica, Amsterdam, 30, 145-154. doi:10.1016/0001- 6918(69)90047-X
8. Colonius, H., & Diederich, A. (2004). Multisensory interaction in saccadic reaction time: A time-window-of-integration model. Journal of Cognitive Neuroscience, 16, 1000-1009. doi:10.1162/0898929041502733
9. Colonius, H., & Diederich, A. (2011). Computing an optimal time window of audiovisual integration in focused attention tasks: Illustrated by studies on effect of age and prior knowledge. Experimental Brain Research, 212, 327-337. doi:10.1007/s00221-011-2732-x
10. Colonius, H., & Diederich, A. (2012). Intersensensory facilitation. In N. M. Seel (Ed.), Encyclopedia of the sciences of learning (pp. 1635-1638). New York, NY: Springer-Verlag.
11. Diederich, A., & Colonius, H. (2008). Crossmodal interaction in saccadic reaction time: Separating multisensory from warning effects in the time window of integration model. Experimental Brain Research, 186, 1-22. doi:10.1007/s00221-007-1197-4
12. Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002). Anatomical evidence of multimodal integration in primate striate cortex. Journal of Neuroscience, 22, 5749-5759.
13. Foxe, J. J., & Schroeder, C. E. (2005). The case for feedforward multisensory convergence during early cortical processing. Neuroreport: For Rapid Communication in Neuroscience Research, 16, 419-423. doi: 10.1097/00001756-200504040-00001
14. Frith, C. D., & Done, D. J. (1986). Routes to action in reaction-time tasks. Psychological Research, 48, 169-177. doi:10.1007/BF00309165
15. Giard, M. H., & Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11, 473-490. doi: 10.1162/089892999563544
16. Hackley, S. A., Langner, R., Rolke, B., Erb, M., Grodd, W., & Ulrich, R. (2009). Separation of phasic arousal and expectancy effects in a speeded reaction time task via fMRI. Psychophysiology, 46, 163-171. doi: 10.1111/j.1469-8986.2008.00722.x
17. Hackley, S. A., Schankin, A., Wohlschlaeger, A., & Wascher, E. (2007). Localization of temporal preparation effects via trisected reaction time. Psychophysiology, 44, 334-338. doi:10.1111/j.1469-8986.2007.00500.x
18. Hackley, S. A., & Valle-Inclán, F. (1998). Automatic alerting does not speed late motoric processes in a reaction-time task. Nature, 391, 786- 788.
19. Hackley, S. A., & Valle-Inclán, F. (1999). Accessory stimulus effects on response selection: Does arousal speed decision making? Journal of Cognitive Neuroscience, 11, 321-329. doi:10.1162/089892999563427
20. Hershenson, M. (1962). Reaction time as a measure of intersensory facilitation. Journal of Experimental Psychology, 63, 289-293. doi:10.1037/ h0039516
21. Hughes, H. C., Reuter-Lorenz, P. A., Nozawa, G., & Fendrich, R. (1994). Visual-auditory interactions in sensorymotor processing: Saccades versus manual responses. Journal of Experimental Psychology: Human Perception and Performance, 20, 131-153. doi:10.1037/0096-1523.20 .1.131
22. Jaffard, M., Benraiss, A., Longcamp, M., Velay, J.-L., & Boulinquez, P. (2007). Cueing method biases in visual detection studies. Brain Research, 1179, 106-118. doi:10.1016/j.brainres.2007.08.032
23. Janssen, P., & Shadlen, M. N. (2005). A representation of the hazard rate of elapsed time in macaque area LIP. Nature Neuroscience, 8, 234-241. doi:10.1038/nn1386
24. Jepma, M., Wagenmakers, E.-J., Band, G. P. H., & Nieuwenhuis, S. (2009). The effects of accessory stimuli on information processing: Evidence from electrophysiology and a diffusion-model analysis. Journal of Cognitive Neuroscience, 21, 847-864. doi:10.1162/jocn.2009 .21063
25. Jonides, J., & Mack, R. (1984). On the cost and benefit of cost and benefit. Psychological Bulletin, 96, 29-44. doi:10.1037/0033-2909.96.1.29
26. Keetels, M., & Vroomen, J. (2011). Sound affects the speed of visual processing. Journal of Experimental Psychology: Human Perception and Performance, 37, 699-708. doi:10.1037/a0020564
27. Klemmer, E. T. (1957). Simple reaction time as a function of time uncertainty. Journal of Experimental Psychology, 54, 195-200. doi:10.1037/ h0046227
28. Lennie, P. (1981). The physiological basis of variations in visual latency. Vision Research, 21, 815-824. doi:10.1016/0042-6989(81)90180-2
29. Leonhard, T., Bratzke, D., Schröter, H., & Ulrich, R. (2012). Time-course analysis of temporal preparation on central processes. Psychological Research, 76, 236-251. doi:10.1007/s00426-011-0364-1
30. Los, S. A. (2010). Foreperiod and the sequential effect: Theory and data. In A. C. Nobre & J. T. Coull (Eds.), Attention and time (pp. 289-302). Oxford, United Kingdom: Oxford University Press. doi:10.1093/acprof: oso/9780199563456.003.0021
31. Los, S. A., & Heslenfeld, D. J. (2005). Intentional and unintentional contributions to nonspecific preparation: Electrophysiological evidence. Journal of Experimental Psychology: General, 134, 52-72. doi:10.1037/ 0096-3445.134.1.52
32. Los, S. A., & Schut, M. L. J. (2008). The effective time course of preparation. Cognitive Psychology, 57, 20-55. doi:10.1016/j.cogpsych .2007.11.001
33. Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
34. McClelland, J. L. (1979). On the time relations of mental processes: An examination of systems of processes in cascade. Psychological Review, 86, 287-330. doi:10.1037/0033-295X.86.4.287
35. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748. doi:10.1038/264746a0
36. Meredith, M. A., & Stein, B. E. (1983). Interactions among converging sensory inputs in the superior colliculus. Science, 221, 389-391. doi: 10.1126/science.6867718
37. Meredith, M. A., & Stein, B. E. (1986). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56, 640-662.
38. Meyer, D. E., Osman, A. M., Irwin, D. E., & Yantis, S. (1988). Modern mental chronometry. Biological Psychology, 26, 3-67. doi:10.1016/ 0301-0511(88)90013-0
39. Miller, J. (1982). Divided attention: Evidence for coactivation with redundant signals. Cognitive Psychology, 14, 247-279. doi:10.1016/0010- 0285(82)90010-X
40. Miller, J. (1988). Discrete and continuous models of information processing: Theoretical distinctions and empirical results. Acta Psychologica, 67, 191-257. doi:10.1016/0001-6918(88)90013-3
41. Miller, J. (2004). Exaggerated redundancy gain in the split brain: A hemispheric coactivation account. Cognitive Psychology, 49, 118-154. doi:10.1016/j.cogpsych.2003.12.003
42. Miller, J., & Ulrich, R. (2003). Simple reaction time and statistical facilitation: A parallel grains model. Cognitive Psychology, 46, 101-151. doi:10.1016/S0010-0285(02)00517-0
43. Miller, J., Ulrich, R., & Rinkenauer, G. (1999). Effects of stimulus intensity on the lateralized readiness potential. Journal of Experimental Psychology: Human Perception and Performance, 25, 1454-1471. doi: 10.1037/0096-1523.25.5.1454
44. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cognitive Brain Research, 14, 115-128. doi:10.1016/S0926- 6410(02)00066-6
45. Mordkoff, J. T., & Yantis, S. (1991). An interactive race model of devided attention. Journal of Experimental Psychology: Human Perception and Performance, 17, 520-538. doi:10.1037/0096-1523.17.2.520
46. Morein-Zamir, S., Soto-Faraco, S., & Kingstone, A.(2003). Auditory capture of vision: Examining temporal ventriloquism. Cognitive Brain Research, 17, 154-163. doi:10.1016/S0926-6410(03)00089-2
47. Morrell, L. K. (1967). Intersensory facilitation of reaction time. Psychonomic Science, 8, 77-78.
48. Morrell, L. K. (1968a). Cross-modality effects upon choice reaction time. Psychonomic Science, 11, 129-130.
49. Morrell, L. K. (1968b). Temporal characteristics of sensory interaction in choice reaction times. Journal of Experimental Psychology, 77, 14-18. doi:10.1037/h0021289
50. Müller-Gethmann, H., Ulrich, R., & Rinkenauer, G. (2003). Locus of the effect of temporal preparation: Evidence from the lateralized readiness potential. Psychophysiology, 40, 597- 611. doi:10.1111/1469-8986 .00061
51. Nickerson, R. S. (1970). The effect of preceding and following auditory stimuli on response times to visual stimuli. Acta Psychologica, Amsterdam, 33, 5-20. doi:10.1016/0001-6918(70)90118-6
52. Nickerson, R. S. (1973). Intersensory facilitation of reaction time: Energy summation or preparation enhancement? Psychological Review, 80, 489-509. doi:10.1037/h0035437
53. Niemi, P., & Näätänen, R. (1981). Foreperiod and simple reaction time. Psychological Bulletin, 89, 133-162. doi:10.1037/0033-2909.89.1.133
54. Otto, T. U., & Mamassian, P. (2012). Noise and correlations in parallel perceptual decision making. Current Biology, 22, 1391-1396. doi: 10.1016/j.cub.2012.05.031
55. Posner, M. I. (1978). Chronometric explorations of mind. Hillsdale NJ: Erlbaum.
56. Posner, M. I., Nissen, M. J., & Klein, R. M. (1976). Visual dominance: An information processing account of its origins and significance. Psychological Review, 83, 157-171. doi:10.1037/0033-295X.83.2.157
57. Raab, D. H. (1962). Statistical facilitation of simple reaction times. Transactions of the New York Academy of Sciences, 24, 574-590. doi: 10.1111/j.2164-0947.1962.tb01433.x
58. Rodway, P. (2005). The modality shift effect and the effectiveness of warning signals in different modalities. Acta Psychologica, 120, 199- 226. doi:10.1016/j.actpsy.2005.05.002
59. Rolke, B., & Hofmann, P. (2007). Temporal uncertainty degrades perceptual processing. Psychonomic Bulletin & Review, 14, 522-526. doi: 10.3758/BF03194101
60. Rolke, B., & Ulrich, R. (2010). On the locus of temporal preparation: Enhancement of premotor processes? In A. C. Nobre & J. T. Coull (Eds.), Attention and Time (pp. 227-242). Oxford, United Kingdom: Oxford University Press. doi:10.1093/acprof:oso/9780199563456.003 .0017
61. Sanders, A. F. (1977). Structural and functional aspects of the reaction process. In S. Dornic (Ed.), Attention and performance VI (pp. 3-25). Hillsdale, NJ: Erlbaum.
62. Sanders, A. F. (1990). Issues and trends in the debate on discrete vs. continuous processing of information. Acta Psychologica, 74, 123-167. doi:10.1016/0001-6918(90)90004-Y
63. Schmidt, R. A., Gielen, S. C. A. M., & Van den Heuvel, P. J. M. (1984). The locus of intersensory facilitation of reaction time. Acta Psychologica, 57, 145-164. doi:10.1016/0001-6918(84)90040-4
64. Schweickert, R., Dahn, C., & McGuigan, K. (1988). Intensity and number of alternatives in hue identification: Piéron's law and choice reaction time. Perception and Psychophysics, 44(4), 383-389. doi:10.3758/ BF03210422
65. Seibold, V. C., Bausenhart, K. M., Rolke, B., & Ulrich, R. (2011). Does temporal preparation increase the rate of sensory information accumulation?. Acta Psychologica, 137, 56-64. doi:10.1016/j.actpsy.2011.02 .006
66. Senkowski, D., Saint-Amour, D., Höfle, M., & Foxe, J. J. (2011). Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness. NeuroImage, 56, 2200 -2208. doi:10.1016/j .neuroimage.2011.03.075
67. Slutsky, D. A., & Recanzone, G. H. (2001). Temporal and spatial dependency of the ventriloquism effect. NeuroReport: For Rapid Communication of Neuroscience Research, 12, 7-10. doi:10.1097/00001756- 200101220-00009
68. Spence, C., & Driver, J. (1997). On measuring selective attention to an unexpected sensory modality. Perception & Psychophysics, 59, 389- 403. doi:10.3758/BF03211906
69. Stahl, J., & Rammsayer, T. H. (2005). Accessory stimulation in the time course of visuomotor information processing: Stimulus intensity effects on reaction time and response force. Acta Psychologica, 120, 1-18. doi:10.1016/j.actpsy.2005.02.003
70. Stein, B. E., Burr, D., Constantinidis, C., Laurienti, P. J., Meredith, M. A., Perrault Jr., T. J., . . . Lewkowicz, D. J. (2010). Semantic confusion regarding the development of multisensory integration: A practical solution. European Journal of Neuroscience, 31, 1713-1720. doi:10.1111/ j.1460-9568.2010.07206.x
71. Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge, MA: MIT Press.
72. Stein, B. E., & Stanford, T. R. (2008). Multisensory integration: Current issues from the perspective of a single neuron. Nature Reviews Neuroscience, 9, 255-266. doi:10.1038/nrn2331
73. Sternberg, S. (1969). The discovery of processing stages: Extensions of Donders' method. Acta Psychologica, Amsterdam, 30, 276-315. doi: 10.1016/0001-6918(69)90055-9
74. Sternberg, S. (2011). Modular processes in mind and brain. Cognitive Neuropsychology, 28, 156-208. doi:10.1080/02643294.2011.557231
75. Sumby, W., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212- 215. doi:10.1121/1.1907309
76. Talsma, D., Doty, T. J., & Woldorff, M. G. (2007). Selective attention and audiovisual integration: Is attending to both modalities a prerequisite for early integration? Cerebral Cortex, 17, 679-790.
77. Theeuwes, J. (2010). Top-down and bottom-up control of visual selection. Acta Psychologica, 135, 77-99. doi:10.1016/j.actpsy.2010.02.006
78. Todd, J. W. (1912). Reaction time to multiple stimuli. Archives of Psychology, 3, 1-65.
79. Turatto, M., Benso, F., Galfano, G., & Umiltà, C. (2002). Nonspatial attention shifts between audition and vision. Journal of Experimental Psychology: Human Perception and Performance, 28, 628-639. doi: 10.1037/0096-1523.28.3.628
80. Van der Burg, E., Awh, E., & Olivers, C. N. L. (2013). The capacity of audiovisual integration is limited to one item. Psychological Science. Advance online publication. doi:10.1177/0956797612452865
81. Van der Burg, E., Cass, J., Olivers, C. N. L., Theeuwes, J., & Alais, D. (2010). Efficient visual search from synchronized auditory signals requires transient audiovisual events. PLoS One, 5, e10664. doi:10.1371/ journal.pone.0010664
82. Van der Burg, E., Olivers, C. N. L., Bronkhorst, A., & Theeuwes, J. (2008). Pip and pop: Non-spatial auditory signals improve spatial visual search. Journal of Experimental Psychology: Human Perception and Performance, 34, 1053-1065. doi:10.1037/0096-1523.34.5.1053
83. Vangkilde, S., Coull, J. T., & Bundesen, C. (2012). Great expectations: Temporal expectation modulates perceptual processing speed. Journal of Experimental Psychology: Human Perception and Performance, 38, 1183-1191. doi:10.1037/a0026343
84. Vroomen, J., & Keetels, M. (2006). The spatial constraint in intersensory pairing: No role in temporal ventriloquism. Journal of Experimental Psychology: Human Perception and Performance, 32, 1063-1071. doi: 10.1037/0096-1523.32.4.1063
85. Welch, R. B., & Warren, D. H. (1986). Intersensory interactions. In K. R. Boff, L. Kaufman & J. P. Thomans (Eds.), Handbook of perception and human performance (Vol. 1, pp. 25.21-25.36). New York, NY: Wiley.
86. Wilschut, A., Theeuwes, J., & Olivers, C. N. L. (2011). The time course of attention: Selection is transient. PLoS One, 6, e27661. doi:10.1371/ journal.pone.0027661
87. Woodman, G. F., Kang, M.-S., Thompson, K., & Schall, J. D. (2008). The effect of visual search efficiency on response preparation. Psychological Science, 19, 128-136. doi:10.1111/j.1467-9280.2008.02058.x