Auditory stimulus timing influences perceived duration of co-occurring visual stimuli

Frontiers in Psychology

Volumn 2, Issue SEP, 2011, Pages

  Romei, Vincenzo ^a,b   De Haas, Benjamin ^a,b   Mok, Robert M ^b,c   Driver, Jon ^a,b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Audition; Crossmodal interactions; Multisensory integration; Response bias; Signal detection theory; Time perception; Vision

Indexed keywords

EID: 84857709989     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2011.00215     Document Type: Article

References (77)

1. Aaen-Stockdale, C., Hotchkiss, J., Heron, J., and Whitaker, D. (2011). Perceived time is spatial frequency dependent. Vision Res. 51, 1232-1238.
2. Alais, D., and Burr, D. (2004). The ventriloquist effect results from nearoptimal bimodal integration. Curr. Biol. 14, 257-262.
3. Berger, T. D., Martelli, M., and Pelli, D. G. (2003). Flicker flutter: is an illusory event as good as the real thing? J. Vis. 3, 406-412.
4. Bertelson, P., and Aschersleben, G. (2003). Temporal ventriloquism: crossmodal interaction on the time dimension: 1. evidence from auditory - visual temporal order judgment. Int. J. Psychophysiol. 50, 147-155.
5. Bertelson, P., and Radeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept. Psychophys. 29, 578-584.
6. Bertelson, P., Vroomen, J., de Gelder, B., and Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Percept. Psychophys. 62, 321-332.
7. Bolognini, N., and Maravita, A. (2011). Uncovering multisensory processing through non-invasive brain stimulation. Front. Psychol. 2:46. doi: 10.3389/fpsyg.2011.00046.
8. Bolognini, N., Senna, I., Maravita, A., Pascual-Leone, A., and Merabet, L. B. (2010). Auditory enhancement of visual phosphene perception: the effect of temporal and spatial factors and of stimulus intensity. Neurosci. Lett. 477, 109-114.
9. Bueti, D., Bahrami, B., and Walsh, V. (2008). The sensory and association cortex in time perception. J. Cogn. Neurosci. 20, 1-9.
10. Burr, D., and Alais, D. (2006). Combining visual and auditory information. Prog. Brain Res. 155, 243-258.
11. Calvert, G.A., Spence, C., and Stein, B. E. (eds). (2004). The Handbook of Multisensory Processes. Cambridge: MIT Press.
12. Cappe, C., Thut, G., Romei, V., and Murray, M. M. (2009). Selective integration of auditory-visual looming cues by humans. Neuropsychologia 47, 1045-1052.
13. Cappe, C., Thut, G., Romei, V., and Murray, M. M. (2010). Auditoryvisual multisensory interactions in humans: timing, topography, directionality, and sources. J. Neurosci. 30, 12572-12580.
14. Chen, K., and Yeh, S. (2009). Asymmetric cross-modal effects in time perception. Acta Psychol. (Amst.) 130, 225-234.
15. Colonius, H., and Diederich, A. (2011). Computing an optimal time window of audiovisual integration in focused attention tasks: illustrated by studies on effect of age and prior knowledge. Exp. Brain Res. 212, 327-337.
16. Coull, J. T., Vidal, F., Nazarian, B., and Macar, F. (2004). Functional anatomy of the attentional modulation of time estimation. Science 303, 1506-1508.
17. Donovan, C. L., Lindsay, D. S., and Kingstone, A. (2004). Flexible and abstract resolutions to crossmodal conflicts. Brain Cogn. 56, 1-4.
18. Driver, J., and Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on "sensory-specific" brain regions, neural responses, and judgments. Neuron 57, 11-23.
19. Eagleman, D. M. (2008). Human time perception and its illusions. Curr. Opin. Neurobiol. 18, 131-136.
20. Ernst, M. O., and Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends Cogn. Sci. (Regul. Ed.) 8, 162-169.
21. Freeman, E., and Driver, J. (2008). Direction of visual apparent motion driven solely by timing of a static sound. Curr. Biol. 18, 1262-1266.
22. Gehard, J. W., and Mowbray, G. H. (1959). On discriminating the rate of visual flicker and auditory flutter. Am.J. Psychol.72, 521-529.
23. Getzmann, S. (2007). The effect of brief auditory stimuli on visual apparent motion. Perception 36, 1089-1103.
24. Ghazanfar, A. A., and Schroeder, C. E. (2006). Is neocortex essentially multisensory? Trends Cogn. Sci. (Regul. Ed.) 10, 278-285.
25. Ghose, G. M., and Maunsell, J. H. R. (2002). Attentional modulation in visual cortex depends on task timing. Nature 419, 616-620.
26. Grondin, S. (2010). Timing and time perception: a review of recent behavioral and neuroscience findings and.
27. Guttman, S. E., Gilroy, L. A., and Blake, R. (2005). Hearing what the eyes see: auditory encoding of visual temporal sequences. Psychol. Sci. 16, 228-235.
28. Harrington, D. L., Haaland, K. Y., and Hermanowicz, N. (1998). Temporal processing in the basal ganglia. Neuropsychology 12, 3-12.
29. Howard, I. P., and Templeton, W. B. (1966). Human Spatial Orientation. London: Wiley.
30. Ivry, R., and Keele, S. (1989). Timing functions of the cerebellum. J. Cogn. Neurosci. 1, 36-152.
31. Ivry, R. B., and Richardson, T. C. (2002). Temporal control and coordination: the multiple timer model. Brain Cogn. 48, 117-132.
32. Ivry, R. B., and Schlerf, J. E. (2008). Dedicated and intrinsic models of time perception. Trends Cogn. Sci. (Regul. Ed.) 12, 273-280.
33. Jantzen, K. J., Steinberg, F. L., and Kelso, J. A. S. (2005). Functional MRI reveals the existence of modality and coordinationdependent timing networks. Neuroimage 25, 1031-1042.
34. Johnston, A., Arnold, D. H., and Nishida, S. (2006). Spatially localised distortions of event time. Curr. Biol. 16, 472-479.
35. Kanai, R., Lloyd, H., Bueti, D., and Walsh, V. (2011). Modalityindependent role of the primary auditory cortex in time estimation. Exp. Brain Res. 209, 465-471.
36. Karmarkar, U. R., and Buonomano, D. V. (2007). Timing in the absence of clocks: encoding time in neural network states. Neuron 53, 427-438.
37. Klink, P. C., Montijn, J. S., and van Wezel, R. J. (2011). Crossmodal duration perception involves perceptual grouping, temporal ventriloquism, and variable internal clock rates. Atten. Percept. Psychophys. 73, 219-236.
38. Leo, F., Romei, V., Freeman, E., Ladavas, E., and Driver, J. (2011). Looming sounds enhance orientation sensitivity for visual stimuli on the same side as such sounds. Exp. Brain Res. 213, 193-201.
39. Leon, M. I., and Shadlen, M. N. (2003). Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron 38, 317-327.
40. Macmillan, N. A., and Creelman, C. D. (1991). Detection Theory: A User's Guide. Cambridge: Cambridge University Press.
41. Macmillan, N. A., and Creelman, C. D. (1997). d'Plus: a program to calculate accuracy and bias measures from detection and discrimination data. Spat. Vis. 11, 141-143.
42. Martuzzi, R., Murray, M. M., Michel, C. M., Thiran, J. P., Maeder, P. P., Clarke, S., and Meuli, R. A. (2007). Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb. Cortex 17, 1672-1679.
43. Meredith, M. A., Nemitz, J. W., and Stein, B. E. (1987). Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J. Neurosci. 7, 3215-3229.
44. Morein-Zamir, S., Soto-Faraco, S., and Kingstone, A. (2003). Auditory capture of vision: examining temporal ventriloquism. Brain Res. Cogn. Brain Res. 17, 154-163.
45. Morrone, M. C. (2005). Saccadic eye movements cause compression of time as well as space. Nat. Neurosci. 8, 950-954.
46. Noesselt, T., Tyll, S., Boehler, C. N., Budinger, E., Heinze, H. J., and Driver, J. (2010). Sound-induced enhancement of low-intensity vision: multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. J. Neurosci. 30, 13609-13623.
47. Rao, S. M., Mayer, A. R., and Harrington, D. L. (2001). The evolution of brain activation during temporal processing. Nat. Neurosci. 4, 317-323.
48. Recanzone, G. H. (2003). Auditory influences on visual temporal rate perception. J. Neurophysiol. 89, 1078-1093.
49. Repp, B. H., and Penel, A. (2002). Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. J. Exp. Psychol. Hum. Percept. Perform. 28, 1085-1099.
50. Romei, V., Murray, M. M., Cappe, C., and Thut, G. (2009). Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds. Curr. Biol. 19, 1799-1805.
51. Romei, V., Murray, M. M., Merabet, L. B., and Thut, G. (2007). Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: implications for multisensory interactions. J. Neurosci. 27, 11465-11472.
52. Rosenbaum, D. A. (2002). Time, space, and short-term memory. Brain Cogn. 48, 52-65.
53. Sanabria, D., Soto-Faraco, S., and Spence, C. (2007). Spatial attention and audiovisual interactions in apparent motion. J. Exp. Psychol. Hum. Percept. Perform. 33, 927-937.
54. Sarri, M., Blankenburg, F., and Driver, J. (2006). Neural correlates of crossmodal visual-tactile extinction and of tactile awareness revealed by fMRI in a right-hemisphere stroke patient. Neuropsychologia 44, 2398-2410.
55. Schöner, G. (2002). Timing, clocks, and dynamical systems. Brain Cogn. 48, 31-51.
56. Shams, L., Kamitani, Y., and Shimojo, S. (2000). What you see is what you hear. Nature 408, 788.
57. Shipley, T. (1964). Auditory flutterdriving of visual flicker. Science 145, 1328-1330.
58. Shuler, M. G., and Bear, M. F. (2006). Reward timing the primary visual cortex. Science 311, 1606-1609.
59. Snodgrass, J. G., and Corwin, J. (1988). Pragmatics of measuring recognition memory: applications to dementia, and amnesia. J. Exp. Psychol. Gen. 117, 34-50.
60. Spence, C., and Driver, J. (eds). (2004). Crossmodal Space and Crossmodal Attention. Oxford: Oxford University Press.
61. Talsma, D., Senkowski, D., Soto-Faraco, S., and Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends Cogn. Sci. (Regul. Ed.) 14, 400-410.
62. Thurlow, W. R., and Jack, C. E. (1973). Certain determinants of the"ventriloquism effect." Percept. Mot. Skills 36, 1171-1184.
63. van Ee, R., van Boxtel, J. J., Parker, A. L., and Alais, D. (2009). Multisensory congruency as a mechanism for attentional control over perceptual selection. J. Neurosci. 29, 11641-11169.
64. van Wassenhove, V., Buonomano, D. V., Shimojo, S., and Shams, L. (2008). Distortions of subjective time perception within and across senses. PLoS ONE 3, e1437. doi: 10.1371/journal.pone.0001437.
65. Vroomen, J., and de Gelder, B. (2000). Sound enhances visual perception: cross-modal effects of auditory organization on vision. J. Exp. Psychol. Hum. Percept. Perform. 26, 1583-1590.
66. Vroomen, J., de Gelder, B., and Vroomen, J. (2004). Temporal ventriloquism: sound modulates the flash-lag effect. J. Exp. Psychol. Hum. Percept. Perform. 30, 513-518.
67. Vroomen, J., and Keetels, M. (2009). Sounds change four-dot masking. Acta Psychol. (Amst.) 130, 58-63.
68. Vroomen, J., and Keetels, M. (2010). Perception of intersensory synchrony: a tutorial review. Atten. Percept. Psychophys. 72, 871-884.
69. Wada, Y., Kitagawa, N., and Noguchi, K. (2003). Audio-visual integration in temporal perception. Int. J. Psychophysiol. 50, 117-124.
70. Walker, J. T., and Scott, K. J. (1981). Auditory - visual conflicts in the perceived duration of lights, tones and gaps. J. Exp. Psychol. Hum. Percept. Perform. 7, 1327-1339.
71. Wang, Y., Celebrini, S., Trotter, Y., and Barone, P. (2008). Visuo-auditory interactions in the primary visual cortex of the behaving monkey: electrophysiological evidence. BMC Neurosci. 9, 79. doi: 10.1186/1471-2202-9-79.
72. Welch, R. B., and Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychol. Bull. 88, 638-667.
73. Wing, A. M. (2002). Voluntary timing and brain function: an information processing approach. Brain Cogn. 48, 7-30.
74. Witten, I. B., and Knudsen, E. I. (2005). Why seeing is believing: merging auditory and visual worlds. Neuron 48, 489-496.
75. Xuan, B., Zhan, D., He, S., and Chen, X. (2007). Larger stimuli are judged to last longer. J. Vis. 7, 1-5.
76. Yarrow, K., Haggard, P., Heal, R., Brown, P., and Rothwell, J. C. (2001). Illusory perceptions of space and time preserve cross-saccadic perceptual continuity. Nature 414, 302-305.
77. Zeiler, M. D. (1999). Time without clocks. J. Exp. Anal. Behav. 71, 288-291.