The spatial constraint in intersensory pairing: No role in temporal ventriloquism

Journal of Experimental Psychology: Human Perception and Performance

Volumn 32, Issue 4, 2006, Pages 1063-1071

  Vroomen, Jean ^a   Keetels, Mirjam ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Intersensory perception; Spatial attention; Spatial discordance; Temporal order judgment; Temporal ventriloquism

Indexed keywords

ARTICLE; ASSOCIATION; ATTENTION; HEARING; HUMAN; LEARNING; ORIENTATION; PSYCHOPHYSICS; SOUND DETECTION; TIME PERCEPTION; VISION;

ASSOCIATION LEARNING; ATTENTION; AUDITORY PERCEPTION; CUES; HUMANS; ORIENTATION; PSYCHOPHYSICS; SOUND LOCALIZATION; TIME PERCEPTION; VISUAL PERCEPTION;

EID: 33646871524     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/0096-1523.32.4.1063     Document Type: Article

References (57)

1. Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands. Current Biology, 15, 839-843.
2. Aschersleben, G., & Bertelson, P. (2003). Temporal ventriloquism: Cross-modal interaction on the time dimension. 2. Evidence from sensorimotor synchronization. International Journal of Psychophysiology, 50, 157-163.
3. Bedford, F. L. (1989). Constraints on learning new mappings between perceptual dimensions. Journal of Experimental Psychology-Human Perception and Performance, 15, 232-248.
4. Bertelson, P. (1999). Ventriloquism: A case of crossmodal perceptual grouping. In G. Aschersleben, T. Bachmann, & J. Müsseler (Eds.), Cognitive contributions to the perception of spatial and temporal events (pp. 347-363). Amsterdam: North-Holland/Elsevier.
5. Bertelson, P., & Aschersleben, G. (2003). Temporal ventriloquism: Crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment. International Journal of Psychophysiology, 50, 147-155.
6. Bertelson, P., Pavani, F., Ladavas, E., Vroomen, J., & de Gelder, B. (2000). Ventriloquism in patients with unilateral visual neglect. Neuropsychologia, 38, 1634-1642.
7. Bertelson, P., Vroomen, J., de Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62, 321-332.
8. Bertelson, P., Vroomen, J., Wiegeraad, G., & de Gelder, B. (1994). Exploring the relation between McGurk interference and ventriloquism. Paper presented at the International Congress on Spoken Language Processing, Yokohama, (pp. 559-562).
9. Calvert, G., Spence, C., & Stein, B. E. (Eds.). (2004). The handbook of multisensory processes. Cambridge, MA: MIT Press.
10. Colin, C., Radeau, M., Deltenre, P., & Morais, J. (2001). Rules of intersensory integration in spatial scene analysis and speechreading. Psychologica Belgica, 41, 131-144.
11. de Gelder, B., & Bertelson, P. (2003). Multisensory integration, perception and ecological validity. Trends in Cognitive Sciences, 7, 460-467.
12. de Gelder, B., & Bertelson. P. (2004). Multisensory integration, perception and ecological validity. Trends in Cognitive Sciences, 8, 7-7.
13. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip reading. Nature, 381, 66-68.
14. Driver, J., & Spence, C. (2004). Crossmodal links in endogenous spatial attention. In J. Driver (Ed.), Crossmodal space and crossmodal attention (pp. 179-220). Oxford, England: Oxford University Press.
15. Fendrich, R., & Corballis, P. M. (2001). The temporal cross-capture of audition and vision. Perception & Psychophysics, 63, 719-725.
16. Finney, D. J. (1964). Probit analysis. Cambridge, England: Cambridge University Press.
17. Frens, M. A., & Van Opstal, A. J. (1998). Visual auditory interactions modulate saccade-related activity in monkey superior colliculus. Brain Research Bulletin, 46, 211-224.
18. Godfroy, M., Roumes, C., & Dauchy, P. (2003). Spatial variations of visual-auditory fusion areas. Perception, 32, 1233-1245.
19. Hairston, W. D., Wallace, M. T., Vaughan, J. W., Stein, B. E., Morris, J. L., & Schirillo, J. A. (2003). Visual localization ability influences cross-modal bias. Journal of Cognitive Neuroscience, 15, 20-29.
20. Heffner, R. S., & Heffner, H. E. (1992). Visual factors in sound localization in mammals. Journal of Comparative Neurolology, 317, 219-232.
21. Keetels, M., & Vroomen, J. (2005). The role of spatial disparity and hemifields in audio-visual temporal order judgements. Experimental Brain Research, 167, 635-640.
22. Kubovy, M., & Van Valkenburg, D. (2001). Auditory and visual objects. Cognition, 80, 97-126.
23. Lewald, J., & Guski, R. (2003). Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cognitive Brain Research, 16, 468-478.
24. Macaluso, E., George, N., Dolan, R.. Spence, C., & Driver, J. (2004). Spatial and temporal factors during processing of audiovisual speech: A PET study. Neuroimage, 21, 725-732.
25. McGurk, H., & MacDonald, T. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
26. Morein-Zamir, S., Soto-Faraco, S., & Kingstone, A. (2003). Auditory capture of vision: Examining temporal ventriloquism. Cognitive Brain Research, 17, 154-163.
27. Murray, M. M., Michel, C. M., Grave de Peralta, R., Ortigue, S., Brunet, D., Gonzalez Andino, S., & Schnider, A. (2004). Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. Neuroimage, 21, 125-135.
28. Posner, M. I. (1978). Chronometric explorations of the mind. Ilillsdale, NJ: Erlbaum.
29. Radeau, M. (1994). Auditory-Visual Spatial Interaction and Modularity. Cahiers de Psychologie Cognitive-Current Psychology of Cognition, 13, 3-51.
30. Radeau, M., & Bertelson, P. (1977). Adaptation to auditory-visual discordance and ventriloquism in semi-realistic situations. Perception & Psychophysics, 22, 137-146.
31. Recanzone, G. H. (2003). Auditory influences on visual temporal rate perception. Journal of Neurophysiolagy, 89, 1078-1093.
32. Scheier, C. R., Nijhawan, R., & Shimojo, S. (1999). Sound alters visual temporal resolution. Investigative Ophthalmology & Visual Science, 40, 4169.
33. Slutsky, D. A., & Recanzone, G. H. (2001). Temporal and spatial dependency of the ventriloquism effect. Neuroreport, 12, 7-10.
34. Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59, 1-22.
35. Spence, C., & McDonald, J. (2004). The cross-modal consequences of the exogenous spatial orienting of attention. In G. Calvert, C. Spence, & D. E. Stein (Eds.). The handbook of multisensory processes (pp. 3-25). Cambridge, MA: MIT Press.
36. Spence, C., Nicholls, M. E. R., Gillespie, N., & Driver, J. (1998). Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision. Perception & Psychophysics, 60, 544-557.
37. Spence, C. J., & Driver, J. (1994). Covert spatial orienting in audition: Exogenous and endogenous mechanisms. Journal of Experimental Psychology: Human Perception and Performance, 20, 555-574.
38. Stein, B. E., London, N., Wilkinson, L. K., & Price, D. D. (1996). Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis. Journal of Cognitive Neuroscience, 8, 497-506.
39. Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge MA: MIT Press.
40. Stekelenburg, J. J., & Vroomen, J. (2005). An event-related potential investigation of the time-course of temporal ventriloquism. Neuroreport, 16, 641-644.
41. Stekelenburg, J. J., Vroomen, J., & de Gelder, B. (2004). Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativity. Neuroscience Letters, 357, 163-166.
42. Talsma, D., & Woldorff, M. G. (2005). Selective attention and multisensory integration: Multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience, 17, 1098-1114.
43. Teder-Salejarvi, W. A., Di Russo, F., McDonald, J. J., & Hillyard, S. A. (2005). Effects of spatial congruity on audio-visual multimodal integration. Journal of Cognitive Neuroscience, 17, 1396-1409.
44. Tiippana, K., Andersen, T. S., & Sams, M. (2004). Visual attention modulates audiovisual speech perception. European Journal of Cognitive Psychology, 16, 475-472.
45. Vroomen, T., Bertelson, P., & de Gelder, B. (2001a). Directing spatial attention towards the illusory location of a ventriloquized sound. Acta Psychologica, 108, 21-33.
46. Vroomen, J., Bertelson, P., & de Gelder, B. (2001b). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception & Psychophysics, 63, 651-659.
47. Vroomen, J., & de Gelder, B. (2000). Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of Experimental Psychology: Human Perception and Performance, 26, 1583-1590.
48. Vroomen, J., & de Gelder, B. (2004a). Perceptual effects of cross-modal stimulation: Ventriloquism and the freezing phenomenon. In G. Calvert. C. Spence, & B. E. Stein (Eds.), The handbook of multisensory processes (pp. 141-150). Cambridge, MA: MIT Press.
49. Vroomen, J., & de Gelder, B. (2004b). Temporal ventriloquism: Sound modulates the flash-lag effect. Journal of Experimental PsychologyHuman Perception and Performance, 30, 513-518.
50. Vroomen, J., Driver, J., & de Gelder, B. (2001). Is cross-modal integration of emotional expressions independent of attentional resources? Cognitive, Affective, & Behavioral Neuroscience, 1, 382-387.
51. Vroomen, J., Keetels, M., de Gelder, B., & Bertelson, P. (2004). Recalibration of temporal order perception by exposure to audio-visual asynchrony. Cognitive Brain Research, 22, 32-35.
52. Wallace, M. T., Roberson, G. E.. Ilairston, W. D., Stein, B. E., Vaughan, J. W., & Schirillo, J. A. (2004). Unifying multisensory signals across time and space. Experimental Brain Research, 158, 252-258.
53. Welch, R. B. (1999). Meaning, attention, and the "unity assumption" in the intcrsensory bias of spatial and temporal perceptions. In G. Aschersleben, T. Bachmann, & J. Müsseler (Eds.). Cognitive contributions to the perception of spatial and temporal events (pp. 371-387). Amsterdam: North-Holland/Elsevier.
54. Welch, R. B., DuttonHurt, L. D., & Warren, D. H. (1986). Contributions of audition and vision to temporal rate perception. Perception & Psychophysics, 39, 294-300.
55. Welch, R. B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological. Bulletin, 88, 638-667.
56. Zampini, M., Shore, D. I., & Spence, C. (2003a). Audiovisual temporal order judgments. Experimental Brain Research, 152, 198-210.
57. Zampini, M., Shore, D. I., & Spence, C. (2003b). Multisensory temporal order judgments: The role of hemispheric redundancy. International Journal of Psychophysiology, 50, 165-180.