The aftereffects of ventriloquism: The time course of the visual recalibration of auditory localization

Seeing and Perceiving

Volumn 25, Issue 1, 2012, Pages 1-14

  Frissen, Ilja ^a,b   Vroomen, Jean ^a   De Gelder, Beatrice ^a,c  

^a TILBURG UNIVERSITY   (Netherlands)

^b ECOLE CENTRALE DE NANTES   (France)

^c MASSACHUSETTS GENERAL HOSPITAL   (United States)

Author keywords

multisensory processes; perceptual adaptation; Sensory perception; sound localization; time course; ventriloquism after effect

Indexed keywords

AFTER-EFFECT; MULTISENSORY; PERCEPTUAL ADAPTATION; SOUND LOCALIZATION; TIME COURSE;

SENSORY PERCEPTION;

EXPERIMENTS;

ADAPTATION; ADULT; ARTICLE; FEMALE; HEMISPHERIC DOMINANCE; HUMAN; ILLUSION; MALE; PHYSIOLOGY; SOUND DETECTION; TIME; VISION;

ADAPTATION, PHYSIOLOGICAL; ADULT; FEMALE; FIGURAL AFTEREFFECT; FUNCTIONAL LATERALITY; HUMANS; ILLUSIONS; MALE; SOUND LOCALIZATION; TIME FACTORS; YOUNG ADULT;

EID: 84858210560     PISSN: 18784755     EISSN: 18784763     Source Type: Journal    
DOI: 10.1163/187847611X620883     Document Type: Article

References (37)

1. Bermant, R. I. andWelch, R. B. (1976). Effect of degree of separation of visual-auditory stimulus and eye position upon spatial interaction of vision and audition, Percept. Mot. Skills 42, 487-493.
2. Bertelson, P. (1993). The time-course of adaptation to auditory-visual spatial discrepancy, in: Proc. 6th Conf. Eur. Soc. Cognit. Psychol., Copenhagen, Denmark.
3. Bertelson, P. (1999). Ventriloquism: A case of crossmodal perceptual grouping, in:Cognitive Contributions to the Perception of Spatial and Temporal Events , G. Aschersleben, T. Bachman and J. Müsseler (Eds), pp. 347-362. Elsevier, Amsterdam.
4. Bertelson, P., Frissen, I., Vroomen, J. and de Gelder, B. (2006). The aftereffects of ventriloquism: Patterns of spatial generalization, Percept. Psychophys. 68, 428-436.
5. Bertelson, P. and Radeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance, Percept. Psychophys. 29, 578-584.
6. Bertelson, P., Vroomen, J. and de Gelder, B. (2003). Visual recalibration of auditory speech identification: A McGurk aftereffect, Psychol. Sci. 14, 592-597.
7. Bizley, J. K., Nodal, F. R., Bajo, V. M., Nelken, I. and King, A. J. (2007). Physiological and anatomical evidence for multisensory interactions in auditory cortex, Cereb. Cortex 17, 2172-2189.
8. Bonath, B., Noesselt, T., Martinez, A., Mishra, J., Schwiecker, K., Heinze, H. J. and Hillyard, S. A. (2007). Neural basis of the ventriloquist illusion, Curr. Biol. 17, 1697-1703.
9. Budinger, E., Heil, P., Hess, A. and Scheich, H. (2006). Multisensory processing via early cortical stages: Connections of the primary auditory cortical field with other sensory systems, Neuroscience 143, 1065-1083.
10. Burge, J., Ernst, M. O. and Banks, M. S. (2008). The statistical determinants of adaptation rate in human reaching, J. Vision 8, Article 20.
11. Calvert, G. A., Brammer, M. J., Bullmore, E. T., Campbell, R., Iversen, S. D. and David, A. S. (1999). Response amplification in sensory-specific cortices during crossmodal binding, Neuroreport 10, 2619-2623.
12. Canon, L. K. (1970). Intermodality inconsistency of input and directed attention as determinants of the nature of adaptation, J. Exper. Psychol. 84, 141-147.
13. Canon, L. K. (1971). Directed attention and maladaptive 'adaptation' to displacement of the visual field, J. Exper. Psychol. 88, 403-408.
14. Eramudugolla, R., Kamke, M. R., Soto-Faraco, S. and Mattingley, J. B. (2011). Perceptual load influences auditory space perception in the ventriloquist aftereffect, Cognition 118, 65-77.
15. Ernst, M. O. (2006). A Bayesian view on multimodal cue integration, in:Perception of the Human Body , G. Knoblich, I. M. Thornton, M. Grosjean and M. Shiffrar (Eds), pp. 105-131. Oxford University Press, New York, NY.
16. Frissen, I., Vroomen, J., de Gelder, B. and Bertelson, P. (2003). The aftereffects of ventriloquism: Are they sound-frequency specific?, Acta Psychol. 113, 315-327.
17. Frissen, I., Vroomen, J., de Gelder, B. and Bertelson, P. (2005). The aftereffects of ventriloquism: Generalization across sound-frequencies, Acta Psychol. 118, 93-100.
18. Giard, M. H. and Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study, J. Cognit. Neurosci. 11, 473-490.
19. Held, R. (1965). Plasticity in sensory-motor systems, Sci. Amer. 213, 84-94.
20. Kayser, C., Logothetis, N. K. and Panzeri, S. (2010). Visual enhancement of the information representation in auditory cortex, Curr. Biol. 20, 19-24.
21. Klemm, O. (1909). Localisation von Sinnineidrucken bei disparaten Nebenreizen (Localization of sensory impressions with disparate distractors), Psychol. Stud./Psychol. Res. (Wundt) 5, 73-161.
22. Kopco, N., Lin, I. F., Shinn-Cunningham, B. G. and Groh, J. M. (2009). Reference frame of the ventriloquism aftereffect, J. Neurosci. 29, 13809-13814.
23. Lewald, J. (2002). Rapid adaptation to auditory-visual spatial disparity, Learn. Mem. 9, 268-278.
24. Lewald, J. and Ehrenstein, W. H. (2001). Effect of gaze direction on sound localization in rear space, Neurosci. Res. 39, 253-257.
25. McCollough, M. C. (1965). Color adaptation of edge detectors in the human visual system, Science 149, 1115-1116.
26. McGurk, H. and MacDonald, J. (1976). Hearing lips and seeing voices, Nature 264, 746-748.
27. Middlebrooks, J. C. and Green, D. M. (1991). Sound localization by human listeners, Ann. Rev. Psychol. 42, 135-159.
28. Passamonti, C., Frissen, I. and Ladavas, E. (2009). Visual recalibration of auditory spatial perception: Two separate neural circuits for perceptual learning, Eur. J. Neurosci. 30, 1141-1150.
29. Radeau, M. (1973). The locus of adaptation to auditory-visual conflict, Perception 2, 327-332.
30. Radeau, M. and Bertelson, P. (1974). The after-effects of ventriloquism, Qtly J. Exper. Psychol. 26, 63-71.
31. Radeau, M. and Bertelson, P. (1976). The effect of a textured visual field on modality dominance in a ventriloquism situation, Percept. Psychophys. 20, 227-235.
32. Recanzone, G. H. (1998). Rapidly induced auditory plasticity: The ventriloquism aftereffect, Proc. Nat. Acad. Sci. USA 95, 869-875.
33. Recanzone, G. H. (2009). Interactions of auditory and visual stimuli in space and time, Hear. Res. 258, 89-99.
34. van Linden, S., Vroomen, J., de Gelder, B. and Bertelson, P. (2004). Visual recalibration of auditory speech versus selective speech adaptation: Different build-up courses, in: Proc. 8th Int. Conf. Spoken Language Processing (ICSLP), Jeju, Jeju Island, Korea.
35. Vroomen, J., van Linden, S., Keetels, M., de Gelder, B. and Bertelson, P. (2004). Selective adaptation and recalibration of auditory speech information by lipread information: Dissipation, Speech Commun. 44, 55-61.
36. Welch, R. B. (1978). Perceptual Modification: Adapting to Altered Sensory Environments. Academic Press, New York, NY.
37. Wozny, D. R. and Shams, L. (2011). Recalibration of auditory space following milliseconds of crossmodal discrepancy, J. Neurosci. 31, 4607-4612.