Sounds can alter the perceived direction of a moving visual object

Journal of Vision

Volumn 12, Issue 3, 2012, Pages 1-12

  Teramoto, Wataru ^a   Hidaka, Souta ^a   Sugita, Yoichi ^b   Sakamoto, Shuichi ^a   Gyoba, Jiro ^a   Iwaya, Yukio ^a   Suzuki, Yôiti ^a  

^a TOHOKU UNIVERSITY   (Japan)

^b NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Audiovisual interaction; Motion perception; Retinal eccentricity

Indexed keywords

ARTICLE; ASSOCIATION; AUDITORY STIMULATION; EYE MOVEMENT; HEARING; HUMAN; METHODOLOGY; MOVEMENT PERCEPTION; PERCEPTION; PHOTOSTIMULATION; PHYSIOLOGY; SOUND DETECTION;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; CUES; EYE MOVEMENTS; HUMANS; MOTION PERCEPTION; PERCEPTUAL MASKING; PHOTIC STIMULATION; SOUND LOCALIZATION;

EID: 84860691919     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/12.3.11     Document Type: Article

References (42)

1. Alais, D., & Burr, D. (2004a). No direction-specific bimodal facilitation for audiovisual motion detection. Brain Research Cognitive Brain Research, 19, 185-194.
2. Alais, D., & Burr, D. (2004b). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14, 257-262.
3. Anscombe, F. J. (1956). On estimating binomial response relations. Biometrika, 43, 461-464.
4. Asano, F., Suzuki, Y., & Sone, T. (1990). Role of spectral cues in median plane localization. Journal of the Acoustical Society of America, 88, 159-168.
5. Aschersleben, G., & Bertelson, P. (2003). Temporal ventriloquism: Crossmodal interaction on the time dimension. 2. Evidence from sensorimotor synchronization. International Journal of Psychophysiology, 50, 157-163.
6. Battaglia, P. W., Jacobs, R. A., & Aslin, R. N. (2003). Bayesian integration of visual and auditory signals for spatial localization. Journal of the Optical Society of America A, Optics, Image Science, and Vision, 20, 1391-1397.
7. Bertelson, P., & Aschersleben, G. (2003). Temporal ventriloquism: Crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment. International Journal of Psychophysiology, 50, 147-155.
8. Blauert, J. (1983). Spatial hearing: The psychophysics of human sound localization. Cambridge, MA: MIT Press.
9. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433-436.
10. Daniel, P. M., & Whitteridge, D. (1961). The representation of the visual field on the cerebral cortex in monkeys. The Journal of Physiology, 159, 203-221.
11. Dick, M., Ullman, S., & Sagi, D. (1987). Parallel and serial processes in motion detection. Science, 237, 400-402.
12. Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429-433.
13. Fendrich, R., & Corballis, P. M. (2001). The temporal cross-capture of audition and vision. Perception & Psychophysics, 63, 719-725.
14. Freeman, E., & Driver, J. (2008). Direction of visual apparent motion driven solely by timing of a static sound. Current Biology, 18, 1262-1266.
15. Grantham, D. W., Hornsby, B. W., & Erpenbeck, E. A. (2003). Auditory spatial resolution in horizontal, vertical, and diagonal planes. Journal of the Acoustical Society of America, 114, 1009-1022.
16. Harrison, N. R., Wuerger, S. M., & Meyer, G. F. (2010). Reaction time facilitation for horizontally moving auditory-visual stimuli. Journal of Vision 10(14):16, 1-21, http://www.journalofvision.org/content/10/14/16, doi:10.1167/10.14.16.
17. Hidaka, S., Manaka, Y., Teramoto, W., Sugita, Y., Miyauchi, R., Gyoba, J., Suzuki, Y., & Iwaya, Y. (2009). The alternation of sound location Induces visual motion perception of a static object. PLoS ONE, 4, e8188.
18. Hidaka, S., Teramoto, W., Sugita, Y., Manaka, Y., Sakamoto, S., & Suzuki, Y. (2011). Auditory motion information drives visual motion perception. PLoS ONE, 6, e17499.
19. Kahneman, D., & Wolman, R. (1970). Stroboscopic motion: Effects of duration and interval. Perception & Psychophysics, 8, 161-164.
20. Kim, R., Peters, M. A., & Shams, L. (2012). 0 + 1 > 1: How adding noninformative sound improves performance on a visual task. Psychological Science, 23, 6-12.
21. Kitagawa, N., & Ichihara, S. (2002). Hearing visual motion in depth. Nature, 416, 172-174.
22. Macmillan, N. A., & Creelman, C. D. (2004). Detection Theory: A user's guide. New Jersey: Lawrence Erlbaum Associates.
23. Maeda, F., Kanai, R., & Shimojo, S. (2004). Changing pitch induced visual motion illusion. Current Biology, 14, R990-R991.
24. Meyer, G. F., & Wuerger, S. M. (2001). Cross-modal integration of auditory and visual motion signals. Neuroreport, 12, 2557-2560.
25. Meyer, G. F., Wuerger, S. M., Roehrbein, M., & Zetzsche, C. (2005). Low-level Integration of auditory and visualmotion signals requires spatial co-localisation. Experimental Brain Research, 166, 538-547.
26. Mills, A. W. (1958). On the minimum audible angle. Journal of the Acoustical Society of America, 30, 237-246.
27. Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437-442.
28. Perrott, D. R., Costantino, B., & Cisneros, J. (1993). Auditory and visual localization performance in a sequential discrimination task. Journal of the Acoustical Society of America, 93, 2134-2138.
29. Posner, M. I., & Boies, S. J. (1971). Components of attention. Psychological Review, 78, 391-408.
30. Radeau, M., & Bertelson, P. (1987). Auditory-visual interaction and the timing of inputs. Thomas (1941) revisited. Psychological Research, 49, 17-22.
31. Rovamo, J., & Virsu, V. (1979). An estimation and application of the human cortical magnification factor. Experimental Brain Research, 37, 495-510.
32. Scheier, C. R., Nijhawan, R., & Shimojo, S. (1999). Sound alters visual temporal resolution. Investigative Ophthalmology & Visual Science, 40, 4169.
33. Sekuler, R., Sekuler, A. B., & Lau, R. (1997). Sound alters visual motion perception. Nature, 385, 308.
34. Sorkin, R. D. (1999). Spreadsheet signal detection. Behavior Research Methods, Instruments, & Computers, 31, 46-54.
35. Soto-Faraco, S., Lyons, J., Gazzaniga, M., Spence, C., & Kingstone, A. (2002). The ventriloquist in motion: Illusory capture of dynamic information across sensory modalities. Brain Research. Cognitive Brain Research, 14, 139-146.
36. Soto-Faraco, S., Spence, C., & Kingstone, A. (2003). Multisensory contributions to the perception of motion. Neuropsychologia, 41, 1847-1862.
37. Soto-Faraco, S., Spence, C., & Kingstone, A. (2004). Cross-modal dynamic capture: Congruency effects in the perception of motion across sensory modalities. Journal of Experimental Psychology: Human Perception and Performance, 30, 330-345.
38. Teramoto, W., Manaka, Y., Hidaka, S., Sugita, Y., Miyauchi, R., Sakamoto, S., Gyoba, J., Iwaya, Y., & Suzuki, Y. (2010). Visual motion perception induced by sounds in vertical plane. Neuroscience Letters, 479, 221-225.
39. van Beers, R. J., Sittig, A. C., & Denier van der Gon, J. J. (1999). Integration of proprioceptive and visual position information: An experimentally supported model. Journal of Neurophysiology, 81, 1355-1364.
40. Watanabe, K., & Shimojo, S. (2001). When sound affects vision: Effects of auditory grouping on visual motion perception. Psychological Science, 12, 109-116.
41. Whitteridge, D., & Daniel, P. M. (1961). The representation of the visual field on the calcarine cortex. In R. Jung & H. Kornhuber (Eds.), The visual system: Neurophysiology and psychophysics (pp. 222-228). Berlin, Germany: Springer.
42. Wuerger, S. M., Hofbauer, M., & Meyer, G. F. (2003). The integration of auditory and visual motion signals at threshold. Perception & Psychophysics, 65, 1188-1196.