Filling-in visual motion with sounds

Acta Psychologica

Volumn 129, Issue 2, 2008, Pages 249-254

  Valjamae A ^a,b   Soto Faraco, S ^c,d,e  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b CHALMERS UNIVERSITY OF TECHNOLOGY   (Sweden)

^c Hospital Sant Joan de Déu   (Spain)

^d UNIVERSITY OF BARCELONA   (Spain)

^e INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

Author keywords

Audition; Motion after effect; Multisensory integration; Vision

Indexed keywords

ADULT; ARTICLE; ATTENTION; CRITICAL FLICKER FUSION; DEPTH PERCEPTION; FEMALE; HEARING; HUMAN; MALE; MOVEMENT PERCEPTION; ORIENTATION; PATTERN RECOGNITION; PERCEPTIVE THRESHOLD; PSYCHOPHYSICS; SOUND DETECTION; VISION;

ADULT; ATTENTION; AUDITORY PERCEPTION; DEPTH PERCEPTION; FEMALE; FIGURAL AFTEREFFECT; FLICKER FUSION; HUMANS; MALE; MOTION PERCEPTION; ORIENTATION; PATTERN RECOGNITION, VISUAL; PSYCHOPHYSICS; SENSORY THRESHOLDS; SOUND LOCALIZATION;

EID: 52249093557     PISSN: 00016918     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.actpsy.2008.08.004     Document Type: Article

References (43)

1. Alais D., and Burr D. No direction-specific bimodal facilitation for audiovisual motion detection. Cognitive Brain Research 19 (2004) 185-194
2. Barfield W., and Hendrix C. The effect of update rate on the sense of presence within virtual environments. Virtual Reality: The Journal of the Virtual Reality Society 1 (1995) 3-16
3. Berger T.D., Martelli M., and Pelli D.G. Flicker flutter: Is an illusory event as good as the real thing?. Journal of Vision 3 6 (2003) 406-412
4. Blauert J. Spatial hearing. revised ed. (1997), The MIT Press, Cambridge, MA
5. Brainard D.H. The psychophysics toolbox. Spatial Vision 10 (1997) 433-436
6. Brown J.L. Flicker and intermittent stimulation. In: Graham C.H. (Ed). Vision and visual perception (1965), Wiley, New York 252-320
7. Chion M. Audio-vision: Sound on screen (1994), Columbia University Press, New York
8. Cornsweet T.N. The staircase-method in psychophysics. American Journal of Psychology 75 (1962) 485-491
9. Hong J., and Papathomas T.V. Influences of attention on auditory aftereffects following purely visual adaptation. Spatial Vision 19 (2006) 569-580
10. Jewett D.L., Hart T., Larson-Prior L.J., Baird B., Olson M., Trumpis M., et al. Human sensory-evoked responses differ coincident with either "fusion-memory" or "flash-memory". BMC Neuroscience 1 7 (2006) 18 10.1186/1471-2202-7-1
11. Kamitani Y., and Shimojo S. Sound-induced visual "rabbit". Journal of Vision 1 3 (2001) 478a
12. Kanizsa G. Subjective contours. Scientific American 234 4 (1976) 48-52
13. Kitagawa N., and Ichihara S. Hearing visual motion in depth. Nature 416 (2002) 172-174
14. Kohlrausch A., Fassel R., and Dau T. The influence of carrier level and frequency on modulation and beat-detection thresholds for sinusoidal carriers. Journal of the Acoustical Society of America 108 (2000) 723-734
15. Komatsu H. The neural mechanisms of perceptual filling-in. Nature Review Neuroscience 7 (2006) 220-231
16. Lutfi R.A., and Wang W. Correlated analysis of acoustic cues for the discrimination of auditory motion. Journal of Acoustic Society of America 106 2 (1999) 919-928
17. McCormick D., and Mamassian P. What does the illusory flash look like?. Vision Research 48 1 (2008) 63-69
18. Maier J.X., Neuhoff J.G., Logothetis N.K., and Ghazanfar A.A. Multisensory integration of looming signals by rhesus monkeys. Neuron 43 (2004) 177-181
19. Massaro D.M. From multisensory integration to talking heads and language learning. In: Calvert G., Spence C., and Stein B.E. (Eds). Handbook of multisensory processes (2004), MIT Press, Cambridge 153-176
20. Mastoropoulou, G., Debattista, K., Chalmers, A., & Troscianko, T. (2005). The influence of sound effects on the perceived smoothness of rendered animations. In Paper presented at APGV'05: Second symposium on applied perception in graphics and visualization. La Coruña, Spain (August).
21. Meyer G.F., and Wuerger S.M. Cross-modal integration of auditory and visual motion signals. Neuroreport 12 11 (2001) 2557-2560
22. Morein-Zamir S., Soto-Faraco S., and Kingstone A. Auditory capture of vision: Examining temporal ventriloquism. Cognitive Brain Research 17 (2003) 154-163
23. Murakami I. Motion after-effect after monocular adaptation to filled-in motion at the blind spot. Vision Research 35 (1995) 1041-1045
24. Navarra J., and Soto-Faraco S. Hearing lips in a second language: Visual articulatory information enables the perception of L2 sounds. Psychological Research 71 (2007) 4-12
25. Pelli D.G. The video toolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision 10 (1997) 437-442
26. Ramachandran V.S. Filling in gaps in perception: Part 1. Current Directions in Psychological Science 1 6 (1992) 199-205
27. Reddy, M. (1997). The effects of low frame rate on a measure for user performance in virtual environments (Technical Report ECS-CSG-36-97). University of Edinburg, Scotland, UK..
28. Regan D., and Beverley K.I. Illusory motion in depth: Aftereffect of adaptation to changing size. Vision Research 18 (1978) 209-212
29. Reinhardt-Rutland A.H. Increasing- and decreasing-loudness aftereffects: Asymmetrical functions for absolute rate of sound level change in adapting stimulus. The Journal of General Psychology 122 2 (1992) 187-193
30. Röhrbein F., Schill K., and Zetzsche C. Intermodal sensory interactions for ecologically valid intensity changes as caused by moving observers or moving objects. In: Bülthoff H.H., Fahle M., Gegenfurthner K., and Mallot H. (Eds). TWK 2000 - Beiträge zur 3. Tübinger Wahrnehmungskonferenz (2000), Knirsch Verlag, Kirchentellinsfurth pp. 62
31. Shams L., Kamitani Y., and Shimojo S. What you see is what you hear. Nature 408 (2000) 788
32. Shams L., Kamitani Y., and Shimojo S. Visual illusion induced by sound. Cognitive Brain Research 14 1 (2002) 147-152
33. Shams L., Kamitani Y., Thompson S., and Shimojo S. Sound alters visual evoked potential in humans. NeuroReport 12 17 (2001) 3849-3852
34. Small A.M. Loudness perception of signals of monotonically changing sound level. Journal of the Acoustical Society of America 61 (1977) 1293-1297
35. Soto-Faraco S., Kingstone A., and Spence C. Multisensory contributions to the perception of motion. Neuropsychologia 41 13 (2003) 1847-1862
36. Soto-Faraco S., Lyons J., Gazzaniga M., Spence C., and Kingstone A. The ventriloquist in motion: Illusory capture of dynamic information across sensory modalities. Cognitive Brain Research 14 (2002) 139-146
37. Soto-Faraco S., Spence C., and Kingstone A. Crossmodal dynamic capture: Congruency effects of motion perception across sensory modalities. Journal of Experimental Psychology: Human Perception & Performance 30 (2004) 330-345
38. Sumby W., and Pollack I. Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America 26 (1954) 212-215
39. Taylor M.M., and Creelman C.D. PEST: Efficient estimates on probability functions. Journal of the Acoustical Society of America 41 (1967) 782-787
40. Thomas F., and Johnston O. Disney animation: The illusion of life (1981), Abbeyville Press, New York
41. Väljamäe A., and Tajadura-Jiménez A. Perceptual optimization of audio-visual media: Moved by sound. In: Anderson B., and Anderson J. (Eds). Narration and spectatorship in moving images (2007), Cambridge Scholars Press
42. Vroomen J., and de Gelder B. Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of Experimental Psychology: Human Perception & Performance 26 (2000) 1583-1590
43. Welch R.B., Duttenhurt L.D., and Warren D.H. Contributions of audition involved in the multimodal integration of perceptual and vision to temporal rate perception. Perception & Psychophysics 39 (1986) 294-300