Capture of intermodal visual/tactile apparent motion by moving and static sound

Seeing and Perceiving

Volumn 24, Issue 4, 2011, Pages 369-389

  Chen, Lihan ^a   Zhou, Xiaolin ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Apparent motion; Crossmodal capture; Intermodal interaction; Ventriloquism

Indexed keywords

APPARENT MOTION; CROSS-MODAL; INTERMODAL INTERACTION; MOTION DIRECTION; TACTILE STIMULI; TEMPORAL INFORMATION; TEMPORAL INTERVALS; VENTRILOQUISM; VISUAL STIMULUS;

ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; FEMALE; HUMAN; MALE; METHODOLOGY; MOVEMENT PERCEPTION; PHOTOSTIMULATION; PHYSIOLOGY; SOUND DETECTION; TIME PERCEPTION; TOUCH;

ACOUSTIC STIMULATION; ADULT; CUES; FEMALE; HUMANS; MALE; MOTION PERCEPTION; PHOTIC STIMULATION; SOUND LOCALIZATION; TIME PERCEPTION; TOUCH PERCEPTION; YOUNG ADULT;

EID: 80053431273     PISSN: 18784755     EISSN: 18784763     Source Type: Journal    
DOI: 10.1163/187847511X584434     Document Type: Article

References (62)

1. Alais, D. and Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration, Curr. Biol. 14, 257-262. (Pubitemid 38215356)
2. Barlow, J. S. (1964). Inertial navigation as a basis for animal navigation, J. Theor. Biol. 6, 76-117.
3. Bensmaïa, S. J., Killebrew, J. H. and Craig, J. C. (2006). Influence of visual motion on tactile motion perception, J. Neurophysiol. 96, 1625-1637. (Pubitemid 44371549)
4. Battaglia, P. W., Jacobs, R. A. and Aslin, R. N. (2003). Bayesian integration of visual and auditory signals for spatial localization, J. Opt. Soc. Am. A Opt. Image Sci. Vis. 20, 1391-1397.
5. Bertelson, P. (1999). Ventriloquism: a case of crossmodal perceptual grouping, in:Cognitive Contributions to the Perception of Spatial and Temporal Events , Aschersleben, G., Bachmann, T. and Müsseler, J. (Eds), pp. 347-362. Elsevier, Amsterdam.
6. Bertelson, P. and Aschersleben, G. (1998). Automatic visual bias of perceived auditory location, Psychonomic Bull. Rev. 5, 482-489. (Pubitemid 128457707)
7. Brainard, D. H. (1997). The psychophysics toolbox, Spat. Vis. 10, 433-436. (Pubitemid 127582520)
8. Bresciani, J. P., Dammeier, F. and Ernst, M. O. (2006). Vision and touch are automatically integrated for the perception of sequences of events, J. Vision 6, 554-564. (Pubitemid 43731177)
9. Bresciani, J. P., Ernst, M. O. (2007). Signal reliability modulates auditory-tactile integration for event counting, Neuroreport 18, 1157-1161. (Pubitemid 46988071)
10. Bresciani, J. P., Ernst, M. O., Drewing, K., Bouyer, G., Maury, V. and Kheddar, A. (2005). Feeling what you hear: auditory signals can modulate tactile tap perception, Exper. Brain Res. 162, 172-180. (Pubitemid 40543828)
11. Bridgeman, B. (2003). Psychology &Evolution: The Origins of Mind. Sage Publications, Inc., Thousand Oaks, CA.
12. Bruns, P. and Getzmann, S. (2008). Audiovisual influences on the perception of visual apparent motion: Exploring the effect of a single sound, Acta Psychol. (Amst.) 129, 272-283.
13. Burr, D., Banks, M. S. and Morrone, M. C. (2009). Auditory dominance over vision in the perception of interval duration, Exper. Brain Res. 198, 49-57.
14. Caclin, A., Soto-Faraco, S., Kingstone, A. and Spence, C. (2002). Tactile "capture" of audition, Percept. Psychophys. 64, 616-630.
15. Chen, L., Shi, Z. andMüller, H. J. (2011). Interaction of perceptual grouping and crossmodal temporal capture in tactile apparent-motion, PLoS ONE 6, e17130; doi:10.1371/journal.pone.0017130.
16. Craig, J. C. (2006). Visual motion interferes with tactile motion perception, Perception 35, 351-367. (Pubitemid 43555558)
17. de Gelder, B. and Bertelson, P. (2003). Multisensory integration, perception and ecological validity, Trends Cogn. Sci. 7, 460-467. (Pubitemid 37188790)
18. Driver, J. and Spence, C. (2000). Multisensory perception: beyond modularity and convergence, Curr. Biol. 10, R731-R735.
19. Ernst, M. O. and Banks,M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion, Nature 415, 429-433. (Pubitemid 34100953)
20. Exner, S. (1875). Uber das Sehen von Bewegungen und die Theorie des zusammengesetzten Auges, Sitzungsberichte der Akademie der Wissenschaften in Wien, Mathematisch-Naturwissenschaftliche Klasse, Abteilung 3, 156-190.
21. Freeman, E. and Driver, J. (2008). Direction of visual apparent motion driven solely by timing of a static sound, Curr. Biol. 18, 1262-1266.
22. Fujisaki, W. and Nishida, S. (2009). Audio-tactile superiority over visuo-tactile and audio-visual combinations in the temporal resolution of synchrony perception, Exper. Brain Res. 198, 245-259.
23. Fujisaki, W. and Nishida, S. (2010). A common perceptual temporal limit of binding synchronous inputs across different sensory attributes and modalities, Proc. R. Soc. B 277, 2281-2290.
24. Galli, P. A. (1932). Über mittelst verschiedener Sinnesreize erweckte Wahrnehmung von Scheinbewegungen [On the perception of apparent motion elicited by different sensory stimuli], Archiv. Fur die gesamte Psychologie 85, 137-180.
25. Gepshtein, S., Burge, J., Ernst, M. O. and Banks, M. S. (2005). The combination of vision and touch depends on spatial proximity, J. Vision 5, 1013-1023. (Pubitemid 43078793)
26. Gesheider, G. A. (1970). Some comparisons between touch and hearing, IEEE Transactions on Manmachine Systems 11, 28-35.
27. Getzmann, S. (2007). The effect of brief auditory stimuli on visual apparent motion, Perception 36, 1089-1103.
28. Gillmeister, H. and Eimer, M. (2007). Tactile enhancement of auditory detection and perceived loudness, Brain Res. 1160, 58-68. (Pubitemid 47058033)
29. Harrar, V. and Harris, L. R. (2007). Multimodal ternus: visual, tactile, and visuo-tactile grouping in apparent motion, Perception 36, 1455-1464.
30. Harrar, V.,Winter, R. and Harris, L. R. (2008). Visuotactile apparent motion, Percept. Psychophys. 70, 807-817.
31. Hirsh, I. J. and Sherrick, C. E. J. (1961). Perceived order in different sense modalities, J. Exper. Psychol. 62, 423-432.
32. Holmes, N. P. and Spence, C. (2005). Multisensory integration: space, time and superadditivity, Curr. Biol. 15, R762-R764. (Pubitemid 41323732)
33. Howard, I. P. and Templeton, W. B. (1966). Human Spatial Orientation. Wiley, New York.
34. Kafaligonul, H. and Stoner, G. R. (2010). Auditory modulation of visual apparent motion with short spatial and temporal intervals, J. Vis. 10(12), 31; doi: 10.1167/10.12.31.
35. Keetels, M. and Vroomen, J. (2005). The role of spatial disparity and hemifields in audio-visual temporal order judgments, Exper. Brain Res. 167, 635-640.
36. Keetels, M. and Vroomen, J. (2008). Tactile-visual temporal ventriloquism: no effect of spatial disparity, Percept. Psychophys. 70, 765-771.
37. Kitagawa, N. and Ichihara, S. (2002). Hearing visual motion in depth, Nature 416, 172-174. (Pubitemid 34246473)
38. Korte, A. (1915). Kinematoskopische Untersuchungen, Zeitschrift fur Psychologie 72, 193-206.
39. Lyons, G., Sanabria, D., Vatakis, A. and Spence, C. (2006). The modulation of crossmodal integration by unimodal perceptual grouping: a visuotactile apparent motion study, Exper. Brain Res. 174, 510-516. (Pubitemid 44451044)
40. Meyer, G. F. andWueger, S. M. (2001). Cross-modal integration of auditory and visual motion signals, Neuroreport 12, 2557-2560. (Pubitemid 32682221)
41. Morein-Zamir, S., Soto-Faraco, S. and Kingstone, A. (2003). Auditory capture of vision: examining temporal ventriloquism, Cogn. Brain Res. 17, 154-163. (Pubitemid 36577550)
42. Oruc, I., Sinnett, S., Bischof, W. F., Soto-Faraco, S., Lock, K. and Kingstone, A. (2008). The effect of attention on the illusory capture of motion in bimodal stimuli, Brain Res. 1242, 200-208.
43. Shi, Z., Chen, L. and Müller, H. J. (2010). Auditory temporal modulation of the visual Ternus effect: the influence of time interval, Exper. Brain Res. 203, 723-735.
44. Slutsky, D. A. and Recanzone, G. H. (2001). Temporal and spatial dependency of the ventriloquism effect, Neuroreport 12, 7-10. (Pubitemid 32099017)
45. Soto-Faraco, S. and Deco, G. (2009). Multisensory contributions to the perception of vibrotactile events, Bahav. Brain Res. 196, 145-154.
46. Soto-Faraco, S., Lyons, J., Gazzaniga, M., Spence, C. and Kingstone, A. (2002). The ventriloquist in motion: Illusory capture of dynamic information across sensory modalities, Cogn. Brain Res. 14, 139-146. (Pubitemid 34626804)
47. Soto-Faraco, S., Kingstone, A. and Spence, C. (2003). Multisensory contributions to the perception of motion, Neuropsychologia 41, 1847-1862. (Pubitemid 37188426)
48. Soto-Faraco, S., Spence, C. and Kingstone, A. (2004a). Congruency effects between auditory and tactile motion: extending the phenomenon of cross-modal dynamic capture, Cogn. Affect. Behav. Neurosci. 4, 208-217. (Pubitemid 39167163)
49. Soto-Faraco, S., Spence, C. and Kingstone, A. (2004b). Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities, J. Exper. Psychol. Hum. Percept. Perform. 30, 330-345. (Pubitemid 38422589)
50. Spence, C., Sanabria, D. and Soto-Faraco, S. (2007). Intersensory Gestalten and crossmodal scene perception, in:The Psychology of Beauty and Kansei: New Horizons of Gestalt Perception , Noguchi, K. (Ed.). Nihon University College of Humanities and Sciences, Tokyo.
51. Stein, B. E. and Meredith, M. A. (1993). The Merging of the Senses. MIT Press, Cambridge, MA.
52. Strybel, T. Z. and Vatakis, A. (2004). A comparison of auditory and visual apparent motion presented individually and with crossmodal moving distractors, Perception 33, 1033-1048. (Pubitemid 39558193)
53. van Erp, J. B. and Werkhoven, P. J. (2004). Vibro-tactile and visual asynchronies: Sensitivity and consistency, Perception 33, 103-111. (Pubitemid 38389684)
54. Von Békésy, G. (1959). Similarities between hearing and skin sensations, Psychol. Rev. 66, 1-22.
55. Vroomen, J. and de Gelder, B. (2004). Temporal ventriloquism: sound modulates the flash-lag effect, J. Exper. Psychol. Hum. Percept. Perform. 30, 513-518. (Pubitemid 38726721)
56. Vroomen, J. and Keetels, M. (2006). The spatial constraint in intersensory pairing: no role in temporal ventriloquism, J. Exper. Psychol. Hum. Percept. Perform. 32, 1063-1071. (Pubitemid 44157620)
57. Welch, R. B. and Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy, Psychol. Bull. 88, 638-667.
58. Welch, R. B. and Warren, D. H. (1986). Intersensory interactions, in:Handbook of Perception and Human Performance , Vol. 1, Boff, K. R., Kaufman, L. and Thomas, J. P. (Eds), pp. 1-36. Wiley, New York.
59. Welch, R. B. (1999).Meaning, attention, and the "unity assumption" in the intersensory bias of spatial and temporal perceptions, in:Cognitive Contributions to the Perception of Spatial and Temporal Events , Aschersleben, G., Bachmann, T. andMusseler, J. (Eds), pp. 371-387. Elsevier, Amsterdam.
60. Witten, I. B. and Knudsen, E. I. (2005). Why seeing is believing, Neuron 48, 480-496.
61. Zapparoli, G. C. and Reatto, L. L. (1969). The apparent movement between visual and acoustic stimulus and the problem of intermodal relations, Acta Psychol. (Amst.) 29, 256-267.
62. Zampini, M., Brown, T., Shore, D. I., Maravita, A., Röder, B. and Spence, C. (2005). Audiotactile temporal order judgments, Acta Psychol. (Amst.) 118, 277-291. (Pubitemid 40216883)