Changing pitch of sounds alters perceived visual motion trajectory

Multisensory Research

Volumn 26, Issue 4, 2013, Pages 317-332

  Takeshima, Yasuhiro ^a   Gyoba, Jiro ^a  

^a TOHOKU UNIVERSITY   (Japan)

Author keywords

Apparent motion; Audio visual interaction; Cross modal correspondences; Multisensory perception

Indexed keywords

APPARENT MOTION; ASYMMETRICAL EFFECTS; AUDIO-VISUAL INTERACTIONS; CROSS-MODAL; MOTION TRAJECTORIES; MULTISENSORY PERCEPTIONS; PERIPHERAL VISUAL FIELD; VISUAL PERCEPTION;

RELIABILITY; TRAJECTORIES;

VISION;

ADULT; ARTICLE; AUDITORY STIMULATION; COMPARATIVE STUDY; FEMALE; HEARING; HUMAN; MALE; METHODOLOGY; MOTION; MOVEMENT PERCEPTION; PHOTOSTIMULATION; PHYSIOLOGY; REPRODUCIBILITY; VISION; YOUNG ADULT; PROCEDURES;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; FEMALE; HUMANS; MALE; MOTION; MOTION PERCEPTION; PHOTIC STIMULATION; REPRODUCIBILITY OF RESULTS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84893306614     PISSN: 22134794     EISSN: 22134808     Source Type: Journal    
DOI: 10.1163/22134808-00002422     Document Type: Article

References (38)

1. Alais, D., Newell, F. N. and Mamassian, P. (2010). Multisensory processing in review: from physiology to behavior, Seeing Perceiv. 23, 3-38.
2. Anstis, S. M. (1974). A chart demonstrating variations in acuity with retinal position, Vision Res. 14, 589-592.
3. Burr, D. (1980). Motion smear, Nature 284, 164-165. (Pubitemid 10114589)
4. Chiou, R. and Rich, A. N. (2012). Cross-modality correspondence between pitch and spatial location modulates attentional orienting, Perception 41, 339-353.
5. Clavagnier, S., Falchier, A. and Kennedy, H. (2003). Long-distance feedback projections to area V1: Implications for multisensory integration, spatial awareness, and visual consciousness, Cogn. Affect. Behav. Neurosci. 4, 117-126. (Pubitemid 39167154)
6. Driver, J. and Spence, C. (2000).Multisensory perception: beyond modularity and convergence, Curr. Biol. 10, R731-R735.
7. Falchier, A., Clavagnier, S., Barone, P. and Kennedy, H. (2002). Anatomical evidence of multimodal integration in primate striate cortex, J. Neurosci. 22, 5749-5759. (Pubitemid 35386498)
8. Hedger, S. C., Nusbaum, H. C., Lescop, O., Wasllisch, P. and Hoeckner, B. (in press). Music can elicit a visual motion aftereffect, Attent. Percept. Psychophys.
9. Klapetek, A., Ngo, M. K. and Spence, C. (2012). Does crossmodal correspondence modulate the facilitatory effect of auditory cues on visual search? Atten. Percept. Psychophys. 74, 1154-1167.
10. Klein, I., Dubois, J.,Mangin, J.-F., Kherif, F., Flandin, G., Poline, J.-B., Poline, J.-B., Denis, M., Kosslyn, S. M. and Bihan, D. L. (2004). Retinotopic organization of visual mental images as revealed by functional magnetic resonance imaging, Cogn. Brain Res. 22, 26-31. (Pubitemid 39550748)
11. Maeda, F., Kanai, R. and Shimojo, S. (2004). Changing pitch induced visual motion illusion, Curr. Biol. 14, R990-R991. (Pubitemid 39637688)
12. Meyer, G. F. andWuerger, S. M. (2001). Cross-modal integration of auditory and visual motion signals, NeuroReport. 12, 2557-2560. (Pubitemid 32682221)
13. Meyer, G. F., Wuerger, S. M., Rohrbein, F. and Zetzsche, C. (2005). Low-level integration of auditory and visual motion signals requires spatial co-localisation, Exp. Brain Res. 166, 538-547. (Pubitemid 41502097)
14. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E. and Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study, Cogn. Brain Res. 14, 115-128. (Pubitemid 34626802)
15. Morein-Zamir, S., Soto-Faraco, S. and Kingstone, A. (2003). Auditory capture of vision: examining temporal ventriloquism, Cogn. Brain Res. 17, 154-163. (Pubitemid 36577550)
16. Parise, C. V. and Spence, C. (2009). ?When birds of a feather flock together?: synesthetic correspondences modulate audiovisual integration in non-synesthetes, PLoS ONE 4, 1-7.
17. Rockland, K. S. and Ojima, H. (2003). Multisensory convergence in calcarine visual areas in macaque monkey, Int. J. Psychophysiol. 50, 19-26. (Pubitemid 37162868)
18. Sadaghiani, S., Maier, J. X. and Noppeney, U. (2009). Natural, metaphoric, and linguistic auditory directions signals have distinct influences on visual motion processing, J. Neurosci. 29, 6490-6499.
19. Schroger, E. and Widmann, A. (1998). Speeded responses to audiovisual signal changes result from bimodal integration, Psychophysiol. 35, 755-759. (Pubitemid 28533608)
20. Shams, L., Kamitani, Y. and Shimojo, S. (2000). What you see is what you hear, Nature 408, 788.
21. Shams, L., Kamitani, Y. and Shimojo, S. (2002). Visual illusion induced by sound, Cogn. Brain Res. 14, 147-152. (Pubitemid 34626805)
22. Shimojo, S. and Shams, L. (2001). Sensory modalities are not separate modalities: plasticity and interactions, Curr. Opin. Neurobiol. 11, 505-509. (Pubitemid 32739179)
23. Shipley, T. (1964). Auditory flutter-driving of visual flicker, Science 145, 1328-1330.
24. Slotnick, S. D., Thompson, W. L. and Kosslyn, S. M. (2005). Visual mental imagery induces retinotopically organized activation of early visual areas, Cereb. Cortex. 15, 1570-1583. (Pubitemid 41344506)
25. Soto-Faraco, S., Kingstone, A. and Spence, C. (2003). Multisensory contributions to the perception of motion, Neuropsychologia 41, 1847-1862. (Pubitemid 37188426)
26. Soto-Faraco, S., Spence, C. and Kingstone, A. (2004). Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities, J. Exp. Psychol. Hum. Percept. Perform. 30, 330-345. (Pubitemid 38422589)
27. Soto-Faraco, S., Kingstone, A. and Spence, C. (2005). Assessing automaticity in the audiovisual integration of motion, Acta Psychol. 118, 71-92. (Pubitemid 40289693)
28. Spence, C. (2007). Audiovisual multisensory integration, Acoust. Sci. Technol. 28, 61-70. (Pubitemid 46457224)
29. Spence, C. (2011). Crossmodal correspondences: a tutorial review, Attent. Percept. Psychophys. 73, 971-995.
30. Sumby, W. H. and Pollack, I. (1954). Visual contribution to speech intelligibility in noise, J. Acoust. Soc. Am. 26, 212-215.
31. Takeshima, Y. and Gyoba, J. (2011). Modification of velocity perception by loud sounds, Jpn. J. Psychon. Sci. 30 (Special issue), 19-24.
32. Takeshima, Y. and Gyoba, J. (2013). High-intensity sound increases size of visually perceived objects, Attent. Percept. Psychophys. 75, 501-507.
33. Talsma, D., Senkowski, D., Soto-Faraco, S. and Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration, Trends Cogn. Sci. 14, 400-410.
34. Vroomen, J. and de Gelder, B. (2004). Temporal ventriloquism: sound modulates the flash-lag effect, J. Exp. Psychol. Hum. Percept. Perform. 30, 513-518. (Pubitemid 38726721)
35. Wada, Y., Kitagawa, N. and Noguchi, K. (2003). Audio-visual integration in temporal perception, Int. J. Psychophysiol. 50, 117-124. (Pubitemid 37162875)
36. Watkins, S., Shams, L., Tanaka, S., Haynes, J.-D. and Rees, G. (2006). Sound alters activity in human V1 in association with illusory visual perception, NeuroImage 31, 1247-1256. (Pubitemid 43870257)
37. Watkins, S., Shams, L., Josephs, O. and Rees, G. (2007). Activity in human V1 follows multisensory perception, NeuroImage 37, 572-578. (Pubitemid 47454512)
38. Welch, R. B. andWarren, D. H. (1980). Immediate perceptual response to intersensory discrepancy, Psychol. Bull. 88, 638-667.