Separation between sound and light enhances audio-visual prior entry effect

IEICE Transactions on Information and Systems

Volumn E91-D, Issue 6, 2008, Pages 1641-1648

  Hongoh, Yuki ^a,b   Kita, Shinichi ^a   Soeta, Yoshiharu ^c  

^a KOBE UNIVERSITY   (Japan)

^b JAPAN SOCIETY FOR THE PROMOTION OF SCIENCE   (Japan)

^c NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Audio visual interaction; Multisensory perception; Prior entry effect; Temporal order judgment (TOJ)

Indexed keywords

LIGHT EMITTING DIODES; LOUDSPEAKERS;

AUDIO-VISUAL INTERACTIONS; MULTISENSORY PERCEPTIONS; MULTISENSORY STIMULUS; PRIOR ENTRY EFFECT; SPATIAL PROXIMITY; SPATIAL SEPARATION; TEMPORAL ORDER JUDGMENTS; VISUAL STIMULUS;

AUDIO ACOUSTICS;

EID: 68149180485     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1093/ietisy/e91-d.6.1641     Document Type: Article

References (29)

1. C.E. Jack andW.R. Thurlow, "Effects of degree of visual association and angle of displacement on the "ventriloquism" effect," Percept. Mot. Skills, vol.37, no.3, pp.967-979, Dec. 1973.
2. K.G. Munhall, P. Gribble, L. Sacco, and M. Ward, "Temporal constraints on the McGurk effect," Percept. Psychophys., vol.58, no.3, pp.351-362, April 1996.
3. Y. Hongoh and S. Kita, "The effect of spatial congruence on audiovisual interaction in temporal perception," Japanese Journal of Cognitive Psychology, vol.3, no.1, pp.13-21, Aug. 2005.
4. Y. Hongoh, S. Kita, and Y. Soeta, "Auditory cue effect on visual temporal order judgment: The spatial proximity of audio and visual stimuli," Proc. 7th Annual Meeting of IMRF, pp.35-36, Dublin, Ireland, June 2006.
5. R. Fendrich and P.M. Corballis, "The temporal cross-capture of audition and vision," Percept. Psychophys., vol.63, no.4, pp.719-725, May 2001.
6. W.R. Thurlow and C.E. Jack, "Certain determinants of the "ventriloquism effect"," Percept. Mot. Skills, vol.36, no.3, pp.1171-1184, June 1973.
7. H. McGurk and J. MacDonald, "Hearing lips and seeing voices," Nature, vol.264, no.5588, pp.746-748, Dec. 1976.
8. I.P. Howard and W.B. Templeton, Human spatial orientation, Wiley, London, 1966.
9. E.B. Titchener, "The law of attention II (section of 'prior entry')," in Lectures on the Elementary Psychology of Feeling and Attention, pp.251-259, Macmillan, New York, 1908.
10. D.I. Shore and C. Spence, "Prior entry," in Neurobiology of Attention, ed. L. Itti, G. Rees, and J. Tostos, pp.89-95, Elsevier Academic, New York, 2005.
11. S. Morein-Zamir, S. Soto-Faraco, and A. Kingstone, "Auditory capture of vision: Examining temporal ventriloquism," Brain Res. Cogn. Brain Res., vol.17, no.1, pp.154-163, June 2003.
12. L. Shams, Y. Kamitani, and S. Shimojo, "Visual illusion induced by sound," Brain Res. Cogn. Brain Res., vol.14, no.1, pp.147-152, June 2002.
13. S. Shimojo, C. Scheier, R. Nijhawan, L. Shams, K. Kamitani, and K. Watanabe, "Beyond perceptual modality: Auditory effects on visual perception," Acoust. Sci. & Tech., vol.22, no.2, pp.61-67, March 2001.
14. K. Watanabe and S. Shimojo, "When sound affects vision: Effects of auditory grouping on visual motion perception," Psychol. Sci., vol.12, no.2, pp.109-116, March 2001.
15. J. Driver and C.J. Spence, "Spatial synergies between auditory and visual attention," in Attention and Performance XV: Conscious and Nonconcious Information Processing, ed. C. Umiltá and M. Moscovitch, pp.311-331, MIT Press, Cambridge, Massachusetts, 1994.
16. C. Spence, J. Ranson, and J. Driver, "Cross-modal selective attention: On the difficulty of ignoring sounds at the locus of visual attention," Percept. Psychophys., vol.62, no.2, pp.410-424, Feb. 2000.
17. B.E. Stein, N. London, L.K.Wilkinson, and D. Price, "Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis," J. Cogn. Neurosci., vol.8, no.6, pp.497-506, Nov. 1996.
18. G.H. Recanzone, "Auditory influences on visual temporal rate perception," J. Neurophysiol., vol.89, no.2, pp.1078-1093, Feb. 2003.
19. R.B. Welch, L.D. DuttonHurt, and D.H. Warren, "Contributions of audition and vision to temporal rate perception," Percept. Psychophys., vol.39, no.4, pp.294-300, April 1986.
20. J. Vroomen and M. Keetels, "The spatial constraint in intersensory pairing: No role in temporal ventriloquism," J. Exp. Psychol. Hum. Percept. Perform., vol.32, no.4, pp.1063-1071, Aug. 2006.
21. B.E. Stein and M.A. Meredith, The merging of the senses, MIT Press, Cambridge, Massachusetts, 1993.
22. T. Nagai, T. Hoshino, and K. Uchikawa, "Statistical significance testing of threshold estimated by constant stimuli method," Vision, vol.18, no.3, pp.113-124, July 2006.
23. R. Sekuler, A.B. Sekuler, and R. Lau, "Sound alters visual motion perception," Nature, vol.385, no.6614, p.308, Jan. 1997.
24. S. Shimojo, S. Miyauchi, and O. Hikosaka, "Visual motion sensation yielded by non-visually driven attention," Vision Res., vol.37, no.12, pp.1575-1580, June 1997.
25. C. Spence, R. Baddeley, M. Zampini, R. James, and D.I. Shore, "Multisensory temporal order judgments: When two locations are better than one," Percept. Psychophys., vol.65, no.2, pp.318-328, Feb. 2003.
26. M. Zampini, D.I. Shore, and C. Spence, "Audiovisual temporal order judgments," Exp. Brain Res., vol.152, no.2, pp.198-210, Sept. 2003.
27. M. Zampini, D.I. Shore, and C. Spence, "Multisensory temporal order judgments: The role of hemispheric redundancy," Int. J. Psychophysiol., vol.50, no.1-2, pp.165-180, Oct. 2003.
28. R.B. Welch and D.H. Warren, "Immediate perceptual response to intersensory discrepancy," Psychol. Bull., vol.88, no.3, pp.638-667, Nov. 1980.
29. M.O. Ernst and M.S. Banks, "Humans integrate visual and haptic information in a statistically optimal fashion," Nature, vol.415, no.6870, pp.429-433, Jan. 2002.