Visual search for a target changing in synchrony with an auditory signal

Proceedings of the Royal Society B: Biological Sciences

Volumn 273, Issue 1588, 2006, Pages 865-874

  Fujisaki, Waka ^a,d   Koene, Ansgar ^b   Arnold, Derek ^b,c   Johnston, Alan ^b   Nishida, Shin'ya ^a  

^a NTT Communication Science Laboratories   (Japan)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF SYDNEY   (Australia)

^d JAPAN SOCIETY FOR THE PROMOTION OF SCIENCE   (Japan)

Author keywords

Audio visual synchrony; Cross modal perception; Visual search

Indexed keywords

AUDITORY CUE; SYNCHRONY; TEMPORAL ANALYSIS; VISUAL CUE;

AMPLITUDE MODULATION; ARTICLE; ATTENTION; AUDITORY STIMULATION; CONTROLLED STUDY; HEARING; HUMAN; HUMAN EXPERIMENT; LINEAR SYSTEM; NOISE; NORMAL HUMAN; PRIORITY JOURNAL; REACTION TIME; SIGNAL TRANSDUCTION; VISION; VISUAL STIMULATION;

PIPS;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; HEARING; HUMANS; MODELS, BIOLOGICAL; PHOTIC STIMULATION; REACTION TIME; VISUAL PERCEPTION;

EID: 34249014111     PISSN: 09628452     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rspb.2005.3327     Document Type: Article

References (50)

1. Alais, D. & Burr, D. 2004 No direction-specific bimodal facilitation for audio-visual motion detection. Brain Res. Cogn. Brain Res. 19, 185-194. (doi:10.1016/j.cogbrainres.2003.11.011)
2. Alais, D. & Carlile, S. 2005 Synchronizing to real events: subjective audio-visual alignment scales with perceived auditory depth and speed of sound. Proc. Natl Acad. Sci. USA 102, 2244-2247.
3. Alsius, A., Navarra, J., Campbell, R. & Soto-Faraco, S. 2005 Audiovisual integration of speech falters under high attention demands. Curr. Biol. 15, 839-843. (doi:10.1016/j.cub.2005.03.046)
4. Arnold, D. H., Johnston, A. & Nishida, S. 2005 Timing sight and sound. Vision Res. 45, 1275-1284. (doi:10.1016/j.visres.2004.11. 014)
5. Arrighi, R., Alais, D. & Burr, D. 2005 Perceived timing of first and second order changes in vision and audition. Exp. Brain Res. 166, 445-454.
6. Bertelson, P., Vroomen, J., de Gelder, B. & Driver, J. 2000 The ventriloquist effect does not depend on the direction of deliberate visual attention. Percept. Psychophys. 62, 321-332.
7. Dixon, N. F. & Spitz, L. 1980 The detection of auditory visual desynchrony. Perception 9, 719-721.
8. Driver, J. 1996 Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature 381, 66-68. (doi:10.1038/381066a0)
9. Engel, G. R. & Dougherty, W. G. 1971 Visual-auditory distance constancy. Nature 234, 308.
10. Fujisaki, W. & Nishida, S. 2005 Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals. Exp. Brain Res. 166, 455-464.
11. Fujisaki, W., Shimojo, S., Kashino, M. & Nishida, S. 2004 Recalibration of audio-visual simultaneity. Nat. Neurosci. 7, 773-778. (doi:10.1038/nn1268)
12. Hacker, M. & Ratcliff, R. 1979 A revised table of d′ for M-alternative forced choice. Percept. Psychophys. 26, 168-170.
13. Hirahara, T. 2004 Physical characteristics of headphones used in psychophysical experiments. Acoust. Sci. & Tech. 25, 276-285. (doi:10.1250/ast.25.276)
14. Holcombe, A. O. & Cavanagh, P. 2001 Early binding of feature pairs for visual perception. Nat. Neurosci. 4, 127-128. (doi:10.1038/83945)
15. Kelly, D. H. 1979 Motion and vision. II. Stabilized spatio-temporal threshold surface. J. Opt. Soc. Am. 69, 1340-1349.
16. Koene, A., Fujisaki, W., Arnold, D. H., Johnston, A. & Nishida, S. 2005 Cross modal correlation search in the presence of visual distractors. [Abstract.] J. Vision 5, 876a. See http://journalofvision.org/5/8/ 876. (doi:10.1167/5.8.876)
17. Kopinska, A. & Harris, L. R. 2004 Simultaneity constancy. Perception 33, 1049-1060. (doi:10.1068/p5169)
18. Lewald, J. & Guski, R. 2004 Auditory-visual temporal integration as a function of distance: no compensation for sound-transmission time in human perception. Neurosci. Lett. 357, 119-122. (doi:10.1016/j.neulet. 2003.12.045)
19. Lewkowicz, D. J. 1996 Perception of auditory-visual temporal synchrony in human infants. J. Exp. Psychol. Hum. Percept. Perform. 22, 1094-1106. (doi:10.1037/0096-1523.22.5.1094)
20. Loomis, J. M. 1978 Lateral masking in foveal and eccentric vision. Vision Res. 18, 335-338. (doi:10.1016/0042-6989(78)90168-2)
21. Lu, Z. L. & Sperling, G. 2001 Three-systems theory of human visual motion perception: review and update. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 18, 2331-2370.
22. McGurk, H. & MacDonald, J. 1976 Hearing lips and seeing voices. Nature 264, 746-748. (doi:10.1038/264746a0)
23. Meyer, G. F. & Wuerger, S. M. 2001 Cross-modal integration of auditory and visual motion signals. Neuroreport 12, 2557-2560. (doi:10.1097/00001756-200108080-00053)
24. Meyer, G. F., Wuerger, S. M., Rohrbein, F. & Zetzsche, C. 2005 Low-level integration of auditory and visual motion signals requires spatial co-localisation. Exp. Brain Res. 166, 538-547.
25. Morein-Zamir, S., Soto-Faraco, S. & Kingstone, A. 2003 Auditory capture of vision: examining temporal ventriloquism. Brain Res. Cogn. Brain Res. 17, 154-163. (doi:10.1016/S0926-6410(03)00089-2)
26. Munhall, K. G., Gribble, P., Sacco, L. & Ward, M. 1996 Temporal constraints on the McGurk effect. Percept. Psychophys. 58, 351-362.
27. Nishida, S. & Johnston, A. 2002 Marker correspondence, not processing latency, determines temporal binding of visual attributes. Curr. Biol. 12, 359-368. (doi:10.1016/S0960-9822(02)00698-X)
28. Odgaard, E. C., Arieh, Y. & Marks, L. E. 2003 Cross-modal enhancement of perceived brightness: sensory interaction versus response bias. Percept. Psychophys. 65, 123-132.
29. Odgaard, E. C., Arieh, Y. & Marks, L. E. 2004 Brighter noise: sensory enhancement of perceived loudness by concurrent visual stimulation. Cogn. Affect. Behav. Neurosci. 4, 127-132.
30. Palmer, J., Verghese, P. & Pavel, M. 2000 The psychophysics of visual search. Vision Res. 40, 1227-1268. (doi:10.1016/S0042-6989(99) 00244-8)
31. Recanzone, G. H. 2003 Auditory influences on visual temporal rate perception. J. Neurophysiol. 89, 1078-1093.
32. Sanabria, D., Soto-Faraco, S., Chan, J. & Spence, C. 2005 Intramodal perceptual grouping modulates multisensory integration: evidence from the crossmodal dynamic capture task. Neurosci. Lett. 377, 59-64. (doi:10.1016/j.neulet.2004.11.069)
33. Sekuler, R., Sekuler, A. B. & Lau, R. 1997 Sound alters visual motion perception. Nature 385, 308. (doi:10.1038/385308a0)
34. Shams, L., Kamitani, Y. & Shimojo, S. 2000 Illusions. What you see is what you hear. Nature 408, 788. (doi:10.1038/35048669)
35. Sheth, B. R. & Shimojo, S. 2004 Sound-aided recovery from and persistence against visual filling-in. Vision Res. 44, 1907-1917. (doi:10.1016/j.visres.2004.03.009)
36. Shimojo, S. & Shams, L. 2001 Sensory modalities are not separate modalities: plasticity and interactions. Curr. Opin. Neurobiol. 11, 505-509. (doi:10.1016/S0959-4388(00)00241-5)
37. Shipley, T. 1964 Auditory flutter-driving of visual flicker. Science 145, 1328-1330.
38. Soto-Faraco, S., Lyons, J., Gazzaniga, M., Spence, C. & Kingstone, A. 2002 The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. Brain Res. Cogn. Brain Res. 14, 139-146. (doi:10.1016/S0926-6410(02)00068-X)
39. Soto-Faraco, S., Navarra, J. & Alsius, A. 2004 Assessing automaticity in audio-visual speech integration: evidence from the speeded classification task. Cognition 92, B13-B23. (doi:10.1016/j.cognition.2003.10.005)
40. Soto-Faraco, S., Spence, C. & Kingstone, A. 2005 Assessing automaticity in the audio-visual integration of motion. Acta Psychol. (Amst) 118, 71-92. (doi:10.1016/j.actpsy.2004.10.008)
41. Spence, C. & Driver, J. 2000 Attracting attention to the illusory location of a sound: reflexive crossmodal orienting and ventriloquism. Neuroreport 11, 2057-2061.
42. Stein, B. E., London, N., Wilkinson, L. K. & Price, D. D. 1996 Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis. J. Cogn. Neurosci. 8, 497-506.
43. Stone, J. V., Hunkin, N. M., Porrill, J., Wood, R., Keeler, V., Beanland, M., Port, M. & Porter, N. R. 2001 When is now? Perception of simultaneity. Proc. R. Soc. B 268, 31-38. (doi:10.1098/rspb.2000.1326)
44. Sugita, Y. & Suzuki, Y. 2003 Audiovisual perception: implicit estimation of sound-arrival time. Nature 421, 911. (doi:10.1038/421911a)
45. Treisman, A. M. & Gelade, G. 1980 A feature-integration theory of attention. Cognit. Psychol. 12, 97-136. (doi:10.1016/0010-0285(80) 90005-5)
46. van de Par, S. & Kohlrausch, A. 2004 Visual and auditory object selection based on temporal correlations between auditory and visual cues. In Proc. 18th Int. Congress on Acoustics. Kyoto, Japan, 4-9 April 2004, pp. 2055-2058.
47. Vroomen, J., Bertelson, P. & de Gelder, B. 2001 The ventriloquist effect does not depend on the direction of automatic visual attention. Percept. Psychophys. 63, 651-659.
48. Vroomen, J., Keetels, M., de Gelder, B. & Bertelson, P. 2004 Recalibration of temporal order perception by exposure to audio-visual asynchrony. Brain Res. Cogn. Brain Res. 22, 32-35. (doi:10.1016/j.cogbrainres.2004.07.003)
49. Watanabe, K. & Shimojo, S. 2001 When sound affects vision: effects of auditory grouping on visual motion perception. Psychol. Sci. 12, 109-116. (doi:10.1111/1467-9280.00319)
50. Wuerger, S. M., Hofbauer, M. & Meyer, G. F. 2003 The integration of auditory and visual motion signals at threshold. Percept. Psychophys. 65, 1188-1196.