Acoustic facilitation of object movement detection during self-motion

Proceedings of the Royal Society B: Biological Sciences

Volumn 278, Issue 1719, 2011, Pages 2840-2847

  Calabro, F J ^a   Soto Faraco, S ^b   Vaina, L M ^a,c  

^a Brain and Vision Research Laboratory   (United States)

^b UNIVERSITAT POMPEU FABRA   (Spain)

^c MASSACHUSETTS GENERAL HOSPITAL   (United States)

Author keywords

Auditory motion; Flow parsing; Multisensory perception; Visual motion; Visual search

Indexed keywords

ACOUSTIC SURVEY; ANIMAL; AUDITORY CUE; HUMAN EVOLUTION; MOVEMENT; PERCEPTION; SELF ORGANIZATION; SENSORY SYSTEM; VISUAL ANALYSIS;

ADULT; ARTICLE; AUDITORY STIMULATION; HUMAN; MALE; MOVEMENT (PHYSIOLOGY); MOVEMENT PERCEPTION; PHOTOSTIMULATION; PHYSIOLOGY; RETINA; VISION;

ACOUSTIC STIMULATION; ADULT; HUMANS; MALE; MOTION PERCEPTION; MOVEMENT; PHOTIC STIMULATION; RETINA; VISUAL PERCEPTION; YOUNG ADULT;

ANIMALIA;

EID: 80051519476     PISSN: 09628452     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rspb.2010.2757     Document Type: Article

References (53)

1. Dick, M., Ullman, S. & Sagi, D. 1987 Parallel and serial processes in motion detection. Science 237, 400-402. (doi:10.1126/science.3603025)
2. McLeod, P., Driver, J. & Crisp, J. 1988 Visual search for a conjunction of movement and form is parallel. Nature 320, 154-155. (doi:10.1038/332154a0)
3. Nakayama, K. & Silverman, G. H. 1986 Serial and parallel processing of visual feature conjunctions. Nature 320, 264-265. (doi:10.1038/320264a0)
4. Duncan, J. 1995 Target and nontarget grouping in visual search. Percept. Psychophys. 57, 117-120.
5. Gibson, J. J. 1950 The perception of the visual world. Boston, MA: Houghton Mifflin.
6. Vaina, L. M. 1998 Complex motion perception and its deficits. Curr. Opin. Neurobiol. 8, 494-502. (doi:10.1016/S0959-4388(98)80037-8)
7. Rushton, S. K. & Warren, P. A. 2005 Moving observers, relative retinal motion and the detection of object movement. Curr. Biol. 15, R542-R543. (doi:10.1016/j.cub.2005.07.020)
8. Rushton, S. K., Bradshaw, M. F. & Warren, P. A. 2007 The pop out of scene-relative object movement against retinal motion due to self-movement. Cognition 105, 237-245. (doi:10.1016/j.cognition.2006.09.004)
9. Warren, P. A. & Rushton, S. K. 2007 Perception of object trajectory: parsing retinal motion into self and object movement components. J. Vis. 7, 2. (doi:10.1167/7.11.2)
10. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C. & Foxe, J. J. 2007 Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 17, 1147-1153. (doi:10.1093/cercor/bhl024)
11. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E. & Foxe, J. J. 2002 Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14, 115-128. (doi:10.1016/S0926-6410(02)00066-6)
12. Vroomen, J. & de Gelder, B. 2000 Sound enhances visual perception: cross-modal effects of auditory organization on vision. J. Exp. Psychol. Hum. Percept. Perform. 26, 1583-1590. (doi:10.1037/0096-1523.26.5.1583)
13. Ladavas, E. 2008 Multisensory-based approach to the recovery of unisensory deficit. Ann. NY Acad. Sci. 1124, 98-110. (doi:10.1196/annals.1440.008)
14. Soto-Faraco, S., Lyons, J., Gazzaniga, M., Spence, C. & Kingstone, A. 2002 The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. Brain Res. Cogn. Brain Res. 14, 139-146. (doi:10.1016/S0926-6410(02)00068-X)
15. Soto-Faraco, S., Spence, C. & Kingstone, A. 2004 Crossmodal dynamic capture: congruency effects in the perception of motion across sensory modalities. J. Exp. Psychol. Hum. Percept. Perform. 30, 330-345. (doi:10.1037/0096-1523.30.2.330)
16. Soto-Faraco, S., Spence, C., Lloyd, D. & Kingstone, A. 2004 Moving multisensory research along: motion perception across sensory modalities. Curr. Direct. Psychol. Sci. 13, 29-32. (doi:10.1111/j.0963-7214.2004.01301008.x)
17. Soto-Faraco, S., Kingstone, A. & Spence, C. 2003 Multisensory contributions to the perception of motion. Neuropsychologia 41, 1847-1862. (doi:10.1016/S0028-3932(03)00185-4)
18. Meyer, G. F., Wuerger, S. M., Röhrbein, F. & Zetzsche, C. 2005 Low-level integration of auditory and visual motion signals requires spatial co-localisation. Exp. Brain Res. 166, 538-547. (doi:10.1007/s00221-005-2394-7)
19. Alais, D. & Burr, D. 2004 No direction-specific bimodal facilitation for audiovisual motion detection. Brain Res. Cogn. Brain Res. 19, 185-194. (doi:10.1016/j.cogbrainres.2003.11.011)
20. Sanabria, D., Lupianez, J. & Spence, C. 2007 Auditory motion affects visual motion perception in a speeded discrimination task. Exp. Brain Res. 178, 415-421. (doi:10.1007/s00221-007-0919-y)
21. Freeman, E. & Driver, J. 2008 Direction of visual apparent motion driven solely by timing of a static sound. Curr. Biol. 18, 1262-1266. (doi:10.1016/j.cub.2008.07.066)
22. Lopez-Moliner, J. & Soto-Faraco, S. 2007 Vision affects how fast we hear sounds move. J. Vis. 7, 1-7. (doi:10.1167/7.12.6)
23. Cappe, C., Thut, G., Romei, V. & Murray, M. M. 2009 Selective integration of auditory-visual looming cues by humans. Neuropsychologia 47, 1045-1052. (doi:10.1016/j.neuropsychologia.2008.11.003)
24. Kitagawa, N. & Ichihara, S. 2002 Hearing visual motion in depth. Nature 416, 172-174. (doi:10.1038/416172a)
25. Valjamae, A. & Soto-Faraco, S. 2008 Filling in visual motion with sounds. Acta Psychol. (Amst.) 129, 249-254. (doi:10.1016/j.actpsy.2008.08.004)
26. Alink, A., Singer, W. & Muckli, L. 2008 Capture of auditory motion by vision is represented by an activation shift from auditory to visual motion cortex. J. Neurosci. 28, 2690-2697. (doi:10.1523/JNEUROSCI.2980-07.2008)
27. Baumann, O. & Greenlee, M. W. 2007 Neural correlates of coherent audiovisual motion perception. Cereb. Cortex 17, 1433-1443.
28. Wolfe, J. M. 1998 What can 1 million trials tell us about visual search? Am. Psychol. Soc. 9, 33-39.
29. Verghese, P. & Pelli, D. G. 1992 The information capacity of visual attention. Vis. Res. 32, 983-995. (doi:10.1016/0042-6989(92)90040-P)
30. Duncan, J. & Humphreys, G. 1989 Visual search and stimulus similarity. Psychol. Rev. 96, 433-458. (doi:10.1037/0033-295X.96.3.433)
31. Bravo, M. & Blake, R. 1990 Preattentive vision and perceptual groups. Perception 19, 515-522. (doi:10.1068/p190515)
32. Cavanagh, P., Arguin, M. & Treisman, A. 1990 Effect of surface medium on visual search for orientation and size features. J. Exp. Psychol. Hum. Percept. Perform. 16, 479-491. (doi:10.1037/0096-1523.16.3.479)
33. Royden, C. S., Wolfe, J. M. & Klempen, N. 2001 Visual search asymmetries in motion and optic flow fields. Percept. Psychophys. 63, 436-444. (doi:10.3758/BF03194410)
34. Rushton, S. K. & Bradshaw, M. F. 2000 Visual search and motion-is it all relative? Spat. Vis. 14, 85-86.
35. Rushton, S. K., Bradshaw, M. F. & Warren, P. A. 2006 The pop out of scene-relative object movement against retinal motion due to self-movement. Cognition 105, 237-245.
36. Van der Burg, E., Olivers, C. N., Bronkhorst, A. W. & Theeuwes, J. 2008 Pip and pop: nonspatial auditory signals improve spatial visual search. J. Exp. Psychol. Hum. Percept. Perform. 34, 1053-1065. (doi:10.1037/0096-1523.34.5.1053)
37. Iordanescu, L., Guzman-Martinez, E., Grabowecky, M. & Suzuki, S. 2008 Characteristic sounds facilitate visual search. Psychon. Bull. Rev. 15, 548-554. (doi:10.3758/PBR.15.3.548)
38. Fujisaki, W., Koene, A., Arnold, D., Johnston, A. & Nishida, S. 2006 Visual search for a target changing in synchrony with an auditory signal. Proc. R. Soc. B 273, 865-874. (doi:10.1098/rspb.2005.3327)
39. Alsius, A., Navarra, J., Campbell, R. & Soto-Faraco, S. 2005 Audiovisual integration of speech falters under high attention demands. Curr. Biol. 15, 839-843. (doi:10.1016/j.cub.2005.03.046)
40. Brainard, D. H. 1997 The psychophysics toolbox. Spat. Vis. 10, 433-436. (doi:10.1163/156856897X00357)
41. Pelli, D. G. 1997 The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 10, 437-442. (doi:10.1163/156856897X00366)
42. McLeod, P., Driver, J., Dienes, Z. & Crisp, J. 1991 Filtering by movement in visual search. J. Exp. Psychol. Hum. Percept. Perform. 17, 55-64. (doi:10.1037/0096-1523.17.1.55)
43. Barker, L. E., Luman, E. T., McCauley, M. M. & Chu, S. Y. 2002 Assessing equivalence: an alternative to the use of difference tests for measuring disparities in vaccination coverage. Am. J. Epidemiol. 156, 1056-1061. (doi:10.1093/aje/kwf149)
44. Barker, L., Rolka, H., Rolka, D. & Brown, C. 2001 Equivalence testing for binomial random variables: which test to use? Am. Stat. 55, 279-287. (doi:10.1198/000313001753272213)
45. Alais, D. & Burr, D. 2004 The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 14, 257-262.
46. Ernst, M. O. & Banks, M. S. 2002 Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433. (doi:10.1038/415429a)
47. Frassinetti, F., Bolognini, N., Bottari, D., Bonora, A. & Ladavas, E. 2005 Audiovisual integration in patients with visual deficit. J. Cogn. Neurosci. 17, 1442-1452. (doi:10.1162/0898929054985446)
48. Frassinetti, F., Bolognini, N. & Ladavas, E. 2002 Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp. Brain Res. Exp. Hirnforsch. Exp. Cereb. 147, 332-343. (doi:10.1007/s00221-002-1262-y)
49. Bolognini, N., Frassinetti, F., Serino, A. & Ladavas, E. 2005 'Acoustical vision' of below threshold stimuli: interaction among spatially converging audiovisual inputs. Exp. Brain Res. 160, 273-282. (doi:10.1007/s00221-004-2005-z)
50. Stein, B. & Meredith, M. 1993 The merging of the senses. Cambridge, MA: MIT Press.
51. Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E. & Foxe, J. J. 2005 Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb. Cortex 15, 963-974. (doi:10.1093/cercor/bhh197)
52. Talsma, D., Senkowski, D., Soto-Faraco, S. & Woldorff, M. G. 2010 The multifaceted interplay between attention and multisensory integration. Trends Cogn. Sci. 14, 400-410. (doi:10.1016/j.tics.2010.06.008)
53. Vaina, L., Calabro, F., Lin, F. & Hamalainen, M. 2010 Long-range coupling of prefrontal cortex and visual (MT) or polysensory (STP) cortical areas in motion perception. 17th International Conference on Biomagnetism Advances in Biomagnetism, Biomag 2010, IFMBE Proceedings, vol. 28, pp. 197-201. Berlin, Germany: Springer Verlag.