Hearing brighter: Changing in-depth visual perception through looming sounds

Cognition

Volumn 132, Issue 3, 2014, Pages 312-323

  Sutherland, Clare A M ^a   Thut, Gregor ^b   Romei, Vincenzo ^c  

^a UNIVERSITY OF YORK   (United Kingdom)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

^c UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

Audio visual integration; Crossmodal perception; Looming sounds

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; BRIGHTNESS; CLINICAL ARTICLE; DECISION MAKING; FEMALE; HEARING; HUMAN; INFORMATION; LOOMING SOUND; LOUDNESS; LUMINANCE; MALE; MASKING; MOTION; NORMAL HUMAN; PRIORITY JOURNAL; SELF REPORT; SOUND; VISION; VISUAL DISCRIMINATION; VISUAL FIELD; VISUAL INFORMATION; VISUAL STIMULATION; ACOUSTIC STIMULATION; ADOLESCENT; AUDITORY PERCEPTION; DEPTH PERCEPTION; HUMANS; PHOTIC STIMULATION; PHYSIOLOGY; REACTION TIME; VISUAL PERCEPTION; YOUNG ADULT;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY PERCEPTION; DEPTH PERCEPTION; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; REACTION TIME; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84900853275     PISSN: 00100277     EISSN: 18737838     Source Type: Journal    
DOI: 10.1016/j.cognition.2014.04.011     Document Type: Article

References (61)

1. Andersen T.S., Mamassian P. Audiovisual integration of stimulus transients. Vision Research 2008, 48(25):2537-2544.
2. Bach D.R., Neuhoff J.G., Perrig W., Seifritz E. Looming sounds as warning signals: The function of motion cues. International Journal of Psychophysiology 2009, 74(1):28-33.
3. Bach D.R., Schächinger H., Neuhoff J.G., Esposito F., Di Salle F., Lehmann C., et al. Rising sound intensity: An intrinsic warning cue activating the amygdala. Cerebral Cortex 2008, 18(1):145-150.
4. Breitmeyer B.G. Visual masking: Past accomplishments, present status, future developments. Advances in Cognitive Psychology 2007, 3(1):9-20.
5. Cappe C., Thelen A., Romei V., Thut G., Murray M.M. Looming signals reveal synergistic principles of multisensory integration. The Journal of Neuroscience 2012, 32(4):1171-1182.
6. Cappe C., Thut G., Romei V., Murray M.M. Selective integration of auditory-visual looming cues by humans. Neuropsychologia 2009, 47(4):1045-1052.
7. Cappe C., Thut G., Romei V., Murray M.M. Auditory-visual multisensory interactions in humans: Timing, topography, directionality, and sources. The Journal of Neuroscience 2010, 30(38):12572-12580.
8. Cecere R., Romei V., Bertini C., Làdavas E. Crossmodal enhancement of visual orientation discrimination by looming sounds requires functional activation of primary visual areas: A case study. Neuropsychologia 2014, 56:350-358.
9. De Haas B., Cecere R., Cullen H., Driver J., Romei V. The duration of a co-occurring sound modulates visual detection performance in humans. PLoS ONE 2013, 8(1):e54789.
10. Dosher B.A., Sperling G., Wurst S.A. Tradeoffs between stereopsis and proximity luminance covariance as determinants of perceived 3D structure. Vision Research 1986, 26(6):973-990.
11. Driver J., Noesselt T. Multisensory interplay reveals crossmodal influences on "sensory-specific" brain regions, neural responses, and judgments. Neuron 2008, 57(1):11-23.
12. Freeman E., Driver J. Direction of visual apparent motion driven solely by timing of a static sound. Current Biology 2008, 18(16):1262-1266.
13. Ghazanfar A.A., Neuhoff J.G., Logothetis N.K. Auditory looming perception in rhesus monkeys. Proceedings of the National Academy of Sciences 2002, 99(24):15755-15757.
14. Giard M.H., Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience 1999, 11(5):473-490.
15. Gordon M.S., Rosenblum L.D. Effects of intrastimulus modality change on audiovisual time-to-arrival judgments. Perception & Psychophysics 2005, 67(4):580-594.
16. Graziano M.S.A., Cooke D.F. Parieto-frontal interactions, personal space, and defensive behavior. Neuropsychologia 2006, 44(6):845-859.
17. Green D.M., Swets J.A. Signal detection theory and psychophysics 1966, Vol. 1. Wiley, New York.
18. Guski R. Acoustic tau: An easy analogue to visual tau?. Ecological Psychology 1992, 4(3):189-197.
19. Guttman S.E., Gilroy L.A., Blake R. Hearing what the eyes see: Auditory encoding of visual temporal sequences. Psychological Science 2005, 16(3):228-235.
20. Harrison N. Auditory motion in depth is preferentially captured by visual looming signals. Seeing and Perceiving 2012, 25(1):71-85.
21. Haynes J.-D., Driver J., Rees G. Visibility reflects dynamic changes of effective connectivity between V1 and fusiform cortex. Neuron 2005, 46(5):811-821.
22. Hubel D.H., Wiesel T.N., Stryker M.P. Orientation columns in macaque monkey visual cortex demonstrated by the 2-deoxyglucose autoradiographic technique. Nature 1977, 269(5626):328-330.
23. Kayser C., Petkov C.I., Augath M., Logothetis N.K. Functional imaging reveals visual modulation of specific fields in auditory cortex. The Journal of Neuroscience 2007, 27(8):1824-1835.
24. Kelly F., Grossberg S. Neural dynamics of 3-D surface perception: Figure-ground separation and lightness perception. Perception & Psychophysics 2000, 62(8):1596-1618.
25. Kitagawa N., Ichihara S. Hearing visual motion in depth. Nature 2002, 416(6877):172-174.
26. Kouider S., Dupoux E. A functional disconnection between spoken and visual word recognition: Evidence from unconscious priming. Cognition 2001, 82(1):B35-B49.
27. Lankheet M.J.M., Van Doorn A.J., Van de Grind W.A. Spatio-temporal tuning of motion coherence detection at different luminance levels. Vision Research 2002, 42(1):65-73.
28. Leo F., Romei V., Freeman E., Ladavas E., Driver J. Looming sounds enhance orientation sensitivity for visual stimuli on the same side as such sounds. Experimental Brain Research 2011, 213(2-3):193-201.
29. Maier J.X., Chandrasekaran C., Ghazanfar A.A. Integration of bimodal looming signals through neuronal coherence in the temporal lobe. Current Biology 2008, 18(13):963-968.
30. Maier J.X., Ghazanfar A.A. Looming biases in monkey auditory cortex. The Journal of Neuroscience 2007, 27(15):4093-4100.
31. Maier J.X., Neuhoff J.G., Logothetis N.K., Ghazanfar A.A. Multisensory integration of looming signals by rhesus monkeys. Neuron 2004, 43(2):177-181.
32. Maij F., Brenner E., Smeets J.B. Temporal information can influence spatial localization. Journal of Neurophysiology 2009, 102(1):490-495.
33. Martuzzi R., Murray M.M., Michel C.M., Thiran J.-P., Maeder P.P., Clarke S., et al. Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cerebral Cortex 2007, 17(7):1672-1679.
34. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cognitive Brain Research 2002, 14(1):115-128.
35. Morland A.B., Ogilvie J.A., Ruddock K.H., Wright J.R. Orientation discrimination is impaired in the absence of the striate cortical contribution to human vision. Proceedings of the Royal Society of London. Series B: Biological Sciences 1996, 263(1370):633-640.
36. Neuhoff J.G. Perceptual bias for rising tones. Nature 1998, 395(6698):123-124.
37. Neuhoff J.G. An adaptive bias in the perception of looming auditory motion. Ecological Psychology 2001, 13(2):87-110.
38. Noesselt T., Rieger J.W., Schoenfeld M.A., Kanowski M., Hinrichs H., Heinze H.-J., et al. Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. The Journal of Neuroscience 2007, 27(42):11431-11441.
39. Noesselt T., Tyll S., Boehler C.N., Budinger E., Heinze H.-J., Driver J. Sound-induced enhancement of low-intensity vision: Multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. The Journal of Neuroscience 2010, 30(41):13609-13623.
40. Odgaard E.C., Arieh Y., Marks L.E. Cross-modal enhancement of perceived brightness: Sensory interaction versus response bias. Perception & Psychophysics 2003, 65(1):123-132.
41. O'Shea R.P., Blackburn S.G., Ono H. Contrast as a depth cue. Vision Research 1994, 34(12):1595-1604.
42. Raij T., Ahveninen J., Lin F.-H., Witzel T., Jääskeläinen I.P., Letham B., et al. Onset timing of cross-sensory activations and multisensory interactions in auditory and visual sensory cortices. European Journal of Neuroscience 2010, 31(10):1772-1782.
43. Ramos-Estebanez C., Merabet L.B., Machii K., Fregni F., Thut G., Wagner T.A., et al. Visual phosphene perception modulated by subthreshold crossmodal sensory stimulation. The Journal of Neuroscience 2007, 27(15):4178-4181.
44. Recanzone G.H. Auditory influences on visual temporal rate perception. Journal of Neurophysiology 2003, 89(2):1078-1093.
45. Romei V., De Haas B., Mok R.M., Driver J. Auditory stimulus timing influences perceived duration of co-occurring visual stimuli. Frontiers in Psychology 2011, 2:215-249.
46. Romei V., Gross J., Thut G. Sounds reset rhythms of visual cortex and corresponding human visual perception. Current Biology 2012, 22(9):807-813.
47. Romei V., Murray M.M., Cappe C., Thut G. Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds. Current Biology 2009, 19(21):1799-1805.
48. Romei V., Murray M.M., Cappe C., Thut G. The contributions of sensory dominance and attentional bias to cross-modal enhancement of visual cortex excitability. Journal of Cognitive Neuroscience 2013, 25(7):1122-1135.
49. Romei V., Murray M.M., Merabet L.B., Thut G. Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: Implications for multisensory interactions. The Journal of Neuroscience 2007, 27(43):11465-11472.
50. Saygin A.P., Driver J., de Sa V.R. In the footsteps of biological motion and multisensory perception: Judgments of audiovisual temporal relations are enhanced for upright walkers. Psychological Science 2008, 19(5):469-475.
51. Schiff W. Perception of impending collision: A study of visually directed avoidant behavior. Psychological Monographs: General and Applied 1965, 79(11):1-26.
52. Schiff W., Caviness J.A., Gibson J.J. Persistent fear responses in rhesus monkeys to the optical stimulus of "looming". Science 1962, 136(3520):982-983.
53. Seifritz E., Esposito F., Hennel F., Mustovic H., Neuhoff J.G., Bilecen D., et al. Spatiotemporal pattern of neural processing in the human auditory cortex. Science 2002, 297(5587):1706-1708.
54. Shams L., Kamitani Y., Shimojo S. Visual illusion induced by sound. Cognitive Brain Research 2002, 14(1):147-152.
55. Shams L., Kamitani Y., Thompson S., Shimojo S. Sound alters visual evoked potentials in humans. NeuroReport 2001, 12(17):3849-3852.
56. Soto-Faraco S., Lyons J., Gazzaniga M., Spence C., Kingstone A. The ventriloquist in motion: Illusory capture of dynamic information across sensory modalities. Cognitive Brain Research 2002, 14(1):139-146.
57. Soto-Faraco S., Spence C., Lloyd D., Kingstone A. Moving multisensory research along motion perception across sensory modalities. Current Directions in Psychological Science 2004, 13(1):29-32.
58. Tajadura-Jiménez A., Väljamäe A., Asutay E., Västfjäll D. Embodied auditory perception: The emotional impact of approaching and receding sound sources. Emotion 2010, 10(2):216.
59. Teghtsoonian R., Teghtsoonian M., Canévet G. Sweep-induced acceleration in loudness change and the "bias for rising intensities". Perception & Psychophysics 2005, 67(4):699-712.
60. Tyll S., Bonath B., Schoenfeld M.A., Heinze H.-J., Ohl F.W., Noesselt T. Neural basis of multisensory looming signals. NeuroImage 2013, 65:13-22.
61. Walker-Andrews A., Lennon E.M. Auditory-visual perception of changing distance by human infants. Child Development 1985, 56(3):544-548.