Eccentricity dependent auditory enhancement of visual stimulus detection but not discrimination

Frontiers in Integrative Neuroscience

Volumn , Issue JUL, 2013, Pages

  Gleiss, Stephanie ^a   Kayser, Christoph ^a,b  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Audio visual integration; Cross modal facilitation; Multisensory; Perception; Visual field

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; FACILITATION; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; NEUROANATOMY; NORMAL HUMAN; SOUND; STATISTICAL ANALYSIS; TASK PERFORMANCE; VISION; VISUAL ACUITY; VISUAL DISCRIMINATION; VISUAL MEMORY; VISUAL STIMULATION; VISUAL SYSTEM PARAMETERS;

EID: 84879751004     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2013.00052     Document Type: Article

References (50)

1. Alais, D., and Burr, D. (2004a). No direction-specific bimodal facilitation for audiovisual motion detection. Brain Res Cogn Brain Res 19, 185-194.
2. Alais, D., and Burr, D. (2004b). The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14, 257-262.
3. Andersen, T.S., and Mamassian, P. (2008). Audiovisual integration of stimulus transients. Vision Res 48, 2537-2544.
4. Anstis, S.M. (1974). Letter: A chart demonstrating variations in acuity with retinal position. Vision Res 14, 589-592.
5. Bizley, J.K., and King, A.J. (2008). Visual-auditory spatial processing in auditory cortical neurons. Brain Res 1242, 24-36.
6. Bizley, J.K., Walker, K.M., Nodal, F.R., King, A.J., and Schnupp, J.W. (2013). Auditory cortex represents both pitch judgments and the corresponding acoustic cues. Curr Biol 23, 620-625.
7. Bolognini, N., Frassinetti, F., Serino, A., and Ladavas, E. (2005). "Acoustical vision" of below threshold stimuli: interaction among spatially converging audiovisual inputs. Exp Brain Res 160, 273-282.
8. Carrasco, M. (2006). Covert attention increases contrast sensitivity: Psychophysical, neurophysiological and neuroimaging studies. Prog Brain Res 154, 33-70.
9. Chen, Y.C., Huang, P.C., Yeh, S.L., and Spence, C. (2011). Synchronous sounds enhance visual sensitivity without reducing target uncertainty. Seeing and Perceiving 24, 623-638.
10. Engineer, C.T., Perez, C.A., Chen, Y.H., Carraway, R.S., Reed, A.C., Shetake, J.A., Jakkamsetti, V., Chang, K.Q., and Kilgard, M.P. (2008). Cortical activity patterns predict speech discrimination ability. Nat Neurosci 11, 603-608.
11. Ernst, M.O., and Bulthoff, H.H. (2004). Merging the senses into a robust percept. Trends Cogn Sci 8, 162-169.
12. Falchier, A., Clavagnier, S., Barone, P., and Kennedy, H. (2002). Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22, 5749-5759.
13. Falchier, A., Schroeder, C.E., Hackett, T.A., Lakatos, P., Nascimento-Silva, S., Ulbert, I., Karmos, G., and Smiley, J.F. (2010). Projection from visual areas V2 and prostriata to caudal auditory cortex in the monkey. Cereb Cortex 20, 1529-1538.
14. Fiebelkorn, I.C., Foxe, J.J., Butler, J.S., and Molholm, S. (2011). Auditory facilitation of visual-target detection persists regardless of retinal eccentricity and despite wide audiovisual misalignments. Exp Brain Res 213, 167-174.
15. Foxe, J.J., Morocz, I.A., Murray, M.M., Higgins, B.A., Javitt, D.C., and Schroeder, C.E. (2000). Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res 10, 77-83.
16. Foxe, J.J., and Schroeder, C.E. (2005). The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16, 419-423.
17. Frassinetti, F., Bolognini, N., and Ladavas, E. (2002). Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp Brain Res 147, 332-343.
18. Fritz, J.B., Elhilali, M., David, S.V., and Shamma, S.A. (2007). Auditory attention--focusing the searchlight on sound. Curr Opin Neurobiol 17, 437-455.
19. Ghazanfar, A.A., and Schroeder, C.E. (2006). Is neocortex essentially multisensory? Trends Cogn Sci 10, 278-285.
20. Giard, M.H., and Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11, 473-490.
21. Gielen, S.C., Schmidt, R.A., and Van Den Heuvel, P.J. (1983). On the nature of intersensory facilitation of reaction time. Percept Psychophys 34, 161-168.
22. Iurilli, G., Ghezzi, D., Olcese, U., Lassi, G., Cristiano, N., Tonini, R., Tucci, V., Benfenati, F., and Medini, P. (2012). Sound-driven synaptic inhibition in primary visual cortex. Neuron 73, 814-828.
23. Jaekl, P.M., and Harris, L.R. (2009). Sounds can affect visual perception mediated primarily by the parvocellular pathway. Vis Neurosci 26, 477-486.
24. Jaekl, P.M., and Soto-Faraco, S. (2010). Audiovisual contrast enhancement is articulated primarily via the M-pathway. Brain Research 1366, 85-92.
25. Kim, R., Peters, M.A., and Shams, L. (2012). 0 + 1 >1: How adding noninformative sound improves performance on a visual task. Psychol Sci 23, 6-12.
26. Leo, F., Bertini, C., Di Pellegrino, G., and Ladavas, E. (2008). Multisensory integration for orienting responses in humans requires the activation of the superior colliculus. Exp Brain Res 186, 67-77.
27. Ling, S., Liu, T., and Carrasco, M. (2009). How spatial and feature-based attention affect the gain and tuning of population responses. Vision Res 49, 1194-1204.
28. Lippert, M., Logothetis, N., and Kayser, C. (2007). Improvement of visual contrast detection by a simultaneous sound. Brain Res, 102-109.
29. Mcgurk, H., and Macdonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748.
30. Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E., and Foxe, J.J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: a highdensity electrical mapping study. Brain Res Cogn Brain Res 14, 115-128.
31. Nelken, I. (2008). Processing of complex sounds in the auditory system. Curr Opin Neurobiol 18, 413-417.
32. Nelken, I., and Bar-Yosef, O. (2008). Neurons and objects: the case of auditory cortex. Front Neurosci 2, 107-113.
33. Noesselt, T., Tyll, S., Boehler, C.N., Budinger, E., Heinze, H.J., and Driver, J. (2010). Sound-induced enhancement of low-intensity vision: Multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. Journal of Neuroscience 30, 13609-13623.
34. Otto, T.U., Dassy, B., and Mamassian, P. (2013). Principles of multisensory behavior. J Neurosci 33, 7463-7474.
35. Otto, T.U., and Mamassian, P. (2012). Noise and correlations in parallel perceptual decision making. Curr Biol 22, 1391-1396.
36. Pelli, D.G. (1997). The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10, 437-442.
37. Posner, M.I., Nissen, M.J., and Klein, R.M. (1976). Visual dominance: an information-processing account of its origins and significance. Psychol Rev 83, 157-171.
38. Recanzone, G.H. (2000). Spatial processing in the auditory cortex of the macaque monkey. Proc Natl Acad Sci U S A 97, 11829-11835.
39. Rockland, K.S., and Ojima, H. (2003). Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 50, 19-26.
40. Ross, L.A., Saint-Amour, D., Leavitt, V.M., Javitt, D.C., and Foxe, J.J. (2007). Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb Cortex 17, 1147-1153.
41. Sekuler, R., Sekuler, A.B., and Lau, R. (1997). Sound alters visual motion perception. Nature 385, 308.
42. Shams, L., Kamitani, Y., and Shimojo, S. (2000). Illusions. What you see is what you hear. Nature 408, 788.
43. Shams, L., Kamitani, Y., and Shimojo, S. (2002). Visual illusion induced by sound. Brain Res Cogn Brain Res 14, 147-152.
44. Spence, C. (2011). Crossmodal correspondences: a tutorial review. Atten Percept Psychophys 73, 971-995.
45. Spence, C. (2013). Just how important is spatial coincidence to multisensory integration? Evaluating the spatial rule. Ann N Y Acad Sci.
46. Stein, B.E., and Stanford, T.R. (2008). Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9, 255-266.
47. Tremblay, C., Champoux, F., Voss, P., Bacon, B.A., Lepore, F., and Theoret, H. (2007). Speech and non-speech audio-visual illusions: a developmental study. PLoS ONE 2, e742.
48. Watkins, S., Shams, L., Tanaka, S., Haynes, J.D., and Rees, G. (2006). Sound alters activity in human V1 in association with illusory visual perception. Neuroimage 31, 1247-1256.
49. Werner, S., and Noppeney, U. (2010). Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. J Neurosci 30, 2662-2675.
50. Wyart, V., Nobre, A.C., and Summerfield, C. (2012). Dissociable prior influences of signal probability and relevance on visual contrast sensitivity. Proc Natl Acad Sci U S A 109, 3593-3598.