Spatial shifts of audio-visual interactions by perceptual learning are specific to the trained orientation and eye

Seeing and Perceiving

Volumn 24, Issue 6, 2011, Pages 579-594

  Batson, Melissa A ^a   Beer, Anton L ^b   Seitz, Aaron R ^c   Watanabe, Takeo ^a  

^a BOSTON UNIVERSITY   (United States)

^b UNIVERSITY OF REGENSBURG   (Germany)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

AUDIO VISUAL EFFECTS; AUDIO VISUAL PLASTICITY; BOTTOM UP INTEGRATION; CROSS MODAL CUING EFFECTS; MULTISENSORY PROCESSING; TASK IRRELEVANT PERCEPTUAL LEARNING

Indexed keywords

AUDIO-VISUAL; AUDIO-VISUAL EFFECTS; CROSS-MODAL; MULTISENSORY; PERCEPTUAL LEARNING;

AUDIO ACOUSTICS;

ADOLESCENT; ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; FEMALE; HEARING; HUMAN; LEARNING; MALE; METHODOLOGY; NERVE CELL PLASTICITY; ORIENTATION; PERCEPTION; PHOTOSTIMULATION; PHYSIOLOGY; VISION;

ACOUSTIC STIMULATION; ADOLESCENT; AUDITORY PERCEPTION; CUES; FEMALE; HUMANS; LEARNING; MALE; NEURONAL PLASTICITY; ORIENTATION; PERCEPTUAL MASKING; PHOTIC STIMULATION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84858209725     PISSN: 18784755     EISSN: 18784763     Source Type: Journal    
DOI: 10.1163/187847611X603738     Document Type: Article

References (55)

1. Ahissar, M. and Hochstein, S. (1997). Task difficulty and the specificity of perceptual learning, Nature 387, 401-406. (Pubitemid 27227204)
2. Alais, D. and Cass, J. (2010).Multisensory perceptual learning of temporal order: audiovisual learning transfers to vision but not audition, PLoS One 5, e11283.
3. Beauchamp, M. S. (2005). See me, hear me, touch me: multimodal integration in lateral occipital- temporal cortex, Curr. Opin. Neurobiol. 15, 145-153. (Pubitemid 41569262)
4. Beer, A. L., Batson, M. A. and Watanabe, T. (2011a). Multisensory perceptual learning escapes both fast and slow mechanisms of cross-modal processing, Cognit. Affect. Behav. Neurosci. 11, 1-12.
5. Beer, A. L., Plank, T. and Greenlee, M. W. (2011b). Diffusion tensor imaging shows white matter tracts between human auditory and visual cortex, Exper. Brain Res. 213, 299-308.
6. Beer, A. L. andWatanabe, T. (2009). Specificity of auditory-guided visual perceptual learning suggests cross-modal plasticity in early visual cortex, Exper. Brain Res. 198, 353-361.
7. Brainard, D. H. (1997). The psychophysics toolbox, Spatial Vision 10, 433-436. (Pubitemid 127582520)
8. Calvert, G. A. and Thesen, T. (2004). Multisensory integration: methodological approaches and emerging principles in the human brain, J. Physiol. (Paris) 98, 191-205. (Pubitemid 39345371)
9. Cappe, C. and Barone, P. (2005). Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey, Eur. J. Neurosci. 22, 2886-2902. (Pubitemid 41818860)
10. Dill, M. (2002). Specificity versus invariance of perceptual learning: the example of position, in: Perceptual Learning, M. Fahle and T. Poggio (Eds), Chapter 12. MIT Press, Cambridge, MA, USA.
11. Driver, J. and Noesselt, T. (2008). Multisensory interplay reveals cross-modal influences on 'sensoryspecific' brain regions, neural responses, and judgments, Neuron 57, 11-23.
12. Eckert,M. A., Kamdar, N. V., Change, C. E., Beckmann, C. F., Greicius, M. D. andMenon, V. (2008). A cross-modal system linking primary auditory and visual cortices: evidence from intrinsic fMRI connectivity analysis, Hum. Brain Mapp. 29, 848-857. (Pubitemid 351813086)
13. Eimer, M., van Velzen, J. and Driver, J. (2002). Cross-modal interactions between audition, touch, and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations, J. Cognit. Neurosci. 14, 1-18.
14. Fahle, M. (2005). Perceptual learning: specificity versus generalization, Curr. Opin. Neurobiol. 15, 154-160. (Pubitemid 41569263)
15. Falchier, A., Clavagnier, S., Barone, P. and Kennedy, H. (2002). Anatomical evidence of multimodal integration in primate striate cortex, J. Neurosci. 22, 5749-5759. (Pubitemid 35386498)
16. Fiorentini, A. and Berardi, N. (1980). Perceptual learning specific for orientation and spatial frequency, Nature 278, 43-44. (Pubitemid 10018203)
17. Foxe, J. J. and Schroeder, C. E. (2005). The case for feedforward multisensory convergence during early cortical processing, Neuroreport 16, 419-423. (Pubitemid 40477541)
18. Franko, E., Seitz, A. R. and Vogels, R. (2010). Dissociable neural effects of long term stimulus-reward pairing in macaque visual cortex, J. Cognit. Neurosci. 22, 1425-1439.
19. Grantham, D. W. (1986). Detection and discrimination of simulated motion of auditory targets in the horizontal plane, J. Acoust. Soc. Amer. 79, 1939-1949. (Pubitemid 16034865)
20. Karni, A. and Sagi, D. (1991). Where practice makes perfect: evidence for primary visual cortex plasticity, Proc. Natl. Acad. Sci. USA 88, 4966-4970. (Pubitemid 21914664)
21. Kim, R. S., Seitz, A. R. and Shams, L. (2008). Benefits of stimulus congruency for multisensory facilitation of visual learning, PLoS ONE 3, e1532.
22. Klein, R. M. (2000). Inhibition of return, Trends Cognit. Sci. 4, 138-146.
23. Law, C. and Gold, J. I. (2008). Neural correlates of perceptual learning in a sensory-motor but not a sensory cortical area, Nature Neurosci. 11, 505-513. (Pubitemid 351441885)
24. McDonald, J. J., Teder-Sälejärvi, W. A. and Hillyard, S. A. (2000). Involuntary orienting to sound improves visual perception, Nature 407, 906-908.
25. Meredith, M. A. and Stein, B. E. (1986). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration, J. Neurophysiol. 56, 640-662. (Pubitemid 16031523)
26. Meyer, G. F., Wuerger, S. M., Rohrbein, F. and Zetzsche, C. (2005). Low-level integration of auditory and visual motion signals requires spatial co-localisation, Exper. Brain Res. 166, 538-547. (Pubitemid 41502097)
27. Mishkin, M., Ungerleider, L. G. and Macko, K. A. (1983). Object visions and spatial visions: two cortical pathways, Trends Neurosci. 6, 414-417. (Pubitemid 13025036)
28. Mollon, J. D. and Danilova, M. V. (1996). Three remarks on perceptual learning, Spatial Vision 10, 51-58. (Pubitemid 126559607)
29. Nishina, S., Seitz, A. R., Kawato, M. and Watanabe, T. (2007). Effect of spatial distance to the task stimulus on task-irrelevant perceptual learning of static Gabors, J. Vision 7, 1-10.
30. Petrov, A. A., Dosher, B. A. and Lu, Z. L. (2005). The dynamics of perceptual learning: an incremental reweighting model, Psychol. Rev. 112, 715-743. (Pubitemid 41677516)
31. Rockland, K. S. and Ojima, H. (2003).Multisensory convergence in calcarine visual areas in macaque monkey, Int. J. Psychophysiol. 50, 19-26. (Pubitemid 37162868)
32. Rosenthal, O. and Humphreys, G. W. (2010). Perceptual organization without perception: the subliminal learning of global contour, Psychol. Sci. 21, 1751-1758.
33. Sary, G., Vogels, R., Kovacs, G. and Orban, G. A. (1995). Responses of monkey inferior temporal neurons to luminance-, motion- and texture-defined gratings, J. Neurophysiol. 73, 1341-1354.
34. Schoups, A. A., Vogels, R. and Orban, G. (1995). Human perceptual learning in identifying the oblique orientation: retinotopy, orientation specificity and monocularity, J. Physiol. 483, 797-810.
35. Seitz, A. R., Kim, R. and Shams, L. (2006a). Sound facilitates visual learning, Curr. Biol. 16, 1422- 1427. (Pubitemid 44066770)
36. Seitz, A. R., Kim, D. and Watanabe, T. (2009). Rewards evoke learning of unconsciously processed visual stimuli in adult humans, Neuron 12, 700-707.
37. Seitz, A. R., Nanez, J. E., Holloway, S. R. andWatanabe, T. (2005). Visual experience can substantially alter critical flicker fusion thresholds, Hum. Psychopharmacol. 20, 55-60. (Pubitemid 40227646)
38. Seitz, A. R., Nanez, J. E., Holloway, S. R. and Watanabe, T. (2006b). Perceptual learning of motion leads to faster flicker perception, PLoS ONE 1, e28.
39. Seitz, A. R., Protopapas, A., Tsushima, Y., Vlahou, E. L., Gori, S., Grossberg, S. and Watanabe, T. (2010). Unattended exposure to components of speech sounds yields same benefits as explicit auditory training, Cognition 115, 435-443.
40. Seitz, A. R. and Watanabe, T. (2003). Is subliminal learning really passive?, Nature 422, 36.
41. Seitz, A. R. and Watanabe, T. (2005). A unified model for perceptual learning, Trends Cognit. Sci. 9, 329-334. (Pubitemid 40910331)
42. Seitz, A. R. and Watanabe, T. (2009). The phenomenon of task-irrelevant perceptual learning, Vision Res. 49, 2604-2610.
43. Shams, L. and Seitz, A. R. (2008). Benefits of multisensory learning, Trend Cognit. Sci. 12, 411-417.
44. Shinn-Cunningham, B. (2000). Adapting to remapped auditory localization cues: a decision theory model, Percept. Psychophys. 62, 33-47.
45. Spence, C. and Driver, J. (1997). Audio-visual links in exogenous covert spatial orienting, Percept. Psychophys. 59, 1-22. (Pubitemid 127456363)
46. Spence, C. and Driver, J. (1998). Auditory and audio-visual inhibition of return, Percept. Psychophys. 60, 125-139.
47. Tanaka, K., Saito, H., Fukada, Y. and Moriya, M. (1991). Coding visual images of objects in the inferotemporal cortex of the Macaque monkey, J. Neurophysiol. 66, 170-189.
48. Thesen, T., Vibell, J. F., Calvert, G. A. and Österbauer, R. A. (2004). Neuroimaging of multisensory processing in vision, audition, touch, and olfaction, Cognit. Process 5, 84-93.
49. Tong, F., Meng, M. and Blake, R. (2006). Neural basis of binocular rivalry, Trends Cognit. Sci. 10, 502-511.
50. Tong, F., Nakayama, K., Vaughan, J. T. and Kanwisher, N. (1998). Binocular rivalry and visual awareness in human extrastriate cortex, Neuron 21, 753-759. (Pubitemid 28498784)
51. Wang, Y., Celebrini, S., Trotter, Y. and Barone, P. (2008). Visuo-auditory interactions in the primary visual cortex of the behaving monkey: electrophysiological evidence, BMC Neurosci. 9, 79.
52. Watanabe, T., Náñez, J. E., Koyama, S., Mukai, I., Liederman, J. and Sasaki, Y. (2002). Greater plasticity in lower-level than higher-level visual motion processing in a passive perceptual learning task, Nat. Neurosci. 5, 1003-1009.
53. Watanabe, T., Náñez, J. and Sasaki, Y. (2001). Perceptual learning without perception, Nature 413, 844-848. (Pubitemid 33026851)
54. Xiao, L. Q., Zhang, J. Y., Wang, R., Klein, S. A., Levi, D. M. and Yu, C. (2008). Complete transfer of perceptual learning across retinal locations enabled by double training, Curr. Biol. 18, 1922-1926.
55. Zwiers, M. P., Van Opstal, A. J. and Paige, G. D. (2003). Plasticity in human sound localization induced by compressed spatial vision, Nature Neurosci. 6, 175-181. (Pubitemid 36182787)