Multisensory perceptual learning reshapes both fast and slow mechanisms of crossmodal processing

Cognitive, Affective and Behavioral Neuroscience

Volumn 11, Issue 1, 2011, Pages 1-12

  Beer, Anton L ^a   Batson, Melissa A ^a   Watanabe, Takeo ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Attention; Crossmodal plasticity; Development; IOR; Multisensory; Perceptual learning; Visual perception

Indexed keywords

ADULT; ANALYSIS OF VARIANCE; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; EYE MOVEMENT; FEMALE; HEARING; HUMAN; LEARNING; MALE; METHODOLOGY; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME; TIME; VISION;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; CUES; EYE MOVEMENTS; FEMALE; HUMANS; LEARNING; MALE; PHOTIC STIMULATION; REACTION TIME; TIME FACTORS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 79953205179     PISSN: 15307026     EISSN: None     Source Type: Journal    
DOI: 10.3758/s13415-010-0006-x     Document Type: Article

References (64)

1. Alais, D., & Burr, D. (2004). No direction-specific bimodal facilitation for audiovisual motion detection. Cognitive Brain Research, 19 (2), 185-194. doi:10.1016/j.cogbrainres.2003.11.011 (Pubitemid 38328751)
2. Bauer, B. B. (1961). Phasor analysis of some stereophonic phenomena. The Journal of the Acoustical Society of America, 33(11), 1536-1539.
3. Bavelier, D., & Neville, H. J. (2002). Cross-modal plasticity: Where and how? Nature Reviews. Neuroscience, 3(6), 443-452. doi:10.1038/nrn848
4. Beer, A. L., & Röder, B. (2004a). Attention to motion enhances processing of both visual and auditory stimuli: An event-related potential study. Cognitive Brain Research, 18, 205-225. doi:10.1016/j.cogbrainres.2003.10. 004 (Pubitemid 38084936)
5. Beer, A. L., & Röder, B. (2004b). Unimodal and crossmodal effects of endogenous attention to visual and auditory motion. Cognitive, Affective & Behavioral Neuroscience, 4(2), 230-240. doi:10.3758/CABN.4.2.230 (Pubitemid 39167165)
6. Beer, A. L., & Röder, B. (2005). Attending to visual or auditory motion affects perception within and across modalities: An event-related potential study. The European Journal of Neuroscience, 21, 1116-1130. doi:10.1111/j.1460-9568.2005.03927.x (Pubitemid 40461064)
7. Beer, A. L., & Watanabe, T. (2009). Specificity of auditory-guided visual perceptual learning suggests crossmodal plasticity in early visual cortex. Experimental Brain Research, 198, 353-361. doi:10.1007/s00221-009-1769-6
8. Bower, T. G. R. (1974). Development in infancy. San Francisco, CA: Freeman. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10 (4), 433-436.
9. Brainard, M. S., & Knudsen, E. I. (1998). Sensitive periods for visual calibration of the auditory space map in the barn owl optic tectum. The Journal of Neuroscience, 18(10), 3929-3942. (Pubitemid 28225697)
10. Budinger, E., Heil, P., Hess, A., & Scheich, H. (2006). Multisensory processing via early cortical stages: Connections of the primary auditory cortical field with other sensory systems. Neuroscience, 143(4), 1065-1083. doi:10.1016/j.neuroscience.2006.08.035 (Pubitemid 44827516)
11. Collie, A., Maruff, P., Yucel, M., Danckert, J., & Currie, J. (2000). Spatiotemporal distribution of facilitation and inhibition of return arising from the reflexive orienting of covert attention. Journal of Experimental Psychology: Human Perception and Performance, 26(6), 1733-1745.
12. DeBello, W. M., Feldman, D. E., & Knudsen, E. I. (2001). Adaptive axonal remodeling in the midbrain auditory space map. The Journal of Neuroscience, 21(9), 3161-3174. (Pubitemid 32323498)
13. Dumoulin, S. O., & Wandell, B. A. (2008). Population receptive field estimates in human visual cortex. Neuroimage, 39(2), 647-660. doi:10.1016/j.neuroimage.2007.09.034 (Pubitemid 350117649)
14. Eimer, M. (2001). Crossmodal links in spatial attention between vision, audition, and touch: Evidence from event-related brain potentials. Neuropsychologia, 39, 1292-1303. (Pubitemid 32826273)
15. Feldman, D. E., & Knudsen, E. I. (1998). Experience-dependent plasticity and the maturation of glutamatergic synapses. Neuron, 20(6), 1067-1071. (Pubitemid 28293124)
16. Fieger, A., Röder, B., Teder-Sálejárvi, W., Hillyard, S. A., & Neville, H. J. (2006). Auditory spatial tuning in late-onset blindness in humans. Journal of Cognitive Neuroscience, 18(2), 149-157. doi:10.1162/jocn.2006.18.2.149
17. Foxe, J. J., & Schroeder, C. E. (2005). The case for feedforward multisensory convergence during early cortical processing. NeuroReport, 16(5), 419-423. doi:10.1097/00001756-200504040-00001 (Pubitemid 40477541)
18. Frassinetti, F., Bolognini, N., & Ladavas, E. (2002). Enhancement of visual perception by crossmodal visuo-auditory interaction. Experimental Brain Research, 147(3), 332-343. doi:10.1007/s00221-002-1262-y (Pubitemid 35341007)
19. Gibson, E. J. (1969). Principles of perceptual learning and development. Englewood Cliffs, NJ: Prentice Hall.
20. Gougoux, F., Zatorre, R. J., Lassonde, M., Voss, P., & Lepore, F. (2005). A functional neuroimaging study of sound localization: Visual cortex activity predicts performance in early-blind individuals. PLoS Biology, 3(2), e27. doi:10.1371/journal.pbio.0030027 (Pubitemid 40412652)
21. Grantham, D. W. (1986). Detection and discrimination of simulated motion of auditory targets in the horizontal plane. The Journal of the Acoustical Society of America, 79(6), 1939-1949. (Pubitemid 16034865)
22. Gutfreund, Y., Zheng, W., & Knudsen, E. I. (2002). Gated visual input to the central auditory system. Science, 297, 1556-1559. doi:10.1126/science. 1073712 (Pubitemid 34971003)
23. King, A. J., & Moore, D. R. (1991). Plasticity of auditory maps in the brain. Trends in Neurosciences, 14(1), 31-37.
24. Klein, R. M. (2000). Inhibition of return. Trends in Cognitive Sciences, 4(4), 138-146.
25. Knudsen, E. I. (2002). Instructed learning in the auditory localization pathway of the barn owl. Nature, 417, 322-328. doi:10.1038/417322a (Pubitemid 34534719)
26. Lee, D. S., Lee, J. S., Oh, S. H., Kim, S.-K., Kim, J.-W., Chung, J.-K., et al. (2001). Cross-modal plasticity and cochlear implants. Nature, 409, 149-150. doi:10.1038/35051653 (Pubitemid 32144270)
27. Leo, F., Bertini, C., di Pellegrino, G., & Ladavas, E. (2008). Multisensory integration for orienting responses in humans requires the activation of the superior colliculus. Experimental Brain Research, 186(1), 67-77. doi:10.1007/s00221-007-1204-9
28. Lepsien, J., & Pollmann, S. (2002). Covert reorienting and inhibition of return: an event-related fMRI study. Journal of Cognitive Neuroscience, 14(2), 127-144. doi:10.1162/089892902317236795 (Pubitemid 34113701)
29. Li, W., Piech, V., & Gilbert, C. D. (2004). Perceptual learning and topdown influences in primary visual cortex. Nature Neuroscience, 7 (6), 651-657. doi:10.1038/nn1255 (Pubitemid 38691905)
30. Loftus, G. R., & Masson, M. E. J. (1994). Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review, 1(4), 476-490.
31. Marks, L. E. (1978). The unity of the senses: Interrelations among the modalities. New York: Academic.
32. Mayer, A. R., Seidenberg, M., Dorflinger, J. M., & Rao, S. M. (2004). An event-related fMRI study of exogenous orienting: Supporting evidence for the cortical basis of inhibition of return? Journal of Cognitive Neuroscience, 16(7), 1262-1271. doi:10.1162/0898929041920531 (Pubitemid 39274452)
33. Maylor, E. A. (1985). Facilitatory and inhibitory components of orienting in visual space. In M. I. Posner & O. S. M. Marin (Eds.), Attention and performance XI (pp. 189-204). Hillsdale, NJ: Erlbaum.
34. Mazza, V., Turatto, M., Rossi, M., & Umiltá, C. (2007). How automatic are audiovisual links in exogenous spatial attention? Neuropsychologia, 45(3), 514-522. doi:10.1016/j.neuropsycho logia.2006.02.010 (Pubitemid 44894459)
35. McDonald, J. J., Teder-Sálejárvi, W. A., Di Russo, F., & Hillyard, S. A. (2003). Neural substrates of perceptual enhancement by crossmodal spatial attention. Journal of Cognitive Neuroscience, 15, 10-19. doi:10.1162/089892903321107783 (Pubitemid 36106259)
36. McDonald, J. J., Teder-Sálejárvi, W. A., Di Russo, F., & Hillyard, S. A. (2005). Neural basis of auditory-induced shifts in visual timeorder perception. Nature Neuroscience, 8(9), 1197-1202. doi:10.1038/nn1512 (Pubitemid 43348138)
37. McDonald, J. J., Teder-Sálejárvi, W. A., & Hillyard, S. A. (2000). Involuntary orienting to sound improves visual perception. Nature, 407, 906-908. doi:10.1038/35038085
38. Meredith, M. A., & Stein, B. E. (1986a). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56(3), 640-662. (Pubitemid 16031523)
39. Meredith, M. A., & Stein, B. E. (1986b). Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Research, 365, 350-354. (Pubitemid 16120784)
40. Meyer, G. F.,& Wuerger, S. M. (2001). Cross-modal integration of auditory and visual motion signals. NeuroReport, 12(11), 2557-2560. (Pubitemid 32682221)
41. Meyer, G. F., Wuerger, S. M., Rohrbein, F., & Zetzsche, C. (2005). Low-level integration of auditory and visual motion signals requires spatial co-localisation. Experimental Brain Research, 166(3-4), 538-547. doi:10.1007/s00221-005-2394-7 (Pubitemid 41502097)
42. Middlebrooks, J. C., & Green, D. M. (1991). Sound localization by human listeners. Annual Review of Psychology, 42, 135-159. doi:10.1146/annurev. ps.42.020191.001031
43. Polley, D. B., Hillock, A. R., Spankovich, C., Popescu, M. V., Royal, D. W., & Wallace, M. T. (2008). Development and plasticity of intra- and intersensory information processing. Journal of the American Academy of Audiology, 19(10), 780-798. doi:10.3766/jaaa.19.10.6
44. Polley, D. B., Steinberg, E. E., & Merzenich, M. M. (2006). Perceptual learning directs auditory cortical map reorganization through top-down influences. The Journal of Neuroscience, 26 (18), 4970-4982. doi:10.1523/JNEUROSCI.3771-05.2006 (Pubitemid 44315340)
45. Posner, M. I., Rafal, R. D., Choate, L. S., & Vaughan, J. (1985). Inhibition of return: Neural basis and function. Cognitive Neuropsychology, 2(3), 211-228. (Pubitemid 15247633)
46. Röder, B., Teder-Sálejárvi, W., Sterr, A., Rösler, F., Hillyard, S. A., & Neville, H. J. (1999). Improved auditory spatial tuning in blind humans. Nature, 400, 162-166. (Pubitemid 29327544)
47. Seitz, A., & Watanabe, T. (2003). Is subliminal learning really passive? Nature, 422, 36. doi:10.1038/422036a (Pubitemid 36323286)
48. Shinn-Cunningham, B. (2000). Adapting to remapped auditory localization cues: A decision-theory model. Perception & Psychophysics, 62(1), 33-47.
49. Smith, A. T., Singh, K. D., Williams, A. L., & Greenlee, M. W. (2001). Estimating receptive field size from fMRI data in human striate and extrastriate visual cortex. Cerebral Cortex, 11, 1182-1190. (Pubitemid 33108245)
50. Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59(1), 1-22. (Pubitemid 127456363)
51. Spence, C., & Driver, J. (1998a). Auditory and audiovisual inhibition of return. Perception & Psychophysics, 60(1), 125-139. (Pubitemid 128460304)
52. Spence, C., & Driver, J. (1998b). Inhibition of return following an auditory cue. The role of central reorienting events. Experimental Brain Research, 118, 352-360. (Pubitemid 28052341)
53. Strybel, T. Z., & Fujimoto, K. (2000). Minimum audible angles in the horizontal and vertical planes: Effects of stimulus onset asynchrony and burst duration. The Journal of the Acoustical Society of America, 108(6), 3092-3095.
54. Swets, J. A. (1973). The relative operating characteristic in psychology:A technique for isolating effects of response bias finds wide use in the study of perception and cognition. Science, 182, 990-1000. doi:10.1126/science.182.4116.990
55. Tassinari, G., Aglioti, S., Chelazzi, L., Peru, A., & Berlucchi, G. (1994). Do peripheral non-informative cues induce early facilitation of target detection? Vision Research, 34(2), 179-189.
56. Tassinari, G., & Berlucchi, G. (1995). Covert orienting to noninformative cues: reaction time studies. Behavioural Brain Research, 71, 101-112.
57. Taylor, T. L., & Klein, R. M. (2000). Visual and motor effects in inhibition of return. Journal of Experimental Psychology: Human Perception and Performance, 26(5), 1639-1656.
58. Vallines, I., & Greenlee, M. W. (2006). Saccadic suppression of retinotopically localized blood oxygen level-dependent responses in human primary visual area V1. The Journal of Neuroscience, 26(22), 5965-5969. doi:10.1523/JNEUROSCI.0817-06.2006 (Pubitemid 44318361)
59. Wallace, M. T., & Stein, B. E. (2007). Early experience determines how the senses will interact. Journal of Neurophysiology, 97(1), 921-926. doi:10.1152/jn.00497.2006 (Pubitemid 46143406)
60. Watanabe, T., Náñez, J. E., Sr., Koyama, S., Mukai, I., Liederman, J., & Sasaki, Y. (2002). Greater plasticity in lower-level than higherlevel visual motion processing in a passive perceptual learning task. Nature Neuroscience, 5(10), 1003-1009. doi:10.1038/nn915
61. Watanabe, T., Náñez, J.E., & Sasaki, Y. (2001). Perceptual learning without perception. Nature, 413, 844-848. doi:10.1038/35101601 (Pubitemid 33026851)
62. Weeks, R., Horwitz, B., Aziz-Sultan, A., Tian, B., Wessinger, C. M., Cohen, L. G., et al. (2000). A positron emission tomographic study of auditory localization in the congenitally blind. The Journal of Neuroscience, 20(7), 2664-2672. (Pubitemid 30220354)
63. Wilmington, D., Gray, L., & Jahrsdoerfer, R. (1994). Binaural processing after corrected congenital unilateral conductive hearing loss. Hearing Research, 74(1-2), 99-114. (Pubitemid 24131275)
64. Zwiers, M. P., Van Opstal, A. J., & Paige, G. D. (2003). Plasticity in human sound localization induced by compressed spatial vision. Nature Neuroscience, 6(2), 175-181. doi:10.1038/nn999 (Pubitemid 36182787)