What neuroimaging tells us about sensory substitution

Neuroscience and Biobehavioral Reviews

Volumn 31, Issue 7, 2007, Pages 1064-1070

  Poirier, Colline ^a   De Volder, Anne G ^a   Scheiber, Christian ^b  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^b CNRS   (France)

Author keywords

Blindness; Cross modality; Mental imagery; Neuroimaging; Sensory substitution; Visual perception

Indexed keywords

HUMAN; INFORMATION PROCESSING; NEUROIMAGING; PATTERN RECOGNITION; PERCEPTION; POSITRON EMISSION TOMOGRAPHY; PRIORITY JOURNAL; REVIEW; SOMATOSENSORY CORTEX; VISION;

AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; DIAGNOSTIC IMAGING; HUMANS; IMAGINATION; SENSORY DEPRIVATION; VISUAL PERCEPTION;

EID: 34548288420     PISSN: 01497634     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2007.05.010     Document Type: Review

References (41)

1. Amedi A., Malach R., Hendler T., Peled S., and Zohary E. Visuo-haptic object-related activation in the ventral visual pathway. Nature Neuroscience 4 (2001) 324-330
2. Amedi A., Raz N., Pianka P., Malach R., and Zohary E. Early 'visual' cortex activation correlates with superior verbal memory performance in the blind. Nature Neuroscience 6 (2003) 758-766
3. Arno P., Capelle C., Wanet-Defalque M.C., Catalan-Ahumada M., and Veraart C. Auditory coding of visual patterns for the blind. Perception 28 (1999) 1013-1029
4. Arno P., Vanlierde A., Streel E., Wanet-Defalque M.-C., Sanabria-Bohorquez S., and Veraart C. Auditory substitution of vision: pattern recognition by the blind. Applied Cognitive Psychology 15 (2001) 509-519
5. Arno P., De Volder A.G., Vanlierde A., Wanet-Defalque M.C., Streel E., Robert A., Sanabria-Bohorquez S., and Veraart C. Occipital activation by pattern recognition in the early blind using auditory substitution for vision. Neuroimage 13 (2001) 632-645
6. Bach-y-Rita P., Collins C.C., Saunders F., White B., and Scadden L. Vision substitution by tactile image projection. Nature 221 (1969) 963-964
7. Blake R., Sobel K.V., and James T.W. Neural synergy between kinetic vision and touch. Psychological Science 15 (2004) 397-402
8. Capelle C., Trullemans C., Arno P., and Veraart C. A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution. IEEE TransActions of Biomedical Engineering 45 (1998) 1279-1293
9. Collignon, O., Davare, M., De Volder, A.G., Lassonde, M., Lepore, F., Olivier, E., Veraart, C., 2005. Involvement of the right occipito-parietal stream during spatial hearing in early blind subjects. In: Proceeding of the 35th Annual meeting of the Society for Neurosciences, Washington, November 12-16, 2005.
10. Collignon O., Lassonde M., Lepore F., Bastien D., and Veraart C. Functional cerebral reorganization for auditory spatial processing and auditory substitution of vision in early blind subjects. Cerebral Cortex 17 (2007) 457-465
11. Cronly-Dillon J., Persaud K., and Gregory R.P. The perception of visual images encoded in musical form: a study in cross-modality information transfer. Proceedings of Biological Science 266 (1999) 2427-2433
12. De Volder A.G., Toyama H., Kimura Y., Kiyosawa M., Nakano H., Vanlierde A., Wanet-Defalque M.C., Mishina M., Oda K., Ishiwata K., and Senda M. Auditory triggered mental imagery of shape involves visual association areas in early blind humans. Neuroimage 14 (2001) 129-139
13. Epstein W., Hughes B., Schneider S.L., and Bach-y-Rita P. Perceptual learning of spatiotemporal events: evidence from an unfamiliar modality. Journal of Experimental Psychology: Human Perception and Performance 15 (1989) 28-44
14. Gougoux F., Zatorre R.J., Lassonde M., Voss P., and Lepore F. A functional neuroimaging study of sound localization: visual cortex activity predicts performance in early-blind individuals. PLoS Biology 3 (2005) e27
15. Kaczmarek K.A., Webster J.G., Bach-y-Rita P., and Tompkins W.J. Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Transactions of Biomedical Engineering 38 (1991) 1-16
16. Kerr N.H. The role of vision in "visual imagery" experiments: evidence from the congenitally blind. Journal of Experimental Psychology: Genetics 112 (1983) 265-277
17. Kosslyn S.M. Measuring the visual angle of the mind's eye. Cognitive Psychology 10 (1978) 356-389
18. Kosslyn S.M., and Thompson W.L. When is early visual cortex activated during visual mental imagery?. Psychological Bulletin 129 (2003) 723-746
19. Kosslyn S.M., Thompson W.L., Kim I.J., and Alpert N.M. Topographical representations of mental images in primary visual cortex. Nature 378 (1995) 496-498
20. Kupers R., Fumal A., de Noordhout A.M., Gjedde A., Schoenen J., and Ptito M. Transcranial magnetic stimulation of the visual cortex induces somatotopically organized qualia in blind subjects. Proceedings of National Academy of Science, USA. 103 (2006) 1360-13256
21. Lambert S., Sampaio E., Mauss Y., and Scheiber C. Blindness and brain plasticity: contribution of mental imagery? An fMRI study. Brain Research-Cognitive Brain Research 20 (2004) 1-11
22. Marmor G.S., and Zaback L.A. Mental rotation by the blind: does mental rotation depend on visual imagery?. Journal of Experimental Psychology: Human Perception and Performance 2 (1976) 515-521
23. Meijer P.B. An experimental system for auditory image representations. IEEE Transactions of Biomedical Engineering 39 (1992) 112-121
24. Mellet E., Tzourio N., Crivello F., Joliot M., Denis M., and Mazoyer B. Functional anatomy of spatial mental imagery generated from verbal instructions. Journal of Neuroscience 16 (1996) 6504-6512
25. Miller J., and Navon D. Global precedence and response activation: evidence from LRPs. Quarterly Journal of Experimental Psychology 55 (2002) 289-310
26. Morrison D.J., and Schyns P.G. Usage of spatial scales for the categorization of faces, objects, and scenes. Psychon Bulletin Review 8 (2001) 454-469
27. Peterson M.A., Kihlstrom J.F., Rose P.M., and Glisky M.L. Mental images can be ambiguous: reconstruals and reference-frame reversals. Memory and Cognition 20 (1992) 107-123
28. Poirier C., Collignon O., De Volder A., Tranduy D., Renier L., Vanlierde A., and Scheiber C. Specific activation of the V5 brain area by auditory motion processing: an fMRI study. Brain Research-Cognitive Brain Research 25 (2005) 650-658
29. Poirier C., Richard M.-A., Tranduy D., and Veraart C. Assessment of sensory substitution prosthesis potentialities in minimalist conditions of learning. Applied Cognitive Psychology 20 (2006) 447-460
30. Poirier C., Collignon O., Scheiber C., Renier L., Vanlierde A., Tranduy D., Veraart C., and De Volder A.G. Auditory motion perception activates visual motion areas in early blind subjects. Neuroimage 31 (2006) 279-285
31. Poirier C., De Volder A., Tranduy D., and Scheiber C. Pattern recognition using a device substituting audition for vision in blindfolded sighted subjects. Neuropsychologia 45 (2007) 1108-1121
32. Ptito M., Moesgaard S.M., Gjedde A., and Kupers R. Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind. Brain 128 (2005) 606-614
33. Renier L., Collignon O., Tranduy D., Poirier C., Vanlierde A., Veraart C., and De Volder A. Visual cortex activation in early blind and sighted subjects using an auditory visual substitution device to perceive depth. Neuroimage 22 (2004) S1
34. Renier L., Laloyaux C., Collignon O., Tranduy D., Vanlierde A., Bruyer R., and De Volder A.G. The Ponzo illusion with auditory substitution of vision in sighted and early-blind subjects. Perception 34 (2005) 857-867
35. Renier L., Collignon O., Poirier C., Tranduy D., Vanlierde A., Bol A., Veraart C., and De Volder A.G. Cross-modal activation of visual cortex during depth perception using auditory substitution of vision. Neuroimage 26 (2005) 573-580
36. Renier L., Bruyer R., and De Volder A.G. Vertical-horizontal illusion present for sighted but not early blind humans using auditory substitution of vision. Perception and Psychophysics 68 (2006) 535-542
37. Ricciardi, E., Vanello, N., Sani, L., Gentili, C., Scilingo, E.P., Landini, L., Guazzelli, M., Bicchi, A., Haxby, J.V., Pietrini, P. The Effect of Visual Experience on the Development of Functional Architecture in hMT+. Cereb. Cortex published online 19 March 2007 (doi:10.1093/cercor/bhm018).
38. Sampaio E., Maris S., and Bach-y-Rita P. Brain plasticity: 'visual' acuity of blind persons via the tongue. Brain Research 908 (2001) 204-207
39. Theoret H., Merabet L., and Pascual-Leone A. Behavioral and neuroplastic changes in the blind: evidence for functionally relevant cross-modal interactions. Journal of Physiology Paris 98 (2004) 221-233
40. Ungerleider L.G., and Haxby J.V. 'What' and 'where' in the human brain. Current Opinion in Neurobiology 4 (1994) 157-165
41. Vanlierde A., De Volder A.G., Wanet-Defalque M.C., and Veraart C. Occipito-parietal cortex activation during visuo-spatial imagery in early blind humans. Neuroimage 19 (2003) 698-709