Cognitive and brain mechanisms in sensory substitution of vision: A contribution to the study of human perception

Journal of Integrative Neuroscience

Volumn 4, Issue 4, 2005, Pages 489-503

  Renier, Laurent ^a   de Volder, Anne G ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Brain plasticity; Cross modal perception; Early blindness; Functional imaging; Sensory substitution

Indexed keywords

ADAPTATION; AUDITORY STIMULATION; BLINDNESS; BRAIN FUNCTION; COGNITION; DEVICE; HUMAN; HUMAN CHARACTERISTIC; INFORMATION PROCESSING DEVICE; NERVE CELL PLASTICITY; REVIEW; SENSORY SUBSTITUTION; SENSORY SYSTEM; TACTILE STIMULATION; TECHNOLOGY; VISION; VISUAL DEPRIVATION; VISUAL ILLUSION; VISUAL PROSTHESIS;

BLINDNESS; BRAIN; COGNITION; HUMANS; NEURONAL PLASTICITY; VISUAL PERCEPTION;

EID: 30744446725     PISSN: 02196352     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219635205000999     Document Type: Review

References (93)

1. Amedi A, Bermpohl F, Camprodon J, Fox S, Merabet L, Meijer P, Pascual-Leone A, Neural correlates of visual-to-auditory sensory substitution in proficient blind users, Proceedings of the 12th Annual Meeting of the Cognitive Neuroscience Society (CNS 2005), New York, April 2005.
2. Amedi A, Raz N, Pianka P, Malach R, Zohary E, Early "visual" cortex activation correlates with superior verbal memory performance in the blind, Nat Neurosci 6: 758-766, 2003.
3. Arno P, Capelle C, Wanet-Defalque M-C, Catalan-Ahumada M, Veraart C, Auditory coding of visual patterns for the blind, Perception 28:1013-1029, 1999.
4. Arno P, De Volder AG, Vanlierde A, Wanet-Defalque M-C, Streel E, Robert A, Sanabria-Bohorquez S, Veraart C, Occipital activation by pattern recognition in the Early Blind using auditory substitution of vision, Neuroimage 13:632-645, 2001.
5. Arno P, Vanlierde A, Streel E, Wanet-Defalque M-C, Sanabria-Bohorquez S, Veraart C, Auditory substitution of vision: Pattern recognition by the blind, Appl Cognitive Psych 15:509-519, 2001.
6. Auvray M, Hanneton S, O'Regan JK, Localisation and form recognition in sensory substitution, Proceedings of the 26th European Conference on Visual Perception (ECVP 2003), Paris, September 2003.
7. Bach-y-Rita P, Brain Mechanisms in Sensory Substitution, Academic Press, San Diego CA, 1972.
8. Bach-y-Rita P, Nonsynaptic Diffusion Neurotransmission and Late Brain Reorganization, Demos-Vermande, New York, 1995.
9. Bach-y-Rita P, Substitution sensorielle et qualia, in Proust J (ed.), Perception et Intermodalité, Presses Universitaires de France, Paris, pp. 303, 1997.
10. Bach-y-Rita P, Tactile sensory substitution studies, Ann NY Acad Sci 1013:83-91, 2004.
11. Bach-y Rita P, Collins CC, Saunders F, White B, Scadden L, Vision substitution by tactile image projection, Nature 221:963-964, 1969.
12. Bach-y-Rita P, Kaczmareck KA, Tyler ME, Garcia-Lara J, Form perception with a 49-point electrotactile stimulus array on the tongue: A technical note, J Rehabil Res Dev 35:427-430, 1998.
13. Bach-y-Rita P, Kercel SW, Sensory substitution and the human-machine interface, Trends Cogn Sci 7:541-546, 2003.
14. Bach-y-Rita P, Tyler ME, Kaczmarek KA, Seeing with the brain, Int J Hum-Comput Int 15:285-295, 2003.
15. Bliss JC, Katcher MH, Rogers CH, Shepard RP, Optical-to-tactile image conversion for the blind, IEEE T Man Machine MMS-11:58-65, 1970.
16. Brabyn JA, A review of mobility aids and means of assessment, in Warren DH, Strelow ER (eds.), Electronic Spatial Sensing for the Blind, Martinus Nijhoff, Boston, pp. 544, 1985.
17. Brindley GS, Lewin WS, The sensations produced by electrical stimulation of the visual cortex, J Physiol 96:479-493, 1968.
18. Büchel C, Price C, Frackowiak RSJ, Friston K, Different activation patterns in the visual cortex of late and congenitally blind subjects, Brain 121:409-419, 1998.
19. Büchel C, Price C, Friston K, A multimodal language region in the ventral visual pathway, Nature 394:274-277, 1998.
20. Burton H, Snyder AZ, Diamond JB, Raichle ME, Adaptive changes in early and late blind: A fMRI study of verb generation to heard nouns, J Neurophysiol 88:3359-3371, 2002.
21. Capelle C, Trullemans C, Arno P, Veraart C, A real time experimental prototype for enhancement of vision rehabilitation using auditory substitution, IEEE T Bio-med Eng 45:1279-1293, 1998.
22. Collignon O, Lassonde M, Lepore F, Vasilescu MC, Bastien D, Tranduy D, Veraart C, Functional involvement of occipital cortex for sound processing in early blind subjects using a sensory substitution prosthesis, Proceedings of the 34th Annual Meeting of the Society for Neurosciences, San Diego CA, 2004.
23. Collignon O, Renier L, Bruyer R, Tranduy D, Veraart C, Crossmodal compensation for spatial attention in early blind subjects, Proceedings of the 5th Annual Meeting of the International Multisensory Research Forum (IMRF2004), Oxford University Press, Oxford, 2004.
24. Collins CC, On mobility aids for the blind, in Warren DH, Strelow ER (eds.), Electronic Spatial Sensing for the Blind, Martinus Nijhoff, Boston, pp. 35-64, 1985.
25. Collins CC, Bach-y-Rita P, Transmission of pictorial information through the skin, Adv Biol Med Phys 14:285-315, 1973.
26. Crandall W, Bentzen BL, Myers L, Brabyn J, New orientation and accessibility option for persons with visual impairment: Transportation applications for remote infrared audible signage, Clin Exp Optom 84:120-131, 2001.
27. Crandall W, Brabyn J, Bentzen BL, Myers L, Remote infrared signage evaluation for transit stations and intersections, J Rehabil Res Dev 36:341-355, 1999.
28. Crandall W, Gerrey W, Alden A, Remote signage and its implications to print-handicap travelers, Proceedings: Rehabilitation Engineering Society of North America (RESNA) Annual Conference, Las Vegas, June 1993.
29. De Volder AG, Catalan-Ahumada M, Robert A, Bol A, Labar D, Coppens A, Michel C, Veraart C, Changes in occipital cortex activity in early blind humans using a sensory substitution device, Brain Res 826:128-134, 1999.
30. De Volder AG, Toyama H, Kimura Y, Kiyosawa M, Nakano H, Vanlierde A, Wanet-Defalque MC, Mishina M, Oda K, Ishiwata K, Senda M, Auditory triggered mental imagery of shape involves visual association areas in early blind humans, Neuroimage 14:129-139, 2001.
31. Dobelle WH, Turkel J, Henderson DC, Evans JR, Mapping the representation of the visual-field by electrical-stimulation of human visual cortex, Am J Ophthalmol 88:727-735, 1979.
32. Farmer LW, Mobility devices, Bull Prosthet Res 14:47-118, 1978.
33. Gougoux F, Lepore F, Lassonde M, Voss P, Zatorre RJ, Belin P, Neuropsychology: Pitch discrimination in the early blind, Nature 430:309, 2004.
34. Gregory RL, Distortion of visual space as inappropriate constancy scaling, Nature 199:678-691, 1963.
35. Gregory RL, Eye and Brain: The Psychology of Seeing, 5th edn., Princeton University Press, Princeton NJ, 1997.
36. Hoover RE, The cane as a travel aid, in Zahl PA (ed.), Blindness, Princeton University Press, Princeton NJ, pp. 589, 1950.
37. Howard IP, Seeing in Depth Volume 1 Basic Mechanisms, I Porteous, Thornhill ON Canada, 2002.
38. Humayun MS, de Juan E, Dagnelie G, Greenburg RJ, Propst RH, Phillips H, Visual perception elicited by electrical stimulation of retina in blind humans, Arch Ophthalmol 114:40-46, 1996.
39. Humayun MS, de Juan E, Weiland JD, Dagnelie G, Katona S, Greenberg R, Suzuki S, Pattern electrical stimulation of the human retina, Vision Res 39:2569-2576, 1999.
40. Kaczmareck KA, Sensory augmentation and substitution, in Bronzino JD (ed.), CRC Handbook of Biomedical Engineering, CRC Press, Boca Raton FL, 1995.
41. Kaczmareck KA, Webster JG, Bach-y-Rita P, Tompkins WJ, Electrotactile and vibrotactile displays for sensory substitution systems, IEEE T Bio-med Eng 38:1-16, 1991.
42. Kay L, A New or Improved Apparatus for Furnishing Information as to Position of Objects, Patent Specification No. 978741, The Patent Office, London, 1959.
43. Kay L, Orientation of bats and men by ultrasonic echo-location, Br Commun Electron 8:582-586, 1961.
44. Kay L, The Sonic Glasses evaluated, New Outlook Blind 67:7-11, 1973.
45. Kay L, A sonar aid to enhance spatial perception of the blind: Engineering design and evaluation, J I Electron Rad Eng 44:605-627, 1974.
46. Kay L, Sensory aids to spatial perception for blind persons: Their design and evaluation, in Warren DH, Strelow ER (eds.), Electronic Spatial Sensing for the Blind, Martinus Nijhoff, Boston, pp. 544, 1985.
47. Kellogg WN, Sonar system of the blind, Science 137:399-404, 1962.
48. Kujala T, Alho K, Paavilainen P, Summala H, Näätänen R, Neural plasticity in processing of sound location by the early blind: An event-related potential study, Electroencephalogr Clin Neurophysiol 84:469-472, 1992.
49. Kujala T, Huotilainen M, Sinkkonen J, Ahonen AI, Alho K, Hämäläinen MS, Ilmoniemi RJ, Kajola M, Knuutila JET, Lavikainen J, Salonen O, Simola J, Standerskjöld-Nordenstram C-G, Tiinen H, Tissari SO, Näätänen R, Visual cortex activation in blind humans during sound discrimination, Neurosci Lett 183:143-146, 1995.
50. Künnapas TM, The vertical-horizontal illusion and the visual field, J Exp Psychol 53:405-407, 1957.
51. Kupers R, Sampaio E, Moesgaard S, Gjedde A, Ptito M, Activation of visual cortex by electrotactile stimulation of the tongue in early-blind subjects, Neuroimage 19: Abstract (S65), 2003.
52. Lambert S, Sampaio E, Mauss Y, Scheiber C, Blindness and brain plasticity: Contribution of mental imagery? An fMRI study, Brain Res Cogn Brain Res 20:1-11, 2004.
53. Leclerc C, Saint-Amour D, Lavoie ME, Lassonde M, Lepore F, Brain functional reorganisation in early blind humans revealed by auditory event-related potentials, Neuroreport 11:545-550, 2000.
54. Lessard N, Pare M, Lepore F, Lassonde M, Early-blind human subjects localize sound sources better than sighted subjects, Nature 395:278-280, 1998.
55. Loomis JM, Golledge RG, Klatzky RL, GPS-based navigation systems for the visually impaired, in Barfield W, Caudell T (eds.), Fundamentals of Wearable Computers and Augmented Reality, Lawrence Erlbaum Associates, Mahwah NJ, pp. 797, 2000.
56. Loomis JM, Klatzky RL, Golledge RG, Navigating without vision: Basic and applied research, Optom Vis Sci 78:282-289, 2001.
57. Margalit E, Maia M, Weiland JD, Greenberg RJ, Fujii GY, Torres G, Piyathaisere DV, O'Hearn TM, Liu W, Lazzi G, Dagnelie G, Scribner DA, de Juan E, Humayun MS, Retinal prosthesis for the blind, Surv Ophthalmol 47:335-356, 2002.
58. Meijer PBL, An experimental system for auditory image representations, IEEE T Biomed Eng 39:112-121, 1992.
59. Morgan MJ, Molyneux's Question, Cambridge University Press, Cambridge, 1977.
60. Niemeyer W, Starlinger I, Do the blind hear better? Investigations on auditory processing in congenital or early acquired blindness. II Central functions, Audiology 20: 510-515, 1981.
61. Normann KA, Visual neuroprosthetics: Fundamental vision for the blind, IEEE Eng Med Biol 14:77-83, 1995.
62. O'Regan JK, Noë A, A sensorimotor account of vision and visual consciousness, Behav Brain Sci 24:939-1011, 2001.
63. Pietrini P, Furey ML, Ricciardi E, Gobbini MI, Wu WHC, Cohen L, Guazzelli M, Haxby JV, Beyond sensory images: Object-based representation in the human ventral pathway, P Natl Acad Sci USA 101:5658-5663, 2004.
64. Ptito M, Moesgaard SM, Gjedde A, Kupers R, Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind, Brain 128:606-614, 2005.
65. Rauschecker JP, Compensatory plasticity and sensory substitution in the cerebral cortex, Trends Neurosci 18:36-43, 1995.
66. Rauschecker JP, Korte M, Auditory compensation for early blindness in cat cerebral cortex, J Neurosci 13:4538-4548, 1993.
67. Renier L, Collignon O, Poirier C, Tranduy D, Vanlierde A, Bol A, Veraart C, De Volder AG, Cross-modal activation of visual cortex during depth perception using auditory substitution of vision, Neuroimage 26:573-580, 2005.
68. Renier L, Collignon O, Tranduy D, Poirier C, Vanlierde A, Veraart C, De Volder AG, Visual cortex activation in early blind and sighted subjects using an auditory visual sensory substitution device to perceive depth, 10th Annual Meeting of the Organization for Human Brain Mapping (HBM2004), Budapest, June 2004.
69. Renier L, Collignon O, Tranduy D, Vanlierde A, De Volder AG, Depth perception with a sensory substitution system in early blind subjects, Annual Meeting of the Belgian Psychological Society, Abstract, Universal Press, Brussels, 2003.
70. Renier L, Laloyaux C, Collignon O, Tranduy D, Vanlierde A, Bruyer R, De Volder AG, The Ponzo illusion with auditory substitution of vision in sighted and early blind subjects, Perception 34:851-867, 2005.
71. Rice CE, Perceptual enhancement in the early blind? Psychol Rec 19:1-14, 1969.
72. Rock I, Gallant J, Kube P, An introduction to vision science, in Palmer SE (ed.), Vision Science, MIT Press, Cambridge MA, pp. 760, 1999.
73. Röder B, Rösler F, Hennighausen E, Näcker F, Event-related potentials during auditory and somatosensory discrimination in sighted and blind human subjects, Cognitive Brain Res 4:77-93, 1996.
74. Röder B, Stock O, Bien S, Neville H, Rösler F, Speech processing activates visual cortex in congenitally blind humans, Eur J Neurosci 16:930-936, 2002.
75. Röder B, Teder-Salejarvi W, Sterr A, Rosler F, Hillyard SA, Neville HG, Improved auditory spatial tuning in blind humans, Nature 400:162-166, 1999.
76. Sadato N, Okada T, Honda M, Yonekura Y, Critical period for cross-modal plasticity in blind humans a functional MRI study, Neuroimage 16:389-400, 2002.
77. Sadato N, Pascual-Leone A, Grafman J, Deiber MP, Ibanez V, Hallett M, Neural networks for Braille reading by the blind, Brain 121:1213-1229, 1998.
78. Sadato N, Pascual-Leone A, Grafman J, Ibanez V, Deiber M-P, Dold G, Hallett M, Activation of the primary visual cortex by Braille reading in blind subjects, Nature 380:526-528, 1996.
79. Sampaio E, Maris S, Bach-y-Rita P, Brain plasticity: "Visual" acuity of blind persons via the tongue, Brain Res 908:204-207, 2001.
80. Squire L, Memory and Brain, Oxford University Press, New York, 1987.
81. Stoerig P, Ludowig E, Mierdorf T, Oros-Peusquens A, Shah JN, Meijer PB, Pascual-Leone A, Seeing through the ears? Identification of images converted to sounds improves with practice, 34th Annual Meeting of the Society for Neuroscience (SfN), San Diego CA, 2004.
82. Talairach J, Tournoux P, Co-Planar Stereotaxic Atlas of the Human Brain, Thieme Medical, New York, 1988.
83. Tulving E, Organisation of Memory: Quo vadis? in Gazzaniga MS (ed.), The Cognitive Neurosciences, MIT Press, Cambridge MA, pp. 1447, 1995.
84. Uhl F, Franzen P, Lindinger G, Lang W, Deecke L, On the functionality of the visually deprived occipital cortex in early blind persons, Neurosci Lett 124:256-259, 1991.
85. Vanlierde A, De Volder A, Wanet-Defalque M-C, Veraart C, Occipito-parietal cortex activation during visuo-spatial imagery in early blind humans, Neuroimage 19:698-709, 2003.
86. Veraart C, Neurophysiological approach to the design of visual prosthesis: A theoretical discussion, J Med Eng Technol 13:57-62, 1989.
87. Veraart C, Duret F, Brelen M, Oozeer M, Delbeek J, Vision rehabilitation in case of blindness, Expert Rev Med Dev 1:139-153, 2004.
88. Veraart C, Raftopoulos C, Mortimer JT, Delbeke J, Pins D, Michaux G, Vanlierde A, Parini S, Wanet-Defalque M, Visual sensations produced by optic nerve stimulation using an implanted self-sizing spiral cuff electrode, Brain Res 813:181-186, 1998.
89. Veraart C, Wanet-Defalque MC, Gerard B, Vanlierde A, Delbeke J, Pattern recognition with the optic nerve visual prosthesis, Artif Organs 27:996-1004, 2003.
90. Weeks R, Horwitz B, Aziz-Sultan A, Tian B, Wessinger CM, Cohen LG, Hallett M, Rauschecker JP, A positron emission tomographic study of auditory localization in the congenitally blind, J Neurosci 20:2664-2672, 2000.
91. White BW, Saunders FA, Scadden L, Bach-y-Rita P, Collins CC, Seeing with the skin, Percept Psychophys 7:23-27, 1970.
92. Zappe A-C, Maucher T, Meier K, Scheiber C, Evaluation of a pneumatically driven stimulator device for vision substitution during fMRI studies, Magn Reson Med 51: 828-834, 2004.
93. Zrenner E, Stett A, Weiss S, Aramant RB, Guenther E, Kohler K, Miliczek KD, Seiler MJ, Haemmerle H, Can subretinal microphotodiodes successfully replace degenerated photoreceptors? Vision Res 39:2555-2567, 1999.