Fast, accurate reaching movements with a visual-to-auditory sensory substitution device

Restorative Neurology and Neuroscience

Volumn 30, Issue 4, 2012, Pages 313-323

  Levy Tzedek, S ^a,b   Hanassy, S ^a   Abboud, S ^a   Maidenbaum, S ^a   Amedi, A ^a,b  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

blindness; motor control; perception and action; sensorimotor integration; Sensory substitution; spatial processing; vision rehabilitation; visual impairment

Indexed keywords

ADULT; ALGORITHM; ARTICLE; BLINDNESS; BRAIN FUNCTION; CLINICAL ARTICLE; COLOR; DEVICES; FEMALE; HAND MOVEMENT; HUMAN; MALE; MOTOR CONTROL; PERCEPTION; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; SENSORY SUBSTITUTION DEVICES; SOUND; TASK PERFORMANCE; VISION; VISUAL IMPAIRMENT;

ACOUSTIC STIMULATION; ADULT; FEEDBACK; FEMALE; HUMANS; MALE; MOVEMENT; PERCEPTION; PSYCHOMOTOR PERFORMANCE; TIME FACTORS; VISION, OCULAR; VISUALLY IMPAIRED PERSONS; YOUNG ADULT;

EID: 84863894354     PISSN: 09226028     EISSN: 18783627     Source Type: Journal    
DOI: 10.3233/RNN-2012-110219     Document Type: Article

References (47)

1. Amedi, A., Kriegstein, K., Atteveldt, N.M., Beauchamp, M.S. & Naumer,M.J. (2005). Functional imaging of human crossmodal identification and object recognition. Exp Brain Res, 166(3), 559-571.
2. Amedi, A., Stern, W.M., Camprodon, J.A., Bermpohl, F., Merabet, L., Rotman, S., et al. (2007). Shape conveyed by visualto- auditory sensory substitution activates the lateral occipital complex. Nat Neurosci, 10(6), 687-689.
3. Arno, P., Vanlierde, A., Streel, E., Wanet Defalque, M.C., Sanabria Bohorquez, S. & Veraart, C. (2001). Auditory substitution of vision: Pattern recognition by the blind. Appl Cognitive Psych, 15(5), 509-519.
4. Auvray,M., Hanneton, S. & O'Regan, J.K. (2007). Learning to perceive with a visuo-Auditory substitution system: Localisation and object recognition with 'The vOICe'. Perception, 36(3), 416-430.
5. Bach-y-Rita, P. (1970). Neurophysiological basis of a tactile visionsubstitution system. IEEE T Man Machine, 108-110.
6. Bach-y-Rita, P. (1972). Brain mechanisms in sensory substitution, Academic Press
7. Bach-Y-Rita, P., Collins, C.C., Saunders, F.A., White, B. & Scadden, L. (1969). Vision substitution by tactile image projection. Nature, 221(5184), 963-964.
8. Bach-y-Rita, P. & Kercel, S.W. (2003). Sensory substitution and the human-Machine interface. Trends Cogn Sci, 7(12), 541-546.
9. Bach-y-Rita, P., Tyler, M.E.&Kaczmarek, K.A. (2003). Seeing with the brain. Int j hum-Comput int, 15(2), 285-295.
10. Bangert, M., Peschel, T., Schlaug, G., Rotte, M., Drescher, D., Hinrichs, H., et al. (2006). Shared networks for auditory and motor processing in professional pianists: Evidence from fMRI conjunction. Neuroimage, 30(3), 917-926.
11. Bootsma, R.J., Boulard, M., Fernandez, L. & Mottet, D. (2002). Informational constraints in human precision aiming. Neurosci Lett, 333(2), 141-145.
12. Capelle, C., Trullemans, C., Arno, P. & Veraart, C. (1998). A real-Time experimental prototype for enhancement of vision rehabilitation using auditory substitution. Biomedical Engineering, IEEE T Bio-Med Eng, 45(10), 1279-1293.
13. Cattaneo, Z., Vecchi, T., Cornoldi, C., Mammarella, I., Bonino, D., Ricciardi, E., et al. (2008). Imagery and spatial processes in blindness and visual impairment. Neurosci Biobehav R, 32(8), 1346-1360.
14. Chebat, D.R., Schneider, F.C., Kupers, R. & Ptito, M. (2011). Navigation with a sensory substitution device in congenitally blind individuals. Neuroreport, 22(7), 342-347.
15. Chen, Y.P., Kang, L.J., Chuang, T.Y., Doong, J.L., Lee, S.J., Tsai, M.W., et al. (2007). Use of virtual reality to improve upper-Extremity control in children with cerebral palsy: A single-Subject design. Phys Ther, 87(11), 1441.
16. Collignon, O., Vandewalle, G., Voss, P., Albouy, G., Charbonneau, G., Lassonde, M., et al. (2011). Functional specialization for auditory-Spatial processing in the occipital cortex of congenitally blind humans. P Natl Acad Sci, 108(11), 4435-4440.
17. Collins, C.C. (1970). Tactile television-Mechanical and electrical image projection. IEEE T Man Machine, 11(1), 65-71.
18. Fiehler, K., Burke, M., Bien, S., Röder, B. & Rösler, F. (2009). The human dorsal action control system develops in the absence of vision. Cereb Cortex, 19(1), 1-12.
19. Fiehler, K., Burke, M., Engel, A., Bien, S.&Rösler, F. (2008). Kinesthetic working memory and action control within the dorsal stream. Cereb Cortex, 18(2), 243-253.
20. Flash, T. & Hogan, N. (1985). The coordination of arm movements: An experimentally confirmed mathematical model. J Neurosci, 5(7), 1688-1703
21. Harris, C.M.&Wolpert, D.M. (1998). Signal-Dependent noise determines motor planning. Nature, 394(6695), 780-784.
22. Hasegawa, T., Matsuki, K.I., Ueno, T., Maeda, Y., Matsue, Y., Konishi, Y., et al. (2004). Learned audio-visual cross-Modal associations in observed piano playing activate the left planum temporale. An fMRI study. Cognitive Brain Res, 20(3), 510-518.
23. Haslinger, B., Erhard, P., Altenmüller, E., Schroeder, U., Boecker,H. & Ceballos-Baumann, A.O. (2005). Transmodal sensorimotor networks during action observation in professional pianists. J Cognitive Neurosci, 17(2), 282-293.
24. Jansson, G. (1983). Tactile guidance of movement. Int J Neurosci, 19(1-4), 37-46.
25. Kupers, R., Chebat, D.R., Madsen, K.H., Paulson, O.B. & Ptito, M. (2010). Neural correlates of virtual route recognition in congenital blindness. P Natl Acad Sci, 107(28), 12716-12721.
26. Levy-Tzedek, S., Ben Tov, M. & Karniel, A. (2011). Early switching between movement types: Indication of predictive control? Brain Res Bull, 85(5), 283-288.
27. Levy-Tzedek, S., Ben Tov, M. & Karniel, A. (2011). Rhythmic movements are larger, faster but with the same frequency upon removal of visual feedback. J Neurophysiol, 106(5), 2120-2126.
28. Levy-Tzedek, S., Krebs, H., Song, D., Hogan, N. & Poizner, H. (2010). Non-Monotonicity on a spatio-Temporally defined cyclic task: Evidence of two movement types? Exp Brain Res, 202(4), 733-746.
29. Levy-Tzedek, S., Krebs, H.I., Arle, J.E., Shils, J.L. & Poizner, H. (2011). Rhythmic movement in Parkinson's disease: Effects of visual feedback and medication state. Exp Brain Res, 211(2), 277-86.
30. Levy-Tzedek, S., Krebs, H.I., Shils, J.L., Apetauerova, D. & Arle, J.E. (2007). Parkinson's disease: A motor control study using a wrist robot. Adv Robotics, 21(10), 1201-1213.
31. Maidenbaum, S., Levy-Tzedek, S., Arbel, R., Hanassy, S. & Amedi, A. (2011). Shapes from the Depths-Shape Recognition Using Distance Information. Presented at the 7th Computational Motor Control Workshop, Israel.
32. Mazzoni, P., Hristova, A. & Krakauer, J.W. (2007). Why don't we move faster? Parkinson's disease, movement vigor, and implicit motivation. J Neurosci, 27(27), 7105.
33. Meijer, P.B.L. (1992). An experimental system for auditory image representations. IEEE T Bio-Med Eng, 39(2), 112-121
34. Melara, R.D.&O'Brien, T.P. (1987). Interaction between synesthetically corresponding dimensions. J Exp Psychol Gen, 116(4), 323.
35. Merabet, L.B., Battelli, L., Obretenova, S., Maguire, S., Meijer, P. & Pascual-Leone, A. (2009). Functional recruitment of visual cortex for sound encoded object identification in the blind. Neuroreport, 20(2), 132-138.
36. Messier, J., Adamovich, S., Berkinblit, M., Tunik, E. & Poizner, H. (2003). Influence of movement speed on accuracy and coordination of reaching movements to memorized targets in three-Dimensional space in a deafferented subject. Exp Brain Res, 150(4), 399-416.
37. Renier, L., Bruyer, R. & De Volder, A.G. (2006). Vertical-Horizontal illusion present for sighted but not early blind humans using auditory substitution of vision. Atten Percept Psycho, 68(4), 535-542.
38. Renier, L., Collignon, O., Poirier, C., Tranduy, D., Vanlierde, A., Bol, A. et al. (2005). Cross-Modal activation of visual cortex during depth perception using auditory substitution of vision. Neuroimage, 26(2), 573-580.
39. Renier, L. & De Volder, A.G. (2010). Vision substitution and depth perception: Early blind subjects experience visual perspective through their ears. Disabil Rehabil: Assistive Technology, 5(3), 175-183.
40. Renier, L.A., Anurova, I., De Volder, A.G., Carlson, S., VanMeter, J. &Rauschecker, J.P. (2010). Preserved functional specialization for spatial processing in the middle occipital gyrus of the early blind. Neuron, 68(1), 138-148.
41. Röder, B., Kusmierek, A., Spence, C. & Schicke, T. (2007). Developmental vision determines the reference frame for the multisensory control of action. P Natl Acad Sci, 104(11), 4753-4758.
42. Rossetti, Y., Stelmach, G., Desmurget, M., Prablanc, C. & Jeannerod, M. (1994). The effect of viewing the static hand prior to movement onset on pointing kinematics and variability. Exp Brain Res, 101(2), 323-330.
43. Soechting, J. & Flanders, M. (1989). Sensorimotor representations for pointing to targets in three-Dimensional space. J Neurophysiol, 62(2), 582-594.
44. Striem-Amit, E., Dakwar, O., Reich, L. & Amedi, A. (2011). The large-Scale organization of "visual" streams emerges without visual experience. Cereb Cortex, doi:10.1093/cercor/bhr253
45. Striem-Amit, E., Guendelman, M. & Amedi, A. (2012). 'Visual' acuity of the congenitally blind using visual-To-Auditory sensory substitution. PLoS ONE, 7(3), e33136.
46. Ward, J.&Meijer, P. (2010). Visual experiences in the blind induced by an auditory sensory substitution device. Conscious Cogn, 19(1), 492-500.
47. Wolpert, D., Ghahramani, Z. & Jordan, M. (1995). An internal model for sensorimotor integration. Science, 269(5232), 1880-1882.