Sensory substitution and the human-machine interface

Trends in Cognitive Sciences

Volumn 7, Issue 12, 2003, Pages 541-546

  Bach y Rita, Paul ^a   W Kercel, Stephen ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UNIVERSITY OF NEW ENGLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; HAPTIC INTERFACES; MAN MACHINE SYSTEMS; PLASTICITY; SENSORY PERCEPTION;

SENSORY LOSS; SENSORY SUBSTITUTION; TACTILE SYSTEMS;

COGNITIVE SYSTEMS;

AUDITORY SYSTEM; BRAILLE; COGNITION; HUMAN; NERVE CELL PLASTICITY; PATTERN RECOGNITION; PERCEPTION; POSITRON EMISSION TOMOGRAPHY; REVIEW; SENSATION; SENSORY DYSFUNCTION; SENSORY SYSTEM; SKIN RECEPTOR; SOMATOSENSORY SYSTEM; SPATIAL ORIENTATION; TACTILE DISCRIMINATION; TONGUE; TOUCH; VESTIBULAR SYSTEM; VISUAL INFORMATION; WALKING AID;

EID: 0345688029     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2003.10.013     Document Type: Review

References (52)

1. Bach-y-Rita P. Brain Mechanisms in Sensory Substitution. 1972;Academic Press.
2. Bach-y-Rita P. Nonsynaptic Diffusion Neurotransmission and Late Brain Reorganization. 1995;Demos-Vermande, New York.
3. White B.W., et al. Seeing with the skin. Percept. Psychophys. 7:1970;23-27.
4. Heil J. Perception and Cognition. 1983;University of California Press.
5. Morgan M.J. Molyneux's Question. 1977;Cambridge University Press.
6. O'Regan J.K., Noë A. A sensorimotor account of vision and visual consciousness. Behav. Brain Sci. 24:2001;939-973.
7. Bach-y-Rita P., et al. Vision substitution by tactile image projection. Nature. 221:1969;963-964.
8. Kuc R. Binaural sonar electronic travel aid provides vibrotactile cues for landmark, reflector motion and surface texture classification. IEEE Trans. Biomed. Eng. 49:2002;1173-1180.
9. Wang J., et al. Basic eperimental research on electrotactile physiology for deaf auditory substitution. Acta Acad. Med. Shandong. 35:(1):1997;1-5.
10. Wang J., et al. Application software for electrotactile substitution. Shandong J. Biomed. Eng. 2:1995;29-37.
11. Tyler, M. et al. Closing an open-loop control system: vestibular substitution through the tongue. J. Integr. Neurosci. (in press).
12. Meijer P.B.L. An experimental system for auditory image representations. IEEE Trans. Biomed. Eng. 39:1992;112-121.
13. Veraart C., Wanet-Defalque M.C. Representation of locomotor space by the blind. Percept. Psychophys. 42:1987;132-139.
14. Arno P., et al. Auditory coding of visual patterns for the blind. Perception. 28:1999;1013-1029.
15. Sampaio E., et al. Brain plasticity: "visual" acuity of blind persons via the tongue. Brain Res. 908:2001;204-207.
16. Hurley S., Noë A. Neural plasticity and consciousness. Biol. Philos. 18:2003;131-168.
17. Bach-y-Rita, P. (1988) Brain plasticity. In Rehabilitation Medicine (Goodgold, J., ed.), pp. 113-118, Mosby.
18. Mitterauer B., Kopp K. The self-composing brain: towards a glial-neuronal brain theory. Brain Cogn. 51:2003;357-367.
19. Kercel, S.W. The endogenous brain. J. Integr. Neurosci. (in press).
20. Kercel S.W., et al. Bizarre hierarchy of brain function. Priddy K.L., Angeline P.J. Intelligent Computing: Theory and Applications. Proceedings of SPIE (Vol. 5103). 2003;150-161 SPIE.
21. Kercel S.W. Softer than soft computing. Kercel S.W. Proceedings of the 2003 IEEE International Workshop on Soft Computing in Industrial Applications. 2003;27-32 IEEE.
22. Jenkins W.M., et al. Functional reorganization of primary somatosensory cortex in adult owl monkeys after behaviorally controlled tactile stimulation. J. Neurophysiol. 63:1990;82-104.
23. Levin H.S., Grafman J. Cerebral Reorganization of Function after Brain Damage. 2000;Oxford University Press.
24. De Volder A.G., et al. Auditory triggered mental imagery of shape involves visual association areas in early blind humans. Neuroimage. 14:2001;129-139.
25. Capelle C., et al. A real time experimental prototype for enhancement of vision rehabilitation using auditory substitution. IEEE Trans. Biomed. Eng. 45:1998;1279-1293.
26. Kajimoto, H. et al. (2003) SmartTouch - augmentation of skin sensation with electrocutaneous display. Proceedings of the 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, IEEE, pp. 40-46.
27. Kaczmarek K.A. Electrotactile adaptation on the abdomen: preliminary results. IEEE Trans. Rehabil. Eng. 8:2000;499-505.
28. Kajimoto H., et al. optimal design method for selective nerve stimulation and its application to electrocutaneous display. Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 2002:2002;303-310.
29. Kaczmarek K.A., Haase S.J. Pattern identification as a function of stimulation current on a fingertip-scanned electrotactile display. IEEE Trans. Neural Syst. Rehabil. Eng. 11:2003;269-275.
30. Kaczmarek K.A., Haase S.J. Pattern identification and perceived stimulus quality as a function of stimulation current on a fingertip-scanned electrotactile display. IEEE Trans. Neural Syst. Rehabil. Eng. 11:2003;9-16.
31. Kaczmarek K., Bach-y-Rita P. Tactile displays. Barfield W., Furness-IIIrd T. Advanced Interface Design and Virtual Environments. 1995;349-414 Oxford University Press.
32. Bach-y-Rita P., et al. Form perception with a 49-point electrotactile stimulus array on the tongue. J. Rehabil. Res. Dev. 35:1998;427-430.
33. Kercel, S.W. and Bach-y-Rita, P. Non-invasive coupling of electronically generated data into the human nervous system. In Wiley Encyclopedia of Biomedical Engineering, (Metin Akay, ed.), Wiley (in press).
34. Bach-y-Rita, P. and Kaczmarek, K.A. (2002) Tongue placed tactile output device. US Patent 6,430,459.
35. Collins C.C., Bach-y-Rita P. Transmission of pictorial information through the skin. Adv. Biol. Med. Phys. 14:1973;285-315.
36. Mussa-Ivaldi F.A., Miller L.E. Brain-machine interfaces: computational demands and clinical needs meet basic neuroscience. Trends Neurosci. 26:2003;329-334.
37. Suaning G.J., Lovell N.H. CMOS neurostimulation ASIC with 100 channels, scalable output and bidirectional radio-frequency telemetry. IEEE Trans. Biomed. Eng. 48:2001;248-260.
38. Nicolelis M.A., et al. Chronic, multisite, multielectrode recordings in macaque monkeys. Proc. Natl. Acad. Sci. U. S. A. 100:2003;11041-11046.
39. Niparko J.K., et al. Cochlear Implants: Principles and Practices. 2000;Lippincott, Williams & Wilkins.
40. Sadato N., et al. Neural networks for braille reading by the blind. Brain. 121:1998;1213-1229.
41. Büchel C., et al. Different activation patterns in the visual cortex of late and congenitally blind subjects. Brain. 121:1998;409-419.
42. Arno P., et al. Occipital activation by pattern recognition in the early blind using auditory substitution of vision. Neuroimage. 13:2001;632-645.
43. De Volder A.G., et al. Changes in occipital cortex activity in early blind humans using a sensory substitution device. Brain Res. 826:1999;128-134.
44. Kupers R., et al. Activation of visual cortex by electrotactile stimulation of the tongue in early-blind subjects. Neuroimage. 19:2003;S65.
45. Danilov Y., et al. Analysis of head stability in normal and bilateral vestibular dysfunction subjects. J. Neurosci. Abstr. 268.5. 2003;. (Abstract Viewer online).
46. Bach-y-Rita P., et al. Seeing with the brain. Internat. J. Human-Computer Interaction. 15:2003;287-297.
47. Freeman W.J. How Brains Make Up Their Minds. 1999;Weidenfeld & Nicholson.
48. Merleau-Ponty, M. (1945) (transl. 1962, Smith, C.) Phenomenology of Perception, Humanities, New York.
49. Merleau-Ponty, M., (1942) (transl. 1963, Fischer, A.L.) The Structure of Behavior, Beacon, Boston.
50. Proust J. Perception et Intermodalite. 1997;Presses Universitaires de France, Paris.
51. Pacherie E. Du probleme de Molyneux au probleme de Bach-y-Rita. Proust J. Perception et Intermodalite. 1997;255-293 Presses Universitaires de France, Paris.
52. Bach-y-Rita P., Kercel S.W. Sensori-'motor' coupling by observed and imagined movement. Intellectica. 35:2002;287-297.