Perception with compensatory devices: From sensory substitution to sensorimotor extension

Cognitive Science

Volumn 33, Issue 6, 2009, Pages 1036-1058

  Auvray, Malika ^a   Myin, Erik ^b  

^a CNRS   (France)

^b UNIVERSITY OF ANTWERP   (Belgium)

Author keywords

Extended mind; Neural plasticity; Perceptual adaptation; Sensory modalities; Sensory substitution; Vision

Indexed keywords

EID: 70349593554     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1551-6709.2009.01040.x     Document Type: Article

References (84)

1. Aiello, G. L. (1998). Multidimensional electrocutaneous stimulation. IEEE Transactions on Rehabilitation Engineering, 6, 95-101.
2. Arno, P., Capelle, C., Wanet Defalque, M. C., Catalan Ahumada, M., & Veraart, C. (1999). Auditory coding of visual patterns for the blind. Perception, 28, 1013-1029.
3. Arno, P., Vanlierde, A., Streel, E., Wanet Defalque, M. C., Sanabria Bohorquez, S., & Veraart, C. (2001). Auditory substitution of vision: Pattern recognition by the blind. Applied Cognitive Psychology, 15, 509-519.
4. Auvray, M., Hanneton, S., Lenay, C., & O'Regan, J. K. (2005). There is something out there: Distal attribution in sensory substitution, twenty years later. Journal of Integrative Neuroscience, 4, 505-521.
5. Auvray, M., Hanneton, S., & O'Regan, J. K. (2007a). Learning to perceive with a visuo-auditory substitution system: Localization and object recognition with The Voice. Perception, 36, 416-430.
6. Auvray, M., Lenay, C., & Stewart, J. (2009). Perceptual interactions in a minimalist environment. New Ideas in Psychology, 27, 32-47.
7. Auvray, M., Philipona, D., O'Regan, J. K., & Spence, C. (2007b). The perception of space and form recognition in a simulated environment: The case of minimalist sensory-substitution devices. Perception, 36, 1736-1751.
8. Bach-y-Rita, P. (1972). Brain mechanisms in sensory substitution. New York: Academic Press.
9. Bach-y-Rita, P. (2002). Sensory substitution and qualia. In A. Noë & E. Thompson (Eds.), Vision and mind (pp. 497-514). Cambridge, MA: MIT Press.
10. Bach-y-Rita, P., Collins, C. C., Saunders, F. A., White, B., & Scadden, L. (1969). Vision substitution by tactile image projection. Nature, 221, 963-964.
11. Bach-y-Rita, P., & Kercel, S. W. (2003). Sensory substitution and the human-machine interface. Trends in Cognitive Sciences, 7, 541-546.
12. Bach-y-Rita, P., Tyler, M. E., & Kaczmarek, K. A. (2003). Seeing with the brain. International Journal of Human-Computer Interaction, 2, 285-295.
13. Bliss, J. C., Katcher, M. H., Rogers, C. H., & Shepard, R. P. (1970). Optical-to-tactile image conversion for the blind. IEEE Transaction on Man-Machine Systems, 11, 58-65.
14. Block, N. (2003). Tactile sensation via spatial perception. Trends in Cognitive Sciences, 7, 285-286.
15. Brand, P., & Yancey, P. (1993). Pain: The gift nobody wants. New York: Harper Collins.
16. Buchel, C. (1998). Functional neuroimaging studies of Braille reading: Cross-modal reorganization and its implications. Brain, 121, 1193-1194.
17. Buchel, C., Price, C., Frackowiak, R. S. J., & Friston, K. (1998). Different activation patterns in the visual cortex of late and congenitally blind subjects. Brain, 121, 409-419.
18. Capelle, C., Trullemans, C., Arno, P., & Veraart, C. (1998). A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution. IEEE Transaction on Biomedical Engineering, 45, 1279- 1293.
19. Casati, R., & Dokic, J. (1994). La philosophie du son (The philosophy of sound). Paris: Editions Jacqueline Chambon.
20. Churchland, P. M. (1988). Matter and consciousness (2nd ed.). Cambridge, MA: MIT Press.
21. Clark, A. (2003). Natural-born cyborgs: Minds, technologies, and the future of human intelligence. New York: Oxford University Press.
22. Cohen, L. G., Celnik, P., Pascual-Leone, A., Corwell, B., Faiz, L., Dambrosia, J., Honda, M., Sadato, N., Gerloff, C., Catala, M. D., & Hallett, M. (1997). Functional relevance of cross-modal plasticity in blind humans. Nature, 389, 180-183.
23. Cole, D. (1990). Functionalism and inverted spectra. Synthese, 82, 207-222.
24. Craig, J. C. (1981). Tactile letter recognition: Pattern duration and modes of pattern generation. Perception & Psychophysics, 30, 540-546.
25. Craig, J. C. (1983). Some factors affecting tactile pattern recognition. International Journal of Neuroscience, 19, 47-58.
26. Cronly-Dillon, J., Persaud, K., & Blore, F. (2000). Blind subjects construct conscious mental images of visual scenes encoded in musical form. Proceedings of Royal Society of London, B, 267, 2231-2238.
27. Cronly-Dillon, J., Persaud, K., & Gregory, R. P. F. (1999). The perception of visual images encoded in musical form: A study in cross modality information transfer. Proceedings of Royal Society of London, 266, 2427- 2433.
28. De Volder, A. G., Catalan Ahumada, M., Robert, A., Bol, A., Labar, D., Coppens, A., Michel, C., & Veraart, C. (1999). Changes in occipital cortex activity in early blind humans using a sensory substitution device. Brain Research, 826, 128-134.
29. Dennett, D. C. (1991). Consciousness explained. New York: Little, Brown and Company.
30. Ditchburn, R. W. (1973). Eye-movements and visual perception. Oxford, England: Clarendon Press.
31. Epstein, W. (1985). Amodal information and transmodal perception. In D. H. Warren & E. R. Strelow (Eds.), Electronic spatial sensing for the blind (pp. 421-430). Dordrecht, The Netherlands: Matinus Nijhoff.
32. Fletcher, P. (2002). Seeing with sound: A journey into sight. Proceedings of Towards a Science of Consciousness, 8 April 2002, Tucson, Arizona.
33. Gregory, R. L. (1966). Eye and brain: The psychology of seeing. London: Weidenfeld and Nicolson.
34. Gregory, R. L. (2003). Seeing after blindness. Nature Neuroscience, 6, 909-910.
35. Grice, H. P. (1962). Some remarks about the senses. In R. J. Butler (Ed.), Analytical Philosophy (First Series) (pp. 248-268). Oxford, England: Basil Blackwell.
36. Hanson, N. R. (1958). Patterns of discovery. Cambridge, England: Cambridge University Press.
37. Held, R., & Hein, A. (1963). Movement-produced stimulation in the development of visually guided behavior. Journal of Comparative and Physiological Psychology, 5, 872-876.
38. Heyes, A. D. (1984). Sonic Pathfinder: A programmable guidance aid for the blind. Electronics and Wireless World, 90, 26-29.
39. Hirsh, I. J. (1988). Auditory perception and speech. In R. C. Atkinson, R. J. Hernstein, G. Lindzey, & R. D. Luce (Eds.), Handbook of experimental psychology (pp. 377-408). New York: John Wiley.
40. Holmes, N. P., Calvert, G. A., & Spence, C. (2004). Extending or projecting peripersonal space with tools: Multisensory interactions highlight only the distal and proximal ends of tools. Neuroscience Letters, 372, 62-67.
41. Holmes, N. P., & Spence, C. (2006). Beyond the body schema: Visual, prosthetic, and technological contributions to bodily perception and awareness. In G. Knoblich, I. M. Thornton, M. Grosjean, & M. Shiffrar (Eds.), Human body perception from the inside out (pp. 15-64). Oxford, England: Oxford University Press.
42. Hughes, B. (2001). Active artificial echolocation and the nonvisual perception of aperture passability. Human Movement Science, 20, 371-400.
43. Humphrey, N. (1992). A history of the mind. New York: Simon & Schuster.
44. Hurley, S., & Noë, A. (2003). Neural plasticity and consciousness. Biology and Philosophy, 18, 131-168.
45. Hutto, D. (2005). Knowing what? Radical versus conservative enactivism. Phenomenology and the Cognitive Sciences, 4, 389-405.
46. Jansson, G. (1983). Tactile guidance of movement. International Journal of Neuroscience, 19, 37-46.
47. Kaczmarek, K. A., & Haase, S. J. (2003). Pattern identification and perceived stimulus quality as a function of stimulation current on a fingertip-scanned electrotactile display. IEEE Transaction on Neural System Rehabilitation Engineering, 11, 9-16.
48. Kay, L. (1964). An ultrasonic sensing probe as a mobility aid for the Blind. Ultrasonics, 2, 53.
49. Kay, L. (1985). Sensory aids to spatial perception for blind persons: Their design and evaluation. In D. Warren & E. Strelow (Eds.), Electronic spatial sensing for the blind (pp. 125-139). Dordrecht, The Netherlands: Martinus Nijhoff.
50. Keeley, B. (2002). Making sense of the senses: Individuating modalities in humans and other animals. The Journal of Philosophy, 99, 5-28.
51. Kupers, R., Fumal, A., Maertens de Noordhout, A., Gjedde, A., Schoenen, J., & Ptito, M. (2006). Transcranial magnetic stimulation of the visual cortex induces somatotopically organized qualia in blind subjects. PNAS, 35, 13256-13260.
52. van Leeuwen, C., Verstijnen, I. M., & Hekkert, P. (1999). Common unconscious dynamics underly uncommon conscious effect: A case study in the iterative nature of perception and creation. In J. S. Jordan (Ed.), Modeling consciousness across the disciplines (pp. 179-218). Lanham, MD: University Press of America.
53. Lemaire, L. (1999). Approche comportementale de la question de Molyneux (Behavioural approaches to Molyneux' question). Unpublished Thesis. Strasbourg, France: Université Louis Pasteur.
54. Lenay, C. (2002). Ignorance et suppléance: la question de l'espace (Ignorance and augmentation: The question of space). Unpublished Thesis. Compiègne, France: U.T.C.
55. Lenay, C., Gapenne, O., Hanneton, S., Marque, C., & Genouëlle, C. (2003). Sensory substitution: Limits and perspectives. In Y. Hatwell, A. Streri, & E. Gentaz (Eds.), Touching for knowing (pp. 275-292). Amsterdam: John Benjamins.
56. Loomis, J. M. (1974). Tactile letter recognition under different modes of stimulus presentation. Perception & Psychophysics, 16, 401-408.
57. Loomis, J. M. (1981). Tactile pattern perception. Perception, 10, 5-27.
58. Maravita, A., Spence, C., Kennett, S., & Driver, J. (2002). Tool-use changes multimodal spatial interactions between vision and touch in normal humans. Cognition, 83, 25-34.
59. Meijer, P. B. L. (1992). An experimental system for auditory image representations. IEEE Transactions on Biomedical Engineering, 39, 112-121.
60. Menary, R. (2006). Attacking the bounds of cognition. Philosophical Psychology, 19, 329-344.
61. Menary, R. (2007). Cognitive integration. Mind and cognition unbounded. Basingstoke: Palgrave.
62. Morgan, M. J. (1977). Molyneux's question. Vision, touch and the philosophy of perception. Cambridge, England: Cambridge University Press.
63. Myin, E., & O'Regan, J. K. (2009). Situated perception and sensation in vision and other modalities: A sensorimotor approach. In M. Aydede & P. Robbins (Eds.), The Cambridge handbook of situated cognition (pp. 185-200). Cambridge, England: Cambridge University Press.
64. Nagel, T. (1974). What is it like to be a bat? Philosophical Review, 83, 435-450.
65. Noë, A. (2004). Action in perception. Cambridge, MA: MIT Press.
66. O'Regan, J. K., Myin, E., & Noë, A. (2005). Skill, corporality and alerting capacity in an account of sensory consciousness. Progress in Brain Research, 150, 55-68.
67. O'Regan, J. K., & Noë, A. (2001). A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences, 24, 939-973.
68. Pacherie, E. (1997). Du problème de Molyneux au problème de Bach-y-Rita (From Molyneux's problem to Bach-y-Rita's problem). In J. Proust (Ed.), Perception et intermodalitè, approches actuelles du problème de molyneux (pp. 255-293). Paris: PUF.
69. Pollok, B., Schnitzler, I., Mierdorf, T., Stoerig, P., & Schnitzler, A. (2005). Image-to-sound conversion: Experience-induced plasticity in auditory cortex of blindfolded adults. Experimental Brain Research, 167, 287-291.
70. Prinz, J. (2006). Putting the brakes on enactive perception. Psyche, 12, 1-19.
71. Ptito, M., Fumal, A., de Noordhout, A. M., Schoenen, J., Gjedde, A., & Kupers, R. (2008). TMS of the occipital cortex induces tactile sensations in the fingers of blind Braille readers. Experimental Brain Research, 184, 193-200.
72. Ptito, M., & Kupers, R. (2005). Cross-modal plasticity in early blindness. Journal of Integrative Neuroscience, 4, 479-488.
73. Ptito, M., Moesgaard, S. M., Gjedde, A., & Kupers, R. (2005). Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind. Brain, 128, 606-614.
74. Putnam, H. (1960). Minds and machines. In S. Hook (Ed.), Dimensions of mind (pp. 138-164). New York: New York University Press.
75. Renier, L., Collignon, O., Poirier, C., Tranduy, D., Vanlierde, A., Bol, A., Veraart, C., & De Volder, A. G. (2005a). Cross-modal activation of visual cortex during depth perception using auditory substitution of vision. NeuroImage, 26, 573-580.
76. Renier, L., Laloyaux, C., Collignon, O., Tranduy, D., Vanlierde, A., Bruyer, R., & De Volder, A. G. (2005b). The Ponzo illusion using auditory substitution of vision in sighted and early blind subjects. Perception, 34, 857-867.
77. Roxbee-Cox, J. W. (1970). Distinguishing the senses. Mind, 79, 530-550.
78. Sadato, N., Pascual-Leone, A., Grafman, J., Deiber, M. P., Ibanez, V., & Hallett, M. (1998). Neural networks for Braille reading by the blind. Brain, 121, 1213-1229.
79. Sadato, N., Pascual-Leone, A., Grafman, J., Ibanez, V., Deiber, M. P., Dold, G., & Hallett, M. (1996). Activation of the primary visual cortex by Braille reading in blind subjects. Nature, 380, 526-528.
80. Sampaio, E., Maris, S., & Bach-y-Rita, P. (2001). Brain plasticity: 'Visual' acuity of blind persons via the tongue. Brain Research, 908, 204-207.
81. Steinman, R. M., & Levinson, J. Z. (1990). The role of eye movement in the detection of contrast and detail. In E. Kowler (Ed.), Eye movement and their role in visual and cognitive processes (pp. 115-212). Amsterdam: Elsevier Science.
82. Tyler, M., Danilov, Y., & Bach-y-Rita, P. (2003). Closing an open-loop control system: Vestibular substitution through the tongue. Journal of Integrative Neuroscience, 2, 159-164.
83. Vega-Bermudez, F., Johnson, K. O., & Hsiao, S. S. (1991). Human tactile pattern recognition: Active versus passive touch, velocity effects, and patterns of confusion. Journal of Neurophysiology, 65, 531-546.
84. White, B. W., Saunders, F. A., Scadden, L., Bach-y-Rita, P., & Collins, C. C. (1970). Seeing with the skin. Perception & Psychophysic, 7, 23-27.