Learning to perceive with a visuo-auditory substitution system: Localisation and object recognition with 'The vOICe'

Perception

Volumn 36, Issue 3, 2007, Pages 416-430

  Auvray, Malika ^a,b   Hanneton, Sylvain ^c   O'Regan, J Kevin ^d  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITÉ DE TECHNOLOGIE DE COMPIÈGNE   (France)

^c UNIVERSITÉ PARIS DESCARTES   (France)

^d UNIVERSITÉ PARIS DESCARTES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34247501606     PISSN: 03010066     EISSN: None     Source Type: Journal    
DOI: 10.1068/p5631     Document Type: Article

References (41)

1. Arno P, Capelle C, Wanet-Defalque M C, Catalan-Ahumada M, Veraart C, 1999 "Auditory coding of visual patterns for the blind" Perception 28 1013-1029
2. Arno P, Vanlierde A, Streel E, Wanet-Defalque M C, Sanabria-Bohorquez S, Veraart C, 2001 "Auditory substitution of vision: Pattern recognition by the blind" Applied Cognitive Psychology 15 509-519
3. Bach-y-Rita P, 1972 Brain Mechanisms in Sensory Substitution (New York: Academic Press)
4. Bach-y-Rita P, Collins C C, Saunders F A, White B, Scadden L, 1969 "Vision substitution by tactile image projection" Nature 221 963-964
5. Bliss J C, Katcher M H, Rogers C H, Shepard R P, 1970 "Optical-to-tactile image conversion for the blind" IEEE Transactions on Man-Machine Systems 11 58-65
6. Capelle C, Trullemans C, Arno P, Veraart C, 1998 "A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution" IEEE Transactions on Biomedical Engineering 45 1279-1293
7. Craig J C, 1976 "Vibrotactile letter recognition: The effects of a masking stimulus" Perception & Psychophysics 20 317-326
8. Craig J C, 1980 "Modes of vibrotactile pattern generation" Journal of Experimental Psychology: Human Perception and Performance 6 151-166
9. Craig J C, 1981 "Tactile letter recognition: Pattern duration and modes of pattern generation" Perception & Psychophysics 30 540-546
10. Craig J C, 1983 "Some factors affecting tactile pattern recognition" International Journal of Neuroscience 19 47-58
11. Cronly-Dillon J, Persaud K, Blore F, 2000 "Blind subjects construct conscious mental images of visual scenes encoded in musical form" Proceedings of the Royal Society of London, Series B 267 2231-2238
12. Cronly-Dillon J, Persaud K, Gregory R P F, 1999 "The perception of visual images encoded in musical form: a study in cross modality information transfer" Proceedings of the Royal Society of London, Series B 266 2427-2433
13. Epstein W, 1985 "Amodal information and transmodal perception", in Electronic Spatial Sensing for the Blind Eds D Warren, E Strelow (Dordrecht: Martinus Nijhoff) pp 421-430
14. Evans K K, Treisman A, 2005 "Crossmodal binding of audio-visual correspondent features" Journal of Vision 5 874 [abstract]
15. Heller M A, 2000 Touch, Representation and Blindness Debates in Psychology Series (Oxford: Oxford University Press)
16. Heyes A D, 1984 "Sonic Pathfinder: A programmable guidance aid for the blind" Electronics and Wireless World 90 26 -29
17. Hirsh I J, 1988 "Auditory perception and speech", in Handbook of Experimental Psychology Eds R C Atkinson, R J Hernstein, G Lindzey, R D Luce (New York: John Wiley) pp 377-408
18. Hughes B, 2001 "Active artificial echolocation and the nonvisual perception of aperture passability" Human Movement Science 20 371-400
19. Jansson G, 1983 "Tactile guidance of movement" International Journal of Neuroscience 19 37-46
20. Jeannerod M, 1994 "The representing brain: Neural correlates of motor intention and imagery" Behavioral and Brain Sciences 17 187-245
21. Kaczmarek K A, Haase S J, 2003 "Pattern identification and perceived stimulus quality as a function of stimulation current on a fingertip-scanned electrotactile display" IEEE Transactions on Neural System Rehabilitation Engineering 119-16
22. Kay L, 1964 "An ultrasonic sensing probe as a mobility aid for the blind" Ultrasonics 2 53
23. Kay L, 1980 "Air sonars with acoustical display of spatial information", in Animal Sonar Systems Eds R G Busnel, J F Fish (New York: Plenum Press) pp 769-816
24. Kay L, 1985 "Sensory aids to spatial perception for blind persons: Their design and evaluation", in Electronic Spatial Sensing for the Blind Eds D Warren, E Strelow (Dordrecht: Martinus Nijhoff) pp 125-139
25. Lemaire L, 1999 Approche Comportementale de la Question de Molyneux (A Behavioural Approach to Molyneux' Question) PhD thesis, Université Louis Pasteur, Strasbourg, France
26. Lenay C, 2002 Ignorance et Suppléance la Question de l'Espace (Ignorance and Augmentation: The Question of Space) Unpublished Thesis, U.T.C., Compiègne, France
27. Lenay C, Gapenne O, Hanneton S, Marque C, Genouëlle C, 2003 "Sensory substitution: Limits and perspectives", in Touching for Knowing Eds Y Hatwell, A Streri, E Gentaz (Amsterdam: John Benjamins) pp 275-292
28. Loomis J M, 1974 "Tactile letter recognition under different modes of stimulus presentation" Perception & Psychophysics 16 401-408
29. Loomis J M, 1980 "Interaction of display mode and character size in vibrotactile letter recognition" Bulletin of the Psychonomic Society 16 385-387
30. Loomis J M, 1981 "Tactile pattern perception" Perception 10 5-27
31. Meijer P B L, 1992 "An experimental system for auditory image representations" IEEE Transactions on Biomedical Engineering 39 112-121
32. Melara R D, O'Brien T P, 1987 "Interaction between synesthetically corresponding dimensions" Journal of Experimental Psychology: General 116 323-336
33. Noë A, 2005 Action in Perception (Cambridge, MA: MIT Press)
34. O'Regan J K, Noë A, 2001 "A sensorimotor account of vision and visual consciousness" Behavioral and Brain Sciences 24 939-973
35. Pollok B, Schnitzler I, Mierdorf T, Stoerig P, Schnitzler A, 2005 "Image-to-sound conversion: Experience-induced plasticity in auditory cortex of blindfolded adults" Experimental Brain Research 167 287-291
36. Pratt C C, 1930 "The spatial character of high and low tones" Journal of Experimental Psychology 13 278-285
37. Renier L, Collignon O, Poirier C, Tranduy D, Vanlierde A, Bol A, Veraart C, De Volder A G, 2005a "Cross-modal activation of visual cortex during depth perception using auditory substitution of vision" NeuroImage 26 573-580
38. Renier L, Laloyaux C, Collignon O, Tranduy D, Vanlierde A, Bruyer R, De Volder A G, 2005b "The Ponzo illusion with auditory substitution of vision in sighted and early-blind subjects" Perception 34 857-867
39. Sampaio E, Maris S, Bach-y-Rita P, 2001 "Brain plasticity: 'Visual' acuity of blind persons via the tongue" Brain Research 908 204-207
40. Segond H, Weiss D, Sampaio E, 2005 "Human spatial navigation via a visuo-tactile sensory substitution system" Perception 34 1231-1249
41. Ungerleider L G, Mishkin M, 1992 "Two cortical visual systems", in Analysis of Visual Behavior Eds D J Ingle, M A Goodale, R J W Mansfield (Cambridge, MA: MIT Press) pp 549-586