How well do you see what you hear? The acuity of visual-to-auditory sensory substitution

Frontiers in Psychology

Volumn 4, Issue , 2013, Pages

  Haigh, Alastair ^a   Brown, David ^a   Meijer, Peter ^b   Proulx, Michael J ^c  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b Metamodal BV   (Netherlands)

^c University of Bath   (United Kingdom)

Author keywords

Acuity; Auditory; Blindness; Sensory substitution; Synthetic synesthesia; Visual

Indexed keywords

EID: 84995477320     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00330     Document Type: Editorial

References (44)

1. Arno, P., Vanlierde, A., Wanet Defalque, M. C., Catalan Ahumada, M., and Veraat, C. (2001). Auditory coding of visual patterns for the blind. Perception 28, 1013-1029. doi:10.1068/p2607
2. Auvray, M., Hanneton, S., Lenay, C., and O'Regan, J. K. (2005). There is something out there: distal attribution in sensory substitution, twenty years later. J. Integr. Neurosci. 4, 505-521. doi:10.1142/S0219635205001002
3. Auvray, M., Hanneton, S., and O'Regan, J. K. (2007). Learning to perceive with a visuo-auditory substitution system: localisation and object recognition with 'The vOICe'. Perception 36, 416-430. doi:10.1068/p5631
4. Bach, M. (1996). The Freiburg visual acuity test-automatic measurement of visual acuity. Optom. Vis. Sci. 73, 49-53. doi:10.1097/00006324-199601000-00008
5. Bach-y-Rita, P., Collins, C. C., Saun-ders, F. A., White, B., and Scadden, L. (1969). Vision substitution by tactile image projection. Nature221, 963-964. doi:10.1038/221963a0
6. Bach-y-Rita, P.,andKercel, S.W. (2003). Sensory substitution and the human-machine interface. Trends Cogn. Sci.(Regul. Ed.)7, 541-546. doi:10.1016/j.tics.2003.10.013
7. Brainard, D. H. (1997). The psychophysics toolbox. Spat. Vis. 10, 433-436. doi:10.1163/156856897X00357
8. Brown, D., Macpherson, T., and Ward, J. (2011). Seeing with sound? Exploring different characteristics of a visual-to-auditory sensory substitution device. Perception 40, 1120-1135. doi:10.1068/p6952
9. Capelle, C., Trullemans, C., Arno, P., and Veraart, C. (1998). A realtime experimental prototype for enhancement of vision rehabilitation using auditory substitution. IEEE Trans. Biomed. Eng. 45, 1279-1293. doi:10.1109/10.720206
10. Chebat, D.-R., Rainville, C., Kupers, R., and Ptito, M. (2007). 'Tactile-visual' acuity of the tongue in early blind individuals. Neuroreport18, 1901-1904. doi:10.1097/WNR. 0b013e3282f2a63
11. Cronly-Dillon, J., Persaud, K., and Blore, F. (2000). Blind subjects construct conscious mental images of visual scenes encoded in musical form. Proc. Biol. Sci. 267, 2231-2238. doi:10.1098/rspb.2000.1273
12. Cronly-Dillon, J., Persaud, K., and Gregory, R. P. F. (1999). The perception of visual images encoded in musical form: a study in cross modality information transfer. Proc. Biol. Sci. 266, 2427-2433. doi:10.1098/rspb.1999.0942
13. Cui, X., Jeter, C. B., Yang, D., Read Montague, P., and Eagleman, D. M. (2007). Vividness of mental imagery: individual variability can be measured objectively. Vision Res.47, 474-478. doi:10.1016/j.visres.2006.11.013
14. Duke-Elder, W. S. and Abrams, D. (1970). "Ophthalmic optics and refraction," in System of Ophthalmology, Vol. V, edW. S. Duke-Elder (London: Henry Kimpton).
15. Evans, K. K., and Treisman, A. (2010). Natural cross-modal mappings between visual and auditory features. J. Vis.10, 1-12.
16. Hanneton, S., Auvray, M., and Durette, B. (2010). The Vibe: a versatile vision-to-audition sensory substitution device. Appl. Bionics Biomech. 7, 269-276. doi:10.1080/11762322.2010.512734
17. He, S., Cavanagh, P.,andIntriligator, J. (1996). Attentional resolution and the locus of visual awareness. Nature 383, 334-337. doi:10.1038/383334a0
18. He, S., Cavanagh, P.,andIntriligator, J. (1997). Attentional resolution. TrendsCogn. Sci.(Regul. Ed.)1, 115-121. doi:10.1016/S1364-6613(97)89058-4
19. Hubbard, E.M., Brang, D.,and Ramachandran, V. S. (2011). The cross-activation theory at 10. J. Neuropsychol. 5 152-177. doi:10.1111/j.1748-6653.2011.02014.x
20. Intriligator, J., and Cavanagh, P. (2001). The spatial resolution of visual attention. Cogn. Psychol. 43, 171-216. doi:10.1006/cogp.2001.0755
21. Jacobson, H. (1950). The informational capacity of the human ear. Science 112, 143-144. doi:10.1126/science.112.2901.143
22. Jacobson, H. (1951). The informational capacity of the human eye. Science 113, 292-293. doi:10.1126/science.113.2933.292
23. Koelsch, S., Schröger, E.,andTervaniemi, M. (1999). Superior pre-attentive auditory processing in musicians. Neuroreport 10, 1309-1313. doi:10.1097/00001756-199904260-00029
24. Kokjer, K. J. (1987). The information capacity of the human fingertip. IEEE Trans. Syst. Man Cybern. 17, 100-102. doi:10.1109/TSMC.1987.289337
25. Marks, D. F. (1973). Visual imagery differences in the recall of pictures. Br. J. Psychol. 64, 17-24. doi:10.1111/j.2044-8295. 1973.tb01322.x
26. Meijer, P. B. L. (1992). An experimental system for auditory image representations. IEEE Trans. Biomed. Eng. 39, 112-121. doi:10.1109/10.121642
27. Merabet, L. B., Battelli, L., Obretenova, S., Maguire, S., Meijer, P., and Pascual-Leone, A. (2009). Functional recruitment of visual cortex for sound encoded object identification in the blind. Neuroreport 20, 132-138. doi:10.1097/WNR.0b013e32832104dc
28. Merabet, L. B., and Pascual-Leone, A. (2010). Neuronal reorganization following sensory loss: the opportunity of change. Nat. Rev. Neurosci. 11, 44-52. doi:10.1038/nrn2758
29. Merabet, L.B., Rizzo, J.F., Amedi, A., Somers, D. C., and Pascual-Leone, A. (2005). What blindness can tell us about seeing again: merging neuroplasticity and neuroprostheses. Nat. Rev. Neurosci.6, 71-77. doi:10.1038/nrn1586
30. Moore, C. M., Lanagan-Leitzel, L. K., and Fine, E. M. (2008). Distinguishing between the precision of attentional localization and attentional resolution. Percept. Psychophys. 70, 573-582. doi:10.3758/PP.70.4.573
31. Morgan, M. J. (1977).Molyneux's Question: Vision, Touch and the Philosophy of Perception. Cambridge: Cambridge University Press.
32. Parbery-Clark, A., Skoe, E., Lam, C., and Kraus, N. (2009). Musician enhancement for speech-in-noise. Ear Hear.30, 653-661. doi:10.1097/AUD.0b013e3181b412e9
33. Pascual-Leone, A., and Hamilton, R. (2001). The metamodal organization of the brain. Prog. Brain Res.134, 1-19. doi:10.1016/S0079-6123(01)34028-1
34. Pasqualotto, A., and Proulx, M. J. (2012). The role of visual experience for the neural basis of spatial cognition. Neurosci. Biobehav. Rev. 36, 1179-1187. doi:10.1016/j.neubiorev.2012.01.008
35. Pasqualotto, A., Spiller, M. J., Jansari, A. S., and Proulx, M. J. (2013). Visual experience facilitates allocentric spatial representation. Behav. Brain Res. 236, 175-179. doi:10.1016/j.bbr.2012.08.042
36. Pelli, D. G. (1997). The Video Toolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 10, 437-442. doi:10.1163/156856897X00366
37. Proulx, M. J. (2010). Synthetic synaesthesia and sensory substitution. Conscious. Cogn. 19, 501-503. doi:10.1016/j.concog.2009.12.005
38. Proulx, M.J., Brown, D., Pasqualotto, A., and Meijer, P. (2013). Multisensory perceptual learning and sensory substitution. Neurosci. Biobehav. Rev. doi: 10.1016/j.neubiorev.2012.11.017. [Epub ahead of print].
39. Proulx, M. J., and Stoerig, P. (2006). Seeing sounds and tingling tongues: Qualia in synaesthesia and sensory substitution. Anthropol. Philos. 7, 135-151.
40. Proulx, M. J., Stoerig, P., Ludowig, E., and Knoll, I. (2008). Seeing "where" through the ears: effects of learning-by-doing and long-term sensory deprivation on localization based on image-to-sound substitution. PLoS ONE 3:e1840. doi:10.1371/journal.pone.0001840
41. Sampaio, E., Maris, S., and Bachy-Rita, P. (2001). Brain plasticity: 'visual' acuity of blind persons via the tongue. Brain Res. 908, 204-207. doi:10.1016/S0006-8993(01)02667-1
42. Striem-Amit, E., Guendelman, M., and Amedi, A. (2012). 'Visual' acuity of the congenitally blind using visual-to-auditory sensory substitution. PLoS ONE7:e33136. doi:10.1371/journal.pone.0033136
43. Social Security Act. United States Social Security Administration. (2006). Code of Federal Regulations, Title 20, Ch. III, Pt. 404, Subpt. P, App. 1. List of Impairments. U.S. DHHS (SSA). Washington, DC.
44. Ward, J., and Meijer, P. (2010). Visual experiences in the blind induced by an auditory sensory substitution device. Conscious. Cogn. 19, 492-500. doi:10.1016/j.concog.2009.10.006