Simulating auditory and visual sensorineural prostheses: A comparative review

Journal of Neural Engineering

Volumn 4, Issue 1, 2007, Pages

  Hallum, L E ^a   Dagnelie, G ^b   Suaning, G J ^a,c   Lovell, N H ^a,d  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b JOHNS HOPKINS UNIVERSITY   (United States)

^c UNIVERSITY OF NEWCASTLE   (Australia)

^d CSIRO   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; ELECTRODES; SPEECH PROCESSING; VISION;

BLIND SUBJECT; LUMINOUS SPOTS; MICROELECTRONIC VISION; SIMULATION DATA;

PROSTHETICS;

ACOUSTICS; COCHLEA; COCHLEA PROSTHESIS; ELECTRODE; ELECTROSTIMULATION; HEARING; HEARING AID; HUMAN; IMPLANT; NEUROPHYSIOLOGY; PRIORITY JOURNAL; RETINA PROSTHESIS; REVIEW; SPEECH; VISION; VISUAL PROSTHESIS;

ANIMALS; AUDITORY PERCEPTION; COCHLEAR IMPLANTS; COMPUTER SIMULATION; EQUIPMENT FAILURE ANALYSIS; HEARING LOSS, SENSORINEURAL; HUMANS; MODELS, BIOLOGICAL; PROSTHESES AND IMPLANTS; PROSTHESIS DESIGN; VISION DISORDERS; VISUAL PERCEPTION;

EID: 33847656278     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/4/1/S08     Document Type: Review

References (88)

1. Wardrop P, Whinney D, Rebscher S J, Roland J T Jr, Luxford W and Leake P A 2005 A temporal bone study of insertion trauma and intracochlear position of cochlear implant electrodes: I. Comparison of nucleus banded and nucleus contour electrodes Hear. Res. 203 54-67
2. Rubinstein J T and Miller C A 1999 How do cochlear prostheses work? Curr. Opin. Neurobiol. 9 399-404
3. Gregory R L 1974 Concepts and Mechanisms of Perception (London: Duckworth)
4. Dallos P 1992 The active cochlea J. Neurosci. 12 4575-85
5. Nobili R, Mammano F and Ashmore J 1998 How well do we understand the cochlea? Trends Neurosci. 21 159-67
6. von Helmholtz H 1885 On the Sensations of Tone ed A J Ellis (New York: Dover) (Engl. Transl.)
7. Cohen N L 2004 Cochlear implant candidacy and surgical considerations Audiol. Neuro-Otol. 9 197-202
8. Gstoettner W K, Adunka O, Franz P, Hamzavi J, Plenk H Jr, Susani M, Baumgartner W and Kiefer J 2001 Perimodiolar electrodes in cochlear implant surgery Acta Otolaryngol. 121 216-9
9. Skinner M W, Holden L K, Whitford L A, Plant K L, Psarros C and Holden T A 2002 Speech recognition with the Nucleus 24 SPEAK, ACE, and CIS speech processing strategies in newly implanted adults Ear Hear. 23 207-23
10. Durand D M 1995 Electrical stimulation of excitable tissue The Biomedical Engineering Handbook ed J D Bronzino (New York: CRC Press) pp 229-51
11. Seligman P M and McDermott H J 1995 Architecture of the Spectra 22 speech processor Ann. Otol. Rhinol. Laryngol. 104 172-5
12. Wilson B S, Finley C F, Lawson D T, Wolford R D, Eddington D K and Rabinowitz W M 1991 Better speech recognition with cochlear implants Nature 352 236-8
13. Vandali A E, Whitford L A, Plant K L and Clark G M 2000 Speech perception as a function of electrical stimulation rate: using the new Nucleus 24 cochlear implant system Ear Hear. 21 608-24
14. Wilson B S 2004 Engineering design of cochlear implants Cochlear Implants ed F-G Zeng, A N Popper and R Fay (New York: Springer) pp 14-52
15. Rubinstein J T and Hong R 2003 Signal coding in cochlear implants: exploiting stochastic effects of electrical stimulation Ann. Otol. Rhinol. Laryngol. 112 14-9
16. Friesen L M, Shannon R V and Cruz R J 2005 Effects of stimulation rate on speech recognition with cochlear implants Audiol. Neuro-Otol. 10 169-84
17. Eddington D K 1983 Speech recognition in deaf subjects with multichannel intracochlear electrodes Ann. New York Acad. Sci. 405 241-58
18. Throckmorton C S and Collins L M 2002 The effect of channel interactions on speech recognition in cochlear implant subjects: predictions from an acoustic model J. Acoust. Soc. Am. 112 285-96
19. Coleman A M 2006 A Dictionary of Psychology (Oxford: Oxford University Press)
20. Blamey P J, Martin L F A and Clark G M 1984 A comparison of three speech coding strategies using an acoustic model of a cochlear implant J. Acoust. Soc. Am. 77 209-17
21. Shannon R V, Zeng F-G, Kamath V, Wygonski J and Ekelid M 1995 Speech recognition with primarily temporal cues Science 270 303-4
22. Ladefoged P 2006 A Course in Phonetics http://hctv.humnet.ucla.edu/ departments/linguistics/VowelsandConsonants/course/contents.html (page accessed 1 Jan 2006)
23. Miller G A and Nicely P E 1955 An analysis of perceptual confusions among some english consonants J. Acoust. Soc. Am. 27 338-52
24. Wiener N 1948 Cybernetics (New York: Wiley)
25. Dorman M F, Loizou P C and Rainey D 1997 Speech intelligibility as a function of the number of channels of stimulation for signal processors using sine-wave and noise-band outputs J. Acoust. Soc. Am. 102 2403-11
26. Gonzalez J and Oliver J C 2005 Gender and speaker identification as a function of the number of channels in spectrally reduced speech J. Acoust. Soc. Am. 118 461-70
27. Humayun M S et al 2003 Visual perception in a blind subject with a chronic microelectronic retinal prosthesis Vision Res. 43 2573-81
28. Zrenner E, Besch D, Bartz-Schmidt K U, Gekeler F, Gabel V P, Kuttenkeuler C, Sachs H, Sailer H, Wilhelm B and Wilke R 2006 Subretinal chronic multi-electrode arrays implanted in blind patients Invest. Ophthalmol. Vis. Sci. 47 1538 (ARVO e-abstract)
29. Hornig R, Velikay-Parel M, Feucht M, Zehnder T and Richard G 2006 Early clinical experience with a chronic retinal implant system for artificial vision Invest. Ophthalmol. Vis. Sci. 47 3216 (ARVO e-abstract)
30. Dorman M F and Loizou P C 1998 The identification of consonants and vowels by cochlear implant patients using a 6-channel continuous interleaved sampling processor and by normal-hearing subjects using simulations of processors with two to nine channels Ear Hear. 19 162-6
31. Dorman M F, Loizou P C and Fitzke J 1998 The identification of speech in noise by cochlear implant patients and normal-hearing listeners using six-channel signal processors Ear Hear. 19 481-4
32. Friesen L M, Shannon R V, Baskent D and Wang X 2001 Speech recognition in noise as a function of the number of spectral channels: comparison of acoustic hearing and cochlear implants J. Acoust. Soc. Am. 110 1150-63
33. Fishman K E, Shannon R V and Slattery W H 1997 Speech recognition as a function of the number of electrodes used in the speak cochlear implant speech processor J. Speech Language Hear. Res. 40 1201-15
34. Merritt C D and Justus B L 2003 Fabrication of microelectrode arrays having high-aspect-ratio microwires Chem. Mater. 15 2520-6
35. Hallum L E, Chen S C, Cloherty S L and Lovell N H 2006 Psychophysics of prosthetic vision: II. Stochastic sampling, the phosphene image, and noise Proc. 28th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society (EMBS)
36. Dorman M F, Loizou P C and Rainey D 1997 Simulating the effect of cochlear-implant electrode insertion depth on speech understanding J. Acoust. Soc. Am. 102 2993-6
37. Greenwood D D 1990 A cochlear frequency-position function for several species-29 years later J. Acoust. Soc. Am. 87 2592-605
38. Baskent D and Shannon R V 2003 Speech recognition under conditions of frequency-place compression and expansion J. Acoust. Soc. Am. 113 2064-76
39. Xu L, Thompson C S and Pfingst B E 2005 Relative contribution of spectral and temporal cues for phoneme recognition J. Acoust. Soc. Am. 117 3255-67
40. Fu Q-J and Nogaki G 2004 Noise susceptibility of cochlear implant users: the role of spectral resolution and smearing J. Assoc. Res. Otolaryngol. 6 19-27
41. Loizou P C, Dorman M, Poroy O and Spahr T 2000 Speech recognition by normal-hearing and cochlear implant listeners as a function of intensity resolution J. Acoust. Soc. Am. 108 2377-87
42. Drullman R 1995 Temporal envelope and fine structure cues for speech intelligibility J. Acoust. Soc. Am. 97 585-92
43. Weiland J D, Liu W T and Humayun M S 2005 Retinal prosthesis Annu. Rev. Biomed. Eng. 7 361-401
44. Zrenner E 2002 Will retinal implants restore vision? Science 295 1022-5
45. Suaning G J, Hallum L E, Chen S C, Preston P J and Lovell N H 2003 Phosphene vision: development of a portable visual prosthesis system for the blind Proc. 25th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society (EMBS) pp 2047-50
46. Chow A Y, Pardue M T, Perlman J I, Ball S L, Chow V Y, Hetling J R, Peyman G A, Liang C P, Stubbs E B and Peachey N S 2002 Subretinal implantation of semiconductor-based photodiodes: durability of novel implant designs J. Rehabil. Res. Dev. 39 313-21
47. Humayun M S, de Juan E Jr, Dagnelie G, Greenberg R J, Propst R H and Phillips D H 1996 Visual perception elicited by electrical stimulation of the retina in blind humans Arch. Ophthalmol. 114 40-6
48. Weiland J D, Humayun M S, Dagnelie G, de Juan E, Greenberg R J and Iliff N T 1999 Understanding the origin of visual percepts elicited by electrical stimulation of the human retina Graef's Arch. Clin. Exp. Ophthalmol. 237 1007-13
49. Rizzo J F III, Wyatt J, Loewenstein J, Kelly S and Shire D 2003 Perceptual efficacy of electrical stimulation of human retina with a microelectrode array during short-term surgical trials Invest. Ophthalmol. Vis. Sci. 44 5362-9
50. Richard G, Feucht M, Bornfeld N, Laube T, Rossler G, Velikay-Parel M and Hornig R 2005 Multicenter study on acute electrical stimulation of the human retina with an epiretinal implant: clinical results in 20 patients Invest. Ophthalmol. Vis. Sci. 46 (Suppl. S) 1143
51. Cha K, Horch K W, Normann R A and Boman D K 1992 Reading speed with a pixelized vision system J. Opt. Soc. Am. A 9 673-7
52. Cha K, Horch K W and Normann R A 1992 Simulation of a phosphene-based visual field: visual acuity in a pixelized vision system Ann. Biomed. Eng. 20 439-49
53. Cha K, Horch K W and Normann R A 1992 Mobility performance with a pixelized vision system Vision Res. 32 1367-72
54. Humayun M S 2001 Intraocular retinal prosthesis Trans. Am. Ophthalmol. Soc. 99 271-300
55. Sommerhalder J, Oueghlani E, Bagnoud M, Leonards U, Safran A B and Pelizzone M 2003 Simulation of artificial vision: I. Eccentric reading of isolated words, and perceptual learning Vision Res. 43 269-83
56. Sommerhalder J, Rappaz B, de Haller R, Pérez Fornos A, Safran A B and Pelizzone M 2004 Simulation of artificial vision: II. Eccentric reading of full-page text and the learning of this task Vision Res. 44 1693-706
57. Pérez Fornos A, Sommerhalder J, Rappaz B, Safran A B and Pelizzone M 2005 Simulation of artificial vision: III. Do the spatial or temporal characteristics of stimulus pixelization really matter? Invest. Ophthalmol. Vis. Sci. 46 3906-12
58. Thompson R W Jr, Barnett G D, Humayun M S and Dagnelie G 2003 Facial recognition using simulated prosthetic pixelized vision Invest. Ophthalmol. Vis. Sci. 44 5035-42
59. Hayes J S, Yin V T, Piyathaisere D, Weiland J D, Humayun M S and Dagnelie G 2003 Visually guided performance of simple tasks using simulated prosthetic vision Artif. Organs 27 1016-28
60. Chen S C, Hallum L E, Lovell N H and Suaning G J 2005 Visual acuity measurement of prosthetic vision: a virtual-reality simulation study J. Neural Eng. 2 S135-45
61. Chen S C, Hallum L E, Lovell N H and Suaning G J 2005 Learning prosthetic vision: a virtual-reality study IEEE Trans. Neural Syst. Rehabil. Eng. 13 249-55
62. Hallum L E, Suaning G J, Taubman D S and Lovell N H 2005 Simulated prosthetic visual fixation, saccade, and smooth pursuit Vision Res. 45 775-88
63. Dagnelie G, Barnett D, Humayun M S and Thompson R W 2006 Paragraph text reading using a pixelized prosthetic vision simulator: parameter dependence and task learning in free-viewing conditions Invest. Ophthalmol. Vis. Sci. 47 1241-50
64. Dagnelie G 2006 Playing checkers: detection and eye-hand coordination in simulated prosthetic vision J. Mod. Opt. 53 1325-42
65. Cottaris N P and Elfar S D 2005 How the retinal network reacts to epiretinal stimulation to form the prosthetic visual input to the cortex J. Neural Eng. 2 S74-90
66. Hancock P Psychological Image Collection at Stirling http://pics.psych. stir.ac.uk (pages accessed 1 July 2003)
67. Hallum L E, Chen S C, Preston P J, Suaning G J and Lovell N H 2005 Simulating prosthetic vision Invest. Ophthalmol. Vis. Sci. 46 1522 (ARVO e-abstract)
68. Boyle J R 2005 Improving perception from electronic visual prostheses PhD Thesis Queensland University of Technology
69. Suaning G J and Lovell N H 2001 CMOS neurostimulation ASIC with 100 channels, scaleable output, and bi-directional radio-frequency telemetry IEEE Trans. Biomed. Eng. 48 248-60
70. Sivaprakasam M, Liu W, Humayun M S and Weiland J D 2005 A variable range bi-phasic current stimulus driver circuitry for an implantable retinal prosthetic device IEEE J. Solid-State Circuits 40 763-71
71. Pelli D G 1987 The visual requirements of mobility Low Vision: Principles and Applications ed G C Woo (New York: Springer) pp 134-45
72. Harmon L D 1973 The recognition of faces Sci. Am. 229 70-83
73. House W 1985 A personal perspective on cochlear implants Cochlear Implants ed R Schindler and M Merzenich (New York: Raven Press) pp 13-6
74. Loizou P C 1998 Mimicking the human ear IEEE Signal Process. Mag. 15 102-30
75. Hallum L E, Suaning G J and Lovell N H 2004 Contribution to the theory of prosthetic vision ASAIO J. 50 392-6
76. Fu L, Cai S, Zhang H, Hu G and Zhang X 2006 Psychophysics of reading with a limited number of pixels: towards the rehabilitation of reading ability with visual prosthesis Vision Res. 46 1292-301
77. Legge G E, Pelli D G, Rubin G S and Schleske M M 1985 Psychophysics of reading: I. Normal vision Vision Res. 25 239-52
78. Dokos S, Suaning G J and Lovell N H 2005 A bidomain model of epiretinal stimulation IEEE Trans. Neural Syst. Rehabil. Eng. 13 137-46
79. Hallum L E, Suaning G J, Taubman D S and Lovell N H 2004 Towards photosensor movement-adaptive image analysis in an electronic retinal prosthesis Proc. 26th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society (EMBS) pp 4165-8
80. Morrone M C, Burr D C and Ross J 1983 Added noise restores recognizability of coarse quantized images Nature 305 226-8
81. Harmon L D and Julesz B 1973 Masking in visual recognition-effects of 2-dimensional filtered noise Science 180 1194-7
82. Hallum L E, Cloherty S L, Taubman D S, Suaning G J and Lovell N H 2006 Psychophysics of prosthetic vision: III. Stochastic rendering, the phosphene image, and perception Proc. 28th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society (EMBS)
83. Leigh R J and Zee D S 1999 The Neurology of Eye Movements 3rd edn (New York: Oxford University Press)
84. Shepherd R K and Hardie N A 2001 Deafness-induced changes in the auditory pathway: implications for cochlear implants Audiol. Neuro-Otol. 6 305-18
85. Kiang N Y S and Moxon E C 1972 Physiological considerations in artificial stimulation of the inner ear Ann. Otol. Rhinol. Laryngol. 81 714-30
86. Rubinstein J T, Wilson B S, Finley C C and Abbas P J 1999 Pseudospontaneous activity: stochastic independence of auditory nerve fibers with electrical stimulation Hear. Res. 127 108-18
87. Jones B W and Marc R E 2005 Retinal remodeling during retinal degeneration Exp. Eye Res. 81 123-37
88. Stone J L, Barlow W E, Humayun M S, de Juan E and Milam A H 1992 Morphometric analysis of macular photoreceptors and ganglion-cells in retinas with retinitis-pigmentosa Arch. Ophthalmol. 110 1634-9