Pulse trains to percepts: The challenge of creating a perceptually intelligible world with sight recovery technologies

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 370, Issue 1677, 2015, Pages

  Fine, Ione ^a   Boynton, Geoffrey M ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Macular degeneration; Neural coding; Neural prosthetic; Optogenetic; Retinal degeneration; Vision restoration

Indexed keywords

ARTIFICIAL INTELLIGENCE; LIGHT EFFECT; NERVOUS SYSTEM; NEUROLOGY; VISION;

BIOLOGICAL MODEL; CYTOLOGY; ELECTROTHERAPY; HUMAN; OPTOGENETICS; PATHOPHYSIOLOGY; PHYSIOLOGY; PROCEDURES; PSYCHOLOGY; RETINA; VISION; VISION DISORDERS; VISUAL PROSTHESIS;

ELECTRIC STIMULATION THERAPY; HUMANS; MODELS, BIOLOGICAL; OPTOGENETICS; RETINA; VISION DISORDERS; VISUAL PERCEPTION; VISUAL PROSTHESIS;

EID: 84938488343     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2014.0208     Document Type: Article

References (85)

1. Daiger SP, Rossiter BJF, Greenberg J, Christoffels A, Hide W. 1998 Data services and software for identifying genes and mutations causing retinal degeneration. Invest. Ophthalmol. Vis. Sci. 39, S295. (doi:10.1016/j.conb.2010.07.003)
2. Bamann C, Nagel G, Bamberg E. 2010 Microbial rhodopsins in the spotlight. Curr. Opin. Neurobiol. 20, 610-616. (doi:10.1016/j.conb.2010.07.003)
3. Bi A, Cui J, Ma YP, Olshevskaya E, Pu M, Dizhoor AM, Pan ZH. 2006 Ectopic expression of a microbialtype rhodopsin restores visual responses in mice with photoreceptor degeneration. Neuron 50, 23-33. (doi:10.1016/j.neuron.2006.02.026)
4. Busskamp V, Picaud S, Sahel JA, Roska B. 2012 Optogenetic therapy for retinitis pigmentosa. Gene Ther. 19, 169-175. (doi:10.1038/gt.2011.155)
5. Tochitsky I et al. 2014 Restoring visual function to blind mice with a photoswitch that exploits electrophysiological remodeling of retinal ganglion cells. Neuron 81, 800-813. (doi:10.1016/j.neuron.2014.01.003)
6. Polosukhina A et al. 2012 Photochemical restoration of visual responses in blind mice. Neuron 75, 271-282. (doi:10.1016/j.neuron.2012.05.022)
7. Gaub BM et al. 2014 Restoration of visual function by expression of a light-gated mammalian ion channel in retinal ganglion cells or ON-bipolar cells. Proc. Natl Acad. Sci. USA 111, E5574-E5583. (doi:10.1073/pnas.1414162111)
8. Humayun MS et al. 2012 Interim results from the international trial of Second Sight’s visual prosthesis. Ophthalmology 119, 779-788. (doi:10.1016/j.ophtha.2011.09.028)
9. Klauke S, Goertz M, Rein S, Hoehl D, Thomas U, Eckhorn R, Bremmer F, Wachtler T. 2011 Stimulation with a wireless intraocular epiretinal implant elicits visual percepts in blind humans. Invest. Ophthalmol. Vis. Sci. 52, 449-455. (doi:10.1167/iovs.09-4410)
10. Stingl K et al. 2013 Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS. Proc. R. Soc. B 280, 20130077. (doi:10.1098/rspb.2013.0077)
11. Palanker D, Vankov A, Huie P, Baccus S. 2005 Design of a high-resolution optoelectronic retinal prosthesis. J. Neural Eng. 2, S105. (doi:10.1088/1741-2560/2/1/012)
12. Mutter M, Swietek N, Munch TA. 2014 Salvaging ruins: reverting blind retinas into functional visual sensors. Methods Mol. Biol. 1148, 149-160. (doi: 10.1007/978-1-4939-0470-910)
13. Lagali PS, Balya D, Awatramani GB, Munch TA, Kim DS, Busskamp V, Cepko CL, Roska B. 2008 Lightactivated channels targeted to ON bipolar cells restore visual function in retinal degeneration. Nat. Neurosci. 11, 667-675. (doi:10.1038/nn.2117)
14. Zhang Y, Ivanova E, Bi A, Pan ZH. 2009 Ectopic expression of multiple microbial rhodopsins restores ON and OFF light responses in retinas with photoreceptor degeneration. J. Neurosci. 29, 9186-9196. (doi:10.1523/JNEUROSCI.0184-09.2009)
15. Doroudchi MM et al. 2011 Virally delivered channelrhodopsin-2 safely and effectively restores visual function in multiple mouse models of blindness. Mol. Ther. 19, 1220-1229. (doi:10.1038/mt.2011.69)
16. Caporale N et al. 2011 LiGluR restores visual responses in rodent models of inherited blindness. Mol. Ther. 19, 1212-1219. (doi:10.1038/mt.2011.103)
17. da Cruz L et al. 2013 The Argus II epiretinal prosthesis system allows letter and word reading and long-term function in patients with profound vision loss. Br. J. Ophthalmol. 97, 632-636. (doi:10.1136/bjophthalmol-2012-301525)
18. Stingl K et al. 2012 What can blind patients see in daily life with the subretinal Alpha IMS implant? Current overview from the clinical trial in Tubingen. Der Ophthalmol. 109, 136-141. (doi:10.1007/s00347-011-2479-6)
19. Nanduri D, Fine I, Horsager A, Boynton GM, Humayun MS, Greenberg RJ, Weiland JD. 2012 Frequency and amplitude modulation have different effects on the percepts elicited by retinal stimulation. Invest. Ophthalmol. Vis. Sci. 53, 205-214. (doi:10.1167/iovs.11-8401)
20. Horsager A, Greenwald SH, Weiland JD, Humayun MS, Greenberg RJ, McMahon MJ, Boynton GM, Fine I. 2009 Predicting visual sensitivity in retinal prosthesis patients. Invest. Ophthalmol. Vis. Sci. 50, 1483-1491. (doi:10.1167/iovs.08-2595)
21. Horsager A, Boynton GM, Greenberg RJ, Fine I. 2011 Temporal interactions during paired-electrode stimulation in two retinal prosthesis subjects. Invest. Ophthalmol. Vis. Sci. 52, 549-557. (doi:10.1167/iovs.10-5282)
22. Horsager A, Greenberg RJ, Fine I. 2010 Spatiotemporal interactions in retinal prosthesis subjects. Invest. Ophthalmol. Vis. Sci. 51, 1223-1233. (doi:10.1167/iovs.09-3746)
23. Greenwald SH, Horsager A, Humayun MS, Greenberg RJ, McMahon MJ, Fine I. 2009 Brightness as a function of current amplitude in human retinal electrical stimulation. Invest. Ophthalmol. Vis. Sci. 50, 5017-5025. (doi:10.1167/iovs.08-2897)
24. de Balthasar C et al. 2008 Factors affecting perceptual thresholds in epiretinal prostheses. Invest. Ophthalmol. Vis. Sci. 49, 2303-2314. (doi:10.1167/iovs.07-0696)
25. Nirenberg S, Pandarinath C. 2012 Retinal prosthetic strategy with the capacity to restore normal vision. Proc. Natl Acad. Sci. USA 109, 15012-1 017. (doi:10.1073/pnas.1207035109)
26. Rubinstein JT. 2004 How cochlear implants encode speech. Curr. Opin. Otolaryngol. Head Neck Surg. 12, 444-448. (doi:10.1097/01.moo.0000134452.24819.c0)
27. Shannon RV. 2012 Advances in auditory prostheses. Curr. Opin. Neurol. 25, 61-66. (doi:10.1097/WCO.0b013e32834ef878)
28. Pillow JW, Shlens J, Paninski L, Sher A, Litke AM, Chichilnisky EJ, Simoncelli EP. 2008 Spatio-temporal correlations and visual signalling in a complete neuronal population. Nature 454, 995-999. (doi:10.1038/nature07140)
29. Pillow JW, Paninski L, Uzzell VJ, Simoncelli EP, Chichilnisky EJ. 2005 Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model. J. Neurosci. 25, 11 003-11 013. (doi:10.1523/JNEUROSCI.3305-05.2005)
30. Keat J, Reinagel P, Reid RC, Meister M. 2001 Predicting every spike: a model for the responses of visual neurons. Neuron 30, 803-817. (doi:10.1016/S0896-6273(01)00322-1)
31. Rodieck RW. 1998 The first steps in seeing. Sunderland, MA: Sinauer Associates.
32. Dacey D. 2004 20 Origins of perception: retinal ganglion cell diversity and the creation of parallel visual pathways. In The cognitive neurosciences III (ed. MS Gazzaniga), p. 281. Cambridge, MA: MIT Press.
33. DeVries SH. 2000 Bipolar cells use kainate and AMPA receptors to filter visual information into separate channels. Neuron 28, 847-856. (doi:10.1016/S0896-6273(00)00158-6)
34. Winter IM, Robertson D, Yates GK. 1990 Diversity of characteristic frequency rate-intensity functions in guinea pig auditory nerve fibres. Hear. Res. 45, 191-202. (doi:10.1016/0378-5955(90)90120-E)
35. Heil P, Neubauer H, Irvine DRF. 2011 An improved model for the rate-level functions of auditory-nerve fibers. J. Neurosci. 31, 15 424-15 437. (doi:10.1523/JNEUROSCI.1638-11.2011)
36. Field GD et al. 2010 Functional connectivity in the retina at the resolution of photoreceptors. Nature 467, 673-677. (doi:10.1038/nature09424)
37. Frechette ES, Sher A, Grivich MI, Petrusca D, Litke AM, Chichilnisky EJ. 2005 Fidelity of the ensemble code for visual motion in primate retina. J. Neurophysiol. 94, 119-135. (doi:10.1152/jn.01175.2004)
38. Devries SH, Baylor DA. 1997 Mosaic arrangement of ganglion cell receptive fields in rabbit retina. J. Neurophysiol. 78, 2048-2060.
39. Wassle H, Peichl L, Boycott BB. 1981 Dendritic territories of cat retinal ganglion cells. Nature 292, 344-345. (doi:10.1038/292344a0)
40. Callaway EM. 2005 Structure and function of parallel pathways in the primate early visual system. J. Physiol. 566, 13-19. (doi:10.1113/jphysiol.2005.088047)
41. Berdyyeva TK, Reynolds JH. 2009 The dawning of primate optogenetics. Neuron 62, 159-160. (doi:10.1016/j.neuron.2009.04.011)
42. Mastronarde DN. 1983 Interactions between ganglion cells in cat retina. J. Neurophysiol. 49, 350-365.
43. Shlens J, Field GD, Gauthier JL, Grivich MI, Petrusca D, Sher A, Litke AM, Chichilnisky EJ. 2006 The structure of multi-neuron firing patterns in primate retina. J. Neurosci. 26, 8254-8266. (doi:10.1523/JNEUROSCI.1282-06.2006)
44. Busskamp V et al. 2010 Genetic reactivation of cone photoreceptors restores visual responses in retinitis pigmentosa. Science 329, 413-417. (doi:10.1126/science.1190897)
45. Greenberg KP, Pham A, Werblin FS. 2011 Differential targeting of optical neuromodulators to ganglion cell soma and dendrites allows dynamic control of center-surround antagonism. Neuron 69, 713-720. (doi:10.1016/j.neuron.2011.01.024)
46. Wheatstone C. 1838 Contributions to the physiology of vision. Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision. Phil. Trans. R. Soc. 128, 371-394. (doi:10.1098/rstl.1838.0019)
47. Jensen RJ, Ziv OR, Rizzo III JF. 2005 Thresholds for activation of rabbit retinal ganglion cells with relatively large, extracellular microelectrodes` Invest. Ophthalmol. Vis. Sci. 46, 1486-1496. (doi:10.1167/iovs.04-1018)
48. Tsai D, Chen S, Protti DA, Morley JW, Suaning GJ, Lovell NH. 2012 Responses of retinal ganglion cells to extracellular electrical stimulation, from single cell to population: model-based analysis. PLoS ONE 7, e53357. (doi:10.1371/journal.pone.0053357)
49. Nanduri D, Fine I, Greenberg R, Horsager A, Boynton GM, Weiland J. 2011 Predicting the percepts of electrical stimulation in retinal prosthesis subjects. Cosyne Abstracts 2011, Salt Lake City, USA.
50. Jansonius NM et al. 2009 A mathematical description of nerve fiber bundle trajectories and their variability in the human retina. Vis. Res. 49, 2157-2163. (doi:10.1016/j.visres.2009.04.029)
51. Wilke R et al. 2011 Spatial resolution and perception of patterns mediated by a subretinal 16-electrode array in patients blinded by hereditary retinal dystrophies. Invest. Ophthalmol. Vis. Sci. 52, 5995-6003. (doi:10.1167/iovs.10-6946)
52. Tsai D, Morley JW, Suaning GJ, Lovell NH. 2009 Direct activation and temporal response properties of rabbit retinal ganglion cells following subretinal stimulation. J. Neurophysiol. 102, 2982-2993. (doi:10.1152/jn.00545.2009)
53. Stingl K et al. 2013 Safety and efficacy of subretinal visual implants in humans: methodological aspects. Clin. Exp. Optom. 96, 4-13. (doi:10.1111/j.1444-0938.2012.00816.x)
54. Donaldson GS, Kreft HA, Litvak L. 2005 Place-pitch discrimination of single-versus dual-electrode stimuli by cochlear implant users. J. Acoust. Soc. Am. 118, 623-626. (doi:10.1121/1.1937362)
55. Hughes ML, Goulson AM. 2011 Electrically evoked compound action potential measures for virtual channels versus physical electrodes. Ear Hear. 32, 323-330. (doi:10.1097/AUD.0b013e3182008c56)
56. Bonham BH, Litvak LM. 2008 Current focusing and steering: modeling, physiology, and psychophysics. Hear. Res. 242, 141-153. (doi:10.1016/j.heares.2008.03.006)
57. Srinivasan AG, Landsberger DM, Shannon RV. 2010 Current focusing sharpens local peaks of excitation in cochlear implant stimulation. Hear. Res. 270, 89-100. (doi:10.1016/j.heares.2010.09.004)
58. Berndt A, Yizhar O, Gunaydin LA, Hegemann P, Deisseroth K. 2009 Bi-stable neural state switches. Nat. Neurosci. 12, 229-234. (doi:10.1038/nn.2247)
59. Kleinlogel S, Feldbauer K, Dempski RE, Fotis H, Wood PG, Bamann C, Bamberg E. 2011 Ultra lightsensitive and fast neuronal activation with the Ca2þ-permeable channelrhodopsin CatCh. Nat. Neurosci. 14, 513-518. (doi:10.1038/nn.2776)
60. van Hateren JH. 1990 Directional tuning curves, elementary movement detectors, and the estimation of the direction of visual movement. Vis. Res. 30, 603-614. (doi:10.1016/0042-6989(90)90071-R)
61. Zeitz C, Robson AG, Audo I. 2014 Congenital stationary night blindness: an analysis and update of genotype-phenotype correlations and pathogenic mechanisms. Prog. Retin. Eye Res. 45, 58-110. (doi:10.1016/j.preteyeres.2014.09.001)
62. Cibis GW, Fitzgerald KM. 2001 The negative ERG is not synonymous with nightblindness. Trans. Am. Ophthalmol. Soc. 99, 171-176.
63. Bijveld MM et al. 2013 Genotype and phenotype of 101 Dutch patients with congenital stationary night blindness. Ophthalmology 120, 2072-2081. (doi:10.1016/j.ophtha.2013.03.002)
64. Robertson D, Irvine DR. 1989 Plasticity of frequency organization in auditory cortex of guinea pigs with partial unilateral deafness. J. Comp. Neurol. 282, 456-471. (doi:10.1002/cne.902820311)
65. Recanzone GH, Schreiner CE, Merzenich MM. 1993 Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys. J. Neurosci. 13, 87-103.
66. Smirnakis SM, Brewer AA, Schmid MC, Tolias AS, Schuz A, Augath M, Inhoffen W, Wandell BA, Logothetis NK. 2005 Lack of long-term cortical reorganization after macaque retinal lesions. Nature 435, 300-307. (doi:10.1038/nature03495)
67. Ghose GM, Yang T, Maunsell JH. 2002 Physiological correlates of perceptual learning in monkey V1 and V2. J. Neurophysiol. 87, 1867-1888.
68. Baseler HA, Brewer AA, Sharpe LT, Morland AB, Jagle H, Wandell BA. 2002 Reorganization of human cortical maps caused by inherited photoreceptor abnormalities. Nat. Neurosci. 5, 364-370. (doi:10.1038/nn817)
69. Levin N, Dumoulin SO, Winawer J, Dougherty RF, Wandell BA. 2010 Cortical maps and white matter tracts following long period of visual deprivation and retinal image restoration. Neuron 65, 21-31. (doi:10.1016/j.neuron.2009.12.006)
70. Fine I, Wade AR, Brewer AA, May MG, Goodman DF, Boynton GM, Wandell BA, MacLeod DI. 2003 Longterm deprivation affects visual perception and cortex. Nat. Neurosci. 6, 915-916. (doi:10.1038/nn1102)
71. Masuda Y, Dumoulin SO, Nakadomari S, Wandell BA. 2008 V1 projection zone signals in human macular degeneration depend on task, not stimulus. Cereb. Cortex 18, 2483-2493. (doi:10.1093/cercor/bhm256)
72. Baseler HA, Gouws A, Haak KV, Racey C, Crossland MD, Tufail A, Rubin GS, Cornelissen FW, Morland AB. 2011 Large-scale remapping of visual cortex is absent in adult humans with macular degeneration. Nat. Neurosci. 14, 649-655. (doi:10.1038/nn.2793)
73. Baker CI, Peli E, Knouf N, Kanwisher NG. 2005 Reorganization of visual processing in macular degeneration. J. Neurosci. 25, 614-618. (doi:10.1523/JNEUROSCI.3476-04.2005)
74. Baker CI, Dilks DD, Peli E, Kanwisher N. 2008 Reorganization of visual processing in macular degeneration: replication and clues about the role of foveal loss. Vis. Res. 48, 1910-1919. (doi:10.1016/j.visres.2008.05.020)
75. Dilks DD, Baker CI, Peli E, Kanwisher N. 2009 Reorganization of visual processing in macular degeneration is not specific to the ‘preferred retinal locus’. J. Neurosci. 29, 2768-2773. (doi:10.1523/JNEUROSCI.5258-08.2009)
76. Sunness JS, Liu T, Yantis S. 2004 Retinotopic mapping of the visual cortex using functional magnetic resonance imaging in a patient with central scotomas from atrophic macular degeneration. Ophthalmology 111, 1595-1598. (doi:10.1016/j.ophtha.2003.12.050)
77. Masuda Y, Horiguchi H, Dumoulin SO, Furuta A, Miyauchi S, Nakadomari S, Wandell BA. 2010 Task-dependent V1 responses in human retinitis pigmentosa. Invest. Ophthalmol. Vis. Sci. 51, 5356-5364. (doi:10.1167/iovs.09-4775)
78. Georgeson MA, Sullivan GD. 1975 Contrast constancy: deblurring in human vision by spatial frequency channels. J. Physiol. (Lond.) 252, 627-656. (doi:10.1113/jphysiol.1975.sp011162)
79. Falconbridge M, Wozny D, Shams L, Engel SA. 2009 Adapting to altered image statistics using processed video. Vis. Res. 49, 1757-1764. (doi:10.1016/j.visres.2009.03.027)
80. Bao M, Engel SA. 2012 Distinct mechanism for long-term contrast adaptation. Proc. Natl Acad. Sci. USA 109, 5898-5903. (doi:10.1073/pnas.1113503109)
81. Webster MA, Georgeson MA, Webster SM. 2002 Neural adjustments to image blur. Nat. Neurosci. 5, 839-840. (doi:10.1038/nn906)
82. Vaziri-Pashkam M, Cavanagh P. 2008 Apparent speed increases at low luminance. J. Vis. 8, 1-12. (doi:10.1167/8.16.9)
83. Johnston A. 2010 Modulation of time perception by visual adaptation. In Attention and time (eds AC Nobre, JT Coull), pp. 187-2000. Oxford, UK: Oxford University Press.
84. Bruno A, Ng E, Johnston A. 2013 Motion-direction specificity for adaptation-induced duration compression depends on temporal frequency. J. Vis. 13, 19. (doi:10.1167/13.12.19)
85. Ahuja AK, Behrend MR, Kuroda M, Humayun MS, Weiland JD. 2008 An in vitro model of a retinal prosthesis. Biomed. Eng. IEEE Trans. 55, 1744-1753. (doi:10.1109/TBME.2008.919126)