Learning quadratic receptive fields from neural responses to natural stimuli

Neural Computation

Volumn 25, Issue 7, 2013, Pages 1661-1692

  Rajan, Kanaka ^a   Marre, Olivier ^b   Tkačik, Gašper ^c  

^a PRINCETON UNIVERSITY   (United States)

^b INSTITUT DE LA VISION   (France)

^c INSTITUTE OF SCIENCE AND TECHNOLOGY AUSTRIA   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; BAYES THEOREM; BIOLOGICAL MODEL; COMPUTER SIMULATION; ENTROPY; HUMAN; INFORMATION SCIENCE; LEARNING; NERVE CELL; NONLINEAR SYSTEM; PHYSIOLOGY; REVIEW; STATISTICAL MODEL;

ANIMALS; BAYES THEOREM; COMPUTER SIMULATION; ENTROPY; HUMANS; INFORMATION THEORY; LEARNING; LIKELIHOOD FUNCTIONS; LINEAR MODELS; MODELS, NEUROLOGICAL; NEURONS; NONLINEAR DYNAMICS;

EID: 84881003399     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00463     Document Type: Review

References (86)

1. Agüera y Arcas, B., & Fairhall, A. L. (2003). What causes a neuron to spike?. Neural Comput., 15, 1789-1807.
2. Agüera y Arcas, B., Fairhall, A. L., & Bialek, W. (2003). Computation in a single neuron: Hodgkin and Huxley revisited. Neural Comput., 15, 1715-1749.
3. Baccus, S. A., & Meister, M. (2002). Fast and slow contrast adaptation in retinal circuitry. Neuron, 36, 909-919.
4. Baccus, S. A., & Meister, M. (2004). Retina versus cortex: Contrast adaptation in parallel visual pathways. Neuron, 42, 5-7.
5. Berry, M. J. II, Brivanlou, I. H., Jordan, T. A., & Meister, M. (1999). Anticipation of moving stimuli by the retina. Nature, 398, 334-338.
6. Berry,M. J. II, & Meister,M. (1998). Refractoriness and neural precision. J. Neurosci., 18, 2200-2211.
7. Bialek,W., & de Ruyter van Steveninck, R. R. (2005). Features and dimensions: Motion estimation in fly vision. arxiv.org:q-bio/0505003
8. Bölinger, D.,& Gollisch, T. (2012). Closed-loop measurements of iso-response stimuli reveal dynamic nonlinear stimulus integration in the retina. Neuron, 73, 333-346.
9. Borst, A., & Egelhaaf, M. (1987). Temporal modulation of luminance adapts time constant of fly movement detectors. Biol. Cybern., 56, 209-215.
10. Brenner, N., de Ruyter van Steveninck, R. R., & Bialek,W. (2000). Adaptive rescaling maximizes information transmission. Neuron, 26, 695-702.
11. Chen, E., Marre, O., Fisher, C., Schwartz, G., Levy, J., da Silveira, R., et al. (2012). Alert response to motion onset in the retina. J. Neurosci., 33, 120-132.
12. Dayan, P., & Abbott, L. F. (2001). Theoretical neuroscience. Cambridge,MA: MIT Press.
13. de Boer, E., & Kuyper, P. (1968). Triggered correlation. IEEE Trans. Biomed. Eng., 15, 169-179.
14. Demb, J. B., Zaghloul, K., Haarsma, L., & Sterling, P. (2001). Bipolar cells contribute to nonlinear spatial summation in the brisk-transient (Y) ganglion cell in mammalian retina. J. Neurosci., 21, 7447-7454.
15. de Ruyter van Steveninck, R. R., & Bialek, W. (1988). Real-time performance of a movement sensitive in the blowfly visual system: Information transfer in short spike sequences. Proc. Roy. Soc. Lond. B, 234, 379-414.
16. de Ruyter van Steveninck, R. R., Lewen, G. D., Strong, S. P., & Bialek, W. (1997). Reproducibility and variability in neural spike trains. Science, 275, 1805-1808.
17. de Ruyter van Steveninck, R. R., Zaagman, W. H., & Mastebroek, H.A.K. (1986). Adaptation of transient responses of a movement-sensitive neuron in the visual system of the blowfly Calliphora erythrocephala. Biol Cybern, 54, 223-226.
18. Fairhall, A. L., Burlingame, C. A., Narasimhan, R., Harris, R. A., Puchalla, J. L., & Berry,M. J. II (2006). Selectivity formultiple stimulus features in retinal ganglion cells. J. Neurophysiol., 96, 2724-2738.
19. Fairhall, A. L., Lewen, G. D., Bialek, W., & de Ruyter van Steveninck, R. R. (2001). Efficiency and ambiguity in an adaptive neural code. Nature, 412, 787-792.
20. Fitzgerald, J.D., Rowekamp, R. J., Sincich, L.C.,&Sharpee, T. O. (2011). Second order dimensionality reduction using minimum and maximum mutual information models. PLoS Comput. Biol., 7, e1002249.
21. Fitzgerald, J. D., Sincich, L. C., & Sharpee, T. O. (2011). Minimal models of multidimensional computations. PLoS Comput. Biol., 7, e1001111.
22. Geisler,W. S. (2008).Visual perception and the statistical properties of natural scenes. Annu. Rev. Psychol., 59, 167-192.
23. Gerstner, W., & Kistler, W. (2002). Spiking neuron models: Single neurons, populations, plasticity. Cambridge: Cambridge University Press.
24. Gerwinn, S.,Macke, J., & Bethge,M. (2010). Bayesian inference for generalized linear models for spiking neurons. Frontiers in Comput. Neurosci., 4, 12.
25. Gerwin, S., Macke, J., Seeger,M., & Bethge,M. (2008). Bayesian inference for spiking neuron models with a sparsity prior. In D. Köller, D. Schuurmans, Y. Bengio, & L. Bottou (Eds.), Advances in neural information processing systems, 20. Cambridge, MA: MIT Press.
26. Globerson, A., Stark, E., Vaadia, E., & Tishby, N. (2009). The minimum information principle and its application to neural code analysis. Proc. Natl. Acad. Sci. USA, 106, 3490-3495.
27. Gollisch, T., & Herz, A. V. M. (2005). Disentangling sub-millisecond process within an auditory transduction chain. PLoS Comp. Biol., 9(3), e1002922.
28. Gollisch, T., & Meister, M. (2010). Eye smarter than scientists believed: Neural computations in circuits of the retina. Neuron, 65, 150-164.
29. Granot-Atedgi, E., Tkačik, G., Segev, R., & Schneidman, E. (2013). Stimulusdependent maximum entropy models of neural population codes. PLoS Comput. Biol., 9, e1002922.
30. Hartline, H. K. (1940). The receptive fields of optic nerve fibers. Am. J. Physiol., 130, 690-699.
31. Hong, S., Agüera y Arcas, B., & Fairhall, A. L. (2007). Single neuron computation: From dynamical system to feature detector. Neural Comput., 19, 3133- 3172.
32. Hubel, D. H., & Wiesel, T. H. (1965). Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. J. Physiol., 28, 229-289.
33. Jaynes, E. T. (1957a). Information theory and statistical mechanics. Phys. Rev., 106, 620-630.
34. Jaynes, E. T. (1957b). Information theory and statistical mechanics II. Phys. Rev., 108, 171-190.
35. Karklin, Y.,& Lewicki, M. S. (2009). Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457, 83-86.
36. Keat, J., Reinagel, P., Reid, R., & Meister, M. (2001). Predicting every spike: A model for the responses of visual neurons. Neuron, 30, 803-817.
37. Kerr, J.N.D.,& Nimmerjahn, A. (2012). Functional imaging in freelymoving animals. Curr. Op. Neurobiol., 22, 45-53.
38. Kinney, J. B., Tkačik, G., & Callan, C. G. Jr (2007). Precise physical models of protein- DNA interaction from high-throughput data. Proc. Nat. Acad. Sci. USA, 104, 501- 506.
39. Kouh, M., & Sharpee, T. O. (2009). Estimating linear-nonlinear models using Renyi divergences. Network, 20, 49-68.
40. Lesica, N. A., Ishii, T., Stanley, G. B., & Hosoya, T. (2008). Estimating receptive fields from responses to natural stimuli with asymmetric intensity distributions. PLoS ONE, 3, e3060.
41. Lundstrom, B. N., Hong, S., & Fairhall, A. L. (2008). Two computational regimes of a single-compartment neuron separated by a planar boundary in conductance space. Neural Comput., 20, 1239-1260.
42. Maravall, M., Petersen, R. S., Fairhall, A. L., Arabzadeh, E., & Diamond,M. E. (2007). Shifts in coding properties and maintenance of information transmission during adaptation in barrel cortex. PLoS Biol., 5, e19.
43. Marmarelis, P. Z., & Marmarelis, V. Z. (1978). Analysis of physiological systems: The white-noise approach. New York: Plenum.
44. Olveczky, B. P., Baccus, S. A., & Meister, M. (2007). Retinal adaptation to object motion. Neuron, 56, 689-700.
45. Ostojic, S., & Brunel, N. (2011). From spiking neuron models to linear-nonlinear models. PLoS Comput. Biol., 7, e1001056.
46. Ozuysal, Y., & Baccus, S. A. (2012). Linking the computational structure of variance adaptation to biophysical mechanisms. Neuron, 73, 1002-1015.
47. Paninski, L. (2003). Convergence properties of some spike-triggered analysis techniques. Network, 14, 437-464.
48. Paninski, L. (2004).Maximum likelihood estimation of cascade point-process neural encoding models. Network Comp. Neural Syst., 15, 243-262.
49. Paninski, L., Pillow, J.W., & Simoncelli, E. P. (2004).Maximum likelihood estimation of a stochastic integrate-and-fire neural encoding model. Neural Comput., 16, 2533-2561.
50. Park, I., & Pillow, J. W. (2011). Bayesian spike-triggered covariance. In J. Shawe- Taylor, R. S. Zemel, P. Bartlett, F. Pereira, & K. Q. Weinberger (Eds.), Advances in neural information processing systems, 24 (pp. 1692-1700). Red Hook, NY: Curran.
51. Pillow, J.W. (2007). Likelihood-based approaches to modeling the neural code. In K. Daya, S. Ishii, A. Pouget, & R. Rao (Eds.), Bayesian brain: Probabilistic approaches to neural coding (pp. 53-70). Cambridge, MA: MIT Press.
52. Pillow, J. W., Shlens, J., Paninski, L., Sher, A., Litke, A. M., Chichilnisky, E. J., et al. (2008). Spatio-temporal correlations and visual signalling in a complete neural population. Nature, 454, 995-999.
53. Pillow, J. W., & Simoncelli, E. P. (2006). Dimensionality reduction in neural models: An information-theoretic generalization of spike-triggered average and covariance analysis. J. Vis., 6, 414-428.
54. Rajan, K., & Bialek,W. (2012). Maximally informative "stimulus energies" in the analysis of neural responses to natural signals. arXiv.org:1201.0321.
55. Rapela, J., Felsen, G., Touryan, J., Mendel, J. M., & Grzywacz, N. M. (2010). ePPR: A new strategy for the characterization of sensory cells from input/output data. Network, 21, 35-90.
56. Recio-Spinoso, A., Temchin, A. N., van Dijk, P., Fan, Y. H., & Ruggero, M. A. (2005). Wiener-kernel analysis of responses to noise of chinchilla auditory-nerve fibers. J. Neurophys., 93, 3615-3634.
57. Reid, R. C., Victor, J. D., & Shapley, R. M. (1997). The use of m-sequences in the analysis of visual neurons: Linear receptive field properties. Vis. Neurosci., 14, 1015-1027.
58. Rust, N. C., & Movshon, J. A. (2005). In praise of artifice. Nat. Neurosci., 8, 1647- 1650.
59. Rust, N. C., Schwartz, O., Movshon, J. A., & Simoncelli, E. P. (2004). Spike-triggered characterization of excitatory and suppressive stimulus dimensions in monkey V1. Neurocomputing, 5860, 793-799.
60. Sakai, H. M. (1992). White-noise analysis in neurophysiology. Physiol. Rev., 72, 491- 505.
61. Schetzen, M. (1989). The Volterra andWiener theories of nonlinear systems.Malabar, FL: Krieger.
62. Schneidman, E., Berry, M. J. II, Segev, R., & Bialek, W. (2006). Weak pairwise correlations imply strongly correlated network states in a neural population. Nature, 440, 1007-1012.
63. Schwartz, O., Chichilnisky, E. J., & Simoncelli, E. P. (2002). Characterizing neural gain control using spike-triggered covariance. In T. G. Dietterich, S. Becker, & Z. Ghahramani (Eds.), Advances in neural information processing systems, 14 (pp. 269-276). Cambridge, MA: MIT Press.
64. Schwartz, O., Pillow, J. W., Rust, N. C., & Simoncelli, E. P. (2006). Spike-triggered neural characterization. J. Vis., 6, 484-507.
65. Schwartz, O., & Simoncelli, E. P. (2001). Natural signal statistics and sensory gain control. Nat. Neurosci., 4, 819-825.
66. Schwartz, G. W., Okawa, H., Dunn, F. A., Morgan, J. L., Kerschensteiner, D., Wong, R. O., et al. (2012). The spatial structure of a nonlinear receptive field. Nature Neurosci., 15, 1572-1580.
67. Schwartz, G., Taylor, S., Fisher, C., Harris, R., & Berry, M. J. II. (2007). Synchronizedfiring among retinal ganglion cells signals motion reversal. Neuron, 55, 958-969.
68. Sharpee, T. O., Rust, N. C.,& Bialek,W. (2004). Analyzing neural responses to natural signals: Maximally informative dimensions. Neural Comput., 16, 223-250.
69. Sharpee, T. O., Sugihara, H., Kurgansky, A. V., Rebrik, S. P., Stryker, M. P., & Miller, K. D. (2006). Adaptive filtering enhances information transmission in visual cortex. Nature, 439, 936-942.
70. Simoncelli, E. P., & Olshausen, B. A. (2001). Natural image statistics and neural representation. Annu. Rev. Neurosci., 24, 1193-1216.
71. Simoncelli, E. P., Paninski, L., Pillow, J., & Schwartz, O. (2004). Characterization of neural responses with stochastic stimuli. In M. Gazzaniga (Ed.), The cognitive neurosciences (3rd ed). Cambridge, MA: MIT Press.
72. Smirnakis, S. M., Berry, M. J. II, Warland, D. K., Bialek, W., & Meister, M. (1997). Adaptation of retinal processing to image contrast and spatial scale. Nature, 386, 69-73.
73. Tkačik, G., Garrigan, P., Ratliff, C., Milčinski, G., Klein, J. M., Seyfarth, L. H., et al. (2011).Natural images fromthe birthplace of the humaneye. PLoSONE, 6, e20409.
74. Tkačik, G., & Magnasco, M. O. (2008). Decoding spike timing: The differential reverse-correlation method. Biosystems, 93, 90-100.
75. Tkačik, G., Prentice, J. S., Victor, J. D., & Balasubramanian, V. (2010). Local statistics in natural scenes predict the saliency of synthetic textures. Proc. Natl. Acad. Sci. USA, 107, 18149-18154.
76. Touryan, J., Lau, B., & Dan, Y. (2002). Isolation of relevant visual features from random stimuli for cortical complex cells. J. Neurosci., 22, 10811-10818.
77. Truccolo, W., Eden, U. T., Fellows, M. R., Donoghue, J. P., & Brown, E. N. (2004). A point process framework for relating neural spiking activity to spiking history, neural ensemble and extrinsic covariate effects. J. Neurophysiol., 93, 1074-1089.
78. van Hateren, J. H. (1992). Theoretical predictions of spatiotemporal receptive felds of fly LMCs, and experimental validation. J. Comp. Physiol. A, 171, 157-170.
79. Victor, J. D., & Johannesma, P. (1986).Maximum-entropy approximations of stochastic nonlinear transfunctions: An extension of the Wiener theory. Biol. Cybern., 54, 289-300.
80. Victor, J. D., & Knight, B. W. (1979). Nonlinear analysis with an arbitrary stimulus ensemble. Quart. Appl. Math., 2, 113-136.
81. Victor, J. D., & Shapley, R. M. (1979). The nonlinear pathway of Y ganglion cells in the cat retina. J. Gen. Physiol., 74, 671-689.
82. Victor, J.D.,& Shapley, R.M. (1980). The effect of contrast on the non-linear response of the Y cell. J. Physiol., 302, 535-547.
83. Wiener, N. (1958). Nonlinear problems in random theory. New York:Wiley.
84. Williamson, R. S., Sahani, M., & Pillow, J. W. (2011). On information-theoretic and likelihood-based methods for spike-triggered neural characterization. Poster at COSYNE 2011.
85. Wu,M.C.K., David, S.V.,&Gallant, J. L. (2006). Complete functional characterization of sensory neurons by system identification. Annu. Rev. Neurosci., 29, 477-505.
86. Zetzsche, C., & Nuding, U. (2005). Nonlinear and higher-order approaches to the encoding of natural scenes. Network, 16, 191-221.