Estimating linear-nonlinear models using Rényi divergences

Network: Computation in Neural Systems

Volumn 20, Issue 2, 2009, Pages 49-68

  Kouh, Minjoon ^a,b   Sharpee, Tatyana O ^a,b  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Information theory; Natural scenes; Single neuron computation; Visual system

Indexed keywords

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; HUMAN; NERVE CELL; NONLINEAR SYSTEM; PHYSIOLOGY;

ANIMALS; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS;

EID: 70649100413     PISSN: 0954898X     EISSN: 13616536     Source Type: Journal    
DOI: 10.1080/09548980902950891     Document Type: Article

References (47)

1. Ahrens MB, Paninski L, Sahani M. 2008. Inferring input nonlinearities in neural encoding models. Network: Computation in Neural Systems 19:35-67.
2. Aldworth ZN, Miller JP, Gedeon T, Cummins GI, Dimitrov AG. 2005. Dejittered spike-conditioned stimulus waveforms yield improved estimates of neuronal feature selectivity and spike-timing precision of sensory interneurons. Journal of Neuroscience 25:5323-5332.
3. Ali SM, Silvey SD. 1966. A general class of coefficient of divergence of one distribution from another. Journal of Royal Statistical Society B 28:131-142.
4. Bell AJ, Sejnwoski TJ. 1995. An information-maximization approach to blind separation and blind deconvolution. Neural Computation 7:1129-1159.
5. Bialek W, De Ruyter Van Steveninck RR. 2005, Features and dimensions: Motion estimation in fly vision. arXiv:q-bio/0505003v1.
6. Brenner N, Strong SP, Koberle R, Bialek W, De Ruyter Van Steveninck RR. 2000. Synergy in a neural code. Neural Computation 12:1531-1552, See also physics/9902067.
7. Cardoso JF. 1997. Infomax and maximum likelihood for blind source separation. Signal Processing Letters, IEEE 4:112-114.
8. Christianson GB, Sahani M, Linden JF. 2008. The consequences of response nonlinearities for interpretation of spectrotemporal receptive fields. Journal of Neuroscience 28:446-455.
9. Cover TM, Thomas JA. 1991. Information theory. New York: John Wiley & Sons, INC.
10. Csiszár I. 1967. Information-type measures of difference of probability distributions and indirect observations. Studia Scientarium Mathematicarum Hungararica 2:299-318.
11. Daniels HE. 1961. The asymptotic efficiency of a maximum likelihood estimator. Proceeding of the Fourth Symposium on Mathematical Statistics and Problems 1:151-163.
12. David SV, Gallant JL. 2005. Predicting neuronal responses during natural vision. Network 22:239-260.
13. David SV, Hayden BY, Gallant JL. 2006. Spectral receptive field properties explain shape selectivity in area V4. Journal of Neurophysics 96:3492-3505
14. Dayan P, Abbott LF. 2001. Theoretical neuroscience: Computational and mathematical modeling of neural systems Cambridge: MIT Press.
15. De Boer E, Kuyper P. 1968. Triggered correlation. IEEE Transactions Biomedical Engineering 15:169-179.
16. De Ruyter Van Steveninck RR, Bialek W. 1988. Real-time performance of a movement-sensitive neuron in the blowfly visual system: Coding and information transfer in short spike sequences. Proceeding of the Royal Society London B 265:259-265.
17. Dimitrov AG, Gedeon T. 2006. Effects of stimulus transformations on estimates of sensory neuron selectivity. Journal of Computational Neuroscience 20:265-283.
18. Dimitrov AG, Miller JP, Gedeon T, Aldworth Z, Parker AE. 2003. Analysis of neural coding through quantization with an information-based distortion measure. Network: Computation Neural Systems 14:151-176.
19. Dimitrov AG, Sheiko MA, Baker J, Yen SC. 2009. Spatial and temporal jitter distort estimated functional properties of visual sensory neurons. DOI: 10.1007/S10827-009-0144-8. Journal of Computational Neuroscience [Epub ahead of print].
20. Felsen G, Touryan J, Han F, Dan Y. 2005. Cortical sensitivity to visual features in natural scenes. Public Library of Science Biology 3:1819-1828.
21. Gollisch T. 2006. Estimating receptive fields in the presence of spike-time jitter. Network: Computation in Neural Systems 17:103-129.
22. Harremoës P, Tishby N. 2007. The information bottleneck revisited or how to choose a good distortion measure. Proceeding of the IEEE International Symposium on Information Theory (ISIT) .
23. Hinton GE, Sejnowski TJ. 1986. Learning and relearning in Boltzmann machines. In: Rumelhart DE, McClelland JL, editors. Parallel distributed processing: Explorations in the microstructure of cognition. Cambridge: MIT Press. pp 282-317.
24. Hunter IW, Korenberg MJ. 1986. The identification of nonlinear biological systems: Wiener and hammerstein cascaDe models. Biological Cybernetics 55:135-144.
25. Kinney JB, Tkaćik G, Callan CG. 2007. Precise physical models of protein-DNA interaction from highthroughput data. Proceeding of the National Academy of Science 104:501-506.
26. MacKay D. 2003. Information theory, inference, and learning algorithms Cambridge: Cambridge University Press.
27. Marmarelis VZ. 1997. Modeling methodology for nonlinear physiological systems. Annals of Biomedical Engineering 25:239-251.
28. Paninski L. 2003. Convergence properties of three spike-triggered average techniques. Network: Computation Neural Systems 14:437-464.
29. Paninski L. 2004. Maximum likelihood estimation of cascaDe point-process neural encoding models. Network: Computation in Neural Systems 15:243-262. (Pubitemid 39586479)
30. Pillow JW, Paninski L, Uzzell VJ, Simoncelli EP, Chichilnisky EJ. 2005. Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model. Journal of Neuroscience 25:11003-11013.
31. Pillow JW, Shlens J, Paninski L, Shar A, Litke AM, Chichilnisky EJ, Simoncelli EP. 2008. Spatio-temporal correlations and visual signaling in a complete neural population. Nature 454:995-999.
32. Press WH, Teukolsky SA, Vetterling WT, Flannery BP. 1992. Numerical Recipes in C: The Art of Scientific Computing. Cambridge: Cambridge University Press.
33. Rényi, A. 1961. On measures of entropy and information. In: Neyman, J, editor. Proceeding of the Fourth Berkeley Symposium Mathematical Statistics Problems. Vol.1: pp 547-561.
34. Rieke F, Warland D, De Ruyter Van Steveninck RR, Bialek W. 1997. Spikes: Exploring the neural coDe Cambridge: MIT Press.
35. Ringach DL, Hawken MJ, Shapley R. 2002. Receptive field structure of neurons in monkey visual cortex revealed by stimulation with natural image sequences. Journal of Vision 2:12-24.
36. Ringach DL, Sapiro G, Shapley R. 1997. A subspace reverse-correlation technique for the study of visual neurons. Vision Research 37:2455-2464.
37. Ruderman DL, Bialek W. 1994. Statistics of natural images: Scaling in the woods. Physical Review Letters 73:814-817.
38. Rust NC, Schwartz O, Movshon JA, Simoncelli EP. 2005. Spatiotemporal elements of macaque v1 receptive fields. Neuron 46:945-956.
39. Sahani M. 2008, Neural coding. [Published 2008]. Available from: http://www.gatsby.ucl.ac. uk/maneesh/
40. Schwartz O, Pillow JW, Rust NC, Simoncelli EP. 2006. Spike-triggered neural characterization. Journal of Vision 176:484-507.
41. Sharpee T, Rust NC, Bialek W. 2004. Analyzing neural responses to natural signals: Maximally informative dimensions. Neural Computation 16:223-250, 2004. [See also physics/ 0212110 and a preliminary account in Advances in Neural Information Processing 15 edited by Becker S, Thrun S, Obermayer K. 2003. pp. 261-268.]
42. Sharpee TO. 2007. Comparison of information and variance maximization strategies for characterizing neural feature selectivity. Statistics in Medicine 26:4009-40031.
43. Sharpee TO, Sugihara H, Kurgansky AV, Rebrik SP, Stryker MP, Miller KD. 2006. Adaptive filtering enhances information transmission in visual cortex. Nature 439:936-942.
44. Simoncelli EP, Olshausen BA. 2001. Natural image statistics and neural representation. Annual Review of Neuroscience 24:1193-1216.
45. Theunissen FE, David SV, Singh NC, Hsu A, Vinje WE, Gallant JL. 2001. Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli. Network 3:289-316.
46. Tishby N, Pereira FC, Bialek W. 1999. The information bottleneck method. In Hajek B and Sreenivas RS, editors. Proceedings of the 37th Allerton Conference on Communication, Control and Computing. pp. 368-377, University of Illinois. [See also physics/0004057.]
47. Weisberg S, Welsh AH. 1994. Adapting for the missing link. Annals of Statistics 22:1674-1700.