Minimal models of multidimensional computations

PLoS Computational Biology

Volumn 7, Issue 3, 2011, Pages

  Fitzgerald, Jeffrey D ^a,b   Sincich, Lawrence C ^c   Sharpee, Tatyana O ^a,b  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION THEORY; LEARNING SYSTEMS;

CLOSED FORM; ENTROPY MODEL; INPUT AND OUTPUTS; INPUT-OUTPUT; LIMITED INFORMATION; LOGISTICS FUNCTIONS; MINIMAL MODEL; NEURAL RESPONSE; RANDOM FIELD MODEL; RESPONSE FUNCTIONS;

ENTROPY;

ACCURACY; ARTICLE; BRAIN NERVE CELL; CELL FUNCTION; CORRELATION ANALYSIS; ENTROPY; MACACA; MATHEMATICAL COMPUTING; NONHUMAN; NONLINEAR SYSTEM; STATISTICAL MODEL; VISUAL STIMULATION; ACTION POTENTIAL; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; COMPUTER SIMULATION; NERVE CELL; PHYSIOLOGY;

ACTION POTENTIALS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; ENTROPY; MODELS, NEUROLOGICAL; NEURONS;

EID: 79953663015     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1001111     Document Type: Article

References (60)

1. Haken H, (1988) Information and Self-Organization. Berlin Springer.
2. Bray D, (1995) Protein molecules as computational elements in living cells. Nature 376: 307-312.
3. Körding K, (2007) Decision theory: What "should" the nervous system do? Science 318: 606-610.
4. Sanfey AG, (2007) Social decision-making: Insights from game theory and neuroscience. Science 318: 598-602.
5. Grenfell BT, Williams CS, Björnstad ON, Banavar JR, (2006) Simplifying biological complexity. Nat Phys 2: 212-214.
6. Lafferty J, McCallum A, Pereira F, (2001) Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proceedings of the Eighteenth International Conference on Machine Learning pp. 282-289.
7. Globerson A, Tishby N, (2004) The minimum information principle for discriminative learning. Proceedings of the 20th conference on Uncertainty in artificial intelligence Arlington, Virginia AUAI Press, UAI '04, 193-200 Available: http://portal.acm.org/citation.cfm?id=1036843.1036867.
8. Globerson A, Stark E, Vaadia E, Tishby N, (2009) The minimum information principle and its application to neural code analysis. Proc Natl Acad Sci USA 106: 3490-3495.
9. Jaynes ET, (1957) Information theory and statistical mechanics. Phys Rev 106: 620-630.
10. Jaynes ET, (1957) Information theory and statistical mechanics ii. Phys Rev 108: 171-190.
11. Shannon C, (1949) Communication in the presence of noise. Proc of the IRE 37: 10-21.
12. Cover TM, Thomas JA, (1991) Information theory. New York John Wiley & Sons, Inc.
13. Rieke F, Warland D, de Ruyter van Steveninck RR, Bialek W, (1997) Spikes: Exploring the neural code. Cambridge MIT Press.
14. Strong SP, Koberle R, de Ruyter van Steveninck RR, Bialek W, (1998) Entropy and information in neural spike trains. Phys Rev Lett 80: 197-200.
15. de Boer E, Kuyper P, (1968) Triggered correlation. IEEE Trans Biomed Eng 15: 169-179.
16. Victor J, Shapley R, (1980) A method of nonlinear analysis in the frequency domain. Biophys J 29: 459-483.
17. Meister M, Berry MJ, (1999) The neural code of the retina. Neuron 22: 435-450.
18. Chichilnisky EJ, (2001) A simple white noise analysis of neuronal light responses. Network: Comput Neural Syst 12: 199-213.
19. de Ruyter van Steveninck RR, Bialek W, (1988) Real-time performance of a movement-sensitive neuron in the blowfly visual system: coding and information transfer in short spike sequences. Proc R Soc Lond B 265: 259-265.
20. Bialek W, de Ruyter van Steveninck RR, (2005) Features and dimensions: Motion estimation in fly vision. Q-bio/ 0505003.
21. Pillow J, Simoncelli EP, (2006) Dimensionality reduction in neural models: An information-theoretic generalization of spike-triggered average and covariance analysis. J Vis 6: 414-428.
22. Schwartz O, Pillow J, Rust N, Simoncelli EP, (2006) Spike-triggered neural characterization. J Vis 176: 484-507.
23. Landau LD, Lifshitz EM, (1959) Statistical Physics. Oxford Pergamon Press.
24. Dayan P, Abbott LF, (2001) Theoretical neuroscience: computational and mathematical modeling of neural systems. Cambridge MIT Press.
25. Kauffman SA, (1969) Metabolic stability and epigenesis in randomly constructed genetic nets. J Theoret Biol 22: 437-467.
26. Schneidman E, Still S, Berry MJ, Bialek W, (2003) Network information and connected correlations. Phys Rev Lett 91: 238701.
27. Fairhall AL, Burlingame CA, Narasimhan R, Harris RA, Puchalla JL, et al. (2006) Selectivity for multiple stimulus features in retinal ganglion cells. J Neurophysiol 96: 2724-2738.
28. Rust NC, Schwartz O, Movshon JA, Simoncelli EP, (2005) Spatiotemporal elements of macaque v1 receptive fields. Neuron 46: 945-956.
29. Sincich LC, Horton JC, Sharpee TO, (2009) Preserving information in neural transmission. J Neurosci 29: 6207-6216.
30. Chen X, Han F, Poo MM, Dan Y, (2007) Excitatory and suppressive receptive field subunits in awake monkey primary visual cortex (v1). Proc Natl Acad Sci USA 104: 19120-5.
31. Atencio CA, Sharpee TO, Schreiner CE, (2008) Cooperative nonlinearities in auditory cortical neurons. Neuron 58: 956-966.
32. Maravall M, Petersen RS, Fairhall A, Arabzadeh E, Diamond M, (2007) Shifts in coding properties and maintenance of information transmission during adaptation in barrel cortex. PLoS Biol 5: e19.
33. Hong S, Arcas BA, Fairhall AL, (2007) Single neuron computation: from dynamical system to feature detector. Neural Comput 112: 3133-3172.
34. Ruderman DL, Bialek W, (1994) Statistics of natural images: scaling in the woods. Phys Rev Lett 73: 814-817.
35. van Hateren JH, (1997) Processing of natural time series of intensities by the visual system of the blowfly. Vision Res 37: 3407-3416.
36. Simoncelli EP, Olshausen BA, (2001) Natural image statistics and neural representation. Annu Rev Neurosci 24: 1193-1216.
37. Sharpee T, Rust N, Bialek W, (2004) Analyzing neural responses to natural signals: Maximally informative dimensions. Neural Computation 16: 223-250.
38. Chubb C, Econopouly J, Landy MS, (1994) Histogram contrast analysis and the visual segregation of iid textures. J Opt Soc Am A 11: 2350-2374.
39. Chubb C, Landy MS, Econopouly J, (2004) A visual mechanism tuned to black. Vision Research 44: 3223-3232.
40. Tkačik G, Prentice JS, Victor JD, Balasubramanian V, (2010) Local statistics in natural scenes predict the saliency of synthetic textures. Proc Natl Acad Sci USA 107: 18149-18154.
41. Theunissen FE, Miller JP, (1995) Temporal encoding in nervous systems: a rigorous definition. J Comput Neurosci 2: 149-162.
42. Brenner N, Strong SP, Koberle R, Bialek W, de Ruyter van Steveninck RR, (2000) Synergy in a neural code. Neural Computation 12: 1531-1552.
43. Narayan R, Nityananda R, (1986) Maximum entropy image restoration in astronomy. Ann Rev Astron Astrophys 24: 127-170.
44. Victor JD, Johannesma P, (1986) Maximum-entropy approximations of stochastic nonlinear transductions: an extension of the wiener theory. Biol Cybern 54: 289-300.
45. Schneidman E, Berry MJ, Segev R, Bialek W, (2006) Weak pairwise correlations imply strongly correlated network states in a neural population. Nature 440: 1007-1012.
46. Shlens J, Field GD, Gauthier JL, Grivich MI, Petrusca D, et al. (2006) The structure of multi-neuron firing patterns in primate retina. J Neurosci 26: 8254-8266.
47. Tang A, Jackson D, Hobbs J, Chen W, Smith JL, et al. (2008) A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. J Neurosci 28: 505-518.
48. Roudi Y, Tyrcha J, Hertz J, (2009) Ising model for neural data: model quality and approximate methods for extracting functional connectivity. Phys Rev E 79: 051915.
49. Roudi Y, Aurell E, Hertz J, (2009) Statistical physics of pairwise probability models. Front in Comp Neuro 3: 22.
50. Roudi Y, Nirenberg S, Latham PE, (2009) Pairwise maximum entropy models for studying large biological systems: When they can work and when they can't. PLoS Comput Biol 5: e1000380.
51. Malouf R, (2002) A comparison of algorithms for maximum entropy parameter estimation. Proceedings of the Conference on Natural Language Learning pp. 49-55.
52. Berger AL, Pietra SAD, Pietra VJD, (1996) A maximum entropy approach to natural language processing. Computational Linguistics 22: 39-71.
53. Berger T, (1971) Rate distortion theory: Mathematical basis for data compression. New Jersey Prentice Hall.
54. Tishby N, Pereira FC, Bialek W, (1999) The information bottleneck method. Proceedings of the 37-th Annual Allerton Conference on Communication, Control and Computing pp. 368-377.
55. Li Z, (2006) Theoretical understanding of the early visual processes by data compression and data selection. Network: Computation in neural systems 17: 301-334.
56. Laughlin SB, (1981) A simple coding procedure enhances a neuron's information capacity. Z Naturf 36c: 910-912.
57. Sharpee TO, Bialek W, (2007) Neural decision boundaries for maximal information transmission. PLoS One 2: e646.
58. Fitzgerald JD, Sharpee TO, (2009) Maximally informative pairwise interactions in networks. Phys Rev E 80: 031914.
59. Nikitin AP, Stocks NG, Morse RP, McDonnell MD, (2009) Neural population coding is optimized by discrete tuning curves. Phys Rev Lett 103: 138101.
60. Sincich LC, Adams DL, Economides JR, Horton JC, (2007) Transmission of spike trains at the retinogeniculate synapse. J Neurosci 27: 2683-2692.