Information theoretic approaches to understanding circuit function

Current Opinion in Neurobiology

Volumn 22, Issue 4, 2012, Pages 653-659

  Fairhall, Adrienne ^a   Shea Brown, Eric ^a   Barreiro, Andrea ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b SOUTHERN METHODIST UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN FUNCTION; COMPUTER PREDICTION; CONCEPTUAL FRAMEWORK; CORRELATIONAL STUDY; ENTROPY; KERNEL METHOD; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NEUROTRANSMISSION; PRIORITY JOURNAL; RECEPTIVE FIELD; REVIEW; SENSORY STIMULATION; STIMULUS RESPONSE; THEORETICAL STUDY;

ANIMALS; BRAIN; HUMANS; INFORMATION THEORY; MODELS, NEUROLOGICAL; NERVE NET; NEURONS; PROBABILITY;

EID: 84865977524     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2012.06.005     Document Type: Review

References (54)

1. Cover T.M., Thomas J.A. Information Theory 1991, John Wiley & Sons, Inc., New York.
2. Nemenman I., Bialek W., de Ruyter van Steveninck R. Entropy and information in neural spike trains: progress on the sampling problem. Phys Rev E Stat Nonlinear Soft Matter Phys 2004, 69:56111.
3. Ince R.A., Senatore R., Arabzadeh E., Montani F., Diamond M.E., Panzeri S. Information-theoretic methods for studying population codes. Neural Netw 2010, 23:713-727.
4. Quian Quiroga R., Panzeri S. Extracting information from neural populations: information theory and decoding approaches. Nat Rev Neurosci 2009, 10:173-185.
5. Reinagel P., Reid R.C. Temporal coding of visual information in the thalamus. J Neurosci 2000, 20:5392-5400.
6. Nemenman I., Lewen G.D., Bialek W., de Ruyter van Steveninck R.R. Neural coding of natural stimuli: information at sub-millisecond resolution. PLoS Comput Biol 2008, 4:e1000025.
7. Arabzadeh E., Panzeri S., Diamond M.E. Whisker vibration information carried by rat barrel cortex neurons. J Neurosci 2004, 24:6011-6020.
8. Belitski A., Panzeri S., Magri C., Logothetis N.K., Kayser C. Sensory information in local field potentials and spikes from visual and auditory cortices: time scales and frequency bands. J Comput Neurosci 2010, 29:533-545.
9. Fairhall A.L., Lewen G.D., Bialek W., de Ruyter Van Steveninck R.R. Efficiency and ambiguity in an adaptive neural code. Nature 2001, 412:787-792.
10. Panzeri S., Brunel N., Logothetis N.K., Kayser C. Sensory neural codes using multiplexed temporal scales. Trends Neurosci 2010, 33:111-120.
11. Schneidman E., Still S., Berry M., Bialek W. Network information and connected correlations. Phys Rev Lett 2003, 91:238701.
12. Schneidman E., Bialek W., Berry M.J. Synergy, redundancy, and independence in population codes. J Neurosci 2003, 23:11539-11553.
13. Barlow H.B. Possible principles underlying the transformation of sensory messages. Sensory Communication 1961, MIT Press, Cambridge, MA. W. Rosenblith (Ed.).
14. Attneave F. Some informational aspects of visual perception. Psychol Rev 1954, 61:183-193.
15. Srinivasan M.V., Laughlin S.B., Dubs A. Predictive coding: a fresh view of inhibition in the retina. Proc R Soc Lond B Biol Sci 1982, 216:427-459.
16. Atick Could information theory provide an ecological theory of sensory processing?. Network 1992, 3:213-252.
17. Puchalla J.L., Schneidman E., Harris R.A., Berry M.J. Redundancy in the population code of the retina. Neuron 2005, 46:493-504.
18. Pitkow X., Meister M. Decorrelation and efficient coding by retinal ganglion cells. Nat Neurosci 2012, 15:628-635.
19. Fairhall A.L., Burlingame C.A., Narasimhan R., Harris R.A., Puchalla J.L., Berry M.J. Selectivity for multiple stimulus features in retinal ganglion cells. J Neurophysiol 2006, 96:2724-2738.
20. Schwartz O., Pillow J.W., Rust N.C., Simoncelli E.P. Spike-triggered neural characterization. J Vis 2006, 6:484-507.
21. Sharpee T., Rust N.C., Bialek W. Analyzing neural responses to natural signals: maximally informative dimensions. Neural Comput 2004, 16:223-250.
22. Pillow J.W., Simoncelli E.P. Dimensionality reduction in neural models: an information-theoretic generalization of spike-triggered average and covariance analysis. J Vis 2006, 6:414-428.
23. Simoncelli E.P., Olshausen B.A. Natural image statistics and neural representation. Annu Rev Neurosci 2001, 24:1193-1216.
24. Sharpee T.O., Sugihara H., Kurgansky A.V., Rebrik S.P., Stryker M.P., Miller K.D. Adaptive filtering enhances information transmission in visual cortex. Nature 2006, 439:936-942.
25. Sincich L.C., Horton J.C., Sharpee T.O. Preserving information in neural transmission. J Neurosci 2009, 29:6207-6216.
26. Atencio C.A., Sharpee T.O., Schreiner C.E. Receptive field dimensionality increases from the auditory midbrain to cortex. J Neurophysiol 2012, 107:2594-2603.
27. Schneidman E., Berry M.J., Segev R., Bialek W. Weak pairwise correlations imply strongly correlated network states in a neural population. Nature 2006, 440:1007-1012. 10.1038/nature04701.
28. Pillow J., Shlens J., Paninski L., Sher A., Litke A., Chichilnisky E.J., Simoncelli E.P. Spatiotemporal correlations and visual signaling in a complete neuronal population. Nature 2008, 454:995-999.
29. Ganmor E., Segev R., Schneidman E. Sparse low-order interaction network underlies a highly correlated and learnable neural population code. Proc Natl Acad Sci USA 2011, 108:9679-9684.
30. Abbott L., Dayan P. The effect of correlated variability on the accuracy of a population code. Neural Comput 1999, 11:91-101.
31. Averbeck B.B., Lee D. Effects of noise correlations on information encoding and decoding. J Neurophysiol 2006, 95:3633-3644. 10.1152/jn.00919.2005.
32. Shlens J., Field G., Gauthier J., Grivich M., Petrusca D., Sher A., Litke A.M., Chichilnisky E.J. The structure of multi-neuron firing patterns in primate retina. J Neurosci 2006, 26:8254.
33. Tang A., Jackson D., Hobbs J., Chen W., Smith J.L., Patel H., Prieto A., Petrusca D., Grivich M.I., Sher A., et al. A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. J Neurosci 2008, 28:505-518.
34. Montani F., Ince R.A., Senatore R., Arabzadeh E., Diamond M.E., Panzeri S. The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex. Philos Trans A Math Phys Eng Sci 2009, 367:3297-3310.
35. Globerson A., Stark E., Vaadia E., Tishby N. The minimum information principle and its application to neural code analysis. Proc Natl Acad Sci USA 2009, 106:3490-3495.
36. Fitzgerald J.D., Sincich L.C., Sharpee T.O. Minimal models of multidimensional computations. PLoS Comput Biol 2011, 7:e1001111.
37. Fitzgerald J.D., Rowekamp R.J., Sincich L.C., Sharpee T.O. Second order dimensionality reduction using minimum and maximum mutual information models. PLoS Comput Biol 2011, 7:e1002249.
38. Fairhall A.L., Burlingame C.A., Puchalla J., Harris R., Berry M.J. Feature selectivity in retinal ganglion cells. J Neurophysiol 2006, 96:2724-2738.
39. Tishby N., Pereira F.C., Bialek W. The information bottleneck method. Proceedings of the 37-th Annual Allerton Conference on Communication, Control and Computing 1999, 368-377.
40. Latham P., Nirenberg S. Synergy, redundancy, and independence in population codes, revisited. J Neurosci 2005, 25:5195.
41. Oizumi M., Ishii T., Ishibashi K., Okada M. Mismatched decoding in the brain. J Neurosci 2010, 30:4815-4826.
42. Shlens J., Field G.D., Gauthier J.L., Greschner M., Sher A., Litke A.M., Chichilnisky E.J. The structure of large-scale synchronized firing in primate retina. J Neurosci 2009, 29:5022-5031.
43. Roudi Y., Nirenberg S., Latham P.E. Pairwise maximum entropy models for studying large biological systems: when they can work and when they can't. PLoS Comput Biol 2009, 5:e1000380.
44. Roudi Y., Tyrcha J., Hertz J. Ising model for neural data: model quality and approximate methods for extracting functional connectivity. Phys Rev E 2009, 79:051915.
45. Macke J.H., Opper M., Bethge M. Common input explains higher-order correlations and entropy in a simple model of neural population activity. Phys Rev Lett 2011, 106:208102.
46. Yu Y., Yang H., Nakahara H., Sanstos G.S., Nikolić D., Plenz D. Higher-order interactions characterized in cortical activity. J Neurosci 2011, 31:17514-17526.
47. Truccolo W., Eden U.T., Fellows M.R., Donoghue J.P., Brown E.N. A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. J Neurophysiol 2005, 93:1074-1089.
48. Vidne M., Ahmadian Y., Shlens J., Pillow J.W., Kulkarni J., Litke A.M., Chichilnisky E.J., Simoncelli E., Paninski L. Modeling the impact of common noise inputs on the network activity of retinal ganglion cells. J Comp Neurosci 2011, [online only at present]. 10.1007/s10827-011-0376-2.
49. Series P., Latham P., Pouget A. Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations. Nat Neurosci 2004, 7:1129-1135.
50. Wark B., Lundstrom B.N., Fairhall A. Sensory adaptation. Curr Opin Neurobiol 2007, 17:423-429.
51. Vergassola M., Villermaux E., Shraiman B.I. 'Infotaxis' as a strategy for searching without gradients. Nature 2007, 445:406-409.
52. Agarwala Chiel H., Thomas P. Pursuit of food versus pursuit of information in a Markovian perception-action loop model of foraging. J Theor Biol 2012, 304:235-272.
53. Renninger L.W., Verghese P., Coughlan J. Where to look next? Eye movements reduce local uncertainty. J Vis 2007, 7:6.
54. Najemnik J., Geisler W.S. Eye movement statistics in humans are consistent with an optimal search strategy. J Vis 2008, 8. 4.1-14.