Synergy, redundancy, and independence in population codes, revisited

Journal of Neuroscience

Volumn 25, Issue 21, 2005, Pages 5195-5206

  Latham, Peter E ^a   Nirenberg, Sheila ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Decoding; Encoding; Information theory; Neural code; Noise correlations; Population coding; Retina; Signal correlations

Indexed keywords

ALGORITHM; ARTICLE; CELL POPULATION; CORRELATION ANALYSIS; MATHEMATICAL ANALYSIS; NERVE CELL NETWORK; NEUROSCIENCE; PRIORITY JOURNAL; VALIDATION PROCESS;

ACTION POTENTIALS; ANIMALS; HUMANS; MODELS, NEUROLOGICAL; NEURONS; STATISTICS;

EID: 19544382559     PISSN: 02706474     EISSN: None     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.5319-04.2005     Document Type: Article

References (50)

1. Abbott LF, Dayan P (1999) The effect of correlated variability on the accuracy of a population code. Neural Comput 11:91-101.
2. Atick JJ (1992) Could information theory provide an ecological theory of sensory processing? Network 3:213-251.
3. Atick JJ, Redlich AN (1990) Towards a theory of early visual processing. Neural Comput 2:308-320.
4. Attneave F (1954) Informational aspects of visual perception. Psychol Rev 61:183-193.
5. Averbeck BB, Lee D (2003) Neural noise and movement-related codes in the macaque supplementary motor area. J Neurosci 23:7630-7641.
6. Averbeck BB, Lee D (2004) Coding and transmission of information by neural ensembles. Trends Neurosci 27:225-230.
7. Averbeck BB, Crowe DA, Chafee MV, Georgopoulos AP (2003) Neural activity in prefrontal cortex during copying geometrical shapes. II. Decoding shape segments from neural ensembles. Exp Brain Res 150:142-153.
8. Barlow H (1961) The coding of sensory messages. In: Current problems in animal behavior (Thorpe WH, Zangwill OL, eds), pp 331-361. Cambridge, MA: Cambridge UP.
9. Barlow H (2001) Redundancy reduction revisited. Network 12:241-253.
10. Brenner N, Strong SP, Koberle R, Bialek W, de Ruyter van Steveninck RR (2000) Synergy in a neural code. Neural Comput 12:1531-1552.
11. Cover TM, Thomas JA (1991) Elements of information theory. New York: Wiley.
12. Dan Y, Alonso JM, Usrey WM, Reid RC (1998) Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus. Nat Neurosci 1:501-507.
13. deCharms RC, Merzenich MM (1996) Primary cortical representation of sounds by the coordination of action-potential timing. Nature 381:610-613.
14. Dembo A, Zeitouni O (1993) Large deviation techniques and applications. New York: Springer.
15. Eckhorn R, Bauer R, Jordan W, Brosch M, Kruse W, Munk M, Reitboeck HJ (1988) Coherent oscillations: a mechanism of feature linking in the visual cortex? Multiple electrode and correlation analyses in the cat. Biol Cybern 60:121-130.
16. Gawne TJ, Richmond BJ (1993) How independent are the messages carried by adjacent inferior temporal cortical neurons? J Neurosci 13:2758-2771.
17. Golledge HD, Panzeri S, Zheng F, Pola G, Scannell J, Giannikopoulos DV, Mason RJ, Tovee MJ, Young MP (2003) Correlations, feature-binding and population coding in primary visual cortex. NeuroReport 14:1045-1050.
18. Gray CM, Singer W (1989) Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. Proc Natl Acad SCi USA 86:1698-1702.
19. Gray CM, Konig P, Engel AK, Singer W (1989) Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature 338:334-337.
20. Hoeffding W (1963) Probability inequalities for sums of bounded random variables. J Am Stat Assoc 58:13-30.
21. Levine MW, Castaldo K, Kasapoglu MB (2002) Firing coincidences between neighboring retinal ganglion cells: inside information or epiphenomenon? Biosystems 67:139-146.
22. Liu RC, Tzonev S, Rebrik S, Miller KD (2001) Variability and information in a neural code of the cat lateral geniculate nucleus. J Neurophysiol 86:2789-2806.
23. Machens CK, Stemmler MB, Prinz P, Krahe R, Ronacher B, Herz AV (2001) Representation of acoustic communication signals by insect auditory receptor neurons. J Neurosci 21:3215-3227.
24. Meister M, Lagnado L, Baylor DA (1995) Concerted signaling by retinal ganglion cells. Science 270:1207-1210.
25. Merhav N, Kaplan G, Lapidoth A, Shamai Shitz S (1994) On information rates for mismatched decoders. IEEE Trans Inform Theory 40:1953-1967.
26. Nemenman I, Bialek W, de Ruyter van Steveninck R (2004) Entropy and information in neural spike trains: progress on the sampling problem. Phys Rev E Stat Nonlin Soft Matter Phys 69:056111.
27. Nirenberg S, Latham PE (1998) Population coding in the retina. Curr Opin Neurobiol 8:488-493.
28. Nirenberg S, Latham PE (2003) Decoding neuronal spike trains: how important are correlations? Proc Natl Acad SCi USA 100:7348-7353.
29. Nirenberg S, Carcieri SM, Jacobs AL, Latham PE (2001) Retinal ganglion cells act largely as independent encoders. Nature 411:698-701.
30. Oram MW, Hatsopoulos NG, Richmond BJ, Donoghue JP (2001) Excess synchrony in motor cortical neurons provides redundant direction information with that from coarse temporal measures. J Neurophysiol 86:1700-1716.
31. Osborne LC, Bialek W, Lisberger SG (2004) Time course of information about motion direction in visual area MT of macaque monkeys. J Neurosci 24:3210-3222.
32. Paninski L (2003) Estimation of entropy and mutual information. Neural Comput 15:1191-1253.
33. Paninski L (2004) Estimating entropy on m bins given fewer than m samples. IEEE Trans Inform Theory 50:2200-2203.
34. Panzeri S, Treves A, Schultz S, RoLLs ET (1999) On decoding the responses of a population of neurons from short time windows. Neural Comput 11:1553-1577.
35. Panzeri S, Golledge HDR, Zheng F, TovÉe MJ, Young MP (2001) Objective assessment of the functional role of spike train correlations using information measures. Vis Cogn 8:531-547.
36. Panzeri S, Golledge HDR, Zheng F, PoLa G, Blanche TJ, TovÉe MJ, Young MP (2002a) The role of correlated firing and synchrony in coding information about single and separate objects in cat V1. Neurocomputing 44-46:579-584.
37. Panzeri S, Pola G, Petroni F, Young MP, Petersen RS (2002b) A critical assessment of different measures of the information carried by correlated neuronal firing. Biosystems 67:177-185.
38. Petersen RS, Panzeri S, Diamond ME (2001) Population coding of stimulus location in rat somatosensory cortex. Neuron 32:503-514.
39. Petersen RS, Panzeri S, Diamond ME (2002) Population coding in somatosensory cortex. Curr Opin Neurobiol 12:441-447.
40. Pola G, Thiele A, Hoffmann KP, Panzeri S (2003) An exact method to quantify the information transmitted by different mechanisms of correlational coding. Network 14:35-60.
41. Sanov IN (1957) On the probability of large deviations of random variables. Mat Sbornik 42:11-44.
42. Schneidman E, Bialek W, Berry MJ (2003) Synergy, redundancy, and independence in population codes. J Neurosci 23:11539-11553.
43. Shannon CE, Weaver W (1949) The mathematical theory of communication. Urbana, IL: University of Illinois.
44. Sompolinsky H, Yoon H, Kang K, Shamir M (2001) Population coding in neuronal systems with correlated noise. Phys Rev E Stat Nonlin Soft Matter Phys [Erratum 2002 65(4 Pt 2B)] 64:051904.
45. Srinivasan MV, Laughlin SB, Dubs A (1982) Predictive coding: a fresh view of inhibition in the retina. Proc R Soc Lond B Biol Sci 216:427-459.
46. Steinmetz PN, Roy A, Fitzgerald PJ, Hsiao SS, Johnson KO, Niebur E (2000) Attention modulates synchronized neuronal firing in primate somatosensory cortex. Nature 404:187-190.
47. Vaadia E, Haalman I, Abeles M, Bergman H, Prut Y, Slovin H, Aertsen A (1995) Dynamics of neuronal interactions in monkey cortex in relation to behavioural events. Nature 373:515-518.
48. Wu S, Nakahara H, Murata N, Amari S (2000) Population decoding based on an unfaithful model. Advances in neural information processing systems, pp 167-173. Cambridge, MA: MIT.
49. Wu S, Nakahara H, Amari S (2001) Population coding with correlation and an unfaithful model. Neural Comput 13:775-797.
50. Wu S, Amari S, Nakahara H (2002) Population coding and decoding in a neural field: a computational study. Neural Comput 14:999-1026.