Extracting information from neuronal populations: Information theory and decoding approaches

Nature Reviews Neuroscience

Volumn 10, Issue 3, 2009, Pages 173-185

  Quian Quiroga, Rodrigo ^a   Panzeri, Stefano ^b,c  

^a UNIVERSITY OF LEICESTER   (United Kingdom)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^c UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ATTENTION; BEHAVIOR; CELL FUNCTION; CELL POPULATION; CODING; DECODING APPROACH; FUNCTIONAL MAGNETIC RESONANCE IMAGING; IMAGING SYSTEM; INFORMATION SCIENCE; MATHEMATICAL ANALYSIS; NERVE CELL; NERVE POTENTIAL; NEUROPHYSIOLOGY; PRIORITY JOURNAL; REVIEW; SIGNAL NOISE RATIO; SPIKE WAVE;

ACTION POTENTIALS; ALGORITHMS; ANIMALS; BRAIN; HUMANS; INFORMATION THEORY; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; NEUROPHYSIOLOGY; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 60549113334     PISSN: 1471003X     EISSN: 14710048     Source Type: Journal    
DOI: 10.1038/nrn2578     Document Type: Review

References (125)

1. Hubel, D. Tungsten microelectrode for recording from single units. Science 125, 549-550 (1957).
2. Kandel, E. R., Schwartz, J. H. & Jessell, T. M. Principles of neural Science (McGraw Hill, New York, 2000).
3. Schwartz, A. B. Cortical neural prosthetics. Annu. Rev. neurosci. 27, 487-507 (2004).
4. Buzsaki, G. Large-scale recording of neuronal ensembles. nature neurosci. 7, 446-451 (2004).
5. Csicsvari, J. et al. Massively parallel recording of unit and local field potentials with silicon-based electrodes. J. neurophysiol. 90, 1314-1323 (2003).
6. Kelly, R. C. et al. Comparison of recordings from microelectrode arrays and single electrodes in the visual cortex. J. neurosci. 27, 261-264 (2007).
7. Rousche, P. J. & Normann, R. A. Chronic recording capability of the Utah intracortical electrode in cat sensory cortex. J. neurosci. Methods 82, 1-15 (1998).
8. Blanche, T. J., Spacek, M. A., Hetke, J. F. & Swindale, N. V. Polytrodes: high-density silicon electrode arrays for large-scale multiunit recording. J. neurophysiol. 93, 2987-3000 (2005).
9. Brown, E. N., Kass, R. E. & Mitra, P. P. Multiple neural spike train data analysis: state-of-the-art and future challenges. nature neurosci. 7, 456-461 (2004).
10. Abbott, L. F. Decoding neuronal firing and modelling neural networks. Q. Rev. Biophys. 27, 291-331 (1994).
11. Pouget, A., Dayan, P. & Zemel, R. Information processing with population codes. nature Rev. neurosci. 1, 125-132 (2000).
12. Rieke, F., Warland, D., de Ruyter van Steveninck, R. R. & Bialek, W. Spikes: Exploring the neural Code (MIT Press, Cambridge, Massachusetts, 1997).
13. Oram, M. W., Foldiak, P., Perrett, D. I. & Sengpiel, F. The 'ideal homunculus': decoding neural population signals. Trends neurosci. 21, 259-265 (1998).
14. Dayan, P. & Abbott, L. F. Theoretical neuroscience: Computational and Mathematical Modeling of neural Systems (MIT Press, Cambridge, Massachusetts, 2001).
15. Shannon, C. E. A mathematical theory of communication. Bell Syst. Tech. J. 27, 379-423 & 623-656 (1948).
16. Deco, G. & Obradovic, D. An Information-Theoretic Approach to neural Computing (Springer, Berlin, 1997).
17. Borst, A. & Theunissen, F. E. Information theory and neural coding. nature neurosci. 2, 947-957 (1999).
18. Quian Quiroga, R. Spike sorting. Scholarpedia 2, 3583 (2007). A short review describing the steps for processing neural data, basically focused on spike detection and sorting.
19. Quian Quiroga, R., Nadasdy, Z. & Ben-Shaul, Y. Unsupervised spike detection and sorting with wavelets and superparamagnetic clustering. neural Comput. 16, 1661-1687 (2004).
20. Lewicki, M. A review of methods for spike sorting: the detection and classification of neural action potentials. network 9, R53-R78 (1998).
21. Harris, K. D., Henze, D. A., Csicsvari, J., Hirase, H. & Buzsaki, G. Accuracy of tetrode spike separation as determined by simultaneous intracellular and extracellular measurements. J. neurophysiol. 84, 401-414 (2000).
22. Singer, W. & Gray, C. M. Visual feature integration and the temporal correlation hypothesis. Annu. Rev. neurosci. 18, 555-586 (1995).
23. Engel, A. K. & Singer, W. Temporal binding and the neural correlates of sensory awareness. Trends Cogn. Sci. 5, 16-25 (2001).
24. Quian Quiroga, R., Reddy, L., Kreiman, G., Koch, C. & Fried, I. Invariant visual representation by single neurons in the human brain. nature 435, 1102-1107 (2005).
25. Reich, D. S., Mechler, F. & Victor, J. D. Independent and redundant information in nearby cortical neurons. Science 294, 2566-2568 (2001).
26. Barlow, H. B., Hill, R. M. & Levick, W. R. Retinal ganglion cells responding selectively to direction and speed of image motion in the rabbit. J. Physiol. (Lond.) 173, 377-407 (1964).
27. MacKay, D. M. Information Theory, Inference, and Learning Algorithms (Cambridge Univ. Press, Cambridge, 2003).
28. Foldiak, P. in Computation and neural Systems (eds Eeckman, F. H. & Bower, J.) 55-60 (Kluwer, Norwell, Massachusetts, 1993).
29. Sanger, T. D. Probability density estimation for the interpretation of neural population codes. J. neurophysiol. 76, 2790-2793 (1996).
30. Paradiso, M. A. A theory for the use of visual orientation information which exploits the columnar structure of striate cortex. Biol. Cybern. 58, 35-49 (1988).
31. Duda, O. H., Hart, P. E. & Stork, D. G. Pattern Classification (Wiley & sons, New York, 2001).
32. Kjaer, T. W., Hertz, J. A. & Richmond, B. J. Decoding cortical neuronal signals: network models, information estimation and spatial tuning. J. Comp. neurosci. 1, 109-139 (1994).
33. Averbeck, B. B. in Coherent Behavior in neuronal networks (ed. Rubin, J., Matias, M. and Romo, R.) (Springer, New York, in the press).
34. Cover, T. M. & Thomas, J. A. Elements of Information Theory. (Wiley & sons, Hoboken, New Jersey, 2006).
35. Victor, J. D. Approaches to information-theoretic analysis of neural activity. Biol. Theory 1, 302-316 (2006).
36. Panzeri, S., Senatore, R., Montemurro, M. A. & Petersen, R. S. Correcting for the sampling bias problem in spike train information measures. J. neurophysiol. 98, 1064-1072 (2007).
37. Samengo, I. Information loss in an optimal maximum likelihood decoding. neural Comput. 14, 771-779 (2002).
38. Treves, A. On the perceptual structure of face space. Biosystems 40, 189-196 (1997). One of the first papers to analyse the information given by the confusion matrix, showing that the distribution of incorrect stimulus predictions is important for understanding neural representations. This work was later extended to the study of how incorrect stimulus predictions relate to the mutual information between stimuli and responses in reference 47.
39. Panzeri, S., Treves, A., Schultz, S. & Rolls, E. T. On decoding the responses of a population of neurons from short time windows. neural Comput. 11, 1553-1577 (1999).
40. Robertson, R. G., Rolls, E. T., Georges-Francois, P. & Panzeri, S. Head direction cells in the primate presubiculum. Hippocampus 9, 206-219 (1999).
41. Georgopoulos, A. P., Schwartz, A. B. & Kettner, R. E. Neuronal population coding of movement direction. Science 233, 1416-1419 (1986). The first study to implement a population analysis of neuronal responses by using a population vector.
42. Zhang, K., Ginzburg, I., McNaughton, B. L. & Sejnowski, T. J. Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J. neurophysiol. 79, 1017-1044 (1998).
43. Knill, D. C. & Pouget, A. The bayesian brain: the role of uncertainty in neural coding and computation. Trends neurosci. 27, 712-719 (2004).
44. Quian Quiroga, R., Reddy, L., Koch, C. & Fried, I. Decoding visual inputs from multiple neurons in the human temporal lobe. J. neurophysiol. 98, 1997-2007 (2007). This paper showed that it is possible to correctly predict picture presentations from the firing of neurons in the human medial temporal lobe far above chance. The authors also showed that more information can be extracted from a population analysis than from a single-cell study.
45. Victor, J. D. & Purpura, K. P. Nature and precision of temporal coding in visual cortex: a metric-space analysis. J. neurophysiol. 76, 1310-1326 (1996).
46. Schnupp, J. W. H., Hall, T. M., Kokelaar, R. F. & Ahmed, B. Plasticity of temporal pattern codes for vocalization stimuli in primary auditory cortex. J. neurosci. 26, 4785-4795 (2006).
47. Thomson, E. E. & Kristan, W. B. Quantifying stimulus discriminability: a comparison of information theory and ideal observer analysis. neural Comput. 17, 741-778 (2005).
48. Ma, W. J., Beck, J. M., Latham, P. E. & Pouget, A. Bayesian inference with probabilistic population codes. nature neurosci. 9, 1432-1438 (2006).
49. Beck, J. M. et al. Probabilistic population codes for Bayesian decision making. neuron 60, 1142-1152 (2008).
50. Averbeck, B. B., Sohn, J.-W. & Lee, D. Activity in prefrontal cortex during dynamic selection of action sequences. nature neurosci. 9, 276-282 (2006).
51. Pouget, A., Zhang, K., Deneve, S. & Latham, P. E. Statistically efficient estimation using population coding. neural Comput. 10, 373-401 (1998).
52. Sahani, M. & Dayan, P. Doubly distributional population codes: simultaneous representation of uncertainty and multiplicity. neural Comput. 15, 2255-2279 (2003).
53. Pouget, A., Zemel, R. & Dayan, P. Inference and computation with population code. Annu. Rev. neurosci. 26, 381-410 (2003).
54. Victor, J. D. & Nirenberg, S. Indices for testing neural codes. neural Comput. 20, 2895-2936 (2008). The authors analysed in detail the relative strengths and weaknesses of information theory and Bayesian decoders when they are used to rule out neural codes. They also introduced a set of measures that varied smoothly between information theory and Bayesian decoders.
55. Andersen, R. A. & Buneo, C. A. Intentional maps in the posterior parietal cortex. Annu. Rev. neurosci. 25, 189-220 (2002).
56. Mountcastle, V. B., Lynch, J. C., Georgopoulos, A., Sakata, H. & Acuna, C. Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. J. neurophysiol. 38, 871-908 (1975).
57. Andersen, R. A., Essick, G. K. & Siegel, R. M. Neurons of area 7 activated by both visual stimuli and oculomotor behavior. Exp. Brain Res. 67, 316-322 (1987).
58. Snyder, L. H., Batista, A. P. & Andersen, R. A. Coding of intention in the posterior parietal cortex. nature 386, 167-170 (1997).
59. Bisley, J. W. & Goldberg, M. E. Neuronal activity in the lateral intraparietal area and spatial attention. Science 299, 81-81 (2003).
60. Robinson, D. L., Goldberg, M. E. & Stanton, G. B. Parietal association cortex in the primate: sensory mechanisms and behavioral modulations. J. neurophysiol. 41, 910-932 (1978).
61. Quian Quiroga, R., Snyder, L. H., Batista, A. P., Cui, H. & Andersen, R. A. Movement intention is better predicted than attention in the posterior parietal cortex. J. neurosci. 26, 3615-3620 (2006). Using a decoding population analysis, the authors showed that neurons in the posterior parietal cortex encode different movement plans and not just attention to target location.
62. Musallam, S., Corneil, B., Greger, B., Scherberger, H. & Andersen, R. A. Cognitive control signals for neural prosthetics. Science 305, 258-262 (2004).
63. Pesaran, B., Pezaris, J., Sahani, M., Mitra, P. M. & Andersen, R. A. Temporal structure in neuronal activity during working memory in macaque parietal cortex. nature neurosci. 5, 805-811 (2002).
64. Scherberger, H., Jarvis, M. & Andersen, R. A. Cortical local field potential encodes movement intentions in the posterior parietal cortex. neuron 46, 347-354 (2005).
65. Wessberg, J. et al. Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. nature 408, 361-365 (2000).
66. Andersen, R. A., Burdick, J. W., Musallam, S., Pesaran, B. & Cham, J. G. Cognitive neural prosthetics. Trends Cogn. Sci. 8, 486-493 (2004).
67. Nicolelis, M. A. Actions from thoughts. nature 409, 403-407 (2001).
68. Stopfer, M., Jayaraman, V. & Laurent, G. Intensity versus identity coding in an olfactory system. neuron 39, 991-1004 (2003).
69. Arabzadeh, E., Panzeri, S. & Diamond, M. E. Whisker vibration information carried by rat barrel cortex neurons. J. neurosci. 24, 6011-6020 (2004).
70. Adrian, E. D. The Basis of Sensations (Norton, New York, 1928).
71. Optican, L. M. & Richmond, B. J. Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. J. neurophysiol. 57, 162-178 (1987). The first study to demonstrate that the time profile of cortical spike trains encodes much more information about static visual features than spike counts.
72. de Ruyter van Steveninck, R. R., Lewen, G. D., Strong, S. P. & Koberle, R. Reproducibility and variability in neural spike trains. Science 275, 1805-1808 (1997).
73. Hopfield, J. J. Pattern recognition computation using action potential timing for stimulus representation. nature 376, 33-36 (1995).
74. Theunissen, F. & Miller, J. P. Temporal encoding in nervous systems: a rigorous definition. J. Comp. neurosci. 2, 149-162 (1995).
75. Victor, J. D. Temporal aspects of neural coding in the retina and lateral geniculate. network 10, R1-R66 (1999).
76. Panzeri, S., Petersen, R. S., Schultz, S. R., Lebedev, M. & Diamond, M. E. The role of spike timing in the coding of stimulus location in rat somatosensory cortex. neuron 29, 769-777 (2001).
77. Reinagel, P. & Clay Reid, R. Temporal coding of visual information in the thalamus. J. neurosci. 20, 5392-5400 (2000).
78. Berry, M. J., Warland, D. K. & Meister, M. The structure and precision of retinal spike trains. Proc. natl Acad. Sci. USA 94, 5411-5416 (1997).
79. Engineer, C. T. et al. Cortical activity patterns predict speech discrimination ability. nature neurosci. 11, 603-608 (2008).
80. Shadlen, M. N. & Movshon, J. A. Synchrony unbound: a critical evaluation of the temporal binding hypothesis. neuron 24, 67-77; 111-125 (1999).
81. Huxter, J. R., Senior, T. J., Allen, K. & Csicsvari, J. Theta phase-specific codes for two-dimensional position, trajectory and heading in the hippocampus. nature neurosci. 11, 587-594 (2008). The authors recorded spiking activity and local field oscillations in the hippocampus of rats moving through a two-dimensional environment. Using a decoding analysis, they demonstrated that spikes emitted at different oscillation phases represent complementary aspects of the animal's trajectory.
82. Huxter, J. R., Burgess, N. & O'Keefe, J. Independent rate and temporal coding in hippocampal pyramidal cells. nature 425, 828-832 (2003).
83. Buracas, G. T., Zador, A., DeWeese, M. & Albright, T. Efficient encoding of rapidly varying stimuli by motion-sensitive neurons in MT of alert monkeys. neuron 20, 959-969 (1998).
84. Kara, P., Reinagel, P. & Clay Reid, R. Low response variability in simultaneously recorded retinal, thalamic, and cortical neurons. neuron 27, 635-646 (2000).
85. Theunissen, F. E. From synchrony to sparseness. Trends neurosci. 26, 61-64 (2003).
86. Perez-Orive, J. et al. Oscillations and sparsening of odor representations in the mushroom body. Science 297, 359-365 (2002).
87. Hahnloser, R. H. R., Kozhevnikov, A. A. & Fee, M. S. An ultra-sparse code underlies the generation of neural sequences in a songbird. nature 419, 65-70 (2002).
88. Salinas, E., Hernandez, A., Zainos, A. & Romo, R. Periodicity and firing rate as candidate neural codes for the frequency of vibrotactile stimuli. J. neurosci. 20, 5503-5515 (2000).
89. Arabzadeh, E., Panzeri, S. & Diamond, M. E. Deciphering the spike train of a sensory neuron: counts and temporal patterns in the rat whisker pathway. J. neurosci. 26, 9216-9226 (2006). This paper developed an analytical formalism that quantifies how much sensory information can be extracted from the spike times when the stimulus time is not known precisely.
90. Reich, D. S., Mechler, F. & Victor, J. D. Temporal coding of contrast in primary visual cortex: when, what, and why. J. neurophysiol. 85, 1039-1050 (2001).
91. Gawne, T. J., Kjaer, T. W. & Richmond, B. J. Latency: another potential code for feature binding in striate cortex. J. neurophysiol. 76, 1356-1360 (1996).
92. Muller, J. R., Metha, A. B., Krauskopf, J. & Lennie, P. Information conveyed by onset transients in responses of striate cortical neurons. J. neurosci. 21, 6978-6990 (2001).
93. Ahrens, K. F. & Kleinfeld, D. Current flow in vibrissa motor cortex can phase-lock with exploratory rhythmic whisking in rat. J. neurophysiol. 92, 1700-1707 (2004).
94. Abbott, L. F. & Dayan, P. The effect of correlated variability on the accuracy of a population code. neural Comput. 11, 91-101 (1999).
95. Averbeck, B. B., Latham, P. E. & Pouget, A. Neural correlations, population coding and computation. nature Rev. neurosci. 7, 358-366 (2006). An up-to-date and comprehensive review of the role of noise correlations in population coding.
96. Nirenberg, S. & Latham, P. E. Decoding neuronal spike trains: how important are correlations? Proc. natl Acad. Sci. USA 100, 7348-7353 (2003).
97. Salinas, E. & Sejnowski, T. J. Correlated neuronal activity and the flow of neural information. nature Rev. neurosci. 2, 539-550 (2001).
98. Zohary, E., Shadlen, M. & Newsome, W. Correlated neuronal discharge rate and its implications for psychophysical performance. nature 370, 140-143 (1994).
99. Panzeri, S., Schultz, S., Treves, A. & Rolls, E. T. Correlations and the encoding of information in the nervous system. Proc. R. Soc. Lond. B Biol. Sci. 266, 1001-1012 (1999).
100. Petersen, R. S., Panzeri, S. & Diamond, M. E. Population coding of stimulus location in rat somatosensory cortex. neuron 32, 503-514 (2001).
101. Montani, F., Kohn, A., Smith, M. A. & Schultz, S. R. The role of correlations in direction and contrast coding in the primary visual cortex. J. neurosci. 27, 2338-2348 (2007).
102. Nirenberg, S., Carcieri, S. M., Jacobs, A. L. & Latham, P. E. Retinal ganglion cells act largely as independent encoders. nature 411, 698-701 (2001).
103. Dan, Y., Alonso, J. M., Usrey, W. M. & Clay Reid, R. Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus. nature neurosci. 1, 501-507 (1998).
104. Mitzdorf, U. Properties of the evoked potential generators: current source-density analysis of visually evoked potentials in the cat cortex. Int. J. neurosci. 33, 33-59 (1987).
105. Juergens, E., Guettler, A. & Eckhorn, R. Visual stimulation elicits locked and induced gamma oscillations in monkey intracortical and EEG-potentials, but not in human EEG. Exp. Brain Res. 129, 247-259 (1999).
106. Harada, Y. & Takahashi, T. The calcium component of the action potential in spinal motoneurones of the rat. J. Physiol. 335, 89-100 (1983).
107. Kamondi, A., Acsady, L., Wang, X. J. & Buzsaki, G. Theta oscillations in somata and dendrites of hippocampal pyramidal cells in vivo: activity-dependent phase-precession of action potentials. Hippocampus 8, 244-261 (1998).
108. Montemurro, M., Rasch, M. J., Murayama, Y., Logothetis, N. K. & Panzeri, S. Phase-of-firing coding of natural visual stimuli in primary visual cortex. Curr. Biol. 18, 375-380 (2008). This study used information theory to demonstrate that, in the macaque primary visual cortex, the phase of slow (<12 Hz) local field fluctuations encodes information about natural visual scenes that cannot be obtained from spike counts.
109. Belitski, A. et al. Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information. J. neurosci. 28, 5696-5709 (2008).
110. Mehta, M. R., Lee, A. K. & Wilson, M. A. Role of experience and oscillations in transforming a rate code into a temporal code. nature 417, 741-746 (2002).
111. Harris, K. D. et al. Spike train dynamics predicts theta-related phase precession in hippocampal pyramidal cells. nature 417, 738-741 (2002).
112. Harris, K. D. Neural signatures of cell assembly organization. nature Rev. neurosci. 6, 399-407 (2005).
113. Kraskov, A., Quian Quiroga, R., Reddy, L., Fried, I. & Koch, C. Local field potentials and spikes in the human medial temporal lobe are selective to image category. J. Cogn. neurosci. 19, 479-492 (2007).
114. Kreiman, G. et al. Object selectivity of local field potentials and spikes in the macaque inferior temporal cortex. neuron 49, 433-445 (2006).
115. Andersen, R. A., Musallam, S. & Pesaran, B. Selecting the signals for a brain-machine interface. Curr. Opin. neurobiol. 14, 720-726 (2004).
116. Schneiman, E., Berry, M. J., Segev, R. & Bialek, W. Weak pairwise correlations imply strongly correlated network states in a neural population. nature 440, 1007-1012 (2006).
117. Logothetis, N. K. What we can do and what we cannot do with fMRI. nature 453, 869-878 (2008).
118. Haxby, J. V. et al. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425-2430 (2001).
119. Haynes, J.-D. & Rees, G. Decoding mental states from brain activity in humans. nature Rev. neurosci. 7, 523-534 (2006).
120. Eichele, T. et al. Assessing the spatiotemporal evolution of neuronal activation with single-trial event-related potentials and functional MRI. Proc. natl Acad. Sci. USA 102, 17798-17803 (2005). First study using a single-trial analysis to combine the temporal and spatial resolutions of electroencephalogram and functional MRI recordings.
121. Debener, S., Ullsperger, M., Siegel, M. & Engel, A. K. Single-trial EEG-fMRI reveals the dynamics of cognitive function. Trends Cogn. Sci. 10, 558-563 (2006).
122. Gerstein, G. L. & Clark, W. A. Simultaneous studies of firing patterns in several neurons. Science 143, 1325-1327 (1964).
123. Vapnik, R. J. Statistical Learning Theory (Wiley & sons, New York, 1998).
124. Soong, T. T. Fundamentals of Probability and Statistics for Engineers (Wiley, Sussex, 2004).
125. Latham, P. E. & Nirenberg, S. Synergy, redundancy, and independence in population codes, revisited. J. neurosci. 25, 5195-5206 (2005). This study derived a rigorous measure of the information that is lost when using algorithms that make incorrect assumptions about the probabilities of neural responses to stimuli. It provides a useful tool for understanding which features of the stimulus-response relationship are important for information transmission.