Model-based decoding, information estimation, and change-point detection techniques for multineuron spike trains

Neural Computation

Volumn 23, Issue 1, 2011, Pages 1-45

  Pillow, Jonathan W ^a   Ahmadian, Yashar ^b   Paninski, Liam ^b  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ANIMAL; ARTICLE; BIOLOGICAL MODEL; HUMAN; NERVE CELL NETWORK; PHYSIOLOGY; SENSORY RECEPTOR; SIGNAL PROCESSING;

ACTION POTENTIALS; ANIMALS; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; SENSORY RECEPTOR CELLS; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 78650608745     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00058     Document Type: Article

References (98)

1. Abbott, L., & Dayan, P. (1999). The effect of correlated variability on the accuracy of a population code. Neural Computation, 11, 91-101.
2. Ahmadian, Y., Pillow, J. W., & Paninski, L. (2011). Efficient Markov chain Monte Carlo methods for decoding neural spike trains. Neural Computation, 23(1), 46-96.
3. Barbieri, R., Frank, L., Nguyen, D., Quirk, M., Solo, V., Wilson, M., et al. (2004). Dynamic analyses of information encoding in neural ensembles. Neural Computation, 16, 277-307.
4. Berry, M., & Meister, M. (1998). Refractoriness and neural precision. Journal of Neuroscience, 18, 2200-2211.
5. Bialek, W., Rieke, F., de Ruyter van Steveninck, R. R., & Warland, D. (1991). Reading a neural code. Science, 252, 1854-1857.
6. Bialek, W., & Zee, A. (1990). Coding and computation with neural spike trains. Journal of Statistical Physics, 59, 103-115.
7. Boyd, S., & Vandenberghe, L. (2004). Convex optimization. New York: Oxford University Press.
8. Brillinger, D. (1988). Maximum likelihood analysis of spike trains of interacting nerve cells. Biological Cyberkinetics, 59, 189-200.
9. Brillinger, D. (1992). Nerve cell spike train data analysis: A progression of technique. Journal of the American Statistical Association, 87, 260-271.
10. Brockwell, A. E., Kass, R. E., & Schwartz, A. (2007). Statistical signal processing and the motor cortex. Proceedings of the IEEE, 95, 1-18.
11. Brockwell, A., Rojas, A., & Kass, R. (2004). Recursive Bayesian decoding of motor cortical signals by particle filtering. Journal of Neurophysiology, 91, 1899-1907.
12. Brown, E., Barbieri, R., Ventura, V., Kass, R., & Frank, L. (2002). The time-rescaling theorem and its application to neural spike train data analysis. Neural Computation, 14, 325-346.
13. Brown, E., Frank, L., Tang, D., Quirk, M., & Wilson, M. (1998). A statistical paradigm for neural spike train decoding applied to position prediction from ensemble firing patterns of rat hippocampal place cells. Journal of Neuroscience, 18, 7411-7425.
14. Brunel, N., & Nadal, J. P. (1998). Mutual information, Fisher information, & population coding. Neural Computation, 10, 773-782.
15. Butts, D., & Stanley, G. (2003). Quick and accurate information calculations based on linear characterizations of sensory neurons. Society for Neuroscience Abstracts 29.
16. Chacron, M. (2005). Nonlinear information processing in a model sensory system. Journal of Neurophysiology, 95, 2933-2946.
17. Chichilnisk, E. J. (2001). A simple white noise analysis of neuronal light responses. Network: Computation in Neural Systems, 12, 199-213.
18. Clarke, B., & Barron, A. (1990). Information-theoretic asymptotics of Bayes methods. IEEE Transactions on Information Theory, 36, 453-471.
19. Cover, T., & Thomas, J. (1991). Elements of information theory. New York: Wiley.
20. Cronin, B., Stevenson, I. H., Sur, M., & Kording, K. P. (2009). Hierarchical Bayesian modeling and Markov chain Monte Carlo sampling for tuning curve analysis. J. Neurophysiol, 00379. 2009.
21. Dayan, P., & Abbott, L. (2001). Theoretical neuroscience. Cambridge, MA: MIT Press.
22. de Ruyter van Steveninck, R., & Bialek, W. (1988). Real-time performance of a movement-senstive neuron in the blowfly visual system: Coding and information transmission in short spike sequences. Proc. R. Soc. Lond. B, 234, 379-414.
23. de Ruyter van Steveninck, R., & Bialek, W. (1995). Reliability and statistical efficiency of a blowfly movement-sensitive neuron. Phil. Trans. R. Soc. Lond. Ser. B, 348, 321-340.
24. DeWeese, M., & Zador, A. (1998). Asymmetric dynamics in optimal variance adaptation. Neural Computation, 10(5), 1179-1202.
25. Donoghue, J. (2002). Connecting cortex to machines: Recent advances in brain interfaces. Nature Neuroscience, 5, 1085-1088.
26. Doucet, A., de Freitas, N., & Gordon, N. (Eds.). (2001). Sequential Monte Carlo in practice. Berlin: Springer.
27. Duda, R., & Hart, P. (1972). Pattern classification and scene analysis. New York: Wiley.
28. Eichhorn, J., Tolias, A., Zien, A., Kuss, M., Rasmussen, C., Weston, J., et al. (2004). Prediction on spike data using kernel algorithms. In S. Thrün, L. K. Saul, & B. Schölkopf (Eds.), Advances in neural information processing systems, 16. Cambridge, MA: MIT Press.
29. Ergun, A., Barbieri, R., Eden, U., Wilson, M., & Brown, E. (2007). Construction of point process adaptive filter algorithms for neural systems using sequential Monte Carlo methods. IEEE Transactions on Biomedical Engineering, 54, 419-428.
30. Fahrmeir, L. (1992). Posterior mode estimation by extended Kalman filtering for multivariate dynamic generalized linear models. Journal of the American Statistical Association, 87(418), 501-509.
31. Gerwinn, S., Macke, J.,& Bethge,M.(2009). Bayesian population decoding of piking neurons. Frontiers in Computational Neuroscience, 3, 1-28.
32. Gerwinn, S., Macke, J., Seeger, M., & Bethge, M. (2008). Bayesian inference for spiking neuron models with a sparsity prior. In J. C. Platt, D. Koller, & S. Roweis (Eds.), Advances in neural information processing systems, 20 (pp. 529-536). Cambridge, MA: MIT Press.
33. Haag, J., & Borst, A. (1997). Encoding of visual motion information and reliability in spiking and graded potential neurons. Journal of Neuroscience, 17, 4809-4819.
34. Harris, K., Csicsvari, J., Hirase, H., Dragoi, G., & Buzsaki, G. (2003). Organization of cell assemblies in the hippocampus. Nature, 424, 552-556.
35. Humphrey, D., Schmidt, E., & Thompson, W. (1970). Predicting measures of motor performance from multiple cortical spike trains. Science, 170, 758-762.
36. Huys, Q. J. M., Ahrens, M. B., & Paninski, L. (2006). Efficient estimation of detailed single-neuron models. J. Neurophysiol., 96(2), 872-890.
37. Jacobs, A., Grzywacz, N., & Nirenberg, S. (2006). Decoding the parallel pathways of the retina. Society for Neuroscience Abstracts.
38. Jordan, M. I. (Ed.). (1999). Learning in graphical models. Cambridge, MA: MIT Press.
39. Karmeier, K., Krapp, H., & Egelhaaf, M. (2005). Population coding of self-motion: Applying Bayesian analysis to a population of visual interneurons in the fly. Journal of Neurophysiology, 94, 2182-2194.
40. Kass, R., & Raftery, A. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795.
41. Kelly, R., & Lee, T. (2004). Decoding V1 neuronal activity using particle filtering with Volterra kernels. In S. Becker, S. Thrün, & K. Obermayer (Eds.), Advances in neural information processing systems, 15 (pp. 1359-1366). Cambridge, MA: MIT Press.
42. Kennel, M., Shlens, J., Abarbanel, H., & Chichilnisky, E. (2005). Estimating entropy rates with Bayesian confidence intervals. Neural Computation, 17, 1531-1576.
43. Koyama, S., & Paninski, L. (in press). Efficient computation of the maximum a posteriori path and parameter estimation in integrate-and-fire and more general state-space models. Journal of Computational Neuroscience.
44. Kulkarni, J. E., & Paninski, L. (2007). Common-input models for multiple neural spike-train data. Network: Computation in Neural Systems, 18(4), 375-407.
45. Latham, P., & Nirenberg, S. (2005). Synergy, redundancy, and independence in population codes, revisited. J. Neurosci., 25, 5195-5206.
46. Lazar, A. A., & Pnevmatikakis, E. A. (2008). Faithful representation of stimuli with a population of integrate-and-fire neurons. Neural Computation, 20(11), 2715-2744.
47. Lyu, S., & Simoncelli, E. P. (2009). Nonlinear extraction of "independent components" of natural images using radial gaussianization. Neural Computation, 21(6), 1485-1519.
48. Marmarelis, P. Z., & Marmarelis, V. (1978). Analysis of physiological systems: The white-noise approach. New York: Plenum Press.
49. Maynard, E., Hatsopoulos, N., Ojakangas, C., Acuna, B., Sanes, J., Normann, R., etal. (1999). Neuronal interactions improve cortical population coding of movement direction. Journal of Neuroscience, 19, 8083-8093.
50. McCullagh, P., & Nelder, J. (1989). Generalized linear models. London: Chapman and Hall.
51. Mesgarani, N., David, S. V., Fritz, J. B., & Shamma, S. A. (2009). Influence of context and behavior on stimulus reconstruction from neural activity in primary auditory cortex. J. Neurophysiol., 102(6), 3329-3339.
52. Minka, T. (2001). A family of algorithms for approximate bayesian inference. Unpublished doctoral dissertation, MIT.
53. Nemenman, I., Bialek, W., & de Ruyter van Steveninck, R. (2004). Entropy and information in neural spike trains: Progress on the sampling problem. Physical Review E, 69, 056111.
54. Nicolelis, M., Dimitrov, D., Carmena, J., Crist, R., Lehew, G., Kralik, J., et al. (2003). Chronic, multisite, multielectrode recordings in macaque monkeys. PNAS, 100, 11041-11046.
55. Paninski, L. (2003). Estimation of entropy and mutual information. Neural Computation, 15, 1191-1253.
56. Paninski, L. (2004). Maximum likelihood estimation of cascade point-process neural encoding models. Network: Computation in Neural Systems, 15, 243-262.
57. Paninski, L. (2005). Asymptotic theory of information-theoretic experimental design. Neural Computation, 17(7), 1480-1507.
58. Paninski, L. (2006). The most likely voltage path and large deviations approximations for integrate-and-fire neurons. Journal of Computational Neuroscience, 21, 71-87.
59. Paninski, L., Ahmadian, Y., Ferreira, D., Koyama, S., Rahnama Rad, K., Vidne, M., et al. (in press). A new look at state-space models for neural data. Journal of Computational Neuroscience, In press.
60. Paninski, L., Fellows, M., Shoham, S., Hatsopoulos, N., & Donoghue, J. (2004). Super-linear population encoding of dynamic hand trajectory in primary motor cortex. J. Neurosci., 24, 8551-8561.
61. Paninski, L., Pillow, J. W., & Lewi, J. (2007). Statistical models for neural encoding, decoding, and optimal stimulus design. In P. Cisek, T. Drew, & J. Kalaska (Eds.), Computational neuroscience: Theoretical insights into brain function (pp. 493-507). Amsterdam: Elsevier.
62. Paninski, L., Pillow, J. W., & Simoncelli, E. P. (2004). Maximum likelihood estimation of a stochastic integrate-and-fire neural model. Neural Computation, 16, 2533-2561.
63. Paninski, L., Pillow, J. W., & Simoncelli, E. P. (2005). Comparing integrate-and-fire-like models estimated using intracellular and extracellular data. Neurocomputing, 65-66, 379-385.
64. Passaglia, C., & Troy, J. (2004). Information transmission rates of cat retinal ganglion cells. Journal of Neurophysiology, 91, 1217-1229.
65. Pillow, J. (2009). Time-rescaling methods for the estimation and assessment of non-poisson neural encoding models. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, & A. Culotta (Eds.), Advances in neural information processing systems, 22 (pp. 1473-1481). Cambridge, MA: MIT Press.
66. Pillow, J. W., Paninski, L., & Simoncelli, E. P. (2004). Maximum likelihood estimation of a stochastic integrate-and-fire neural model. In S. Thrün, L. K. Saul, & B. Schölkopf (Eds.), Advances in neural information processing systems, 16. Cambridge, MA: MIT Press.
67. Pillow, J. W., Paninski, L., Uzzell, V. J., Simoncelli, E. P., & Chichilnisky, E. J. (2005). Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model. Journal of Neuroscience, 25, 11003-11013.
68. Pillow, J. W., Shlens, J., Paninski, L., Sher, A., Litke, A. M., Chichilnisky, E. J., et al. (2008). Spatio-temporal correlations and visual signaling in a complete neuronal population. Nature, 454, 995-999.
69. Pillow, J. W., & Simoncelli, E. P. (2003). Biases in white noise analysis due to non-Poisson spike generation. Neurocomputing, 52, 109-115.
70. Pillow, J. W., & Simoncelli, E. P. (2006). Dimensionality reduction in neural models: An information-theoretic generalization of spike-triggered average and covariance analysis. Journal of Vision, 6(4), 414-428.
71. Plesser, H., & Gerstner, W. (2000). Noise in integrate-and-fire neurons: From stochastic input to escape rates. Neural Computation, 12, 367-384.
72. Press, W., Teukolsky, S., Vetterling, W., & Flannery, B. (1992). Numerical recipes in C. Cambridge: Cambridge University Press.
73. Rieke, F., Warland, D., de Ruyter van Steveninck, R. R., & Bialek, W. (1997). Spikes: Exploring the neural code. Cambridge, MA: MIT Press.
74. Rigat, F., de Gunst, M., & van Pelt, J. (2006). Bayesian modelling and analysis of spatio-temporal neuronal networks. Bayesian Analysis, 1(4), 733-764.
75. Robert, C., & Casella, G. (2005). Monte Carlo statistical methods. Berlin: Springer.
76. Sahani, M. (2000). Kernel regression for neural systems identification. Presented at the NIPS00 workshop on Information and Statistical Structure in Spike Trains, Vancouver, BC.
77. Salinas, E., & Abbott, L. (2001). Principles of neural ensemble and distributed coding in the nervous system. Amsterdam: Elsevier.
78. Sanger, T. (1994). Theoretical considerations for the analysis of population coding in motor cortex. Neural Computation, 6, 12-21.
79. Schervish, M. (1995). Theory of statistics. Berlin: Springer-Verlag.
80. Schölkopf, B., & Smola, A. (2002). Learning with kernels: Support vector machines, regularization, optimization and beyond. Cambridge, MA: MIT Press.
81. Serruya, M., Hatsopoulos, N., Paninski, L., Fellows, M., & Donoghue, J. (2002). Instant neural control of a movement signal. Nature, 416, 141-142.
82. Sharpee, T., Rust, N., & Bialek, W. (2004). Analyzing neural responses to natural signals: Maximally informative dimensions. Neural Computation, 16, 223-250.
83. Shoham, S., Paninski, L., Fellows, M., Hatsopoulos, N., Donoghue, J., & Normann, R. (2005). Optimal decoding for a primary motor cortical brain-computer interface. IEEE Transactions on Biomedical Engineering, 52, 1312-1322.
84. Shpigelman, L., Singer, Y., Paz, R., & Vaadia, E. (2003). Spikernels: Embedding spike neurons in inner product spaces. In S. Becker, S. Thrün, & K. Obermayer (Eds.), Advances in neural information processing system, 15. Cambridge MA: MIT Press.
85. Simoncelli, E. P. (2005). Statistical modeling of photographic images. In A. Bovik (Ed.), Handbook of image and video processing (2nd ed., pp. 431-441). Orlando, FL: Academic Press.
86. Simoncelli, E. P., Paninski, L., Pillow, J., & Schwartz, O. (2004). Characterization of neural responses with stochastic stimuli. In M. Gazzaniga (Ed.), The cognitive neurosciences (3rd ed., pp. 327-338). Cambridge, MA: MIT Press.
87. Srinivasan, L., Eden, U., Willsky, A., & Brown, E. (2006). A state-space analysis for reconstruction of goal-directed movements using neural signals. Neural Computation, 18, 2465-2494.
88. Stanley, G., & Boloori, A. (2001). Decoding in neural systems: Stimulus reconstruction from nonlinear encoding. In Proceedings of the 23rd Annual IEEE/EMBS International Conference. Piscataway, NJ: IEEE.
89. Stevenson, I., Rebesco, J., Hatsopoulos, N., Haga, Z., Miller, L., & Kording, K. (2009). Bayesian inference of functional connectivity and network structure from spikes. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 17(3), 203-213.
90. Strong, S., Koberle, R., de Ruyter van Steveninck R., & Bialek, W. (1998). Entropy and information in neural spike trains. Physical Review Letters, 80, 197-202.
91. Theunissen, F., Roddey, J., Stufflebeam, S., Clague, H., & Miller, J. (1996). Information theoretic analysis of dynamical encoding by four primary sensory interneurons in the cricket cercal system. Journal of Neurophysiology, 75, 1345-1364.
92. Truccolo, W., Eden, U. T., Fellows, M. R., Donoghue, J. P., & Brown, E. N. (2005). A point process framework for relating neural spiking activity to spiking history, neural ensemble and extrinsic covariate effects. J. Neurophysiol, 93(2), 1074-1089.
93. Truccolo, W., Hochberg, L., & Donoghue, J. (2010). Collective dynamics in human and monkey sensorimotor cortex: Predicting single neuron spikes. Nature Neuroscience, 13, 105-111.
94. Warland, D., Reinagel, P., & Meister, M. (1997). Decoding visual information from a population of retinal ganglion cells. Journal of Neurophysiology, 78, 2336-2350.
95. Wu, W., Black, M. J., Mumford, D., Gao, Y., Bienenstock, E., & Donoghue, J. P. (2004). Modeling and decoding motor cortical activity using a switching Kalman filter. IEEE Transactions on Biomedical Engineering, 51, 933-942.
96. Wu, W., Kulkarni, J., Hatsopoulos, N., & Paninski, L. (2009). Neural decoding of goal-directed movements using a linear statespace model with hidden states. IEEE Trans. Neural Systems and Rehabilitation Engineering, 17, 370-378.
97. Yu, B. M., Cunningham, J. P., Shenoy, K. V., & Sahani, M. (2007). Neural decoding of movements: From linear to nonlinear trajectory models. In M. Ishikawa, K. Doya, H. Miyamoto, & T. Yamakawa (Eds.), Neural information processing (ICONIP 2007) (pp. 586-595). Berlin: Springer.
98. Zhang, K., Ginzburg, I., McNaughton, B., & Sejnowski, T. (1998). Interpreting neuronal population activity by reconstruction: Unified framework with application to hippocampal place cells. Journal of Neurophysiology, 79, 1017-1044.