State-space analysis of time-varying higher-order spike correlation for multiple neural spike train data

PLoS Computational Biology

Volumn 8, Issue 3, 2012, Pages

  Shimazaki, Hideaki ^a   Amari, Shun ichi ^a   Brown, Emery N ^b,c   Grün, Sonja ^a,d,e  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c MASSACHUSETTS GENERAL HOSPITAL   (United States)

^d FORSCHUNGSZENTRUM JÜLICH   (Germany)

^e RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

NEURAL NETWORKS; REGRESSION ANALYSIS; TESTING;

CELL ASSEMBLY; HIGH-ORDER; HIGHER-ORDER; MULTIPLE NEURONS; NETWORK ACTIVITIES; NEURAL SPIKE; NEURAL SPIKE TRAINS; SPIKE SEQUENCES; STATE-SPACE ANALYSIS; TIME VARYING;

NEURONS;

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BAYES THEOREM; BRAIN DEPTH RECORDING; CELL COUNT; CELL INTERACTION; CONTROLLED STUDY; CORRELATION FUNCTION; INTRACELLULAR RECORDING; LOGLINEAR MODEL; MATHEMATICAL COMPUTING; MOLECULAR DYNAMICS; MOTOR CORTEX; NERVE CONDUCTION; NONHUMAN; PROCESS DEVELOPMENT; SPIKE WAVE; WAKEFULNESS;

ANIMALIA;

EID: 84861181840     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1002385     Document Type: Article

References (111)

1. Hebb DO, (1949) The Organization of Behavior: A Neuropsychological Theory New York Wiley.
2. Abeles M, (1991) Corticonics: Neural Circuits of the Cerebral Cortex Cambridge; New York Cambridge University Press.
3. Diesmann M, Gewaltig M, Aertsen A, (1999) Stable propagation of synchronous spiking in cortical neural networks. Nature 402: 529-533.
4. Kumar A, Rotter S, Aertsen A, (2010) Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding. Nat Rev Neurosci 11: 615-627.
5. Kuhn A, Aertsen A, Rotter S, (2003) Higher-order statistics of input ensembles and the response of simple model neurons. Neural Comput 15: 67-101.
6. Gerstein GL, Bedenbaugh P, Aertsen MH, (1989) Neuronal assemblies. IEEE Trans Biomed Eng 36: 4-14.
7. Fujii H, Ito H, Aihara K, Ichinose N, Tsukada M, (1996) Dynamical cell assembly hypothesis- theoretical possibility of spatio-temporal coding in the cortex. Neural Netw 9: 1303-1350.
8. Riehle A, Grün S, Diesmann M, Aertsen A, (1997) Spike synchronization and rate modulation differentially involved in motor cortical function. Science 278: 1950-1953.
9. Sakurai Y, (1996) Population coding by cell assemblies-what it really is in the brain. Neurosci Res 26: 1-16.
10. Harris KD, (2005) Neural signatures of cell assembly organization. Nat Rev Neurosci 6: 399-407.
11. Aertsen AM, Gerstein GL, Habib MK, Palm G, (1989) Dynamics of neuronal firing correlation: modulation of "effective connectivity". J Neurophysiol 61: 900-917.
12. Berger D, Warren D, Normann R, Arieli A, Grün S, (2007) Spatially organized spike correlation in cat visual cortex. Neurocomputing 70: 2112-2116.
13. Maldonado P, Babul C, Singer W, Rodriguez E, Berger D, et al. (2008) Synchronization of neuronal responses in primary visual cortex of monkeys viewing natural images. J Neurophysiol 100: 1523-1532.
14. Ito H, Maldonado PE, Gray CM, (2010) Dynamics of stimulus-evoked spike timing correlations in the cat lateral geniculate nucleus. J Neurophysiol 104: 3276-3292.
15. Ahissar E, Vaadia E, Ahissar M, Bergman H, Arieli A, et al. (1992) Dependence of cortical plasticity on correlated activity of single neurons and on behavioral context. Science 257: 1412-1415.
16. Vaadia E, Haalman I, Abeles M, Bergman H, Prut Y, et al. (1995) Dynamics of neuronal interactions in monkey cortex in relation to behavioral events. Nature 373: 515-518.
17. Ishikane H, Gangi M, Honda S, Tachibana M, (2005) Synchronized retinal oscillations encode essential information for escape behavior in frogs. Nat Neurosci 8: 1087-1095.
18. Fujisawa S, Amarasingham A, Harrison MT, Buzsáki G, (2008) Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex. Nat Neurosci 11: 823-833.
19. Kilavik BE, Roux S, Ponce-Alvarez A, Confais J, Grün S, et al. (2009) Long-term modi-cations in motor cortical dynamics induced by intensive practice. J Neurosci 29: 12653-12663.
20. Sakurai Y, (1996) Hippocampal and neocortical cell assemblies encode memory processes for different types of stimuli in the rat. J Neurosci 16: 2809-2819.
21. Steinmetz PN, Roy A, Fitzgerald PJ, Hsiao SS, Johnson KO, et al. (2000) Attention modulates synchronized neuronal firing in primate somatosensory cortex. Nature 404: 187-190.
22. Sakurai Y, Takahashi S, (2006) Dynamic synchrony of firing in the monkey prefrontal cortex during working-memory tasks. J Neurosci 26: 10141-10153.
23. Takahashi S, Sakurai Y, (2009) Sub-millisecond firing synchrony of closely neighboring pyramidal neurons in hippocampal CA1 of rats during delayed non-matching to sample task. Front Neural Circuits 3: 9.
24. Brown EN, Kass RE, Mitra PP, (2004) Multiple neural spike train data analysis: state-of-the-art and future challenges. Nat Neurosci 7: 456-461.
25. Grün S, (2009) Data-driven significance estimation for precise spike correlation. J Neurophysiol 101: 1126-1140.
26. Grün S, Rotter S, eds. (2010) Analysis of Parallel Spike Trains New York Springer.
27. Perkel DH, Gerstein GL, Moore GP, (1967) Neuronal spike trains and stochastic point processes. II. simultaneous spike trains. Biophys J 7: 419-440.
28. Gerstein GL, Perkel DH, (1969) Simultaneously recorded trains of action potentials- analysis and functional interpretation. Science 164: 828-830.
29. Gerstein GL, Kiang NYS, (1960) An approach to the quantitative analysis of electrophysiological data from single neurons. Biophys J 1: 15-28.
30. Shimazaki H, Shinomoto S, (2007) A method for selecting the bin size of a time histogram. Neural Comput 19: 1503-1527.
31. Shimazaki H, Shinomoto S, (2010) Kernel bandwidth optimization in spike rate estimation. J Comput Neurosci 29: 171-182.
32. Grün S, Diesmann M, Aertsen A, (2002) Unitary events in multiple single-neuron spiking activity: I. detection and significance. Neural Comput 14: 43-80.
33. Grün S, Diesmann M, Aertsen A, (2002) Unitary events in multiple single-neuron spiking activity: II. nonstationary data. Neural Comput 14: 81-119.
34. Staude B, Rotter S, Grün S, (2010) Cubic: cumulant based inference of higher-order correlations in massively parallel spike trains. J Comput Neurosci 29: 327-350.
35. Staude B, Grün S, Rotter S, (2010) Higher-order correlations in non-stationary parallel spike trains: statistical modeling and inference. Front Comput Neurosci 4: 16.
36. Chornoboy ES, Schramm LP, Karr AF, (1988) Maximum likelihood identification of neural point process systems. Biol Cybern 59: 265-275.
37. Brown EN, Frank LM, Tang D, Quirk MC, Wilson MA, (1998) A statistical paradigm for neural spike train decoding applied to position prediction from ensemble firing patterns of rat hippocampal place cells. J Neurosci 18: 7411-7425.
38. Truccolo W, Eden UT, Fellows MR, Donoghue JP, Brown EN, (2005) A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. J Neurophysiol 93: 1074-1089.
39. Okatan M, Wilson MA, Brown EN, (2005) Analyzing functional connectivity using a network likelihood model of ensemble neural spiking activity. Neural Comput 17: 1927-1961.
40. Pillow JW, Shlens J, Paninski L, Sher A, Litke AM, et al. (2008) Spatio-temporal correlations and visual signalling in a complete neuronal population. Nature 454: 995-999.
41. Kim S, Putrino D, Ghosh S, Brown EN, (2011) A granger causality measure for point process models of ensemble neural spiking activity. PLoS Comput Biol 7: e1001110.
42. Kulkarni JE, Paninski L, (2007) Common-input models for multiple neural spike-train data. Network: Comp Neural Sys 18: 375-407.
43. Vidne M, Ahmadian Y, Shlens J, Pillow JW, Kulkarni J, et al. (2011) Modeling the impact of common noise inputs on the network activity of retinal ganglion cells. J Comput Neurosci In press. DOI: 101007/s10827-011-0376-2.
44. Amari SI, (2001) Information geometry on hierarchy of probability distributions. IEEE T Inform Theory 47: 1701-1711.
45. Nakahara H, Amari SI, (2002) Information-geometric measure for neural spikes. Neural Comput 14: 2269-2316.
46. Ackley D, Hinton G, Sejnowski T, (1985) A learning algorithm for boltzmann machines. Cognitive Sci 9: 147-169.
47. Amari S, Kurata K, Nagaoka H, (1992) Information geometry of boltzmann machines. IEEE T Neural Networ 3: 260-271.
48. Amari S, (1972) Learning patterns and pattern sequences by self-organizing nets of threshold elements. IEEE Trans Comput 21: 1197-1206.
49. Hopfield J, (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci U S A 79: 2554-2558.
50. Amari S, Nagaoka H, (2000) Methods of Information Geometry Providence American Mathematical Society.
51. Amari S, (2009) Measure of correlation orthogonal to change in firing rate. Neural Comput 21: 960-972.
52. Schneidman E, Still S, Berry MJ, Bialek W, (2003) Network information and connected correlations. Phys Rev Lett 91: 238701.
53. Montani F, Ince RAA, Senatore R, Arabzadeh E, Diamond ME, et al. (2009) The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex. Philos Transact A Math Phys Eng Sci 367: 3297-3310.
54. Roudi Y, Nirenberg S, Latham PE, (2009) Pairwise maximum entropy models for studying large biological systems: when they can work and when they can't. PLoS Comput Biol 5: e1000380.
55. Schneidman E, Berry MJ, Segev R, Bialek W, (2006) Weak pairwise correlations imply strongly correlated network states in a neural population. Nature 440: 1007-1012.
56. Shlens J, Field GD, Gauthier JL, Grivich MI, Petrusca D, et al. (2006) The structure of multineuron firing patterns in primate retina. J Neurosci 26: 8254-8266.
57. Tang A, Jackson D, Hobbs J, Chen W, Smith JL, et al. (2008) A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. J Neurosci 28: 505-518.
58. Santos GS, Gireesh ED, Plenz D, Nakahara H, (2010) Hierarchical interaction structure of neural activities in cortical slice cultures. J Neurosci 30: 8720-8733.
59. Yu S, Yang H, Nakahara H, Santos GS, Nikolic D, et al. (2011) Higher-order interactions characterized in cortical activity. J Neurosci 31: 17514-17526.
60. Ohiorhenuan IE, Mechler F, Purpura KP, Schmid AM, Hu Q, et al. (2010) Sparse coding and high-order correlations in fine-scale cortical networks. Nature 466: 617-621.
61. Martignon L, Hasseln HV, Grün S, Aertsen A, Palm G, (1995) Detecting higher-order interactions among the spiking events in a group of neurons. Biol Cybern 73: 69-81.
62. Martignon L, Deco G, Laskey K, Diamond M, Freiwald W, et al. (2000) Neural coding: higherorder temporal patterns in the neurostatistics of cell assemblies. Neural Comput 12: 2621-2653.
63. Macke JH, Opper M, Bethge M, (2011) Common input explains higher-order correlations and entropy in a simple model of neural population activity. Phys Rev Lett 106: 208102.
64. Gütig R, Aertsen A, Rotter S, (2003) Analysis of higher-order neuronal interactions based on conditional inference. Biol Cybern 88: 352-359.
65. Amari SI, Nakahara H, Wu S, Sakai Y, (2003) Synchronous firing and higher-order interactions in neuron pool. Neural Comput 15: 127-142.
66. Long J II, Carmena J, (2011) A statistical description of neural ensemble dynamics. Front Comput Neurosci 5: 52.
67. Kass RE, Kelly RC, Loh WL, (2011) Assessment of synchrony in multiple neural spike trains using loglinear point process models. Ann Appl Stat 5: 1262-1292.
68. Smith AC, Brown EN, (2003) Estimating a state-space model from point process observations. Neural Comput 15: 965-991.
69. Eden UT, Frank LM, Barbieri R, Solo V, Brown EN, (2004) Dynamic analysis of neural encoding by point process adaptive filtering. Neural Comput 16: 971-998.
70. Stevenson IH, Rebesco JM, Hatsopoulos NG, Haga Z, Miller LE, et al. (2009) Bayesian inference of functional connectivity and network structure from spikes. IEEE Trans Neural Syst Rehabil Eng 17: 203-213.
71. Truccolo W, Hochberg LR, Donoghue JP, (2010) Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes. Nat Neurosci 13: 105-111.
72. Chen Z, Barbieri R, Brown EN, (2010) State-space modeling of neural spike train and behavioral data. In: Oweiss KG, editors. Statistical Signal Processing for Neuroscience and Neurotechnology Burlington Elsevier Science pp. 175-218.
73. Akaike H, (1980) Likelihood and the bayes procedure. Trabajos de Estadística y de Investigación Operativa 31: 143-166.
74. Jeffreys H, (1961) Theory of Probability Oxford Clarendon Press.
75. Good IJ, (1985) Weight of Evidence: A brief survey. In: Bernardo JM, De Groot MH, Lindley DV, Smith AFM, editors. Bayesian statistics 2 New York North Holland pp. 249-269.
76. Kass RE, Raftery AE, (1995) Bayes factors. J Am Stat Assoc 90: 773-795.
77. Shimazaki H, Amari SI, Brown EN, Grün S, (2009) State-space analysis on time-varying correlations in parallel spike sequences. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 2009 pp. 3501-3504 ICASSP-2009.
78. Dempster AP, Laird NM, Rubin DB, (1977) Maximum likelihood from incomplete data via the EM algorithm. J Roy Stat Soc B Met 39: 1-38.
79. Schwarz G, (1978) Estimating the dimension of a model. Ann Stat 6: 461-464.
80. Rissanen J, (2009) Information and Complexity in Statistical Modeling New York Springer.
81. Shimodaira H, (1994) A new criterion for selecting models from partially observed data. In: Cheeseman P, Oldford RW, editors. Selecting models from data- artificial intelligence and statistics IV New York Springer-Verlag pp. 21-30.
82. Shlens J, Field GD, Gauthier JL, Greschner M, Sher A, et al. (2009) The structure of large-scale synchronized -ring in primate retina. J Neurosci 29: 5022-5031.
83. Louis S, Gerstein G, Grün S, Diesmann M, (2010) Surrogate spike train generation through dithering in operational time. Front Comput Neurosci 4: 127.
84. Riehle A, Grammont F, Diesmann M, Grün S, (2000) Dynamical changes and temporal precision of synchronized spiking activity in monkey motor cortex during movement preparation. J Physiol Paris 94: 569-582.
85. Bohte SM, Spekreijse H, Roelfsema PR, (2000) The effects of pair-wise and higher order correlations on the firing rate of a post-synaptic neuron. Neural Comput 12: 153-179.
86. Staude B, Grün S, Rotter S, (2010) Higher order correlations and cumulants. In: Grün, Rotter, editors. Analysis of parallel spike trains Springer New York pp. 253-280.
87. Jenison RL, Reale RA, (2004) The shape of neural dependence. Neural Comput 16: 665-672.
88. Berkes P, Wood F, Pillow J, (2009) Characterizing neural dependencies with copula models. In: Koller D, Schuurmans D, Bengio Y, Bottou L, editors. Advances in NIPS 21 pp. 129-136.
89. Onken A, Grünewälder S, Munk MHJ, Obermayer K, (2009) Analyzing short-term noise dependencies of spike-counts in macaque prefrontal cortex using copulas and the flashlight transformation. PLoS Comput Biol 5: e1000577.
90. Paninski L, (2005) Log-concavity results on gaussian process methods for supervised and unsupervised learning. In: Saul LK, Weiss Y, Bottou L, editors. Advances in NIPS 17 pp. 1025-1032.
91. Amari S, (1998) Natural gradient works efficiently in learning. Neural Comput 10: 251-276.
92. Murray I, Ghahramani Z, (2004) Bayesian learning in undirected graphical models: approximate MCMC algorithms. Proceedings of the 20th Annual Conference on Uncertainty in Artificial Intelligence. UAI-2004 Arlington AUAI Press pp. 392-399.
93. Schaub MT, Schultz SR, (2011) The Ising decoder: reading out the activity of large neural ensembles. J Comput Neurosci 32: 101-118 101007/s10827-011-0342-z.
94. Shinomoto S, Kim H, Shimokawa T, Matsuno N, Funahashi S, et al. (2009) Relating neuronal firing patterns to functional differentiation of cerebral cortex. PLoS Comput Biol 5: e1000433.
95. Daley D, Vere-Jones D, (1988) An Introduction to the Theory of Point Processes New York Springer-Verlag.
96. Kass RE, Ventura V, Brown EN, (2005) Statistical issues in the analysis of neuronal data. J Neurophysiol 94: 8-25.
97. Brody CD, (1999) Correlations without synchrony. Neural Comput 11: 1537-1551.
98. Czanner G, Eden UT, Wirth S, Yanike M, Suzuki WA, et al. (2008) Analysis of between-trial and within-trial neural spiking dynamics. J Neurophysiol 99: 2672-2693.
99. Grün S, Diesmann M, Grammont F, Riehle A, Aertsen A, (1999) Detecting unitary events without discretization of time. J Neurosci Methods 94: 67-79.
100. Marre O, Boustani SE, Frégnac Y, Destexhe A, (2009) Prediction of spatiotemporal patterns of neural activity from pairwise correlations. Phys Rev Lett 102: 138101.
101. Brown EN, Barbieri R, Ventura V, Kass RE, Frank LM, (2001) The time-rescaling theorem and its application to neural spike train data analysis. Neural Comput 14: 325-346.
102. Oizumi M, Ishii T, Ishibashi K, Hosoya T, Okada M, (2010) Mismatched decoding in the brain. J Neurosci 30: 4815-4826.
103. Shumway R, Stoffer D, (1982) An approach to time series smoothing and forecasting using the em algorithm. J Time Ser Anal 3: 253-264.
104. Smith AC, Frank LM, Wirth S, Yanike M, Hu D, et al. (2004) Dynamic analysis of learning in behavioral experiments. J Neurosci 24: 447-461.
105. Kitagawa G, (1987) Non-Gaussian state-space modeling of nonstationary time series. J Am Stat Assoc 82: 1032-1041.
106. Fahrmeir L, (1992) Posterior mode estimation by extended kalman filtering for multivariate dynamic generalized linear models. J Am Stat Assoc 87: 501-509.
107. Koyama S, Paninski L, (2010) Efficient computation of the maximum a posteriori path and parameter estimation in integrate-and-fire and more general state-space models. J Comput Neurosci 89-105: 1-2.
108. De Jong P, Mackinnon MJ, (1988) Covariances for smoothed estimates in state space models. Biometrika 75: 601-602.
109. Harvey AC, (1989) Forecasting Structural Time Series Models and the Kalman Filter Cambridge; New York Cambridge University Press.
110. Durbin J, Koopman SJ, (2001) Time Series Analysis by State Space Methods Oxford; New York Oxford University Press.
111. Meng X, Rubin D, (1991) Using EM to obtain asymptotic variance-covariance matrices: the SEM algorithm. J Am Stat Assoc 86: 899-909.