Identification of sparse neural functional connectivity using penalized likelihood estimation and basis functions

Journal of Computational Neuroscience

Volumn 35, Issue 3, 2013, Pages 335-357

  Song, Dong ^a   Wang, Haonan ^c   Tu, Catherine Y ^c   Marmarelis, Vasilis Z ^a   Hampson, Robert E ^d   Deadwyler, Sam A ^d   Berger, Theodore W ^a,b  

^a University of Southern California   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c Veterinary Dentistry and Oral Surgery   (United States)

^d WAKE FOREST SCHOOL OF MEDICINE   (United States)

Author keywords

Basis function; Functional connectivity; Generalized linear model; Penalized likelihood; Sparsity; Spike trains; Temporal coding

Indexed keywords

ESTIMATION; INTERPOLATION; MAXIMUM LIKELIHOOD ESTIMATION;

BASE FUNCTION; FUNCTIONAL ADDITIVES; FUNCTIONAL CONNECTIVITY; GENERALIZED LINEAR MODEL; PENALIZED LIKELIHOOD; PENALIZED-LIKELIHOOD; PENALIZED-LIKELIHOOD ESTIMATIONS; SPARSITY; SPIKE TRAIN; TEMPORAL CODING;

FUNCTIONS;

ACCURACY; ANIMAL EXPERIMENT; ARTICLE; BASIS FUNCTION; BEHAVIOR; CONTROLLED STUDY; GENERALIZED FUNCTIONAL ADDITIVE MODEL; HIPPOCAMPAL CA1 REGION; HIPPOCAMPAL CA3 REGION; INTERMETHOD COMPARISON; MALE; MEMORY; NERVOUS SYSTEM PARAMETERS; NEURAL FUNCTIONAL CONNECTIVITY; NONHUMAN; PENALIZED LIKELIHOOD ESTIMATION; PRIORITY JOURNAL; PROCESS DEVELOPMENT; RAT; STATISTICAL ANALYSIS; STATISTICAL MODEL; ALGORITHM; ANIMAL; BIOLOGICAL MODEL; COMPUTER SIMULATION; CYTOLOGY; ELECTROPHYSIOLOGY; NERVE CELL; NERVE TRACT; PHYSIOLOGY;

ALGORITHMS; ANIMALS; CA1 REGION, HIPPOCAMPAL; CA3 REGION, HIPPOCAMPAL; COMPUTER SIMULATION; ELECTROPHYSIOLOGICAL PROCESSES; LIKELIHOOD FUNCTIONS; LINEAR MODELS; MEMORY; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; NEURONS; RATS;

EID: 84886600772     PISSN: 09295313     EISSN: 15736873     Source Type: Journal    
DOI: 10.1007/s10827-013-0455-7     Document Type: Article

References (67)

1. Aertsen, A. M. H. J.; Gerstein, G. L.; Habib, M. K.; & Palm, G. (1989). Dynamics of neuronal firing correlation - modulation of effective connectivity. Journal of Neurophysiology, 61(5), 900-917.
2. Berger, T. W.; Ahuja, A.; Courellis, S. H.; Deadwyler, S. A.; Erinjippurath, G.; Gerhardt, G. A.; et al. (2005). Restoring lost cognitive function. IEEE Engineering in Medicine and Biology Magazine, 24(5), 30-44.
3. Berger, T. W.; Song, D.; Chan, R. H. M.; & Marmarelis, V. Z. (2010). The neurobiological basis of cognition: identification by multi-input, multioutput nonlinear dynamic modeling. Proceedings of the IEEE, 98(3), 356-374.
4. Berger, T. W.; Hampson, R. E.; Song, D.; Goonawardena, A.; Marmarelis, V. Z.; & Deadwyler, S. A. (2011). A cortical neural prosthesis for restoring and enhancing memory. Journal of Neural Engineering, 8(4), 046017.
5. Berger, T. W.; Song, D.; Chan, R. H. M.; Marmarelis, V. Z.; LaCoss, J.; Wills, J.; et al. (2012). A Hippocampal Cognitive Prosthesis: Multi-Input, Multi-Output Nonlinear Modeling and VLSI Implementation. IEEE Trans Neural Syst Rehabil Eng, in press.
6. Brown, E. N.; Barbieri, R.; Ventura, V.; Kass, R. E.; & Frank, L. M. (2002). The time-rescaling theorem and its application to neural spike train data analysis. Neural Computation, 14(2), 325-346.
7. Brown, E. N.; Kass, R. E.; & Mitra, P. P. (2004). Multiple neural spike train data analysis: state-of-the-art and future challenges. Nature Neuroscience, 7(5), 456-461.
8. Chen, Z.; Putrino, D. F.; Ghosh, S.; Barbieri, R.; & Brown, E. N. (2011). Statistical inference for assessing functional connectivity of neuronal ensembles with sparse spiking data. [Article]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 19(2), 121-135.
9. de Boor, C. (1972). On calculating with B-splines. Journal of Approximation Theory, 6, 50-62.
10. Deadwyler, S. A.; Bunn, T.; & Hampson, R. E. (1996). Hippocampal ensemble activity during spatial delayed-nonmatch-to-sample performance in rats. Journal of Neuroscience, 16(1), 354-372.
11. Eilers, P. H. C.; & Marx, B. D. (1996). Flexible smoothing with B-splines and penalties. Statistical Science, 11(2), 89-102.
12. Eldawlatly, S.; Jin, R.; & Oweiss, K. G. (2009). Identifying functional connectivity in large-scale neural ensemble recordings: a multiscale data mining approach. Neural Computation, 21(2), 450-477.
13. Frank, I. E.; & Friedman, J. H. (1993). A statistical view of some chemometrics regression tools. Technometrics, 35(2), 109-135.
14. Fu, W. J. (1998). Penalized regression: the bridge versus the lasso. Journal of Computational and Graphical Statistics, 7(3), 397-416.
15. Garofalo, M.; Nieus, T.; Massobrio, P.; & Martinoia, S. (2009). Evaluation of the Performance of Information Theory-Based Methods and Cross-Correlation to Estimate the Functional Connectivity in Cortical Networks. Plos One, 4(8).
16. Gerhard, F.; Pipa, G.; Lima, B.; Neuenschwander, S.; & Gerstner, W. (2011). Extraction of network topology from multi-electrode recordings: is there a small-world effect? Frontiers in Computational Neuroscience, 5, 1-13.
17. Gerwinn, S.; Macke, J. H.; & Bethge, M. (2010). Bayesian inference for generalized linear models for spiking neurons. Frontiers in Computational Neuroscience, 4.
18. Gourevitch, B.; & Eggermont, J. J. (2007). Evaluating information transfer between auditory cortical neurons. Journal of Neurophysiology, 97(3), 2533-2543.
19. Hampson, R. E.; Simeral, J. D.; & Deadwyler, S. A. (1999). Distribution of spatial and nonspatial information in dorsal hippocampus. Nature, 402(6762), 610-614. doi: 10.1038/45154.
20. Harris, K. D.; Csicsvari, J.; Hirase, H.; Dragoi, G.; & Buzsaki, G. (2003). Organization of cell assemblies in the hippocampus. Nature, 424(6948), 552-556. doi: 10.1038/Nature01834.
21. Haslinger, R.; Pipa, G.; & Brown, E. (2010). Discrete time rescaling theorem: determining goodness of fit for discrete time statistical models of neural spiking. Neural Computation, 22(10), 2477-2506.
22. Hille, B. (1992). Ionic channels of excitable membranes. Sunderland: Sinauer Associates.
23. Hines, M. L.; & Carnevale, N. T. (2000). Expanding NEURON's repertoire of mechanisms with NMODL. Neural Computation, 12(5), 995-1007.
24. Huang, J.; Ma, S.; Xie, H.; & Zhang, C.-H. (2009). A group bridge approach for variable selection. Biometrika, 96(4), 1024.
25. Ito, S.; Hansen, M. E.; Heiland, R.; Lumsdaine, A.; Litke, A. M.; & Beggs, J. M. (2011). Extending Transfer Entropy Improves Identification of Effective Connectivity in a Spiking Cortical Network Model. Plos One, 6(11).
26. Johnston, D. (1999). Foundations of cellular neurophysiology. Cambridge: The MIT Press.
27. Kass, R. E.; & Ventura, V. (2001). A spike-train probability model. Neural Computation, 13(8), 1713-1720.
28. Kelly, R. C.; Smith, M. A.; Kass, R. E.; & Lee, T. S. (2010). Accounting for network effects in neuronal responses using L1 regularized point process models. Advances in Neural Information Processing Systems (NIPS), 23, 1099-1107.
29. Kim, S.; Putrino, D.; Ghosh, S.; & Brown, E. N. (2011). A Granger Causality Measure for Point Process Models of Ensemble Neural Spiking Activity. Plos Computational Biology, 7(3).
30. Kutner, M. H.; Nachtsheim, C. J.; Neter, J.; & Li, W. (2004). Applied linear statistical models (5th ed.). Boston: McGraw-Hill/Irwin.
31. Li, W. X. Y.; Chan, R. H. M.; Zhang, W.; Cheung, R. C. C.; Song, D.; & Berger, T. W. (2011). High-performance and scalable system architecture for the real-time estimation of generalized laguerre-volterra MIMO model from neural population spiking activity. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 1(4), 489-501.
32. Li, L.; Park, I. M.; Seth, S.; Sanchez, J. C.; & Principe, J. C. (2012). Functional connectivity dynamics among cortical neurons: a dependence analysis. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 20(1), 18-30.
33. Marmarelis, V. Z. (1993). Identification of nonlinear biological systems using Laguerre expansions of kernels. Annals of Biomedical Engineering, 21(6), 573-589.
34. Marmarelis, V. Z. (2004). Nonlinear dynamic modeling of physiological systems (IEEE press series on biomedical engineering). Hoboken: Wiley-IEEE Press.
35. McCullagh, P.; & Nelder, J. A. (1989). Generalized linear models (2nd ed.). Boca Raton: Chapman & Hall/CRC.
36. Nedungadi, A. G.; Rangarajan, G.; Jain, N.; & Ding, M. Z. (2009). Analyzing multiple spike trains with nonparametric granger causality. Journal of Computational Neuroscience, 27(1), 55-64.
37. Ogura, H. (1972). Orthogonal functionals of the Poisson process. IEEE Transactions on Information Theory, 18(4), 473-481.
38. Okatan, M.; Wilson, M. A.; & Brown, E. N. (2005). Analyzing functional connectivity using a network likelihood model of ensemble neural spiking activity. Neural Computation, 17(9), 1927-1961.
39. Paninski, L. (2003). Estimation of entropy and mutual information. Neural Computation, 15(6), 1191-1253.
40. Paninski, L.; Pillow, J. W.; & Simoncelli, E. P. (2004). Maximum likelihood estimation of a stochastic integrate-and-fire neural encoding model. Neural Computation, 16(12), 2533-2561.
41. Park, M.; & Pillow, J. W. (2011). Receptive Field Inference with Localized Priors. Plos Computational Biology, 7(10).
42. Pillow, J. W.; Paninski, L.; Uzzell, V. J.; Simoncelli, E. P.; & Chichilnisky, E. J. (2005). Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model. Journal of Neuroscience, 25, 11003-11013.
43. Pillow, J. W.; Shlens, J.; Paninski, L.; Sher, A.; Litke, A. M.; Chichilnisky, E. J.; et al. (2008). Spatio-temporal correlations and visual signalling in a complete neuronal population. Nature, 454(7207), 995-999.
44. Quinn, C. J.; Coleman, T. P.; Kiyavash, N.; & Hatsopoulos, N. G. (2011). Estimating the directed information to infer causal relationships in ensemble neural spike train recordings. Journal of Computational Neuroscience, 30(1), 17-44.
45. Reed, J. L.; & Kaas, J. H. (2010). Statistical analysis of large-scale neuronal recording data. Neural Networks, 23(6), 673-684.
46. Schmidt, M.; Fung, G.; & Rosales, R. (2007). Fast optimization methods for L1 regularization: A comparative study and two new approaches. In J. N. Kok, J. Koronacki, R. L. DeMantaras, S. Matwin, D. Mladenic, & A. Skowron (Eds.), Machine learning: ECML 2007, proceedings (Vol. 4701, pp. 286-297, lecture notes in artificial intelligence). Berlin: Springer-Verlag Berlin.
47. Schmidt, M.; Murphy, K.; Fung, G.; Rosales, R.; & Ieee (2008). Structure learning in random fields for heart motion abnormality detection. In 2008 Ieee Conference on Computer Vision and Pattern Recognition, Vols 1-12 (pp. 203-210, Proceedings-Ieee Computer Society Conference on Computer Vision and Pattern Recognition).
48. Schumaker, L. (1980). Spline Functions: Basic Theory (American Scientist): Wiley.
49. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461-464.
50. So, K.; Koralek, A. C.; Ganguly, K.; Gastpar, M. C.; & Carmena, J. M. (2012). Assessing functional connectivity of neural ensembles using directed information. Journal of Neural Engineering, 9(2), 026004.
51. Song, D.; & Berger, T. W. (2009). Identification of nonlinear dynamics in neural population activity. In K. G. Oweiss (Ed.), Statistical signal processing for neuroscience and neurotechnology. Boston: McGraw-Hill/Irwin.
52. Song, D.; Chan, R. H.; Marmarelis, V. Z.; Hampson, R. E.; Deadwyler, S. A.; & Berger, T. W. (2007). Nonlinear dynamic modeling of spike train transformations for hippocampal-cortical prostheses. IEEE Transactions on Biomedical Engineering, 54(6 Pt 1), 1053-1066.
53. Song, D.; Chan, R. H.; Marmarelis, V. Z.; Hampson, R. E.; Deadwyler, S. A.; & Berger, T. W. (2009a). Nonlinear modeling of neural population dynamics for hippocampal prostheses. Neural Networks, 22(9), 1340-1351.
54. Song, D.; Marmarelis, V. Z.; & Berger, T. W. (2009b). Parametric and non-parametric modeling of short-term synaptic plasticity. Part I: computational study. Journal of Computational Neuroscience, 26(1), 1-19.
55. Song, D.; Wang, Z.; Marmarelis, V. Z.; & Berger, T. W. (2009c). Parametric and non-parametric modeling of short-term synaptic plasticity. Part II: experimental study. Journal of Computational Neuroscience, 26(1), 21-37.
56. Song, D.; Chan, R.H.M.; Marmarelis, V.Z.; Hampson, R.E.; Deadwyler, S.A.; & Berger, T.W. (2011). Estimation and statistical validation of event-invariant nonlinear dynamic models of hippocampal CA3-CA1 population activities. Proceedings of the IEEE EMBS Conference, 3330-3333.
57. Stevenson, I. H.; Rebesco, J. M.; Miller, L. E.; & Kording, K. P. (2008). Inferring functional connections between neurons. Current Opinion in Neurobiology, 18(6), 582-588.
58. Stevenson, I. H.; Rebesco, J. M.; Hatsopoulos, N. G.; Haga, Z.; Member, L. E. M.; & Kording, K. P. (2009). Bayesian inference of functional connectivity and network structure from spikes. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 17(3), 203-213.
59. Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society Series B (Methodological), 58(1), 267-288.
60. Truccolo, W.; & Donoghue, J. P. (2007). Nonparametric modeling of neural point processes via stochastic gradient boosting regression. Neural Computation, 19(3), 672-705.
61. Truccolo, W.; Eden, U. T.; Fellows, M. R.; Donoghue, J. P.; & Brown, E. N. (2005). A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. Journal of Neurophysiology, 93(2), 1074-1089.
62. Tu, C. Y.; Song, D.; Breidt, F. J.; Berger, T. W.; & Wang, H. (2012). Functional model selection for sparse binary time series with multiple inputs. In S. H. Holan, W. R. Bell, & T. S. McElroy (Eds.), Economic time series: Modeling and seasonality. Boca Raton: Chapman and Hall/CRC.
63. Vidne, M.; Ahmadian, Y.; Shlens, J.; Pillow, J. W.; Kulkarni, J.; Litke, A. M.; et al. (2012). Modeling the impact of common noise inputs on the network activity of retinal ganglion cells. Journal of Computational Neuroscience, 33(1), 97-121.
64. Yuan, M.; & Lin, Y. (2006). Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society Series B (Statistical Methodology), 68, 49-67.
65. Zanos, T. P.; Courellis, S. H.; Berger, T. W.; Hampson, R. E.; Deadwyler, S. A.; & Marmarelis, V. Z. (2008). Nonlinear modeling of causal interrelationships in neuronal ensembles. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 16(4), 336-352.
66. Zhao, M. Y.; Batista, A.; Cunningham, J. P.; Chestek, C.; Rivera-Alvidrez, Z.; Kalmar, R.; et al. (2012). An L (1)-regularized logistic model for detecting short-term neuronal interactions. Journal of Computational Neuroscience, 32(3), 479-497.
67. Zucker, R. S.; & Regehr, W. G. (2002). Short-term synaptic plasticity. Annual Review of Physiology, 64, 355-405.