Hidden Markov models for the stimulus-response relationships of multistate neural systems

Neural Computation

Volumn 23, Issue 5, 2011, Pages 1071-1132

  Escola, Sean ^a   Fontanini, Alfredo ^b   Katz, Don ^c   Paninski, Liam ^a  

^a Columbia University ^*  (United States)

^b Stony Brook University   (United States)

^c BRANDEIS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; HUMAN; NERVE CELL; PHYSIOLOGY; PROBABILITY; STANDARD; THEORETICAL MODEL;

ACTION POTENTIALS; ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; HUMANS; MARKOV CHAINS; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 79958260141     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00118     Document Type: Article

References (49)

1. Abeles,M., Bergman, H., Gat, I., Meilijson, I., Seidemann, E., Tishby, N., et al. (1995). Cortical activity flips among quasi-stationary states. Proceedings of the National Academy of Sciences of the United States of America, 92, 8616-8620.
2. Ahrens,M. B., Linden, J. F., & Sahani, M. (2008). Nonlinearities and contextual influences in auditory cortical responses modeled with multilinear spectrotemporal methods. Journal of Neuroscience, 28(8), 1929-1942.
3. Ahrens, M. B., Paninski, L., & Sahani, M. (2008). Inferring input nonlinearities in neural encoding models. Network, 19, 35-67.
4. Anderson, J., Lampl, I., Reichova, I., Carandini, M., & Ferster, D. (2000). Stimulus dependence of two-state fluctuations of membrane potential in cat visual cortex. Nature Neuroscience, 3, 617-621.
5. Baum, L., Petrie, T., Soules, G., & Weiss, N. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Annals of Mathematical Statistics, 41, 164-171.
6. Bezdudnaya, T., Cano,M., Bereshpolova,Y., Stoelzel, C. R., Alonso, J.-M.,&Swadlow, H. A. (2006). Thalamic burst mode and inattention in the awake LGND. Neuron, 49, 421-432.
7. Blake, D. T., & Merzenich, M. M. (2002). Changes of AI receptive fields with sound density. Journal of Neurophysiology, 88(6), 3409-3420.
8. Borst, A., Flanagin, V. L., & Sompolinsky, H. (2005). Adaptation without parameter change: Dynamic gain control in motion detection. Proceedings of the National Academy of Sciences of the United States of America, 102(17), 6172-6176.
9. Brown, E. N., Nguyen, D. P., Frank, L. M., Wilson, M. A., & Solo, V. (2001). An analysis of neural receptive field plasticity by point process adaptive filtering. Proceedings of the National Academy of Sciences of the United States of America, 98, 12261-12266.
10. Chan, K., & Ledolter, J. (1995). Monte Carlo EM estimation for time series models involving counts. Journal of the American Statistical Association, 90, 242-252.
11. Chen, Z., Vijayan, S., Barbieri, R., Wilson, M. A., & Brown, E. N. (2009). Discreteand continuous-time probabilistic models and algorithms for inferring neuronal up and down states. Neural Computation, 21, 1797-1862.
12. Czanner, G., Eden, U.,Wirth, S., Yanike,M., Suzuki,W., & Brown, E. (2008). Analysis of between-trial and within-trial neural spiking dynamics. Journal of Neurophysiology, 99, 2672-2693.
13. Dempster, A., Laird, N., & Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39, 1-38.
14. Eden, U. T., Frank, L.M., Barbieri, R., Solo, V., & Brown, E. N. (2004). Dynamic analysis of neural encoding by point process adaptive filtering. Neural Computation, 16, 971-998.
15. Escola, S. (2009). Markov chains, neural responses, and optimal temporal computations. Unpublished doctoral dissertation, Columbia University.
16. Fontanini, A., & Katz, D. B. (2006). State-dependent modulation of time-varying gustatory responses. Journal of Neurophysiology, 96, 3183-3193.
17. Fox, E. B., Sudderth, E. B., Jordan, M. I., & Willsky, A. S. (2008). An HDP-HMM for systems with state persistence. In Proc. International Conference on Machine Learning. Piscataway, NJ: IEEE Press.
18. Frank, L., Eden, U., Solo, V., Wilson, M., & Brown, E. (2002). Contrasting patterns of receptive field plasticity in the hippocampus and the entorhinal cortex: An adaptive filtering approach. J. Neurosci., 22(9), 3817-3830.
19. Gat, I., Tishby, N., & Abeles, M. (1997). Hidden Markov modeling of simultaneously recorded cells in the associative cortex of behaving monkeys. Network: Computation in Neural Systems, 8, 297-322.
20. Guédon, Y. (2003). Estimating hidden semi-Markov chains from discrete sequences. Journal of Computational and Graphical Statistics, 12, 604-639.
21. Haider, B., Duque, A., Hasenstaub, A. R., Yu, Y., & McCormick, D. A. (2007). Enhancement of visual responsiveness by spontaneous local network activity in vivo. Journal of Neurophysiology, 97, 4186-4202.
22. Hong, S., Lundstrom, B. N., & Fairhall, A. L. (2008). Intrinsic gain modulation and adaptive neural coding. PLoS Computational Biology, 4(7), e1000119.
23. Jin, D. (2009). Generating variable birdsong syllable sequences with branching chain networks in avian premotor nucleus HVC. Phys. Rev. E, 80, 051902.
24. Jones, L., Fontanini, A., Sadacca, B., Miller, P., & Katz, D. (2007). Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles. Proceedings of the National Academy of Sciences, 104, 18772-18777.
25. Kass, R., & Ventura, V. (2001). A spike-train probability model. Neural Comp., 13, 1713-1720.
26. Kass, R.,Ventura,V.,&Cai,C. (2003). Statistical smoothing of neuronal data. Network: Computation in Neural Systems, 14, 5-15.
27. Kemere, C., Santhanam, G., Yu, B. M., Afshar, A., Ryu, S. I.,Mẽng, T. H., et al. (2008). Detecting neural-state transitions using hiddenMarkov models for motor cortical prostheses. J. Neurophysiol., 100, 2441-2452.
28. Kulkarni, J. E., & Paninski, L. (2007). Common-input models for multiple neural spike-train data. Network (Bristol, England), 18, 375-407.
29. Maravall, M., Petersen, R. S., Fairhall, A. L., Arabzadeh, E., & Diamond,M. E. (2007). Shifts in coding properties and maintenance of information transmission during adaptation in barrel cortex. PLoS Biology, 5(2), e19.
30. Paninski, L. (2004). Maximum likelihood estimation of cascade point-process neural encoding models. Network: Computation in Neural Systems, 15, 243-262.
31. Paninski, L., Ahmadian, Y., Ferreira, D. G., Koyama, S., Rahnama Rad, K., Vidne, M., Vogelstein, J., et al. (2009). A new look at state-space models for neural data. Journal of Computational Neuroscience, 29, 107-126.
32. Paninski, L., Pillow, J., & Lewi, J. (2007). Statistical models for neural encoding, decoding, and optimal stimulus design. In P. Cisek, T. Drew, and J. Kalaska (Eds.), Computational neuroscience: Progress in brain research. Amsterdam: Elsevier.
33. Rabiner, L. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77, 257-286.
34. Rahnama Rad, K., & Paninski, L. (2010). Efficient estimation of two-dimensional firing rate surfaces via gaussian processmethods. Network: Computation in Neural Systems, 21, 142-168.
35. Ramcharan, E., Gnadt, J., & Sherman, S. (2000). Burst and tonic firing in thalamic cells of unanesthetized, behaving monkeys. Visual Neuroscience, 17, 55-62.
36. Salakhutdinov, R., Roweis, S., & Ghahramani, Z. (2003). Optimization with EM and expectation-conjugate-gradient. In Proceedings of the Twentieth International Conference on Machine Learning. Menlo Park, CA: AAAI Press.
37. Sanchez-Vives, M. V., & McCormick, D. A. (2000). Cellular and network mechanisms of rhythmic recurrent activity in neocortex. Nature Neuroscience, 3, 1027-1034.
38. Sansom, J., & Thomson, P. (2001). Fitting hidden semi-Markov models to breakpoint rainfall data. Journal of Applied Probability, 38, 142-157.
39. Seidemann, E.,Meilijson, I., Abeles, M., Bergman,H.,&Vaadia, E. (1996). Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task. Journal of Neuroscience, 16, 752-768.
40. Sherman, S. M. (2001). Tonic and burst firing: Dual modes of thalamocortical relay. Trends in Neurosciences, 24, 122-126.
41. Simoncelli, E., Paninski, L., Pillow, J., & Schwartz, O. (2004). Characterization of neural responses with stochastic stimuli. In M. Gazzaniga (Ed.), The cognitive neurosciences (3rd ed.). Cambridge, MA: MIT Press.
42. Smith, A. C., & Brown, E. N. (2003). Estimating a state-space model from point process observations. Neural Computation, 15, 965-991.
43. Tokdar, S., Xi, P., Kelly, R. C., & Kass, R. E. (2009). Detection of bursts in extracellular spike trains using hidden semi-Markov point process models. Journal of Computational Neuroscience, 29, 203-212.
44. Truccolo, W., Eden, U., Fellows, M., Donoghue, J., & Brown, E. (2005). A point process framework for relating neural spiking activity to spiking history, neural ensemble and extrinsic covariate effects. Journal of Neurophysiology, 93, 1074-1089.
45. Wahba, G. (1990). Spline models for observational data. Philadelphia: SIAM.
46. Wang, X.,Wei, Y., Vaingankar, V.,Wang, Q., Koepsell, K., Sommer, F. T., et al. (2007). Feedforward excitation and inhibition evoke dual modes of firing in the cat's visual thalamus during naturalistic viewing. Neuron, 55, 465-478.
47. Wu,W., Black, M. J.,Mumford, D., Gao, Y., Bienenstock, E., & Donoghue, J. P. (2004). Modeling and decoding motor cortical activity using a switching Kalman filter. IEEE Transactions on Bio-Medical Engineering, 51, 933-942.
48. Wu, W., Kulkarni, J., Hatsopoulos, N., & Paninski, L. (2009). Neural decoding of goal-directed movements using a linear statespace model with hidden states. IEEE Trans. Neural Syst. Rehabil. Eng., 17, 370-378.
49. Yu, B., Afshar, A., Santhanam, G., Ryu, S., Shenoy, K., & Sahani, M. (2006). Extracting dynamical structure embedded in neural activity. In Y. Weiss, B. Schölkopf, & J. Platt (Eds.), Advances in neural information processing systems, 18 (pp. 1545-1552). Cambridge, MA: MIT Press.