Online variational inference for state-space models with point-process observations

Neural Computation

Volumn 23, Issue 8, 2011, Pages 1967-1999

  Zammit Mangion, Andrew ^a   Yuan, Ke ^b   Kadirkamanathan, Visakan ^a   Niranjan, Mahesan ^b   Sanguinetti, Guido ^c  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^c UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; BIOLOGICAL MODEL; LETTER; NERVE CELL; PHYSIOLOGY; RAT; THEORETICAL MODEL;

ALGORITHMS; ANIMALS; MODELS, NEUROLOGICAL; MODELS, THEORETICAL; NEURONS; RATS;

EID: 79959658819     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00156     Document Type: Letter

References (37)

1. Attias, H. (1999). Inferring parameters and structure of latent variable models by variational Bayes. In Proceedings of the 15th Conference on Uncertainty in Artificial Intelligence (pp. 21-30). San Francisco: Morgan Kaufmann.
2. Barbieri, R., Matten, E., Alabi, A., & Brown, E. (2005). A point-process model of human heartbeat intervals:Newdefinitions of heart rate and heart rate variability. AJP-Heart and Circulatory Physiology, 288(1), 424-435.
3. Beal,M. (2003). Variational algorithms for approximate Bayesian inference. Unpublished doctoral dissertation, University College London.
4. Boel, R., & Benes, V. (1980). Recursive nonlinear estimation of a diffusion acting as the rate of an observed Poisson process. IEEE Transactions on Information Theory, 26(5), 561-575.
5. Boll, S. (1979). Suppression of acoustic noise in speech using spectral subtraction. IEEE Transactions on Acoustics, Speech and Signal Processing, 27(2), 113-120.
6. Brown, E., Barbieri, R., Eden, U., & Frank, L. (2003). Likelihood methods for neural spike train data analysis. In J. Feng (Ed.), Computational neuroscience: A comprehensive approach (pp. 253-286). Boca Raton, FL: CRC.
7. Brown, E., Barbieri, R., Ventura, V., Kass, R., & Frank, L. (2002). The time-rescaling theorem and its application to neural spike train data analysis. Neural Computation, 14(2), 325-346.
8. Carter, C., & Kohn, R. (1994). On Gibbs sampling for state space models. Biometrika, 81(3), 541-553.
9. de Freitas, J., Niranjan, M., Gee, A., & Doucet, A. (2000). Sequential Monte Carlo methods to train neural network models. Neural Computation, 12(4), 955-993.
10. di Lorenzo, P., & Victor, J. (2003). Taste response variability and temporal coding in the nucleus of the solitary tract of the rat. Journal of Neurophysiology, 90, 1418-1431.
11. Doucet, A., de Freitas, N., & Gordon, N. (2001). An introduction to sequential Monte Carlo methods. In A. Doucet, N. de Freitas, & N. Gordon (Eds.), Sequential Monte Carlo methods in practice (pp. 3-14). New York: Springer-Verlag.
12. Doucet, A., de Freitas, N., Murphy, K., & Russell, S. (2000). Rao-Blackwellised particle filters for dynamic Bayesian networks. In Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence (pp. 176-183). San Francisco: Morgan Kaufmann.
13. Eden, U., Frank, L., Barbieri, R., Solo, V., & Brown, E. (2004). Dynamic analysis of neural encoding by point process adaptive filtering. Neural Computation, 16(5), 971-998.
14. Ergün, A., Barbieri, R., Eden, U., Wilson, M., & Brown, E. (2007). Construction of point process adaptive filter algorithms for neural systems using sequential Monte Carlo methods. IEEE Transactions on Biomedical Engineering, 54(3), 419-428.
15. Fahrmeir, L., & Tutz, G. (1994). Dynamic stochastic models for time-dependent ordered paired comparison systems. Journal of the American Statistical Association, 89(428), 1438-1449.
16. Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., & Penny,W. (2007). Variational free energy and the Laplace approximation. NeuroImage, 34, 220-234.
17. Geweke, J., & Tanizaki, H. (2001). Bayesian estimation of state-space models using the Metropolis-Hasting algorithm with in Gibbs sampling. Computational Statistics and Data Analysis, 37(2), 151-170.
18. Ivanov, P., Rosenblum, M., Peng, C., Mietus, J., Havlin, S. Stanley, H., et al. (1996). Scaling behavior of heartbeat intervals obtained by wavelet-based time-series analysis. Nature, 383, 323-327.
19. Jolivet, R., Kobayashi, R., Rauch, A., Naud, R., Shinomoto, S., & Gerstner,W. (2008). A benchmark test for a quantitative assessment of simple neuron models. Journal of Neuroscience Methods, 169(2), 417-424.
20. Kitagawa, G. (1998). A self-organizing state-space model. Journal of the American Statistical Association, 93(443):1203-1215.
21. MacGregor, D., Williams, C., & Leng., G. (2009). A new method of spike modelling and interval analysis. Journal of Neuroscience Methods, 176(1), 45-56.
22. Manton, J., Krishnamurthy, V., & Elliott, R. (1999). Discrete time filters for doubly stochastic Poisson processes and other exponential noise models. International Journal of Adaptive Control and Signal Processing, 13(5), 393-416.
23. Quinn, J.,Williams, C., & McIntosh, N. (2008). Factorial switching linear dynamical systems applied to physiological condition monitoring. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(9), 1537-1551.
24. Riehle, A., Grün, S., Diesmann, M., & Aertsen, A. (1997). Spike synchronization and rate modulation differentially involved in motor cortical function. Science, 278(5345), 1950-1953.
25. Roussin, A., Victor, J., Chen, J.-Y., & di Lorenzo, P. (2008). Variability in responses and temporal coding of tastants of similar quality in the nucleus of the solitary tract of the rat. J. Neurophysiol., 99(2), 644-655.
26. Roweis, S., & Ghahramani, Z. (1999). A unifying review of linear gaussian models. Neural Computation, 11(2), 305-345.
27. Sato, M. (2001). On-line model selection based on the variational Bayes. Neural Computation, 13(7), 1649-1681.
28. Segall, A., Davis, M. H. A., & Kailath, T. (1975). Nonlinear filtering with counting observations. IEEE Transactions on Information Theory, 21(2), 143-149.
29. Šmídl, V., & Quinn, A. (2005). The variational Bayes method in signal processing. New York: Springer-Verlag.
30. Šmídl, V., & Quinn, A. (2006). The restricted variational Bayes approximation in Bayesian filtering. In Proceedings of the IEEE Nonlinear Statistical Signal Processing Workshop (pp. 224-227). Piscataway, NJ: IEEE.
31. Smith, A., & Brown, E. (2003). Estimating a state-space model from point process observations. Neural Computation, 15(5), 965-991.
32. Smith, A., Shah, S., Hudson, A., Purpura, K., Victor, J., Brown, E. et al. (2009). A Bayesian statistical analysis of behavioral facilitation associated with deep brain stimulation. Journal of Neuroscience Methods, 183, 267-276.
33. Snyder, D. L., & Miller, M. I. (1991). Random point processes in time and space. New York: Springer-Verlag.
34. Solo, V. (2000). "Unobserved" Monte Carlo method for identification of partially observed nonlinear state space systems. Part II: Counting process observations. In Proceedings of the 39th IEEE Conference on Decision and Control (Vol. 4, pp. 3331-3336). Piscataway, NJ: IEEE.
35. Storvik, G. (2002). Particle filters for state-space models with the presence of unknown static parameters. IEEE Transactions on Signal Processing, 50(2), 281-289.
36. Wan, E., & Nelson, A. (2001). Dual extended Kalman filter methods. In S. Haykin (Ed.), Kalman filtering and neural networks (pp. 123-173). Hoboken, NJ: Wiley.
37. Yuan, K., & Niranjan, M. (2010). Estimating a state-space model from point process observations: A note on convergence. Neural Computation, 22(8), 1993-2001.