Variational Bayesian filtering

IEEE Transactions on Signal Processing

Volumn 56, Issue 10 II, 2008, Pages 5020-5030

  Šmídl, Václav ^a   Quinn, Anthony ^b  

^a INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

^b TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

Bayesian filtering; EM algorithm; Hidden Markov model; Particle filtering; Variational Bayes

Indexed keywords

EID: 54749127464     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2008.928969     Document Type: Article

References (34)

1. M. Abramowitz and I. Stegun, Handbook of Mathematical Functions. New York: Dover, 1972.
2. B. Anderson and J. Moore, Optimal Filtering. Englewood Cliffs, NJ: Prentice-Hall, 1979.
3. H. Attias, J. C. Platt, A. Acero, and L. Deng, "Speech denoising and dereverberation using probabilistic models," Adv. Neur. Inf. Process. Syst., pp. 758-764, 2001.
4. M. J. Beal and Z. Ghahramani, "The variational Kalman smoother," Univ. College London, Tech. Rep., 2000.
5. R. Bucy and K. Senne, "Digital synthesis on nonlinear filters," Automatica, vol. 7, pp. 287-298, 1971.
6. D. Cox and N. Reid, "Parameter orthogonality and approximate conditional inference," J. Roy. Statist. Soc. B, vol. 49, no. 1, pp. 1-39, 1987.
7. E. Daum, "New exact nonlinear filters," in Bayesian Analysis of Time Series and Dynamic Models, J. Spall, Ed. New York: Marcel Dekker, 1988.
8. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc. B, vol. 39, pp. 1-38, 1977.
9. Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, Eds. Berlin, Germany: Springer, 2001.
10. Z. Ghahramani and M. Beal, "Propagation algorithms for variational Bayesian learning," Adv. Neur. Inf. Process. Syst., vol. 13, pp. 507-513, 2001.
11. A. Ilin and H. Valpola, "On the effect of the form of the posterior approximation in variational learning of ICA models," Neur. Process. Lett., vol. 22, no. 2, pp. 183-204, 2005.
12. S. Ji, B. Krishnapuram, and L. Carin, "Variational Bayes for continuous hidden Markov models and its application to active learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 522-532, 2006.
13. S. Julier and J. Uhlman, "A new extension of the Kalman filter to non-linear systems," in Proc. AeroSense, 1997.
14. R. Kulhavý, Recursive Nonlinear Estimation: A Geometric Approach ser. Lecture Notes in Control and Information Sciences. London, U.K.: Springer-Verlag, 1996, vol. 216.
15. G. Lee, S. Gelfand, and M. Fitz, "Bayesian techniques for blind deconvolution," IEEE Trans. Commun., vol. 44, pp. 826-835, 1996.
16. J. Liu and R. Chen, "Sequential Monte Carlo methods for dynamic systems," J. Amer. Statist. Assoc., vol. 93, 1998.
17. D. J. C. MacKay, "Ensemble learning for hidden Markov models," Univ. of Cambridge, Cambridge, U.K., Tech. Rep., 1997.
18. F. Mustière, M. Bolić, and M. Bouchard, "A modified Rao-Black-wellised particle filter," in Proc. IEEE Conf. Acoust., Speech, Signal Process., Toulouse, France, 2006.
19. M. Opper and D. Saad, Advanced Mean Field Methods: Theory and Practice. Cambridge, MA: MIT Press, 2001.
20. M. Opper and O. Winther, "From naïve mean field theory to the tap equations," in Advanced Mean Field Methods, M. Opper and D. Saad, Eds. Cambridge, MA: MIT Press, 2001.
21. V. Peterka, "Bayesian approach to system identification," in Trends and Progress in System Identification, P. Eykhoff, Ed. Oxford,U.K.: Pergamon, 1981, pp. 239-304.
22. Y. Qi, J. Paisley, and L. Carin, "Music analysis using hidden Markov mixture models," IEEE Trans. Signal Process., vol. 55, pp. 5209-5224, 2007.
23. S. J. Roberts and W. D. Penny, "Variational Bayes for generalized autoregressive models," IEEE Trans. Signal Process., vol. 50, pp. 2245-2257, 2002.
24. M. Sato, "Online model selection based on the variational Bayes," Neur. Comput., vol. 13, pp. 1649-1681, 2001.
25. T. Schön, F. Gustafsson, and P.-J. Nordlund, "Marginalized particle filters for mixed linear/nonlinear state-space models," IEEE Trans. Signal Process., vol. 53, pp. 2279-2289, 2002.
26. M.Šimandl, J. Královec, and T. Söderström, "Advanced point-mass method for nonlinear state estimation," Automatica, vol. 42, pp. 1133-1145, 2006.
27. M.Šimandl and O. Straka, "Application of the EM algorithm in Gaussian sums methods," Univ. of West Bohemia, Tech. Rep., 2000.
28. V.Šimandl and A. Quinn, "Mixture-based extension of the AR model and its recursive Bayesian identification," IEEE Trans. Signal Process. vol. 53, pp.3530-3542, 2005.
29. V.Širmandl and A. Quinn, The Variational Bayes Method in Signal Processing. Berlin, Germany: Springer, 2005.
30. V.Šrimandl and A. Quinn, "The restricted variational Bayes approximation in Bayesian filtering," in Proc. IEEE Nonlinear Statist. Signal Process. Workshop, Cambridge, U.K., 2006.
31. H. Sorenson, "On development of practical nonlinear filters," Inf. Sci., vol. 7, pp. 253-270, 1974.
32. J. Vermaak, N. Lawrence, and P. Perez, "Variational inference for visual tracking," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2003, vol. 1, pp. 773-780.
33. B. Wang and D. Titterington, "Lack of consistency of mean field and variational Bayes approximations for state space models," Neur. Process. Lett., vol. 20, pp. 151-170, 2004.
34. J. Winn and C. Bishop, "Variational message passing," J. Mach. Learn. Res., vol. 6, pp. 661-694, 2005.