Variational Bayesian inference with Gaussian-mixture approximations

Electronic Journal of Statistics

Volumn 8, Issue 1, 2014, Pages 355-389

  Zobay, O ^a,b  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b MRC INSTITUTE OF HEARING RESEARCH   (United Kingdom)

Author keywords

Approximation methods; Bayesian lasso; Normal mixtures; State space models; Variational inference

Indexed keywords

EID: 84902472341     PISSN: 19357524     EISSN: None     Source Type: Journal    
DOI: 10.1214/14-EJS887     Document Type: Article

References (22)

1. Bishop, C. M. (2006). Pattern recognition and machine learning. Springer, New York. MR2247587.
2. Chen, J.-Y., Hershey, J. R., Olsen, P. A., and Yashchin, E. (2008). Accelerated Monte Carlo for Kullback-Leibler divergence between Gaussian mixture models. In Proceedings of the IEEE International Conference on Acous-tics, Speech and Signal Processing (ICASSP), 4553-4556.
3. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004). Least angle regression. Ann. Stat. 32, 407-499. MR2060166.
4. Gilks, W. R., Best, N. G., and Tan, K. K. C. (1995). Adaptive rejection Metropolis sampling within Gibbs sampling. Appl. Statist. 21, 455-472.
5. Goldberger, J., Gordon, S., and Greenspan, H. (2003). An efficient image similarity measure based on approximations of KL-divergence between two Gaussian mixtures. In Proceedings of the Ninth IEEE International Con-ference on Computer Vision (ICCV03), 487-493.
6. Hans, C. (2009). Bayesian lasso regression. Biometrika 96, 835-845. MR2564494.
7. Hans, C. (2010). Model uncertainty and variable selection in Bayesian lasso regression. Statistics and Computing 20, 221-229. MR2610774.
8. Hershey, J. R. and Olsen, P. A. (2007). Approximating the Kullback-Leibler divergence between Gaussian mixture models. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing 2007, IV-317-IV-320.
9. Huber, M. F., Bailey, T., Durrant-Whyte, H., and Hanebeck, U. D. (2008). On entropy approximation for Gaussian mixture random vectors. In Proceedings of the EEE International Conference on Multisensor Fusion and Integration for Intelligent Systems 2008, 181-188.
10. Jaakkola, T. S. and Jordan, M. I. (1998). Improving the mean field approximation via the use of mixture distributions. In Learning in Graphical Models, ed. M. I. Jordan, MIT Press, Cambridge, MA, 163-174.
11. MacKay, D. J. C. (2003). Information theory, inference and learning algo-rithms. Cambridge University Press, New York. MR2012999.
12. Minka, T. (2005). Divergence measures and message passing. Microsoft Tech-nical Report MSR-TR-2005-173.
13. Opper, M. and Archambeau, C. (2009). The variational Gaussian approximation revisited. Neural Computation 21, 786-792. MR2478318.
14. Opper, M. and Saad, D. (eds.) (2001). Advanced mean field methods: theory and practice. Neural Information Processing Series. MIT Press, Cambridge, MA. MR1863214.
15. Ormerod, J. T. and Wand, M. P. (2010). Explaining variational approximations. The American Statistician 64, 140-153. MR2757005.
16. Park, T. and Casella, G. (2008). The Bayesian Lasso. Journal of the Amer-ican Statistical Association 103, 681-686. MR2524001.
17. Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. (2007). Numerical Recipes: The Art of Scientific Computing. Cambridge University Press, Cambridge. MR2371990.
18. Smidl, V. and Quinn, A. (2006). The Variational Bayes Method in Signal Processing. Springer, Berlin, Heidelberg, New York.
19. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B 58, 267-288. MR1379242.
20. Wainwright, M. J. and Jordan, M. I. (2008). Graphical models, exponential families, and variational inference. Found. Trends Mach. Learning 1, 1-305.
21. Zhang, S. and Jin, J. (1996). Computation of Special Functions. Wiley, New York. MR1406797.
22. Zobay, O. (2009). Mean field inference for the Dirichlet process mixture model. Electronic Journal Statistics 3, 507-545. MR2519531.