Approximate marginals in latent Gaussian models

Journal of Machine Learning Research

Volumn 12, Issue , 2011, Pages 417-454

  Cseke, Botond ^a   Heskes, Tom ^a  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

Approximate marginals; Expectation propagation; Gaussian markov random fields; Laplace approximation; Variational inference

Indexed keywords

EXPECTATION PROPAGATION; GAUSSIAN MARKOV RANDOM FIELD; LAPLACE APPROXIMATION; MARGINALS; VARIATIONAL INFERENCE;

GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); LAPLACE TRANSFORMS;

COMPUTATIONAL COMPLEXITY;

EID: 79952745784     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (24)

1. P. R. Amestoy, T. A. Davis, and Iain S. D. An approximate minimum degree ordering algorithm. SIAM Journal on Matrix Analysis and Applications., 17(4):886-905, October 1996.
2. A. Birlutiu and T. Heskes. Expectation propagation for rating players in sports competitions. In Joost N. Kok, Jacek Koronacki, Ramon López de Mántaras, Stan Matwin, Dunja Mladenic, and Andrzej Skowron, editors, Proceedings ECML/PKDD, volume 4702 of Lecture Notes in Computer Science, pages 374-381. Springer, 2007.
3. L. Csato and M. Opper. Sparse representation for Gaussian process models. In T. K. Leen, T. G. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, Cambridge, MA, USA, 2001. MIT Press.
4. P. Dangauthier, R. Herbrich, T. Minka, and T. Graepel. Trueskill through time: Revisiting the history of chess. In J. C. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems 20, pages 337-344. MIT Press, Cambridge, MA, 2008.
5. A. M. Erisman and W. F. Tinney. On computing certain elements of the inverse of a sparse matrix. Communications of the ACM, 18(3):177-179, 1975. ISSN 0001-0782.
6. T. Heskes, M. Opper, W. Wiegerinck, O. Winther, and O. Zoeter. Approximate inference techniques with expectation constraints. Journal of Statistical Mechanics: Theory and Experiment, 2005: P11015, 2005.
7. S. Ingram. Minimum degree reordering algorithms: A tutorial, 2006. URL http://www.cs.ubc.ca/~sfingram/cs517-final.pdf.
8. M. Kuss and C. E. Rasmussen. Assessing approximate inference for binary Gaussian process classification. Journal of Machine Learning Research, 6:1679-1704, 2005. ISSN 1533-7928.
9. S. Martino and H. Rue. Implementing approximate Bayesian inference using integrated nested Laplace approximation: a manual for the INLA program. Technical report, Department of Mathematical Sciences, NTNU, Norway, 2009.
10. T. P. Minka. A Family of Algorithms for Approximate Bayesian Inference. PhD thesis, MIT, 2001.
11. T. P. Minka. Divergence measures and message passing. Technical Report MSR-TR-2005-173, Microsoft Research Ltd., Cambridge, UK, December 2005.
12. K. Murphy, Y. Weiss, and M. I. Jordan. Loopy belief propagation for approximate inference: An empirical study. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, volume 9, pages 467-475, San Francisco, USA, 1999. Morgan Kaufman.
13. I. Murray, R. P. Adams, and D. J. C. MacKay. Elliptical slice sampling. In Y. W. Teh and M. Titterington, editors, Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, pages 541-548. 2010.
14. M. Opper and C. Archambeau. The variational Gaussian approximation revisited. Neural Computation, 21(3):786-792, 2009.
15. M. Opper and O. Winther. Gaussian processes for classification: Mean-field algorithms. Neural Computation, 12(11):2655-2684, 2000.
16. M. Opper, U. Paquet, and O. Winther. Improving on expectation propagation. In D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, editors, Advances in Neural Information Processing Systems 21, pages 1241-1248. MIT, Cambridge, MA, US, 2009.
17. H. Rue and L. Held. Gaussian Markov Random Fields: Theory and Applications, volume 104 of Monographs on Statistics and Applied Probability. Chapman & Hall, London, UK, 2005.
18. H. Rue, S. Martino, and N. Chopin. Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations. Journal of the Royal Statistical Society (Series B), 71(2):319-392, 2009.
19. M. W. Seeger. Bayesian inference and optimal design for the sparse linear model. Journal of Machine Learning Research, 9:759-813, 2008. ISSN 1533-7928.
20. K. Takahashi, J. Fagan, and M.-S. Chin. Formation of a sparse impedance matrix and its application to short circuit study. In Proceedings of the 8th PICA Conference, 1973.
21. L. Tierney and J. B. Kadane. Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81(393):82-86, 1986.
22. M. van Gerven, B. Cseke, R. Oostenveld, and T. Heskes. Bayesian source localization with the multivariate Laplace prior. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, editors, Advances in Neural Information Processing Systems 22, pages 1901-1909, 2009.
23. M. van Gerven, B. Cseke, F. de Lange, and T. Heskes. Efficient Bayesian multivariate fMRI analysis using a sparsifying spatio-temporal prior. Neuroimage, 50(1):150-161, March 2010.
24. O. Zoeter and T. Heskes. Gaussian quadrature based expectation propagation. In Z. Ghahramani and R. Cowell, editors, Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, pages 445-452. Society for Artificial Intelligence and Statistics, 2005.