Concave Gaussian variational approximations for inference in large-scale Bayesian linear models

Journal of Machine Learning Research

Volumn 15, Issue , 2011, Pages 199-207

  Challis, Edward ^a   Barber, David ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE BAYESIAN INFERENCE; CONCAVE FUNCTION; GAUSSIAN APPROXIMATIONS; GAUSSIANS; KULLBACK LEIBLER DIVERGENCE; KULLBACK-LEIBLER; LOWER BOUNDS; MARGINAL LIKELIHOOD; OPTIMISATIONS; VARIATIONAL APPROXIMATION; VARIATIONAL METHODS;

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; EQUIVALENCE CLASSES; INFERENCE ENGINES;

GAUSSIAN DISTRIBUTION;

EID: 84862280449     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (17)

1. D. Barber. Bayesian Reasoning and Machine Learning. Cambridge University Press, 2011.
2. D. Barber and C. Bishop. Ensemble Learning in Bayesian Neural Networks. In Neural Networks and Machine Learning, pages 215-237. Springer, 1998.
3. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, 2004.
4. M. Gibbs and D. MacKay. Variational Gaussian Process Classifiers. IEEE Transactions on Neural Networks, 11(6):1458-1464, 2000.
5. M. Girolami. A Variational Method for Learning Sparse and Overcomplete Representations. Neural Computation, 13(11):2517-2532, 2001.
6. J. Hardin and J. Hilbe. Generalized Linear Models and Extensions. Stata Press, 2007.
7. T. Jaakkola and M. Jordan. A variational approach to Bayesian logistic regression problems and their extensions. In Artificial Intelligence and Statistics, 1996.
8. T. Jaakkola and M. Jordan. Bayesian parameter estimation via variational methods. Statistics and Computing, 10(1):25-37, 2000.
9. M. Kuss and C. Rasmussen. Assessing Approximate Inference for Binary Gaussian Process Classification. Journal of Machine Learning Research, 6: 1679-1704, 2005.
10. H. Nickisch and C. Rasmussen. Approximations for Binary Gaussian Process Classification. Journal of Machine Learning Research, 9:2035-2078, 10 2008.
11. H. Nickisch and M. Seeger. Convex Variational Bayesian Inference for Large Scale Generalized Linear Models. International Conference on Machine Learning, 26:761-768, 2009.
12. M. Opper and C. Archambeau. The Variational Gaussian Approximation Revisited. Neural Computation, 21(3):786-792, 2009.
13. A. Palmer, D. Wipf, K. Kreutz-Delgado, and B. Rao. Variational EM algorithms for non-Gaussian latent variable models. In B. Schölkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Informa-tion Processing Systems (NIPS), number 19, pages 1059-1066, Cambridge, MA, 2006. MIT Press.
14. M. Seeger. Bayesian Model Selection for Support Vector Machines, Gaussian Processes and other Kernel Classifiers. In S. Solla, T. Leen, and Müller, editors, Advances in Neural Information Processing Systems (NIPS), number 12, pages 603-609, Cambridge, MA, 1999. MIT Press.
15. M. Seeger. Sparse linear models: Variational approximate inference and Bayesian experimental design. Journal of Physics: Conference Series, 197(1), 2009.
16. M. Seeger and H. Nickisch. Large Scale Variational Inference and Experimental Design for Sparse Generalized Linear Models. Technical report, Max Planck Institute for Biological Cybernetics, http://arxiv.org/abs/0810.0901, 2010.
17. D. Wipf and S. Nagarajan. A unified Bayesian framework for MEG/EEG source imaging. NeuroImage, 44(3):947-966, 2009.