Fast dual variational inference for non-conjugate latent gaussian models

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 3, 2013, Pages 1988-1996

  Khan, Mohammad Emtiyaz ^a   Aravkin, Aleksandr Y ^b   Friedlander, Michael P ^c   Seeger, Matthias ^a  

^a EPFL   (Switzerland)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; CONVEX OPTIMIZATION; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); INFERENCE ENGINES; LEARNING SYSTEMS; MARKOV PROCESSES;

BAYESIAN INFERENCE; CONVEX OPTIMIZATION PROBLEMS; CONVEXITY PROPERTIES; GAUSSIAN MARKOV RANDOM FIELD; GAUSSIAN PROCESS CLASSIFICATIONS; OPTIMIZATION PROBLEMS; VARIATIONAL INFERENCE; VARIATIONAL PARAMETERS;

APPROXIMATION ALGORITHMS;

EID: 84897522166     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Blei, D. and Lafferty, J. Correlated topic models. In Advances in Neural Information Processing Systems, 2006.
2. Braun, M. and McAuliffe, J. Variational inference for large-scale models of discrete choice. Journal of the American Statistical Association, 105(489):324-335, 2010.
3. Challis, E. and Barber, D. Concave Gaussian variational approximations for inference in large-scale Bayesian linear models. In International conference on Artificial Intelligence and Statistics, volume 6, pp. 7, 2011.
4. Girolami, M. and Rogers, S. Variational Bayesian multinomial probit regression with Gaussian process priors. Neural Comptuation, 18(8):1790-1817, 2006. (Pubitemid 44036395)
5. Honkela, A., Raiko, T., Kuusela, M., Tornio, M., and Karhunen, J. Approximate Riemannian conjugate gradient learning for fixed-form variational Bayes. Journal of Machine Learning Research, 11:-3235-3268, 2011.
6. Jojic, Vladimir, Gould, Stephen, and Roller, Daphne. Accelerated dual decomposition for map inference. In International Conference on Machine Learning, 2010.
7. Khan, Mohammad Emtiyaz. Variational Learning for Latent Gaussian Models of Discrete Data. PhD thesis, University of British Columbia, 2012.
8. Khan, Mohammad Emtiyaz, Mohamed, Shakir, Marlin, Benjamin, and Murphy, Kevin. A stick breaking likelihood for categorical data analysis with latent Gaussian models. In International conference on Artificial Intelligence and Statistics, 2012a.
9. Khan, Mohammad Emtiyaz, Mohamed, Shakir, and Murphy, Kevin. Fast Bayesian inference for non-conjugate Gaussian process regression. In Advances in Neural Information Processing Systems, 2012b.
10. Knowles, D. and Minka, T. Non-conjugate variational message passing for multinomial and binary regression. In Advances in Neural Information Processing Systems, 2011.
11. Lázaro-Gredilla, M. and Titsias, M. Variational heteroscedastic Gaussian process regression. In International Conference on Machine Learning 28, 2011.
12. Marlin, B., Khan, M., and Murphy, K. Piecewise bounds for estimating Bernoulli-logistic latent Gaussian models. In International Conference on Machine Learning, 2011.
13. Minka, T. Expectation propagation for approximate Bayesian inference. In Uncertainty in Artificial Intelligence 17, 2001.
14. Nickisch, H. and Rasmussen, C.E. Approximations for binary Gaussian process classification. Journal of Machine Learning Research, 9(10), 2008.
15. Opper, M. and Archambeau, C. The variational Gaussian approximation revisited. Neural computation, 21(3):786-792, 2009.
16. Rasmussen, Carl Edward and Williams, Christopher K. I. Gaussian Processes for Machine Learning. MIT Press, 2006.
17. Rockafellar, R. Convex Analysis. Princeton University Press, 1970.
18. Rue, H. and Held, L. Gaussian Markov Random Fields: Theory and Applications, volume 104 of Monographs on Statistics and Applied Probability. Chapman & Hall, London, 2005.
19. Rue, H., Martino, S., and Chopin, N. Approximate Bayesian inference for latent Gaussian models using integrated nested Laplace approximations. Journal of Royal Statistical Sociecty, Series B, 71:319-392, 2009.
20. Seeger, M. Bayesian inference and optimal design for the sparse linear model. Journal of Machine Learning Research, 9:759-813, 2008.
21. Seeger, M. Sparse linear models: Variational approximate inference and Bayesian experimental design. Journal of Physics: Conference Series, 197(012001), 2009.
22. Seeger, M. and Nickisch, H. Large scale Bayesian inference and experimental design for sparse linear models. SIAM J. Imag. Sciences, 4(1):166-199, 2011.
23. Sontag, David, Globerson, Amir, and Jaakkola, Tommi. Introduction to dual decomposition for inference. Optimization for Machine Learning, 1, 2011.
24. Tipping, M. Sparse Bayesian learning and the relevance vector machine. Journal of Machine Learning Research, 1:211-244, 2001. (Pubitemid 33687203)