Hybrid variational/Gibbs collapsed inference in topic models

Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008

Volumn , Issue , 2008, Pages 587-594

  Welling, Max ^a   Teh, Yee Whye ^b   Kappen, Bert ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COSTS; GIBBS SAMPLING; HYBRID ALGORITHMS; INFERENCE ALGORITHM; TEST SETS; TOPIC MODEL; VARIATIONAL BAYESIAN; VARIATIONAL INFERENCE;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS;

INFERENCE ENGINES;

EID: 66849117589     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Beal, M. (2003). Variational algorithms for approximate Bayesian inference (Technical Report). Gatsby Computational Neuroscience Unit, University College London, London, UK. PhD. Thesis.
2. Bidyuk, B., & Dechter, R. (2007). Cutset sampling for Bayesian networks. Journal Artificial Intelligence Research, 28, 1-48. (Pubitemid 46790299)
3. Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022.
4. Buntine,W. (Ed.). (2002). Variational extensions to em and multinomial pca, vol. 2430 of Lecture Notes in Computer Science. Helsinki, Finland: Springer.
5. Carbonetto, P., & de Freitas, N. (2006). Conditional mean field. NIPS.
6. Castella, G., & Robert, C. (1996). Rao-blackwellisation of sampling schemes. Biometrika, 83(1), 81-94.
7. Celeux, G., & Diebolt, J. (1985). The SEM algorithm: a probabilistic teacher algorithm derived from the EM algorithm for the mixture problem. Comp. Statis. Quaterly, 2, 73-82.
8. de Freitas, N., d. F. R. Hojen-Sorensen, P. A., & Russell, S. J. (2001). Variational mcmc. UAI '01: Proceedings of the 17th Conference in Uncertainty in Artificial Intelligence (pp. 120-127).
9. Griffiths, T., & Steyvers, M. (2002). A probabilistic approach to semantic representation. Proceedings of the 24th Annual Conference of the Cognitive Science Society.
10. Heckerman, D. (1999). A tutorial on learning with bayesian networks. 301-354.
11. Minka, T. (2000). Estimating a dirichlet distribution (Technical Report).
12. Scott, S. L. (2002). Bayesian methods for hidden Markov models, recursive computing in the 21st century (pp. 337-351. ).
13. Teh, Y., Jordan, M., Beal, M., & Blei, D. (2004). Hierarchical Dirichlet processes. NIPS.
14. Teh, Y., Newman, D., & Welling, M. (2006). A collapsed variational bayesian inference algorithm for latent dirichlet allocation. NIPS.
15. Teh, Y. W., Kurihara, K., & Welling, M. (2008). Collapsed variational inference for HDP. Advances in Neural Information Processing Systems.