A collapsed variational Bayesian inference algorithm for latent Dirichlet allocation

Advances in Neural Information Processing Systems

Volumn , Issue , 2007, Pages 1353-1360

  Teh, Yee Whye ^a   Newman, David ^b   Welling, Max ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b Ringgold Standard Institution Informatics   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONALLY EFFICIENT; DOCUMENT MODELING; GIBBS SAMPLING; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; VARIATIONAL BAYES; VARIATIONAL BAYESIAN;

ALGORITHMS; COMPUTER VISION; INFERENCE ENGINES; STATISTICS;

BAYESIAN NETWORKS;

EID: 84864061876     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. D. Heckerman. A tutorial on learning with Bayesian networks. In M. I. Jordan, editor, Learning in Graphical Models. Kluwer Academic Publishers, 1999.
2. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent Dirichlet allocation. JMLR, 3, 2003.
3. W. Buntine. Variational extensions to EM and multinomial PCA. In ECML, 2002.
4. M. Rosen-Zvi, T. Griffiths,M. Steyvers, and P. Smyth. The author-topic model for authors and documents. In UAI, 2004.
5. T. L. Griffiths and M. Steyvers. Finding scientific topics. In PNAS, 2004.
6. L. Fei-Fei and P. Perona. A Bayesian hierarchical model for learning natural scene categories. In CVPR, 2005.
7. T. P. Minka and J. Lafferty. Expectation propagation for the generative aspect model. In UAI, 2002.
8. W. Buntine and A. Jakulin. Applying discrete PCA in data analysis. In UAI, 2004.
9. M. Opper and O. Winther. From naive mean field theory to the TAP equations. In D. Saad and M. Opper, editors, Advanced Mean Field Methods : Theory and Practice. The MIT Press, 2001.
10. G. Casella and C. P. Robert. Rao-Blackwellisation of sampling schemes. Biometrika, 83(1):81-94, 1996.
11. M. J. Beal. Variational Algorithms for Approximate Bayesian Inference. PhD thesis, Gatsby Computational Neuroscience Unit, University College London, 2003.
12. J. Sung, Z. Ghahramani, and S. Choi. Variational Bayesian EM: A second-order approach. Unpublished manuscript, 2005.
13. W. Li and A. McCallum. Pachinko allocation: DAG-structured mixture models of topic correlations. In ICML, 2006.
14. E. M. Airoldi, D. M. Blei, E. P. Xing, and S. E. Fienberg. Mixed membership stochastic block models for relational data with application to protein-protein interactions. In Proceedings of the International Biometrics Society Annual Meeting, 2006.
15. M. Welling and K. Kurihara. Bayesian K-means as a "maximization- expectation" algorithm. In SIAM Conference on Data Mining, 2006.