Rethinking collapsed variational bayes inference for LDA

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 2, Issue , 2012, Pages 999-1006

  Sato, Issei ^a   Nakagawa, Hiroshi ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

LATENT DIRICHLET ALLOCATIONS; NOVEL INTERPRETATION; TAYLOR EXPANSION APPROXIMATION; VARIATIONAL BAYES;

STATISTICS;

LEARNING SYSTEMS;

EID: 84867130111     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Amari, S. Differential-Geometrical Methods in Statistic. Springer, New York, 1985.
2. Asuncion, A. Approximate mean field for dirichlet-based models. In Topic Models Workshop, ICML. 2010.
3. Asuncion, A., Welling, M., Smyth, P., and Teh, Y. W. On smoothing and inference for topic models. In Proceedings of the International Conference on Uncertainty in Artificial Intelligence, 2009.
4. Blei, D. M., Ng, A. Y., and Jordan, M. I. Latent Dirichlet allocation. Journal of Machine Learning Research, 3: 993-1022, 2003.
5. Griffiths, T. L. and Steyvers, M. Finding scientific topics. Proc Natl Acad Sci U S A, 101 Suppl 1:5228-5235, 2004. ISSN 0027-8424.
6. Hoffman, Matthew D., Blei, David M., and Bach, Francis R. Online learning for latent dirichlet allocation. In Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 2010, pp. 856-864, 2010.
7. Minka, T. and Lafferty, J. Expectation-Propagation for the generative aspect model. In Proceedings of the 18th Conference on Uncertainty in Artificial Intelligence (UAI). Morgan Kaufmann, 2002.
8. Minka, Thomas. Divergence measures and message passing. Technical report, Microsoft Research, 2005.
9. Minka, Thomas P. Estimating a dirichlet distribution. Technical report, Microsoft, 2000.
10. Rosen-Zvi, Michal, Jordan, Michael I., and Yuille, Alan L. The dlr hierarchy of approximate inference. In Proceedings of the 21st Conference in Uncertainty in Artificial Intelligence, pp. 493-500, 2005.
11. Sato, Issei, Kurihara, Kenichi, and Nakagawa, Hiroshi. Deterministic single-pass algorithm for Ida. In Advances in Neural Information Processing Systems 23, pp. 2074-2082. 2010.
12. Sung, Jaemo, Ghahramani, Zoubin, and Bang, Sung-Yang. Latent-space variational bayes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30:2236-2242, 2008. ISSN 0162-8828.
13. Teh, Yee Whye, Newman, David, and Welling, Max. A collapsed variational Bayesian inference algorithm for latent Dirichlet allocation. In Advances in Neural Information Processing Systems 19, 2007.
14. Teh, Yee Whye, Kurihara, Kenichi, and Welling, Max. Collapsed variational inference for hdp. In Advances in Neural Information Processing Systems 20, 2008.
15. Trottini, M. and Spezzaferri, F. A generalized predictive criterion for model selection. In Canadian Journal of Statisticse, 2002.
16. Wallach, Hanna, Mimno, David, and McCallum, Andrew. Rethinking Ida: Why priors matter. In Advances in Neural Information Processing Systems 22, pp. 1973-1981. 2009.
17. Wang, Chong, Paisley, John William, and Blei, David M. Online variational inference for the hierarchical dirichlet process. Journal of Machine Learning Research - Proceedings Track, 15:752-760, 2011.
18. Zhu, Huaiyu and Rohwer, Richard. Information geometric measurements of generalisation. Technical report, Aston University, 1995.