Online variational inference for the hierarchical Dirichlet process

Journal of Machine Learning Research

Volumn 15, Issue , 2011, Pages 752-760

  Wang, Chong ^a   Paisley, John ^a   Blei, David M ^a  

^a Princeton University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; DOCUMENT COLLECTION; HIERARCHICAL DIRICHLET PROCESS; INFERENCE ALGORITHM; INFINITE NUMBERS; LARGE-SCALE APPLICATIONS; MULTIPLE PASS; NON-PARAMETRIC MODEL; STREAMING DATA; TOPIC MODEL; VARIATIONAL INFERENCE;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; PROBABILITY DISTRIBUTIONS;

INFERENCE ENGINES;

EID: 84862277698     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (27)

1. Teh, Y., M. Jordan, M. Beal, et al. Hierarchical Dirichlet processes. Journal of the American Statistical Association, 101(476):1566-1581, 2007.
2. Blei, D., A. Ng, M. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research, 3:993-1022, 2003.
3. Teh, Y., K. Kurihara, M. Welling. Collapsed variational inference for HDP. In Neural Information Processing Systems. 2007.
4. Liang, P., S. Petrov, D. Klein, et al. The infinite PCFG using hierarchical Dirichlet processes. In Empirical Methods in Natural Language Processing. 2007.
5. Canini, K., L. Shi, T. Griffiths. Online inference of topics with latent Dirichlet allocation. In Artificial Intelligence and Statistics. 2009.
6. Rodriguez, A. On-line learning for the infinite hidden Markov model. Tech. Rep. UCSC-SOE-10-27, Department of Applied Mathematics and Statistics, University of California at Santa Cruz, 2010.
7. Hoffman, M., D. Blei, F. Bach. Online inference for latent Drichlet allocation. In NIPS. 2010.
8. Jordan, M., Z. Ghahramani, T. Jaakkola, et al. Introduction to variational methods for graphical models. Machine Learning, 37:183-233, 1999.
9. Robbins, H., S. Monro. A stochastic approximation method. The Annals of Mathematical Statistics, 22(3):pp. 400-407, 1951.
10. Amari, S. Natural gradient works efficiently in learning. Neural computation, 10(2):251-276, 1998.
11. Sato, M. Online model selection based on the variational Bayes. Neural Computation, 13(7):1649-1681, 2005.
12. Attias, H. A variational Bayesian framework for graphical models. In Advances in Neural Information Processing Systems 12. 2000.
13. Boyd-Graber, J., D. Blei. Syntactic topic models. In Neural Information Processing Systems. 2009.
14. Fox, E., E. Sudderth, M. Jordan, et al. An HDP-HMM for systems with state persistence. In International Conference on Machine Learning. 2008.
15. Sethuraman, J. A constructive definition of Dirichlet priors. Statistica Sinica, 4:639-650, 1994.
16. Ferguson, T. A Bayesian analysis of some nonparametric problems. The Annals of Statistics, 1:209-230, 1973.
17. Pitman, J. Poisson-Dirichlet and GEM invariant distributions for split-and-merge transformations of an interval partition. Combinatorics, Probability, and Computing, 11:501-514, 2002.
18. Blei, D., M. Jordan. Variational methods for the Dirichlet process. In 21st International Conference on Machine Learning. 2004.
19. Kurihara, K., M. Welling, Y. Teh. Collapsed variational Dirichlet process mixture models. In IJCAI. 2007.
20. Kurihara, K., M.Welling, N. Vlassis. Accelerated variational Dirichlet process mixtures. In B. Schölkopf, J. Platt, T. Hoffman, eds., Advances in Neural Information Processing Systems 19, pages 761-768. MIT Press, Cambridge, MA, 2007.
21. Wang, C., D. Blei. Variational inference for the nested Chinese restaurant process. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, A. Culotta, eds., Advances in Neural Information Processing Systems 22, pages 1990-1998. 2009.
22. Asuncion, A., M. Welling, P. Smyth, et al. On smoothing and inference for topic models. In Uncertainty in Artificial Intelligence. 2009.
23. Blei, D., J. Lafferty. Dynamic topic models. In International Conference on Machine Learning, pages 113-120. ACM, New York, NY, USA, 2006.
24. Wang, C., D. Blei, D. Heckerman. Continuous time dynamic topic models. In Uncertainty in Artificial Intelligence (UAI). 2008.
25. Griffiths, T., Z. Ghahramani. Infinite latent feature models and the Indian buffet process. In Y. Weiss, B. Schölkopf, J. Platt, eds., Advances in Neural Information Processing Systems 18, pages 475-482. MIT Press, Cambridge, MA, 2006.
26. Teh, Y., D. Gorur, Z. Ghahramani. Stick-breaking construction for the Indian buffet process. In 11th Conference on Artificial Intelligence and Statistics. 2007.
27. Doshi-Velez, F., K. Miller, J. Van Gael, et al. Variational inference for the Indian buffet process. In Proceedings of the Intl. Conf. on Artificial Intelligence and Statistics, pages 137-144. 2009.