Sparse stochastic inference for latent Dirichlet allocation

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 2, Issue , 2012, Pages 1599-1606

  Mimno, David ^a   Hoffman, Matthew D ^b   Blei, David M ^a  

^a Princeton University   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GIBBS SAMPLING; HYBRID ALGORITHMS; LATENT DIRICHLET ALLOCATION; STOCHASTIC INFERENCE; TOPIC MODEL; VARIATIONAL INFERENCE;

ALGORITHMS; LEARNING SYSTEMS; STATISTICS; STOCHASTIC SYSTEMS;

INFERENCE ENGINES;

EID: 84867121232     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Ahmed, Amr, Aly, Mohamed, Gonzalez, Joseph, Narayanamurthy, Shravan, and Smola, Alexander. Scalable inference in latent variable models. In WSDM, 2012.
2. Asuncion, Arthur, Smyth, Padhraic, and Welling, Max. Asynchronous distributed learning of topic models. In NIPS, 2008.
3. Bishop, Christopher M. Pattern Recognition and Machine Learning. Springer, 2006.
4. Blei, David, Ng, Andrew, and Jordan, Michael. Latent Dirichlet allocation. Journal of Machine Learning Research, 3:993-1022, January 2003.
5. Buntine, Wray L. Estimating likelihoods for topic models. In Asian Conference on Machine Learning, 2009.
6. Cappé, Olivier and Moulines, Eric. Online EM algorithm for latent data models. Journal of the Royal Statistical Society Series B, 71(3):593-613, 2009.
7. Delyon, Bernard, Lavielle, Marc, and Moulines, Eric. Convergence of a stochastic approximation version of the EM algorithm. Annals of Statistics, 27(1):94-128, 1999.
8. Griffiths, Thomas L. and Steyvers, Mark. Finding scientific topics. PNAS, 101(suppl. 1):5228-5235, 2004.
9. Hoffman, Matthew, Blei, David, and Bach, Francis. Online learning for latent dirichlet allocation. In NIPS, 2010.
10. Jordan, Michael, Ghahramani, Zoubin, Jaakkola, Tommi, and Saul, Laurence. Introduction to variational methods for graphical models. Machine Learning, 37:183-233, 1999.
11. Kuhn, Estelle and Lavielle, Marc. Coupling a stochastic approximation version of EM with an MCMC procedure. ESAIM: Probability and Statistics, 8:115-131, August 2004.
12. Michel, Jean-Baptiste, Shen, Yuan Kui, Aiden, Aviva Presser, Veres, Adrian, Gray, Matthew K., Team, The Google Books, Pickett, Joseph P., Hoiberg, Dale, Clancy, Dan, Norvig, Peter, Orwant, Jon, Pinker, Steven, Nowak, Martin A., , and Aiden, Erez Lieberman. Quantitative analysis of culture using millions of digitized books. Science, 311, 2011.
13. Mimno, David, Wallach, Hanna, Talley, Edmund, Leenders, Miriam, and McCallum, Andrew. Optimizing semantic coherence in topic models. In EMNLP, 2011.
14. Newman, David, Lau, Jey Han, Grieser, Karl, and Baldwin, Timothy. Automatic evaluation of topic coherence. In Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics, 2010.
15. Sato, M.A. Online model selection based on the variational Bayes. Neural Computation, 13(7):1649-1681, 2001.
16. Teh, Yee-Whye, Newman, David, and Welling, Max. A collapsed variational bayesian inference algorithm for latent dirichlet allocation. In NIPS, 2006.
17. Wahabzada, Mirwaes and Kersting, Kristian. Larger residuals, less work: Active document scheduling for latent Dirichlet allocation. In ECML/PKDD, 2011.
18. Wallach, Hanna, Murray, Iain, Salakhutdinov, Ruslan, and Mimno, David. Evaluation methods for topic models. In ICML, 2009.