Scalable deep Poisson factor analysis for topic modeling

32nd International Conference on Machine Learning, ICML 2015

Volumn 3, Issue , 2015, Pages 1823-1832

  Gan, Zhe ^a   Chen, Changyou ^a   Henao, Ricardo ^a   Carlson, David ^a   Carin, Lawrence ^a  

^a Duke University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BINS; INFERENCE ENGINES; LEARNING SYSTEMS; MULTIVARIANT ANALYSIS; STOCHASTIC SYSTEMS;

CONDITIONAL DENSITY; FACTOR ANALYSIS MODEL; FILTERING ALGORITHM; INFERENCE ALGORITHM; MULTILAYER MODELS; RESTRICTED BOLTZMANN MACHINE; STOCHASTIC GRADIENT; TOPIC STRUCTURES;

FACTOR ANALYSIS;

EID: 84970024465     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. Blei, D. M. and Lafferty, J. D. A correlated topic model of science. The Annals of Applied Statistics, 2007.
2. Blei, D. M., Ng, A. Y., and Jordan, M. I. Latent Dirichlet allocation. JMLR, 2003.
3. Blei, D. M., Griffiths, T., Jordan, M. I., and Tenenbaum, J. B. Hierarchical topic models and the nested Chinese restaurant process. NIPS, 2004.
4. Byrne, S. and Girolami, M. Geodesic Monte Carlo on embedded manifolds. Scandinavian J. Statist, 2013.
5. Chen, T., Fox, E., and Guestrin, C. Stochastic gradient Hamiltonian Monte Carlo. ICML, 2014.
6. Danilo, J. R., Shakir, M., and Daan, W. Stochastic back-propagation and approximate inference in deep generative models. ICML, 2014.
7. Ding, N., Fang, Y., Babbush, R., Chen, C., Skeel, R. D., and Neven, H. Bayesian sampling using stochastic gradient thermostats. NIPS, 2014.
8. Gan, Z., Henao, R., Carlson, D., and Carin, L. Learning deep sigmoid belief networks with data augmentation. AISTATS, 2015.
9. Girolami, M. and Calderhead, B. Riemann manifold Langevin and Hamiltonian Monte Carlo methods. J. R. Statist. Soc. B, 2011.
10. Guhaniyogi, R., Qamar, S., and Dunson, D. B. Bayesian conditional density filtering. arXiv: 1401.3632, 2014.
11. Hinton, G. E. Training products of experts by minimizing contrastive divergence. Neural computation, 2002.
12. Hinton, G. E. and Salakhutdinov, R. Discovering binary codes for documents by learning deep generative models. Topics in Cognitive Science, 2011.
13. Hinton, G. E., Osindero, S., and Teh, Y. W. A fast learning algorithm for deep belief nets. Neural computation, 2006.
14. Ho, Q., Cipar, J., Cui, H., Kim, J. K., Lee, S., Gibbons, P. B., Gibbons, G. A., Ganger, G. R., and Xing, E. P. More effective distributed ml via a stale synchronous parallel parameter server. NIPS, 2013.
15. Hoffman, M. D., Blei, D. M., and Bach, F. Online learning for latent Dirichlet allocation. NIPS, 2010.
16. Hoffman, M. D., Blei, D. M., Wang, C., and Paisley, J. Stochastic variational inference. JMLR, 2013.
17. Kingma, D. P. and Welling, M. Auto-encoding variational Bayes. ICLR, 2014.
18. Larochelle, H. and Lauly, S. A neural autoregressive topic model. NIPS, 2012.
19. Li, M., Andersen, D., Smola, A., and Yu, K. Communication efficient distributed machine learning with the parameter server. NIPS, 2014.
20. Maaloe, L., Arngren, M., and Winther, O. Deep belief nets for topic modeling. arXiv.1501.04325, 2015.
21. Mimno, D., Hoffman, M. D., and Blei, D. M. Sparse stochastic inference for latent Dirichlet allocation. ICML, 2012.
22. Mnih, A. and Gregor, K. Neural variational inference and learning in belief networks. ICML, 2014.
23. Neal, R. M. Connectionist learning of belief networks. Artificial Intelligence, 1992.
24. Paisley, J., Wang, C., Blei, D. M., and Jordan, M. I. Nested hierarchical Dirichlet processes. PAMI, 2015.
25. Patterson, S. and Teh, Y. W. Stochastic gradient Rie-mannian Langevin dynamics on the probability simplex. NIPS, 2013.
26. Polson, N. G. and Scott, J. G. Local shrinkage rules, Lévy processes and regularized regression. J. R. Statist. Soc. B, 2012.
27. Polson, N. G., Scott, J. G., and Windle, J. Bayesian inference for logistic models using Pólya-Gamma latent variables. JASA, 2013.
28. Ranganath, R., Tang, L., Charlin, L., and Blei, D. M. Deep exponential families. AISTATS, 2015.
29. Salakhutdinov, R. and Hinton, G. E. Replicated softmax: an undirected topic model. NIPS, 2009a.
30. Salakhutdinov, R. and Hinton, G. E. Deep Boltzmann machines. AISTATS, 2009b.
31. Srivastava, N., Salakhutdinov, R., and Hinton, G. E. Modeling documents with deep Boltzmann machines. UAI, 2013.
32. Teh, Y. W., Jordan, M. I., Beal, M. J., and Blei, D. M. Hierarchical Dirichlet processes. JASA, 2006.
33. Tuckerman, M. E. Statistical Mechanics: Theory and Molecular Simulation. Oxford University Press, 2010.
34. Wang, C. and Blei, D. M. Truncation-free stochastic variational inference for Bayesian nonparametric models. NIPS, 2012.
35. Welling, M. and Teh, Y. W. Bayesian learning via stochastic gradient Langevin dynamics. ICML, 2011.
36. Williamson, S., Wang, C., Heller, K., and Blei, D. M. The IBP compound Dirichlet process and its application to focused topic modeling. ICML, 2010.
37. Yuille, A. The convergence of contrastive divergences. NIPS, 2005.
38. Zhang, X. and Carin, L. Joint modeling of a matrix with associated text via latent binary features. NIPS, 2012.
39. Zhou, M. and Carin, L. Negative binomial process count and mixture modeling. PAM1, 2015.
40. Zhou, M., Hannah, L., Dunson, D., and Carin, L. Beta-negative binomial process and Poisson factor analysis. AISTATS, 2012.