Admixture of poisson MRFs: A topic model with word dependencies

31st International Conference on Machine Learning, ICML 2014

Volumn 2, Issue , 2014, Pages 1037-1047

  Inouye, David I ^a   Ravikumar, Pradeep ^a   Dhillon, Inderjit S ^a  

^a University of Texas at Austin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; EQUIVALENCE CLASSES; LEARNING SYSTEMS;

CONDITIONAL DISTRIBUTION; LOG LIKELIHOOD; MARKOV RANDOM FIELDS; MODEL DEPENDENCIES; MODELING POWER; QUANTITATIVE EXPERIMENTS; TOPIC MODEL; TOPIC MODELING;

MARKOV PROCESSES;

EID: 84919926912     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Beck, A. and Teboulle, M. A fast iterative shrinkage- thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1): 183-202, January 2009. ISSN 1936-4954.
2. Bishop, Y., Fienberg, S., and Holland, P. Sampling models for discrete data. In Discrete Multivariate Analysis: Theory and Practice, chapter 13, pp. 435-456. Springer, 2007.
3. Blei, D. Probabilistic topic models. Communications of the ACM, 55(4):77-84, November 2012. ISSN 1053-5888.
4. Blei, D, Ng, A., and Jordan, M. Latent dirichlet allocation. JMLR, 3:993-1022, 2003.
5. Blei, D. M. and Lafferty, J. D. Correlated topic models. In NIPS, pp. 147-154, 2005.
6. Blei, D. M. and Lafferty, J. D. Dynamic topic models. In ICML, pp. 113-120, 2006. ISBN 1595933832.
7. Chen, Y. and Ye, X. Projection onto a simplex. arXiv preprint arXiv:1101.6081, pp. 1-7, 2011.
8. Collins, M., Dasgupta, S and Schapire, R. E. A generalization of principal component analysis to the exponential family. In NIPS, pp. 617-624, 2001.
9. Gopalan, P., Hofman, J., and Blei, D. Scalable recommendation with poisson factorization. arXiv preprint arXiv:1311.1704, 2013.
10. Hinton, G. and Salakhutdinov, R. Replicated softmax: An undirected topic model. NIPS, pp. 1607-1614, 2009.
11. Hofmann, T. Probabilistic latent semantic analysis. In Uncertainty in Artificial Intelligence (UAI), pp. 289-296. Morgan Kaufmann Publishers Inc., 1999.
12. Hsieh, C, Sustik, M. A., Dhillon, I. S., Ravikumar, P. K and Poldrack, R. A. BIG & QUIC: Sparse inverse co- variance estimation for a million variables. In NIPS, pp. 3165-3173, 2013.
13. Hu, Y., Boyd-Graber, J., and Satinoff, B. Interactive topic modeling. In ACL, pp. 248-257, 2011.
14. Mimno, D, Wallach, H. M., Talley, E., Leenders, M., and McCallum, A. Optimizing semantic coherence in topic models. In EMNLP, pp. 262-272, 2011.
15. Nallapati, R., Ahmed, A., Cohen, W., and Xing, E. Sparse word graphs: A scalable algorithm for capturing word correlations in topic models. ICDM, pp. 343-348, 2007.
16. Newman, D, Noh, Y, Talley, E, Karimi, S, and Baldwin, T. Evaluating topic models for digital libraries. In ACM/IEEE Joint Conference on Digital Libraries (JCDL), pp. 215-224, 2010. ISBN 9781450300858.
17. Nigam, K., Mccallum, A. K., Thrun, S., and Mitchell, T. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39(2-3): 103-134, 2000.
18. Parikh, N. and Boyd, S. Proximal algorithms. Foundations and Trends in Optimization, 1(3): 123-231, 2013.
19. Pritchard, J. K., Stephens, M., and Donnelly, P. Inference of population structure using multilocus genotype data. Genetics, 155(2):945-59, June 2000. ISSN 0016-6731.
20. Ravikumar, P., Wainwright, M. J., and Lafferty, J. D. High- dimensional Ising model selection using 11-regularized logistic regression. The Annals of Statistics, 38(3): 1287- 1319, June 2010. ISSN 0090-5364.
21. Ravikumar, P., Wainwright, M. J., Raskutti, G., and Yu, B. High-dimensional covariance estimation by minimizing 11-penalized log-determinant divergence. Electronic Journal of Statistics, 5:935-980, 2011. ISSN 1935-7524.
22. Reisinger, J., Waters, A., Silverthorn, B., and Mooney, R. J. Spherical topic models. In ICML, pp. 903-910, 2010.
23. Slapin, J. and Proksch, S. A scaling model for estimating time-series party positions from texts. American Journal of Political Science, 52(3):705-722, 2008.
24. Stevens, K. and Kegelmeyer, P. Exploring topic coherence over many models and many topics. In EMNLP-CoNLL, pp. 952-961, 2012.
25. Steyvers, M. and Griffiths, T. Probabilistic topic models. In Latent Semantic Analysis: A Road to Meaning, pp. 424-440. 2007.
26. Steyvers, M, Smyth, P., Rosen-Zvi, M, and Griffiths, T. Probabilistic author-topic models for information discovery. In KDD, pp. 306-315, 2004. ISBN 1581138881.
27. Wainwright, M. J. and Jordan, M. I. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(12):1-305, 2008. ISSN 1935-8237.
28. Yang, E., Ravkiumar, P., Allen, G. I., and Liu, Z. Graphical models via generalized linear models. In NIPS, pp. 1367-1375, 2012.
29. Yang, E, Ravikumar, P., Allen, G., and Liu, Z. On poisson graphical models. In MPS, pp. 1718-1726, 2013.
30. Yuan, X. and Zhang, T. Truncated power method for sparse eigenvalue problems. JMLR, 14:899-925, 2013.