Annealing paths for the evaluation of topic models

Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014

Volumn , Issue , 2014, Pages 220-229

  Foulds, James ^a   Smyth, Padhraic ^a  

^a Irvine   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ANNEALING; ARTIFICIAL INTELLIGENCE; ITERATIVE METHODS; LEARNING ALGORITHMS; MONTE CARLO METHODS; STATISTICS;

LATENT DIRICHLET ALLOCATION; LIKELIHOOD ESTIMATE; MODELS AND ALGORITHMS; MONTE CARLO TECHNIQUES; PREDICTIVE PERFORMANCE; PROPOSAL DISTRIBUTION; RELATIVE PERFORMANCE; TRAINING PROCEDURES;

IMPORTANCE SAMPLING;

EID: 84923275273     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Blei, D.M., Ng, A.Y., and Jordan, M.I. Latent Dirichlet allocation. The Journal of Machine Learning Research, 3:993-1022, 2003.
2. Buntine, W. Estimating likelihoods for topic models. In Advances in Machine Learning. First Asian Conference on Machine Learning, ACML 2009, Nanjing, China, November 2-4, 2009. Proceedings, volume 5828 of Lecture Notes in Computer Science, pp. 51-64. Springer, 2009.
3. Chang, Jonathan, Boyd-Graber, Jordan, Gerrish, Sean, Wang, Chong, and Blei, David. Reading tea leaves: How humans interpret topic models. In Advances in Neural Information Processing Systems 22, pp. 288-296, 2009.
4. Foulds, J. R. Latent Variable Modeling for Networks and Text: Algorithms, Models and Evaluation Techniques. PhD thesis, University of California, Irvine, 2014.
5. Foulds, J. R., Boyles, L., DuBois, C., Smyth, P., and Welling, M. Stochastic collapsed variational Bayesian inference for latent Dirichlet allocation. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 446-454, 2013.
6. Grimmer, Justin. A Bayesian hierarchical topic model for political texts: Measuring expressed agendas in Senate press releases. Political Analysis, 18(1):1-35, 2010.
7. Grosse, Roger, Maddison, Chris, and Salakhutdinov, Ruslan. Annealing between distributions by averaging moments. In Advances in Neural Information Processing Systems 26, pp. 2769-2777, 2013.
8. Hoffman, Matt, Blei, David M, Wang, Chong, and Paisley, John. Stochastic variational inference. Journal of Machine Learning Research, 14(1):1303-1347, 2013.
9. Hoffman, Matthew, Bach, Francis R, and Blei, David M. Online learning for latent Dirichlet allocation. In Advances in Neural Information Processing Systems, pp. 856-864, 2010.
10. McCallum, Andrew Kachites. Mallet: A machine learning for language toolkit. http://mallet.cs.umass.edu, 2002.
11. McFarland, Daniel A, Ramage, Daniel, Chuang, Jason, Heer, Jeffrey, Manning, Christopher D, and Jurafsky, Daniel. Differentiating language usage through topic models. Poetics, 41(6):607-625, 2013.
12. Mimno, D. and McCallum, A. Topic models conditioned on arbitrary features with Dirichlet-multinomial regression. In Proceedings of the Twenty-Fourth International Conference on Uncertainty in Artificial Intelligence, pp. 411-418, 2008.
13. Mimno, David, Wallach, Hanna M, Talley, Edmund, Leenders, Miriam, and McCallum, Andrew. Optimizing semantic coherence in topic models. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 262-272.Association for Computational Linguistics, 2011.
14. Neal, R.M. Annealed importance sampling. Statistics and Computing, 11(2):125-139, 2001.
15. Newman, David, Lau, Jey Han, Grieser, Karl, and Baldwin, Timothy. Automatic evaluation of topic coherence. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 100-108. Association for Computational Linguistics, 2010.
16. Nguyen, Viet-An, Boyd-Graber, Jordan, Resnik, Philip, Cai, Deborah A, Midberry, Jennifer E, and Wang, Yuanxin. Modeling topic control to detect influence in conversations using nonparametric topic models. Machine Learning, pp. 1-41, 2013.
17. Radev, Dragomir R., Muthukrishnan, Pradeep, Qazvinian, Vahed, and Abu-Jbara, Amjad. The ACL anthology network corpus. Language Resources and Evaluation, 47 (4):919-944, 2013.
18. Rosen-Zvi, M., Griffiths, T., Steyvers, M., and Smyth, P. The author-topic model for authors and documents. In Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, pp. 487-494. AUAI Press, 2004.
19. Scott, J.G. and Baldridge, J. A recursive estimate for the predictive likelihood in a topic model. In Proceedings of the Sixteenth International Conference on Artificial Intelligence and Statistics, pp. 527-535, 2013.
20. Wallach, Hanna M, Mimno, David M, and McCallum, Andrew. Rethinking LDA: Why priors matter. In Advances in Neural Information Processing Systems 22, pp. 1973-1981, 2009a.
21. Wallach, H.M., Murray, I., Salakhutdinov, R., and Mimno, D. Evaluation methods for topic models. In International Conference onMachine Learning, pp. 1105-1112. ACM, 2009b.