On estimation and selection for topic models

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 1184-1193

  Taddy, Matthew A ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SOFTWARE ENGINEERING;

BLOCK DIAGONAL; GOODNESS OF FIT; INFORMATION MATRIX; MARGINAL LIKELIHOOD; MODEL SELECTION; PARAMETRIZATIONS; RESIDUAL DISPERSIONS; TOPIC MODEL;

ARTIFICIAL INTELLIGENCE;

EID: 84954216017     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (33)

1. Airoldi, E. M., E. A. Erosheva, S. E. Fienberg, C. Joutard, T. Love, and S. Shringarpure (2010). Reconceptualizing the classification of pnas articles. Proceedings of the National Academy of Sciences 107, 20899-20904.
2. Alexander, D. H., J. Novembre, and K. Lange (2009). Fast model-based estimation of ancestry in unrelated individuals. Genome Research 19, 1655-1664.
3. Asuncion, A., M. Welling, P. Smyth, and Y. W. Teh (2009). On smoothing and inference for topic models. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence. UAI.
4. Berger, J. O., B. Liseo, and R. L. Wolpert (1999). Integrated likelihood methods for eliminating nuissance parameters. Statistical Science 14, 1-28.
5. Blei, D. M. and J. D. Lafferty (2006). Dynamic topic models. In Proceedings of the 23rd International Conference on Machine Learning. ICML.
6. Blei, D. M. and J. D. Lafferty (2007). A correlated topic model of Science. The Annals of Applied Statistics 1, 17-35.
7. Blei, D. M. and J. D. McAuliffe (2010). Supervised topic models. arXiv:1003.0783v1.
8. Blei, D. M., A. Y. Ng, and M. I. Jordan (2003). Latent Dirichlet allocation. Journal of Machine Learning Research 3, 993-1022.
9. Chang, J. (2011). lda: Collapsed Gibbs sampling methods for topic models. R package version 1.3.1.
10. Deerwester, S., S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman (1990). Indexing by latent semantic analysis. Journal of the American Society for Information Science 41, 391-407.
11. Gentzkow, M. and J. Shapiro (2010). What drives media slant? Evidence from U.S. daily newspapers. Econometrica 78, 35-72.
12. Griffiths, T. L. and M. Styvers (2004). Finding scientific topics. In Proceedings of the National Acadamy of Sciences, Volume 101, pp. 5228-5235. PNAS.
13. Grimmer, J. (2010). A Bayesian hierarchical topic model for political texts: Measuring expressed agendas in senate press releases. Political Analysis 18, 1-35.
14. Grün, B. and K. Hornik (2011). topicmodels: An R package for fitting topic models. Journal of Statistical Software 40, 1-30.
15. Haberman, S. J. (1973). The analysis of residuals in cross-classified tables. Biometrics 29, 205-220.
16. Hastie, T., R. Tibshrani, and J. H. Friedman (2009). The Elements of Statistical Learning. Springer.
17. Hofmann, T. (1999). Probabilistic latent semantic indexing. In Proceedings of the Twenty-Second Annual International SIGIR Conference.
18. Ipsen, I. and D. Lee (2011). Determinant approximations.http://arxiv.org/abs/1105.0437v1.
19. Kass, R. E. and A. E. Raftery (1995). Bayes factors. Journal of the American Statistical Association 90, 773-795.
20. Lange, K. (2010). Numerical Analysis for Statisticians (2nd ed.). Springer.
21. Luenberger, D. G. and Y. Ye (2008). Linear and Nonlinear Programming (3rd ed.). Springer.
22. Mackay, D. (1998). Choice of basis for laplace approximation. Machine Learning 33, 77-86.
23. Neal, R. (2000). Markov chain sampling methods for Dirichlet process mixture models. Journal of Computational and Graphical Statistics 9, 249-265.
24. Pritchard, J. K., M. Stephens, and P. Donnelly (2000). Inference of polulation structure using multilocus genotype data. Genetics 155, 945-959.
25. Roeder, K. and L. Wasserman (1997). Practical Bayesian density estimation using mixtures of normals. Journal of the American Statistical Association 92, 894-902.
26. Taddy, M. A. (2011). Inverse regression for analysis of sentiment in text. Submitted. http://arxiv.org/abs/1012.2098.
27. Tang, H., M. Coram, P. Wang, X. Zhu, and N. Risch (2006). Reconstructing genetic ancestry blocks in admixed individuals. American Journal of Human Genetics 79, 1-12.
28. Teh, Y. W., M. I. Jordan, M. J. Beal, and D. M. Blei (2006). Hierarchical Dirichlet processes. Journal of the American Statistical Association 101, 1566-1581.
29. Teh, Y. W., D. Newman, and M. Welling (2006). A collapsed variational Bayesian inference algorithm for latent Dirichlet allocation. In Neural Information Processing Systems, pp. 1-8. NIPS.
30. Tierney, L. and J. B. Kadane (1986). Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association 81, 82-86.
31. Wainwright, M. J. and M. I. Jordan (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning 1, 1-305.
32. Wallach, H. M., D. Mimno, and A. McCallum (2009). Rethinking LDA: Why priors matter. In Neural Information Processing Systems. NIPS.
33. Yao, L., D. Mimno, and A. McCallum (2009). Efficient methods for topic model inference on streaming document collections. In 15th Conference on Knowledge Discovery and Data Mining.