Stm: An R package for structural topic models

Journal of Statistical Software

Volumn 91, Issue , 2019, Pages

  Roberts, Margaret E ^a   Stewart, Brandon M ^b   Tingley, Dustin ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b PRINCETON UNIVERSITY   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

LDA; R; Stm; Structural topic model; Text analysis

Indexed keywords

EID: 85074464991     PISSN: 15487660     EISSN: None     Source Type: Journal    
DOI: 10.18637/jss.v091.i02     Document Type: Article

References (72)

1. Ahmed A, Xing EP (2007). “Seeking the Truly Correlated Topic Posterior – On Tight Approximate Inference of Logistic-Normal Admixture Model.” In M Meila, X Shen (eds.), Proceedings of the Eleventh International Conference on Artificial Intelligence and Statistics, volume 2 of Proceedings of Machine Learning Research, pp. 19–26. PMLR, San Juan, Puerto Rico. URL http://proceedings.mlr.press/v2/ahmed07a.html.
2. Ahmed A, Xing EP (2010). “Timeline: A Dynamic Hierarchical Dirichlet Process Model for Recovering Birth/Death and Evolution of Topics in Text Stream.” In Proceedings of the 26th International Conference on Conference on Uncertainty in Artificial Intelligence, pp. 20–29.
3. Airoldi EM, Bischof JM (2016). “Improving and Evaluating Topic Models and Other Models of Text.” Journal of the American Statistical Association, 111(516), 1381–1403. doi: 10.1080/01621459.2015.1051182.
4. Arora S, Ge R, Halpern Y, Mimno D, Moitra A, Sontag D, Wu Y, Zhu M (2013). “A Practical Algorithm for Topic Modeling with Provable Guarantees.” In S Dasgupta, D McAllester (eds.), Proceedings of the 30th International Conference on Machine Learning, volume 28 of Proceedings of Machine Learning Research, pp. 280–288. PMLR, Atlanta. URL http://proceedings.mlr.press/v28/arora13.html.
5. Asuncion A, Welling M, Smyth P, Teh YW (2009). “On Smoothing and Inference for Topic Models.” In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, UAI ’09, pp. 27–34. AUAI Press, Arlington. URL http://dl.acm.org/citation. cfm?id=1795114.1795118.
6. Bates D, Maechler M (2019). Matrix: Sparse and Dense Matrix Classes and Methods. R package version 1.2-17, URL https://CRAN.R-project.org/package=Matrix.
7. Bengtsson H (2018). MatrixStats: Functions That Apply to Rows and Columns of Matrices (and to Vectors). R package version 0.54.0, URL https://CRAN.R-project.org/package= matrixStats.
8. Benoit K, Obeng A (2019). readtext: Import and Handling for Plain and Formatted Text Files. R package version 0.74, URL https://CRAN.R-project.org/package=readtext.
9. Benoit K, Watanabe K, Wang H, Nulty P, Obeng A, Müller S, Matsuo A (2018). “quanteda: An R Package for the Quantitative Analysis of Textual Data.” Journal of Open Source Software, 3(30), 774. doi:10.21105/joss.00774.
10. Bischof J, Airoldi E (2012). “Summarizing Topical Content with Word Frequency and Ex-clusivity.” In J Langford, J Pineau (eds.), Proceedings of the 29th International Conference on Machine Learning, ICML ’12, pp. 201–208. Omnipress, New York.
11. Blei DM, Lafferty JD (2007). “A Correlated Topic Model of Science.” The Annals of Applied Statistics, 1(1), 17–35. doi:10.1214/07-aoas114.
12. Blei DM, Ng A, Jordan M (2003). “Latent Dirichlet Allocation.” Journal of Machine Learning Research, 3, 993–1022.
13. Bouchet-Valat M, Porter M, Boulton R (2019). SnowballC: Snowball Stemmers Based on the C libstemmer UTF-8 Library. R package version 0.6.0, URL https://CRAN.R-project. org/package=SnowballC.
14. Chang J (2015). lda: Collapsed Gibbs Sampling Methods for Topic Models. R package version 1.4.2, URL https://CRAN.R-project.org/package=lda.
15. Coppola A, Roberts M, Stewart B, Tingley D (2016). stmCorrViz: A Tool for Structural Topic Model Visualizations. R package version 1.3, URL https://CRAN.R-project.org/package=stmCorrViz.
16. Csardi G, Nepusz T (2006). “The igraph Software Package for Complex Network Research.” InterJournal, Complex Systems, 1695(5), 1–9. URL http://igraph.org.
17. Dowle M, Srinivasan A (2017). data.table: Extension of data.frame. R package version 1.10.4, URL https://CRAN.R-project.org/package=data.table.
18. Eddelbuettel D, François R (2011). “Rcpp: Seamless R and C++ Integration.” Journal of Statistical Software, 40(8), 1–18. doi:10.18637/jss.v040.i08.
19. Eddelbuettel D, Sanderson C (2014). “RcppArmadillo: Accelerating R with High-Performance C++ Linear Algebra.” Computational Statistics & Data Analysis, 71, 1054–1063. doi: 10.1016/j.csda.2013.02.005.
20. Eisenstein J, Ahmed A, Xing EP (2011). “Sparse Additive Generative Models of Text.” In Proceedings of the 28th International Conference on Machine Learning, pp. 1041–1048.
21. Eisenstein J, O’Connor B, Smith NA, Xing EP (2010). “A Latent Variable Model for Geographic Lexical Variation.” In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp. 1277–1287. Association for Computational Linguistics.
22. Eisenstein J, Xing E (2010). The CMU 2008 Political Blog Corpus. Carnegie Mellon University.
23. Feinerer I, Hornik K, Meyer D (2008). “Text Mining Infrastructure in R.” Journal of Statistical Software, 25(5), 1–54. doi:10.18637/jss.v025.i05.
24. Fellows I (2018). wordcloud: Word Clouds. R package version 2.6, URL https://CRAN. R-project.org/package=wordcloud.
25. Foulds J, Kumar S, Getoor L (2015). “Latent Topic Networks: A Versatile Probabilistic Programming Framework for Topic Models.” In International Conference on Machine Learning, pp. 777–786.
26. Freeman MK, Chuang J, Roberts ME, Stewart BM, Tingley D (2015). stmBrowser: Structural Topic Model Browser. R package version 1.0, URL https://github.com/mroberts/stmBrowser.
27. Friedman J, Hastie T, Tibshirani R (2010). “Regularization Paths for Generalized Linear Models via Coordinate Descent.” Journal of Statistical Software, 33(1), 1–22. doi:10. 18637/jss.v033.i01.
28. Gerrish S, Blei D (2012). “How They Vote: Issue-Adjusted Models of Legislative Behavior.” In Advances in Neural Information Processing Systems 25, pp. 2762–2770.
29. Grimmer J (2010). “A Bayesian Hierarchical Topic Model for Political Texts: Measuring Expressed Agendas in Senate Press Releases.” Political Analysis, 18(1), 1–35. doi:10. 1093/pan/mpp034.
30. Grimmer J, Stewart BM (2013). “Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts.” Political Analysis, 21(3), 267–297. doi: 10.1093/pan/mps028.
31. Grün B, Hornik K (2011). “topicmodels: An R Package for Fitting Topic Models.” Journal of Statistical Software, 40(13), 1–30. doi:10.18637/jss.v040.i13.
32. Habel K, Grasman R, Stahel A, Stahel A, Sterratt DC (2019). geometry: Mesh Generation and Surface Tesselation. R package version 0.4-1, URL https://CRAN.R-project.org/package=geometry.
33. Hausser J, Strimmer K (2009). “Entropy Inference and the James-Stein Estimator, with Application to Nonlinear Gene Association Networks.” Journal of Machine Learning Research, 10, 1469–1484.
34. Hoffman MD, Blei DM, Wang C, Paisley JW (2013). “Stochastic Variational Inference.” Journal of Machine Learning Research, 14(1), 1303–1347.
35. Hornik K (2005). “A CLUE for CLUster Ensembles.” Journal of Statistical Software, 14(12), 1–25. doi:10.18637/jss.v014.i12.
36. Hornik K, Meyer D, Buchta C (2019). slam: Sparse Lightweight Arrays and Matrices. R package version 0.1-45, URL https://CRAN.R-project.org/package=slam.
37. Hughes MC, Sudderth E (2013). “Memoized Online Variational Inference for Dirichlet Process Mixture Models.” In CJC Burges, L Bottou, M Welling, Z Ghahramani, KQ Weinberger (eds.), Advances in Neural Information Processing Systems 26, pp. 1133–1141. Curran Associates.
38. Johannesson M (2018a). tidystm: Extract Effect from estimateEffect in the stm Package. R package version 0.0.0.9000, URL https://github.com/mikajoh/tidystm.
39. Johannesson MP (2018b). stmprinter: Print Multiple STM Models to a File for Inspection. R package version 0.0.0.9000, URL https://github.com/mikajoh/stmprinter.
40. Khan ME, Bouchard G (2009). “Variational EM Algorithms for Correlated Topic Models.” Technical report, University of British Columbia.
41. Krijthe JH, Van der Maaten L (2018). Rtsne: t-Distributed Stochastic Neighbor Embedding Using Barnes-Hut Implementation. R package version 0.15, URL https://CRAN. R-project.org/package=Rtsne.
42. Lee M, Mimno D (2014). “Low-Dimensional Embeddings for Interpretable Anchor-Based Topic Inference.” In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp. 1319–1328. Association for Computational Linguistics, Doha, Qatar. URL http://www.aclweb.org/anthology/D14-1138.
43. Lucas C, Nielsen R, Roberts M, Stewart B, Storer A, Tingley D (2015). “Computer Assisted Text Analysis for Comparative Politics.” Political Analysis, 23(2), 254–277. doi:10.1093/pan/mpu019.
44. Milner HV, Tingley DH (2015). Sailing the Water’s Edge: Domestic Politics and American Foreign Policy. Princeton University Press.
45. Mimno D, McCallum A (2008). “Topic Models Conditioned on Arbitrary Features with Dirichlet-Multinomial Regression.” In Proceedings of the Twenty-Fourth Conference Annual Conference on Uncertainty in Artificial Intelligence, pp. 411–418. AUAI Press.
46. Mimno D, Wallach HM, Talley E, Leenders M, McCallum A (2011). “Optimizing Semantic Coherence in Topic Models.” In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP ’11, pp. 262–272. Association for Computational Linguistics, Stroudsburg. URL http://dl.acm.org/citation.cfm?id=2145432.2145462.
47. Newman D, Lau JH, Grieser K, Baldwin T (2010). “Automatic Evaluation of Topic Co-herence.” In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 100–108. Association for Computational Linguistics.
48. Paul M, Dredze M (2015). “SPRITE: Generalizing Topic Models with Structured Priors.” Transactions of the Association of Computational Linguistics, 3(1), 43–57. doi:10.1162/tacl_a_00121.
49. Perry PO (2017). corpus: Text Corpus Analysis. R package version 0.10.0, URL https://CRAN.R-project.org/package=corpus.
50. Quinn KM, Monroe BL, Colaresi M, Crespin MH, Radev DR (2010). “How to Analyze Political Attention with Minimal Assumptions and Costs.” American Journal of Political Science, 54(1), 209–228. doi:10.1111/j.1540-5907.2009.00427.x.
51. R Core Team (2019). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
52. Reich J, Tingley D, Leder-Luis J, Roberts ME, Stewart BM (2015). “Computer Assisted Reading and Discovery for Student Generated Text in Massive Open Online Courses.” Journal of Learning Analytics, 2(1), 156–184. doi:10.18608/jla.2015.21.8.
53. Roberts M, Stewart B, Tingley D (2016a). “Navigating the Local Modes of Big Data: The Case of Topic Models.” In Computational Social Science: Discovery and Prediction. Cambridge University Press, New York.
54. Roberts ME, Stewart BM, Airoldi E (2016b). “A Model of Text for Experimentation in the Social Sciences.” Journal of the American Statistical Association, 111(515), 988–1003. doi:10.1080/01621459.2016.1141684.
55. Roberts ME, Stewart BM, Tingley D (2019). stm: R Package for Structural Topic Models. R package version 1.3.4, URL https://CRAN.R-project.org/package=stm.
56. Roberts ME, Stewart BM, Tingley D, Airoldi EM (2013). “The Structural Topic Model and Applied Social Science.” In Advances in Neural Information Processing Systems Workshop on Topic Models: Computation, Application, and Evaluation. Neural Information Processing Society.
57. Roberts ME, Stewart BM, Tingley D, Lucas C, Leder-Luis J, Gadarian SK, Albertson B, Rand DG (2014). “Structural Topic Models for Open-Ended Survey Responses.” American Journal of Political Science, 58(4), 1064–1082. doi:10.1111/ajps.12103.
58. Romney D, Stewart B, Tingley D (2015). “Plain Text: Transparency in Computer-Assisted Text Analysis.” Qualitative & Multi-Method Research, 13(1), 32–37.
59. Rosen-Zvi M, Chemudugunta C, Griffiths T, Smyth P, Steyvers M (2010). “Learning Author-Topic Models from Text Corpora.” ACM Transactions on Information Systems, 28(1), 4. doi:10.1145/1658377.1658381.
60. Schwemmer C (2018). stminsights: A shiny Application for Inspecting Structural Topic Models. R package version 0.3.0, URL https://CRAN.R-project.org/package=stminsights.
61. Sievert C, Shirley K (2015). LDAvis: Interactive Visualization of Topic Models. R package version 0.3.2, URL https://CRAN.R-project.org/package=LDAvis.
62. Socher R, Gershman S, Perotte A, Sederberg P, Blei D, Norman K (2009). “A Bayesian Analysis of Dynamics in Free Recall.” Advances in Neural Information Processing Systems, 22, 1714–1722.
63. Taddy M (2013). “Multinomial Inverse Regression for Text Analysis.” Journal of the American Statistical Association, 108(503), 755–770. doi:10.1080/01621459.2012.734168.
64. Taddy M (2015). “Distributed Multinomial Regression.” The Annals of Applied Statistics, 9(3), 1394–1414. doi:10.1214/15-aoas831.
65. Taddy MA (2012). “On Estimation and Selection for Topic Models.” In Proceedings of the 15th International Conference on Artificial Intelligence and Statistics.
66. Van der Maaten L (2014). “Accelerating t-SNE Using Tree-Based Algorithms.” The Journal of Machine Learning Research, 15(1), 3221–3245.
67. Wallach HM, Murray I, Salakhutdinov R, Mimno D (2009). “Evaluation Methods for Topic Models.” In Proceedings of the 26th Annual International Conference on Machine Learning, pp. 1105–1112.
68. Wand M (2015). KernSmooth: Functions for Kernel Smoothing Supporting Wand and Jones (1995). R package version 2.23-15, URL https://CRAN.R-project.org/package= KernSmooth.
69. Wang C, Blei DM (2013). “Variational Inference in Nonconjugate Models.” The Journal of Machine Learning Research, 14(1), 1005–1031. doi:10.1049/pbhe002e_ch9.
70. Wickham H (2016). ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag. doi: 10.1007/978-3-319-24277-4.
71. Wickham H (2019). stringr: Simple, Consistent Wrappers for Common String Operations. R package version 1.4.0, URL https://CRAN.R-project.org/package=stringr.
72. Zhao T, Liu H, Roeder K, Lafferty J, Wasserman L (2012). “The huge Package for High-Dimensional Undirected Graph Estimation in R.” The Journal of Machine Learning Research, 13(1), 1059–1062.