Topicmodels: An r package for fitting topic models

Journal of Statistical Software

Volumn 40, Issue 13, 2011, Pages 1-30

  Grün, Bettina ^a   Hornik, Kurt ^b  

^a JOHANNES KEPLER UNIVERSITY LINZ   (Austria)

^b VIENNA UNIVERSITY OF ECONOMICS AND BUSINESS   (Austria)

Author keywords

Gibbs sampling; R; Text analysis; Topic model; Variational EM

Indexed keywords

EID: 79961227421     PISSN: None     EISSN: 15487660     Source Type: Journal    
DOI: 10.18637/jss.v040.i13     Document Type: Article

References (51)

1. Airoldi EM, Blei DM, Fienberg SE, Xing EP (2008). Mixed Membership Stochastic Blockmodels. Journal of Machine Learning Research, 9, 1981-2014.
2. Banerjee A, Dhillon IS, Ghosh J, Sra S (2005). Clustering on the Unit Hypersphere Using von Mises-Fisher Distributions. Journal of Machine Learning Research, 6, 1345-1382.
3. Blei DM, Griffths TL, Jordan MI, Tenenbaum JB (2003a). Hierarchical Topic Models and the Nested Chinese Restaurant Process. In S Thrun, LK Saul, B Schölkopf (eds.), Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA.
4. Blei DM, Lafferty JD (2006). Dynamic Topic Models. In ICML'06: Proceedings of the 23rd International Conference on Machine Learning, pp. 113-120. ACM Press.
5. Blei DM, Lafferty JD (2007). A Correlated Topic Model of Science. The Annals of Applied Statistics, 1(1), 17-35.
6. Blei DM, Lafferty JD (2009). Topic Models. In A Srivastava, M Sahami (eds.), Text Mining: Classiffcation, Clustering, and Applications. Chapman & Hall/CRC Press.
7. Blei DM, Ng AY, Jordan MI (2003b). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993-1022.
8. Chang J (2010). lda: Collapsed Gibbs Sampling Methods for Topic Models. R package version 1.2.3, URL http://CRAN.R-project.org/package=lda.
9. Daumffé III H (2008). HBC: Hierarchical Bayes Compiler. Pre-release version 0.7, URL http://www.cs.utah.edu/~hal/HBC/.
10. Deerwester S, Dumais ST, Furnas GW, Landauer TK, Harshman R (1990). Indexing by Latent Semantic Analysis. Journal of the American Society for Information Science, 41(6), 391-407.
11. Dempster AP, Laird NM, Rubin DB (1977). Maximum Likelihood from Incomplete Data Via the EM-Algorithm. Journal of the Royal Statistical Society B, 39, 1-38.
12. Feinerer I (2011). tm: Text Mining Package. R package version 0.5-5., URL http://CRAN. R-project.org/package=tm.
13. Feinerer I, Hornik K, Meyer D (2008). Text Mining Infrastructure in R. Journal of Statistical Software, 25(5), 1-54. URL http://www.jstatsoft.org/v25/i05/.
14. Griffths TL, Steyvers M (2004). Finding Scientiffc Topics. Proceedings of the National Academy of Sciences of the United States of America, 101, 5228-5235.
15. Hall D, Jurafsky D, Manning CD (2008). Studying the History of Ideas Using Topic Models.In 2008 Conference on Empirical Methods in Natural Language Processing, EMNLP 2008, Proceedings of the Conference, 25-27 October 2008, Honolulu, Hawaii, USA, A Meeting of SIGDAT, a Special Interest Group of the ACL, pp. 363-371. ACL.
16. Handcock MS, Hunter DR, Butts CT, Goodreau SM, Morris M (2008). statnet: Software Tools for the Representation, Visualization, Analysis and Simulation of Network Data. Journal of Statistical Software, 24(1), 1-11. URL http://www.jstatsoft.org/v24/i01/.
17. Harman D (1992). Overview of the First Text Retrieval Conference (TREC-1). In D Harman (ed.), Proceedings of the First Text Retrieval Conference (TREC-1), NIST Special Publication 500-207, pp. 1-20. National Institute of Standards and Technology.
18. Heinrich G (2009). A Generic Approach to Topic Models. In WL Buntine, M Grobelnik, D Mladenic, J Shawe-Taylor (eds.), Machine Learning and Knowledge Discovery in Databases, volume 5781 of Lecture Notes in Computer Science, pp. 517-532. Springer- Verlag, Berlin.
19. Heinrich G, Goesele M (2009). Variational Bayes for Generic Topic Models. In B ertsching, M Hund, Z Aziz (eds.), KI 2009: Advances in Artiffcial Intelligence, volume 5803 of Lecture Notes in Computer Science, pp. 161-168. Springer-Verlag, Berlin.
20. Hoffman MD, Blei DM, Bach F (2010). Online Learning for Latent Dirichlet Allocation. In J Lafferty, CKI Williams, J Shawe-Taylor, R Zemel, A Culotta (eds.), Advances in Neural Information Processing Systems 23, pp. 856-864. MIT Press, Cambridge, MA.
21. Hofmann T (1999). Probabilistic Latent Semantic Indexing. In SIGIR'99: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 50-57. ACM Press.
22. Hornik K (2005). A CLUE for CLUster Ensembles. Journal of Statistical Software, 14(12), 1-25. URL http://www.jstatsoft.org/v14/i12/.
23. Hornik K (2009). Snowball: Snowball Stemmers. R package version 0.0-7, URL http: //CRAN.R-project.org/package=Snowball.
24. Hornik K (2011). OAIHarvester: Harvest Metadata Using OAI-PMH v2.0. R package version 0.1-3, URL http://CRAN.R-project.org/package=OAIHarvester.
25. Hornik K, Grü n B (2011). movMF: Mixtures of von Mises Fisher Distributions. R package version 0.0-0, URL http://CRAN.R-project.org/package=movMF.
26. Hornik K, Meyer D, Buchta C (2011). slam: Sparse Lightweight Arrays and Matrices. R package version 0.1-21, URL http://CRAN.R-project.org/package=slam.
27. Li W, McCallum A (2006). Pachinko Allocation: DAG-Structured Mixture Models of Topic Correlations. In ICML'06: Proceedings of the 23rd International Conference on Machine Learning, pp. 577-584. ACM Press, New York.
28. Li Z, Wang C, Xie X, Wang X, Ma WY (2008). Exploring LDA-Based Document Model for Geographic Information Retrieval. In C Peters, V Jijkoun, T Mandl, H Müller, D Oard, AP nas, V Petras, D Santos (eds.), Advances in Multilingual and Multimodal Information Retrieval, volume 5152 of Lecture Notes in Computer Science, pp. 842-849. Springer-Verlag, Berlin.
29. Lunn DJ, Thomas A, Best N, Spiegelhalter D (2000). WinBUGS-A Bayesian Modelling Framework: Concepts, Structure, and Extensibility. Statistics and Computing, 10(4), 325-337.
30. McCallum AK (2002). MALLET: Machine Learning for Language Toolkit. URL http://mallet.cs.umass.edu/.
31. Microsoft Corporation (2010). Infer.NET User Guide. Version 2.4 beta 2, URL http://research.microsoft.com/en-us/um/cambridge/projects/infernet/.
32. Mimno D, Li W, McCallum A (2007). "Mixtures of Hierarchical Topics with Pachinko Allocation." In ICML'07: Proceedings of the 21st International Conference on Machine Learning, pp. 633-640. ACM Press.
33. Mochihashi D (2004a). "A Note on a Variational Bayes Derivation of Full Bayesian Latent Dirichlet Allocation." Unpublished manuscript, URL http://chasen.org/~daiti-m/paper/lda-fullvb.pdf.
34. Mochihashi D (2004b). lda, a Latent Dirichlet Allocation Package. MATLAB and C package version 0.1, URL http://chasen.org/~daiti-m/dist/lda/.
35. Nallapati R, Cohen W, Lafferty J (2007). Parallelized Variational EM for Latent Dirichlet Allocation: An Experimental Evaluation of Speed and Scalability. In ICDMW'07: Pro- ceedings of the Seventh IEEE International Conference on Data Mining Workshops, pp. 349-354. IEEE Computer Society, Washington, DC.
36. Newman D, Asuncion A, Smyth P, Welling M (2009). Distributed Algorithms for Topic Models. Journal of Machine Learning Research, 10, 1801-1828.
37. Newton MA, Raftery AE (1994). Approximate Bayesian Inference with the Weighted Likelihood Bootstrap. Journal of the Royal Statistical Society B, 56(1), 3-48.
38. Nigam K, McCallum AK, Thrun S, Mitchell T (2000). Text Classiffcation from Labeled and Unlabeled Documents Using EM. Machine Learning, 39(2-3), 103-134.
39. Phan XH, Nguyen LM, Horiguchi S (2008). Learning to Classify Short and Sparse Text & Web with Hidden Topics from Large-Scale Data Collections. In Proceedings of the 17th International World Wide Web Conference (WWW 2008), pp. 91-100. Beijing, China.
40. Plummer M (2003). JAGS: A Program for Analysis of Bayesian Graphical Models Using Gibbs Sampling. In K Hornik, F Leisch, A Zeileis (eds.), Proceedings of the 3rd International Workshop on Distributed Statistical Computing, Vienna, Austria. ISSN 1609-395X, URL http://www.ci.tuwien.ac.at/Conferences/DSC-2003/Proceedings/.
41. Plummer M. (2011). rjags: Bayesian Graphical Models Using MCMC. R package version 2.2.0- 3, URL http://CRAN.R-project.org/package=rjags.
42. Porteous I, Asuncion A, Newman D, Ihler A, Smyth P, Welling M (2008). Fast Collapsed Gibbs Sampling for Latent Dirichlet Allocation. In KDD'08: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 569-577. ACM Press.
43. R Development Core Team (2011). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org/.
44. Rosen-Zvi M, Chemudugunta C, Griffths T, Smyth P, Steyvers M (2010). Learning Author-Topic Models from Text Corpora. ACM Transactions on Information Systems, 28(1).
45. Steyvers M, Griffths T (2007). Probabilistic Topic Models. In TK Landauer, DS McNamara, S Dennis, W Kintsch (eds.), Handbook of Latent Semantic Analysis. Lawrence Erlbaum Associates.
46. Steyvers M, Griffths T (2011). MATLAB Topic Modeling Toolbox 1.4. URL http://psiexp.ss.uci.edu/research/programsffdata/toolbox.htm.
47. Teh YW, Jordan MI, Beal MJ, Blei DM (2006). Hierarchical Dirichlet Processes. Journal of the American Statistical Association, 101(476), 1566-1581.
48. Temple Lang D (2010). XML: Tools for Parsing and Generating XML Within R and S-PLUS. R package version 3.2-0, URL http://CRAN.R-project.org/package=XML.
49. Wainwright MJ, Jordan MI (2008). Graphical Models, Exponential Families, and Variational Inference. Foundations and Trends in Machine Learning, 1(1-2), 1-305.
50. Wallach HM, Murray I, Salakhutdinov R, Mimno D (2009). Evaluation Methods for Topic Models. In ICML'09: Proceedings of the 26th International Conference on Machine Learning, pp. 1105-1112. ACM Press.
51. Wei X, CroftWB (2006). LDA-Based Document Models for Ad-Hoc Retrieval. In SIGIR'06: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 178-185. ACM Press, New York.