An analysis of the coherence of descriptors in topic modeling

Expert Systems with Applications

Volumn 42, Issue 13, 2015, Pages 5645-5657

  O'Callaghan, Derek ^a   Greene, Derek ^a   Carthy, Joe ^a   Cunningham, Pádraig ^a  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

LDA; NMF; Topic coherence; Topic modeling

Indexed keywords

FACTORIZATION; SEMANTICS; STATISTICS;

DISTRIBUTIONAL SEMANTICS; LATENT DIRICHLET ALLOCATIONS; LDA; MATRIX DECOMPOSITION; NMF; NONNEGATIVE MATRIX FACTORIZATION; PROBABILISTIC TECHNIQUE; TOPIC MODELING;

MATRIX ALGEBRA;

EID: 84926640886     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2015.02.055     Document Type: Article

References (41)

1. Aletras, N. & Stevenson, M. (2013). Evaluating topic coherence using distributional semantics. In Proceedings of the 10th international workshop on computational semantics IWCS-10 (pp. 13-22).
2. Arora, S., Ge, R., Halpern, Y., Mimno, D. M., Moitra, A., Sontag, D., et al. (2012). A practical algorithm for topic modeling with provable guarantees. .
3. S. Arora, R. Ge, and A. Moitra Learning topic models - going beyond SVD FOCS 2012 IEEE Computer Society 1 10
4. D.M. Blei, T.L. Griffiths, M.I. Jordan, and J.B. Tenenbaum Hierarchical topic models and the nested chinese restaurant process Advances in neural information processing systems, NIPS 2004 MIT Press
5. D.M. Blei, and J.D. Lafferty Correlated topic models Proceedings of the 23rd international conference on machine learning 2006 MIT Press 113 120
6. D. Blei, and J. Lafferty Topic models Text mining: Theory and applications 2009 Taylor and Francis
7. D.M. Blei, A.Y. Ng, and M.I. Jordan Latent dirichlet allocation Journal of Machine Learning Research 3 2003 993 1022
8. Bouma, G. (2009). Normalized pointwise mutual information in collocation extraction. In Proceedings of the international conference of the German society for computational linguistics and language technology, GCSL '09.
9. C. Boutsidis, and E. Gallopoulos SVD based initialization: A head start for nonnegative matrix factorization Pattern Recognition 41 4 2008 1350 1362
10. Chang, J., Boyd-Graber, J., Gerrish, S., Wang, C., & Blei, D. M. (2009). Reading tea leaves: How humans interpret topic models. In Advances in neural information processing systems NIPS.
11. Chemudugunta, C., Smyth, P., & Steyvers, M. (2006). Modeling general and specific aspects of documents with a probabilistic topic model. In Advances in neural information processing systems (pp. 241-248).
12. S.C. Deerwester, S.T. Dumais, T.K. Landauer, G.W. Furnas, and R.A. Harshman Indexing by latent semantic analysis Journal of the American Society of Information Science 41 6 1990 391 407
13. E. Gaussier, and C. Goutte Relation between PLSA and NMF and implications Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '05 2005 ACM New York, NY, USA 601 602
14. T.L. Griffiths, and M. Steyvers Finding scientific topics Proceedings of the National Academy of Sciences of the United States of America 101 Suppl. 1 2004 5228 5235
15. Hoffman, M. D., Blei, D. M., & Bach, F. R. (2010). Online learning for latent dirichlet allocation. In Advances in neural information processing systems (pp. 856-864).
16. T. Hofmann Unsupervised learning by probabilistic latent semantic analysis Machine Learning 42 1-2 2001 177 196
17. C. Kohlschütter, P. Fankhauser, and W. Nejdl Boilerplate detection using shallow text features Proceedings of the third ACM international conference on web search and data mining 2010 ACM 441 450
18. J.H. Lau, T. Baldwin, and D. Newman On collocations and topic models ACM Transactions on Speech and Language Processing 10 3 2013 10:1 10:14
19. Lau, J. H., Newman, D., & Baldwin, T. (2014). Machine reading tea leaves: Automatically evaluating topic coherence and topic model quality. In Proceedings of the European chapter of the association for computational linguistics, EACL-14 (pp. 530-539).
20. D.D. Lee, and H.S. Seung Learning the parts of objects by non-negative matrix factorization Nature 401 1999 788 791
21. D.D. Lee, and H.S. Seung Algorithms for non-negative matrix factorization T. Leen, T. Dietterich, V. Tresp, Advances in neural information processing systems Vol. 13 2001 MIT Press 556 562
22. C.-J. Lin Projected gradient methods for nonnegative matrix factorization Neural Computation 19 10 2007 2756 2779
23. E. Loper, and S. Bird NLTK: The natural language toolkit Proceedings of the ACL-02 workshop on effective tools and methodologies for teaching natural language processing and computational linguistics ETMTNLP '02 Vol. 1 2002 Association for Computational Linguistics Stroudsburg, PA, USA 63 70
24. McCallum, A. (2002). MALLET: A machine learning for language toolkit. .
25. Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. .
26. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, NIPS.
27. D. Mimno, H.M. Wallach, E. Talley, M. Leenders, and A. McCallum Optimizing semantic coherence in topic models Proceedings of the conference on empirical methods in natural language processing, EMNLP '11 2011 Association for Computational Linguistics Stroudsburg, PA, USA 262 272
28. D. Newman, J.H. Lau, K. Grieser, and T. Baldwin Automatic evaluation of topic coherence Human language technologies: The 2010 annual conference of the north American chapter of the association for computational linguistics, HLT '10 2010 Association for Computational Linguistics Stroudsburg, PA, USA 100 108
29. D. O'Callaghan, D. Greene, M. Conway, J. Carthy, and P. Cunningham An analysis of interactions within and between extreme right communities in social media M. Atzmueller, A. Chin, D. Helic, A. Hotho, Ubiquitous social media analysis Lecture notes in computer science Vol. 8329 2013 Springer Berlin Heidelberg 88 107
30. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, and O. Grisel Scikit-learn: Machine learning in python Journal of Machine Learning Research 12 2011 2825 2830
31. R. Řehůřek, and P. Sojka Software framework for topic modelling with large corpora Proceedings of the LREC 2010 workshop on new challenges for NLP frameworks 2010 ELRA Valletta, Malta 45 50
32. M. Röder, A. Both, and A. Hinneburg Exploring the space of topic coherence measures Proceedings of the eighth ACM international conference on web search and data mining, WSDM '15 2015 ACM New York, NY, USA 399 408
33. M. Rosen-Zvi, T. Griffiths, M. Steyvers, and P. Smyth The author-topic model for authors and documents Proceedings 20th conference on uncertainty in artificial intelligence, UAI '04 2004 AUAI Press Arlington, VA, United States 487 494
34. Rosner, F., Hinneburg, A., Röder, M., Nettling, M., & Both, A. (2013). Evaluating topic coherence measures. In Advances in neural information processing systems, NIPS.
35. A. Saha, and V. Sindhwani Learning evolving and emerging topics in social media: A dynamic NMF approach with temporal regularization Proceedings of the fifth ACM international conference on web search and data mining 2012 ACM 693 702
36. G. Salton, and C. Buckley Term-weighting approaches in automatic text retrieval Information Processing Management 24 5 1988 513 523
37. E. Sandhaus The New York times annotated corpus 2008 Linguistic Data Consortium Philadelphia
38. K. Stevens, P. Kegelmeyer, D. Andrzejewski, and D. Buttler Exploring topic coherence over many models and many topics Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning, EMNLP-CoNLL '12 2012 Association for Computational Linguistics Stroudsburg, PA, USA 952 961
39. M. Steyvers, and T. Griffiths Probabilistic topic models T. Landauer, D. Mcnamara, S. Dennis, W. Kintsch, Latent semantic analysis: A road to meaning 2006 Laurence Erlbaum
40. Wallach, H. M., Mimno, D., & McCallum, A. (2009). Rethinking LDA: Why priors matter. In Advances in neural information processing systems, NIPS.
41. H.M. Wallach, I. Murray, R. Salakhutdinov, and D. Mimno Evaluation methods for topic models Proceedings of the 26th annual international conference on machine learning, ICML '09 2009 ACM New York, NY, USA 1105 1112