Full-Text or abstract? Examining topic coherence scores using latent dirichlet allocation

Proceedings - 2017 International Conference on Data Science and Advanced Analytics, DSAA 2017

Volumn 2018-January, Issue , 2017, Pages 165-174

  Syed, Shaheen ^a   Spruit, Marco ^a  

^a UTRECHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85045455306     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DSAA.2017.61     Document Type: Conference Paper

References (43)

1. P. O. Larsen and M. von Ins, “The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index,” Scientometrics, vol. 84, no. 3, pp. 575–603, sep 2010.
2. K. W. Boyack and R. Klavans, “Creation of a highly detailed, dynamic, global model and map of science,” Journal of the Association for Information Science and Technology, vol. 65, no. 4, pp. 670–685, apr 2014.
3. A. Srivastava and M. Sahami, Text mining: Classification, clustering, and applications. CRC Press, 2009.
4. S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman, “Indexing by latent semantic analysis,” Journal of the American Society for Information Science, vol. 41, no. 6, pp. 391–407, sep 1990.
5. T. Hofmann, “Probabilistic latent semantic indexing,” in Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR’99. New York, New York, USA: ACM Press, 1999, pp. 50–57.
6. D. M. Blei, A. Y. Ng, and M. I. Jordan, “Latent Dirichlet Allocation,” Journal of Machine Learning Research, vol. 3, pp. 993–1022, 2003.
7. D. M. Blei and J. D. Lafferty, “Topic Models,” Text Mining: Classification, Clustering, and Applications, pp. 71–89, 2009.
8. T. L. Griffiths and M. Steyvers, “Finding scientific topics,” Proceedings of the National Academy of Sciences, vol. 101, no. Supplement 1, pp. 5228–5235, apr 2004.
9. J. Grimmer and B. M. Stewart, “Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts,” Political Analysis, vol. 21, no. 03, pp. 267–297, jan 2013.
10. T. Rusch, P. Hofmarcher, R. Hatzinger, and K. Hornik, “Model trees with topic model preprocessing: An approach for data journalism illustrated with the WikiLeaks Afghanistan war logs,” The Annals of Applied Statistics, vol. 7, no. 2, pp. 613–639, jun 2013.
11. E. Erosheva, S. Fienberg, and J. Lafferty, “Mixed-membership models of scientific publications.” Proceedings of the National Academy of Sciences of the United States of America, vol. 101 Suppl, no. suppl 1, pp. 5220–5227, apr 2004.
12. C. J. Gatti, J. D. Brooks, and S. G. Nurre, “A Historical Analysis of the Field of OR/MS using Topic Models,” arXiv.org, vol. stat.ML, oct 2015.
13. L. Sun and Y. Yin, “Discovering themes and trends in transportation research using topic modeling,” Transportation Research Part C: Emerging Technologies, vol. 77, no. June, pp. 49–66, apr 2017.
14. M. J. Westgate, P. S. Barton, J. C. Pierson, and D. B. Lindenmayer, “Text analysis tools for identification of emerging topics and research gaps in conservation science,” Conservation Biology, vol. 29, no. 6, pp. 1606–1614, 2015.
15. D. Hall, D. Jurafsky, and C. D. Manning, “Studying the history of ideas using topic models,” in Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2008, pp. 363–371.
16. X. Wang and A. McCallum, “Topics over time: a non-Markov continuous-time model of topical trends,” in Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2006, pp. 424–433.
17. J. M. Alston and P. G. Pardey, “Six decades of agricultural and resource economics in Australia: an analysis of trends in topics, authorship and collaboration,” Australian Journal of Agricultural and Resource Economics, vol. 60, no. 4, pp. 554–568, oct 2016.
18. N. Aletras and M. Stevenson, “Evaluating topic coherence using distributional semantics,” in Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013). Association for Computational Linguistics, 2013, pp. 13–22.
19. M. Röder, A. Both, and A. Hinneburg, “Exploring the Space of Topic Coherence Measures,” in Proceedings of the Eighth ACM International Conference on Web Search and Data Mining - WSDM’15. New York, New York, USA: ACM Press, 2015, pp. 399–408.
20. K. Stevens, P. Kegelmeyer, D. Andrzejewski, and D. Buttler, “Exploring Topic Coherence over Many Models and Many Topics,” in Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, no. July. Association for Computational Linguistics, 2012, pp. 952–961.
21. D. O’Callaghan, D. Greene, J. Carthy, and P. Cunningham, “An analysis of the coherence of descriptors in topic modeling,” Expert Systems with Applications, vol. 42, no. 13, pp. 5645–5657, 2015.
22. Z. S. Harris, “Distributional Structure,” WORD, vol. 10, no. 2-3, pp. 146–162, aug 1954.
23. W. L. Buntine, “Operations for Learning with Graphical Models,” Journal of Artificial Intelligence Research, vol. 2, pp. 159–225, nov 1994.
24. D. M. Blei, “Probabilistic topic models,” in Communications of the ACM, vol. 55, no. 4, apr 2012, pp. 77–84.
25. D. Newman, A. Asuncion, P. Smyth, and M. Welling, “Distributed inference for latent dirichlet allocation,” in Advances in Neural Information Processing Systems, vol. 20, 2007, pp. 1081–1088.
26. I. Porteous, D. Newman, A. Ihler, A. Asuncion, P. Smyth, and M. Welling, “Fast Collapsed Gibbs Sampling For Latent Dirichlet Allocation,” in ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2008, p. 569.
27. D. M. Blei and M. I. Jordan, “Variational inference for Dirichlet process mixtures,” Bayesian Analysis, vol. 1, no. 1, pp. 121–143, mar 2006.
28. Y. W. Teh, D. Newman, M. Welling, and D. Neaman, “A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation,” in Advances in Neural Information Processing Systems 19 (NIPS 2006), 2007, pp. 1353–1360.
29. C. Wang, J. Paisley, and D. M. Blei, “Online Variational Inference for the Hierarchical Dirichlet Process,” in Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, vol. 15, 2011, pp. 752–760.
30. A. Asuncion, M. Welling, P. Smyth, and Y. W. Teh, “On Smoothing and Inference for Topic Models,” Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, no. Ml, pp. 27–34, may 2012.
31. D. Wallach, Hanna M., Murray, Iain, Salakhutdinov, Ruslan and Mimno, “Evaluation Methods for Topic Models,” in ICML’09 Proceedings of the 26th Annual International Conference on Machine Learning, 2009, pp. 1105–1112.
32. J. Chang, S. Gerrish, C. Wang, and D. M. Blei, “Reading Tea Leaves: How Humans Interpret Topic Models,” in Advances in Neural Information Processing Systems 22, 2009, pp. 288–296.
33. D. Newman, J. Lau, K. Grieser, and T. Baldwin, “Automatic evaluation of topic coherence,” in Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, no. June. Stroudsburg, PA, USA: Association for Computational Linguistics, 2010, pp. 100–108.
34. I. Douven and W. Meijs, “Measuring coherence,” Synthese, vol. 156, no. 3, pp. 405–425, 2007.
35. G. Bouma, “Normalized (Pointwise) Mutual Information in Collocation Extraction,” in Proceedings of German Society for Computational Linguistics (GSCL 2009), 2009, pp. 31–40.
36. I. Jarić, G. Cvijanović, J. Knežević-Jarić, and M. Lenhardt, “Trends in Fisheries Science from 2000 to 2009: A Bibliometric Study,” Reviews in Fisheries Science, vol. 20, no. 2, pp. 70–79, 2012.
37. S. Syed, M. Spruit, and M. Borit, “Bootstrapping a Semantic Lexicon on Verb Similarities,” in Proceedings of the 8th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, vol. 1, no. Ic3k. SCITEPRESS - Science and Technology Publications, 2016, pp. 189–196.
38. N. Evangelopoulos, X. Zhang, and V. R. Prybutok, “Latent Semantic Analysis: five methodological recommendations,” European Journal of Information Systems, vol. 21, no. 1, pp. 70–86, jan 2012.
39. R. Rehurek and P. Sojka, “Software Framework for Topic Modelling with Large Corpora,” in Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, 2010, pp. 45–50.
40. M. D. Hoffman, D. M. Blei, and F. Bach, “Online Learning for Latent Dirichlet Allocation,” in Proceedings of the 23rd International Conference on Neural Information Processing Systems, 2010, pp. 856–864.
41. J. Chuang, D. Ramage, C. D. Manning, and J. Heer, “Interpretation and Trust: Designing Model-Driven Visualizations for Text Analysis,” in ACM Human Factors in Computing Systems (CHI), 2005, pp. 443–452.
42. C. Sievert and K. Shirley, “LDAvis: A method for visualizing and interpreting topics,” in Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces, 2014, pp. 63–70.
43. Z. Tang and J. Maclennan, Data Mining With SQL Server 2005. Wiley, 2005.