Nonparametric spherical topic modeling with word embeddings

54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Short Papers

Volumn , Issue , 2016, Pages 537-542

  Batmanghelich, Nematollah Kayhan ^a   Saeedi, Ardavan ^a   Narasimhan, Karthik R ^a   Gershman, Samuel J ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; EMBEDDINGS; INFERENCE ENGINES; SEMANTICS; STOCHASTIC SYSTEMS;

COSINE SIMILARITY; DIRECTIONAL DATA; HIERARCHICAL DIRICHLET PROCESS; INFERENCE ALGORITHM; SEMANTIC CONSISTENCY; SEMANTIC STRUCTURES; VARIATIONAL INFERENCE; VON MISES-FISHER DISTRIBUTION;

STOCHASTIC MODELS;

EID: 85016629898     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/p16-2087     Document Type: Conference Paper

References (21)

1. Arindam Banerjee, Inderjit S Dhillon, Joydeep Ghosh, and Suvrit Sra. 2005. Clustering on the unit hypersphere using von mises-fisher distributions. In Journal of Machine Learning Research, pages 1345-1382.
2. David M Blei and John D Lafferty. 2006. Dynamic topic models. In Proceedings of the 23rd international conference on Machine learning, pages 113-120. ACM.
3. David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. the Journal of machine Learning research, 3:993-1022.
4. David M Blei. 2012. Probabilistic topic models. Communications of the ACM, 55(4):77-84.
5. Michael Bryant and Erik B Sudderth. 2012. Truly nonparametric online variational inference for hierarchical dirichlet processes. In Advances in Neural Information Processing Systems, pages 2699-2707.
6. Rajarshi Das, Manzil Zaheer, and Chris Dyer. 2015. Gaussian LDA for topic models with word embeddings. In Proceedings of the 53nd Annual Meeting of the Association for Computational Linguistics.
7. Inderjit S Dhillon and Suvrit Sra. 2003. Modeling data using directional distributions. Technical report, Technical Report TR-03-06, Department of Computer Sciences, The University of Texas at Austin. URL ftp://ftp. cs. utexas. edu/pub/techreports/tr03-06. ps. gz.
8. Siddarth Gopal and Yiming Yang. 2014. Von misesfisher clustering models.
9. Yulan He, Chenghua Lin, Wei Gao, and Kam-Fai Wong. 2013. Dynamic joint sentiment-topic model.ACM Transactions on Intelligent Systems and Technology (TIST), 5(1):6.
10. Matthew D Hoffman, David M Blei, Chong Wang, and John Paisley. 2013. Stochastic variational inference. The Journal of Machine Learning Research, 14(1):1303-1347.
11. Matthew Johnson and Alan Willsky. 2014. Stochastic variational inference for bayesian time series models. In Proceedings of the 31st International Conference on Machine Learning (ICML-14), pages 1854-1862.
12. Jey Han Lau, David Newman, and Timothy Baldwin. 2014. Machine reading tea leaves: Automatically evaluating topic coherence and topic model quality. In EACL, pages 530-539.
13. Omer Levy, Yoav Goldberg, and Ido Dagan. 2015. Improving distributional similarity with lessons learned from word embeddings. Transactions of the Association for Computational Linguistics, 3:211-225.
14. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, pages 3111-3119.
15. David Newman, Jey Han Lau, Karl Grieser, and Timothy Baldwin. 2010. Automatic evaluation of topic coherence. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 100-108. Association for Computational Linguistics.
16. John Paisley, Chingyue Wang, David M Blei, and Michael I Jordan. 2015. Nested hierarchical dirichlet processes. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 37(2):256-270.
17. Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. Glove: Global vectors for word representation. In Empirical Methods in Natural Language Processing (EMNLP), pages 1532-1543.
18. Joseph Reisinger, Austin Waters, Bryan Silverthorn, and Raymond J Mooney. 2010. Spherical topic models. In Proceedings of the 27th International Conference on Machine Learning (ICML-10), pages 903-910.
19. Michal Rosen-Zvi, Thomas Griffiths, Mark Steyvers, and Padhraic Smyth. 2004. The author-topic model for authors and documents. In Proceedings of the 20th conference on Uncertainty in artificial intelligence, pages 487-494. AUAI Press.
20. Yee Whye Teh, Michael I Jordan, Matthew J Beal, and David M Blei. 2006. Hierarchical dirichlet processes. Journal of the American Statistical Association, 101:1566-1581.
21. Yee Whye Teh, Michael I Jordan, Matthew J Beal, and David M Blei. 2012. Hierarchical dirichlet processes. Journal of the american statistical association.