BTM: Topic modeling over short texts

IEEE Transactions on Knowledge and Data Engineering

Volumn 26, Issue 12, 2014, Pages 2928-2941

  Cheng, Xueqi ^a   Yan, Xiaohui ^a   Lan, Yanyan ^a   Guo, Jiafeng ^a  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

biterm; content analysis; online algorithm; Short text; topic model

Indexed keywords

BITERM; CONTENT ANALYSIS; ON-LINE ALGORITHMS; SHORT TEXTS; TOPIC MODELING;

EID: 84910095885     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2014.2313872     Document Type: Article

References (41)

1. D. Ramage, S. Dumais, and D. Liebling, "Characterizing microblogs with topic models," in Proc. Int. AAAI Conf. Weblogs Social Media, 2010, vol. 5, no. 4, pp. 130-137.
2. W. Zhao, J. Jiang, J. Weng, J. He, E. Lim, H. Yan, and X. Li, "Comparing Twitter and traditional media using topic models," in Proc. 33rd Eur. Conf. Adv. Inf. Retrieval, 2011, pp. 338-349.
3. J. Guo, G. Xu, X. Cheng, and H. Li, "Named entity recognition in query," in Proc. 32nd Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2009, pp. 267-274.
4. J. Weng, E. Lim, J. Jiang, and Q. He, "TwitterRank: Finding topicsensitive influential twitterers," in Proc. 3rd ACM Int. Conf. Web Search Data Mining, 2010, pp. 261-270.
5. C. X. Lin, B. Zhao, Q. Mei, and J. Han, "PET: A statistical model for popular events tracking in social communities," in Proc. 16th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010, pp. 929-938.
6. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. 22nd Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1999, pp. 50-57.
7. D. Blei, A. Ng, and M. Jordan, "Latent Dirichlet allocation," J. Mach. Learning Res., vol. 3, pp. 993-1022, 2003.
8. J. Boyd-Graber and D. M. Blei, "Syntactic topic models, arXiv:1002.4665, Feb 2010.
9. X. Wang and A. McCallum, "Topics over time: A non-Markov continuous- time model of topical trends," in Proc. 12th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2006, pp. 424-433.
10. L. Hong and B. Davison, "Empirical study of topic modeling in Twitter," in Proc. 1st Workshop Social Media Analytics, 2010, pp. 80-88.
11. H. Lakkaraju, I. Bhattacharya, and C. Bhattacharyya, "Dynamic multi-relational Chinese restaurant process for analyzing influences on users in social media," in Proc. IEEE 12th Int. Conf. Data Mining, 2012, pp. 389-398.
12. K. Nigam, A. McCallum, S. Thrun, and T. Mitchell, "Text classification from labeled and unlabeled documents using EM," Mach. learning, vol. 39, no. 2, pp. 103-134, 2000.
13. A. Gruber, M. Rosen Zvi, and Y. Weiss, "Hidden topic Markov models," in Proc. Int. Conf. Artif. Intell. Statist., 2007, pp. 163-170.
14. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., pp. 721-741, 1984.
15. M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. K. Saul, An Introduction to Variational Methods for Graphical Models. Machine learning, vol. 37, no. 2, pp. 183-233, 1999.
16. K. R. Canini, L. Shi, and T. L. Griffiths, "Online inference of topics with latent Dirichlet allocation," in Proc. Int. Conf. Artif. Intell. Statist., 2009, pp. 65-72.
17. S. Deerwester, S. Dumais, G. Furnas, T. Landauer, and R. Harshman, "Indexing by latent semantic analysis," J. Amer. Soc. Inf. Sci., vol. 41, no. 6, pp. 391-407, 1990.
18. D. Blei, "Probabilistic topic models," Commun. ACM, vol. 55, no. 4, pp. 77-84, 2012.
19. H. M. Wallach, "Topic modeling: Beyond bag-of-words," in Proc. 23rd Int. Conf. Mach. Learning, 2006, pp. 977-984.
20. D. Newman, E.V. Bonilla, and W. Buntine, "Improving topic coherence with regularized topic models," in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 496-504.
21. D. Mimno, H. Wallach, E. Talley, M. Leenders, and A. McCallum, "Optimizing semantic coherence in topic models," in Proc. Conf. Empirical Methods Natural Language Process., 2011, pp. 262-272.
22. X. Phan, L. Nguyen, and S. Horiguchi, "Learning to classify short and sparse text & web with hidden topics from large-scale data collections," in Proc. 17th Int. Conf. World Wide Web, 2008, pp. 91- 100.
23. O. Jin, N. Liu, K. Zhao, Y. Yu, and Q. Yang, "Transferring topical knowledge from auxiliary long texts for short text clustering," in Proc. 20th ACM Int. Conf. Inf. Knowl. Manage., 2011, pp. 775-784.
24. O. Phelan, K. McCarthy, and B. Smyth, "Using Twitter to recommend real-time topical news," in Proc. 3rd ACM Conf. Recommender Syst., 2009, pp. 385-388.
25. J. Chen, R. Nairn, L. Nelson, M. Bernstein, and E. Chi, "Short and tweet: Experiments on recommending content from information streams," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2010, pp. 1185-1194.
26. Y. Wang, E. Agichtein, and M. Benzi, "TM-LDA: Efficient online modeling of latent topic transitions in social media," in Proc. 18th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2012, pp. 123-131.
27. X. Yan, J. Guo, S. Liu, X.-q. Cheng, and Y. Wang, "Clustering short text using ncut-weighted non-negative matrix factorization," in Proc. 21st ACM Int. Conf. Inf. Knowl. Manage., 2012, pp. 2259-2262.
28. X. Yan, J. Guo, S. Liu, X. Cheng, and Y. Wang, "Learning topics in short texts by non-negative matrix factorization on term correlation matrix," in Proc. 13th SIAM Int. Conf. Data Mining, 2013.
29. X. Yan, J. Guo, Y. Lan, and X. Cheng, "A biterm topic model for short texts," in Proc. 22nd Int. Conf. World Wide Web, 2013, pp. 1445-1456.
30. T. Griffiths and M. Steyvers, "Finding scientific topics," Proc. Nat. Acad. Sci. USA, vol. 101, no. Suppl 1, pp. 5228-5235, 2004.
31. W. Zhao, J. Jiang, J. He, Y. Song, P. Achananuparp, E. Lim, and X. Li, "Topical keyphrase extraction from Twitter," in Proc. 49th Annu. Meet. Assoc. Comput. Linguistics: Human Lang. Technol., 2011, pp. 379-388.
32. J. S. Liu, "The collapsed Gibbs sampler in Bayesian computations with applications to a gene regulation problem," J. Amer. Statist. Assoc., vol. 89, no. 427, pp. 958-966, 1994.
33. G. Heinrich, "Parameter estimation for text analysis," Tech. Rep., vsonix GmbH and University of Leipzig, 2005.
34. L. AlSumait, D. Barbar-a, and C. Domeniconi, "On-line LDA: Adaptive topic models for mining text streams with applications to topic detection and tracking," in Proc. IEEE 8th Int. Conf. Data Mining, 2008, pp. 3-12.
35. C. M. Bishop and N. M. Nasrabadi, Pattern Recognition and Machine Learning, vol. 1, New York, NY, USA: Springer, 2006.
36. B. Marthi, H. Pasula, S. Russell, and Y. Peres, "Decayed MCMC Filtering," in Proc. Conf. Uncertainty Artif. Intell., 2002, pp. 319-326.
37. M. Hoffman, F. R. Bach, and D. M. Blei, "Online learning for latent Dirichlet allocation," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 856-864.
38. T. Griffiths, M. Steyvers, D. Blei, and J. Tenenbaum, "Integrating topics and syntax," in Proc. Adv. Neural Inf. Process. Syst., 2005, vol. 17, pp. 537-544.
39. J. Boyd-Graber, J. Chang, S. Gerrish, C. Wang, and D. Blei, "Reading tea leaves: How humans interpret topic models," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 288-296.
40. D. Newman, J. H. Lau, K. Grieser, and T. Baldwin, "Automatic evaluation of topic coherence," in Proc. Annu. Conf. North Amer. Chapter Assoc. Comput. Linguistics, 2010, pp. 100-108.
41. D. Cai, Q. Mei, J. Han, and C. Zhai, "Modeling hidden topics on document manifold," in Proc. 17th ACM Conf. Inf. Knowl. Manage., 2008, pp. 911-920.