The dual-sparse topic model: Mining focused topics and focused terms in short text

WWW 2014 - Proceedings of the 23rd International Conference on World Wide Web

Volumn , Issue , 2014, Pages 539-549

  Lin, Tianyi ^a   Tian, Wentao ^a   Mei, Qiaozhu ^b   Cheng, Hong ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Sparse representation; Spike and slab; Topic modeling; Usergenerated content

Indexed keywords

MIXTURES;

LARGE CORPORA; REAL-WORLD SCENARIO; SOCIAL MEDIA; SPARSE REPRESENTATION; SPIKE AND SLAB; TOPIC MODELING; USER-GENERATED; USER-GENERATED CONTENT;

TEXT MINING;

EID: 84909644017     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2566486.2567980     Document Type: Conference Paper

References (32)

1. C. Archambeau, B. Lakshminarayanan, and G. Bouchard. Latent IBP compound dirichlet allocation. In NIPS Bayesian Nonparametrics Workshop, 2011.
2. A. Asuncion, M. Welling, P. Smyth, and Y. W. Teh. On smoothing and inference for topic models. In UAI, pages 27-34, 2009.
3. Y. Bengio, A. C. Courville, and J. S. Bergstra. Unsupervised models of images by spike-and-slab rbms. In ICML, pages 1145-1152, 2011.
4. D. M. Blei. Probabilistic topic models. Communications of the ACM, 55(4):77-84, 2012.
5. D. M. Blei, T. L. Griffiths, M. I. Jordan, and J. B. Tenenbaum. Hierarchical topic models and the nested chinese restaurant process. In NIPS, pages 106-114, 2003.
6. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. JMLR, 3:993-1022, 2003.
7. J. Chang, J. L. Boyd-Graber, S. Gerrish, C. Wang, and D. M. Blei. Reading tea leaves: How humans interpret topic models. In NIPS, pages 288-296, 2009.
8. X. Chen, M. Zhou, and L. Carin. The contextual focused topic model. In KDD, pages 96-104, 2012.
9. A. C. Courville, J. Bergstra, and Y. Bengio. A spike and slab restricted boltzmann machine. In International Conference on Artificial Intelligence and Statistics, pages 233-241, 2011.
10. K. Crammer and Y. Singer. On the algorithmic implementation of multiclass kernel-based vector machines. JMLR, 2:265-292, 2002.
11. J. V. Graca, K. Ganchev, B. Taskar, and F. Pereira. Posterior vs. parameter sparsity in latent variable models. In NIPS, pages 664-672, 2009.
12. T. Griffiths and M. Steyvers. Finding scientific topics. PNAS, 101:5228-5235, 2004.
13. T. Hofmann. Probabilistic latent semantic analysis. In UAI, pages 289-296, 1999.
14. P. O. Hoyer. Non-negative matrix factorization with sparseness constraints. JMLR, 5:1457-1469, 2004.
15. H. Ishwaran and J. S. Rao. Spike and slab variable selection: Frequentist and bayesian strategies. The Annals of Statistics, 33(2):730-773, 2005.
16. A. Kabán, E. Bingham, and T. Hirsimäki. Learning to read between the lines: The aspect bernoulli model. In SDM, pages 462-466, 2004.
17. D. D. Lee and H. S. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401(6755):788-791, 1999.
18. Y. Lu, Q. Mei, and C. Zhai. Investigating task performance of probabilistic topic models: an empirical study of plsa and lda. Information Retrieval, 14(2):178-203, 2011.
19. R. Mehrotra, S. Sanner, W. Buntine, and L. Xie. Improving lda topic models for microblogs via tweet pooling and automatic labeling. In SIGIR, pages 889-892, 2013.
20. D. Newman, J. H. Lau, K. Grieser, and T. Baldwin. Automatic evaluation of topic coherence. In NAACL, pages 100-108, 2010.
21. I. Sato and H. Nakagawa. Rethinking collapsed variational bayes inference for lda. In ICML, 2012.
22. E. Saund. A multiply cause mixture model for unsupervised learning. Neural Comput., 7(1):51-71, 1995.
23. M. Shashanka, B. Raj, and P. Smaragdis. Sparse overcomplete latent variable decomposition of counts data. In NIPS, pages 1313-1320, 2007.
24. J. Tang, M. Zhang, and Q. Mei. One theme in all views: Modeling consensus topics in multiple contexts authors. In KDD, pages 5-13, 2013.
25. Y. W. Teh, D. Newman, and M. Welling. A collapsed variational bayesian inference algorithm for latent dirichlet allocation. In NIPS, pages 1353-1360, 2006.
26. H. M. Wallach, D. Mimno, and A. McCallum. Rethinking lda: Why priors matter. In NIPS, pages 1973-1981, 2009.
27. C. Wang and D. M. Blei. Decoupling sparsity and smoothness in the discrete hierarchical dirichlet process. In NIPS, pages 1982-1989, 2009.
28. Q. Wang, J. Xu, H. Li, and N. Craswell. Regularized latent semantic indexing. In SIGIR, pages 685-694, 2011.
29. S. Williamson, C. Wang, K. A. Heller, and D. M. Blei. Focused topic models. In NIPS Workshop on Applications for Topic Models: Text and Beyond, 2009.
30. S. Williamson, C. Wang, K. A. Heller, and D. M. Blei. The ibp compound dirichlet process and its application to focused topic modeling. In ICML, pages 1151-1158, 2010.
31. W. X. Zhao, J. Jiang, J. Weng, J. He, E.-P. Lim, H. Yan, and X. Li. Comparing twitter and traditional media using topic models. In ECIR, pages 338-349, 2011.
32. J. Zhu and E. P. Xing. Sparse topical coding. In UAI, pages 831-838, 2011.