Understanding the limiting factors of topic modeling via posterior contraction analysis

31st International Conference on Machine Learning, ICML 2014

Volumn 1, Issue , 2014, Pages 337-345

  Tang, Jian ^a   Meng, Zhaoshi ^b   Nguyen, Xuan Long ^b   Mel, Qiaozhu ^b   Zhang, Ming ^a  

^a PEKING UNIVERSITY   (China)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; SOCIAL NETWORKING (ONLINE); STATISTICS;

CONTRACTION RATE; EMPIRICAL STUDIES; LATENT DIRICHLET ALLOCATIONS; MODEL PARAMETERS; PRACTICAL GUIDANCE; SYNTHETIC AND REAL DATA; SYSTEMATIC ANALYSIS; TOPIC MODELING;

FACTOR ANALYSIS;

EID: 84919825362     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Anandkumar, Animashree, Foster, Dean P, Hsu, Daniel, Kakade, Sham M, and Liu, Yi-Kai. Two SVDs suffice: Spectral decompositions for probabilistic topic modeling and latent dirichlet allocation. arXiv preprint arXiv: 1204.6703, 2012.
2. Arora, Saneev, Ge, Rong, and Moitra, Ankur. Learning topic models-going beyond SVD. arXiv preprint arXiv: 1204.1956, 2012.
3. Bing, Lidong, Lam, Wai, and Wong, Tak-Lam. Using query log and social tagging to refine queries based on latent topics. In Proceedings of the 20th ACM international conference on Information and knowledge management, pp. 583-592. ACM, 2011.
4. Blei, David M., Ng, Andrew Y, and Jordan, Michael I. Latent Dirichlet allocation. J. Mach. Learn. Res., 3: 993-1022, March 2003. ISSN 1532-4435.
5. Carman, Mark J, Crestani, Fabio, Harvey, Morgan, and Baillie, Mark. Towards query log based personalization using topic models. In CIKM, pp. 1849-1852. ACM, 2010.
6. Griffiths, Thomas L. and Steyvers, Mark. Finding scientific topics. PNAS, 101(suppl. l): 5228-5235, 2004.
7. Grimmer, Justin. A bayesian hierarchical topic model for political texts: Measuring expressed agendas in senate pressreleases. Political Analysis, 18(1): 1-35, 2010.
8. Hong, Liangjie and Davison, Brian D. Empirical study of topic modeling in Twitter. In Proceedings of the First Workshop on Social Media Analytics, SOMA ' 10, pp. 80-88, New York, NY, USA, 2010. ACM. ISBN 978-1-4503-0217-3.
9. Ling, Xu, Jiang, Jing, He, Xin, Mei, Qiaozhu, Zhai, Chengxiang, and Schatz, Bruce. Generating gene summaries from biomedical literature: A study of semi-structured summarization. Information Processing & Management, 43(6): 1777-1791, 2007.
10. Liu, Yan, Niculescu-Mizil, Alexandru, and Gryc, Woj-ciech. Topic-link LDA: joint models of topic and author community. In Proceedings of the 26th Annual International Conference on Machine Learning, pp. 665-672. ACM, 2009.
11. McCallum, A, Mann, GS, and Mimno, D. Bibliometric impact measures leveraging topic analysis. In JCDL, pp. 65-74. IEEE, 2006.
12. Mimno, David. Computational historiography: Data mining in a century of classics journals. Journal on Computing and Cultural Heritage (JOCCH), 5(1 ): 3, 2012.
13. Mimno, David and McCallum, Andrew. Organizing the oca: learning faceted subjects from a library of digital books. In Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries, pp. 376-385. ACM, 2007.
14. Mukherjee, Indraneel and Blei, David M. Relative performance guarantees for approximate inference in latent Dirichlet allocation. Advances in Neural Information Processing Systems, 21: 1129-1136, 2009.
15. Newman, David, Chemudugunta, Chaitanya, Smyth, Padhraic, and Steyvers, Mark. Analyzing entities and topics in news articles using statistical topic models. Intelligence and Security Informatics, pp. 93-104, 2006.
16. Newman, David, Noh, Youn, Talley, Edmund, Karimi, Sarvnaz, and Baldwin, Timothy. Evaluating topic models for digital libraries. In Proceedings of the 10th annual joint conference on Digital libraries, pp. 215-224. ACM, 2010.
17. Newman, David, Bonilla, Edwin V., and Buntine, Wray L. Improving topic coherence with regularized topic models. In NIPS, pp. 496-504, 2011.
18. Nguyen, XuanLong. Posterior contraction of the population polytope in finite admixture models. arXiv preprint arXiv: 1206.0068, 2012.
19. Pritchard, Jonathan K, Stephens, Matthew, and Donnelly, Peter. Inference of population structure using multilocus genotype data. Genetics, 155(2): 945-959, 2000.
20. Ramage, Daniel, Rosen, Evan, Chuang, Jason, Manning, Christopher D, and McFarland, Daniel A. Topic modeling for the social sciences. In NIPS 2009 Workshop on Applications for Topic Models: Text and Beyond, 2009.
21. Ramage, Daniel, Dumais, Susan, and Liebling, Dan. Characterizing microblogs with topic models. In ICWSM, 2010.
22. Wallach, Hanna M, Mimno, David M, and McCallum, Andrew. Rethinking LDA: Why priors matter. In NIPS, volume 22, pp. 1973-1981, 2009.
23. Wang, Chong and Blei, David M. Collaborative topic modeling for recommending scientific articles. In KDD, pp. 448-156, 2011.
24. Zhao, Wayne, Jiang, Jing, Weng, Jianshu, He, Jing, Lim, Ee-Peng, Yan, Hongfei, and Li, Xiaoming. Comparing Twitter and traditional media using topic models. Advances in Information Retrieval, pp. 338-349, 2011.