Investigating task performance of probabilistic topic models: An empirical study of PLSA and LDA

Information Retrieval

Volumn 14, Issue 2, 2011, Pages 178-203

  Lu, Yue ^a   Mei, Qiaozhu ^b   Zhai, ChengXiang ^a  

^a University of Illinois at Urbana Champaign   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Evaluation; Experimentation; LDA; Performance; PLSA; Topic models

Indexed keywords

EID: 79953230442     PISSN: 13864564     EISSN: 15737659     Source Type: Journal    
DOI: 10.1007/s10791-010-9141-9     Document Type: Article

References (30)

1. Blei, D. M., Griffiths, T. L., Jordan, M. I., & Tenenbaum, J. B. (2004). Hierarchical topic models and the nested chinese restaurant process. In Advances in neural information processing systems (p. 2003). MIT Press.
2. Blei, D. M., & Lafferty, J. D. (2005). Correlated topic models. In NIPS. MIT Press.
3. Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022.
4. Cai, D., Mei, Q., Han, J., & Zhai, C. (2008). Modeling hidden topics on document manifold. In J. G. Shanahan, S. Amer-Yahia, I. Manolescu, Y. Zhang, D. A. Evans, A. Kolcz, K.-S. Choi, & A. Chowdhury (Eds.), CIKM (pp. 911-920). ACM.
5. Chang, J., Boyd-Graber, J., Wang, C., Gerrish, S., & Blei, D. M. (2009). Reading tea leaves: How humans interpret topic models. In Neural information processing systems. MIT Press.
6. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of Royal Statistical Society, Series B, 39, 1-38.
7. Gaussier, E., & Goutte, C. (2005). Relation between plsa and nmf and implications. In SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval (pp. 601-602). New York, NY, USA: ACM.
8. Geman, S., & Geman, D. (1984). Stochastic relaxation, gibbs distributions and the bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6(6), 721-741.
9. Girolami, M., & Kabán, A. (2003). On an equivalence between plsi and lda. In SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on research and development in informaion retrieval (pp. 433-434). New York, NY, USA: ACM.
10. Griffiths, T. L., & Steyvers, M. (2004). Finding scientific topics. Proceedings of the National Academy of Sciences of the United States of America, 101(Suppl. 1), 5228-5235.
11. Hofmann, T. (1999a). Probabilistic latent semantic analysis. In K. B. Laskey & H. Prade (Eds.), UAI (pp. 289-296). Morgan Kaufmann.
12. Hofmann, T. (1999b). Probabilistic latent semantic indexing. In SIGIR '99: Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval (pp. 50-57). New York, NY, USA. ACM.
13. Lacoste-Julien, S., Sha, F., & Jordan, M. I. (2008). Disclda: Discriminative learning for dimensionality reduction and classification. In D. Koller, D. Schuurmans, Y. Bengio, & L. Bottou (Eds.), NIPS (pp. 897-904). MIT Press.
14. Li, W., & McCallum, A. (2006). Pachinko allocation: Dag-structured mixture models of topic correlations. In ICML '06 (pp. 577-584). ACM.
15. Mei, Q., Cai, D., Zhang, D., & Zhai, C. (2008). Topic modeling with network regularization. In WWW '08: Proceeding of the 17th international conference on World Wide Web (pp. 101-110). New York, NY, USA: ACM.
16. Mei, Q., Ling, X., Wondra, M., Su, H., & Zhai, C. (2007). Topic sentiment mixture: modeling facets and opinions in weblogs. In WWW '07: Proceedings of the 16th international conference on World Wide Web (pp. 171-180). New York, NY, USA: ACM.
17. Mei, Q., & Zhai, C. (2006). A mixture model for contextual text mining. In KDD '06: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 649-655). New York, NY, USA: ACM.
18. Minka, T. P., & Lafferty, J. D. (2002). Expectation-propogation for the generative aspect model. In A. Darwiche, & N. Friedman (Eds.), UAI (pp. 352-359). Morgan Kaufmann.
19. Nallapati, R. M., Ahmed, A., Xing, E. P., & Cohen, W. W. (2008). Joint latent topic models for text and citations. In Proceeding of the 14th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 542-550). New York, NY, USA: ACM.
20. Steyvers, M., & Griffiths, T. (2007). Probabilistic topic models. Lawrence Erlbaum Associates.
21. Steyvers, M., Smyth, P., Rosen-Zvi, M., & Griffiths, T. (2004). Probabilistic author-topic models for information discovery. In KDD '04: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 306-315). New York, NY, USA: ACM.
22. Teh, Y. W., & Görür, D. (2009). Indian buffet processes with power-law behavior. In Advances in neural information processing systems. MIT Press.
23. Wallach, H. M., Murray, I., Salakhutdinov, R., & Mimno, D. (2009). Evaluation methods for topic models. In ICML '09: Proceedings of the 26th annual international conference on machine learning (pp. 1105-1112). New York, NY, USA: ACM.
24. Wang, X., & McCallum, A. (2006). Topics over time: A non-markov continuous-time model of topical trends. In KDD '06: Proceedings of the 12th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 424-433). New York, NY, USA: ACM.
25. Wei, X., & Bruce Croft, W. (2006). Lda-based document models for ad-hoc retrieval. In SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval (pp. 178-185). New York, NY, USA: ACM.
26. Xu, W., Liu, X., & Gong, Y. (2003). Document clustering based on non-negative matrix factorization. In SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on research and development in informaion retrieval (pp. 267-273). New York, NY, USA: ACM.
27. Yi, X., & Allan, J. (2009). A comparative study of utilizing topic models for information retrieval. In ECIR '09: Proceedings of the 31th European conference on IR research on advances in information retrieval (pp. 29-41). Berlin, Heidelberg: Springer.
28. Zhai, C., & Lafferty, J. (2001). Model-based feedback in the language modeling approach to information retrieval. In CIKM'01: Proceedings of the tenth international conference on information and knowledge management (pp. 403-410). New York, NY, USA: ACM.
29. Zhai, C., & Lafferty, J. (2001). A study of smoothing methods for language models applied to ad hoc information retrieval. In SIGIR '01: Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval (pp. 334-342). New York, NY, USA: ACM.
30. Zhai, C., Velivelli, A., & Yu, B. (2004). A cross-collection mixture model for comparative text mining. In KDD '04: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 743-748). New York, NY, USA: ACM.