Topic models with power-law using pitman-yor process

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2010, Pages 673-681

  Sato, Issei ^a   Nakagawa, Hiroshi ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

Latent dirichlet allocation; Nonparametric bayes; Pitman yor process; Power law; Topic model

Indexed keywords

LATENT DIRICHLET ALLOCATION; NON-PARAMETRIC; PITMAN-YOR PROCESS; POWER-LAW; TOPIC MODEL;

COMPUTATIONAL LINGUISTICS; DATA MINING; SECURITY OF DATA;

MODELS;

EID: 77956217643     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1835804.1835890     Document Type: Conference Paper

References (29)

1. T. Hofmann. Probabilistic latent semantic indexing. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, pages 50-57. ACM Press, 1999.
2. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent Dirichlet Allocation. Journal of Machine Learning Research, 3:993-1022, 2003.
3. T. L. Griffiths, M. Steyvers, D. M. Blei, and J. B. Tenenbaum. Integrating topics and syntax. In In Advances in Neural Information Processing Systems 17, pages 537-544. MIT Press, 2005.
4. M. Rosen-Zvi, T. Griffiths, M. Steyvers, and P. Smyth. The author-topic model for authors and documents. In Proceedings of the 20th conference on Uncertainty in artificial intelligence, pages 487-494, Arlington, VA, USA, 2004. AUAI Press.
5. M. Steyvers, P. Smyth, M. Rosen-Zvi, and T. Griffiths. Probabilistic author-topic models for information discovery. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 306-315, New York, NY, USA, 2004. ACM Press.
6. D. Newman, C. Chemudugunta, and P. Smyth. Statistical entity-topic models. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 680-686, New York, NY, USA, 2006. ACM Press.
7. D. M. Blei and J. D. Lafferty. Correlated Topic Models. In NIPS, 2005.
8. A. Gruber, M. Rosen-Zvi, and Y. Weiss. Hidden Topic Markov Models. In Proceedings of In Artificial Intelligence and Statistics, 2007.
9. D. M. Blei and J. D. Lafferty. Dynamic topic models. In Proceedings of the 23rd international conference on Machine learning, pages 113-120, New York, NY, USA, 2006. ACM.
10. C. Wang, D. M. Blei, and D. Heckerman. Continuous Time Dynamic Topic Models. In UAI, pages 579-586, 2008.
11. R. M. Nallapati, A. Ahmed, E. P. Xing, and W. W. Cohen. Joint latent topic models for text and citations. In Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 542-550, New York, NY, USA, 2008. ACM.
12. T. Iwata, T. Yamada, and N. Ueda. Probabilistic latent semantic visualization: topic model for visualizing documents. In Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 363-371, New York, NY, USA, 2008. ACM.
13. A. Gruber, M. Rosen-Zvi, and Y. Weiss. Latent Topic Models for Hypertext. In UAI, pages 230-239, 2008.
14. D. M. Mimno and A. McCallum. Topic Models Conditioned on Arbitrary Features with Dirichlet-multinomial Regression. In UAI, pages 411-418, 2008.
15. J. L. Boyd-Graber and D. Blei. Syntactic Topic Models. In NIPS, 2008.
16. J. Pitman and M. Yor. The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator. Annals of Probability, 25, 1997.
17. T. Ferguson. A Bayesian analysis of some nonparametric problems. The Annals of Statistics, 1:209-230, 1973.
18. S. Goldwater, T. L. Griffiths, and M. Johnson. Interpolating Between Types and Tokens by Estimating Power-Law Generators. In NIPS 18, 2006.
19. Y. W. Teh. A Hierarchical Bayesian Language Model Based On Pitman-Yor Processes. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 985-992, 2006.
20. Y. W. Teh. A Bayesian Interpretation of Interpolated Kneser-Ney. Technical Report TRA2/06, School of Computing, National University of Singapore, 2006.
21. D. Mochihashi and E. Sumita. The Infinite Markov Model. In J. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems 20, pages 1017-1024. MIT Press, Cambridge, MA, 2008.
22. H. Wallach, C. Sutton, and A. McCallum. Bayesian Modeling of Dependency Trees Using Hierarchical Pitman-Yor Priors. In Proceedings of the Workshop on Prior Knowledge for Text and Langugae (in conjunction with ICML/UAI/COLT), pages 15-20, 2008.
23. D. Mochihashi, T. Yamada, and N. Ueda. Bayesian unsupervised word segmentation with nested Pitman-Yor language modeling. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1, pages 100-108, Morristown, NJ, USA, 2009. Association for Computational Linguistics.
24. G. Doyle and C. Elkan. Accounting for burstiness in topic models. In Proceedings of the 26th Annual International Conference on Machine Learning, pages 281-288, New York, NY, USA, 2009. ACM.
25. T. L. Griffiths and M. Steyvers. Finding scientific topics. Proc Natl Acad Sci U S A, 101 Suppl 1:5228-5235, April 2004.
26. T. P. Minka. Estimating a Dirichlet distribution. Technical report, Microsoft, 2000.
27. D. Aldous. Exchangeability and related topics. In École d' été de Probabilité de Saint-Flour XIII, 1983.
28. K. R. Canini, L. Shi, and T. L. Griffiths. Online Inference of Topics with Latent Dirichlet Allocation. In Proceedings of the Twelfth International Conference on Artificial Intelligence and Statistics, 2009.
29. Escobar and West. Bayesian Density Estimation and Inference using Mixtures. Journal of the American Statistical Association, 90, 1995.