Model-based document clustering with a collapsed gibbs sampler

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2008, Pages 704-712

  Walker, Daniel David ^a   Ringger, Eric K ^a  

^a Brigham Young University   (United States)

Author keywords

Collapsed samplers; Document clustering; EM; Gibbs sampling; MCMC; Practical guidelines

Indexed keywords

COLLAPSED SAMPLERS; DOCUMENT CLUSTERING; EM; GIBBS SAMPLING; MCMC; PRACTICAL GUIDELINES;

CLUSTER ANALYSIS; CONVERGENCE OF NUMERICAL METHODS; INFORMATION MANAGEMENT; MINING; PARAMETER ESTIMATION; SAMPLING;

INFORMATION RETRIEVAL;

EID: 65449159058     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1401890.1401975     Document Type: Conference Paper

References (25)

1. A. Banerjee and S. Basu. Topic models over text streams: A study of batch and online unsupervised learning. In Procedings of the SIAM International Conference on Data Mining, Minneapolis, Minnesota, April 2007.
2. M. W. Berry, M. Brown, and B. Signer. 2001 topic annotated Enron email data set, 2007.
3. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research, 3:993-1022, 2003.
4. M.-H. Chen, Q.-M. Shao, and J. G. Ibrahim. Monte Carlo Methods in Bayesian Computation. Springer, 2000.
5. I. S. Dhillon, Y. Guan, and J. Kogan. Iterative clustering of high dimensional text data augmented by local search, icdm, 00:131, 2002.
6. B. Dom. An information-theoretic external cluster-validity measure. Technical Report RJ10219, IBM, Oct. 2001.
7. A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin. Bayesian Data Analysis. Chapman & Hall/CRC, second edition, 2004.
8. S. Goldwater and T. L. Griffiths. A fully bayesian aproach to unsupervised part-of-speech tagging. In The 45th Annual Meeting of the Association for Computational Linguistics (ACL'07), Prague, 2007.
9. T. L. Griffiths and M. Steyvers. Finding scientific topics. In Proceedings of the National Academy of Sciences, volume 101 (suppl. 1), pages 5228-5235, 2004.
10. A. Haghighi and D. Klein. Unsupervised coreference resolution in a nonparametric bayesian model. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 848-855, Prague, Czech Republic, June 2007. Association for Computational Linguistics.
11. L. Hubert and P. Arabie. Comparing partitions. Journal of Classification, 2(1):1.93-218, Dec. 1985.
12. T. Joachims. A probabilistic analysis of the Rocchio algorithm with TFIDF for text categorization. In Machine Learning: Proceedings of the Fourteenth International Conference (ICML'97), pages 143-151, 1997.
13. M. Meilǎ. Comparing clusterings - an information based distance. Journal of Multivariate Analysis, 98(5):873-895, 2007.
14. M. Meilǎ and D. Heckerman. An experimental comparison of model-based clustering methods. Machine Learning, 42(1-2):9-29, Jan. 2001.
15. R. M. Neal. Markov chain sampling methods for Dirichlet process mixture models. Journal of Computational and Graphical Statistics, 9(2):249-265, June 2000.
16. A. E. Raftery and S. M. Lewis. Implementing MCMC. Markov Chain Monte Carlo in Practice, pages 115-130, 1996.
17. S. Richardson and P. J. Green. On bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society. Series B, 59(4):731-792, 1997.
18. A. Rosenberg and J. Hirschberg. V-measure: A conditional entropy-based external cluster evaluation measure. In Joint Conference on Empirical Methods in Natural Language Processing and Computational Language Learning, Prague, June 2007.
19. M. M. Shafiei and E. E. Milios. Latent Dirichlet co-clustering. In ICDM '06: Proceedings of the Sixth International Conference on Data Mining, pages 542-551, Washington, DC, USA, 2006. IEEE Computer Society.
20. M. Steinbach, G. Karypis, and B. Kumar. A comparison of document clustering techniques. Technical report, University of Minnesota, May 2000.
21. M. Stephens. Dealing with label switching in mixture models. Journal of the Royal Statistical Society: Series B, 64(4):795-809, 2000.
22. Y. W. Teh, D. Newman, and M. Welling. A collapsed variational bayesian inference algorithm for latent Dirichlet allocation. In B. Schölkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems 19, pages 1353-1360, Cambridge, MA, 2007. MIT Press.
23. D. Walker and E. Ringger. New social bookmarking data set. http://nlp.cs.byu.edu/mediawiki/index.php/Data#New-Social-Bookmarking, Oct. 2007.
24. S. Yu. Advanced Probabilistic Models for Clustering and Projection. PhD thesis, Fakultät für Mathematik, Informatik und Statistik der Ludwig-Maximilians-Universität München, 2006.
25. J. Zhang, Z. Ghahramani, and Y. Yang. A probabilistic model for online document clustering with application to novelty detection. In Advances in Neural Information Processing Systems, pages 1617-1624. MIT Press, 2005.