Care and feeding of topic models: Problems, diagnostics, and improvements

Handbook of Mixed Membership Models and Their Applications

Volumn , Issue , 2014, Pages 225-254

  Boyd Graber, Jordan ^a   Mimno, David ^b   Newman, David ^c  

^a University of Colorado at Boulder   (United States)

^b Cornell University ^*  (United States)

^c GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

TOPIC MODEL; TOPIC MODELING; VERSATILE TOOLS;

EID: 85007337530     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b17520     Document Type: Chapter

References (59)

1. AlSumait, L., Barbará, D., Gentle, J., and Domeniconi, C. (2009). Topic significance ranking of LDA generative models. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part I (ECML PKDD '09). Berlin, Heidelberg: Springer-Verlag, 67-82.
2. th International Conference of Machine Learning (ICML '09). New York, NY, USA: ACM, 25-32.
3. Bird, S., Klein, E., and Loper, E. (2009). Natural Language Processing with Python. O’Reilly Media.
4. Blei, D. M., Griffiths, T. L., and Jordan, M. I. (2007). The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies. Journal of the ACM 57: 7.1-7.30.
5. Blei, D. M. and Lafferty, J. D. (2005). Correlated Topic Models. In Weiss, Y., Schölkopf, B., and Platt, J. (eds), Advances in Neural Information Processing Systems 18. Cambridge, MA: The MIT Press, 147-154.
6. rd International Conference of Machine Learning (ICML '06). New York, NY, USA: ACM, 113-120.
7. Blei, D. M. and Lafferty, J. D. (2009). Visualizing topics with multi-word expressions. http://arxiv.org/abs/0907.1013 [stat.ML].
8. Blei, D. M., Ng, A. Y., and Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research 3: 993-1022.
9. Boyd-Graber, J. and Blei, D. M. (2008). Syntactic Topic Models. In Koller, D., Schuurmans, D., Bengio, Y., and Bottou, L. (eds), Advances in Neural Information Processing Systems 21. Red Hook, NY: Curran Associates, Inc., 185-192.
10. Boyd-Graber, J., Blei, D. M., and Zhu, X. (2007). A topic model for word sense disambiguation. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. Stroudsburg, PA, USA: Association of Computational Linguistics, 1024-1033.
11. th Conference of the European Chapter of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 103-111.
12. st Asian Conference on Machine Learning: Advances in Machine Learning. Berlin, Heidelberg: Springer-Verlag, 51-64.
13. th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '09). New York, NY, USA: ACM, 169-178.
14. Chang, J., Boyd-Graber, J., Wang, C., Gerrish, S., and Blei, D. M. (2009b). Reading tea leaves: How humans interpret topic models. In Bengio, Y., Schuurmans, D., Lafferty, J. D., Williams, C. K. I., and Culotta, A. (eds), Advances in Neural Information Processing Systems 22. Red Hook, NY: Curran Associates, Inc., 288-296.
15. th Annual International Conference on Machine Learning (ICML '07). New York, NY, USA: ACM, 233-240.
16. th Annual Meeting of the Association for Computational Linguistics: Short Papers - Vol. 2. Stroudsburg, PA, USA: Association for Computational Linguistics, 115-119.
17. th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2005). Los Alamitos, CA, USA: IEEE Computer Society, 524-531.
18. Freedman, A. (2007). The Party of the First Part: The Curious World of Legalese. New York, NY: Henry Holt and Company.
19. th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Comptuational Linguistics, 673-680.
20. Griffiths, T. L. and Steyvers, M. (2004). Finding scientific topics. Proceedings of the National Academy of Sciences 101: 5228-5235.
21. Griffiths, T. L., Steyvers, M., Blei, D. M., and Tenenbaum, J. B. (2005). Integrating topics and syntax. In Saul, L. K., Weiss, Y., and Bottou, L. (eds), Advances in Neural Information Processing Systems 17. Cambridge, MA: The MIT Press, 537-544.
22. th International Conference on Artificial Intelligence and Statistics (AISTATS 2007). Journal of Machine Learning Research - Proceedings Track 2: 163-170.
23. Haghighi, A. and Vanderwende, L. (2009). Exploring content models for multi-document summarization. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Boulder, Colorado: Association for Computational Linguistics, 362-370.
24. Hall, D., Jurafsky, D., and Manning, C. D. (2008). Studying the history of ideas using topic models. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP '08). Stroudsburg, PA, USA: Association for Computational Linguistics, 363-371.
25. Hardisty, E. A., Boyd-Graber, J., and Resnik, P. (2010). Modeling perspective using adaptor grammars. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing (EMNLP '10). Stroudsburg, PA, USA: Association for Computational Linguistics, 284-292.
26. Hu, Y., Boyd-Graber, J., Satinoff, B., and Smith, A. (To Appear). Interactive topic modeling. Machine Learning Journal.
27. th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 1148-1157.
28. rd ACM International Conference on Web Search and Data Mining (WSDM '10). New York, NY, USA: ACM, 441-450.
29. Lau, J. H., Grieser, K., Newman, D., and Baldwin, T. (2011). Automatic Labelling of Topic Models. In Proceedings of the Association for Computational Linguistics, 1536-1545.
30. rd International Conference on Computational Linguistics (Coling 2010). Poster presented. Beijing, China, 605-613.
31. th Conference on Computational Natural Language Learning (CoNLL-X '06). Stroudsburg, PA, USA: Association for Computational Linguistics, 109-116.
32. Mahmoud, H. (2008). Pólya Urn Models. Chapman & Hall/CRC, 1st edition.
33. Manning, C. D. and Schütze, H. (1999). Foundations of Statistical Natural Language Processing. Cambridge, MA: The MIT Press.
34. Marcus, M. P., Santorini, B., and Marcinkiewicz, M. A. (1993). Building a large annotated corpus of English: The Penn treebank. Computational Linguistics 19: 313-330.
35. Mimno, D., Wallach, H. M., Talley, E. M., Leenders, M., and McCallum, A. (2011). Optimizing semantic coherence in topic models. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP '11). Stroudsburg, PA, USA: Association for Computational Linguistics, 262-272.
36. Narayanamurthy, S. (2011). Yahoo! LDA project.
37. Neal, R. M. (1993). Probabilistic Inference Using Markov Chain Monte Carlo Methods. Tech. report CRG-TR-93-1, University of Toronto.
38. Newman, D., Baldwin, T., Cavedon, L., Huang, E., Karimi, S., Martinez, D., Scholer, F., and Zobel, J. (2010a). Visualizing search results and document collections using topic maps. Web Semantics 8: 169-175.
39. Newman, D., Bonilla, E., and Buntine, W. (2011). Improving topic coherence with regularized topic models. In Shawe-Taylor, J., Zemel, R. S., Bartlett, P., Pereira, F. C. N., and Weinberger, K. Q. (eds), Advances in Neural Information Processing Systems 24. Red Hook, NY: Curran Associates, Inc., 496-504.
40. Newman, D., Lau, J. H., Grieser, K., and Baldwin, T. (2010b). Automatic evaluation of topic coherence. In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 100-108.
41. th Annual Meeting of the Association for Computational Linguistics: Long Papers -Vol. 1. Stroudsburg, PA, USA: Association for Computational Linguistics, 78-87.
42. th AAAI Conference on Artificial Intelligence (AAAI 2010). Palo Alto, CA, USA: AAAI, 545-550.
43. Porter, M. F. (1980). An algorithm for suffix stripping. Program: Electronic Library and Information Systems 14: 130-137.
44. th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 17-24.
45. Ramage, D., Hall, D., Nallapati, R. M., and Manning, C. D. (2009). Labeled LDA: A supervised topic model for credit attribution in multi-labeled corpora. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Vol. 1. Stroudsburg, PA, USA: Association for Computational Linguistics, 248-256.
46. th Conference on Uncertainty in Artificial Intelligence. Arlington, VA, USA: AUAI Press, 487-494.
47. Salton, G. (1968). Automatic Information Organization and Retrieval. McGraw Hill Text.
48. Sandhaus, E. (2008). The New York Times Annotated Corpus. Philadelphia, PA: Linguistic Data Consortium.
49. Schemann, H. and Knight, P. (1995). German-English Dictionary of Idioms. Oxford, UK: Routledge.
50. Taghva, K., Elkhoury, R., and Coombs, J. (2005). Arabic stemming without a root dictionary. In Proceedings of the Internaional Conference on Information Technology: Coding and Computing - Vol. 1 (ITCC 2005). Los Alamitos, CA, USA: IEEE Computer Society, 152-157.
51. Talley, E. M., Newman, D., Mimno, D., Herr, B. W., Wallach, H. M., Burns, G. A. P. C., Leenders, M., and McCallum, A. (2011). Database of NIH grants using machine-learned categories and graphical clustering. Nature Methods 8: 443-444.
52. Teh, Y. W., Jordan, M. I., Beal, M. J., and Blei, D. M. (2006). Hierarchical Dirichlet processes. Journal of the American Statistical Association 101: 1566-1581.
53. th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, PA, USA: Association for Computational Linguistics, 308-316.
54. Wallach, H. M., Mimno, D., and McCallum, A. (2009a). Rethinking LDA: Why priors matter. In Bengio, Y., Schuurmans, D., Lafferty, J. D., Williams, C. K. I., and Culotta, A. (eds), Advances in Neural Information Processing Systems 22. Red Hook, NY: Curran Associates, Inc., 1973-1981.
55. rd International Conference of Machine Learning (ICML '06). New York, NY, USA: ACM, 977-984.
56. th Annual International Conference of Machine Learning (ICML '09). New York, NY, USA: ACM, 1105-1112.
57. Wei, X. and Croft, B. (2006). LDA-based document models for ad-hoc retrieval. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '06). New York, NY, USA: ACM, 178-185.
58. th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, NY, USA: ACM, 937-946.
59. st International Conference on World Wide Web. New York, NY, USA: ACM, 879-888.