Probabilistic topic models

IEEE Signal Processing Magazine

Volumn 27, Issue 6, 2010, Pages 55-65

  Blei, David ^a   Carin, Lawrence ^b   Dunson, David ^c  

^a Princeton University   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c DUKE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

STATISTICS;

COLLECTION OF DOCUMENTS; FINITE DIMENSIONAL; GRAPHICAL MODEL; HIERARCHICAL DIRICHLET PROCESS (HDP); NON-PARAMETRIC; PROBABILISTIC TOPIC MODELS; RECENT RESEARCHES; TOPIC MODEL;

PROBABILITY DISTRIBUTIONS;

EID: 85032751708     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2010.938079     Document Type: Article

References (66)

1. E. Airoldi, D. Blei, S. Fienberg, and E. Xing, "Mixed membership stochastic blockmodels," J. Mach. Learn. Res., vol. 9, pp. 1981-2014, 2008.
2. J. Aitchison, "The statistical analysis of compositional data," J. R. Statist. Soc., Ser. B, vol. 44, no. 2, pp. 139-177, 1982.
3. Q. An, C. Wang, I. Shterev, E. Wang, L. Carin, and D. B. Dunson, "Hierarchical kernel stick-breaking process for multi-task image analysis," in Proc. Int. Conf. Machine Learning, 2008.
4. D. Andrzejewski, A. Mulhern, B. Liblit, and X. Zhu, "Statistical debugging using latent topic models," in Proc. European Conf. Machine Learning, 2007.
5. C. E. Antoniak, "Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems," Ann. Statist., vol. 2, no. 6, pp. 1152-1174, 1974.
6. K. Barnard, P. Duygulu, N. de Freitas, D. Forsyth, D. Blei, and M. I. Jordan, "Matching words and pictures," J. Mach. Learn. Res., vol. 3, pp. 1107-1135, Mar. 2003.
7. C. Bishop, D. Spiegelhalter, and J. Winn, "VIBES: A variational inference engine for Bayesian networks," in Advances in Neural Information Processing Systems, vol. 15, S. Becker, S. Thrun, and K. Obermayer, Eds. Cambridge, MA: MIT Press, 2003, pp. 777-784.
8. D. Blei. [Online]. Available: http//www.cs.princeton.edu/blei/lda-c/
9. D. Blei and P. Frazier, "Distance dependent Chinese restaurant processes," in Proc. Int. Conf. Machine Learning, 2010.
10. D. Blei and M. Jordan, "Modeling annotated data," in Proc. ACM Special Interest Group on Information Retrieval (SIGIR'03), 2003.
11. D. Blei and M. Jordan, "Variational inference for Dirichlet process mixtures," Bayesian Anal., vol. 1, no. 1, pp. 121-144, 2006.
12. D. Blei and J. Lafferty, "Dynamic topic models," in Proc. Int. Conf. Machine Learning (ICML'06), 2006, pp. 113-120.
13. D. Blei and J. Lafferty, "Topic models," in Text Mining: Theory and Applications, A. Srivastava and M. Sahami, Eds. New York: Taylor & Francis, 2009.
14. D. Blei and J. D. Lafferty, "Dynamic topic models," in Proc. 23rd Int. Conf. Machine Learning, 2006, pp. 113-120.
15. D. Blei, A. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, Mar. 2003.
16. A. Bosch, A. Zisserman, and X. Munoz, "Scene classification via pLSA," in Proc. European Conf. Computer Vision, 2006.
17. M. Braun and J. McAuliffe, "Variational inference for large-scale models of discrete choice," J. Amer. Statist. Assoc., pp. 324-335, 2010.
18. W. Buntine and A. Jakulin, "Discrete component analysis," in Subspace, Latent Structure and Feature Selection. New York: Springer-Verlag, 2006.
19. L. Cao and L. Fei-Fei, "Spatially coherent latent topic model for concurrent segmentation and classification of objects and scenes," in Proc. Int. Conf. Computer Vision, 2007.
20. J. Chang. [Online]. Available: http://cran.r-project.org/web/packages/ lda/
21. J. Chang and D. Blei, "Hierarchical relational models for document networks," Ann. Appl. Statist., vol. 4, no. 1, 2010.
22. J. Chang, J. Boyd-Graber, S. Gerrish, C. Wang, and D. Blei, "Reading tea leaves: How humans interpret topic models," in Advances in Neural Information Processing Systems, vol. 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, Eds. 2009, pp. 288-296.
23. S. Deerwester, S. Dumais, T. Landauer, G. Furnas, and R. Harshman, "Indexing by latent semantic analysis," J. Amer. Soc. Inform. Sci., vol. 41, no. 6, pp. 391-407, 1990.
24. L. Du, L. Ren, D. Dunson, and L. Carin, "A Bayesian model for simultaneous image clustering, annotation and object segmentation," in Proc. Neural and Information Processing Systems (NIPS'09), 2009.
25. E. Erosheva, "Bayesian estimation of the grade of membership model," in Bayesian Statistics. vol. 7, pp. 501-510, 2003.
26. E. Erosheva, S. Fienberg, and C. Joutard, "Describing disability through individual-level mixture models for multivariate binary data," Ann. Appl. Statist., 2007.
27. W. Ewens, "The sampling theory of selective neutral alleles," Theor. Popul. Biol., vol. 3, pp. 87-112, 1972.
28. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. IEEE Computer Vision and Pattern Recognition, 2005, pp. 524-531.
29. T. Ferguson, "A Bayesian analysis of some nonparametric problems," Ann. Statist., vol. 1, no. 2, pp. 209-230, 1973.
30. A. Gelman, J. Carlin, H. Stern, and D. Rubin, Bayesian Data Analysis. London, U.K.: Chapman & Hall, 1995.
31. S. Gerrish and D. Blei, "A language-based approach to measuring scholarly impact," in Proc. Int. Conf. Machine Learning, 2010.
32. T. Griffiths and M. Steyvers, "Finding scientific topics," Proc. Nat. Acad. Sci., 2004, vol. 101, pp. 5228-5235.
33. M. Hoffman, D. Blei, and P. Cook, "Content-based musical similarity computation using the hierarchical Dirichlet process," in Proc. Int. Conf. Music Information Retrieval, 2008.
34. M. Hoffman, D. Blei, and P. Cook, "Finding latent sources in recorded music with a shift-invariant HDP," in Proc. Int. Conf. Digital Audio Effects, 2009.
35. T. Hofmann, "Probabilistic latent semantic analysis," in Proc. Uncertainty in Artificial Intelligence, 1999.
36. R. Kass and A. Raftery, "Bayes factors," J. Amer. Statist. Assoc., vol. 90, no. 430, pp. 773-795, 1995.
37. J. Li, R. Socher, and L. Fei-Fei, "Towards total scene understanding: Classification, annotation and segmentation in an automatic framework," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
38. A. McCallum. [Online]. Available: http://mallet.cs.umass.edu
39. D. Mimno and A. McCallum, "Topic models conditioned on arbitrary features with Dirichlet-multinomial regression," in Proc. Uncertainty in Artificial Intelligence, 2008.
40. D. Mimno, "Reconstructing Pompeian households," in Proc. Applications of Topic Models Workshop, 2009.
41. P. Muller, S. Walker, N. Hjort, C. Holmes, Eds., Bayesian Nonparametrics. Cambridge, U.K.: Cambridge Univ. Press, 2010.
42. R. Nallapati and W. Cohen, "Link-pLSA-LDA: A new unsupervised model for topics and influence of blogs," in Proc. Int. Conf. on Weblogs and Social Media (ICWSM'08), 2008.
43. D. Newman, A. Asuncion, P. Smyth, and M. Welling, "Distributed inference for latent Dirichlet allocation," in Proc. Neural Information Processing Systems (NIPS'07), 2007.
44. D. Newman, J. H. Lau, K. Grieser, and T. Baldwin, "Automatic evaluation of topic coherence," in Proc. North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT'10), 2010.
45. J. Pitman, Combinatorial Stochastic Processes (Lect. Notes for St. Flour Summer School). New York, NY: Springer-Verlag, 2002.
46. J. Pritchard, M. Stephens, and P. Donnelly, "Inference of population structure using multilocus genotype data," Genetics, vol. 155, pp. 945-959, June 2000.
47. I. Pruteanu-Malinici, L. Ren, J. Paisley, E. Wang, and L. Carin, "Hierarchical Bayesian modeling of topics in time-stamped documents," IEEE Trans. Pattern Anal. Machine Intell., 2009.
48. V. Rao and Y. W. Teh, "Spatial normalized gamma processes," in Advances in Neural Information Processing Systems, vol. 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, Eds. 2009, pp. 1554-1562.
49. L. Ren, D. Dunson, S. Lindroth, and L. Carin, "Dynamic nonparametric Bayesian models for analysis of music," J. Amer. Statist. Assoc., 2009.
50. C. Robert and G. Casella, Monte Carlo Statistical Methods (Springer Texts in Statistics). New York, NY: Springer-Verlag, 2004.
51. J. Sivic, B. Russell, A. Efros, A. Zisserman, and W. Freeman, "Discovering object categories in image collections," CSAIL, MIT, Tech. Rep., 2005.
52. M. Steyvers and T. Griffiths, "Probabilistic topic models," in Latent Semantic Analysis: A Road to Meaning, T. Landauer, D. McNamara, S. Dennis, and W. Kintsch, Eds. Lawrence Erlbaum, 2006.
53. E. B. Sudderth and M. I. Jordan, "Shared segmentation of natural scenes using dependent Pitman-Yor processes," in Proc. Neural Information Processing Systems (NIPS'08), 2008.
54. Y. Teh, M. Jordan, M. Beal, and D. Blei, "Hierarchical Dirichlet processes," J. Acoust. Soc. Amer., vol. 101, no. 476, pp. 1566-1582, 2005.
55. Y. Teh, K. Kurihara, and M. Welling, "Collapsed variational inference for HDP," in Proc. Neural Information Processing Systems (NIPS'07), 2007.
56. Y. Teh, D. Newman, and M. Welling, "A collapsed variational Bayesian inference algorithm for latent Dirichlet allocation," in Proc. Neural Information Processing Systems (NIPS'06), 2006.
57. C. Wang, D. Blei, and L. Fei-Fei, "Simultaneous image classification and annotation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
58. C. Wang, D. Blei, and D. Heckerman, "Continuous time dynamic topic models," in Proc. Uncertainty in Artificial Intelligence (UAI), 2008.
59. X. Wang and E. Grimson, "Spatial latent Dirichlet allocation," in Proc. Neural Information Processing Systems (NIPS'07), 2007.
60. X. Wang, X. Ma, and E. Grimson, "Unsupervised activity perception by hierarchical Bayesian models," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2007, pp. 1-8.
61. X. Wang, X. Ma, and E. Grimson, "Unsupervised activity perception in crowded and complicated scenes using hierarchical Bayesian models," IEEE Trans. Pattern Anal. Machine Intell., 2009.
62. X. Wang and A. McCallum, "Topics over time: A non-Markov continuous-time model of topical trends," in Proc. 12th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, 2006, pp. 424-433.
63. M. Welling, Y. Teh, and B. Kappen, "Hybrid variational/Gibbs collapsed inference in topic models," in Proc. Conf. Uncertainty in Artifical Intelligence (UAI'08), Citeseer, 2008, pp. 587-594.
64. M. West and J. Harrison, "Bayesian forecasting and dynamic models," in Proc. Int. Conf. Machine Learning. New York: Springer-Verlag, 1997.
65. O. Yakhnenko and V. Honavar, "Multi-modal hierarchical Dirichlet process model for predicting image annotation and image-object label correspondence," in Proc. SIAM Conf. Data Mining (SDM'09), 2009.
66. F. Yan, N. Xu, and Y. Qi, "Parallel inference for latent Dirichlet allocation on graphics processing units," in Advances in Neural Information Processing Systems, vol. 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, Eds. 2009, pp. 2134-2142.