Differential topic models

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 2, 2015, Pages 230-242

  Chen, Changyou ^a   Buntine, Wray ^a   Ding, Nan ^b   Xie, Lexing ^a   Du, Lan ^c  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^b GOOGLE INC   (United States)

^c MACQUARIE UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; INFORMATION RETRIEVAL SYSTEMS;

DATA AUGMENTATION; DIRICHLET PROCESS; DOCUMENT CLASSIFICATION; DOCUMENT COLLECTION; EFFICIENT SAMPLING; HIERARCHICAL BAYESIAN; NON-PARAMETRIC MODEL; STATE OF THE ART;

TEXT PROCESSING;

EID: 84920936716     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2313127     Document Type: Article

References (51)

1. C. Zhai, A. Velivelli, and B. Yu, "A cross-collection mixture model for comparative text mining," in Proc. 10th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2004, pp. 743-748.
2. M. Paul, "Cross-collection topic models: Automatically comparing and contrasting text," Master's thesis, Univ. Illinois Urbana- Champaign, IL, USA, 2009.
3. A. Ahmed and E. Xing, "Staying informed: Supervised and semi-supervised multi-view topical analysis of ideological perspective," in Proc. Conf. Empirical Methods Natural Language Process., 2010, pp. 1140-1150.
4. W.-H. Lin, T. Wilson, J. Wiebe, and A. Hauptmann, "Which side are you on?: Identifying perspectives at the document and sentence levels," in Proc. 10th Conf. Comput. Natural Language Learning, 2006, pp. 109-116.
5. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. 22nd Annu. Int. ACM SIGIR Conf. Res. Develop. Inform. Retrieval, 1999, pp. 50-57.
6. J. Eisenstein, A. Ahmed, and E. Xing, "Sparse additive generative models of text," in Proc. Int. Conf. Mach. Learning, 2011, pp. 1041-1048.
7. M. Paul and R. Girju, "Cross-cultural analysis of blogs and forums with mixed-collection topic models," in Proc. Conf. Empirical Methods Natural Language Process.: Volume 3, 2009, pp. 1408-1417.
8. M. Paul and R. Girju, "A two-dimensional topic-aspect model for discovering multi-faceted topics," AAAI Conf. Artificial Intell., pp. 545-550, 2010.
9. M. Paul, C. Zhai, and R. Girju, "Summarizing contrastive viewpoints in opinionated text," in Proc. Conf. Empirical Methods Natural Language Process., 2010, pp. 66-76.
10. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
11. Y. W. Teh, M. I. Jordan, M. J. Beal, and D. M. Blei, "Hierarchical Dirichlet processes," J. Amer. Statist. Assoc., vol. 101, no. 476, pp. 1566-1581, 2006.
12. W. Li and A. Mccallum, "Pachinko allocation: DAG-structured mixture models of topic correlations," in Proc. 23rd Int. Conf. Mach. Learning, 2006, pp. 577-584.
13. D. Andrzejewski, X. Zhu, and M. Craven, "Incorporating domain knowledge into topic modeling via Dirichlet Forest priors," in Proc. 26th Annu. Int. Conf. Mach. Learning, 2009, pp. 25-32.
14. D.M. Blei, T.L. Griffiths, and M.I. Jordan, "The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies," J. ACM, vol. 57, no. 2, pp. 1-30, 2010.
15. S. Goldwater, T. Griffiths, and M. Johnson, "Producing power-law distributions and damping word frequencies with two-stage language models," J. Mach. Learn. Res., vol. 12, pp. 2335-2382, 2011.
16. I. Sato and H. Nakagawa, "Topic models with power-law using Pitman-Yor process," in Proc. 16th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010.
17. D. M. Blei and J. D. Lafferty, "A correlated topic model of science," Ann. Appl. Statist., vol. 1, no. 1, pp. 17-35, 2007.
18. D. Mimno, H. Wallach, and A. McCallum, "Gibbs sampling for logistic normal topic models with graph-based priors," in Proc. NIPS Workshop Analyzing Graphs, pp. 1-8, 2008.
19. J. Paisley, C. Wang, and D. Blei, "The discrete infinite logistic normal distribution," Bayesian Anal., vol. 7, no. 2, pp. 235-272, 2012.
20. L. Du, W. Buntine, H. Jin, and C. Chen, "Sequential latent Dirichlet allocation," Knowl. Inform. Syst., vol. 31, no. 3, pp. 475-503, 2012.
21. L. Du, W. Buntine, and H. Jin, "Modelling sequential text with an adaptive topic model," in Proc. Joint Conf. Empirical Methods Natural Language Process. Comput. Natural Language Learning, 2012, pp. 535-545.
22. C. Wang and D. M. Blei, "Decoupling sparsity and smoothness in the discrete hierarchical Dirichlet process," in Proc. Advances Neural Inform. Process. Syst. 22, 2009, pp. 1982-1989.
23. C. Wang, B. Thiesson, C. Meek, and D.M. Blei, "Markov topic models," in Proc. Artificial Intell. Statist., 2009, pp. 583-590.
24. J. Petterson, A. Smola, T. Caetano, W. Buntine, and S. Narayanamurthy, "Word features for latent Dirichlet allocation," in Proc. Advances Neural Inform. Process. Syst., 2010, pp. 1921-1929.
25. D. Newman, E. Bonilla, and W. Buntine, "Improving topic coherence with regularized topic models," in Proc. Advances Neural Inform. Process. Syst., 2011, pp. 496-504.
26. M. Paul and M. Dredze, "Factorial LDA: Sparse multi-dimensional text models," in Proc. Advances Neural Inform. Process. Syst., 2012, pp. 2591-2599.
27. L. Wan, L. Zhu, and R. Fergus, "A hybrid neural network-latent topic model," in Proc. 15th Int. Conf. Artificial Intell. Statist., 2012, pp. 1287-1294.
28. T. Ferguson, "A Bayesian analysis of some nonparametric problems," The Ann. Statist., vol. 1, pp. 209-230, 1973.
29. Y. W. Teh and M. I. Jordan, Hierarchical Bayesian Nonparametric Models with Applications. Cambridge, U.K.: Cambridge Univ. Press, 2010.
30. Y. W. Teh, "A hierarchical Bayesian language model based on Pitman- Yor processes," in Proc. 21st Int. Conf. Comput. Linguistics, 44th Annu. Meet. Assoc. Comput. Linguistics, 2006, pp. 985-992.
31. Y. W. Teh, "A Bayesian interpretation of interpolated Kneser- Ney," Nat. Univ, Singapore, Singapore,Tech. Rep. TRA2/06 2006.
32. P. Orbanz and J. M. Buhmann, "Nonparametric Bayesian image segmentation," Int. J. Comput. Vis., vol. 77, pp. 25-45, 2007.
33. L. Du, L. Ren, D. B. Dunson, and L. Carin, "A Bayesian model for simultaneous image clustering, annotation and object segmentation," in Proc. Advances Neural Inform. Process. Syst. 22, 2009, pp. 486-494.
34. E. B. Sudderth, A. Torralba, W. T. Freeman, and A. S. Willsky, "Describing visual scenes using transformed Dirichlet processes," in Advances Neural Inform. Process. Syst. 18, 2005, pp. 1299-1306.
35. F. Wood, C. Archambeau, J. Gasthaus, L. James, and Y. Teh, "A stochastic memoizer for sequence data," in Proc. 26th Ann. Int. Conf. Mach. Learning, 2009, pp. 1129-1136.
36. Z. Xu, V. Tresp, K. Yu, and H. P. Kriegel, "Infinite hidden relational models," in Proc. 22nd Conf. Annu. Conf. Uncertainty Artif. Intell., 2006, pp. 544-551.
37. H. Ishwaran and L. F. James, "Gibbs sampling methods for stickbreaking priors," J. Am. Statist. Assoc., vol. 96, no. 453, pp. 161- 173, 2001.
38. D. Aldous, "Exchangeability and related topics," in Proc.- Ecole d'- Et-e de Probabilit-esde Saint-Flour XIII, 1983, pp. 1-198.
39. B. A. Frigyik, M. R. Gupta, and Y. Chen, "Shadow Dirichlet for restricted probability modeling," in Proc. Advances Neural Inform. Process. Syst. 23, 2010, pp. 613-621.
40. C. Chen, L. Du, and W. Buntine, "Sampling table configurations for the hierarchical Poisson-Dirichlet process," in Proc. Eur. Conf. Mach. Learning Knowl. Discovery Databases, 2011, pp. 296-311.
41. C. Robert and G. Casella, Monte Carlo Statistical Methods. Second ed. New York, NY, USA: Springer-Verlag, 2004.
42. W. Buntine and M. Hutter, "A Bayesian view of the Poisson- Dirichlet process," Canberra, Australia: NICTA and ANU, Australia, Tech. Rep. arXiv:1007.0296 2012.
43. T. P. Minka, "Estimating a Dirichlet distribution," Massachusetts, MA, USA, Massachusetts Inst. Technol., Tech. Rep. 2000.
44. M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. K. Saul, "An introduction to variational methods for graphical models," Mach. Learn., vol. 37, pp. 183-233, 1999.
45. T. Yano, W. Cohen, and N. Smith, "Predicting response to political blog posts with topic models," in Proc. Annu. Conf. North Am. Chapter Assoc. Comput. Linguistics, 2009, pp. 477-485.
46. M. Rosen-Zvi, T. Griffiths, M. Steyvers, and P. Smyth, "The author-topic model for authors and documents," in Proc. 20th Conf. Uncertainty Artif. Intell., 2004, pp. 487-494.
47. L. Du, W. Buntine, and H. Jin, "A segmented topic model based on the two-parameter Poisson-Dirichlet process," Mach. Learn., vol. 81, pp. 5-19, 2010.
48. J. Deng, W. Dong, R. Socher, L. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 248-255.
49. C. Cortes and V.N. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
50. C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval. Cambridge, U.K.: Cambridge Univ. Press, 2008.
51. C. C. Chang and C. J. Lin, "Libsvm-A library for support vector machines," Nat. Taiwan University, Taiwan, China, Tech. Rep. 2013, [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/ libsvm/