Conditional topical coding: An efficient topic model conditioned on rich features

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2011, Pages 475-483

  Zhu, Jun ^a   Lao, Ni ^a   Chen, Ning ^b   Xing, Eric P ^a  

^a Carnegie Mellon University   (United States)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

Conditional models; Sparse coding; Topic models

Indexed keywords

CODES (SYMBOLS); DATA MINING; PROBABILITY DISTRIBUTIONS;

APPLICATIONS DOMAINS; CONDITIONAL MODELS; ORDERS OF MAGNITUDE; PARTITION FUNCTIONS; PROBABILISTIC CONDITIONALS; PROBABILISTIC TOPIC MODELS; RICH FEATURES; SETS OF FEATURES; SPARSE CODING; TOPIC MODELING;

LEARNING ALGORITHMS;

EID: 80052646861     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2020408.2020484     Document Type: Conference Paper

References (42)

1. A. Asuncion, M. Welling, P. Smyth, and Y. Teh. On smoothing and inference for topic models. In UAI, 2009.
2. S. Bengio, F. Pereira, Y. Singer, and D. Strelow. Group sparse coding. In NIPS, 2009.
3. D. Blei and J. McAuliffe. Supervised topic models. In NIPS, 2007.
4. D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. JMLR, (3):993-1022, 2003.
5. S. Branavan, H. Chen, J. Eisenstein, and R. Barzilay. Learning document-level semantic properties from free-text annotations. In ACL, 2008.
6. W. Buntine and A. Jakulin. Discrete components analysis. Subspace, Latent Structure and Feature Selection Techniques, 2006.
7. G. Cawley, N. Talbot, and M. Girolami. Sparse multinomial logistic regression via bayesian l1 regularization. In NIPS, 2007.
8. A. Culotta, D. Kulp, and A. McCallum. Gene prediction with conditional random fields. Tech. Report UM-CS-2005-028, UMass, Amherst., 2005.
9. J. Duchi, S. Shalev-Shwartz, Y. Singer, and T. Chandra. Efficient projections onto the l1-ball for learning in high dimensions. In ICML, 2008.
10. C.-S. Foo, C. Do, and A. Ng. A majorization-minimization algorithm for (multiple) hyperparameter learning. In ICML, 2009.
11. J. Graca, K. Ganchev, B. Taskar, and F. Pereira. Posterior vs. parameter sparsity in latent variable models. In NIPS, 2009.
12. T. Hofmann. Probabilistic latent semantic analysis. In UAI, 1999.
13. P. Hoyer. Non-negative sparse coding. In Neural Networks for Signal Processing, 2002.
14. A. Hyvärinen. Sparse code shrinkage: Denoising of nongaussian data by maximum likelihood estimation. Neural Computation, (11):1739U-1768, 1999.
15. A. Hyvärinen and P. Hoyer. A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Research, 41(18):2413-2423, 2001. (Pubitemid 32667541)
16. L. Jacob, G. Obozinski, and J.-P. Vert. Group lasso with overlap and graph lasso. In ICML, 2009.
17. R. Jenatton, J. Mairal, G. Obozinski, and F. Bach. Proximal methods for sparse hierarchical dictionary learning. In ICML, 2010.
18. Y. Jo and A. Oh. Aspect and sentiment unification model for online review analysis. In WSDM, 2011.
19. M. E. Khan, B. Marlin, G. Bouchard, and K. Murphy. Variational bounds for mixed-data factor analysis. In NIPS, 2010.
20. S. Kim and E. P. Xing. Tree-guided group lasso for multi-task regression with structured sparsity. In ICML, 2010.
21. J. Lafferty, A. McCallum, and F. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML, 2001.
22. D. Lee and H. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401:788 - 791, 1999.
23. H. Lee, R. Raina, A. Teichman, and A. Ng. Exponential family sparse coding with applications to self-taught learning. In IJCAI, 2009.
24. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman. Supervised dictionary learning. In NIPS, 2008.
25. N. Meinshausen and B. Yu. Lasso-type recovery of sparse representations for high-dimensional data. Annals of Statistics, 37(1):246-270, 2009.
26. D. Mimno and A. McCallum. Topic models conditioned on arbitrary features with dirichlet-multinomial regression. In UAI, 2008.
27. D. Newman, A. Asuncion, P. Smyth, and M. Welling. Distributed algorithms for topic models. JMLR, (10):1801-1828, 2009.
28. B. Olshausen and D. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583):607-609, 1996. (Pubitemid 26177476)
29. J. Petterson, A. Smola, T. Caetano, W. Buntine, and S. Narayanamurthy. Word features for latent dirichlet allocation. In NIPS, 2010.
30. D. Pinto, A. McCallum, X. Wei, and W. Croft. Table extraction using conditional random fields. In SIGIR, 2003.
31. M. Shashanka, B. Raj, and P. Smaragdis. Sparse overcomplete latent variable decomposition of counts data. In NIPS, 2007.
32. A. Smola and S. Narayanamurthy. An architecture for parallel topic models. In VLDB, 2010.
33. A. Smola and B. Schölkopf. A tutorial on support vector regression. Statistics and Computing, 2003.
34. S. Sra, D. Kim, and B. Schölkopf. Non-monotonic poisson likelihood maximization. Tech. Report, MPI for Biological Cybernetics, 2008.
35. R. Tibshirani. Regression shrinkage and selection via the lasso. J. Royal. Statist. Soc., B(58):267-288, 1996.
36. I. Titov and R. McDonald. A joint model of text and aspect ratings for sentiment summarization. In ACL, 2008.
37. C. Wang, D. Blei, and L. Fei-Fei. Simultaneous image classification and annotation. In CVPR, 2009.
38. H. Wang, Y. Lu, and C. Zhai. Latent aspect rating analysis on review text data: A rating regression approach. In KDD, 2010.
39. J. Yang, K. Yu, Y. Gong, and T. Huang. Linear spatial pyramid matching using sparse coding for image classification. In CVPR, 2009.
40. J. Zhu, A. Ahmed, and E. P. Xing. MedLDA: Maximum margin supervised topic models for regression and classification. In ICML, 2009.
41. J. Zhu and E. P. Xing. Conditional topic random fields. In ICML, 2010.
42. J. Zhu and E. P. Xing. Sparse topical coding. In UAI, 2011.