Scalable inference in max-margin topic models

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn Part F128815, Issue , 2013, Pages 964-972

  Zhu, Jun ^a   Zheng, Xun ^a   Zhou, Li ^a   Zhang, Bo ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Inference; Large scale systems; Max margin learning; Topic models

Indexed keywords

CLASSIFICATION (OF INFORMATION); EDUCATION; INFORMATION RETRIEVAL SYSTEMS; LARGE SCALE SYSTEMS; LEARNING ALGORITHMS; SEMANTICS;

CLASSIFICATION PERFORMANCE; INFERENCE; MAX-MARGIN LEARNING; MULTI LABEL CLASSIFICATION; OPEN SOURCE IMPLEMENTATION; PARALLEL IMPLEMENTATIONS; STATE-OF-THE-ART METHODS; TOPIC MODEL;

DATA MINING;

EID: 84979594919     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2487575.2487658     Document Type: Conference Paper

References (29)

1. A. Ahmed, M. Aly, J. Gonzalez, S. Narayanamurthy, and A. Smola. Scalable inference in latent variable models. In International Conference on Web Search and Data Mining (WSDM), 2012.
2. R. K. Ando and T. Zhang. A framework for learning predictive structures from multiple tasks and unlabeled data. Journal of Machine Learning Research (JMLR), (6):1817-1853, 2005.
3. A. Argyriou, T. Evgeniou, and M. Pontil. Convex multi-Task feature learning. In Advances in Neural Information Processing Systems (NIPS), 2007.
4. D. Blei and J. McAuliffe. Supervised topic models. In Advances in Neural Information Processing Systems (NIPS), pages 121-128, 2007.
5. D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. JMLR, 3:993-1022, 2003.
6. O. Catoni. PAC-Bayesian supervised classification: The thermodynamics of statistical learning. Monograph series of the Institute of Mathematical Statistics, 2007.
7. J. Chang and D. Blei. Relational topic models for document networks. In International Conference on Artificial Intelligence and Statistics (AISTATS), 2009.
8. N. Chen, J. Zhu, F. Xia, and B. Zhang. Generalized relational topic models with data augmentation. In International Joint Conference on Artificial Intelligence (IJCAI), 2013.
9. L. Devroye. Non-uniform random variate generation. Springer-Verlag, 1986.
10. P. Germain, A. Lacasse, F. Laviolette, and M. Marchand. PAC-Bayesian learning of linear classifiers. In International Conference on Machine Learning (ICML), pages 353-360, 2009.
11. T. Griffiths and M. Steyvers. Finding scientific topics. Proceedings of National Academy of Science (PNAS), pages 5228-5235, 2004.
12. Q. Jiang, J. Zhu, M. Sun, and E. Xing. Monte Carlo methods for maximum margin supervised topic models. In Advances in Neural Information Processing Systems (NIPS), 2012.
13. D. D. Lewis, Y. Yang, T. G. Rose, and F. Li. Rcv1: A new benchmark collection for text categorization research. Journal of Machine Learning Research (JMLR), 5:361-397, Dec. 2004.
14. D. McAllester. PAC-Bayesian stochastic model selection. Machine Learning, 51:5-21, 2003.
15. J. Michael, W. Schucany, and R. Haas. Generating random variates using transformations with multiple roots. The American Statistician, 30(2):88-90, 1976.
16. D. Newman, A. Asuncion, P. Smyth, and M. Welling. Distributed algorithms for topic models. Journal of Machine Learning Research (JMLR), (10):1801-1828, 2009.
17. N. Polson and S. Scott. Data augmentation for support vector machines. Bayesian Analysis, 6(1):1-24, 2011.
18. R. Rifkin and A. Klautau. In defense of one-vs-All classification. Journal of Machine Learning Research (JMLR), (5):101-141, 2004.
19. A. Smola and S. Narayanamurthy. An architecture for parallel topic models. Very Large Data Base (VLDB), 3(1-2):703-710, 2010.
20. M. Tanner and W.-H. Wong. The calculation of posterior distributions by data augmentation. Journal of the Americal Statistical Association (JASA), 82(398):528-540, 1987.
21. G. Tsoumakas, I. Katakis, and I. Vlahavas. Mining multi-label data. Data Mining and Knowledge Discovery Handbook, 2nd ed., pages 667-685, 2010.
22. D. van Dyk and X. Meng. The art of data augmentation. Journal of Computational and Graphical Statistics (JCGS), 10(1):1-50, 2001.
23. Y. Wang and G. Mori. Max-margin latent Dirichlet allocation for image classification and annotation. In British Machine Vision Conference (BMVC), 2011.
24. M. Xu, J. Zhu, and B. Zhang. Fast max-margin matrix factorization with data augmentation. In International Conference on Machine Learning (ICML), 2013.
25. S. Yang, J. Bian, and H. Zha. Hybrid generative/discriminative learning for automatic image annotation. In Uncertainty in Artificial Intelligence (UAI), 2010.
26. L. Yao, D. Mimno, and A. McCallum. Efficient methods for topic model inference on streaming document collections. In ACM SIGKDD, pages 937-946, 2009.
27. J. Zhu, A. Ahmed, and E. Xing. MedLDA: maximum margin supervised topic models. Journal of Machine Learning Research (JMLR), (13):2237-2278, 2012.
28. J. Zhu, N. Chen, H. Perkins, and B. Zhang. Gibbs max-margin topic models with fast sampling algorithms. In International Conference on Machine Learning (ICML), 2013.
29. J. Zhu, N. Chen, and E. Xing. Infinite latent SVM for classification and multi-Task learning. In Advances in Neural Information Processing Systems (NIPS), pages 1620-1628, 2011.