Gibbs max-margin topic models with fast sampling algorithms

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 1, 2013, Pages 124-132

  Zhu, Jun ^a   Chen, Ning ^a   Perkins, Hugh ^a   Zhang, Bo ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

AUGMENTED VARIABLES; CLASSIFICATION PERFORMANCE; FAST SAMPLING; GIBBS SAMPLING; POSTERIOR DISTRIBUTIONS; PREDICTION RULES; SUB-PROBLEMS; TIME EFFICIENCIES;

LEARNING ALGORITHMS;

EID: 84897459309     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Blei, D.M. and McAuliffe, J.D. Supervised topic models. Advances in Neural Information Processing Systems (NIPS), pp. 121-128, 2007.
2. Catoni, O. PAC-Bayesian supervised classification: The thermodynamics of statistical learning. Monograph series of the Institute of Mathematical Statistics, 2007.
3. Dempster, A.P., Laird, N.M., and Rubin, D.B. Maximum likelihood estimation from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Ser. B, (39): 1-38, 1977.
4. Devroye, L. Non-uniform random variate generation. Springer-Verlag, 1986.
5. Germain, P., Lacasse, A., Laviolette, F., and Marchand, M. PAC-Bayesian learning of linear classifiers. In International Conference on Machine Learning (ICML), pp. 353-360, 2009.
6. Griffiths, T.L. and Steyvers, M. Finding scientific topics. Proceedings of National Academy of Science (PNAS), pp. 5228-5235, 2004. (Pubitemid 38469131)
7. Jiang, Q., Zhu, J., Sun, M., and Xing, E.P. Monte Carlo methods for maximum margin supervised topic models. In Advances in Neural Information Processing Systems (NIPS), 2012.
8. Joachims, T. Making large-scale SVM learning practical. MIT press, 1999.
9. Lacoste-Jullien, S., Sha, F., and Jordan, M.I. DiscLDA: Discriminative learning for dimensionality reduction and classification. Advances in Neural Information Processing Systems (NIPS), pp. 897-904, 2009.
10. McAllester, D. PAC-Bayesian stochastic model selection. Machine Learning, 51:5-21, 2003.
11. Michael, J.R., Schucany, W.R., and Haas, R.W. Generating random variates using transformations with multiple roots. The American Statistician, 30(2): 88-90, 1976.
12. Newman, D., Asuncion, A., Smyth, P., and Welling, M. Distributed algorithms for topic models. Journal of Machine Learning Research (JMLR), (10):1801-1828, 2009.
13. Poison, N.G. and Scott, S.L. Data augmentation for support vector machines. Bayesian Analysis, 6(1): 1-24, 2011.
14. Rifkin, R. and Klautau, A. In defense of one-vs-all classification. Journal of Machine Learning Research (JMLR), (5):101-141, 2004.
15. Smola, A. and Narayanamurthy, S. An architecture for parallel topic models. Very Large Data Base (VLDB), 3(1-2):703-710, 2010.
16. Smola, A. and Scholkopf, B. A tutorial on support vector regression. Statistics and Computing, 14(3):-199-222, 2003.
17. Tanner, M.A. and Wong, W.-H. The calculation of posterior distributions by data augmentation. Journal of the Americal Statistical Association (JASA), 82(398):528-540, 1987.
18. van Dyk, D. and Meng, X. The art of data augmentation. Journal of Computational and Graphical Statistics (JCGS), 10(1):1-50, 2001. (Pubitemid 33721606)
19. Yang, S., Bian, J., and Zha, H. Hybrid generative/discriminative learning for automatic image annotation. In Uncertainty in Artificial Intelligence (UAI), 2010.
20. Zhu, J. and Xing, E.P. Conditional topic random fields. In International Conference on Machine Learning (ICML), pp. 1239-1246, 2010.
21. Zhu, J., Ahmed, A., and Xing, E.P. MedLDA: maximum margin supervised topic models for regression and classification. In International Conference on Machine Learning (ICML), pp. 1257-1264, 2009.
22. Zhu, J., Chen, N., and Xing, E.P. Infinite latent SVM for classification and multi-task learning. In Advances in Neural Information Processing Systems (NIPS)pp. 1620-1628, 2011.
23. Zhu, J., Ahmed, A., and Xing, E.P. MedLDA: maximum margin supervised topic models. Journal of Machine Learning Research (JMLR), (13):2237-2278, 2012.