Max-margin deep generative models

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 1837-1845

  Li, Chongxuan ^a   Zhu, Jun ^a   Shi, Tianlin ^b   Zhang, Bo ^a  

^a TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION SCIENCE; NEURAL NETWORKS; PIECEWISE LINEAR TECHNIQUES; STOCHASTIC SYSTEMS;

ACCURATE PREDICTION; CONVOLUTIONAL NEURAL NETWORK; DISCRIMINATIVE ABILITY; DISCRIMINATIVE NETWORKS; DISCRIMINATIVE POWER; DOUBLY STOCHASTIC; PREDICTION PERFORMANCE; SUB-GRADIENT ALGORITHM;

COMPLEX NETWORKS;

EID: 84965165777     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. Y. Altun, I. Tsochantaridis, and T. Hofmann. Hidden Markov support vector machines. In ICML, 2003.
2. F. Bastien, P. Lamblin, R. Pascanu, J. Bergstra, I. Goodfellow, A. Bergeron, N. Bouchard, D. Warde-Farley, and Y. Bengio. Theano: new features and speed improvements. In Deep Learning and Unsupervised Feature Learning NIPS Workshop, 2012.
3. Y. Bengio, E. Laufer, G. Alain, and J. Yosinski. Deep generative stochastic networks trainable by backprop. In ICML, 2014.
4. N. Chen, J. Zhu, F. Sun, and E. P. Xing. Large-margin predictive latent subspace learning for multi-view data analysis. IEEE Trans. on PAMI, 34(12):2365-2378, 2012.
5. C. Cortes and V. Vapnik. Support-vector networks. Journal of Machine Learning, 20(3):273-297, 1995.
6. A. Dosovitskiy, J. T. Springenberg, and T. Brox. Learning to generate chairs with convolutional neural networks. arXiv:1411.5928, 2014.
7. I. J. Goodfellow, J. P. Abadie, M. Mirza, B. Xu, D. W. Farley, S.ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NIPS, 2014.
8. I. J. Goodfellow, D. Warde-Farley, M. Mirza, A. C. Courville, and Y. Bengio. Maxout networks. In ICML, 2013.
9. K. Gregor, I. Danihelka, A. Mnih, C. Blundell, and D. Wierstra. Deep autoregressive networks. In ICML, 2014.
10. D. P. Kingma and J. L. Ba. Adam: A method for stochastic optimization. In ICLR, 2015.
11. D. P. Kingma, D. J. Rezende, S. Mohamed, and M. Welling. Semi-supervised learning with deep generative models. In NIPS, i2014.
12. D. P. Kingma and M. Welling. Auto-encoding variational Bayes. In ICLR, 2014.
13. H. Larochelle and I. Murray. The neural autoregressive distribution estimator. In AISTATS, 2011.
14. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. In Proceedings of the IEEE, 1998.
15. C. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu. Deeply-supervised nets. In AISTATS, 2015.
16. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML, 2009.
17. M. Lin, Q. Chen, and S. Yan. Network in network. In ICLR, 2014.
18. R. J. Little and D. B. Rubin. Statistical analysis with missing data. JMLR, 539, 1987.
19. L. V. Matten and G. Hinton. Visualizing data using t-SNE. JMLR, 9:2579-2605, 2008.
20. K. Miller, M. P. Kumar, B. Packer, D. Goodman, and D. Koller. Max-margin min-entropy models. In AISTATS, 2012.
21. A. Mnih and K. Gregor. Neural variational inference and learning in belief networks. In ICML, 2014.
22. Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, and A. Y. Ng. Reading digits in natural images with unsupervised feature learning. NIPS Workshop on Deep Learning and Unsupervised Feature Learning, 2011.
23. M. Ranzato, J. Susskind, V. Mnih, and G. E. Hinton. On deep generative models with applications to recognition. In CVPR, 2011.
24. D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic backpropagation and approximate inference in deep generative models. In ICML, 2014.
25. R. Salakhutdinov and G. E. Hinton. Deep Boltzmann machines. In AISTATS, 2009.
26. L. Saul, T. Jaakkola, and M. Jordan. Mean field theory for sigmoid belief networks. Journal of AI Research, 4:61-76, 1996.
27. P. Sermanet, S. Chintala, and Y. Lecun. Convolutional neural networks applied to house numbers digit classification. In ICPR, 2012.
28. S. Shalev-Shwartz, Y. Singer, N. Srebro, and A. Cotter. Pegasos: Primal estimated sub-gradient solver for SVM. Mathematical Programming, Series B, 2011.
29. Y. Tang. Deep learning using linear support vector machines. In Challenges on Representation Learning Workshop, ICML, 2013.
30. B. Taskar, C. Guestrin, and D. Koller. Max-margin Markov networks. In NIPS, 2003.
31. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. Support vector machine learning for interdependent and structured output spaces. In ICML, 2004.
32. C. J. Yu and T. Joachims. Learning structural SVMs with latent variables. In ICML, 2009.
33. M. D. Zeiler and R. Fergus. Stochastic pooling for regularization of deep convolutional neural networks. In ICLR, 2013.
34. J. Zhu, A. Ahmed, and E. P. Xing. MedLDA: Maximum margin supervised topic models. JMLR, 13:2237-2278, 2012.
35. J. Zhu, N. Chen, H. Perkins, and B. Zhang. Gibbs max-margin topic models with data augmentation. JMLR, 15:1073-1110, 2014.
36. J. Zhu, N. Chen, and E. P. Xing. Bayesian inference with posterior regularization and applications to infinite latent SVMs. JMLR, 15:1799-1847, 2014.
37. J. Zhu, E. P. Xing, and B. Zhang. Partially observed maximum entropy discrimination Markov networks. In NIPS, 2008.