Learning structured output representation using deep conditional generative models

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 3483-3491

  Sohn, Kihyuk ^a,b   Yan, Xinchen ^a   Lee, Honglak ^a  

^a NEC LABORATORIES AMERICA   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPLEX NETWORKS; FORECASTING; IMAGE SEGMENTATION; INFERENCE ENGINES; INFORMATION SCIENCE; SEMANTICS; STOCHASTIC SYSTEMS; STRUCTURED PROGRAMMING;

DEEP NEURAL NETWORKS; MULTI SCALE PREDICTION; OBJECT SEGMENTATION; PROBABILISTIC INFERENCE; STOCHASTIC GRADIENT; STOCHASTIC INFERENCE; STRUCTURED OUTPUT PREDICTION; STRUCTURED PREDICTION;

STOCHASTIC MODELS;

EID: 84965139640     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. G. Andrew, R. Arora, J. Bilmes, and K. Livescu. Deep canonical correlation analysis. In ICML, 2013.
2. Y. Bengio, E. Thibodeau-Laufer, G. Alain, and J. Yosinski. Deep generative stochastic networks trainable by backprop. In ICML, 2014.
3. D. Ciresan, A. Giusti, L. M. Gambardella, and J. Schmidhuber. Deep neural networks segment neuronal membranes in electron microscopy images. In NIPS, 2012.
4. C. Farabet, C. Couprie, L. Najman, and Y. Le Cun. Scene parsing with multiscale feature learning, purity trees, and optimal covers. In ICML, 2012.
5. C. Farabet, C. Couprie, L. Najman, and Y. Le Cun. Learning hierarchical features for scene labeling. T. PAMI, 35(8):1915-1929, 2013.
6. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Region-based convolutional networks for accurate object detection and segmentation. T. PAMI, PP (99):1-1, 2015.
7. I. Goodfellow, M. Mirza, A. Courville, and Y. Bengio. Multi-prediction deep Boltzmann machines. In NIPS, 2013.
8. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NIPS, 2014.
9. K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In ECCV, 2014.
10. G. E. Hinton, S. Osindero, and Y. Teh. A fast learning algorithm for deep belief nets. Neural Computation, 18(7):1527-1554, 2006.
11. G. B. Huang, M. Narayana, and E. Learned-Miller. Towards unconstrained face recognition. In CVPR Workshop on Perceptual Organization in Computer Vision, 2008.
12. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst, 2007.
13. A. Kae, K. Sohn, H. Lee, and E. Learned-Miller. Augmenting CRFs with Boltzmann machine shape priors for image labeling. In CVPR, 2013.
14. D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. In ICLR, 2015.
15. D. P. Kingma, S. Mohamed, D. J. Rezende, and M. Welling. Semi-supervised learning with deep generative models. In NIPS, 2014.
16. D. P. Kingma and M. Welling. Auto-encoding variational Bayes. In ICLR, 2013.
17. A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks. In NIPS, 2012.
18. H. Larochelle and I. Murray. The neural autoregressive distribution estimator. JMLR, 15:29-37, 2011.
19. Y. Le Cun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
20. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Unsupervised learning of hierarchical representations with convolutional deep belief networks. Communications of the ACM, 54(10):95-103, 2011.
21. Y. Li, D. Tarlow, and R. Zemel. Exploring compositional high order pattern potentials for structured output learning. In CVPR, 2013.
22. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In CVPR, 2015.
23. P. Pinheiro and R. Collobert. Recurrent convolutional neural networks for scene parsing. In ICML, 2013.
24. D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic backpropagation and approximate inference in deep generative models. In ICML, 2014.
25. R. Salakhutdinov and G. E. Hinton. Deep Boltzmann machines. In AISTATS, 2009.
26. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. Le Cun. OverFeat: Integrated recognition, localization and detection using convolutional networks. In ICLR, 2013.
27. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In ICLR, 2014.
28. K. Sohn, W. Shang, and H. Lee. Improved multimodal deep learning with variation of information. In NIPS, 2014.
29. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. JMLR, 15(1):1929-1958, 2014.
30. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In CVPR, 2015.
31. C. Szegedy, A. Toshev, and D. Erhan. Deep neural networks for object detection. In NIPS, 2013.
32. Y. Tang and R. Salakhutdinov. Learning stochastic feedforward neural networks. In NIPS, 2013.
33. A. Vedaldi and K. Lenc. MatConvNet-convolutional neural networks for MATLAB. In ACMMM, 2015.
34. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, 2008.
35. N. Wang, H. Ai, and F. Tang. What are good parts for hair shape modeling? In CVPR, 2012.
36. P. Welinder, S. Branson, T. Mita, C. Wah, F. Schroff, S. Belongie, and P. Perona. Caltech-UCSD Birds 200. Technical Report CNS-TR-2010-001, California Institute of Technology, 2010.
37. J. Yang, S. Sáfár, and M.-H. Yang. Max-margin Boltzmann machines for object segmentation. In CVPR, 2014.