Learning deep structured models

32nd International Conference on Machine Learning, ICML 2015

Volumn 3, Issue , 2015, Pages 1785-1794

  Chen, Liang Chieh ^a   Schwing, Alexander G ^b   Yuille, Alan L ^a   Urtasun, Raquel ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING ALGORITHMS; LEARNING SYSTEMS; MARKOV PROCESSES;

DEEP LEARNING; GPU ACCELERATIONS; JOINT LEARNING; MARKOV RANDOM FIELD; MATHEMATICAL TOOLS; PERFORMANCE GAIN; STRUCTURED MODEL; TRAINING ALGORITHMS;

RANDOM VARIABLES;

EID: 84969930631     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (51)

1. Bengio, Y., Lamblin, P., Popovici, D., and Larochelle, H. Greedy Layer-Wise Training of Deep Networks. In Proc. NIPS, 2007.
2. Bottou, L., Bengio, Y., and LeCun, Y. Global training of document processing systems using graph transformer networks. In Proc. CVPR, 1997.
3. Bridle, J. S. Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters. In Proc. NIPS, 1990.
4. Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A. L. Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs. In Proc. ICLR, 2015.
5. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., and Kuksa, P. Natural language processing (almost) from scratch. JMLR, 2011.
6. de Campos, T. E., Babu, B. R., and Varma, M. Character recognition in natural images. In Proc. VISAPP, 2009.
7. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. Imagenet: A large-scale hierarchical image database. In Proc. CVPR, 2009.
8. Deng, J., Ding, N., Jia, Y., Frome, A., Murphy, K., Bengio, S., Li, Y., Neven, H., and Adam, H. Large-Scale Object Classification using Label Relation Graphs. In Proc. ECCV, 2014.
9. Do, T.-M.-T. and Artieres, T. Neural conditional random fields. In Proc. AISTATS, 2010.
10. Domke, J. Structured Learning via Logistic Regression. In Proc. NIPS, 2013.
11. Eigen, D., Rolfe, J., Fergus, R., and LeCun, Y. Understanding Deep Architectures using a Recursive Convolutional Network. In Proc. ICLR, 2014.
12. Girshick, R., Donahue, J., Darrell, T., and Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proc. CVPR, 2014.
13. Globerson, A. and Jaakkola, T. Fixing max-product: Convergent message passing algorithms for MAP LP-relaxations. In Proc. NIPS, 2007.
14. Hariharan, B., Arbelaez, P., Girshick, R., and Malik, J. Simultaneous detection and segmentation. In Proc. ECCV, 2014.
15. Hazan, T. and Shashua, A. Norm-Product Belief Propagation: Primal-Dual Message-Passing for LP-Relaxation and Approximate-Inference. Trans. Information Theory, 2010.
16. Hazan, T. and Urtasun, R. A Primal-Dual Message-Passing Algorithm for Approximated Large Scale Structured Prediction. In Proc. NIPS, 2010.
17. Hinton, G. E. and Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. Science, 2006.
18. Hinton, G. E., Sejnowski, T. J., and Ackley, D. H. Boltzmann Machines: Constraint Satisfaction Networks that Learn. Technical report, University of Toronto, 1984.
19. Jancsary, J., Nowozin, S., Sharp, T., and Rother, C. Regression Tree Fields - An Efficient, Non-parametric Approach to Image Labeling Problems. In Proc. CVPR, 2012.
20. Jancsary, J., Nowozin, S., and Rother, C. Learning Convex QP Relaxations for Structured Prediction. In Proc. ICML, 2013.
21. Jia, Y. Caffe: An Open Source Convolutional Architecture for Fast Feature Embedding, http://caffe.berkeleyvision.org/, 2013.
22. Koller, D. and Friedman, N. Probabilistic Graphical Models: Principles and Techniques. MIT Press, 2009.
23. Krizhevsky, A., Sutskever, I., and Hinton, G. E. Im-ageNet Classification with Deep Convolutional Neural Networks. In Proc. NIPS, 2013.
24. Larochelle, H., Erhan, D., Courville, A., Bergstra, J., and Bengio, Y. An empirical evaluation of deep architectures on problems with many factors of variation. In Proc. ICML, 2007.
25. LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 1998.
26. Lee, H., Grosse, R., Ranganath, R., and Ng, A. Y. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proc. ICML, 2009.
27. Li, Y. and Zemel, R. High Order Regularization for Semi-Supervised Learning of Structured Output Problems. In Proc. ICML, 2014.
28. Ma, J., Peng, J., Wang, S., and Xu, J. A conditional neural fields model for protein threading. Bioinformatics, 2012.
29. Meltzer, T., Globerson, A., and Weiss, Y. Convergent Message Passing Algorithms: a unifying view. In Proc. UAI, 2009.
30. Meshi, O., Sontag, D., Jaakkola, T., and Globerson, A. Learning Efficiently with Approximate inference via Dual Losses. In Proc. ICML, 2010.
31. Morris, J. and Fosler-Lussier, E. Conditional random fields for integrating local discriminative classifiers. IEEE Trans. Audio, Speech, and Language Processing, 2008.
32. Nowozin, S., Rother, C., Bagon, S., Sharp, T., Yao, B., and Kohli, P. Decision tree fields. In Proc. ICCV, 2011.
33. Pearl, J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 1988.
34. Peng, J., Bo, L., and Xu, J. Conditional Neural Fields. In Proc. NIPS, 2009.
35. Prabhavalkar, R. and Fosler-Lussier, E. Backpropagation training for multilayer conditional random field based phone recognition. In Proc. ICASSP, 2010.
36. Salakhutdinov, R. R. and Hinton, G. E. An Efficient Learning Procedure for Deep Boltzmann Machines. Neural Computation, 2012.
37. Schwing, A. G. Inference and Learning Algorithms with Applications to 3D Indoor Scene Understanding. PhD thesis, ETH Zurich, 2013.
38. Schwing, A. G. and Urtasun, R. Fully Connected Deep Structured Networks, http://arxiv.org/abs/1503.02351, 2015.
39. Schwing, A. G., Hazan, T., Pollefeys, M., and Urtasun, R. Efficient Structured Prediction with Latent Variables for General Graphical Models. In Proc. ICML, 2012.
40. Socher, R., Huval, B., Bhat, B., Manning, C. D., and Ng, A. Y. Convolutional-Recursive Deep Learning for 3D Object Classification. In Proc. NIPS, 2012.
41. Sontag, D., Meltzer, T., Globerson, A., and Jaakkola, T. Tightening LP Relaxations for MAP using Message Passing. In Proc. NIPS, 2008.
42. Taskar, B., Chatalbashev, V., Koller, D., and Guestrin, C. Learning Structured Prediction Models: A Large Margin Approach. In Proc. ICML, 2005.
43. Tompson, J., Jain, A., LeCun, Y., and Bregler, C. Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation. In Proc. NIPS, 2014.
44. Wainwright, M. J. and Jordan, M. I. Graphical Models, Exponential Families and Variational Inference. Foundations and Trends in Machine Learning, 2008.
45. Wainwright, M. J., Jaakkola, T., and Willsky, A. S. A new class of upper bounds on the log partition function. Trans. Information Theory, 2005.
46. Weiss, Y., Yanover, C., and Meltzer, T. MAP Estimation, Linear Programming and Belief Propagation with Convex Free Energies. In Proc. UAI, 2007.
47. Wiegerinck, W. and Heskes, T. Fractional belief propagation. In Proc. NIPS, 2003.
48. Xu, J., Schwing, A. G., and Urtasun, R. Tell me what you see and I will show you where it is. In Proc. CVPR, 2014.
49. Yedidia, J. S., Freeman, W. T., and Weiss, Y. Constructing free-energy approximations and generalized belief propagation algorithms. Trans. Information Theory, 2005.
50. Zeiler, M. D. and Fergus, R. Visualizing and Understanding Convolutional Networks. In Proc. ECCV, 2014.
51. Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., and Torr, P. H. S. Conditional Random Fields as Recurrent Neural Networks. http://arxiv.org/abs/1502.03240, 2015.