Structured prediction energy networks

33rd International Conference on Machine Learning, ICML 2016

Volumn 3, Issue , 2016, Pages 1545-1554

  Belanger, David ^a   McCallum, Andrew ^a  

^a The Manning College of Information and Computer Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BENCHMARKING; CLASSIFICATION (OF INFORMATION); ECONOMIC AND SOCIAL EFFECTS; ITERATIVE METHODS; LEARNING SYSTEMS; NETWORK ARCHITECTURE;

DEEP ARCHITECTURES; DISCRIMINATIVE FEATURES; FLEXIBLE FRAMEWORK; MULTI LABEL CLASSIFICATION; MULTI-LABEL PROBLEMS; STRUCTURAL ASSUMPTION; STRUCTURE-LEARNING; STRUCTURED PREDICTION;

FORECASTING;

EID: 84998953764     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (56)

1. Agrawal, Rahul, Gupta, Archit, Prabhu, Yashoteja, and Varma, Manik. Multi-label learning with millions of labels: Recommending advertiser bid phrases for web pages. In International Conference on World Wide Web, 2013.
2. Amos, Brandon and Kolter, J Zico. Input-convex deep networks. ICLR Workshop, 2016.
3. Beck, Amir and Teboulle, Marc. Mirror descent and nonlinear projected subgradient methods for convex optimization. Operations Research Letters, 31(3), 2003.
4. Bhatia, Kush, Jain, Himanshu, Kar, Purushottam, Jain, Prateek, and Varma, Manik. Locally non-linear embeddings for extreme multi-label learning. CoRR, abs/1507.02743, 2015.
5. Boykov, Yuri and Kolmogorov, Vladimir. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. Pattern Analysis and Machine Intelligence, 26(9):1124-1137, 2004.
6. Bromley, Jane, Bentz, James W, Bottou, Leon, Guyon, Isabelle, LeCun, Yann, Moore, Cliff, Sackinger, Eduard, and Shah, Roopak. Signature verification using a Siamese time delay neural network. Pattern Recognition and Artificial Intelligence, 1(04), 1993.
7. Bucak, Serhat S, Mallapragada, Pavan Kumar, Jin, Rong, and Jain, Anil K. Efficient multi-label ranking for multi-class learning: application to object recognition. In International Conference on Computer Vision, 2009.
8. Bucak, Serhat Selcuk, Jin, Rong, and Jain, Anil K. Multi-label learning with incomplete class assignments. In Computer Vision and Pattern Recognition, 2011.
9. Cabral, Ricardo S, Torre, Fernando, Costeira, Joao P, and Bernardino, Alexandre. Matrix completion for multi-label image classification. In NIPS, 2011.
10. Carreira, Joao, Agrawal, Pulkit, Fragkiadaki, Katerina, and Malik, Jitendra. Human pose estimation with iterative error feedback. arXivpreprint arXiv: 1507.06550, 2015.
11. Chen, L.-C, Schwing, A. G., Yuille, A. L., and Urtasun, R. Learning deep structured models. In ICML, 2015.
12. Chen, Liang-Chieh, Papandreou, George, Kokkinos, Iasonas, Murphy, Kevin, and Yuille, Alan L. Semantic image segmentation with deep convolutional nets and fully connected crfs. ICCV, 2014.
13. Collobert, Ronan, Weston, Jason, Bottou, Leon, Karlen, Michael, Kavukcuoglu, Koray, and Kuksa, Pavel. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12:2493-2537, 2011.
14. Domke, Justin. Generic methods for optimization-based modeling. In AISTATS, volume 22, pp. 318-326, 2012.
15. Domke, Justin. Learning graphical model parameters with approximate marginal inference. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(10):2454-2467, 2013.
16. Elisseeff, Andre and Weston, Jason. A kernel method for multilabelled classification. In NIPS, 2001.
17. Finley, Thomas and Joachims, Thorsten. Training structural svms when exact inference is intractable. In ICML, 2008.
18. Gatys, Leon A., Ecker, Alexander S., and Bethge, Matthias. A neural algorithm of artistic style. CoRR, abs/1508.06576, 2015a.
19. Gatys, Leon A., Ecker, Alexander S., and Bethge, Matthias. Texture synthesis using convolutional neural networks. In NIPS. 2015b.
20. Ghamrawi, Nadia and McCallum, Andrew. Collective multi-label classification. In ACM International Conference on Information and Knowledge Management, 2005.
21. Globerson, Amir and Jaakkola, Tommi S. Fixing maxproduct: Convergent message passing algorithms for map lprelaxations. In NIPS, 2008.
22. Godbole, Shantanu and Sarawagi, Sunita. Discriminative methods for multi-labeled classification. In Advances in Knowledge Discovery and Data Mining, pp. 22-30. Springer, 2004.
23. Goodfellow, Ian J, Shlens, Jonathon, and Szegedy, Christian. Explaining and harnessing adversarial examples. International Conference on Learning Representations, 2015.
24. Hariharan, Bharath, Zelnik-Manor, Lihi, Varma, Manik, and Vishwanathan, Svn. Large scale max-margin multi-label classification with priors. In ICML, 2010.
25. Hershey, John R, Roux, Jonathan Le, and Weninger, Felix. Deep unfolding: Model-based inspiration of novel deep architectures. arXiv preprint arXiv: 1409.2574, 2014.
26. Hsu, Daniel, Kakade, Sham, Langford, John, and Zhang, Tong. Multi-label prediction via compressed sensing. In NIPS, 2009.
27. Huang, Zhiheng, Xu, Wei, and Yu, Kai. Bidirectional LSTM-CRF models for sequence tagging. CoRR, abs/1508.01991, 2015.
28. Jaderberg, Max, Simonyan, Karen, Vedaldi, Andrea, and Zisserman, Andrew. Deep structured output learning for unconstrained text recognition. International Conference on Learning Representations 2014, 2014.
29. Jernite, Yacine, Rush, Alexander M., and Sontag, David. A fast variational approach for learning markov random field language models. In ICML, 2015.
30. Ji, Shuiwang and Ye, Jieping. Linear dimensionality reduction for multi-label classification. In IJCAI, volume 9, pp. 1077-1082, 2009.
31. Jordan, Michael I, Ghahramani, Zoubin, Jaakkola, Tommi S, and Saul, Lawrence K. An introduction to variational methods for graphical models. Machine learning, 37(2):183-233, 1999.
32. Kapoor, Ashish, Viswanathan, Raajay, and Jain, Prateek. Multilabel classification using bayesian compressed sensing. In NIPS, 2012.
33. Koller, Daphne and Friedman, Nir. Probabilistic graphical models: principles and techniques. MIT press, 2009.
34. Kulesza, Alex and Pereira, Fernando. Structured learning with approximate inference. In NIPS, 2007.
35. Kunisch, Karl and Pock, Thomas. A bilevel optimization approach for parameter learning in variational models. SIAM Journal on Imaging Sciences, 6(2):938-983, 2013.
36. Lafferty, John D, McCallum, Andrew, and Pereira, Fernando CN. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML, 2001.
37. Le, Quoc and Mikolov, Tomas. Distributed representations of sentences and documents. In ICML, 2014.
38. LeCun, Yann and Huang, Fu Jie. Loss functions for discriminative training of energy-based models. In AISTATS, 2005.
39. LeCun, Yann, Chopra, Sumit, Hadsell, Raia, Ranzato, M, and Huang, F. A tutorial on energy-based learning. Predicting Structured Data, 1, 2006.
40. Li, Yujia and Zemel, Richard S. Mean-field networks. ICML Workshop on Learning Tractable Probabilistic Models, 2014.
41. Lin, Victoria (Xi), Singh, Sameer, He, Luheng, Taskar, Ben, and Zettlemoyer, Luke. Multi-label learning with posterior regularization. In NIPS Workshop on Modern Machine Learning and NLP, 2014.
42. Long, Jonathan, Shelhamer, Evan, and Darrell, Trevor. Fully convolutional networks for semantic segmentation. In Computer Vision and Pattern Recognition, 2015.
43. Meshi, Ofer, Sontag, David, Globerson, Amir, and Jaakkola, Tommi S. Learning efficiently with approximate inference via dual losses. In ICML, 2010.
44. Mordvintsev, Alexander, Olah, Christopher, and Tyka, Mike. Inceptionism: Going deeper into neural networks, June 2015.
45. Niculescu-Mizil, Alexandra and Abbasnejad, Ehsan. Label filters for large scale multilabel classification. In ICML 2015 Workshop on Extreme Classification, 2015.
46. Petterson, James and Caetano, Tiberio S. Submodular multi-label learning. In NIPS, 2011.
47. Read, Jesse, Pfahringer, Bernhard, Holmes, Geoff, and Frank, Eibe. Classifier chains for multi-label classification. Machine learning, 85(3):333-359, 2011.
48. Schwing, Alexander G. and Urtasun, Raquel. Fully connected deep structured networks. CoRR, abs/1503.02351, 2015.
49. Srikumar, Vivek and Manning, Christopher D. Learning distributed representations for structured output prediction. In NIPS, 2014.
50. Stoyanov, Veselin, Ropson, Alexander, and Eisner, Jason. Empirical risk minimization of graphical model parameters given approximate inference, decoding, and model structure. In International Conference on Artificial Intelligence and Statistics, 2011.
51. Sutskever, Ilya, Vinyals, Oriol, and Le, Quoc V. Sequence to sequence learning with neural networks. In NIPS, 2014.
52. Szegedy, Christian, Zaremba, Wojciech, Sutskever, Ilya, Bruna, Joan, Erhan, Dumitru, Goodfellow, Ian, and Fergus, Rob. Intriguing properties of neural networks. In International Conference on Learning Representations, 2014.
53. Taskar, B., Guestrin, C, and Koller, D. Max-margin Markov networks. NIPS, 2004.
54. Tsochantaridis, Ioannis, Hofmann, Thomas, Joachims, Thorsten, and Altun, Yasemin. Support vector machine learning for interdependent and structured output spaces. In ICML, 2004.
55. Yu, Hsiang-Fu, Jain, Prateek, Kar, Purushottam, and Dhillon, Inderjit S. Large-scale multi-label learning with missing labels. In ICML, 2014.
56. Zheng, Shuai, Jayasumana, Sadeep, Romera-Paredes, Bernardino, Vineet, Vibhav, Su, Zhizhong, Du, Dalong, Huang, Chang, and Torr, Philip. Conditional random fields as recurrent neural networks. In International Conference on Computer Vision (ICCV), 2015.