Input convex neural networks: Supplementary material

34th International Conference on Machine Learning, ICML 2017

Volumn 1, Issue , 2017, Pages 192-206

  Amos, Brandon ^a   Xu, Lei ^a   Kolter, J Zico ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

FUNCTIONS; IMAGE ENHANCEMENT; NEURAL NETWORKS; REINFORCEMENT LEARNING;

CONVEX FUNCTIONS; DATA IMPUTATION; IMAGE COMPLETION; MULTI-LABEL; NETWORK PARAMETERS; OPTIMIZATION ALGORITHMS; STATE OF THE ART; STRUCTURED PREDICTION;

NETWORK ARCHITECTURE;

EID: 85048666489     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (45)

1. Abadi, Martin, Agarwal, Ashish, Barham, Paul, Brevdo, Eugene, Chen, Zhifeng, Citro, Craig, Corrado, Greg S, Davis, Andy, Dean, Jeffrey, Devin, Matthieu, et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467, 2016.
2. Barzilai, Jonathan and Borwein, Jonathan M. Two-point step size gradient methods. IMA Journal of Numerical Analysis, 8(1):141-148, 1988.
3. Belanger, David and McCallum, Andrew. Structured prediction energy networks. In Proceedings of the International Conference on Machine Learning, 2016.
4. Bengio, Yoshua, LeCun, Yann, and Henderson, Donnie. Globally trained handwritten word recognizer using spatial representation, convolutional neural networks, and hidden markov models. Advances in neural information processing systems, pp. 937-937, 1994.
5. Bertsekas, Dimitri P. Projected newton methods for optimization problems with simple constraints. SIAM Journal on control and Optimization, 20(2):221-246, 1982.
6. Birgin, Ernesto G, Martínez, José Mario, and Raydan, Marcos. Nonmonotone spectral projected gradient methods on convex sets. SIAM Journal on Optimization, 10(4):1196-1211, 2000.
7. Boyd, Stephen and Vandenberghe, Lieven. Convex optimization. Cambridge university press, 2004.
8. Boyd, Stephen, Parikh, Ncal, Chu, Eric, Pcleato, Borja, and Eckstein, Jonathan. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends® in Machine Learning, 3(1):1-122, 2011.
9. Brockman, Greg, Cheung, Vicki, Pettersson, Ludwig, Schneider, Jonas, Schulman, John, Tang, Jie, and Zaremba, Wojciech. Openai gym. arXiv preprint arXiv: 1606.01540, 2016.
10. Chen, Liang-Chieh, Schwing, Alexander G, Yuille, Alan L, and Urtasun, Raquel. Learning deep structured models. In Proceedings of the International Conference on Machine Learning, 2015.
11. Domke, Justin. Generic methods for optimization-based modeling. In Proceedings of the Conference on AI and Statistics, pp. 318-326, 2012.
12. Duchi, John, Hazan, Elad, and Singer, Yoram. Adaptive subgradient methods for online learning and stochastic optimization. The Journal of Machine Learning Research, 12:2121-2159, 2011.
13. Goodfellow, Ian, Pouget-Abadie, Jean, Mirza, Mehdi, Xu, Bing, Warde-Farley, David, Ozair, Sherjil, Courville, Aaron, and Bengio, Yoshua. Generative adversarial nets. In Advances in Neural Information Processing Systems, pp. 2672-2680, 2014.
14. Gu, Shixiang, Lillicrap, Timothy, Sutskever, Ilya, and Levine, Sergey. Continuous deep q-learning with modelbased acceleration. In Proceedings of the International Conference on Machine Learning, 2016.
15. He, Kaiming, Zhang, Xiangyu, Ren, Shaoqing, and Sun, Jian. Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385, 2015.
16. Huang, Gao, Liu, Zhuang, and Weinberger, Kilian Q. Densely connected convolutional networks. arXiv preprint arXiv:1608.06993, 2016.
17. Ioffe, Sergey and Szegedy, Christian. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of The 32nd International Conference on Machine Learning, pp. 448-456, 2015.
18. Katakis, Ioannis, Tsoumakas, Grigorios, and Vlahavas, Ioannis. Multilabel text classification for automated tag suggestion. ECML PKDD discovery challenge, 75, 2008.
19. Kingma, Diederik and Ba, Jimmy. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
20. Koller, Daphne and Friedman, Nir. Probabilistic graphical models: principles and techniques. MIT press, 2009.
21. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagcnet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097-1105, 2012.
22. LeCun, Yann, Chopra, Sumit, Hadsell, Raia, Ranzato, M, and Huang, F. A tutorial on energy-based learning. Predicting structured data, 1:0, 2006.
23. Lillicrap, Timothy P, Hunt, Jonathan J, Pritzel, Alexander, Heess, Nicolas, Erez, Tom, Tassa, Yuval, Silver, David, and Wierstra, Daan. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971, 2015.
24. Magnani, Alessandro and Boyd, Stephen P. Convex piecewise-linear fitting. Optimization and Engineering, 10(1):1-17, 2009.
25. Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Rusu, Andrei A, Veness, Joel, Bellemare, Marc G, Graves, Alex, Riedmiller, Martin, Fidjeland, Andreas K, Ostrovski, Georg, et al. Human-level control through deep reinforcement learning. Nature, 518(7540):529-533, 2015.
26. Nair, Vinod and Hinton, Geoffrey E. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 807-814, 2010.
27. Oliphant, Travis E. A guide to NumPy, volume 1. Trelgol Publishing USA, 2006.
28. Pedregosa, Fabian, Varoquaux, Gael, Gramfort, Alexandre, Michel, Vincent, Thirion, Bertrand, Grisel, Olivier, Blondcl, Mathieu, Prettcnhofer, Peter, Weiss, Ron, Dubourg, Vincent, et al. Scikit-learn: Machine learning in python. The Journal of Machine Learning Research, 12:2825-2830, 2011.
29. Peng, Jian, Bo, Liefeng, and Xu, Jinbo. Conditional neural fields. In Advances in neural information processing systems, pp. 1419-1427, 2009.
30. Polyak, Boris T. Some methods of speeding up the convergence of iteration methods. USSR Computational Mathematics and Mathematical Physics, 4(5):1-17, 1964.
31. Poon, Hoifung and Domingos, Pedro. Sum-product networks: A new deep architecture. In UAI 2011 Proceedings of the Twenty-Seventh Conference on Uncertainty in Artificial Intelligence, Barcelona, Spain, July 14-17, 2011, pp. 337-346, 2011.
32. Ratliff, Nathan D, Bagnell, J Andrew, and Zinkevich, Martin. (Approximate) subgradient methods for structured prediction. In International Conference on Artificial Intelligence and Statistics, pp. 380-387, 2007.
33. Rumelhart, David E, Hinton, Geoffrey E, and Williams, Ronald J. Learning representations by back-propagating errors. Cognitive modeling, 5(3):1, 1988.
34. Samaria, Ferdinando S and Harter, Andy C. Parameterisation of a stochastic model for human face identification. In Applications of Computer Vision, 1994., Proceedings of the Second IEEE Workshop on, pp. 138-142. IEEE, 1994.
35. Simard, Patrice and LeCun, Yann. Reverse tdnn: an architecture for trajectory generation. In Advances in Neural Information Processing Systems, pp. 579-588. Citeseer, 1991.
36. Simonyan, Karen and Zisserman, Andrew. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
37. Smola, Alex J., Vishwanathan, S.v. n., and Le, Quoc V. Bundle methods for machine learning. In Platt, J. C, Koller, D., Singer, Y., and Roweis, S. T. (eds.), Advances in Neural Information Processing Systems 20, pp. 1377-1384. Curran Associates, Inc., 2008.
38. Szegedy, Christian, Liu, Wei, Jia, Yangqing, Sermanet, Pierre, Reed, Scott, Anguelov, Dragomir, Erhan, Dumitru, Vanhoucke, Vincent, and Rabinovich, Andrew. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-9, 2015.
39. Taskar, Ben, Chatalbashev, Vassil, Koller, Daphne, and Guestrin, Carlos. Learning structured prediction models: A large margin approach. In Proceedings of the 22nd International Conference on Machine Learning, pp. 896-903. ACM, 2005.
40. Todorov, Emanuel, Erez, Tom, and Tassa, Yuval. Mujoco: A physics engine for model-based control. In 2012 1EEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5026-5033. IEEE, 2012.
41. Tsochantaridis, Ioannis, Joachims, Thorsten, Hofmann, Thomas, and Altun, Yasemin. Large margin methods for structured and interdependent output variables. Journal of Machine Learning Research, 6:1453-1484, 2005.
42. Tsoumakas, Grigorios, Spyromitros-Xioufis, Eleftherios, Vilcek, Jozef, and Vlahavas, Ioannis. Muían: A java library for multi-label learning. Journal of Machine Learning Research, 12(Jul):2411-2414, 2011.
43. Van Rossum, Guido and Drake Jr, Fred L. Python reference manual. Centrum voor Wiskunde en Informática Amsterdam, 1995.
44. Wright, Stephen J. Primal-dual Interior-point methods. Siam, 1997.
45. Zheng, Shuai, Jayasumana, Sadeep, Romera-Paredes, Bernardino, Vineet, Vibhav, Su, Zhizhong, Du, Dalong, Huang, Chang, and Torr, Philip HS. Conditional random fields as recurrent neural networks. In Proceedings of the IEEE International Conference on Computer Vision, pp. 1529-1537, 2015.