Muprop: Unbiased backpropagation for stochastic neural networks

4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings

Volumn , Issue , 2016, Pages

  Gu, Shixiang ^a,b   Levine, Sergey ^c   Sutskever, Ilya ^c   Mnih, Andriy ^d  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^c GOOGLE INC   (United States)

^d DEEPMIND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION ALGORITHMS; DEEP NEURAL NETWORKS; NEURAL NETWORKS; STOCHASTIC MODELS;

COMPUTATIONAL GRAPH; GRADIENT ESTIMATOR; LATENT VARIABLE MODELING; PARAMETRIC FUNCTIONS; PARAMETRIC MODELS; STOCHASTIC NETWORKS; STOCHASTIC NEURAL NETWORK; STRUCTURED OUTPUT PREDICTION;

STOCHASTIC SYSTEMS;

EID: 85083953202     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Bengio, Yoshua, Léonard, Nicholas, and Courville, Aaron. Estimating or propagating gradients through stochastic neurons for conditional computation. arXiv preprint arXiv:1308.3432, 2013.
2. Bornschein, Jörg and Bengio, Yoshua. Reweighted wake-sleep. ICLR, 2015.
3. Burda, Yuri, Grosse, Roger, and Salakhutdinov, Ruslan. Importance weighted autoencoders. arXiv preprint arXiv:1509.00519, 2015.
4. Dayan, Peter, Hinton, Geoffrey E, Neal, Radford M, and Zemel, Richard S. The helmholtz machine. Neural computation, 7(5):889–904, 1995.
5. Gregor, Karol, Danihelka, Ivo, Mnih, Andriy, Blundell, Charles, and Wierstra, Daan. Deep autoregressive networks. In ICML, 2014.
6. Hinton, Geoffrey. Neural networks for machine learning. Coursera, video lectures, 2012.
7. Hinton, Geoffrey, Deng, Li, Yu, Dong, Dahl, George E, Mohamed, Abdel-rahman, Jaitly, Navdeep, Senior, Andrew, Vanhoucke, Vincent, et al. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. Signal Processing Magazine, IEEE, 29(6):82–97, 2012.
8. Hinton, Geoffrey E, Dayan, Peter, Frey, Brendan J, and Neal, Radford M. The”wake-sleep” algorithm for unsupervised neural networks. Science, 268(5214):1158–1161, 1995.
9. Kingma, Diederik P and Welling, Max. Auto-encoding variational bayes. ICLR, 2014.
10. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In NIPS, pp. 1097–1105, 2012.
11. Lee, Dong-Hyun, Zhang, Saizheng, Fischer, Asja, and Bengio, Yoshua. Difference target propagation. In Machine Learning and Knowledge Discovery in Databases, pp. 498–515. Springer, 2015.
12. Mnih, Andriy and Gregor, Karol. Neural variational inference and learning in belief networks. In ICML, 2014.
13. Mnih, Volodymyr, Heess, Nicolas, Graves, Alex, et al. Recurrent models of visual attention. In NIPS, 2014.
14. Neal, Radford M. Connectionist learning of belief networks. Artificial intelligence, 56(1):71–113, 1992.
15. Paisley, John, Blei, David, and Jordan, Michael. Variational bayesian inference with stochastic search. ICML, 2012.
16. Peters, Jan and Schaal, Stefan. Policy gradient methods for robotics. In Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on, pp. 2219–2225. IEEE, 2006.
17. Raiko, Tapani, Berglund, Mathias, Alain, Guillaume, and Dinh, Laurent. Techniques for learning binary stochastic feedforward neural networks. ICLR, 2015.
18. Ranganath, Rajesh, Gerrish, Sean, and Blei, David M. Black box variational inference. AISTATS, 2014.
19. Rezende, Danilo Jimenez, Mohamed, Shakir, and Wierstra, Daan. Stochastic backpropagation and approximate inference in deep generative models. ICML, 2014.
20. Rumelhart, David E, Hinton, Geoffrey E, and Williams, Ronald J. Learning representations by backpropagating errors. Nature, 323:533–536, 1986.
21. Saul, Lawrence K, Jaakkola, Tommi, and Jordan, Michael I. Mean field theory for sigmoid belief networks. Journal of artificial intelligence research, 4(1):61–76, 1996.
22. Schulman, John, Heess, Nicolas, Weber, Theophane, and Abbeel, Pieter. Gradient estimation using stochastic computation graphs. NIPS, 2015.
23. Sutskever, Ilya, Vinyals, Oriol, and Le, Quoc. Sequence to sequence learning with neural networks. In NIPS, 2014.
24. Tang, Yichuan and Salakhutdinov, Ruslan. Learning stochastic feedforward neural networks. In NIPS, 2013.
25. Watkins, Christopher JCH and Dayan, Peter. Q-learning. Machine learning, 8(3-4):279–292, 1992.
26. Weaver, Lex and Tao, Nigel. The optimal reward baseline for gradient-based reinforcement learning. In UAI, pp. 538–545. Morgan Kaufmann Publishers Inc., 2001.
27. Williams, Ronald J. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, 8(3-4):229–256, 1992.
28. Zaremba, Wojciech and Sutskever, Ilya. Reinforcement learning neural turing machines. arXiv preprint arXiv:1505.00521, 2015.