Iterative amortized inference

35th International Conference on Machine Learning, ICML 2018

Volumn 8, Issue , 2018, Pages 5444-5462

  Marino, Joseph ^a   Yue, Yisong ^a   Mandt, Stephan ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; DEPRECIATION; LEARNING SYSTEMS; SIGNAL ENCODING;

COMPUTATIONALLY EFFICIENT; CONVENTIONAL OPTIMIZATION; EMPIRICAL FINDINGS; INFERENCE MODELS; LATENT VARIABLE MODELS; OPTIMIZATION CAPABILITIES; TOP-DOWN INFERENCE; VARIATIONAL INFERENCE;

ITERATIVE METHODS;

EID: 85057262551     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., and de Freitas, N. Learning to learn by gradient descent by gradient descent. In Advances in Neural Information Processing Systems (NIPS), pp. 3981-3989, 2016.
2. Ba, J. L., Kiros, J. R., and Hinton, G. E. Layer normalization. arXivpreprint arXiv:1607.06450, 2016.
3. Cremer, C., Li, X., and Duvenaud, D. Inference subopti- mality in variational autoencoders. NIPS Workshop on Advances in Approximate Bayesian Inference, 2017.
4. Dayan, P., Hinton, G. E., Neal, R. M and Zemel, R. S. The helmholtz machine. Neural computation, 7(5):889-904, 1995.
5. Dempster, A. P., Laird, N. M., and Rubin, D. B. Maximum likelihood from incomplete data via the em algorithm. Journal of the royal statistical society. Series B (methodological), pp. 1-38, 1977.
6. Gershman, S. and Goodman, N. Amortized inference in probabilistic reasoning. In Proceedings of the Cognitive Science Society, volume 36, 2014.
7. Gregor, K., Danihelka, I., Mnih, A., Blundell, C., and Wier- stra, D. Deep autoregressive networks. In Proceedings of the International Conference on Machine Learning (ICML), pp. 1242-1250, 2014.
8. Gregor, K., Danihelka, I., Graves, A., Rezende, D. J., and Wierstra, D. Draw: A recurrent neural network for image generation. Proceedings of the International Conference on Machine Learning (ICML), pp. 1462-1471, 2015.
9. Gregor, K., Besse, F., Rezende, D. J., Danihelka, I., and Wierstra, D. Towards conceptual compression. In Advances In Neural Information Processing Systems (NIPS), pp. 3549-3557, 2016.
10. Higgins, I., Matthey, L., Pal, A., Burgess, C., Glorot, X., Botvinick, M., Mohamed, S., and Lerchner, A. beta-vae: Learning basic visual concepts with a constrained variational framework. In Proceedings of the International Conference on Learning Representations (ICLR), 2016.
11. Hjelm, D., Salakhutdinov, R. R., Cho, K., Jojic, N., Calhoun, V., and Chung, J. Iterative refinement of the approximate posterior for directed belief networks. In Advances in Neural Information Processing Systems (NIPS), pp. 4691- 4699, 2016.
12. Hoffman, M. D., Blei, D. M., Wang, C., and Paisley, J. Stochastic variational inference. The Journal of Machine Learning Research, 14(1): 1303-1347, 2013.
13. Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., and Saul, L. K. An introduction to variational methods for graphical models. NATO ASI SERIES D BEHAVIOURAL AND SOCIAL SCIENCES, 89:105-162, 1998.
14. Karl, M., Soelch, M., Bayer, J., and van der Smagt, P. Deep variational bayes filters: Unsupervised learning of state space models from raw data. In Proceedings of the International Conference on Learning Representations (ICLR), 2017.
15. Kim, Y., Wiseman, S., Miller, A. C., Sontag, D., and Rush, A. M. Semi-amortized variational autoencoders. In Proceedings of the International Conference on Machine Learning (ICML), 2018.
16. Kingma, D. P. and Welling, M. Stochastic gradient vb and the variational auto-encoder. In Proceedings of the International Conference on Learning Representations (ICLR), 2014.
17. Krishnan, R. G., Liang, D., and Hoffman, M. On the challenges of learning with inference networks on sparse, high-dimensional data. In Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 143-151, 2018.
18. Krizhevsky, A. and Hinton, G. Learning multiple layers of features from tiny images. 2009.
19. Lake, B. M., Salakhutdinov, R. R., and Tenenbaum, J. One- shot learning by inverting a compositional causal process. In Advances in Neural Information Processing Systems (NIPS), pp. 2526-2534, 2013.
20. LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P. Gradient- based learning applied to document recognition. Proceedings of the IEEE, 86(ll):2278-2324, 1998.
21. Lewis, D. D Yang, Y Rose, T. G., and Li, F. Rcvl: A new benchmark collection for text categorization research. The Journal of Machine Learning Research, 5(Apr):361- 397, 2004.
22. Neal, R. M. and Hinton, G. E. A view of the em algorithm that justifies incremental, sparse, and other variants. In Learning in graphical models, pp. 355-368. Springer, 1998.
23. Netzer, Y., Wang, T., Coates, A., Bissacco, A., Wu, B., and Ng, A. Y. Reading digits in natural images with unsupervised feature learning. In NIPS workshop on deep learning and unsupervised feature learning, 2011.
24. Putzky, P. and Welling, M. Recurrent inference machines for solving inverse problems. arXiv preprint arXiv:1706.04008, 2017.
25. Ranganath, R., Gerrish, S., and Blei, D. Black box variational inference. In Proceedings of the International Conference on Artificial Intelligence and Statistics (AIS- TATS), pp. 814-822, 2014.
26. Rezende, D. J., Mohamed, S., and Wierstra, D. Stochastic backpropagation and approximate inference in deep generative models. In Proceedings of the International Conference on Machine Learning (ICML), pp. 1278-1286, 2014.
27. Sonderby, C. K., Raiko, T., Maal0e, L., Sonderby, S. K., and Winther, 0. Ladder variational autoencoders. In Advances in Neural Information Processing Systems (NIPS), pp. 3738-3746, 2016.
28. Xue, T., Wu, J., Bouman, K., and Freeman, B. Visual dynamics: Probabilistic future frame synthesis via cross convolutional networks. In Advances in Neural Information Processing Systems (NIPS), pp. 91-99, 2016.