Parallel multiscale autoregressive density estimation

34th International Conference on Machine Learning, ICML 2017

Volumn 6, Issue , 2017, Pages 4447-4456

  Reed, Scott ^a   Van denOord, Aaron ^a   Kalchbrenner, Nal ^a   Colmenarejo, Sergio Gomez ^a   Wang, Ziyu ^a   Chen, Yutian ^a   Belov, Den ^a   De Freitas, Nando ^a  

^a DEEPMIND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS;

AUTO-REGRESSIVE; DENSITY ESTIMATION; EFFICIENT SAMPLING; IMAGE GENERATIONS; NETWORK EVALUATION; ORDERS OF MAGNITUDE; STATE OF THE ART; VIDEO GENERATION;

PIXELS;

EID: 85048559820     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. Andriluka, Mykhaylo, Pishchulin, Leonid, Gehler, Peter, and Schiele, Bernt. 2d human pose estimation: New benchmark and state of the art analysis. In CVPR, pp. 3686-3693. 2014.
2. Dahl, Ryan, Norouzi, Mohammad, and Shlens, Jonathon. Pixel recursive super resolution. arXiv preprint arXiv:1702.00783, 2017.
3. Deng, Jia, Dong, Wei, Socher, Richard, Li, Li-Jia, Li, Kai, and Fei-Fei, Li. Image Net: A large-scale hierarchical image database. In CVPR, 2009.
4. Denton, Emily L, Chintala, Soumith, Szlam, Arthur, and Fergus, Rob. Deep generative image models using a Laplacian pyramid of adversarial networks. In NIPS, pp. 1486-1494, 2015.
5. Dinh, Laurent, Sohl-Dickstein, Jascha, and Bengio, Samy. Density estimation using Real NVP. In NIPS, 2016.
6. Finn, Chelsea, Goodfellow, Ian, and Levine, Sergey. Unsupervised learning for physical interaction through video prediction. In NIPS, 2016.
7. Goodfellow, Ian J., Pougct-Abadie, Jean, Mirza, Mchdi, Xu, Bing, Wardc-Farley, David, Ozair, Shetjil, Courville, Aaron C., and Bengio, Yoshua. Generative adversarial nets. In NIPS, 2014.
8. Gulrajani, Ishaan, Kumar, Kundan, Ahmed, Faruk, Taiga, Adrien Ali, Visin, Francesco, Vazquez, David, and Courville, Aaron. PixelVAE: A latent variable model for natural images. arXiv preprint arXiv:1611.05013, 2016.
9. He, Kaiming, Zhang, Xiangyu, Ren, Shaoqing, and Sun, Jian. Identity mappings in deep residual networks. In ECCV, pp. 630-645, 2016.
10. Johnson, Justin, Alahi, Alexandre, and Fei-Fei, Li. Perceptual losses for real-time style transfer and super- resolution. In ECCV, 2016.
11. Kalchbrenncr, Nal, Espeholt, Lasse, Simonyan, Karen, Oord, Aaron van den, Graves, Alex, and Kavukcuoglu, Koray. Neural machine translation in linear time. arXiv preprint arXiv:1610.10099 2016a.
12. Kalchbrenner, Nal, Oord, Aaron van den, Simonyan, Karen, Danihelka, Ivo, Vinyals, Oriol, Graves, Alex, and Kavukcuoglu, Koray. Video pixel networks. Preprint arXiv:1610.00527, 2016b.
13. Kingma, Diederik P and Salimans, Tim. Improving variational inference with inverse autoregressive flow. In NIPS, 2016.
14. Larochelle, Hugo and Murray, Iain. The neural autoregressive distribution estimator. In AISTATS, 2011.
15. Ledig, Christian, Theis, Lucas, Huszar, Ferenc, Caballero, Jose, Cunningham, Andrew, Acosta, Alejandro, Aitken, Andrew, Tcjani, Alykhan, Totz, Johannes, Wang, Zchan, and Shi, Wcnzhe. Photo-rcalistic single image super- resolution using a generative adversarial network. 2016.
16. Lin, Tsung-Yi, Maire, Michael, Belongie, Serge, Hays, James, Perona, Pietro, Ramanan, Deva, Dolldr, Piotr, and Zitnick, C Lawrence. Microsoft COCO: Common objects in context. In ECCV, pp. 740-755, 2014.
17. Mansimov, Elman, Parisotto, Emilio, Ba, Jimmy Lei, and Salakhutdinov, Ruslan. Generating images from captions with attention. In ICLR, 2015.
18. Nguyen, Anh, Yosinski, Jason, Bengio, Yoshua, Dosovit- skiy, Alexey, and Clunc, Jeff. Plug & play generative networks: Conditional iterative generation of images in latent space. arXiv preprint arXiv:1612.00005 2016.
19. Oord, Aaron van den, Dieleman, Sander, Zen, Heiga, Simonyan, Karen, Vinyals, Oriol, Graves, Alex, Kalchbrenner, Nal, Senior, Andrew, and Kavukcuoglu, Koray. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499, 2016.
20. Ramachandran, Prajit, Paine, Tom Le, Khorrami, Pooya, Babacizadch, Mohammad, Chang, Shiyu, Zhang, Yang, Hasegawa-Johnson, Mark, Campbell, Roy, and Huang, Thomas. Fast generation for convolutional autoregressive models. 2017.
21. Reed, Scott, Akata, Zeynep, Mohan, Santosh, Tenka, Samuel, Schiele, Bernt, and Lee, Honglak. Learning what and where to draw. In NIPS, 2016a.
22. Reed, Scott, Akata, Zeynep, Yan, Xinchen, Logeswaran, Lajanugen, Schiele, Bemt, and Lee, Honglak. Generative adversarial text-to-image synthesis. In ICML, 2016b.
23. Reed, Scott, van den Oord, Aaron, Kalchbrenner, Nal, Bapst, Victor, Botvinick, Matt, and de Freitas, Nando. Generating interpretable images with controllable structure. Technical report, 2016c.
24. Salimans, Tim, Karpathy, Andrej, Chen, Xi, and Kingma, Diederik P. PixelCNN++: Improving the PixelCNN with discretized logistic mixture likelihood and other modifications. arXiv preprint arXiv:1701.05517, 2017.
25. Shi, Wenzhe, Caballero, Jose, Huszdr, Ferenc, Totz, Johannes, Aitken, Andrew P, Bishop, Rob, Rueckert, Daniel, and Wang, Zehan. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In CVPR, 2016.
26. Sonderby, Casper Kaae, Caballero, Jose, Theis, Lucas, Shi, Wenzhe, and Huszdr, Ferenc. Amortised MAP inference for image super-resolution. 2017.
27. Theis, L. and Bcthgc, M. Generative image modeling using spatial LSTMs. In MPS, 2015.
28. Una, Benigno, Murray, Iain, and Larochelle, Hugo. RNADE: The real-valued neural autoregressive density- estimator. In NIPS, 2013.
29. van den Oord, Aaron, Kalchbrenner, Nal, and Kavukcuoglu, Koray. Pixel recurrent neural networks. In ICML, pp. 1747-1756, 2016a.
30. van den Oord, Aaron, Kalchbrcnner, Nal, Vinyals, Oriol, Espcholt, Lassc, Graves, Alex and Kavukcuoglu, Koray. Conditional image generation with PixelCNN decoders. In NIPS, 2016b.
31. Wah, Catherine, Branson, Steve, Welinder, Peter, Perona, Pietro, and Belongie, Serge. The Caltech-UCSD birds- 200-2011 datasct. 2011.
32. Wang, Xiaolong and Gupta, Abhinav. Generative image modeling using style and structure adversarial networks. In ECCV, pp. 318-335, 2016.
33. Wu, Yuhuai, Burda, Yuri, Salakhutdinov, Ruslan, and Grosse, Roger. On the quantitative analysis of decoder- based generative models. 2017.
34. Zhang, Han, Xu, Tao, Li, Hongsheng, Zhang, Shaoting, Huang, Xiaolei, Wang, Xiaogang, and Metaxas, Dim- itris. StackGAN: Text to photo-realistic image synthesis with stacked generative adversarial networks. arXiv preprint arXiv:1612.03242, 2016.