Improved training of wasserstein GANs

Advances in Neural Information Processing Systems

Volumn 2017-December, Issue , 2017, Pages 5768-5778

  Gulrajani, Ishaan ^a,d   Ahmed, Faruk ^a   Arjovsky, Martin ^b   Dumoulin, Vincent ^a   Courville, Aaron ^a,c  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b NEW YORK UNIVERSITY   (United States)

^c CIFAR Fellow   (United States)

^d GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADVERSARIAL NETWORKS; GENERATIVE MODEL; HIGH QUALITY; HYPER-PARAMETER; LANGUAGE MODEL; LIPSCHITZ CONSTRAINTS; UNDESIRED BEHAVIOR;

EID: 85047004943     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. M. Arjovsky and L. Bottou. Towards principled methods for training generative adversarial networks. 2017.
2. M. Arjovsky, S. Chintala, and L. Bottou. Wasserstein gan. arXiv preprint arXiv: 1701.07875, 2017.
3. J. L. Ba, J. R. Kiros, and G. E. Hinton. Layer normalization. arXiv preprint arXiv: 1607.06450, 2016.
4. D. Berthelot, T. Schumm, and L. Metz. Began: Boundary equilibrium generative adversarial networks. arXiv preprint arXiv: 1703.10717, 2017.
5. T. Che, Y. Li, R. Zhang, R. D. Hjelm, W. Li, Y. Song, and Y. Bengio. Maximum-likelihood augmented discrete generative adversarial networks. arXiv preprint arXiv: 1702.07983, 2017.
6. C. Chelba, T. Mikolov, M. Schuster, Q. Ge, T. Brants, P. Koehn, and T. Robinson. One billion word benchmark for measuring progress in statistical language modeling. arXiv preprint arXiv: 1312.3005, 2013.
7. Z. Dai, A. Almahairi, P. Bachman, E. Hovy, and A. Courville. Calibrating energy-based generative adversarial networks. arXiv preprint arXiv: 1702.01691, 2017.
8. V. Dumoulin, M. I. D. Belghazi, B. Poole, A. Lamb, M. Arjovsky, O. Mastropietro, and A. Courville. Adversarially learned inference. 2017.
9. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in neural information processing systems, pages 2672-2680, 2014.
10. R. D. Hjelm, A. P. Jacob, T. Che, K. Cho, and Y. Bengio. Boundary-seeking generative adversarial networks. arXiv preprint arXiv: 1702.08431, 2017.
11. X. Huang, Y. Li, O. Poursaeed, J. Hopcroft, and S. Belongie. Stacked generative adversarial networks. arXiv preprint arXiv: 1612.04357, 2016.
12. E. Jang, S. Gu, and B. Poole. Categorical reparameterization with gumbel-softmax. arXiv preprint arXiv: 1611.01144, 2016.
13. A. Krizhevsky. Learning multiple layers of features from tiny images. 2009.
14. J. Li, W. Monroe, T. Shi, A. Ritter, and D. Jurafsky. Adversarial learning for neural dialogue generation. arXiv preprint arXiv: 1701.06547, 2017.
15. X. Liang, Z. Hu, H. Zhang, C. Gan, and E. P. Xing. Recurrent topic-transition gan for visual paragraph generation. arXiv preprint arXiv: 1703.07022, 2017.
16. C. J. Maddison, A. Mnih, and Y. W. Teh. The concrete distribution: A continuous relaxation of discrete random variables. arXiv preprint arXiv: 1611.00712, 2016.
17. X. Mao, Q. Li, H. Xie, R. Y. Lau, and Z. Wang. Least squares generative adversarial networks. arXiv preprint arXiv: 1611.04076, 2016.
18. L. Metz, B. Poole, D. Pfau, and J. Sohl-Dickstein. Unrolled generative adversarial networks. arXiv preprint arXiv: 1611.02163, 2016.
19. A. Odena, C. Olah, and J. Shlens. Conditional image synthesis with auxiliary classifier gans. arXiv preprint arXiv: 1610.09585, 2016.
20. B. Poole, A. A. Alemi, J. Sohl-Dickstein, and A. Angelova. Improved generator objectives for gans. arXiv preprint arXiv: 1612.02780, 2016.
21. A. Radford, L. Metz, and S. Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv: 1511.06434, 2015.
22. T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford, and X. Chen. Improved techniques for training gans. In Advances in Neural Information Processing Systems, pages 2226-2234, 2016.
23. A. van den Oord, N. Kalchbrenner, L. Espeholt, O. Vinyals, A. Graves, et al. Conditional image generation with pixelcnn decoders. In Advances in Neural Information Processing Systems, pages 4790-4798, 2016.
24. C. Villani. Optimal transport: old and new, Volume 338. Springer Science & Business Media, 2008.
25. D. Wang and Q. Liu. Learning to draw samples: With application to amortized mle for generative adversarial learning. arXiv preprint arXiv: 1611.01722, 2016.
26. D. Warde-Farley and Y. Bengio. Improving generative adversarial networks with denoising feature matching. 2017.
27. R. J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, 8(3-4): 229-256, 1992.
28. Y. Wu, Y. Burda, R. Salakhutdinov, and R. Grosse. On the quantitative analysis of decoder-based generative models. arXiv preprint arXiv: 1611.04273, 2016.
29. Z. Yang, W. Chen, F. Wang, and B. Xu. Improving neural machine translation with conditional sequence generative adversarial nets. arXiv preprint arXiv: 1703.04887, 2017.
30. F. Yu, A. Seff, Y. Zhang, S. Song, T. Funkhouser, and J. Xiao. Lsun: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv preprint arXiv: 1506.03365, 2015.
31. L. Yu, W. Zhang, J. Wang, and Y. Yu. Seqgan: sequence generative adversarial nets with policy gradient. arXiv preprint arXiv: 1609.05473, 2016.