Generative Adversarial Networks: An Overview

IEEE Signal Processing Magazine

Volumn 35, Issue 1, 2018, Pages 53-65

  Creswell, Antonia ^a   White, Tom ^b   Dumoulin, Vincent ^c   Arulkumaran, Kai ^a   Sengupta, Biswa ^a   Bharath, Anil A ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

^c UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS;

ADVERSARIAL NETWORKS; ANNOTATED TRAINING DATA; IMAGE SUPER-RESOLUTION; IMAGE SYNTHESIS; SEMANTIC IMAGES;

SIGNAL PROCESSING;

EID: 85040689867     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2017.2765202     Document Type: Review

References (55)

1. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets, " in Proc. Advances Neural Information Processing Systems Conf., 2014, pp. 2672-2680.
2. J.-Y. Zhu, P. Krähenbühl, E. Shechtman, and A. A. Efros, "Generative visual manipulation on the natural image manifold, " in Proc. European Conf. Computer Vision, 2016, pp. 597-613.
3. K. Bousmalis, N. Silberman, D. Dohan, D. Erhan, and D. Krishnan, "Unsupervised pixel-level domain adaptation with generative adversarial networks, " in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2016, pp. 3722-3731.
4. J.-Y. Zhu, T. Park, P. Isola, and A. A. Efros. (2017). Unpaired image-to-image translation using cycle-consistent adversarial networks, Proc. Int. Conf. Computer Vision. [Online]. Available: https://arxiv. org/abs/1703. 10593
5. A. Radford, L. Metz, and S. Chintala, "Unsupervised representation learning with deep convolutional generative adversarial networks, " in Proc. 5th Int. Conf. Learning Representations Workshop Track, 2016.
6. A. Creswell and A. A. Bharath, "Adversarial training for sketch retrieval, " in Proc. European Conf. Computer Vision Workshops, Amsterdam, The Netherlands, 2016, pp. 798-809.
7. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning, " Nature, vol. 521, no. 7553, pp. 436-444, 2015.
8. H. Hotelling, "Analysis of a complex of statistical variables into principal components, " J. Educ. Psychol., vol. 24, no. 6, pp. 417, 1933.
9. I. J. Goodfellow, "On distinguishability criteria for estimating generative models, " in Proc. Int. Conf. Learning Representations Workshop Track, 2015.
10. M. Gutmann and A. Hyvärinen, "Noise-contrastive estimation: A new estimation principle for unnormalized statistical models, " Artif. Intell. Statist., vol. 1, no. 2, p. 6, 2010.
11. Y. Bengio, L. Yao, G. Alain, and P. Vincent, "Generalized denoising autoencoders as generative models, " in Proc. Advances Neural Information Processing Systems Conf., 2013, pp. 899-907.
12. I. Goodfellow. (2016). NIPS 2016 tutorial: Generative adversarial networks, Proc. Neural Information Processing Systems Conf. [Online]. Available: https:// arxiv. org/abs/1701. 00160
13. E. L. Denton, S. Chintala, A. Szlam, and R. Fergus, "Deep generative image models using a Laplacian pyramid of adversarial networks, " in Proc. Advances Neural Information Processing Systems Conf., 2015, pp. 1486-1494.
14. J. Wu, C. Zhang, T. Xue, B. Freeman, and J. Tenenbaum, "Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling, " in Proc. Advances Neural Information Processing Systems Conf., 2016, pp. 82-90.
15. M. Mirza and S. Osindero, "Conditional generative adversarial nets, " arXiv Preprint, arXiv:1411. 1784, 2014.
16. X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever, and P. Abbeel, "Infogan: Interpretable representation learning by information maximizing generative adversarial nets, " in Proc. Advances Neural Information Processing Systems Conf., 2016, pp. 2172-2180.
17. A. Creswell and A. A. Bharath, "Inverting the generator of a generative adversarial network, " in Proc. Neural Information Processing Systems Workshop Adversarial Training, 2016.
18. Z. C. Lipton and S. Tripathi, "Precise recovery of latent vectors from generative adversarial networks, " in Proc. Int. Conf. Learning Representations Workshop Track, 2017.
19. V. Dumoulin, I. Belghazi, B. Poole, O. Mastropietro, A. Lamb, M. Arjovsky, and A. Courville, "Adversarially learned inference, " in Proc. Int. Conf. Learning Representations, 2017.
20. J. Donahue, P. Krähenbühl, and T. Darrell, "Adversarial feature learning, " in Proc. Int. Conf. Learning Representations, 2017.
21. C. Li, H. Liu, C. Chen, Y. Pu, L. Chen, R. Henao, and L. Carin, "Towards understanding adversarial learning for joint distribution matching, " in Proc. Advances Neural Information Processing Systems Conf., 2017.
22. A. Makhzani, J. Shlens, N. Jaitly, and I. Goodfellow. (2016). Adversarial autoencoders, Proc. Int. Conf. Learning Representations. [Online]. Available: http:// arxiv. org/abs/1511. 05644
23. D. P. Kingma and M. Welling, "Auto-encoding variational bayes, " in Proc. 2nd Int. Conf. Learning Representations, 2014.
24. L. M. Mescheder, S. Nowozin, and A. Geiger. (2017). Adversarial variational Bayes: Unifying variational autoencoders and generative adversarial networks. Available: http://arxiv. org/abs/1701. 04722
25. T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford, and X. Chen, "Improved techniques for training GANS, " in Proc. Advances Neural Information Processing Systems Conf., 2016, pp. 2226-2234.
26. M. Arjovsky and L. Bottou, "Towards principled methods for training generative adversarial networks, " in Proc. Neural Information Processing Systems Conf. Workshop Adversarial Training, 2016.
27. E. Shelhamer, J. Long, and T. Darrell, "Fully convolutional networks for semantic segmentation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 4, pp. 640-651, 2017.
28. S. Ioffe and C. Szegedy, "Batch normalization: Accelerating deep network training by reducing internal covariate shift, " in Proc. 32nd Int. Conf. Machine Learning, 2015, pp. 448-456.
29. C. K. Sønderby, J. Caballero, L. Theis, W. Shi, and F. Huszár, "Amortised map inference for image super-resolution, " in Proc. Int. Conf. Learning Representations, 2017.
30. S. Nowozin, B. Cseke, and R. Tomioka, "F-GAN: Training generative neural samplers using variational divergence minimization, " in Proc. Advances Neural Information Processing Systems Conf., 2016, pp. 271-279.
31. M. Uehara, I. Sato, M. Suzuki, K. Nakayama, and Y. Matsuo, "Generative adversarial nets from a density ratio estimation perspective, " arXiv Preprint, arXiv:1610. 02920, 2016.
32. M. Arjovsky, S. Chintala, and L. Bottou, "Wasserstein GAN, " in Proc. 34th Int. Conf. Machine Learning, 2017, pp. 214-223.
33. I. Gulrajani, F. Ahmed, M. Arjovsky, V. Dumoulin, and A. Courville, "Improved training of wasserstein GANS, " in Proc. Advances Neural Information Processing Systems Conf., 2017.
34. T. Mikolov, K. Chen, G. Corrado, and J. Dean, "Efficient estimation of word representations in vector space, " in Proc. Int. Conf. Learning Representations, 2013.
35. S. Gurumurthy, R. K. Sarvadevabhatla, and V. B. Radhakrishnan, "Deligan: Generative adversarial networks for diverse and limited data, " in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2017, pp. 166-174.
36. C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Aitken, A. Tejani, J. Totz, Z. Wang, and W. Shi, "Photo-realistic single image super-resolution using a generative adversarial network, " in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2017, pp. 4681-4690.
37. X. Yu and F. Porikli, "Ultra-resolving face images by discriminative generative networks, " in Proc. European Conf. Computer Vision, 2016, pp. 318-333.
38. X. Yu and F. Porikli, "Hallucinating very low-resolution unaligned and noisy face images by transformative discriminative autoencoders, " in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2017, pp. 3760-3768.
39. A. Shrivastava, T. Pfister, O. Tuzel, J. Susskind, W. Wang, and R. Webb, "Learning from simulated and unsupervised images through adversarial training, " in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2016, pp. 2107-2116.
40. M. Zhang, K. T. Ma, J. H. Lim, Q. Zhao, and J. Feng, "Deep future gaze: Gaze anticipation on egocentric videos using adversarial networks, " in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2017, pp. 4372-4381.
41. M.-Y. Liu and O. Tuzel, "Coupled generative adversarial networks, " in Proc. Advances Neural Information Processing Systems Conf., 2016, pp. 469-477.
42. X. Huang, Y. Li, O. Poursaeed, J. Hopcroft, and S. Belongie, "Stacked generative adversarial networks, " in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2016.
43. S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee. (2016). Generative adversarial text to image synthesis, Proc. Int. Conf. Machine Learning. Available: https://arxiv. org/abs/1605. 05396
44. S. E. Reed, Z. Akata, S. Mohan, S. Tenka, B. Schiele, and H. Lee, "Learning what and where to draw, " in Proc. Advances Neural Information Processing Systems Conf., 2016, pp. 217-225.
45. A. Brock, T. Lim, J. M. Ritchie, and N. Weston, "Neural photo editing with introspective adversarial networks, " in Proc. 6th Int. Conf. Learning Representations, 2017.
46. P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros, "Image-to-image translation with conditional adversarial networks, " in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2016, pp. 1125-1134.
47. C. Li and M. Wand, "Precomputed real-time texture synthesis with Markovian generative adversarial networks, " in Proc. European Conf. Computer Vision, 2016, pp. 702-716.
48. S. Arora, R. Ge, Y. Liang, T. Ma, and Y. Zhang, "Generalization and equilibrium in generative adversarial nets (GANS), " in Proc. 34th Int. Conf. Machine Learning, 2017, pp. 224-232.
49. I. Tolstikhin, S. Gelly, O. Bousquet, C.-J. Simon-Gabriel, and B. Schölkopf, "ADAGAN: Boosting generative models, " arXiv Preprint arXiv:1701. 02386. Available: https://arxiv. org/abs/1701. 02386
50. J. Zhao, M. Mathieu, and Y. LeCun. (2017). Energy-based generative adversarial network, Proc. Int. Conf. Learning Representations. [Online]. Available: https://arxiv. org/abs/1609. 03126
51. L. Metz, B. Poole, D. Pfau, and J. Sohl-Dickstein. (2017). Unrolled generative adversarial networks, Proc. Int. Conf. Learning Representations. [Online]. Available: https://arxiv. org/abs/1611. 02163
52. J. D. Lee, M. Simchowitz, M. I. Jordan, and B. Recht, "Gradient descent only converges to minimizers, " in Proc. Conf. Learning Theory, 2016, pp. 1246-1257.
53. R. Pemantle, "Nonconvergence to unstable points in urn models and stochastic approximations, " Ann. Probab., vol. 18, no. 2, pp. 698-712, Apr. 1990.
54. L. M. Mescheder, S. Nowozin, and A. Geiger. (2017). The numerics of GANS, Proc. Advances Neural Information Processing Systems Conf. [Online]. Available: http://arxiv. org/abs/1705. 10461
55. L. Theis, A. van den Oord, and M. Bethge, "A note on the evaluation of generative models, " in Proc. Int. Conf. Learning Representations.