How generative adversarial networks and their variants work: An overview

ACM Computing Surveys

Volumn 52, Issue 1, 2020, Pages

  Hong, Yongjun ^a   Hwang, Uiwon ^a   Yoo, Jaeyoon ^a   Yoon, Sungroh ^a  

^a Seoul National University   (South Korea)

Author keywords

Domain adaptation; Generative adversarial networks; Integral probability metric; Mode collapse; Semi supervised learning; Variational auto encoder

Indexed keywords

LEARNING ALGORITHMS; NETWORK CODING; SUPERVISED LEARNING;

AUTO ENCODERS; DOMAIN ADAPTATION; INTEGRAL PROBABILITY METRIC; LEARN+; LEARNING FIELDS; MACHINE-LEARNING; MODE COLLAPSE; PROBABILITY METRICS; SEMI-SUPERVISED LEARNING; VARIATIONAL AUTO-ENCODER;

GENERATIVE ADVERSARIAL NETWORKS;

EID: 85062420736     PISSN: 03600300     EISSN: 15577341     Source Type: Journal    
DOI: 10.1145/3301282     Document Type: Review

References (146)

1. Pieter Abbeel and Andrew Y. Ng. 2011. Inverse reinforcement learning. In Encyclopedia of Machine Learning. Springer, 554–558.
2. Hana Ajakan, Pascal Germain, Hugo Larochelle, François Laviolette, and Mario Marchand. 2014. Domain-adversarial neural networks. arXiv preprint arXiv:1412.4446 (2014).
3. Grigory Antipov, Moez Baccouche, and Jean-Luc Dugelay. 2017. Face aging with conditional generative adversarial networks. arXiv preprint arXiv:1702.01983 (2017).
4. Martin Arjovsky and Léon Bottou. 2017. Towards principled methods for training generative adversarial networks. arXiv preprint arXiv:1701.04862 (2017).
5. Martin Arjovsky, Soumith Chintala, and Léon Bottou. 2017. Wasserstein GAN. arXiv preprint arXiv:1701.07875 (2017).
6. Sanjeev Arora, Rong Ge, Yingyu Liang, Tengyu Ma, and Yi Zhang. 2017. Generalization and equilibrium in generative adversarial nets (GANs). arXiv preprint arXiv:1703.00573 (2017).
7. Shane Barratt and Rishi Sharma. 2018. A note on the inception score. arXiv preprint arXiv:1801.01973 (2018).
8. Marc G, Bellemare, Ivo Danihelka, Will Dabney, Shakir Mohamed, Balaji Lakshminarayanan, Stephan Hoyer, and Rémi Munos. 2017. The cramer distance as a solution to biased Wasserstein gradients. arXiv preprint arXiv:1705.10743 (2017).
9. Sagie Benaim and Lior Wolf. 2017. One-sided unsupervised domain mapping. arXiv preprint arXiv:1706.00826 (2017).
10. David Berthelot, Tom Schumm, and Luke Metz. 2017. BeGAN: Boundary equilibrium generative adversarial networks. arXiv preprint arXiv:1703.10717 (2017).
11. Ashish Bora, Eric Price, and Alexandros G. Dimakis. 2018. AmbientGAN: Generative models from lossy measurements. In Proceedings of the International Conference on Learning Representations. https://openreview.net/forum?id=Hy7fDog0b.
12. Konstantinos Bousmalis, Nathan Silberman, David Dohan, Dumitru Erhan, and Dilip Krishnan. 2016. Unsupervised pixel-level domain adaptation with generative adversarial networks. arXiv preprint arXiv:1612.05424 (2016).
13. Tong Che, Yanran Li, Athul Paul Jacob, Yoshua Bengio, and Wenjie Li. 2016. Mode regularized generative adversarial networks. arXiv preprint arXiv:1612.02136 (2016).
14. Tong Che, Yanran Li, Ruixiang Zhang, R Devon Hjelm, Wenjie Li, Yangqiu Song, and Yoshua Bengio. 2017. Maximum-likelihood augmented discrete generative adversarial networks. arXiv preprint arXiv:1702.07983 (2017).
15. Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, and Pieter Abbeel. 2016. InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets. In Advances in Neural Information Processing Systems. Curran Associates, 2172–2180.
16. Wei Dai, Joseph Doyle, Xiaodan Liang, Hao Zhang, Nanqing Dong, Yuan Li, and Eric P. Xing. 2017. SCAN: Structure correcting adversarial network for chest x-rays organ segmentation. arXiv preprint arXiv:1703.08770 (2017).
17. Ivo Danihelka, Balaji Lakshminarayanan, Benigno Uria, Daan Wierstra, and Peter Dayan. 2017. Comparison of maximum likelihood and GAN-based training of real NVPs. arXiv preprint arXiv:1705.05263 (2017).
18. Ayushman Dash, John Cristian Borges Gamboa, Sheraz Ahmed, Muhammad Zeshan Afzal, and Marcus Liwicki. 2017. TAC-GAN-text conditioned auxiliary classifier generative adversarial network. arXiv preprint arXiv:1703.06412 (2017).
19. Constantinos Daskalakis, Andrew Ilyas, Vasilis Syrgkanis, and Haoyang Zeng. 2018. Training GANs with optimism. In International Conference on Learning Representations. https://openreview.net/forum?id=SJJySbbAZ.
20. Roy De Maesschalck, Delphine Jouan-Rimbaud, and Désiré L. Massart. 2000. The mahalanobis distance. Chemomet-rics and Intelligent Laboratory Systems 50, 1 (2000), 1–18.
21. Emily Denton, Sam Gross, and Rob Fergus. 2016. Semi-supervised learning with context-conditional generative adversarial networks. arXiv preprint arXiv:1611.06430 (2016).
22. Carl Doersch. 2016. Tutorial on variational autoencoders. arXiv preprint arXiv:1606.05908 (2016).
23. Chris Donahue, Akshay Balsubramani, Julian McAuley, and Zachary C. Lipton. 2017. Semantically decomposing the latent spaces of generative adversarial networks. arXiv preprint arXiv:1705.07904 (2017).
24. Jeff Donahue, Philipp Krähenbühl, and Trevor Darrell. 2016. Adversarial feature learning. arXiv preprint arXiv:1605.09782 (2016).
25. Vincent Dumoulin, Ishmael Belghazi, Ben Poole, Alex Lamb, Martin Arjovsky, Olivier Mastropietro, and Aaron Courville. 2016. Adversarially learned inference. arXiv preprint arXiv:1606.00704 (2016).
26. Vincent Dumoulin and Francesco Visin. 2016. A guide to convolution arithmetic for deep learning. arXiv preprint arXiv:1603.07285 (2016).
27. Ishan Durugkar, Ian Gemp, and Sridhar Mahadevan. 2016. Generative multi-adversarial networks. arXiv preprint arXiv:1611.01673 (2016).
28. Kiana Ehsani, Roozbeh Mottaghi, and Ali Farhadi. 2017. SeGAN: Segmenting and generating the invisible. arXiv preprint arXiv:1703.10239 (2017).
29. Werner Fenchel. 1949. On conjugate convex functions. Canadian Journal of Mathematics 1, 73–77 (1949).
30. Chelsea Finn, Paul Christiano, Pieter Abbeel, and Sergey Levine. 2016. A connection between generative adversarial networks, inverse reinforcement learning, and energy-based models. arXiv preprint arXiv:1611.03852 (2016).
31. Robert T. Frankot and Rama Chellappa. 1988. A method for enforcing integrability in shape from shading algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence 10, 4 (1988), 439–451.
32. Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2016. Image style transfer using convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16). IEEE, 2414–2423.
33. Arnab Ghosh, Viveka Kulharia, Vinay Namboodiri, Philip H. S. Torr, and Puneet K. Dokania. 2017. Multi-agent diverse generative adversarial networks. arXiv preprint arXiv:1704.02906 (2017).
34. Aidan N. Gomez, Sicong Huang, Ivan Zhang, Bryan M. Li, Muhammad Osama, and Lukasz Kaiser. 2018. Unsupervised cipher cracking using discrete GANs. In Proceedings of the International Conference on Learning Representations. https://openreview.net/forum?id=BkeqO7x0-.
35. Ian Goodfellow. 2016. NIPS 2016 tutorial: Generative adversarial networks. arXiv preprint arXiv:1701.00160 (2016).
36. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in Neural Information Processing Systems. Curran Associates, 2672–2680.
37. Mahesh Gorijala and Ambedkar Dukkipati. 2017. Image generation and editing with variational info generative AdversarialNetworks. arXiv preprint arXiv:1701.04568 (2017).
38. Alex Graves, Abdel-rahman Mohamed, and Geoffrey Hinton. 2013. Speech recognition with deep recurrent neural networks. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’13). IEEE, 6645–6649.
39. Paulina Grnarova, Kfir Y. Levy, Aurelien Lucchi, Thomas Hofmann, and Andreas Krause. 2017. An online learning approach to generative adversarial networks. arXiv preprint arXiv:1706.03269 (2017).
40. Shixiang Gu, Timothy Lillicrap, Zoubin Ghahramani, Richard E. Turner, and Sergey Levine. 2016. Q-prop: Sample-efficient policy gradient with an off-policy critic. arXiv preprint arXiv:1611.02247 (2016).
41. Gabriel Lima Guimaraes, Benjamin Sanchez-Lengeling, Pedro Luis Cunha Farias, and Alán Aspuru-Guzik. 2017. Objective-reinforced generative adversarial networks (ORGAN) for sequence generation models. arXiv preprint arXiv:1705.10843 (2017).
42. Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville. 2017. Improved training of Wasserstein GANs. arXiv preprint arXiv:1704.00028 (2017).
43. Leonid G. Hanin. 1992. Kantorovich-rubinstein norm and its application in the theory of Lipschitz spaces. Proc. Amer. Math. Soc. 115, 2 (1992), 345–352.
44. R. Devon Hjelm, Athul Paul Jacob, Tong Che, Kyunghyun Cho, and Yoshua Bengio. 2017. Boundary-seeking generative adversarial networks. arXiv preprint arXiv:1702.08431 (2017).
45. Jonathan Ho and Stefano Ermon. 2016. Generative adversarial imitation learning. In Advances in Neural Information Processing Systems. Curran Associates, 4565–4573.
46. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735–1780.
47. Judy Hoffman, Eric Tzeng, Taesung Park, Jun-Yan Zhu, Phillip Isola, Kate Saenko, Alexei A. Efros, and Trevor Darrell. 2017. CyCADA: Cycle-consistent adversarial domain adaptation. arXiv preprint arXiv:1711.03213 (2017).
48. Chin-Cheng Hsu, Hsin-Te Hwang, Yi-Chiao Wu, Yu Tsao, and Hsin-Min Wang. 2017. Voice conversion from unaligned corpora using variational autoencoding Wasserstein generative adversarial networks. arXiv preprint arXiv:1704.00849 (2017).
49. Xun Huang, Yixuan Li, Omid Poursaeed, John Hopcroft, and Serge Belongie. 2016. Stacked generative adversarial networks. arXiv:1612.04357 (2016). https://arxiv.org/abs/1612.04357.
50. Xun Huang, Yixuan Li, Omid Poursaeed, John Hopcroft, and Serge Belongie. 2017. Stacked generative adversarial networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 2. IEEE, 4.
51. Daniel Jiwoong Im, Chris Dongjoo Kim, Hui Jiang, and Roland Memisevic. 2016. Generating images with recurrent adversarial networks. arXiv preprint arXiv:1602.05110 (2016).
52. Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. 2016. Image-to-image translation with conditional adversarial networks. arXiv preprint arXiv:1611.07004 (2016).
53. Edwin T. Jaynes. 1957. Information theory and statistical mechanics. Physical Review 106, 4 (1957), 620.
54. Felix Juefei-Xu, Vishnu Naresh Boddeti, and Marios Savvides. 2017. Gang of GANs: Generative adversarial networks with maximum margin ranking. arXiv preprint arXiv:1704.04865 (2017).
55. Levent Karacan, Zeynep Akata, Aykut Erdem, and Erkut Erdem. 2016. Learning to generate images of outdoor scenes from attributes and semantic layouts. arXiv preprint arXiv:1612.00215 (2016).
56. Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen. 2017. Progressive growing of GANs for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196 (2017).
57. Taeksoo Kim, Moonsu Cha, Hyunsoo Kim, Jungkwon Lee, and Jiwon Kim. 2017. Learning to discover cross-domain relations with generative adversarial networks. arXiv preprint arXiv:1703.05192 (2017).
58. Taeksoo Kim, Byoungjip Kim, Moonsu Cha, and Jiwon Kim. 2017. Unsupervised visual attribute transfer with reconfigurable generative adversarial networks. arXiv preprint arXiv:1707.09798 (2017).
59. Yoon Kim, Kelly Zhang, Alexander M. Rush, Yann LeCun, et al. 2017. Adversarially regularized autoencoders for generating discrete structures. arXiv preprint arXiv:1706.04223 (2017).
60. Murat Kocaoglu, Christopher Snyder, Alexandros G. Dimakis, and Sriram Vishwanath. 2017. CausalGAN: Learning causal implicit generative models with adversarial training. arXiv preprint arXiv:1709.02023 (2017).
61. Naveen Kodali, Jacob Abernethy, James Hays, and Zsolt Kira. 2017. How to train your DRAGAN. arXiv preprint arXiv:1705.07215 (2017).
62. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. Curran Associates, 1097–1105.
63. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. 1097–1105.
64. Anders Boesen Lindbo Larsen, Søren Kaae Sønderby, Hugo Larochelle, and Ole Winther. 2015. Autoencoding beyond pixels using a learned similarity metric. arXiv preprint arXiv:1512.09300 (2015).
65. Christian Ledig, Lucas Theis, Ferenc Huszár, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, et al. 2016. Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint arXiv:1609.04802 (2016).
66. Sang-gil Lee, Uiwon Hwang, Seonwoo Min, and Sungroh Yoon. 2017. A SeqGAN for polyphonic music generation. arXiv preprint arXiv:1710.11418 (2017).
67. Chongxuan Li, Kun Xu, Jun Zhu, and Bo Zhang. 2017. Triple generative adversarial nets. arXiv preprint arXiv:1703.02291 (2017).
68. Chun-Liang Li, Wei-Cheng Chang, Yu Cheng, Yiming Yang, and Barnabás Póczos. 2017. MMD GAN: Towards deeper understanding of moment matching network. arXiv preprint arXiv:1705.08584 (2017).
69. Jianan Li, Xiaodan Liang, Yunchao Wei, Tingfa Xu, Jiashi Feng, and Shuicheng Yan. 2017. Perceptual generative adversarial networks for small object detection. In IEEE CVPR.
70. Yujia Li, Kevin Swersky, and Rich Zemel. 2015. Generative moment matching networks. In Proceedings of the 32nd International Conference on Machine Learning (ICML’15). 1718–1727.
71. Timothy P, Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015).
72. Jae Hyun Lim and Jong Chul Ye. 2017. Geometric GAN. arXiv preprint arXiv:1705.02894 (2017).
73. Kevin Lin, Dianqi Li, Xiaodong He, Zhengyou Zhang, and Ming-Ting Sun. 2017. Adversarial ranking for language generation. arXiv preprint arXiv:1705.11001 (2017).
74. Ming-Yu Liu and Oncel Tuzel. 2016. Coupled generative adversarial networks. In Advances in Neural Information Processing Systems. Curran Associates, 469–477.
75. Yongyi Lu, Yu-Wing Tai, and Chi-Keung Tang. 2017. Conditional CycleGAN for attribute guided face image generation. arXiv preprint arXiv:1705.09966 (2017).
76. Xudong Mao, Qing Li, Haoran Xie, Raymond Y. K. Lau, Zhen Wang, and Stephen Paul Smolley. 2016. Least squares generative adversarial networks. arXiv preprint ArXiv:1611.04076 (2016).
77. Morteza Mardani, Enhao Gong, Joseph Y. Cheng, Shreyas Vasanawala, Greg Zaharchuk, Marcus Alley, Neil Thakur, Song Han, William Dally, John M. Pauly, et al. 2017. Deep generative adversarial networks for compressed sensing automates MRI. arXiv preprint arXiv:1706.00051 (2017).
78. Lars Mescheder, Sebastian Nowozin, and Andreas Geiger. 2017. The numerics of GANs. arXiv preprint arXiv:1705.10461 (2017).
79. Luke Metz, Ben Poole, David Pfau, and Jascha Sohl-Dickstein. 2016. Unrolled generative adversarial networks. arXiv preprint arXiv:1611.02163 (2016).
80. Mehdi Mirza and Simon Osindero. 2014. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014).
81. Takeru Miyato, Toshiki Kataoka, Masanori Koyama, and Yuichi Yoshida. 2018. Spectral normalization for generative adversarial networks. arXiv preprint arXiv:1802.05957 (2018).
82. Takeru Miyato and Masanori Koyama. 2018. cGANs with projection discriminator. arXiv preprint arXiv:1802.05637 (2018).
83. Olof Mogren. 2016. C-RNN-GAN: Continuous recurrent neural networks with adversarial training. arXiv preprint arXiv:1611.09904 (2016).
84. Youssef Mroueh and Tom Sercu. 2017. Fisher GAN. arXiv preprint arXiv:1705.09675 (2017).
85. Youssef Mroueh, Tom Sercu, and Vaibhava Goel. 2017. McGan: Mean and covariance feature matching GAN. arXiv preprint arXiv:1702.08398 (2017).
86. Hariharan Narayanan and Sanjoy Mitter. 2010. Sample complexity of testing the manifold hypothesis. In Advances in Neural Information Processing Systems. Curran Associates, 1786–1794.
87. Anh Nguyen, Alexey Dosovitskiy, Jason Yosinski, Thomas Brox, and Jeff Clune. 2016. Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In Advances in Neural Information Processing Systems. Curran Associates, 3387–3395.
88. Anh Nguyen, Jason Yosinski, Yoshua Bengio, Alexey Dosovitskiy, and Jeff Clune. 2016. Plug & play generative networks: Conditional iterative generation of images in latent space. arXiv preprint arXiv:1612.00005 (2016).
89. Sebastian Nowozin, Botond Cseke, and Ryota Tomioka. 2016. f-GAN: Training generative neural samplers using variational divergence minimization. In Advances in Neural Information Processing Systems. Curran Associates, 271–279.
90. Augustus Odena, Christopher Olah, and Jonathon Shlens. 2016. Conditional image synthesis with auxiliary classifier GANs. arXiv preprint arXiv:1610.09585 (2016).
91. Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. 2016. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499 (2016).
92. Aaron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu. 2016. Pixel recurrent neural networks. arXiv preprint arXiv:1601.06759 (2016).
93. Sinno Jialin Pan and Qiang Yang. 2010. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22, 10 (2010), 1345–1359.
94. Guim Perarnau, Joost van de Weijer, Bogdan Raducanu, and Jose M. Álvarez. 2016. Invertible conditional GANs for image editing. arXiv preprint arXiv:1611.06355 (2016).
95. Patrick Pérez, Michel Gangnet, and Andrew Blake. 2003. Poisson image editing. In ACM Transactions on Graphics (TOG), Vol. 22. ACM, 313–318.
96. Dmitry Pestov, Xi Wang, Gombojav O. Ariunbold, Robert K. Murawski, Vladimir A. Sautenkov, Arthur Dogariu, Alexei V. Sokolov, and Marlan O. Scully. 2008. Single-shot detection of bacterial endospores via coherent Raman spectroscopy. Proceedings of the National Academy of Sciences 105, 2 (2008), 422–427.
97. David Pfau and Oriol Vinyals. 2016. Connecting generative adversarial networks and actor-critic methods. arXiv preprint arXiv:1610.01945 (2016).
98. Guo-Jun Qi. 2017. Loss-sensitive generative adversarial networks on Lipschitz densities. arXiv preprint arXiv:1701.06264 (2017).
99. Svetlozar Todorov Rachev et al. 1990. Duality theorems for Kantorovich-Rubinstein and Wasserstein functionals. (1990).
100. Alec Radford, Luke Metz, and Soumith Chintala. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015).
101. Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 779–788.
102. Mihaela Rosca, Balaji Lakshminarayanan, David Warde-Farley, and Shakir Mohamed. 2017. Variational approaches for auto-encoding generative adversarial networks. arXiv preprint arXiv:1706.04987 (2017).
103. Murray Rosenblatt. 1956. A central limit theorem and a strong mixing condition. Proceedings of the National Academy of Sciences 42, 1 (1956), 43–47.
104. Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. 2016. Improved techniques for training GANs. In Advances in Neural Information Processing Systems. Curran Associates, 2234–2242.
105. Tim Salimans, Andrej Karpathy, Xi Chen, and Diederik P Kingma. 2017. Pixelcnn++: Improving the pixelcnn with discretized logistic mixture likelihood and other modifications. arXiv preprint arXiv:1701.05517 (2017).
106. Bernhard Schölkopf and Alexander J. Smola. 2002. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT press.
107. John Schulman, Sergey Levine, Pieter Abbeel, Michael Jordan, and Philipp Moritz. 2015. Trust region policy optimization. In Proceedings of the 32nd International Conference on Machine Learning (ICML-15). 1889–1897.
108. Jian Shen, Yanru Qu, Weinan Zhang, and Yong Yu. 2017. Adversarial representation learning for domain adaptation. arXiv preprint arXiv:1707.01217 (2017).
109. Haichao Shi, Jing Dong, Wei Wang, Yinlong Qian, and Xiaoyu Zhang. 2017. SSGAN: Secure steganography based on generative adversarial networks. arXiv preprint arXiv:1707.01613 (2017).
110. Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim. 2017. Continual learning with deep generative replay. In Advances in Neural Information Processing Systems. Curran Associates, 2990–2999.
111. Rui Shu, Hung H Bui, Hirokazu Narui, and Stefano Ermon. 2018. A DIRT-T approach to unsupervised domain adaptation. arXiv preprint arXiv:1802.08735 (2018).
112. Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
113. Paul Smolensky. 1986. Information Processing in Dynamical Systems: Foundations of Harmony Theory. Technical Report. Colorado University at Boulder, Department of Computer Science.
114. Yibing Song, Chao Ma, Xiaohe Wu, Lijun Gong, Linchao Bao, Wangmeng Zuo, Chunhua Shen, Rynson Lau, and Ming-Hsuan Yang. 2018. VITAL: VIsual tracking via adversarial learning. arXiv preprint arXiv:1804.04273 (2018).
115. Jost Tobias Springenberg. 2015. Unsupervised and semi-supervised learning with categorical generative adversarial networks. arXiv preprint arXiv:1511.06390 (2015).
116. Adrian Spurr, Emre Aksan, and Otmar Hilliges. 2017. Guiding InfoGAN with semi-supervision. arXiv preprint arXiv:1707.04487 (2017).
117. Bharath K. Sriperumbudur, Kenji Fukumizu, Arthur Gretton, Bernhard Schölkopf, and Gert RG Lanckriet. 2009. On integral probability metrics,\phi-divergences and binary classification. arXiv preprint arXiv:0901.2698 (2009).
118. Richard S. Sutton, David A. McAllester, Satinder P. Singh, and Yishay Mansour. 2000. Policy gradient methods for reinforcement learning with function approximation. In Advances in Neural Information Processing Systems. Curran Associates, 1057–1063.
119. Lucas Theis, Aäron van den Oord, and Matthias Bethge. 2015. A note on the evaluation of generative models. arXiv preprint arXiv:1511.01844 (2015).
120. Alberto Torchinsky and Shilin Wang. 1990. A note on the Marcinkiewicz integral. In Colloquium Mathematicae, Vol. 1. 235–243.
121. Luan Tran, Xi Yin, and Xiaoming Liu. 2017. Representation learning by rotating your faces. arXiv preprint arXiv:1705.11136 (2017).
122. Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, and Jan Kautz. 2017. MocoGAN: Decomposing motion and content for video generation. arXiv preprint arXiv:1707.04993 (2017).
123. Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky. 2017. Adversarial generator-encoder networks. arXiv preprint arXiv:1704.02304 (2017).
124. Denis Volkhonskiy, Ivan Nazarov, Boris Borisenko, and Evgeny Burnaev. 2017. Steganographic generative adversarial networks. arXiv preprint arXiv:1703.05502 (2017).
125. Carl Vondrick, Hamed Pirsiavash, and Antonio Torralba. 2016. Generating videos with scene dynamics. In Advances In Neural Information Processing Systems. 613–621.
126. Jacob Walker, Kenneth Marino, Abhinav Gupta, and Martial Hebert. 2017. The pose knows: Video forecasting by generating pose futures. arXiv preprint arXiv:1705.00053 (2017).
127. Chaoyue Wang, Chang Xu, Chaohui Wang, and Dacheng Tao. 2018. Perceptual adversarial networks for image-to-image transformation. IEEE Transactions on Image Processing 27, 8 (2018), 4066–4079.
128. Ruohan Wang, Antoine Cully, Hyung Jin Chang, and Yiannis Demiris. 2017. MAGAN: Margin adaptation for generative adversarial networks. arXiv preprint arXiv:1704.03817 (2017).
129. Zhou Wang, Alan C. Bovik, Hamid R. Sheikh, and Eero P. Simoncelli. 2004. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (2004), 600–612.
130. Max Welling. 2005. Fisher linear discriminant analysis.Department of Computer Science, University of Toronto, 3, 1 (2005).
131. Edwin B. Wilson and Margaret M. Hilferty. 1931. The distribution of chi-square. Proceedings of the National Academy of Sciences 17, 12 (1931), 684–688.
132. Huikai Wu, Shuai Zheng, Junge Zhang, and Kaiqi Huang. 2017. GP-GAN: Towards realistic high-resolution image blending. arXiv preprint arXiv:1703.07195 (2017).
133. Jiajun Wu, Chengkai Zhang, Tianfan Xue, Bill Freeman, and Josh Tenenbaum. 2016. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. In Advances in Neural Information Processing Systems. Curran Associates, 82–90.
134. Yuan Xue, Tao Xu, Han Zhang, Rodney Long, and Xiaolei Huang. 2017. SegAN: Adversarial network with multi-scale L_1 loss for medical image segmentation. arXiv preprint arXiv:1706.01805 (2017).
135. Xinchen Yan, Jimei Yang, Kihyuk Sohn, and Honglak Lee. 2016. Attribute2image: Conditional image generation from visual attributes. In Proceedings of the European Conference on Computer Vision. Springer, 776–791.
136. Dong Yang, Tao Xiong, Daguang Xu, Qiangui Huang, David Liu, S. Kevin Zhou, Zhoubing Xu, JinHyeong Park, Mingqing Chen, Trac D. Tran, et al. 2017. Automatic vertebra labeling in large-scale 3D CT using deep image-to-image network with message passing and sparsity regularization. In Proceedings of the International Conference on Information Processing in Medical Imaging. Springer, 633–644.
137. Zili Yi, Hao Zhang, Ping Tan Gong, et al. 2017. DualGAN: Unsupervised dual learning for image-to-image translation. arXiv preprint arXiv:1704.02510 (2017).
138. Weidong Yin, Yanwei Fu, Leonid Sigal, and Xiangyang Xue. 2017. Semi-latent GAN: Learning to generate and modify facial images from attributes. arXiv preprint arXiv:1704.02166 (2017).
139. Jaeyoon Yoo, Heonseok Ha, Jihun Yi, Jongha Ryu, Chanju Kim, Jung-Woo Ha, Young-Han Kim, and Sungroh Yoon. 2017. Energy-based sequence GANs for recommendation and their connection to imitation learning. arXiv preprint arXiv:1706.09200 (2017).
140. Jaeyoon Yoo, Yongjun Hong, and Sungroh Yoon. 2017. Autonomous UAV navigation with domain adaptation. arXiv preprint arXiv:1712.03742 (2017).
141. Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. 2017. SeqGAN: Sequence generative adversarial nets with policy gradient. In AAAI. 2852–2858.
142. Han Zhang, Tao Xu, Hongsheng Li, Shaoting Zhang, Xiaolei Huang, Xiaogang Wang, and Dimitris Metaxas. 2016. Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks. arXiv preprint arXiv:1612.03242 (2016).
143. Junbo Zhao, Michael Mathieu, and Yann LeCun. 2016. Energy-based generative adversarial network. arXiv preprint arXiv:1609.03126 (2016).
144. Shuchang Zhou, Taihong Xiao, Yi Yang, Dieqiao Feng, Qinyao He, and Weiran He. 2017. GeneGAN: Learning object transfiguration and attribute subspace from unpaired data. arXiv preprint arXiv:1705.04932 (2017).
145. Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A. Efros. 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. arXiv preprint arXiv:1703.10593 (2017).
146. Brian D. Ziebart, Andrew L. Maas, J. Andrew Bagnell, and Anind K. Dey. 2008. Maximum entropy inverse reinforcement learning. In AAAI, Vol. 8. Chicago, IL, 1433–1438.