On the Effectiveness of Least Squares Generative Adversarial Networks

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 41, Issue 12, 2019, Pages 2947-2960

  Mao, Xudong ^a   Li, Qing ^a   Xie, Haoran ^b   Lau, Raymond Y K ^a   Wang, Zhen ^c   Smolley, Stephen Paul ^d  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^b THE EDUCATION UNIVERSITY OF HONG KONG   (Hong Kong)

^c NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^d CodeHatch Corp ^*  (Canada)

Author keywords

generative model; image generation; Least squares GANs; 2 divergence

Indexed keywords

GALLIUM NITRIDE; GAS GENERATORS; III-V SEMICONDUCTORS; JOB ANALYSIS; LEARNING SYSTEMS; PERSONNEL TRAINING;

ADVERSARIAL NETWORKS; GENERATIVE MODEL; IMAGE GENERATIONS; LEAST SQUARE; STABILITY ANALYSIS; TASK ANALYSIS; X2 DIVERGENCE;

LINEAR PROGRAMMING;

ARTICLE; IMAGE QUALITY; LEARNING; LEAST SQUARE ANALYSIS; LOSS OF FUNCTION MUTATION; PUNISHMENT; QUANTITATIVE ANALYSIS;

EID: 85054646594     PISSN: 01628828     EISSN: 19393539     Source Type: Journal    
DOI: 10.1109/TPAMI.2018.2872043     Document Type: Article

References (48)

1. K. He, X. Zhang, S. Ren, J. Sun, "Deep residual learning for image recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 770-778.
2. S. Ren, K. He, R. Girshick, J. Sun, "Faster r-CNN: Towards real-time object detection with region proposal networks, " in Proc. Advances Neural Inf. Process. Syst., 2015, vol. 28, pp. 91-99.
3. J. Long, E. Shelhamer, T. Darrell, "Fully convolutional networks for semantic segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 3431-3440.
4. G. Hinton and R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Sci., vol. 313, no. 5786, pp. 504-507, 2006.
5. R. Salakhutdinov and G. Hinton, "Deep Boltzmann machines, " in Proc. Int. Conf. Artif. Intell. Statist., vol. 5, 2009, pp. 448-455.
6. D. P. Kingma and M. Welling, "Auto-encoding variational bayes, " CoRR, vol. abs/1312.6114, 2013. [Online]. Available: Http://arxiv. org/abs/1312.6114.
7. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, Y. Bengio, "Generative adversarial nets, " in Proc. Advances Neural Inf. Process. Syst., 2014, pp. 2672-2680.
8. I. Goodfellow, Y. Bengio, A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016.
9. A. Nguyen, J. Yosinski, Y. Bengio, A. Dosovitskiy, J. Clune, "Plug & play generative networks: Conditional iterative generation of images in latent space, " in Proc. Comput. Vis. Pattern Recognit., 2017, pp. 4467-4477.
10. X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever, P. Abbeel, "Infogan: Interpretable representation learning by information maximizing generative adversarial nets, " in Proc. Advances Neural Inf. Process. Syst., 2016, pp. 2172-2180.
11. C. Ledig, L. Theis, F. Huszar, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, W. Shi, "Photo-realistic single image super-resolution using a generative adversarial network, " in Proc. Comput. Vis. Pattern Recognit., 2017, pp. 4681-4690.
12. T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford, X. Chen, X. Chen, "Improved techniques for training gans, " in Proc. Advances Neural Inf. Process. Syst., 2016, pp. 2226-2234.
13. A. Radford, L. Metz, S. Chintala, "Unsupervised representation learning with deep convolutional generative adversarial networks, " CoRR, vol. abs/1511.06434, 2015. [Online]. Available: Http://arxiv.org/abs/1511.06434.
14. L. Metz, B. Poole, D. Pfau, J. Sohl-Dickstein, "Unrolled generative adversarial networks, " CoRR, vol. abs/1611.02163, 2016. [Online]. Available: Http://arxiv.org/abs/1611.02163
15. M. Arjovsky, S. Chintala, L. Bottou, "Wasserstein gan, " in Proc. 33rd Int. Conf. Mach. Learn., 2017, pp. 214-223.
16. G.-J. Qi, "Loss-sensitive generative adversarial networks on lipschitz densities, " CoRR, vol. abs/1701.06264, 2017. [Online]. Available: Http://arxiv.org/abs/1701.06264
17. C. M. Bishop, Pattern Recognition and Machine Learning, Berlin, Germany: Springer, 2006.
18. N. Kodali, J. D. Abernethy, J. Hays, Z. Kira, "On convergence and stability of gans, " CoRR, vol. abs/1705.07215, 2017. [Online]. Available: Http://arxiv.org/abs/1705.07215
19. I. Gulrajani, F. Ahmed, M. Arjovsky, V. Dumoulin, A. Courville, "Improved training of wasserstein gans, " in Adv. Neural Inf. Process. Syst. (NIPS), 2017, pp. 5767-5777.
20. X. Mao, Q. Li, H. Xie, R. Y. Lau, Z. Wang, S. P. Smolley, "Least squares generative adversarial networks, " in Proc. Int. Conf. Comput. Vis., 2017, pp. 2813-2821.
21. G. W. Taylor, R. Fergus, Y. LeCun, C. Bregler, "Convolutional learning of spatio-temporal features, " in Proc. Eur. Conf. Comput. Vis., 2010, pp. 140-153.
22. G. E. Hinton and R. R. Salakhutdinov, "Replicated softmax: An undirected topic model, " in Proc. Advances Neural Inf. Process. Syst., 2009, pp. 1607-1614.
23. G. E. Hinton, S. Osindero, Y.-W. Teh, "A fast learning algorithm for deep belief nets, " Neural Comput., vol. 18, no. 7, pp. 1527-1554, Jul. 2006.
24. Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, V. Lempitsky, "Domain-adversarial training of neural networks, " J. Mach. Learn. Res., vol. 17, no. 1, pp. 2096-2030, 2016.
25. S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, H. Lee, "Generative adversarial text-to-image synthesis, " in Proc. 33rd Int. Conf. Mach. Learn., 2016, pp. 1060-1069.
26. P. Isola, J.-Y. Zhu, T. Zhou, A. A. Efros, "Image-to-image translation with conditional adversarial networks, " in Comput. Vis. Pattern Recognit., 2017, pp. 5967-5976.
27. M. Mirza and S. Osindero, "Conditional Generative Adversarial Nets, " CoRR, vol. abs/1411.1784, 2014. [Online]. Available: Http://arxiv.org/abs/1411.1784
28. J. Donahue, P. Krahenbuhl, T. Darrell, "Adversarial feature learning, " CoRR, vol. abs/1605.09782, 2016. [Online]. Available: Http://arxiv.org/abs/1605.09782.
29. V. Dumoulin, I. Belghazi, B. Poole, O. Mastropietro, A. Lamb, M. Arjovsky, A. Courville, "Adversarially learned inference, " CoRR, vol. abs/1606.00704, 2016. [Online]. Available: Http://arxiv.org/abs/1606.00704.
30. C. Li, H. Liu, C. Chen, Y. Pu, L. Chen, R. Henao, L. Carin, "Alice: Towards understanding adversarial learning for joint distribution matching, " in Adv. Neural Inf. Process. Syst. (NIPS), 2017, pp. 5495-5503.
31. E. Denton, S. Chintala, A. Szlam, R. Fergus, "Deep generative image models using a laplacian pyramid of adversarial networks, " in Proc. Advances Neural Inf. Process. Syst., 2015, pp. 1486-1494.
32. X. Huang, Y. Li, O. Poursaeed, J. Hopcroft, S. Belongie, "Stacked generative adversarial networks, " in Proc. Comput. Vis. Pattern Recognit., 2017, pp. 5077-5086.
33. T. Che, Y. Li, A. P. Jacob, Y. Bengio, W. Li, "Mode regularized generative adversarial networks, " CoRR, vol. abs/1612.02136, 2016. [Online]. Available: Http://arxiv.org/abs/1612.02136
34. S. Nowozin, B. Cseke, R. Tomioka, "f-GAN: Training generative neural samplers using variational divergence minimization, " in Proc. Adv. Neural Inf. Process. Syst., 2016, pp. 271-279.
35. J. Zhao, M. Mathieu, Y. LeCun, "Energy-based Generative Adversarial Network, " CoRR, vol. abs/1609.03126, 2016. [Online]. Available: Http://arxiv.org/abs/1609.03126
36. Z. Dai, A. Almahairi, P. Bachman, E. Hovy, A. Courville, "Calibrating energy-based generative adversarial networks, " CoRR, vol. abs/1702.01691, 2017. [Online]. Available: Http://arxiv.org/abs/1702.01691.
37. X. Nguyen, M. J. Wainwright, M. I. Jordan, "Estimating divergence functionals and the likelihood ratio by convex risk minimization, " IEEE Trans. Inform. Theory, vol. 56, no. 11, pp. 5847-5861, Nov. 2010.
38. L. Mescheder, S.Nowozin, A. Geiger, "The numerics ofGANs, " in Proc. Advances Neural Inf. Process. Syst., 2017, pp. 1825-1835.
39. K. Roth, A. Lucchi, S. Nowozin, T. Hofmann, "Stabilizing training of generative adversarial networks through regularization, " in Proc. Advances Neural Inf. Process. Syst., 2017, pp. 2018-2028.
40. W. Fedus, M. Rosca, B. Lakshminarayanan, A.M. Dai, S.Mohamed, I. Goodfellow, "Many paths to equilibrium: Gans do not need to decrease a divergence at every step, " in CoRR, vol. abs/1710.08446, 2017. [Online]. Available: Http://arxiv.org/abs/1710.08446
41. F. Husz_ar, "How (not) to train your generative model: Scheduled sampling, likelihood, adversary" CoRR, vol. abs/1511.05101, 2015. [Online]. Available: Http://arxiv.org/abs/1511.05101
42. A. B. Dieng, D. Tran, R. Ranganath, J. Paisley, D. M. Blei, "Variational inference via x upper bound minimization, " in Proc. Advances Neural Inf. Process. Syst., 2017, pp. 2732-2741.
43. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. J. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. J_ozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Man_e, R. Monga, S. Moore, D. G. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. A. Tucker, V. Vanhoucke, V. Vasudevan, F. B. Vi_egas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, X. Zheng, "TensorFlow: Large-scale machine learning on heterogeneous systems, " CoRR, vol. abs/1603.04467, 2016. [Online]. Available: Http://arxiv.org/abs/1603.04467
44. W. Zhang, J. Sun, X. Tang, "Cat head detection-how to effectively exploit shape and texture features, " in Proc. Eur. Conf. Comput. Vis., 2008, pp. 802-816.
45. M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, S. Hochreiter, "Gans trained by a two time-scale update rule converge to a local nash equilibrium, " in Proc. Advances Neural Inf. Process. Syst., 2017, pp. 6626-6637.
46. D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization, " CoRR, vol. abs/1412.6980, 2014. [Online]. Available: Http://arxiv.org/abs/1412.6980
47. T. Tieleman and G. Hinton, "Lecture 6.5|RMSProp: Divide the gradient by a running average of its recent magnitude, " COURSERA: Neural Netw. Mach. Learn., vol. 4, pp. 26-30, 2012.
48. Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, A. Y. Ng, "Reading digits in natural images with unsupervised feature learning, " in Proc. NIPS Workshop Deep Learn. Unsupervised Feature Learn., 2011.