DA-GAN: Instance-Level Image Translation by Deep Attention Generative Adversarial Networks

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 5657-5666

  Ma, Shuang ^a   Fu, Jianlong ^b   Chen, Chang Wen ^a,c   Mei, Tao ^b  

^a State University of New York   (United States)

^b MICROSOFT RESEARCH   (United States)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS;

ADVERSARIAL NETWORKS; BROAD APPLICATION; DATA AUGMENTATION; FALSE POSITIVE; IMAGE TRANSLATION; INDEPENDENT SET; SEMANTIC PARTS; STATE OF THE ART;

COMPUTER VISION;

EID: 85059735285     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00593     Document Type: Conference Paper

References (45)

1. M. Arjovsky, S. Chintala, and L. Bottou. Wasserstein generative adversarial networks. In Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017, pages 214-223, 2017.
2. Y. Aytar, L. Castrejon, C. Vondrick, H. Pirsiavash, and A. Torralba. Cross-modal scene networks. CoRR, abs/1610.09003, 2016.
3. K. Bousmalis, N. Silberman, D. Dohan, D. Erhan, and D. Krishnan. Unsupervised pixel-level domain adaptation with generative adversarial networks. CoRR, abs/1612.05424, 2016.
4. A. Brock, T. Lim, J. M. Ritchie, and N. Weston. Neural photo editing with introspective adversarial networks. CoRR, abs/1609.07093, 2016.
5. X. Chen, X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever, and P. Abbeel. Infogan: Interpretable representation learning by information maximizing generative adversarial nets. Pages 2172-2180, 2016.
6. B. Fernando, A. Habrard, M. Sebban, and T. Tuytelaars. Unsupervised visual domain adaptation using subspace alignment. In Proceedings of the 2013 IEEE International Conference on Computer Vision, ICCV '13, pages 2960-2967, Washington, DC, USA, 2013. IEEE Computer Society.
7. J. Fu, H. Zheng, and T. Mei. Look closer to see better: Recurrent attention convolutional neural network for fine-grained image recognition. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 4476-4484, 2017.
8. Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, and V. Lempitsky. Domainadversarial training of neural networks. J. Mach. Learn. Res., 17(1): 2096-3030, Jan. 2016.
9. L. A. Gatys, A. S. Ecker, and M. Bethge. Image style transfer using convolutional neural networks. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2414-2423, June 2016.
10. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D.Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 2672-2680. Curran Associates, Inc., 2014.
11. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D.Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. Pages 2672-2680, 2014.
12. I. J. Goodfellow, Y. Bulatov, J. Ibarz, S. Arnoud, and V. D. Shet. Multi-digit number recognition from street view imagery using deep convolutional neural networks. 2014.
13. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. June 2016.
14. P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. Image-To-image translation with conditional adversarial networks.
15. J. Johnson, A. Alahi, and F. Li. Perceptual losses for real-Time style transfer and super-resolution. CoRR, abs/1603.08155, 2016.
16. L. Karacan, Z. Akata, A. Erdem, and E. Erdem. Learning to generate images of outdoor scenes from attributes and semantic layouts. CoRR, abs/1612.00215, 2016.
17. T. Kim, M. Cha, H. Kim, J. K. Lee, and J. Kim. Learning to discover cross-domain relations with generative adversarial networks. 2017.
18. Y. LeCun and C. Cortes. MNIST handwritten digit database. 2010.
19. C. Ledig, L. Theis, F. Huszar, J. Caballero, A. P. Aitken, A. Tejani, J. Totz, Z. Wang, and W. Shi. Photo-realistic single image super-resolution using a generative adversarial network. 2017.
20. J. Liao, Y. Yao, L. Yuan, G. Hua, and S. B. Kang. Visual attribute transfer through deep image analogy. ACM Trans. Graph., 36(4): 120: 1-120: 15, 2017.
21. M. Liu, T. Breuel, and J. Kautz. Unsupervised image-Toimage translation networks. 2017.
22. L. Metz, B. Poole, D. Pfau, and J. Sohl-Dickstein. Unrolled generative adversarial networks. 2016.
23. H. Ng and S. Winkler. A data-driven approach to cleaning large face datasets. Pages 343-347, 2014.
24. A. Odena, C. Olah, and J. Shlens. Conditional image synthesis with auxiliary classifier GANs. In D. Precup and Y. W. Teh, editors, Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 2642-2651, International Convention Centre, Sydney, Australia, 06-11 Aug 2017. PMLR.
25. A. Radford, L. Metz, and S. Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. CoRR, abs/1511.06434, 2015.
26. S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee. Generative adversarial text to image synthesis. In Proceedings of the 33rd International Conference on International Conference on Machine Learning-Volume 48, ICML'16, pages 1060-1069. JMLR.org, 2016.
27. S. E. Reed, Z. Akata, S. Mohan, S. Tenka, B. Schiele, and H. Lee. Learning what and where to draw. In D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett, editors, Advances in Neural Information Processing Systems 29, pages 217-225. Curran Associates, Inc., 2016.
28. T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford, X. Chen, and X. Chen. Improved techniques for training gans. Pages 2234-2242, 2016.
29. T. Salimans, I. J. Goodfellow, W. Zaremba, V. Cheung, A. Radford, and X. Chen. Improved techniques for training gans. CoRR, abs/1606.03498, 2016.
30. P. Sangkloy, J. Lu, C. Fang, F. Yu, and J. Hays. Scribbler: Controlling deep image synthesis with sketch and color. CoRR, abs/1612.00835, 2016.
31. A. Shrivastava, T. Pfister, O. Tuzel, J. Susskind, W. Wang, and R. Webb. Learning from simulated and unsupervised images through adversarial training. 2017.
32. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. International conference on learning representations, 2015.
33. C. K. Sonderby, J. Caballero, L. Theis, W. Shi, and F. Huszár. Amortised MAP inference for image super-resolution. 2017.
34. Y. Taigman, A. Polyak, and L. Wolf. Unsupervised crossdomain image generation. 2017.
35. R. Tyleček and R. Šára. Spatial Pattern Templates for Recognition of Objects with Regular Structure, pages 364-374. Springer Berlin Heidelberg, Berlin, Heidelberg, 2013.
36. D. Ulyanov, V. Lebedev, A. Vedaldi, and V. S. Lempitsky. Texture networks: Feed-forward synthesis of textures and stylized images. CoRR, abs/1603.03417, 2016.
37. A. Van den Oord, N. Kalchbrenner, L. Espeholt, k. Kavukcuoglu, O. Vinyals, and A. Graves. Conditional image generation with pixelcnn decoders. Pages 4790-4798, 2016.
38. C. Wah, S. Branson, P. Welinder, P. Perona, and S. Belongie. The Caltech-UCSD Birds-200-2011 Dataset. Technical Report CNS-TR-2011-001, California Institute of Technology, 2011.
39. X. Wang and A. Gupta. Generative image modeling using style and structure adversarial networks. In ECCV, 2016.
40. X. Yan, J. Yang, K. Sohn, and H. Lee. Attribute2image: Conditional image generation from visual attributes. 2016.
41. J. Yang, A. Kannan, D. Batra, and D. Parikh. Lr-gan: Layered recursive generative adversarial networks for image generation. CoRR, abs/1703.01560, 2017.
42. Z. Yi, H. Zhang, P. Tan, and M. Gong. Dualgan: Unsupervised dual learning for image-To-image anslation. 2017.
43. H. Zhang, T. Xu, H. Li, S. Zhang, X. Huang, X. Wang, and D. N. Metaxas. Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks. 2017.
44. J. J. Zhao, M. Mathieu, and Y. LeCun. Energy-based generative adversarial network. CoRR, abs/1609.03126, 2016.
45. J. Zhu, T. Park, P. Isola, and A. A. Efros. Unpaired imageto-image translation using cycle-consistent adversarial networks.