CartoonGAN: Generative Adversarial Networks for Photo Cartoonization

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 9465-9474

  Chen, Yang ^a   Lai, Yu Kun ^b   Liu, Yong Jin ^a  

^a TSINGHUA UNIVERSITY   (China)

^b CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER GRAPHICS; SEMANTICS; TEXTURES;

ADVERSARIAL NETWORKS; CARTOON STYLIZATIONS; HIGH-LEVEL FEATURES; LEARNING-BASED METHODS; SEMANTIC CONTENT; SPARSE REGULARIZATIONS; STATE-OF-THE-ART METHODS; TEXTURE DESCRIPTOR;

COMPUTER VISION;

EID: 85059854610     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00986     Document Type: Conference Paper

References (38)

1. J. Bruna, P. Sprechmann, and Y. LeCun. Super-resolution with deep convolutional sufficient statistics. In International Conference on Learning Representations (ICLR), 2016.
2. J. Canny. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, (6): 679-698, 1986.
3. Y. Chen, Y.-K. Lai, and Y.-J. Liu. Transforming photos to comics using convolutional neural networks. In International Conference on Image Processing, 2017.
4. R. Collobert, K. Kavukcuoglu, and C. Farabet. Torch7: A MATLAB-like environment for machine learning. In NIPS Workshop on BigLearn, 2011.
5. V. Dumoulin, I. Belghazi, B. Poole, A. Lamb, M. Arjovsky, O. Mastropietro, and A. Courville. Adversarially learned inference. In International Conference on Learning Representations (ICLR), 2017.
6. L. Gatys, A. Ecker, and M. Bethge. Image style transfer using convolutional neural networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2414-2423, 2016.
7. L. A. Gatys, A. S. Ecker, and M. Bethge. Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks. ArXiv preprint arXiv: 1505. 07376, 12, 2015.
8. L. A. Gatys, A. S. Ecker, M. Bethge, A. Hertzmann, and E. Shechtman. Controlling perceptual factors in neural style transfer. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
9. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems 27, pages 2672-2680. 2014.
10. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770-778, 2016.
11. A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin. Image analogies. In ACM SIGGRAPH, pages 327-340, 1998.
12. S.-S. Huang, G.-X. Zhang, Y.-K. Lai, J. Kopf, D. Cohen-Or, and S.-M. Hu. Parametric meta-filter modeling from a single example pair. The Visual Computer, 30 (6-8): 673-684.
13. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International Conference on Machine Learning, pages 448-456, 2015.
14. P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. Image-toimage translation with conditional adversarial networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
15. J. Johnson, A. Alahi, and L. Fei-Fei. Perceptual losses for real-time style transfer and super-resolution. In European Conference on Computer Vision, pages 694-711, 2016.
16. L. Karacan, Z. Akata, A. Erdem, and E. Erdem. Learning to generate images of outdoor scenes from attributes and semantic layouts. ArXiv preprint arXiv: 1612. 00215, 2016.
17. A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, pages 1097-1105, 2012.
18. S. Lawrence, C. L. Giles, A. C. Tsoi, and A. D. Back. Face recognition: A convolutional neural-network approach. IEEE Transactions on Neural Networks, 8 (1): 98-113, 1997.
19. C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, et al. Photo-realistic single image super-resolution using a generative adversarial network. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
20. C. Li and M. Wand. Combining Markov random fields and convolutional neural networks for image synthesis. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2479-2486, 2016.
21. J. Liao, Y. Yao, L. Yuan, G. Hua, and S. B. Kang. Visual attribute transfer through deep image analogy. ACM Transactions on Graphics, 36 (4): 120, 2017.
22. R. R. Luque. The cel shading technique. Technical report, 2012.
23. A. L. Maas, A. Y. Hannun, and A. Y. Ng. Rectifier nonlinearities improve neural network acoustic models. In International Conference on Machine Learning, volume 30, 2013.
24. S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee. Generative adversarial text to image synthesis. In International Conference on Machine Learning, 2016.
25. P. L. Rosin and J. Collomosse. Image and Video-Based Artistic Stylisation. Springer, 2013.
26. P. L. Rosin and Y.-K. Lai. Non-photorealistic rendering of portraits. In Workshop on Computational Aesthetics, pages 159-170, 2015.
27. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al. Imagenet large scale visual recognition challenge. International Journal of Computer Vision, 115 (3): 211-252, 2015.
28. T. Saito and T. Takahashi. Comprehensible rendering of 3-D shapes. In ACM SIGGRAPH, volume 24, pages 197-206, 1990.
29. E. Simo-Serra, S. Iizuka, K. Sasaki, and H. Ishikawa. Learning to simplify: Fully convolutional neural networks for rough sketch cleanup. ACM Transactions on Graphics, 35 (4): 121, 2016.
30. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409. 1556, 2014.
31. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-9, 2015.
32. J. Wang, Y. Xu, H.-Y. Shum, and M. F. Cohen. Video tooning. ACM Transactions on Graphics, 23 (3): 574-583, 2004.
33. H. Winnemöller, S. C. Olsen, and B. Gooch. Real-time video abstraction. ACM Transactions on Graphics, 25 (3): 1221-1226, 2006.
34. J. Wu, C. Zhang, T. Xue, B. Freeman, and J. Tenenbaum. Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling. In Advances in Neural Information Processing Systems, pages 82-90, 2016.
35. L. Xu, C. Lu, Y. Xu, and J. Jia. Image smoothing via L0 gradient minimization. ACM Transactions on Graphics, 30 (6): 174, 2011.
36. M. Yang, S. Lin, P. Luo, L. Lin, and H. Chao. Semanticsdriven portrait cartoon stylization. In International Conference on Image Processing, 2010.
37. R. Yeh, C. Chen, T. Y. Lim, M. Hasegawa-Johnson, and M. N. Do. Semantic image inpainting with perceptual and contextual losses. ArXiv preprint arXiv: 1607. 07539, 2016.
38. J.-Y. Zhu, T. Park, P. Isola, and A. A. Efros. Unpaired imageto-image translation using cycle-consistent adversarial networks. In International Conference on Computer Vision, 2017.