Transforming photos to comics using convolutional neural networks

Proceedings - International Conference on Image Processing, ICIP

Volumn 2017-September, Issue , 2017, Pages 2010-2014

  Chen, Yang ^a   Lai, Yu Kun ^b   Liu, Yong Jin ^a  

^a TSINGHUA UNIVERSITY   (China)

^b CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Comics; Convolutional neural networks; Deep learning; Style transfer

Indexed keywords

COMPUTER VISION; DEEP NEURAL NETWORKS;

COMIC; CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; GRAY SCALE; GRAY-SCALE IMAGES; LOCAL MINIMUMS; OPTIMIZATION FRAMEWORK; STATE-OF-THE-ART METHODS; STYLE TRANSFER; SYNTHESISED;

CONVOLUTION;

EID: 85045293419     PISSN: 15224880     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIP.2017.8296634     Document Type: Conference Paper

References (20)

1. L. A. Gatys, A. S. Ecker, and M. Bethge, "Image style transfer using convolutional neural networks, " in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2414-2423.
2. C. Li and M. Wand, "Combining Markov random fields and convolutional neural networks for image synthesis, " in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2479-2486.
3. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Advances in neural information processing systems, 2012, pp. 1097-1105.
4. S. Lawrence, C. L. Giles, A. C. Tsoi, and A. D. Back, "Face recognition: A convolutional neural-network approach, " IEEE Transactions on Neural Networks, vol. 8, no. 1, pp. 98-113, 1997.
5. A. Hertzmann, "Painterly rendering with curved brush strokes of multiple sizes, " in ACM SIGGRAPH, 1998, pp. 453-460.
6. D. Mould, "A stained glass image filter, " in Eurographics Workshop on Rendering, 2003, pp. 20-25.
7. C.-K. Yang and H.-L. Yang, "Realization of Seurats pointillism via non-photorealistic rendering, " The Visual Computer, vol. 24, no. 5, pp. 303-322, 2008.
8. J. E. Kyprianidis and J. Döllner, "Image abstraction by structure adaptive filtering, " in EG UK Theory and Practice of Computer Graphics, 2008, pp. 51-58.
9. M. Zhao and S.-C. Zhu, "Sisley the abstract painter, " in International Symposium on Non-Photorealistic Animation and Rendering, 2010, pp. 99-107.
10. S.-H. Zhang, X.-Y. Li, S.-M. Hu, and R. R. Martin, "Online video stream abstraction and stylization, " IEEE Transactions on Multimedia, vol. 13, no. 6, pp. 1286-1294, 2011.
11. P. L. Rosin and Y.-K. Lai, "Artistic minimal rendering with lines and blocks, " Graphical Models, vol. 75, no. 4, pp. 208-229, 2013.
12. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " CoRR, vol. Abs/1409. 1556, 2014.
13. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei, "ImageNet large scale visual recognition challenge, " International Journal of Computer Vision, vol. 115, no. 3, pp. 211-252, 2015.
14. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding, " in ACM International Conference on Multimedia, 2014, pp. 675-678.
15. L. A. Gatys, A. S. Ecker, and M. Bethge, "Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks, " arXiv preprint arXiv: 1505. 07376, 2015.
16. R. H. Byrd, P. Lu, J. Nocedal, and C. Zhu, "A limited memory algorithm for bound constrained optimization, " SIAM Journal on Scientific Computing, vol. 16, no. 5, pp. 1190-1208, 1995.
17. C. Zhu, R. H. Byrd, P. Lu, and J. Nocedal, "Algorithm 778: L-BFGS-B: Fortran subroutines for largescale bound-constrained optimization, " ACM Transactions on Mathematical Software (TOMS), vol. 23, no. 4, pp. 550-560, 1997.
18. A. J. Champandard, "Semantic style transfer and turning two-bit doodles into fine artworks, " arXiv preprint arXiv: 1603. 01768, 2016.
19. L. A. Gatys, A. S. Ecker, M. Bethge, A. Hertzmann, and E. Shechtman, "Controlling perceptual factors in neural style transfer, " in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
20. T. Q. Chen and M. Schmidt, "Fast patch-based style transfer of arbitrary style, " in Advances in neural information processing systems, 2016.