Multi-content GAN for Few-Shot Font Style Transfer

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 7564-7573

  Azadi, Samaneh ^a   Fisher, Matthew ^b   Kim, Vladimir ^b   Wang, Zhaowen ^b   Shechtman, Eli ^b   Darrell, Trevor ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION;

COLOR GRADIENTS; DATA SET; END TO END; INFOGRAPHICS; NETWORK TRANSFERS; PARTIAL OBSERVATION; REAL-WORLD;

NETWORK LAYERS;

EID: 85062864157     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00789     Document Type: Conference Paper

References (38)

1. S. Baluja. Learning typographic style. ArXiv preprint arXiv: 1603. 04000, 2016. 1, 2
2. N. D. Campbell and J. Kautz. Learning a manifold of fonts. ACM Transactions on Graphics (TOG), 33 (4): 91, 2014. 1, 2
3. J. Chang and Y. Gu. Chinese typography transfer. ArXiv preprint arXiv: 1707. 04904, 2017. 1, 2
4. M. Chen, L. Denoyer, and T. Artières. Multi-view data generation without view supervision. ArXiv preprint arXiv: 1711. 00305, 2017. 2
5. A. Dai, C. R. Qi, and M. Nießner. Shape completion using 3dencoder-predictor cnns and shape synthesis. Proc. Computer Vision and Pattern Recognition (CVPR), IEEE, 2017. 2
6. J. Flynn, I. Neulander, J. Philbin, and N. Snavely. Deepstereo: Learning to predict new views from the world's imagery. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. 2
7. L. A. Gatys, A. S. Ecker, and M. Bethge. Image style transfer using convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2414-2423, 2016. 2
8. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in neural information processing systems, pages 2672-2680, 2014. 2
9. H. Huang, E. Kalogerakis, and B. Marlin. Analysis and synthesis of 3d shape families via deep-learned generative models of surfaces. Computer Graphics Forum, 34 (5), 2015. 2
10. X. Huang and S. Belongie. Arbitrary style transfer in realtime with adaptive instance normalization. ArXiv preprint arXiv: 1703. 06868, 2017. 2
11. P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. Image-to-image translation with conditional adversarial networks. ArXiv preprint arXiv: 1611. 07004, 2016. 1, 2, 3, 4, 5
12. J. Johnson, A. Alahi, and L. Fei-Fei. Perceptual losses for real-time style transfer and super-resolution. In European Conference on Computer Vision, pages 694-711. Springer, 2016. 2, 3
13. N. K. Kalantari, T.-C. Wang, and R. Ramamoorthi. Learningbased view synthesis for light field cameras. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2016), 35 (6), 2016. 2
14. E. Kalogerakis, S. Chaudhuri, D. Koller, and V. Koltun. A Probabilistic Model of Component-Based Shape Synthesis. ACM Transactions on Graphics, 31 (4), 2012. 2
15. T. D. Kulkarni, W. F. Whitney, P. Kohli, and J. Tenenbaum. Deep convolutional inverse graphics network. In Advances in Neural Information Processing Systems, pages 2539-2547, 2015. 2
16. C. Li and M. Wand. Combining Markov random fields and convolutional neural networks for image synthesis. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2479-2486, 2016. 2
17. C. Li and M. Wand. Precomputed real-time texture synthesis with Markovian generative adversarial networks. In European Conference on Computer Vision, pages 702-716. Springer, 2016. 2
18. Y. Li, C. Fang, J. Yang, Z. Wang, X. Lu, and M.-H. Yang. Universal style transfer via feature transforms. ArXiv preprint arXiv: 1705. 08086, 2017. 2
19. Z. Lian, B. Zhao, and J. Xiao. Automatic generation of largescale handwriting fonts via style learning. In SIGGRAPH ASIA 2016 Technical Briefs, page 12. ACM, 2016. 2
20. J. Liao, Y. Yao, L. Yuan, G. Hua, and S. B. Kang. Visual attribute transfer through deep image analogy. ArXiv preprint arXiv: 1705. 01088, 2017. 2
21. Z. Lun, E. Kalogerakis, R. Wang, and A. Sheffer. Functionality preserving shape style transfer. ACM Transactions on Graphics, 35 (6), 2016. 2
22. P. Lyu, X. Bai, C. Yao, Z. Zhu, T. Huang, and W. Liu. Autoencoder guided GAN for Chinese calligraphy synthesis. ArXiv preprint arXiv: 1706. 08789, 2017. 1, 2
23. X. Mao, Q. Li, H. Xie, R. Y. Lau, Z. Wang, and S. P. Smolley. Least squares generative adversarial networks. ArXiv preprint ArXiv: 1611. 04076, 2016. 4
24. M. Mirza and S. Osindero. Conditional generative adversarial nets. ArXiv preprint arXiv: 1411. 1784, 2014. 3
25. E. Park, J. Yang, E. Yumer, D. Ceylan, and A. C. Berg. Transformation-grounded image generation network for novel 3D view synthesis. ArXiv preprint arXiv: 1703. 02921, 2017. 2
26. D. Pathak, P. Krähenbühl, J. Donahue, T. Darrell, and A. Efros. Context encoders: Feature learning by inpainting. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. 2
27. H. Q. Phan, H. Fu, and A. B. Chan. Flexyfont: Learning transferring rules for flexible typeface synthesis. In Computer Graphics Forum, volume 34, pages 245-256. Wiley Online Library, 2015. 1, 2
28. M. Sung, V. G. Kim, R. Angst, and L. Guibas. Data-driven structural priors for shape completion. Transactions on Graphics (Proc. of SIGGRAPH Asia), 2015. 2
29. R. Suveeranont and T. Igarashi. Example-based automatic font generation. In Smart Graphics, pages 127-138. Springer, 2010. 1, 2
30. J. B. Tenenbaum andW. T. Freeman. Separating style and content. In Advances in neural information processing systems, pages 662-668, 1997. 2
31. L. Tran, X. Yin, and X. Liu. Disentangled representation learning gan for pose-invariant face recognition. In CVPR, volume 4, page 7, 2017. 2
32. D. Ulyanov, A. Vedaldi, and V. Lempitsky. Deep image prior. ArXiv preprint arXiv: 1711. 10925, 2017. 2
33. P. Upchurch, N. Snavely, and K. Bala. From A to Z: Supervised transfer of style and content using deep neural network generators. ArXiv preprint arXiv: 1603. 02003, 2016. 1, 2
34. S. Yang, J. Liu, Z. Lian, and Z. Guo. Awesome typography: Statistics-based text effects transfer. ArXiv preprint arXiv: 1611. 09026, 2016. 1, 2, 5, 6, 8
35. B. Zhao, X. Wu, Z.-Q. Cheng, H. Liu, and J. Feng. Multiview image generation from a single-view. ArXiv preprint arXiv: 1704. 04886, 2017. 2
36. B. Zhou, W. Wang, and Z. Chen. Easy generation of personal Chinese handwritten fonts. In Multimedia and Expo (ICME), 2011 IEEE International Conference on, pages 1-6. IEEE, 2011. 2
37. T. Zhou, S. Tulsiani, W. Sun, J. Malik, and A. A. Efros. View synthesis by appearance flow. In European Conference on Computer Vision, pages 286-301. Springer, 2016. 2
38. J.-Y. Zhu, T. Park, P. Isola, and A. A. Efros. Unpaired imageto-image translation using cycle-consistent adversarial networks. ArXiv preprint arXiv: 1703. 10593, 2017. 4