Controlling perceptual factors in neural style transfer

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 3730-3738

  Gatys, Leon A ^a   Ecker, Alexander S ^a   Bethge, Matthias ^a   Hertzmann, Aaron ^b   Shechtman, Eli ^b  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b ADOBE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION;

COLOUR INFORMATIONS; CONTROL MEASURES; HIGH RESOLUTION; IMAGE MANIPULATION; MULTIPLE SOURCE; PERCEPTUAL FACTORS; SPATIAL LOCATION; SPATIAL SCALE;

PATTERN RECOGNITION;

EID: 85035227078     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.397     Document Type: Conference Paper

References (27)

1. L. Benedetti, Winnemöller, M. H., Corsini, and R. Scopigno. Painting with bob: Assisted creativity for novices. In Proc. UIST, 2014.
2. A. J. Champandard. Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks. arXiv:1603.01768 [cs], Mar. 2016. arXiv: 1603.01768.
3. V. Dumoulin, J. Shlens, and M. Kudlur. A learned representation for artistic style. In Proc. ICLR, 2017.
4. A. A. Efros and T. K. Leung. Texture synthesis by nonparametric sampling. In Proc. ICCV, 1999.
5. H. S. Faridul, T. Pouli, C. Chamaret, J. Stauder, E. Reinhard, D. Kuzovkin, and A. Tremeau. Colour mapping: A review of recent methods, extensions and applications. Computer Graphics Forum, 35(1):59-88, 2016.
6. J. Fišer, O. Jamriška, M. LukÁč, E. Shechtman, P. Asente, J. Lu, and D. Sýkora. Stylit: Illumination-guided examplebased stylization of 3d renderings. ACM Trans. Graph., 35(4), July 2016.
7. L. A. Gatys, A. S. Ecker, and M. Bethge. Texture Synthesis Using Convolutional Neural Networks. In Advances in Neural Information Processing Systems 28, 2015.
8. L. A. Gatys, A. S. Ecker, and M. Bethge. Image Style Transfer Using Convolutional Neural Networks. In Proc. CVPR, 2016.
9. C. Han, E. Risser, R. Ramamoorthi, and E. Grinspun. Multiscale texture synthesis. ACM TOG, 27(3):51:1-51:8, 2008.
10. D. J. Heeger and J. R. Bergen. Pyramid-based Texture Analysis/Synthesis. In Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '95, pages 229-238, New York, NY, USA, 1995. ACM.
11. A. Hertzmann. Algorithms for Rendering in Artistic Styles. PhD thesis, New York University, 2001.
12. A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin. Image Analogies. In Proc. SIGGRAPH, 2001.
13. J. Johnson, A. Alahi, and L. Fei-Fei. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In B. Leibe, J. Matas, N. Sebe, and M. Welling, editors, Computer Vision-ECCV 2016, number 9906 in Lecture Notes in Computer Science, pages 694-711. Springer International Publishing, Oct. 2016. DOI: 10.1007/978-3-319-46475-643.
14. B. Julesz. Visual Pattern Discrimination. IRE Transactions on Information Theory, 8(2), Feb. 1962.
15. R. D. Kalnins, L. Markosian, B. J. Meier, M. A. Kowalski, J. C. Lee, P. L. Davidson, M. Webb, J. F. Hughes, and A. Finkelstein. Wysiwyg npr: Drawing strokes directly on 3d models. ACM Trans. Graph., 21(3), July 2002.
16. C. Li and M. Wand. Combining markov random fields and convolutional neural networks for image synthesis. In Proc. CVPR, 2016.
17. C. Li and M. Wand. Precomputed real-time texture synthesis with markovian generative adversarial networks. In Proc. ECCV, 2016.
18. P. O'Donovan and A. Hertzmann. Anipaint: Interactive painterly animation from video. IEEE TVCG, 18(3), 2012.
19. J. Portilla and E. P. Simoncelli. A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients. International Journal of Computer Vision, 40(1):49-70, Oct. 2000.
20. G. Ramanarayanan and K. Bala. Constrained texture synthesis via energy minimization. IEEE TVCG, 2007.
21. X. Shen, A. Hertzmann, J. Jia, S. Paris, B. Price, E. Shechtman, and I. Sachs. Automatic portrait segmentation for image stylization. Computer Graphics Forum, 35(2):93-102, 2016.
22. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In Proc. ICLR, 2015.
23. D. Ulyanov, V. Lebedev, A. Vedaldi, and V. Lempitsky. Texture Networks: Feed-forward Synthesis of Textures and Stylized Images. arXiv:1603.03417 [cs], Mar. 2016. arXiv: 1603.03417.
24. D. Ulyanov, A. Vedaldi, and V. Lempitsky. Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv:1607.08022 [cs], July 2016. arXiv: 1607.08022.
25. B. Wandell. Foundations of Vision. Sinauer Associates Inc., 1995.
26. L.-Y. Wei and M. Levoy. Fast texture synthesis using treestructured vector quantization. In Proc. SIGGRAPH, 2000.
27. P. Wilmot, E. Risser, and C. Barnes. Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses. arXiv preprint arXiv:1701.08893, 2017.