Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 2479-2486

  Li, Chuan ^a   Wand, Michael ^a  

^a JOHANNES GUTENBERG UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; CONVOLUTION; IMAGE SEGMENTATION; MARKOV PROCESSES; NEURAL NETWORKS; PATTERN RECOGNITION;

ABSTRACT LEVELS; CONVOLUTIONAL NEURAL NETWORK; FEATURE PYRAMID; IMAGE SYNTHESIS; MARKOV RANDOM FIELD MODELS; MARKOV RANDOM FIELDS; PHOTO-REALISTIC; TEXTURE SYNTHESIS;

IMAGE PROCESSING;

EID: 84986290423     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.272     Document Type: Conference Paper

References (30)

1. A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M. Cohen. Interactive digital photomontage. ACM Trans. Graphics (Proc. Siggraph), 23(3):294-302, 2004.
2. C. Barnes, E. Shechtman, A. Finkelstein, and D. B. Goldman. Patchmatch: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph. (Proc. Siggraph), 28(3):24:1-24:11, 2009.
3. E. L. Denton, R. Fergus, A. Szlam, and S. Chintala. Deep generative image models using a laplacian pyramid of adversarial networks. In Advances in Neural Information Processing Systems (NIPS) 28, 2015.
4. C. Dong, C. C. Loy, K. He, and X. Tang. Image superresolution using deep convolutional networks, 2015. ArXiv preprint: http://arxiv.org/abs/1501.00092.
5. A. A. Efros and W. T. Freeman. Image quilting for texture synthesis and transfer. In Proc. ACM Siggraph, pages 341-346, 2001.
6. A. A. Efros and T. K. Leung. Texture synthesis by nonparametric sampling. In Proc. IEEE Int. Conf. Computer Vision (ICCV), Washington, DC, USA, 1999.
7. L. A. Gatys, A. S. Ecker, and M. Bethge. A neural algorithm of artistic style, 2015. ArXiv preprint; http://arxiv.org/abs/1508.06576.
8. L. A. Gatys, A. S. Ecker, and M. Bethge. Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS) 28, May 2015.
9. J. Gauthier. Conditional generative adversarial nets for convolutional face generation. http://www.foldl.me/2015/conditional-gans-face-generation/, 2015.
10. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D.Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS) 27, pages 2672-2680. 2014.
11. K. He and J. Sun. Statistics of patch offsets for image completion. In Proc. European Conference on Computer Vision (ECCV), pages 16-29, 2012.
12. A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin. Image analogies. In Proc. ACM Siggraph 2001, pages 327-340, 2001.
13. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS) 25, pages 1097-1105. 2012.
14. V. Kwatra, I. Essa, A. Bobick, and N. Kwatra. Texture optimization for example-based synthesis. ACM Trans. Graph. (Proc. Siggraph), 24(3):795-802, 2005.
15. V. Kwatra, A. Schödl, I. Essa, G. Turk, and A. Bobick. Graphcut textures: Image and video synthesis using graph cuts. ACM Trans. Graph. (Proc. Siggraph), 22(3):277-286, 2003.
16. H. Lee, S. Seo, S. Ryoo, and K. Yoon. Directional texture transfer. In Proc. Int. Symp. on Non-Photorealistic Animation and Rendering (NPAR), pages 43-48. ACM, 2010.
17. S. Lefebvre and H. Hoppe. Appearance-space texture synthesis. In SIGGRAPH, pages 541-548, 2006.
18. C. Li and M. Wand. Approximate translational building blocks for image decomposition and synthesis. In ACM Transactions on Graphics, 2015. to appear.
19. Y. Lu, S. Zhu, and Y. N. Wu. Learning FRAME models using CNN filters for knowledge visualization, 2015. ArXive preprint; http://arxiv.org/abs/1509.08379.
20. A. Mahendran and A. Vedaldi. Understanding deep image representations by inverting them. In IEEE Conf. on Comp. Vision and Pattern Recognition (CVPR), 2015.
21. A. Mordvintsev, C. Olah, and M. Tyka. Inceptionism: Going deeper into neural networks. http://googleresearch.blogspot. com/2015/06/inceptionism-going-deeper-into-neural.html, 2015.
22. J. Portilla and E. P. Simoncelli. A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vision, 40(1):49-70, Oct. 2000.
23. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. Int. J. Computer Vision (IJCV), pages 1-42, April 2015.
24. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. 2014. Preprint; http://arxiv.org/abs/1409.1556.
25. L. Theis and M. Bethge. Generative image modeling using spatial lstms. In Advances in Neural Information Processing Systems (NIPS) 28, Jun 2015.
26. L.-Y. Wei and M. Levoy. Fast texture synthesis using treestructured vector quantization. In Proc. ACM Siggraph 2000, pages 479-488, 2000.
27. X. Xie, F. Tian, and H. S. Seah. Feature guided texture synthesis (fgts) for artistic style transfer. In Proc. Int. Conf. Digital Interactive Media in Entertainment and Arts (DIMEA), pages 44-49. ACM, 2007.
28. L. Xu, J. S. Ren, C. Liu, and J. Jia. Deep convolutional neural network for image deconvolution. In Advances in Neural Information Processing Systems (NIPS) 27, pages 1790-1798. 2014.
29. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In Proc. Europ. Conf. Comp. Vision (ECCV), pages 818-833, 2014.
30. Y. Zhang, J. Xiao, J. Hays, and P. Tan. Framebreak: Dramatic image extrapolation by guided shift-maps. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1171-1178, 2013.