Eye In-painting with Exemplar Generative Adversarial Networks

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 7902-7911

  Dolhansky, Brian ^a   Ferrer, Cristian Canton ^a  

^a FACEBOOK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SCIENCE; COMPUTERS; ELECTRICAL ENGINEERING; PATTERN RECOGNITION; SOFTWARE ENGINEERING;

ADVERSARIAL NETWORKS; BENCHMARK DATASETS; HIGH QUALITY; INPAINTING; MULTIPLE POINTS; PHOTO-REALISTIC; REFERENCE IMAGE;

COMPUTER VISION;

EID: 85058233264     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00824     Document Type: Conference Paper

References (44)

1. Adobe Systems Inc. Adobe Photoshop Elements 2018. 2
2. A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M. Cohen. Interactive digital photomontage. ACM Transactions on Graphics, 23 (3): 294-302, 2004. 2
3. M. Arjovsky, S. Chintala, and L. Bottou. Wasserstein GAN. ArXiv e-prints, Jan. 2017. 5
4. C. Barnes, E. Shechtman, A. Finkelstein, and D. B. Goldman. Patchmatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics, 28 (3): 1-11, July 2009. 2
5. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester. Image inpainting. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pages 417-424, 2000. 2
6. M. Bertalmio, L. Vese, G. Sapiro, and S. Osher. Simultaneous structure and texture image inpainting. IEEE Transactions on Image Processing, 12 (8): 882-889, Aug 2003. 2
7. M. Brand and P. Pletscher. A conditional random field for automatic photo editing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2008. 1
8. D.-A. Clevert, T. Unterthiner, and S. Hochreiter. Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). ArXiv e-prints, Nov. 2015. 4
9. A. Criminisi, P. Perez, and K. Toyama. Object removal by exemplar-based inpainting. In Proceedins of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), volume 2, pages 721-728, June 2003. 2
10. A. Criminisi, P. Perez, and K. Toyama. Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing, 13 (9): 1200-1212, Sept 2004. 2
11. Y. Ganin, D. Kononenko, D. Sungatullina, and V. Lempitsky. DeepWarp: Photorealistic image resynthesis for gaze manipulation. 2016. 2
12. J. Gauthier. Conditional generative adversarial nets for convolutional face generation. Class Project for Stanford CS231N: Convolutional Neural Networks for Visual Recognition, Winter semester, 2014. 3
13. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS), pages 2672-2680. 2014. 1, 2, 3
14. D. Guo and T. Sim. Digital face makeup by example. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009. 1
15. T. Hassner, S. Harel, E. Paz, and R. Enbar. Effective face frontalization in unconstrained images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 4295-4304, June 2015. 2
16. M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. ArXiv e-prints, June 2017. 6
17. R. Huang, S. Zhang, T. Li, and R. He. Beyond face rotation: Global and local perception gan for photorealistic and identity preserving frontal view synthesis. In Proceedings of the International Conference on Computer Vision (ICCV), 2017. 3
18. S. Iizuka, E. Simo-Serra, and H. Ishikawa. Globally and locally consistent image completion. ACM Transactions on Graphics, 36 (4), July 2017. 1, 4, 5
19. T. Karras, T. Aila, S. Laine, and J. Lehtinen. Progressive Growing of GANs for Improved Quality, Stability, and Variation. In arXiv: 1710. 10196, 2017. 1
20. D. P. Kingma and J. Ba. Adam: A Method for Stochastic Optimization. ArXiv e-prints, Dec. 2014. 2, 5
21. G. Lample, N. Zeghidour, N. Usunier, A. Bordes, L. Denoyer, and M. Ranzato. Fader Networks: Manipulating Images by Sliding Attributes. ArXiv e-prints, June 2017. 2
22. C. Ledig, L. Theis, F. Huszar, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, and W. Shi. Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. 2016. 6
23. T. Leyvand, D. Cohen-Or, G. Dror, and D. Lischinski. Digital Face Beautification. In Proc. of ACM SIGGRAPH, 2006. 1
24. Y. Li, S. Liu, J. Yang, and M.-H. Yang. Generative face completion. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017. 2
25. Z. Liu, P. Luo, X. Wang, and X. Tang. Deep Learning Face Attributes in the Wild. In Proceedings of International Conference on Computer Vision (ICCV), 2015. 5
26. M. Mirza and S. Osindero. Conditional Generative Adversarial Nets. pages 1-7, 2014. 2, 3
27. M. Mori, K. F. MacDorman, and T. Minato. The Uncanny Valley. Energy, 7 (4): 33-35, 1970. 1
28. A. Nech and I. Kemelmacher-Shlizerman. Level Playing Field For Million Scale Face Recognition. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017. 5
29. D. Pathak, P. Krahenbuhl, J. Donahue, T. Darrell, and A. A. Efros. Context Encoders: Feature Learning by Inpainting. 2016. 2
30. P. Pérez, M. Gangnet, and A. Blake. Poisson Image Editing. ACM Transactions on Graphics, 22 (3): 313, 2003. 2
31. C. Sagonas, Y. Panagakis, S. Zafeiriou, and M. Pantic. Robust Statistical Face Frontalization. Proc. of the IEEE International Conference on Computer Vision (ICCV), 2015: 3871-3879, 2015. 1
32. T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford, and X. Chen. Improved Techniques for Training GANs. In arXiv: 1606. 03498, pages 1-10, 2016. 4, 6
33. P. Sinha, B. Balas, Y. Ostrovsky, and R. Russell. Face Recognition by Humans: Nineteen Results all Computer Vision Researchers Should Know About. Proceedings of the IEEE, 94 (11): 1948-1961, 2006. 1
34. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich, C. Hill, and A. Arbor. Going Deeper with Convolutions. In arXiv: 1409. 4842, 2014. 6
35. D. Vlasic, M. Brand, H. Pfister, and J. Popovíc. Face Transfer with Multilinear Models. ACM SIGGRAPH 2005, page 426, 2005. 1
36. Z. Wang, E. P. Simoncelli, and A. C. Bovik. Multi-scale Structural Similarity for Image Quality Assessment. IEEE Asilomar Conference on Signals, Systems and Computers, 2: 9-13, 2003. 6
37. L. Wolf, Z. Freund, and S. Avidan. 2
38. C. Yang, X. Lu, Z. Lin, E. Shechtman, O. Wang, and H. Li. High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesis. In arXiv: 1611. 09969. 2
39. F. Yang, J. Wang, E. Shechtman, L. Bourdev, and D. Metaxas. Expression Flow for 3D-aware Face Component Transfer. ACM Transactions on Graphics, 30 (4): 1, 2011. 1
40. R. A. Yeh, C. Chen, T. Y. Lim, A. G. Schwing, M. Hasegawa-Johnson, and M. N. Do. Semantic Image Inpainting with Deep Generative Models. In arXiv: 1607. 07539, 2016. 2
41. S. Yoo and R. H. Park. Red-eye detection and correction using inpainting in digital photographs. IEEE Transactions on Consumer Electronics, 2009. 1
42. K. Yoshida and C. Huang. Evaluation of Image Completion Algorithms : Deep Convolutional Generative Adversarial Nets vs. Exemplar-Based Inpainting. 2
43. Z. Zhu, P. Luo, X. Wang, and X. Tang. Deep Learning Identity-preserving Face Space. Proc. IEEE International Conference on Computer Vision (ICCV), 2013. 3
44. Z. Zhu, P. Luo, X. Wang, and X. Tang. Multi-View Perceptron : A Deep Model for Learning Face Identity and View Representations. Advances in Neural Information Processing Systems, 2014. 3