GAGAN: Geometry-Aware Generative Adversarial Networks

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 878-887

  Kossaifi, Jean ^a   Tran, Linh ^a   Panagakis, Yannis ^a,b   Pantic, Maja ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b MIDDLESEX UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; GEOMETRY; IMAGE ENHANCEMENT; MATHEMATICAL TRANSFORMATIONS; TEXTURES;

ADVERSARIAL NETWORKS; CANONICAL COORDINATES; FACIAL EXPRESSIONS; GEOMETRIC INFORMATION; GEOMETRIC TRANSFORMATIONS; IMAGE GENERATIONS; PROBABILITY SPACES; STATISTICAL SHAPE MODEL;

IMAGE TEXTURE;

EID: 85062825624     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00098     Document Type: Conference Paper

References (50)

1. E. Antonakos, J. Alabort-i-Medina, G. Tzimiropoulos, and S. Zafeiriou. Feature-based lucas-kanade and active appearance models. IEEE Transactions on Image Processing (TIP), 24(9):2617-2632, 2015.
2. M. Arjovsky, S. Chintala, and L. Bottou. Wasserstein gan. arXiv preprint arXiv:1701.07875, 2017.
3. P. N. Belhumeur, D. W. Jacobs, D. J. Kriegman, and N. Kumar. Localizing parts of faces using a consensus of exemplars. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 545-552, June 2011.
4. D. Berthelot, T. Schumm, and L. Metz. Began: Boundary equilibrium generative adversarial networks. arXiv preprint arXiv:1703.10717, 2017.
5. A. Bulat and G. Tzimiropoulos. How far are we from solving the 2d &3d face alignment problem? (and a dataset of 230,000 3d facial landmarks). In IEEE International Conference on Computer Vision. 2, 6, 7
6. X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever, and P. Abbeel. Infogan: Interpretable representation learning by information maximizing generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS), pages 2172-2180, 2016.
7. T. Cootes, C. Taylor, D. Cooper, and J. Graham. Active shape models-their training and application. Computer Vision and Image Understanding, 61(1):38-59, 1995.
8. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. In IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), volume 23, pages 681-685, 2001.
9. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), volume 1, pages 886-893, June 2005.
10. R. Davies, C. Twining, and C. Taylor. Statistical Models of Shape: Optimisation and Evaluation. Springer Publishing Company, Incorporated, 1 edition, 2008.
11. C. Donahue, Z. C. Lipton, A. Balsubramani, and J. McAuley. Semantically decomposing the latent spaces of generative adversarial networks. arXiv preprint arXiv:1705.07904, 2017.
12. G. J. Edwards, C. J. Taylor, and T. F. Cootes. Interpreting face images using active appearance models. In IEEE International Conference on Automatic Face and Gesture Recognition (FG), pages 300-305, 1998.
13. J. B. F. Zhou and Z. Lin. Exemplar-based graph matching for robust facial landmark localization. In IEEE International Conference on Computer Vision (ICCV), pages 1025-1032, 2013.
14. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D.Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in neural information processing systems (NIPS), pages 2672-2680, 2014.
15. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker. Multi-pie. Image and Vision Computing (IVC), 28(5):807-813, 2010.
16. P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. Imageto-image translation with conditional adversarial networks. arXiv preprint arXiv:1611.07004, 2016.
17. J. Johnson, A. Alahi, and L. Fei-Fei. Perceptual losses for real-time style transfer and super-resolution. In European Conference on Computer Vision (ECCV), pages 694-711. Springer, 2016.
18. D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2014.
19. J. Kossaifi, G. Tzimiropoulos, and M. Pantic. Fast newton active appearance models. In IEEE International Conference on Image Processing (ICIP), pages 1420-1424, Paris, France, October 2014.
20. J. Kossaifi, G. Tzimiropoulos, and M. Pantic. Fast and exact bi-directional fitting of active appearance models. In IEEE International Conference on Image Processing (ICIP), pages 1135-1139, Quebec City, QC, Canada, September 2015.
21. J. Kossaifi, G. Tzimiropoulos, and M. Pantic. Fast and exact newton and bidirectional fitting of active appearance models. IEEE Transactions on Image Processing (TIP), 26(2):1040-1053, Feb 2017.
22. J. Kossaifi, G. Tzimiropoulos, S. Todorovic, and M. Pantic. Afew-va database for valence and arousal estimation in-thewild. Image and Vision Computing, 65(Supplement C):23-36, 2017. Image and Vision Computing (IVC), Multimodal Sentiment Analysis and Mining in the Wild. 6
23. C. Ledig, L. Theis, F. Huszar, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, et al. Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint arXiv:1609.04802, 2016.
24. Z. Liu, P. Luo, X. Wang, and X. Tang. Deep learning face attributes in the wild. In IEEE International Conference on Computer Vision (ICCV), 2015.
25. D. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (IJCV), 60(2):91-110, 2004.
26. M. F. Mathieu, J. J. Zhao, J. Zhao, A. Ramesh, P. Sprechmann, and Y. LeCun. Disentangling factors of variation in deep representation using adversarial training. In Advances in Neural Information Processing Systems (NIPS), pages 5040-5048, 2016.
27. I. Matthews and S. Baker. Active appearance models revisited. International Journal of Computer Vision (IJCV), 60(2):135-164, Nov 2004.
28. M. Mirza and S. Osindero. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784, 2014.
29. A. Odena, C. Olah, and J. Shlens. Conditional image synthesis with auxiliary classifier gans. arXiv preprint arXiv:1610.09585, 2016.
30. T. Ojala, M. Pietikainen, and T. Maenpaa. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 24(7):971-987, 2002.
31. D. Pathak, P. Krahenbuhl, J. Donahue, T. Darrell, and A. A. Efros. Context encoders: Feature learning by inpainting. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2536-2544, 2016.
32. A. Radford, L. Metz, and S. Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434, 2015.
33. S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee. Generative adversarial text to image synthesis. arXiv preprint arXiv:1605.05396, 2016.
34. C. Sagonas, E. Antonakos, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-The-wild challenge: Database and results. Image and Vision Computing (IVC), Special Issue on Facial Landmark Localisation "In-The-Wild", 47:3-18, 2016.
35. C. Sagonas, Y. Panagakis, S. Zafeiriou, and M. Pantic. Robust statistical face frontalization. In IEEE International Conference on Computer Vision (ICCV), pages 3871-3879, Santiago, Chile, December 2015.
36. C. Sagonas, Y. Panagakis, S. Zafeiriou, and M. Pantic. Robust statistical frontalization of human and animal faces. International Journal of Computer Vision (IJCV), Special Issue on "Machine Vision Applications", June 2016.
37. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-The-wild challenge: The first facial landmark localization challenge. In IEEE International Conference on Computer Vision (ICCV) Workshops, pages 397-403, December 2013.
38. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. A semi-automatic methodology for facial landmark annotation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pages 896-903, 2013.
39. T. Salimans, I. Goodfellow,W. Zaremba, V. Cheung, A. Radford, and X. Chen. Improved techniques for training gans. In Advances in Neural Information Processing Systems (NIPS), pages 2234-2242, 2016.
40. J. Shen, S. Zafeiriou, G. Chrysos, J. Kossaifi, G. Tzimiropoulos, and M. Pantic. The first facial landmark tracking in-thewild challenge: Benchmark and results. In IEEE International Conference on Computer Vision (ICCV), 300 Videos in theWild (300-VW): Facial Landmark Tracking in-The-Wild Challenge &Workshop (ICCVW'15), pages 50-58, December 2015.
41. L. Tran, X. Yin, and X. Liu. Disentangled representation learning gan for pose-invariant face recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), volume 4, page 7, 2017.
42. G. Tzimiropoulos and M. Pantic. Gauss-newton deformable part models for face alignment in-The-wild. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1851-1858, 2014.
43. G. Tzimiropoulos and M. Pantic. Fast algorithms for fitting active appearance models to unconstrained images. International Journal of Computer Vision (IJCV), pages 1-17, 2016.
44. G. Tzimiropoulos and M. Pantic. Fast algorithms for fitting active appearance models to unconstrained images. International Journal of Computer Vision (IJCV), 122(1):17-33, Mar 2017.
45. G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. Subspace learning from image gradient orientations. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 34(12):2454-2466, 2012.
46. C.Wang, C.Wang, C. Xu, and D. Tao. Tag disentangled generative adversarial networks for object image re-rendering. In International Joint Conference on Artificial Intelligence (IJCAI), pages 2901-2907, 2017.
47. H. Zhang, T. Xu, H. Li, S. Zhang, X. Huang, X. Wang, and D. Metaxas. Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks. arXiv preprint arXiv:1612.03242, 2016.
48. J. Zhao, M. Mathieu, and Y. LeCun. Energy-based generative adversarial network. arXiv preprint arXiv:1609.03126, 2016.
49. J.-Y. Zhu, T. Park, P. Isola, and A. A. Efros. Unpaired imageto-image translation using cycle-consistent adversarial networks. arXiv preprint arXiv:1703.10593, 2017.
50. X. Zhu and D. Ramanan. Face detection, pose estimation, and landmark localization in the wild. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2879-2886, 2012.