Synthesizing normalized faces from facial identity features

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 3386-3395

  Cole, Forrester ^a   Belanger, David ^a,b   Krishnan, Dilip ^a   Sarna, Aaron ^a   Mosseri, Inbar ^a   Freeman, William T ^a,c  

^a GOOGLE INC   (United States)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DECODING; PATTERN RECOGNITION; PHOTOGRAPHY; THREE DIMENSIONAL COMPUTER GRAPHICS;

FACIAL EXPRESSIONS; FACIAL LANDMARK; FACIAL RECOGNITION; FEATURE VECTORS; IMAGE WARPING; SPARSE SET; TEXTURE MAPS; WHITE BALANCE;

FACE RECOGNITION;

EID: 85041926374     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.361     Document Type: Conference Paper

References (39)

1. F. Schroff, D. Kalenichenko, and J. Philbin, "FaceNet: A unified embedding for face recognition and clustering," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 815-823. 1
2. V. Blanz and T. Vetter, "A morphable model for the synthesis of 3d faces," in Proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., 1999, pp. 187-194.
3. I. Kemelmacher-Shlizerman, S. M. Seitz, D. Miller, and E. Brossard, "The megaface benchmark: 1 million faces for recognition at scale," CoRR, vol. abs/1512.00596, 2015. [Online]. Available: http://arxiv.org/abs/1512.
4. O. M. Parkhi, A. Vedaldi, and A. Zisserman, "Deep face recognition," in British Machine Vision Conference, vol. 1, no. 3, 2015, p. 6.
5. T. Hassner, S. Harel, E. Paz, and R. Enbar, "Effective face frontalization in unconstrained images," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 4295-4304.
6. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "DeepFace: Closing the gap to human-level performance in face verification," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 1701-1708.
7. A. Lanitis, C. J. Taylor, and T. F. Cootes, "A unified approach to coding and interpreting face images," in Computer Vision, 1995. Proceedings., Fifth International Conference on. IEEE, 1995, pp. 368-373.
8. D. Erhan, Y. Bengio, A. Courville, and P. Vincent, "Visualizing higher-layer features of a deep network," University of Montreal, Tech. Rep. 1341, Jun. 2009, also presented at the ICML 2009 Workshop on Learning Feature Hierarchies, Montréal, Canada.
9. K. Simonyan, A. Vedaldi, and A. Zisserman, "Deep inside convolutional networks: Visualising image classification models and saliency maps," CoRR, vol. abs/1312.6034, 2013. [Online]. Available: http://arxiv.org/abs/1312.
10. A. Mahendran and A. Vedaldi, "Understanding deep image representations by inverting them," CoRR, vol. abs/1412.0035, 2014. [Online]. Available: http://arxiv.org/abs/1412.
11. J. Yosinski, J. Clune, A. M. Nguyen, T. Fuchs, and H. Lipson, "Understanding neural networks through deep visualization," CoRR, vol. abs/1506.06579, 2015. [Online]. Available: http://arxiv.org/abs/1506.
12. A. Mordvintsev, C. Olah, and M. Tyka. (2015, Jun.) Inceptionism: Going deeper into neural networks.
13. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks," CoRR, vol. abs/1311.2901, 2013. [Online]. Available: http://arxiv.org/abs/1311.
14. A. Dosovitskiy and T. Brox, "Inverting visual representations with convolutional networks," arXiv preprint arXiv: 1506.02753, 2015.
15. A. Zhmoginov and M. Sandler, "Inverting face embeddings with convolutional neural networks," arXiv preprint arXiv: 1606.04189, 2016.
16. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," in IEEE Transactions on Pattern Analysis and Machine Intelligence. Springer, 1998, pp. 484-498.
17. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1-9.
18. A. Dosovitskiy and T. Brox, "Generating images with perceptual similarity metrics based on deep networks," CoRR, vol. abs/1602.02644, 2016. [Online]. Available: http://arxiv.org/abs/1602.
19. J. Johnson, A. Alahi, and L. Fei-Fei, "Perceptual losses for real-time style transfer and super-resolution," in European Conference on Computer Vision, 2016.
20. A. Asthana, M. J. Jones, T. K. Marks, K. H. Tieu, R. Goecke et al., "Pose normalization via learned 2d warping for fully automatic face recognition." in BMVC. Citeseer, 2011, pp. 1-11.
21. A. Asthana, T. K. Marks, M. J. Jones, K. H. Tieu, and M. Rohith, "Fully automatic pose-invariant face recognition via 3d pose normalization," in 2011 International Conference on Computer Vision. IEEE, 2011, pp. 937-944.
22. D. Yi, Z. Lei, and S. Z. Li, "Towards pose robust face recognition," in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2013.
23. D. Yi, Z. Lei, and S. Li, "Towards pose robust face recognition," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2013, pp. 3539-3545.
24. Z. Liu, P. Luo, X. Wang, and X. Tang, "Deep learning face attributes in the wild," in Proceedings of International Conference on Computer Vision (ICCV), 2015.
25. A. B. L. Larsen, S. K. Sønderby, and O. Winther, "Autoencoding beyond pixels using a learned similarity metric," arXiv preprint arXiv: 1512.09300, 2015.
26. J. Zhao, M. Mathieu, and Y. LeCun, "Energy-based generative adversarial network," arXiv preprint arXiv: 1609.03126, 2016.
27. L. Dinh, J. Sohl-Dickstein, and S. Bengio, "Density estimation using real nvp," arXiv preprint arXiv: 1605.08803, 2016.
28. V. Dumoulin and F. Visin, "A guide to convolution arithmetic for deep learning," arXiv preprint arXiv: 1603.07285, 2016.
29. A. Iske, Multiresolution Methods in Scattered Data Modelling, ser. Lecture Notes in Computational Science and Engineering. Springer Berlin Heidelberg, 2012. [Online]. Available: https://books.google.com/books?id= CqP-sgEACAAJ
30. P. Pérez, M. Gangnet, and A. Blake, "Poisson image editing," in ACM SIGGRAPH 2003 Papers, ser. SIGGRAPH '03, 2003, pp. 313-318.
31. V. Kazemi and J. Sullivan, "One millisecond face alignment with an ensemble of regression trees," in Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, ser. CVPR '14. IEEE Computer Society, 2014, pp. 1867-1874.
32. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," University of Massachusetts, Amherst, Tech. Rep. 07-49, October 2007.
33. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. J. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Józefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mané, R. Monga, S. Moore, D. G. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. A. Tucker, V. Vanhoucke, V. Vasudevan, F. B. Viégas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, and X. Zheng, "TensorFlow: Large-scale machine learning on heterogeneous distributed systems," CoRR, vol. abs/1603.04467, 2016. [Online]. Available: http://arxiv.org/abs/1603.0
34. D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization," CoRR, vol. abs/1412.6980, 2014. [Online]. Available: http://arxiv.org/abs/1412.
35. S. Suwajanakorn, I. Kemelmacher-Shlizerman, and S. M. Seitz, Total Moving Face Reconstruction. Cham: Springer International Publishing, 2014, pp. 796-812.
36. S. Suwajanakorn, I. Kemelmacher Shlizerman, and S. M. Seitz, "What makes tom hanks look like tom hanks," in International Conference on Computer Vision, 2015.
37. J. Booth, A. Roussos, S. Zafeiriou, A. Ponniah, and D. Dunaway, "A 3d morphable model learnt from 10,000 faces," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016.
38. J. T. Barron, "Convolutional color constancy," International Conference on Computer Vision, 2015.
39. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets," in Advances in Neural Information Processing Systems, 2014, pp. 2672-2680.