Face swapping: Automatically replacing faces in photographs

ACM Transactions on Graphics

Volumn 27, Issue 3, 2008, Pages

  Bitouk, Dmitri ^a   Kumar, Neeraj ^a   Dhillon, Samreen ^b   Belhumeur, Peter ^a   Nayar, Shree K ^a  

^a Columbia University ^*

^b NONE

Author keywords

Computational photography; Face replacement; Image databases; Image based rendering

Indexed keywords

3-D MODELING; CO-ORDINATE SYSTEMS; COMPLETE SYSTEMS; COMPUTATIONAL PHOTOGRAPHY; DE-IDENTIFICATION; FACE DETECTION; FACE IMAGES; FACE REPLACEMENT; HIGH-QUALITY; IMAGE DATABASES; IMAGE-BASED RENDERING; INPUT IMAGES; LIGHTING CONDITIONS; OVERLAP REGION; REPLACEMENT ALGORITHMS; SKIN TONES; USER STUDIES;

COORDINATE MEASURING MACHINES; IMAGE ENHANCEMENT; IMAGE SEGMENTATION; IMAGING TECHNIQUES; LIGHTING; PHOTOGRAPHY;

THREE DIMENSIONAL;

EID: 49249104121     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1360612.1360638     Document Type: Article

References (24)

1. AGARWALA, A., DONTCHEVA, M., AGRAWALA, M., DRUCKER, S., COLBURN, A., CURLESS, B., SALESIN, D., AND COHEN, M. 2004. Interactive Digital Photomontage. ACM Transactions on Graphics 23, 294-302.
2. AVIDAN, S., AND SHAMIR, A. 2007. Seam carving for contentaware image resizing. ACM Transactions on Graphics 26.
3. BASRI, R., AND JACOBS, D. 2003. Lambertian reflectance and linear subspaces. IEEE TPAMI 25, 218-233.
4. BLANZ, V., SCHERBAUM, K., VETTER, T., AND SEIDEL, H.-P. 2004. Exchanging Faces in Images. Computer Graphics Forum 23, 669-676.
5. BOYLE, M., EDWARDS, C., AND GREENBERG, S. 2000. The Effects of Filtered Video on Awareness and Privacy. In ACM Conference on Computer Supported Cooperative Work.
6. COOTES, T., EDWARDS, G., AND TAYLOR, C. 2001. Active Appearance Models. IEEE TPAMI 26, 681-685.
7. DEBEVEC, P., HAWKINS, T., TCHOU, C., DUIKER, H.-P., SAROKIN, W., AND SAGAR, M. 2000. Acquiring the Reflectance Field of a Human Face. In SIGGRAPH 00, 145-156.
8. DEBEVEC, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In SIGGRAPH 98, 189-198.
9. EFROS, A. A., AND FREEMAN, W. T. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH 01, 341-346.
10. FERGUS, R., SINGH, B., HERTZMANN, A., ROWEIS, S., AND FREEMAN, W. 2006. Removing camera shake from a single photograph. SIGGRAPH 06, 787-794.
11. GROSS, R., SWEENEY, L., DE LA TORRE, F., AND BAKER, S. 2006. Model-Based Face De-Identification. 161-168.
12. HAYS, J., AND EFROS, A. A. 2007. Scene completion using millions of photographs. ACM Transactions on Graphics 26, 3.
13. KUNDUR, D., AND HATZINAKOS, D. 1996. Blind image deconvolution. IEEE Signal Processing Magazine, 3, 43-64.
14. LANITIS, I., DRAGANOVA, C., AND CHRISTODOULOU, C. 2004. Comparing different classifiers for automatic age estimation. IEEE Trans. on Systems, Man, and Cybernetics, B 34, 621-628.
15. LIU, Z., SHAN, Y., AND ZHANG, Z. 2001. Expressive expression mapping with ratio images. In SIGGRAPH 01: Proc. of the 28th CGIT, 271-276.
16. MALIK, S., 2003. Digital face replacement in photographs. http://www.cs.toronto.edu/~smalik/2530/project/results.html.
17. MOGHADDAM, B., AND YANG, M.-H. 2002. Learning gender with support faces. IEEE TPAMI24, 707-711.
18. NEWTON, E., SWEENEY, L., AND MALIN, B. 2005. Preserving Privacy by De-Identifying Face Images. IEEE Trans. on Knowledge and Data Eng., 232-243.
19. OMRON, 2007. OKAO vision, http://omron.com/rd/vision/01.html.
20. RAMAMOORTHI, R., AND HANRAHAN, P. 2001. An Efficient Representation for Irradiance Environment Maps. In SIGGRAPH 01, 491-500.
21. RUBNER, Y., TOMASI, C., AND GUIBAS, L. J. 2000. The earth mover's distance as a metric for image retrieval. IJCV, 99-121.
22. WANG, H., RASKAR, R., XU, N., AND AHUJA, N. 2007. Videoshop: A New Framework for Video Editing in Gradient Domain. Graphical Models 69, 57-70.
23. WANG, Y., LIU, Z., HUA, G., WEN, Z., ZHANG, Z., AND SAMARAS, D. 2007. Face re-lighting from a single image under harsh lighting conditions,. CVPR '07.
24. WEN, Z., LIU, Z., AND HUANG., T. S. 2003. Face Relighting with Radiance Environment Maps. In CVPR '03, 158-165.