Facial performance transfer via deformable models and parametric correspondence

IEEE Transactions on Visualization and Computer Graphics

Volumn 18, Issue 9, 2012, Pages 1511-1519

  Asthana, Akshay ^a   De La Hunty, Miles ^a   Dhall, Abhinav ^a   Goecke, Roland ^b  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^b UNIVERSITY OF CANBERRA   (Australia)

Author keywords

Active appearance models; face modeling and animation; facial performance transfer

Indexed keywords

ACTIVE APPEARANCE MODELS; AREA OF INTEREST; DEFORMABLE MODELS; FACE MODELING; FACE MODELS; FACIAL PERFORMANCE TRANSFER; ILLUMINATION CONDITIONS; LINEAR REGRESSION METHODS; MODEL BASED APPROACH; MOVIE INDUSTRY; NON-LINEAR METHODS; REAL TIME;

ANIMATION; COMPUTER GRAPHICS; COMPUTER VISION; LINEAR REGRESSION;

DEFORMATION;

ALGORITHM; ANATOMY AND HISTOLOGY; COMPUTER GRAPHICS; COMPUTER SIMULATION; FACE; FEMALE; HUMAN; MALE; PROCEDURES; THREE DIMENSIONAL IMAGING;

ALGORITHMS; COMPUTER GRAPHICS; COMPUTER SIMULATION; FACE; FEMALE; HUMANS; IMAGING, THREE-DIMENSIONAL; MALE;

EID: 84864119602     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2011.157     Document Type: Article

References (24)

1. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. Salesin, "Synthesizing Realistic Facial Expressions from Photographs," Proc. ACM SIGGRAPH, pp. 75-84, 1998.
2. J. Noh and U. Neumann, "Expression Cloning," Proc. ACM SIGGRAPH, pp. 277-288, 2001. (Pubitemid 33047313)
3. Z. Liu, Y. Shan, and Z. Zhang, "Expressive Expression Mapping with Ratio Images," Proc. ACM SIGGRAPH, pp. 271-276, 2001. (Pubitemid 33047312)
4. V. Blanz, C. Basso, T. Vetter, and T. Poggio, "Reanimating Faces in Images and Video," Proc. EUROGRAPHICS, pp. 641-650, 2003.
5. Y.-J. Chang and T. Ezzat, "Transferable Videorealistic Speech Animation," Proc. ACM SIGGRAPH, pp. 143-151, 2005.
6. B. Theobald, I. Matthews, J. Cohn, and S. Boker, "Real-Time Expression Cloning Using Appearance Models," Proc. Ninth Int'l Conf. Multimodal Interfaces (ICMI '07), pp. 134-139, 2007.
7. M.J. Jones and T. Poggio, "Multidimensional Morphable Models: A Framework for Representing and Matching Object Classes," Int'l J. Computer Vision, vol. 29, no. 2, pp. 107-131, 1998. (Pubitemid 128517907)
8. T. Leyvand, D. Cohen-Or, G. Dror, and D. Lischinski, "Data-Driven Enhancement of Facial Attractiveness," ACM Trans. Graphics, vol. 27, no. 3, 2008, doi: 10.1145/1399504.1360637.
9. D. Vlasic, M. Brand, H. Pfister, and J. Popovic, "Face Transfer with Multilinear Models," ACM Trans. Graphics, vol. 24, no. 3, pp. 426-433, 2005.
10. G. Edwards, C. Taylor, and T. Cootes, "Interpreting Face Images Using Active Appearance Models," Proc. Third IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG '98), pp. 300-305, 1998.
11. R. Goecke and B. Millar, "The Audio-Video Australian English Speech Data Corpus AVOZES," Proc. Int'l Conf. Spoken Language Processing (ICSLP '04), pp. 2525-2528, 2004.
12. S. Baker, R. Gross, and I. Matthews, "Lucas-Kanade 20 Years on: A Unifying Framework: Part 3," Technical Report CMU-RITR-03-35, Robotics Inst., Carnegie Mellon Univ., 2003.
13. S.-J. Kim, K. Koh, M. Lustig, S. Boyd, and D. Gorinevsky, "An Interior-Point Method for Large-Scale L1-Regularized Least Squares," IEEE J. Selected Topics in Signal Processing, vol. 1, no. 4, pp. 606-617, Dec. 2007. (Pubitemid 351266626)
14. D.L. Donoho, "For Most Large Underdetermined Systems of Linear Equations, the Minimal L1-Norm Solution is also the Sparsest Solution," Comm. Pure and Applied Math., vol. 59, pp. 797-829, 2004.
15. C.E. Rasmussen, Gaussian Processes for Machine Learning. MIT Press, 2006.
16. P. Boyle and M. Frean, "Dependent Gaussian Processes," Proc. Advances in Neural Information Processing Systems (NIPS 17), pp. 217-224, 2005.
17. M. Alvarez and N.D. Lawrence, "Sparse Convolved Gaussian Processes for Multi-Output Regression," Proc. Advances in Neural Information Processing Systems (NIPS 21), pp. 57-64, 2008.
18. R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, second ed. Cambridge Univ. Press, 2004.
19. R.W. Sumner and J. Popovic, "Deformation Transfer for Triangle Meshes," Proc. ACM SIGGRAPH, pp. 399-405, 2004.
20. Z. Wang, A.C. Bovik, H.R. Sheikh, S. Member, E.P. Simoncelli, and S. Member, "Image Quality Assessment: From Error Visibility to Structural Similarity," IEEE Trans. Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004.
21. A. Dhall, A. Asthana, and R. Goecke, "Facial Expression Based Automatic Album Creation," Proc. Seventh Int'l Conf. Neural Information Processing (ICONIP '10), pp. 485-492, 2010.
22. A. Dhall, A. Asthana, and R. Goecke, "A SSIM Based Approach for Finding Similar Facial Expressions," Proc. IEEE Int'l Conf. Automated Face and Gesture Recognition and Workshops (FG '11), 2011.
23. T. Jan and A. Zaknich, "An Adjustable Model for Linear to Nonlinear Regression," Proc. IEEE Int'l Joint Conf. Neural Networks, pp. 846-850, 1999. (Pubitemid 30593100)
24. P. Vacha, "Texture Similarity Measure," Proc. Contributed Papers: Part I-Math. and Computer Sciences (WDS '05), pp. 47-52, 2005.