Detail-preserving controllable deformation from sparse examples

IEEE Transactions on Visualization and Computer Graphics

Volumn 18, Issue 8, 2012, Pages 1215-1227

  Huang, Haoda ^a   Yin, Kangkang ^b   Zhao, Ling ^c   Qi, Yue ^c   Yu, Yizhou ^d   Tong, Xin ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c BEIHANG UNIVERSITY   (China)

^d University of Illinois at Urbana Champaign   (United States)

Author keywords

CCA regression; controllable skinning; Detail preserving deformation; learning from sparse examples

Indexed keywords

CCA REGRESSION; CONTROL POINT; CONTROLLABLE DEFORMATIONS; CONTROLLABLE SKINNING; DATA-DRIVEN MODEL; DEFORMABLE MODELS; DEFORMATION MODELS; DIGITAL MODEL; FACE MODELS; FINE FEATURE; GEOMETRIC DETAILS; GLOBAL MAPPING; HIGH RESOLUTION; HUMAN HANDS; KEY FRAMES; LARGE-SCALE DEFORMATION; LASER SCANNING TECHNOLOGY; LEARNING FROM SPARSE EXAMPLES; MULTIVIEW VIDEO SEQUENCES; NONLINEAR MAPPINGS; PERFORMANCE-DRIVEN; POSE SPACE; RANGE OF MOTIONS; REAL OBJECTS; REALISTIC GEOMETRY; TRAINING DATA; TWO-COMPONENT;

ANIMATION; MAPPING;

DEFORMATION;

ADULT; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; COMPUTER GRAPHICS; COMPUTER SIMULATION; DINOSAUR; FACE; HAND; HISTOLOGY; HUMAN; IMAGE PROCESSING; MALE; METHODOLOGY; REGRESSION ANALYSIS; VIDEORECORDING;

ADULT; ANIMALS; ARTIFICIAL INTELLIGENCE; COMPUTER GRAPHICS; COMPUTER SIMULATION; DINOSAURS; FACE; HAND; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MALE; MODELS, BIOLOGICAL; REGRESSION ANALYSIS; VIDEO RECORDING;

EID: 84862525398     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2012.88     Document Type: Article

References (34)

1. H. Huang, L. Zhao, K. Yin, Y. Qi, Y. Yu, and X. Tong, "Controllable Hand Deformation from Sparse Examples with Rich Details," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '11), pp. 73-82, 2011.
2. J.P. Lewis, M. Cordner, and N. Fong, "Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation," Proc. ACM SIGGRAPH '00, pp. 165-172, 2000.
3. P.-P.J. Sloan, C.F. Rose, and M.F. Cohen, "Shape by Example," Proc. Symp. Interactive 3D Graphics (I3D '01), pp. 135-143, 2001.
4. A. Mohr and M. Gleicher, "Building Efficient, Accurate Character Skins from Examples," ACM Trans. Graphics, vol. 22, no. 3, pp. 562-568, 2003.
5. O. Weber, O. Sorkine, Y. Lipman, and C. Gotsman, "Context-Aware Skeletal Shape Deformation," Computer Graphics Forum, vol. 26, no. 3, pp. 265-274, 2007.
6. R.Y. Wang, K. Pulli, and J. Popovic, "Real-Time Enveloping with Rotational Regression," ACM Trans. Graphics, vol. 26, no. 3, article 73, 2007.
7. P.G. Kry, D.L. James, and D.K. Pai, "EigenSkin: Real Time Large Deformation Character Skinning in Hardware," Proc. ACM SIGGRAPH/ Eurographics Symp. Computer Animation (SCA '02), pp. 153-159, 2002.
8. T. Kurihara and N. Miyata, "Modeling Deformable Human Hands from Medical Images," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '04), pp. 355-363, 2004.
9. T.-Y. Kim and E. Vendrovsky, "DrivenShape: A Data-Driven Approach for Shape Deformation," Proc. ACM SIGGRAPH/ Eurographics Symp. Computer Animation (SCA '08), pp. 49-55, 2008.
10. R.W. Sumner, M. Zwicker, C. Gotsman, and J. Popovic, "Mesh-Based Inverse Kinematics," ACM Trans. Graphics, vol. 24, no. 3, pp. 488-495, 2005.
11. K.G. Der, R.W. Sumner, and J. Popovic, "Inverse Kinematics for Reduced Deformable Models," ACM Trans. Graphics, vol. 25, no. 3, pp. 1174-1179, 2006.
12. W.-W. Feng, B.-U. Kim, and Y. Yu, "Real-Time Data Driven Deformation Using Kernel Canonical Correlation Analysis," ACM Trans. Graphics, vol. 27, no. 3, article 91, 2008.
13. M. Lau, J. Chai, Y.-Q. Xu, and H. Shum, "Face Poser: Interactive Modeling of 3D Facial Expressions Using Model Priors," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '07), pp. 161-170, 2007.
14. H. Huang, J. Chai, X. Tong, and H.-T. Wu, "Leveraging Motion Capture and 3D Scanning for High-Fidelity Facial Performance Acquisition," ACM Trans. Graphics, vol. 30, no. 4, article 74, 2011.
15. J.R. Tena, F.D. la Torre, and I. Matthews, "Interactive Region-Based Linear 3D Face Models," ACM Trans. Graphics, vol. 30, no. 4, article 76, 2011.
16. B. Bickel, M. Botsch, R. Angst, W. Matusik, M. Otaduy, H. Pfister, and M. Gross, "Multi-Scale Capture of Facial Geometry and Motion," ACM Trans. Graphics, vol. 26, no. 3, article 33, 2007.
17. B. Bickel, M. Lang, M. Botsch, M.A. Otaduy, and M. Gross, "Pose-Space Animation and Transfer of Facial Details," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '08), pp. 57-66, 2008.
18. W.-C. Ma, A. Jones, J.-Y. Chiang, T. Hawkins, S. Frederiksen, P. Peers, M. Vukovic, M. Ouhyoung, and P. Debevec, "Facial Performance Synthesis Using Deformation-Driven Polynomial Displacement Maps," ACM Trans. Graphics, vol. 27, no. 5, article 121, 2008.
19. E. de Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.-P. Seidel, and S. Thrun, "Performance Capture from Sparse Multi-View Video," ACM Trans. Graphics, vol. 27, no. 3, article 98, 2008.
20. D. Vlasic, I. Baran, W. Matusik, and J. Popovic, "Articulated Mesh Animation from Multi-View Silhouettes," ACM Trans. Graphics, vol. 27, no. 3, article 97, 2008.
21. H. Li, B. Adams, L.J. Guibas, and M. Pauly, "Robust Single-View Geometry and Motion Reconstruction," ACM Trans. Graphics, vol. 28, no. 5, article 175, 2009.
22. D. Bradley, W. Heidrich, T. Popa, and A. Sheffer, "High Resolution Passive Facial Performance Capture," ACM Trans. Graphics, vol. 29, no. 4, article 41, 2010.
23. S. Sueda, A. Kaufman, and D.K. Pai, "Musculotendon Simulation for Hand Animation," ACM Trans. Graphics, vol. 27, no. 3, article 83, 2008.
24. L. Zhang, N. Snavely, B. Curless, and S. Seitz, "Spacetime Faces: High Resolution Capture for Modeling and Animation," ACM Trans. Graphics, vol. 23, no. 3, pp. 546-556, 2004.
25. A. Golovinskiy, W. Matusik, H. Pfister, S. Rusinkiewicz, and T. Funkhouser, "A Statistical Model for Synthesis of Detailed Facial Geometry," Proc. ACM SIGGRAPH '06, pp. 1025-1034, 2006.
26. S. Park and J. Hodgins, "Capturing and Animating Skin Deformation in Human Motion," ACM Trans. Graphics, vol. 25, no. 3, pp. 881-889, 2006.
27. G. Turk, "Re-Tiling Polygonal Surfaces," Proc. ACM SIGGRAPH '92, pp. 55-64, 1992.
28. R.W. Sumner and J. Popovic, "Deformation Transfer for Triangle Meshes," ACM Trans. Graphics, vol. 23, no. 3, pp. 399-405, 2004.
29. D.L. James and C.D. Twigg, "Skinning Mesh Animations," Proc. ACM SIGGRAPH '05, pp. 399-407, 2005.
30. W.S. Cleveland and S.J. Devlin, "Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting," J. Am. Statistical Assoc., vol. 83, no. 403, pp. 596-610, 1988.
31. L.K. Saul and S.T. Roweis, "Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifolds," J. Machine Learning Research, vol. 4, pp. 119-155, 2003.
32. M. Belkin and P. Niyogi, "Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering," Proc. Advances in Neural Information Processing Systems (NIPS), pp. 585-591, 2001.
33. L. Kavan, S. Collins, J. Zára, and C. O'Sullivan, "Skinning with Dual Quaternions," Proc. Symp. Interactive 3D Graphics and Games (I3D '07), pp. 39-46, 2007.
34. S.R. Buss and J.-S. Kim, "Selectively Damped Least Squares for Inverse Kinematics," J. Graphics Tools, vol. 10, no. 3, pp. 37-49, 2005.