Compression and direct manipulation of complex blendshape models

ACM Transactions on Graphics

Volumn 30, Issue 6, 2011, Pages

  Seo, Jaewoo ^a,b   Irvingy, Geoffrey ^b   Lewisz, J P ^b   Nohx, Junyong ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b WETA DIGITAL   (New Zealand)

Author keywords

Blendshape; Compression; Direct manipulation

Indexed keywords

BLENDSHAPE; BLENDSHAPES; DIRECT MANIPULATION; EXTENDED VERSIONS; GPU IMPLEMENTATION; HARDWARE-ACCELERATED; MATRIX; MATRIX BLOCKS; MATRIX COMPRESSION; PARALLEL PROCESSING; REALTIME PROCESSING; TARGET SHAPE; VISUAL ARTIFACTS;

ANIMATION; COMPACTION;

MATRIX ALGEBRA;

EID: 82455171629     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2024156.2024198     Document Type: Article

References (42)

1. AUTODESK, 2011. Autodesk Maya API White Paper.
2. BAINVILLE, E., 2010. OpenCL Training Course: GPU matrixvector product . http://www.bealto.com/.
3. BERGERON, P., AND LACHAPELLE, P. 1985. Controlling facial expressions and body movements in the computer generated animated short 'Tony de Peltrie'. In SIGGRAPH 85 Tutorial Notes, Advanced Computer Animation Course.
4. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3d faces. In Proc. of SIGGRAPH 99, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 187-194.
5. BÖRM, S., GRASEDYCK, L., AND HACKBUSCH, W. 2003. Introduction to hierarchical matrices with applications. Engineering Analysis with Boundary Elements 27, 5, 405-422.
6. BÖRM, S. 2010. Efficient numerical methods for non-local operators: H2-matrix compression, algorithms and analysis. EMS Tracts in Math. European Mathematical Society.
7. CARR, J. C., BEATSON, R. K., CHERRIE, J. B., MITCHELL, T. J., FRIGHT, W. R., MCCALLUM, B. C., AND EVANS, T. R. 2001. Reconstruction and representation of 3d objects with radial basis functions. In Proc. of SIGGRAPH 2001, ACM, Computer Graphics Proceedings, Annual Conference Series, 67-76. (Pubitemid 33047291)
8. ÇIVRIL, A., AND MAGDON-ISMAIL, M. 2009. On selecting a maximum volume sub-matrix of a matrix and related problems. Theor. Comput. Sci. 410 (November), 4801-4811.
9. CHANDRASEKARAN, S., GU, M., AND PALS, T. 2004. Fast and stable algorithms for hierarchically semi-separable representations. Tech. rep., University of California, Berkeley.
10. CHUANG, E. S. 2004. Analysis, synthesis, and retargeting of facial expressions. PhD thesis, Stanford, CA, USA. AAI3128633.
11. DENG, Z., CHIANG, P.-Y., FOX, P., AND NEUMANN, U. 2006. Animating blendshape faces by cross-mapping motion capture data. In Proc. of the 2006 Symp. on Interactive 3D graphics and games, ACM, New York, NY, USA, I3D '06, 43-48.
12. ERNST, J., 2011. Fast and efficient facial rigging. Talk at Game Developers Conference (GDC) 2011.
13. FENG, W.-W., KIM, B.-U., AND YU, Y. 2008. Real-time data driven deformation using kernel canonical correlation analysis. ACM Trans. Graph. 27 (August), 91:1-91:9.
14. IRVING, G. 2011. Banded householder representation of linear subspaces. http://arxiv.org/abs/1108.5822.
15. JOHNSON, S. G., 2010. The NLopt nonlinear-optimization package. http://ab-initio.mit.edu/nlopt.
16. JOSHI, P., TIEN, W. C., DESBRUN, M., AND PIGHIN, F. 2003. Learning controls for blend shape based realistic facial animation. In Proc. of the 2003 ACM SIGGRAPH/Eurographics Symp. on Comp. Anim., Eurographics Association, SCA '03, 187-192.
17. JOSHI, P., MEYER, M., DEROSE, T., GREEN, B., AND SANOCKI, T. 2007. Harmonic coordinates for character articulation. ACM Trans. Graph. 26 (July).
18. JU, T., SCHAEFER, S., AND WARREN, J. 2005. Mean value coordinates for closed triangular meshes. ACM Trans. Graph. 24 (July), 561-566.
19. KARNI, Z., AND GOTSMAN, C. 2000. Spectral compression of mesh geometry. In Proc. of SIGGRAPH 2000, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 279-286. (Pubitemid 32393991)
20. KERNIGHAN, B. W., AND LIN, S. 1970. An Efficient Heuristic Procedure for Partitioning Graphs. The Bell System Tech. J. 49, 1, 291-307.
21. LAU, M., CHAI, J., XU, Y.-Q., AND SHUM, H.-Y. 2009. Face poser: Interactive modeling of 3d facial expressions using facial priors. ACM Trans. Graph. 29 (December), 3:1-3:17.
22. LEWIS, J., AND ANJYO, K.-I. 2010. Direct manipulation blendshapes. IEEE Comp. Graph. and Appl. 30, 4 (July-Aug.), 42-50.
23. LEWIS, J. P., MOOSER, J., DENG, Z., AND NEUMANN, U. 2005. Reducing blendshape interference by selected motion attenuation. In Proc. of the 2005 Symp. on Interactive 3D graphics and games, ACM, New York, NY, USA, I3D '05, 25-29. (Pubitemid 41832867)
24. LI, H., WEISE, T., AND PAULY, M. 2010. Example-based facial rigging. ACM Trans. Graph. 29 (July), 32:1-32:6.
25. LIPMAN, Y., KOPF, J., COHEN-OR, D., AND LEVIN, D. 2007. Gpu-assisted positive mean value coordinates for mesh deformations. In Proc. of the fifth Eurographics Symp. on Geom. Proc.
26. LOIOLA, E. M., MARIA, N., ABREU, M., BOAVENTURANETTO, P. O., HAHN, P., AND QUERIDO, T. 2007. An analytical survey for the quadratic assignment problem. European Journal Operational Research 176, 657-690. (Pubitemid 44537635)
27. NGUYEN, H. 2007. GPU Gems 3. Addison-Wesley Professional.
28. NVIDIA. 2010. CUDA Compute Unified Device Architecture - Programming Guide.
29. OSIPA, J. 2010. Stop Staring: Facial Modeling and Animation Done Right, 3rd Ed. Sybex.
30. PENG, J., KIM, C.-S., AND KUO, C.-C. J. 2005. Technologies for 3d mesh compression: A survey. Journal of Visual Communication and Image Representation 16, 6, 688-733. (Pubitemid 41497915)
31. PIGHIN, F., HECKER, J., LISCHINSKI, D., SZELISKI, R., AND SALESIN, D. H. 1998. Synthesizing realistic facial expressions from photographs. In Proc. of SIGGRAPH 98, ACM, New York, NY, USA, 75-84.
32. POWELL, M. J. D. 2009. The BOBYQA algorithm for bound constrained optimization without derivatives. Tech. rep., Cambridge, England.
33. RAITT, B., 2004. The making of gollum. Presentation at U. Southern California Institute for Creative Technologies' Frontiers of Facial Animation Workshop, August.
34. SEOL, Y., SEO, J., KIM, P. H., LEWIS, J. P., AND NOH, J. 2011. Artist friendly facial animation retargeting. ACM Trans. Graph. (Proceedings of SIGGRAPH ASIA 2011) 30, 6.
35. SIFAKIS, E., NEVEROV, I., AND FEDKIW, R. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Trans. Graph. 24 (July), 417-425.
36. SORKINE, O., COHEN-OR, D., IRONY, D., AND TOLEDO, S. 2005. Geometry-aware bases for shape approximation. IEEE Trans. on Viz. and Comp. Graph. 11, 2 (March-April), 171-180.
37. STEFANOSKI, N., AND OSTERMANN, J. 2008. Spatially and temporally scalable compression of animated 3d meshes with MPEG-4/FAMC. In ICIP '08 - IEEE International Conference on Image Processing, vol. 0.
38. SUMNER, R. W., ZWICKER, M., GOTSMAN, C., AND POPOVIĆ , J. 2005. Mesh-based inverse kinematics. ACM Trans. Graph. 24 (July), 488-495.
39. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ , J. 2005. Face transfer with multilinear models. ACM Trans. Graph. 24 (July), 426-433.
40. WU, Q., XIA, T., CHEN, C., LIN, H.-Y. S., WANG, H., AND YU, Y. 2008. Hierarchical tensor approximation of multidimensional visual data. IEEE Trans. on Vis. and Comp. Graph. 14 (January), 186-199. (Pubitemid 350157890)
41. XIA, J., CHANDRASEKARAN, S., GU, M., AND LI, X. S. 2010. Fast algorithms for hierarchically semiseparable matrices. Numerical Linear Algebra with Applications 17, 6, 953-976.
42. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Trans. Graph. 23 (August), 548-558.