Capturing and animating skin deformation in human motion

ACM Transactions on Graphics

Volumn 25, Issue 3, 2006, Pages 881-889

  Sang, Park Il ^a   Hodgins, Jessica K ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Human animation; Motion capture; Skin deformation

Indexed keywords

FLEXING MUSCLES; HUMAN ANIMATIONS; MOTION CAPTURES; SKIN DEFORMATIONS;

ANIMATION; FREQUENCIES; IMAGE SEGMENTATION; MOTION PICTURES; SKIN;

IMAGE ANALYSIS;

EID: 33749249390     PISSN: 07300301     EISSN: 07300301     Source Type: Conference Proceeding    
DOI: 10.1145/1141911.1141970     Document Type: Conference Paper

References (59)

1. ALBRECHT, I., HABER, J., AND SEIDEL, H.-P. 2003. Construction and animation of anatomically based human hand models. In 2003 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 98-109.
2. ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2002. Articulated body deformation from range scan data. ACM Transactions on Graphics 21, 3, 612-619.
3. ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2003. The space of human body shapes: Reconstruction and parameterization from range scans. ACM Transactions on Graphics 22, 3, 587-594.
4. ANGUELOV, D., KOLLER, D., PANG, H., SRINIVASAN, P., AND THRUN, S. 2004. Recovering articulated object models from 3d range data. In the 20th Conference on Uncertainty in Artificial Intelligence, 18-26.
5. ANGUELOV, D., SRINIVASAN, P., KOLLER, D., THRUN, S., RODGERS, J., AND DAVIS, J. 2005. Scape: shape completion and animation of people. ACM Transactions on Graphics 24, 3, 408-416.
6. CHADWICK, J. E., HAUMANN, D. R., AND PARENT, R. E. 1989. Layered construction for deformable animated characters. Computer Graphics (Proceedings of SIGGRAPH 89) 23, 3, 243-252.
7. CHAI, J., XIAO, J., AND HODGINS, J. 2003. Vision-based control of 3d facial animation. In 2003 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 193-206.
8. CHOE, B., LEE, H., AND KO, H.-S. 2001. Performance-driven muscle-based facial animation. The Journal of Visualization and Computer Animation 12, 2, 67-79.
9. CHUANG, E., AND BREGLER, C. 2005. Mood swings: expressive speech animation. ACM Transactions on Graphics 24, 2, 331-347.
10. COSKER, D., PADDOCK, S., MARSHALL, D., ROSIN, P. L., AND RUSHTON, S. 2004. Towards perceptually realistic talking heads: models, methods and mcgurk. In APGV 2004, 151-157.
11. DONG, F., CLAPWORTHY, G. J., KROKOS, M. A., AND YAO, J. 2002. An anatomy-based approach to human muscle modeling and deformation. IEEE Transactions on Visualization and Computer Graphics 8, 2, 154-170.
12. FIDALEO, D., AND NEUMANN, U. 2004. Analysis of coarticulation regions for performance-driven facial animation. Computer Animation and Virtual Worlds 15, 1, 15-26.
13. GUENTER, B., GRIMM, C., WOOD, D., MALVAR, H., AND PIGHIN, F. 1998. Making faces. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 55-66.
14. GUO, Z., AND WONG, K. C. 2005. Skinning with deformable chunks. Computer Graphics Forum 24, 3, 373-382.
15. HORN, B. K. P. 1987. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A 4, 4, 629-642.
16. HUANG, K.-S., CHANG, C.-F., HSU, Y.-Y., AND YANG, S.-N. 2005. Key probe: a technique for animation keyframe extraction. The Visual Computer 21, 8-10, 532-541.
17. HWANG, B.-W., AND LEE, S.-W. 2003. Reconstruction of partially damaged face images based on a morphable face model. IEEE Trans. Pattern Anal. Mach. Intell. 25, 3, 365-372.
18. HYUN, D.-E., YOON, S.-H., CHANG, J.-W., SEONG, J.-K., KIM, M.-S., AND JÜTTLER, B. 2005. Sweep-based human deformation. The Visual Computer 21, 8-10, 542-550.
19. IGARASHI, T., MOSCOVICH, T., AND HUGHES, J. F. 2005. As-rigid-as-possible shape manipulation. ACM Transactions on Graphics 24, 3, 1134-1141.
20. JAMES, D. L., AND TWIGG, C. D. 2005. Skinning mesh animations. ACM Transactions on Graphics 24, 3, 399-407.
21. KANATANI, K. 1994. Analysis of 3-d rotation fitting. IEEE Trans. Pattern Anal. Mach. Intell. 16, 5, 543-549.
22. KAVAN, L., AND ZARA, J. 2005. Spherical blend skinning: A real-time deformation of articulated models. In 2005 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ACM Press, 9-16.
23. KSHIRSAGAR, S., MOLET, T., AND MAGNENAT-THALMANN, N. 2001. Principal components of expressive speech animation. In Computer Graphics International 2001, 38-44.
24. KURIHARA, T., AND MIYATA, N. 2004. Modeling deformable human hands from medical images. In 2004 ACM SIGGRAPH /Eurographics Symposium on Computer Animation, 355-363.
25. LA TORRE, F. D., AND BLACK, M. J. 2001. Dynamic coupled component analysis. In CVPR, 643-650.
26. LARBOULETTE, C., CANI, M.-P., AND ARNALDI, B. 2005. Dynamic skinning: adding real-time dynamic effects to an existing character animation. In Spring Conference on Computer Graphics 2005, 87-93.
27. LEMOS, R. R., ROKNE, J., BARANOSKI, G. V. G., KAWAKAMI, Y., AND KURIHARA, T. 2005. Modeling and simulating the deformation of human skeletal muscle based on anatomy and physiology. Computer Animation and Virtual Worlds 16, 3-4, 319-330.
28. LEWIS, J. P., CORDNER, M., AND FONG, N. 2000. Pose space deformations: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 165-172.
29. LIN, I.-C., AND OUHYOUNG, M. 2005. Mirror mocap: Automatic and efficient capture of dense 3d facial motion parameters from video. The Visual Computer 21, 6, 355-372.
30. LIN, I.-C., YENG, J.-S., AND OUHYOUNG, M. 2002. Extracting 3d facial animation parameters from multiview video clips, IEEE Computer Graphics & Applications 22, 6, 72-80.
31. LIPMAN, Y., SORKINE, O., LEVIN, D., AND COHEN-OR, D. 2005. Linear rotation-invariant coordinates for meshes. ACM Transactions on Graphics 24, 3, 479-487.
32. MAGNENAT-THALMANN, N., AND THALMANN, D. 2005. Virtual humans: thirty years of research, what next? The Visual Computer 21, 12, 997-1015.
33. MOHR, A., AND GLEICHER, M. 2003. Building efficient, accurate character skins from examples. ACM Transactions on Graphics 22, 3, 562-568.
34. MÜLLER, M., HEIDELBERGER, B., TESCHNER, M., AND GROSS, M. 2005. Meshless deformations based on shape matching. ACM Transactions on Graphics 24, 3, 471-478.
35. NEDEL, L. P., AND THALMANN, D. 2000. Anatomic modeling of deformable human bodies. The Visual Computer 16, 6, 306-321.
36. PRATSCHER, M., COLEMAN, P., LASZLO, J., AND SINGH, K. 2005. Outside-in anatomy based character rigging. In 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 329-338.
37. PRONOST, N., DUMONT, G., BERILLON, G., AND NICOLAS, G. 2006. Morphological and stance interpolations in database for simulating bipedalism of virtual humans. The Visual Computer 22, 1, 4-13.
38. SAND, P., MCMILLAN, L., AND POPOVIĆ, J. 2003. Continuous capture of skin deformation. ACM Transactions on Graphics 22, 3, 578-586.
39. SCHEEPERS, F., PARENT, R. E., CARLSON, W. E., AND MAY, S. F. 1997. Anatomy-based modeling of the human musculature. In Proceedings of SIGGRAPH 97, Computer Graphics Proceedings, Annual Conference Series, 163-172.
40. SEO, H., AND MAGNENAT-THALMANN, N. 2003. An automatic modeling of human bodies from sizing parameters. In 2003 ACM Symposium on Interactive 3D Graphics, 19-26.
41. SEO, H., CORDIER, F., AND MAGNENAT-THALMANN, N. 2003. Synthesizing animatable body models with parameterized shape modifications. In 2003 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 120-125.
42. SHUM, H.-Y., IKEUCHI, K., AND REDDY, R. 1995. Principal component analysis with missing data and its application to polyhedral object modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence 17, 9, 854-867.
43. SIFAKIS, E., NEVEROV, I., AND FEDKIW, R. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Transactions on Graphics 24, 3, 417-425.
44. SINGH, K., AND KOKKEVIS, E. 2000. Skinning characters using surface oriented free-form deformations. In Graphics Interface, 35-42.
45. SLOAN, P.-P. J., Ill, C. F. R., AND COHEN, M. F. 2001. Shape by example. In 2001 ACM Symposium on Interactive 3D Graphics, 135-144.
46. SUMNER, R. W., ZWICKER, M., GOTSMAN, C., AND POPOVIĆ, J. 2005. Mesh-hased inverse kinematics. ACM Transactions on Graphics 24, 3, 488-495.
47. SUN, W., HILTON, A., SMITH, R., AND ILLINGWORTH, J. 2001. Layered animation of captured data. The Visual Computer 17, 8, 457-474.
48. TERAN, J., SIFAKIS, E., BLEMKER, S. S., NG-THOW-HING, V., LAU, C., AND FEDKIW, R. 2005. Creating and simulating skeletal muscle from the visible human data set. IEEE Transactions on Visualization and Computer Graphics 11, 3, 317-328.
49. TERAN, J., SIFAKIS, E., IRVING, G., AND FEDKIW, R. 2005. Robust quasistatic unite elements and flesh simulation. In 2005 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 181-190.
50. VICON MOTION SYSTEMS, 2006. http://www.vicon.com/.
51. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ, J. 2005. Face transfer with multilinear models. ACM Transactions on Graphics 24, 3, 426-433.
52. WALLRAVEN, C., BREIDT, M., CUNNINGHAM, D. W., AND BÜLTHOFF, H. H. 2005. Psychophysical evaluation of animated facial expressions. In APGV 2005, 17-24.
53. WANG, X. C., AND PHILLIPS, C. 2002. Multi-weight enveloping: Least-squares approximation techniques for skin animation. In ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 129-138.
54. WANG, Y., HUANG, X.. LEE, C.-S., ZHANG, S., LI, Z., SAMARAS, D., METAXAS, D., ELGAMMAL, A., AND HUANG, P. 2004. High resolution acquisition, learning and transfer of dynamic 3-d facial expressions. Computer Graphics Forum 23, 3, 677-686.
55. WILHELMS, J., AND GELDER, A. V. 1997. Anatomically based modeling. In Proceedings of SIGGRAPH 97, Computer Graphics Proceedings, Annual Conference Series, 173-180.
56. ZALEWSKI, L., AND GONG, S. 2005. 2d statistical models of facial expressions for realistic 3d avatar animation. In CVPR, 217-222.
57. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Transactions on Graphics 23, 3, 548-558.
58. ZORDAN, V. B., AND HORST, N. C. V. D. 2003. Mapping optical motion capture data to skeletal motion using a physical model. In 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 245-250.
59. ZORDAN, V. B., CELLY, B., CHIU, B., AND DILORENZO, P. C. 2004. Breathe easy: model and control of simulated respiration for animation. In 2004 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 29-37.