Articulated mesh animation from multi-view silhouettes

ACM Transactions on Graphics

Volumn 27, Issue 3, 2008, Pages

  Vlasic, Daniel ^a   Baran, Ilya ^a   Matusik, Wojciech ^b   Popoviç, Jovan ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

Deformation; Motion capture

Indexed keywords

DEFORMATION MODELING; DEFORMATION TRANSFER; EDITING OPERATIONS; HUMAN PERFORMANCE; MOTION CAPTURE; MULTI VIEWS; MULTI-VIEW VIDEO; MULTIPLE VIEWPOINTS; NON-RIGID DEFORMATION; POSE TRACKING; SOFTWARE SYSTEMS; VIDEO IMAGING; VISUAL QUALITIES;

ANIMATION; COMPUTER SOFTWARE; DEFORMATION; IMAGING TECHNIQUES; MATHEMATICAL MODELS; PHOTOGRAPHY; VIDEO RECORDING;

MESH GENERATION;

EID: 49349090403     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1360612.1360696     Document Type: Article

References (38)

1. ALEXA, M. 2003. Differential coordinates for local mesh morphing and deformation. The Visual Computer 19, 2, 105-114.
2. ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2002. Articulated body deformation from range scan data. ACM Transactions on Graphics 21, 3 (July), 612-619.
3. ANGUELOV, D., SRINIVASAN, P., KOLLER, D., THRUN, S., RODGERS, J., AND DAVIS, J. 2005. Scape: Shape Completion and Animation of People. ACM Transactions on Graphics 24, 3 (Aug.), 408-416.
4. ANUAR, N., AND GUSKOV, I. 2004. Extracting animated meshes with adaptive motion estimation. In Workshop on Vision, Modeling, and Visualization, 63-71.
5. BALAN, A. O., SIGAL, L., BLACK, M. J., DAVIS, J. E., AND HAUSSECKER, H. W. 2007. Detailed human shape and pose from images. In Computer Vision and Pattern Recognition.
6. BARAN, I., AND POPOVIĆ, J. 2007. Automatic rigging and animation of 3D characters. ACM Transactions on Graphics 26, 3 (July), 72:1-72:8.
7. CARRANZA, J., THEOBALT, C., MAGNOR, M. A., AND SEIDEL, H.-P. 2003. Free-viewpoint video of human actors. ACM Transactions on Graphics 22, 3 (July), 569-577.
8. CHEUNG, K. M., BAKER, S., AND KANADE, T. 2005. Shape-from - silhouette across time Part II: Applications to human modeling and markerless motion tracking. International Journal of Computer Vision 63, 3 (July), 225-245.
9. CORAZZA, S., MÜNDERMANN, L., CHAUDHARI, A., DEMATTIO, T., COBELLI, C., AND ANDRIACCHI, T. R 2006. A markerless motion capture system to study musculoskeletal biomechanics: Visual hull and simulated annealing approach. Annals of Biomedical Engineering 34, 6 (July), 1019-1029.
10. DANIELSSON, R-E. 1980. Euclidean distance mapping. Computer Graphics and Image Processing 14, 227-248.
11. DE AGUIAR, E., THEOBALT, C., MAGNOR, M., THEISEL, H., AND SEIDEL, H.-P. 2004. M3: marker-free model reconstruction and motion tracking from 3D voxel data. In Pacific Conference on Computer Graphics and Applications, 101-110.
12. DE AGUIAR, E., THEOBALT, C., MAGNOR, M., AND SEIDEL, H.-P. 2005. Reconstructing human shape and motion from multi-view video. In Conference on Visual Media Production, 44-51.
13. DE AGUIAR, E., THEOBALT, C., STOLL, C., AND SEIDEL, H.-P. 2007. Marker-less deformable mesh tracking for human shape and motion capture. In Computer Vision and Pattern Recognition.
14. DE AGUIAR, E., THEOBALT, C., STOLL, C., AND SEIDEL, H.-P. 2007. Rapid animation of laser-scanned humans. In Virtual Reality, 223-226.
15. EROL, A., BEBIS, G., BOYLE, R. D., AND NICOLESCU, M. 2005. Visual hull construction using adaptive sampling. In Workshop on Applications of Computer Vision, 234-241.
16. ESTEBAN, C. H., AND SCHMITT, F. 2004. Silhouette and stereo fusion for 3D object modeling. Computer Vision and Image Understanding 96, 3 (Dec.), 367-392.
17. FURUKAWA, Y., AND PONCE, J. 2006. Carved visual hulls for image-based modeling. In European Conference on Computer Vision, 564-577.
18. GILL, R E., MURRAY, W., AND SAUNDERS, M. A. 2002. SNOPT: An SQP algorithm for large-scale constrained optimization. SIAM Journal on Optimization 12, 4, 979-1006.
19. GOLDLÜCKE, B., IHRKE, I., LINZ, C., AND MAGNOR, M. 2007. Weighted minimal hypersurface reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 7 (July), 1194-1208.
20. HORNUNG, A., AND KOBBELT, L. 2006. Hierarchical volumetric multi-view stereo reconstruction of manifold surfaces based on dual graph embedding. In Computer Vision and Pattern Recognition, 503-510.
21. KIRCHER, S., AND GARLAND, M. 2006. Editing arbitrarily deforming surface animations. ACM Transactions on Graphics 25, 3 (July), 1098-1107.
22. LEVOY, M., PULLI, K., CURLESS, B., RUSINKIEWICZ, S., KOLLER, D., PEREIRA, L., GINZTON, M., ANDERSON, S., DAVIS, J., GINSBERG, J., SHADE, J., AND FULK, D. 2000. The digital michelangelo project: 3D scanning of large statues. In Proceedings of ACM SIGGRAPH 2000, Annual Conference Series, 131-144.
23. LIPMAN, Y., SORKINE, O., COHEN-OR, D., LEVIN, D., RÖSSL, C., AND SEIDEL, H.-P. 2004. Differential coordinates for interactive mesh editing. In Shape Modeling International, 181-190.
24. MÉNIER, C., BOYER, E., AND RAFFIN, B. 2006. 3D skeleton-based body pose recovery. In 3D Data Processing, Visualization and Transmission, 389-396.
25. MEYER, M., DESBRUN, M., SCHRÖDER, P., AND BARR, A. H. 2003. Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and Mathematics III. 35-57.
26. PARK, S. I., AND HODGINS, J. K. 2006. Capturing and animating skin deformation in human motion. ACM Transactions on Graphics 25, 3 (July), 881-889.
27. PLÄNKERS, R., AND FUA, R 2001, Articulated soft objects for video-based body modeling. In International Conference on Computer Vision, 394-401.
28. RANDER, P. W., NARAYANAN, P., AND KANADE, T. 1997. Virtualized reality: Constructing time-varying virtual worlds from real world events. In IEEE Visualization, 277-284.
29. SAND, P., MCMILLAN, L., AND POPOVIĆ, J. 2003. Continuous capture of skin deformation. ACM Transactions on Graphics 22, 3 (July), 578-586.
30. SCHOLZ, V., STICH, T., KECKEISEN, M., WACKER, M., AND MAGNOR, M. 2005. Garment motion capture using color-coded patterns. Computer Graphics Forum 24, 3 (Aug.), 439-448.
31. SEITZ, S. M., CURLESS, B., DIEBEL, J., SCHARSTEIN, D., AND SZELISKI, R. 2006. A comparison and evaluation of multiview stereo reconstruction algorithms. In Computer Vision and Pattern Recognition, 519-528.
32. STARCK, J., AND HILTON, A. 2007. Surface capture for performance based animation. IEEE Computer Graphics and Applications 27(3), 21-31.
33. SUMNER, R. W., AND POPOVIĆ, J. 2004. Deformation transferror triangle meshes. ACM Transactions on Graphics 23, 3 (Aug.), 399-405.
34. SVOBODA, T., MARTINEC, D., AND PAJDLA, T. 2005. A convenient multi-camera self-calibration for virtual environments. PRESENCE: Teleoperators and Virtual Environments 14, 4 (August), 407-422.
35. THEOBALT, C., MAGNOR, M., SCHULER, P., AND SEIDEL, H.-P. 2002. Combining 2d feature tracking and volume reconstruction for online video-based human motion capture. In Pacific Conference on Computer Graphics and Applications, 96-103.
36. THEOBALT, C., AHMED, N., LENSCH, H., MAGNOR, M., AND SEIDEL, H.-P. 2007. Seeing people in different light-joint shape, motion, and reflectance capture. IEEE Transactions on Visualization and Computer Graphics 13, 4 (July/Aug.), 663-674.
37. WANG, R. Y., PULLI, K., AND POPOVIĆ, J. 2007. Real-time enveloping with rotational regression. ACM Transactions on Graphics 26, 3 (July), 73:1-73:9.
38. WHITE, R., CRANE, K., AND FORSYTH, D. A. 2007. Capturing and animating occluded cloth. ACM Transactions on Graphics 25, 3 (July), 34:1-34:8.