Robust non-rigid motion tracking and surface reconstruction using L0 regularization

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 3083-3091

  Guo, Kaiwen ^a,b   Xu, Feng ^a,b   Wang, Yangang ^c   Liu, Yebin ^a,b   Dai, Qionghai ^a,b  

^a TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b TSINGHUA UNIVERSITY   (China)

^c MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DEFORMATION; ITERATIVE METHODS; MOTION ANALYSIS;

ARTICULATED MOTION; HUMAN BODY MOTION; ITERATIVE OPTIMIZATION; L0- REGULARIZATIONS; LOCAL DEFORMATIONS; MOTION TRACKING METHODS; NON-RIGID MOTION; RECONSTRUCTION ACCURACY;

SURFACE RECONSTRUCTION;

EID: 84973924393     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.353     Document Type: Conference Paper

References (34)

1. A. Baak, M. Müller, G. Bharaj, H.-P. Seidel, and C. Theobalt. A data-driven approach for real-time full body pose reconstruction from a depth camera. In Consumer Depth Cameras for Computer Vision. 2013.
2. I. Baran and J. Popovic. Automatic rigging and animation of 3d characters. ACM Trans. Graph, 26(3):72, 2007.
3. D. Bradley, T. Popa, A. Sheffer, W. Heidrich, and T. Boubekeur. Markerless garment capture. ACM Trans. Graph, 27(3):99, 2008.
4. C. Budd, P. Huang, M. Klaudiny, and A. Hilton. Global nonrigid alignment of surface sequences. IJCV, 102(1-3):256-270, Mar. 2013.
5. C. Cagniart, E. Boyer, and S. Ilic. Free-form mesh tracking: A patch-based approach. In CVPR, 2010.
6. C. Cagniart, E. Boyer, and S. Ilic. Probabilistic deformable surface tracking from multiple videos. In Computer Vision-ECCV 2010, pages 326-339. Springer, 2010.
7. E. De Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.-P. Seidel, and S. Thrun. Performance capture from sparse multi-view video. ACM Trans. Graph, 27(3):98, 2008.
8. M. de La Gorce, D. J. Fleet, and N. Paragios. Model-based 3d hand pose estimation from monocular video. IEEE Trans. Pattern Anal. Mach. Intell., 33(9):1793-1805, 2011.
9. M. Dou, H. Fuchs, and J.-M. Frahm. Scanning and tracking dynamic objects with commodity depth cameras. In Mixed and Augmented Reality (ISMAR), 2013.
10. J. Gall, C. Stoll, E. De Aguiar, C. Theobalt, B. Rosenhahn, and H.-P. Seidel. Motion capture using joint skeleton tracking and surface estimation. In CVPR, 2009.
11. A. Jacobson, I. Baran, J. Popovi, and O. Sorkine. Bounded biharmonic weights for real-time deformation. ACM Trans. Graph, pages 1-8, 2011.
12. H. Li, B. Adams, L. J. Guibas, and M. Pauly. Robust singleview geometry and motion reconstruction. ACM Trans. Graph, 28(5):175, 2009.
13. M. Liao, Q. Zhang, H. Wang, R. Yang, and M. Gong. Modeling deformable objects from a single depth camera. In ICCV, 2009.
14. Y. Liu, C. Stoll, J. Gall, H.-P. Seidel, and C. Theobalt. Markerless motion capture of interacting characters using multiview image segmentation. In CVPR, 2011.
15. T. B. Moeslund and E. Granum. A survey of computer vision-based human motion capture. Computer vision and image understanding, 81(3):231-268, 2001.
16. T. B. Moeslund, A. Hilton, and V. Krüger. A survey of advances in vision-based human motion capture and analysis. Computer vision and image understanding, 104(2):90-126, 2006.
17. I. Oikonomidis, N. Kyriazis, and A. A. Argyros. Full DOF tracking of a hand interacting with an object by modeling occlusions and physical constraints. In ICCV, 2011.
18. T. Popa, I. South-Dickinson, D. Bradley, A. Sheffer, and W. Heidrich. Globally consistent space-time reconstruction. Computer Graphics Forum, 2010.
19. O. Sorkine and M. Alexa. As-rigid-as-possible surface modeling. In Symposium on Geometry processing, 2007.
20. J. Starck and A. Hilton. Surface capture for performancebased animation. Computer Graphics and Applications, 27(3):21-31, 2007.
21. J. Starck and A. Hilton. Model-based human shape reconstruction from multiple views. Computer Vision and Image Understanding, 111(2):179-194, 2008.
22. R. W. Sumner, J. Schmid, and M. Pauly. Embedded deformation for shape manipulation. ACM Trans. Graph, 26(3):80, 2007.
23. R. Szeliski and S. Lavallée. Matching 3-d anatomical surfaces with non-rigid deformations using octree-splines. IJCV, 18(2):171-186, 1996.
24. D. Vlasic, I. Baran, W. Matusik, and J. Popovíc. Articulated mesh animation from multi-view silhouettes. ACM Trans. Graph, 27(3):97, 2008.
25. M. Waschbüsch, S. Würmlin, D. Cotting, F. Sadlo, and M. Gross. Scalable 3d video of dynamic scenes. The Visual Computer, 21(8-10):629-638, 2005.
26. X. Wei, P. Zhang, and J. Chai. Accurate realtime full-body motion capture using a single depth camera. ACM Trans. Graph, 31(6):188, 2012.
27. C. Wu, C. Stoll, L. Valgaerts, and C. Theobalt. On-set performance capture of multiple actors with a stereo camera. ACM Trans. Graph, 32(6):161, 2013.
28. L. Xu, C. Lu, Y. Xu, and J. Jia. Image smoothing via l0 gradient minimization. ACM Trans. Graph, 30(6):174, 2011.
29. G. Ye, Y. Liu, N. Hasler, X. Ji, Q. Dai, and C. Theobalt. Performance capture of interacting characters with handheld kinects. In ECCV. 2012.
30. M. Ye, X. Wang, R. Yang, L. Ren, and M. Pollefeys. Accurate 3d pose estimation from a single depth image. In ICCV, 2011.
31. M. Ye and R. Yang. Real-time simultaneous pose and shape estimation for articulated objects using a single depth camera. In CVPR, 2014.
32. Q. Zhou, S. Miller, and V. Koltun. Elastic fragments for dense scene reconstruction. In ICCV, 2013.
33. Y. Zhu, D. Huang, F. De La Torre, and S. Lucey. Complex non-rigid motion 3d reconstruction by union of subspaces. June 2014.
34. M. Zollhöfer, M. Nießner, S. Izadi, C. Rehmann, C. Zach, M. Fisher, C. Wu, A. Fitzgibbon, C. Loop, and C. Theobalt. Real-time Non-rigid Reconstruction using an RGB-D Camera. ACM Trans. Graph, 33(4):156, 2014.