3D scanning deformable objects with a single RGBD sensor

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 493-501

  Dou, Mingsong ^a   Taylor, Jonathan ^b   Fuchs, Henry ^a   Fitzgibbon, Andrew ^b   Izadi, Shahram ^b  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; IMAGE REGISTRATION; PATTERN RECOGNITION; SCANNING;

ALIGNMENT ERROR; BUNDLE ADJUSTMENTS; CAMERA MOTIONS; DEFORMABLE OBJECT; FREE-FORM DEFORMATION; GROUND TRUTH DATA; NON-RIGID DEFORMATION; OBJECT SCANNING;

DEFORMATION;

EID: 84959196032     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298647     Document Type: Conference Paper

References (29)

1. S. Agarwal, K. Mierle, and Others. Ceres solver. http: //ceres-solver. org
2. T. J. Cashman and A. W. Fitzgibbon. What shape are dolphins? building 3d morphable models from 2d images. Pat-tern Analysis and Machine Intelligence, IEEE Transactions on, 35(1):232-244, 2013
3. Y. Cui, W. Chang, T. Nöll, and D. Stricker. Kinectavatar: fully automatic body capture using a single kinect. In Computer Vision-ACCV 2012 Workshops, pages 133-147. Springer, 2013
4. E. de Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.-P. Seidel, and S. Thrun. Performance capture from sparse multi-view video. ACM TOG (Proc. SIGGRAPH), 27:1-10, 2008
5. M. Dou, H. Fuchs, and J.-M. Frahm. Scanning and tracking dynamic objects with commodity depth cameras. In Proc. ISMAR, pages 99-106. IEEE, 2013
6. J. Gall, C. Stoll, E. De Aguiar, C. Theobalt, B. Rosenhahn, and H.-P. Seidel. Motion capture using joint skeleton tracking and surface estimation. In IEEE Conf. CVPR, 2009
7. T. Helten, A. Baak, G. Bharaj, M. Muller, H.-P. Seidel, and C. Theobalt. Personalization and evaluation of a real-time depth-based full body tracker. In Proc. 3DV, pages 279-286, 2013
8. C. Hernández, G. Vogiatzis, G. J. Brostow, B. Stenger, and R. Cipolla. Non-rigid photometric stereo with colored lights. In Proc. ICCV, pages 1-8. IEEE, 2007
9. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, et al. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology, pages 559-568. ACM, 2011
10. H. Li, B. Adams, L. J. Guibas, and M. Pauly. Robust singleview geometry and motion reconstruction. ACM Trans-actions on Graphics (Proceedings SIGGRAPH Asia 2009), 28(5), December 2009
11. H. Li, E. Vouga, A. Gudym, L. Luo, J. T. Barron, and G. Gusev. 3d self-portraits. ACM Trans. Graph., 32(6):187, 2013
12. M. Liao, Q. Zhang, H. Wang, R. Yang, and M. Gong. Modeling deformable objects from a single depth camera. In Proc. ICCV, pages 167-174. IEEE, 2009
13. N. J. Mitra, S. Flöry, M. Ovsjanikov, N. Gelfand, L. J. Guibas, and H. Pottmann. Dynamic geometry registration. In Proc. SGP, pages 173-182, 2007
14. R. A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohi, J. Shotton, S. Hodges, and A. Fitzgibbon. Kinectfusion: Real-time dense surface mapping and tracking. In Mixed and augmented reality (ISMAR), 2011 10th IEEE international symposium on, pages 127-136. IEEE, 2011
15. R. W. Sumner, J. Schmid, and M. Pauly. Embedded deformation for shape manipulation. In SIGGRAPH, 2007
16. J. Taylor, R. Stebbing, V. Ramakrishna, C. Keskin, J. Shotton, S. Izadi, A. Hertzmann, and A. Fitzgibbon. User-specific hand modeling from monocular depth sequences. In Com-puter Vision and Pattern Recognition (CVPR). IEEE, 2014
17. A. Tevs, A. Berner, M. Wand, I. Ihrke, M. Bokeloh, J. Kerber, and H.-P. Seidel. Animation cartography-intrinsic reconstruction of shape and motion. ACM TOG, 31(2):12, 2012
18. J. Tong, J. Zhou, L. Liu, Z. Pan, and H. Yan. Scanning 3D full human bodies using Kinects. TVCG, 18(4):643-650, 2012
19. L. Valgaerts, C. Wu, A. Bruhn, H.-P. Seidel, and C. Theobalt. Lightweight binocular facial performance capture under uncontrolled lighting. ACM TOG (Proc. SIGGRAPH Asia), 31(6):187, November 2012
20. D. Vlasic, I. Baran, W. Matusik, and J. Popovíc. Articulated mesh animation from multi-view silhouettes. ACM TOG (Proc. SIGGRAPH), 2008
21. D. Vlasic, P. Peers, I. Baran, P. Debevec, J. Popovíc, S. Rusinkiewicz, and W. Matusik. Dynamic shape capture using multi-view photometric stereo. ACM Transactions on Graphics (TOG), 28(5):174, 2009
22. M. Wand, B. Adams, M. Ovsjanikov, A. Berner, M. Bokeloh, P. Jenke, L. Guibas, H.-P. Seidel, and A. Schilling. Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data. ACM TOG, 28:15, 2009
23. T. Weise, S. Bouaziz, H. Li, and M. Pauly. Realtime performance-based facial animation. ACM TOG, 30(4):77, 2011
24. A. Weiss, D. A. Hirshberg, and M. J. Black. Home 3d body scans from noisy image and range data. In Int. Conf. on Com-puter Vision (ICCV), 2011
25. C. Wu, C. Stoll, L. Valgaerts, and C. Theobalt. On-set performance capture of multiple actors with a stereo camera. ACM TOG, 32(6):161, 2013
26. G. Ye, Y. Liu, N. Hasler, X. Ji, Q. Dai, and C. Theobalt. Performance capture of interacting characters with handheld kinects. In Proc. ECCV, pages 828-841. Springer, 2012
27. M. Zeng, J. Zheng, X. Cheng, and X. Liu. Templateless quasi-rigid shape modeling with implicit loop-closure. In Computer Vision and Pattern Recognition (CVPR), pages 145-152. IEEE, 2013
28. Q. Zhang, B. Fu, M. Ye, and R. Yang. Quality dynamic human body modeling using a single low-cost depth camera. In Computer Vision and Pattern Recognition (CVPR), pages 676-683. IEEE, 2014
29. M. Zollhöfer, M. Nießner, S. Izadi, C. Rehmann, C. Zach, M. Fisher, C. Wu, A. Fitzgibbon, C. Loop, C. Theobalt, and M. Stamminger. Real-time non-rigid reconstruction using an rgb-d camera. ACM Transactions on Graphics (TOG), 33(4), 2014.