DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 343-352

  Newcombe, Richard A ^a   Fox, Dieter ^a   Seitz, Steven M ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION;

KINECTFUSION; MOTION FIELDS; MOVING OBJECTS; NON-RIGID; REAL TIME; SCENE MODEL; UPDATED MODEL;

PATTERN RECOGNITION;

EID: 84958227024     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298631     Document Type: Conference Paper

References (37)

1. B. Brown and S. Rusinkiewicz. Non-Rigid Range-Scan Alignment Using Thin-Plate Splines. In Symposium on 3D Data Processing, Visualization, and Transmission, Sept. 2004
2. B. J. Brown and S. Rusinkiewicz. Global Non-rigid Alignment of 3-D Scans. ACM Trans. Graph., 26(3), July 2007
3. C. Cao, Y. Weng, S. Lin, and K. Zhou. 3D Shape Regression for Real-time Facial Animation. ACM Trans. Graph., 32(4):41:1-41:10, July 2013
4. W. Chang and M. Zwicker. Range Scan Registration Using Reduced Deformable Models. Comput. Graph. Forum, 28(2):447-456, 2009
5. B. Curless and M. Levoy. A volumetric method for building complex models from range images. In Proceedings of SIGGRAPH, 1996
6. B. L. Curless. New Methods for Surface Reconstruction from Range Images. PhD thesis, Stanford University, 1997
7. M. Dou and H. Fuchs. Temporally enhanced 3D capture of room-sized dynamic scenes with commodity depth cameras. In Virtual Reality (VR), 2014 iEEE, pages 39-44, March 2014
8. M. Dou, H. Fuchs, and J.-M. Frahm. Scanning and tracking dynamic objects with commodity depth cameras. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on, 2013
9. P. Henry, D. Fox, A. Bhowmik, and R. Mongia. Patch Volumes: Segmentation-based Consistent Mapping with RGBD Cameras. In International Conference on 3D Vision (3DV), 2013
10. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. A. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. J. Davison, and A. Fitzgibbon. KinectFusion: Real-Time 3D Reconstruction and Interaction Using a Moving Depth Camera. In Proceedings of ACM Symposium on User Interface Software and Technolog (UIST), 2011
11. L. Kavan, S. Collins, J. Z ára, and C. O'Sullivan. Skinning with Dual Quaternions. In Proceedings of the 2007 Sympo-sium on Interactive 3D Graphics and Games, I3D '07, pages 39-46, New York, NY, USA, 2007. ACM
12. H. Li, B. Adams, L. J. Guibas, and M. Pauly. Robust Singleview Geometry and Motion Reconstruction. ACM Trans. Graph., 28(5):175:1-175:10, Dec. 2009
13. H. Li, L. Luo, D. Vlasic, P. Peers, J. Popovíc, M. Pauly, and S. Rusinkiewicz. Temporally Coherent Completion of Dynamic Shapes. ACM Transactions on Graphics, 31(1), January 2012
14. H. Li, R. W. Sumner, and M. Pauly. Global Correspondence Optimization for Non-Rigid Registration of Depth Scans. Computer Graphics Forum (Proc. SGP'08), 27(5), July 2008
15. H. Li, E. Vouga, A. Gudym, L. Luo, J. T. Barron, and G. Gusev. 3D Self-Portraits. ACM Transactions on Graphics (Pro-ceedings SIGGRAPH Asia 2013), 32(6), November 2013
16. H. Li, J. Yu, Y. Ye, and C. Bregler. Realtime Facial Animation with On-the-fly Correctives. ACM Transactions on Graphics, 32(4), July 2013
17. N. J. Mitra, S. Flöry, M. Ovsjanikov, N. Gelfand, L. Guibas, and H. Pottmann. Dynamic Geometry Registration. In Pro-ceedings of the Fifth Eurographics Symposium on Geometry Processing, SGP '07, pages 173-182, Aire-la-Ville, Switzerland, Switzerland, 2007. Eurographics Association
18. R. A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohli, J. Shotton, S. Hodges, and A. Fitzgibbon. KinectFusion: Real-Time Dense Surface Mapping and Tracking. In Proceedings of the Inter-national Symposium on Mixed and Augmented Reality (IS-MAR), 2011
19. M. Nießner, M. Zollhöfer, S. Izadi, and M. Stamminger. Real-time 3d reconstruction at scale using voxel hashing. ACM Transactions on Graphics (TOG), 32(6):169, 2013
20. I. Oikonomidis, N. Kyriazis, and A. Argyros. Efficient model-based 3D tracking of hand articulations using Kinect. In BMVC. BMVA, 2011
21. C. Qian, X. Sun, Y. Wei, X. Tang, and J. Sun. Realtime and Robust Hand Tracking from Depth. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1106-1113, June 2014
22. H. Roth and M. Vona. Moving Volume KinectFusion. In Pro-ceedings of the British Machine Vision Conference (BMVC), 2012
23. T. Schmidt, R. Newcombe, and D. Fox. DART: Dense Articulated Real-Time Tracking. Proceedings of Robotics: Sci-ence and Systems, Berkeley, USA, 2014
24. A. Sharf, D. A. Alcantara, T. Lewiner, C. Greif, A. Sheffer, N. Amenta, and D. Cohen-Or. Space-time surface reconstruction using incompressible flow. ACM Trans. Graph., 27(5):110, 2008
25. R. W. Sumner, J. Schmid, and M. Pauly. Embedded deformation for shape manipulation. ACM Trans. Graph., 26(3):80, 2007
26. J. Süssmuth, M. Winter, and G. Greiner. Reconstructing Animated Meshes from Time-varying Point Clouds. In Pro-ceedings of the Symposium on Geometry Processing, SGP '08, pages 1469-1476, Aire-la-Ville, Switzerland, Switzerland, 2008. Eurographics Association
27. J. Taylor, J. Shotton, T. Sharp, and A. Fitzgibbon. The Vitruvian manifold: Inferring dense correspondences for oneshot human pose estimation. In Computer Vision and Pat-tern Recognition (CVPR), 2012 IEEE Conference on, pages 103-110. IEEE, 2012
28. A. Tevs, A. Berner, M. Wand, I. Ihrke, M. Bokeloh, J. Kerber, and H.-P. Seidel. Animation Cartography&Mdash;Intrinsic Reconstruction of Shape and Motion. ACM Trans. Graph., 31(2):12:1-12:15, Apr. 2012
29. M. Wand, B. Adams, M. Ovsjanikov, A. Berner, M. Bokeloh, P. Jenke, L. Guibas, H.-P. Seidel, and A. Schilling. Efficient Reconstruction of Nonrigid Shape and Motion from Realtime 3D Scanner Data. ACM Trans. Graph., 28(2):15:1-15:15, May 2009
30. M. Wand, P. Jenke, Q. Huang, M. Bokeloh, L. Guibas, and A. Schilling. Reconstruction of Deforming Geometry from Time-varying Point Clouds. In Proceedings of the Fifth Eu-rographics Symposium on Geometry Processing, SGP '07, pages 49-58, Aire-la-Ville, Switzerland, Switzerland, 2007. Eurographics Association
31. T. Whelan, M. Kaess, J. Leonard, and J. McDonald. Deformation-based loop closure for large scale dense RGBD SLAM. In Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on, pages 548-555, Nov 2013
32. T. Whelan, J. McDonald, M. Kaess, M. Fallon, H. Johannsson, and J. J. Leonard. Kintinuous: Spatially Extended KinectFusion. InWorkshop on RGB-D: Advanced Reasoning with Depth Cameras, in conjunction with Robotics: Science and Systems, 2012
33. M. Ye and R. Yang. Real-Time Simultaneous Pose and Shape Estimation for Articulated Objects Using a Single Depth Camera. In Computer Vision and Pattern Recogni-tion (CVPR), 2014 IEEE Conference on, pages 2353-2360, June 2014
34. M. Zeng, F. Zhao, J. Zheng, and X. Liu. A Memory-Efficient KinectFusion Using Octree. In Computational Visual Media, volume 7633, pages 234-241. 2012
35. M. Zeng, J. Zheng, X. Cheng, and X. Liu. Templateless Quasi-rigid Shape Modeling with Implicit Loop-Closure. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 145-152, June 2013
36. Q. Zhang, B. Fu, M. Ye, and R. Yang. Quality Dynamic Human Body Modeling Using a Single Low-cost Depth Camera. In The IEEE Conference on Computer Vision and Pat-tern Recognition (CVPR), June 2014
37. M. Zollhöfer, M. Niessner, S. Izadi, C. Rehmann, C. Zach, M. Fisher, C. Wu, A. Fitzgibbon, C. Loop, C. Theobalt, and M. Stamminger. Real-time Non-rigid Reconstruction Using an RGB-D Camera. ACM Trans. Graph., 33(4), July 2014.