Scalable real-time volumetric surface reconstruction

ACM Transactions on Graphics

Volumn 32, Issue 4, 2013, Pages

  Chen, Jiawen ^a   Bautembach, Dennis ^a   Izadi, Shahram ^a  

^a MICROSOFT RESEARCH   (United Kingdom)

Author keywords

GPU; Hierarchical grid; Kinect; Real time; Scalability; Streaming; Volumetric surface reconstruction

Indexed keywords

CAMERA POSE ESTIMATION; GPU; HIERARCHICAL DATA STRUCTURE; HIERARCHICAL GRID; KINECT; REAL-TIME; SPARSE DATA STRUCTURES; VOLUMETRIC REPRESENTATION;

ACOUSTIC STREAMING; CAMERAS; DATA STRUCTURES; SCALABILITY;

SURFACE RECONSTRUCTION;

EID: 84880825691     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2461912.2461940     Document Type: Article

References (48)

1. ALLIEZ, P., COHEN-STEINER, D., TONG, Y., AND DESBRUN, M. 2007. Voronoi-based variational reconstruction of unoriented point sets. In Proc. SGP 2007, vol. 257, Eurographics, 39-48.
2. AMANATIDES, J., AND WOO, A. 1987. A fast voxel traversal algorithm for ray tracing. In Proc. Eurographics, vol. 87, 3-10.
3. BESL, P., AND MCKAY, N. 1992. A method for registration of 3-D shapes. IEEE Trans. PAMI 14, 2, 239-256.
4. BOLITHO, M., KAZHDAN, M., BURNS, R., AND HOPPE, H. 2007. Multilevel streaming for out-of-core surface reconstruction. In Proc. SGP 2007, vol. 257, Eurographics, 69-78.
5. CHANG, C., CHATTERJEE, S., AND KUBE, P. R. 1994. A quantization error analysis for convergent stereo. In Proc. ICIP 94, vol. 2, IEEE, 735-739.
6. CHEN, Y., AND MEDIONI, G. 1992. Object modelling by registration of multiple range images. Image and vision computing 10, 3, 145-155.
7. CHIEN, C., SIM, Y., AND AGGARWAL, J. 1988. Generation of volume/surface octree from range data. In Proc. CVPR 98, IEEE, 254-260.
8. CONNOLLY, C. 1984. Cumulative generation of octree models from range data. In Proc. ICRA 84, vol. 1, IEEE, 25-32.
9. CRASSIN, C., NEYRET, F., LEFEBVRE, S., AND EISEMANN, E. 2009. GigaVoxels: Ray-guided streaming for efficient and detailed voxel rendering. In Proc. I3D 2009, ACM, 15-22.
10. CUI, Y., SCHUON, S., CHAN, D., THRUN, S., AND THEOBALT, C. 2010. 3D shape scanning with a time-of-flight camera. In Proc. CVPR 2010, IEEE, 1173-1180.
11. CURLESS, B., AND LEVOY, M. 1996. A volumetric method for building complex models from range images. In Proceedings of SIGGRAPH 96, Annual Conference Series, 303-312.
12. FRISKEN, S., PERRY, R., ROCKWOOD, A., AND JONES, T. 2000. Adaptively sampled distance fields: a general representation of shape for computer graphics. In Proceedings of SIGGRAPH 2000, Annual Conference Series, 249-254.
13. FUHRMANN, S., AND GOESELE, M. 2011. Fusion of depth maps with multiple scales. ACM Trans. Graph. 30, 6 (December), 148:1-148:8.
14. GREENE, N., KASS, M., MILLER, G., ET AL. 1993. Hierarchical z-buffer visibility. In Proceedings of SIGGRAPH 93, Annual Conference Series, 231-238.
15. HENRY, P., KRAININ, M., HERBST, E., REN, X., AND FOX, D. 2010. RGB-D mapping: Using depth cameras for dense 3D modeling of indoor environments. In Proc. ISER, vol. 20, 22-25.
16. HIGUCHI, K., HEBERT, M., AND IKEUCHI, K. 1995. Building 3-d models from unregistered range images. Graphical models and image processing 57, 4, 315-333.
17. HILTON, A., STODDART, A., ILLINGWORTH, J., AND WINDEATT, T. 1996. Reliable surface reconstruction from multiple range images. Computer Vision (Proc. ECCV 96), 117-126.
18. HILTON, A., STODDART, A. J., ILLINGWORTH, J., AND WINDEATT, T. 1998. Implicit surface-based geometric fusion. Computer Vision and Image Understanding 69, 3, 273-291.
19. HOPPE, H., DEROSE, T., DUCHAMP, T., MCDONALD, J., AND STUETZLE, W. 1992. Surface reconstruction from unorganized points. In Computer Graphics, vol. 26, 71-78.
20. HORNUNG, A., WURM, K. M., BENNEWITZ, M., STACHNISS, C., AND BURGARD, W. 2013. OctoMap: An efficient probabilistic 3D mapping framework based on octrees. Autonomous Robots 34, 3, 189-206.
21. IZADI, S., KIM, D., HILLIGES, O., MOLYNEAUX, D., NEWCOMBE, R., KOHLI, P., SHOTTON, J., HODGES, S., FREEMAN, D., DAVISON, A., ET AL. 2011. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In Proc. UIST 2011, ACM, 559-568.
22. KAZHDAN, M., BOLITHO, M., AND HOPPE, H. 2006. Poisson surface reconstruction. In Proc. SGP 2006, vol. 256, Eurographics, 61-70.
23. LAINE, S., AND KARRAS, T. 2010. Efficient sparse voxel octrees. In Proc. I3D 2010, ACM, 55-63.
24. LEVOY, M., PULLI, K., CURLESS, B., RUSINKIEWICZ, S., KOLLER, D., PEREIRA, L., GINZTON, M., ANDERSON, S., DAVIS, J., GINSBERG, J., ET AL. 2000. The digital michelangelo project: 3D scanning of large statues. In Proceedings of SIGGRAPH 2000, Annual Conference Series, 131-144.
25. LORENSEN, W., AND CLINE, H. 1987. Marching cubes: A high resolution 3d surface construction algorithm. In Computer Graphics, vol. 21, 163-169.
26. MUSIALSKI, P., WONKA, P., ALIAGA, D., WIMMER, M., VAN GOOL, L., PURGATHOFER, W., MITRA, N., PAULY, M., WAND, M., CEYLAN, D., ET AL. 2012. A survey of urban reconstruction. In Proc. Eurographics 2012 STARs, Eurographics, 1-28.
27. NEWCOMBE, R., AND DAVISON, A. J. 2010. Live dense reconstruction with a single moving camera. In Proc. CVPR 2010, IEEE, 1498-1505.
28. NEWCOMBE, R., LOVEGROVE, S. J., AND DAVISON, A. J. 2011. DTAM: Dense tracking and mapping in real-time. In Proc. ICCV 2011, IEEE, 2320-2327.
29. NEWCOMBE, R. A., IZADI, S., HILLIGES, O., MOLYNEAUX, D., KIM, D., DAVISON, A. J., KOHLI, P., SHOTTON, J., HODGES, S., AND FITZGIBBON, A. 2011. KinectFusion: Real-time dense surface mapping and tracking. In Proc. ISMAR, IEEE, 127-136.
30. NGUYEN, C., IZADI, S., AND LOVELL, D. 2012. Modeling Kinect sensor noise for improved 3D reconstruction and tracking. In Proc. 3DIMPVT 2012, IEEE, 524-530.
31. OSHER, S., AND FEDKIW, R. P. 2003. Level set methods and dynamic implicit surfaces. Applied mathematical science. Springer, New York, N.Y.
32. PARKER, S., SHIRLEY, P., LIVNAT, Y., HANSEN, C., AND SLOAN, P.-P. 1998. Interactive ray tracing for isosurface rendering. In Proc. Visualization 98, IEEE, 233-238.
33. POLLEFEYS, M., VAN GOOL, L., VERGAUWEN, M., VERBIEST, F., CORNELIS, K., TOPS, J., AND KOCH, R. 2004. Visual modeling with a hand-held camera. IJCV 2004 59, 3, 207-232.
34. POLLEFEYS, M., NISTÉR, D., FRAHM, J., AKBARZADEH, A., MORDOHAI, P., CLIPP, B., ENGELS, C., GALLUP, D., KIM, S., MERRELL, P., ET AL. 2008. Detailed real-time urban 3D reconstruction from video. IJCV 2008 78, 2, 143-167.
35. POTMESIL, M. 1987. Generating octree models of 3d objects from their silhouettes in a sequence of images. Computer Vision, Graphics, and Image Processing 40, 1, 1-29.
36. ROTH, H., AND VONA, M. 2012. Moving volume KinectFusion. In Proc. BMVC 2012, BMVA Press, 112.1-112.11.
37. RUSINKIEWICZ, S., HALL-HOLT, O., AND LEVOY, M. 2002. Real-time 3D model acquisition. ACM Trans. Graph. 21, 3 (July), 438-446.
38. SEITZ, S., CURLESS, B., DIEBEL, J., SCHARSTEIN, D., AND SZELISKI, R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In Proc. CVPR 2006, vol. 1, IEEE, 519-528.
39. STÜCKLER, J., AND BEHNKE, S. 2012. Robust real-time registration of RGB-D images using multi-resolution surfel representations. In Proc. ROBOTIK 2012, VDE, 1-4.
40. SZELISKI, R. 1993. Rapid octree construction from image sequences. CVGIP Image Understanding 58, 23-23.
41. THRUN, S., BURGARD, W., FOX, D., ET AL. 2005. Probabilistic Robotics. MIT Press, Cambridge, MA.
42. TURK, G., AND LEVOY, M. 1994. Zippered polygon meshes from range images. In Proceedings of SIGGRAPH 94, Annual Conference Series, 311-318.
43. WEISE, T., WISMER, T., LEIBE, B., AND VAN GOOL, L. 2009. In-hand scanning with online loop closure. In Proc. ICCV 2009 Workshops, IEEE, 1630-1637.
44. WHEELER, M., SATO, Y., AND IKEUCHI, K. 1998. Consensus surfaces for modeling 3D objects from multiple range images. In Proc. ICCV 98, IEEE, 917-924.
45. WHELAN, T., KAESS, M., FALLON, M., JOHANNSSON, H., LEONARD, J., AND MCDONALD, J. 2012. Kintinuous: Spatially extended KinectFusion. In Proc. RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras.
46. ZACH, C., POCK, T., AND BISCHOF, H. 2007. A globally optimal algorithm for robust TV-L1 range image integration. In Proc. ICCV 2007, IEEE, 1-8.
47. ZENG, M., ZHAO, F., ZHENG, J., AND LIU, X. 2013. Octree-based fusion for realtime 3d reconstruction. Graphical Models 75, 3 (May), 126-136.
48. ZHOU, K., GONG, M., HUANG, X., AND GUO, B. 2011. Dataparallel octrees for surface reconstruction. IEEE Trans. Visualization and Computer Graphics 17, 5, 669-681.