Real-time 3D reconstruction at scale using voxel hashing

ACM Transactions on Graphics

Volumn 32, Issue 6, 2013, Pages

  Niesner, Matthias ^a,c   Zollhöfer, Michael ^a   Izadi, Shahram ^b   Stamminger, Marc ^a  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^b MICROSOFT RESEARCH   (United Kingdom)

^c STANFORD UNIVERSITY   (United States)

Author keywords

Data structure; GPU; Real time reconstruction; Scalable

Indexed keywords

CAMERA POSE ESTIMATION; EFFICIENT DATA STRUCTURES; GPU; REAL-TIME 3D RECONSTRUCTION; REAL-TIME RECONSTRUCTION; RECONSTRUCTION QUALITY; SCALABLE; VOLUMETRIC RECONSTRUCTION;

CAMERAS; DATA STRUCTURES; ONLINE SYSTEMS;

THREE DIMENSIONAL;

EID: 84887850788     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2508363.2508374     Document Type: Article

References (46)

1. ALCANTARA, D. A., SHARF, A., ABBASINEJAD, F., SENGUPTA, S., MITZENMACHER, M., OWENS, J. D., AND AMENTA, N. 2009. Real-time parallel hashing on the GPU. ACM Transactions on Graphics (TOG) 28, 5, 154.
2. AMANATIDES, J., AND WOO, A. 1987. A fast voxel traversal algorithm for ray tracing. In Proc. Eurographics, vol. 87, 3-10.
3. BASTOS, T., AND CELES, W. 2008. Gpu-accelerated adaptively sampled distance fields. In Shape Modeling and Applications, 2008. SMI 2008. IEEE International Conference on, IEEE, 171- 178.
4. BESL, P., AND MCKAY, N. 1992. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. and Mach. Intell. 14, 2, 239-256.
5. CHANG, C., CHATTERJEE, S., AND KUBE, P. R. 1994. A quantization error analysis for convergent stereo. In Proc. ICIP 94, vol. 2, IEEE, 735-739.
6. CHEN, Y., AND MEDIONI, G. 1992. Object modelling by registration of multiple range images. Image and Vision Computing 10, 3, 145-155.
7. CHEN, J., BAUTEMBACH, D., AND IZADI, S. 2013. Scalable real-time volumetric surface reconstruction. ACM Transactions on Graphics (TOG) 32, 4, 113.
8. CRASSIN, C., NEYRET, F., LEFEBVRE, S., AND EISEMANN, E. 2009. Gigavoxels: Ray-guided streaming for efficient and detailed voxel rendering. In Proc. Symp. Interactive 3D Graphics and Games, ACM, 15-22.
9. CURLESS, B., AND LEVOY, M. 1996. A volumetric method for building complex models from range images. In In Proc. Computer graphics and interactive techniques, ACM, 303-312.
10. GALLUP, D., POLLEFEYS, M., AND FRAHM, J.-M. 2010. 3D reconstruction using an n-layer heightmap. In Pattern Recognition. Springer, 1-10.
11. GARCIA, I., LEFEBVRE, S., HORNUS, S., AND LASRAM, A. 2011. Coherent parallel hashing. ACM Transactions on Graphics (TOG) 30, 6, 161.
12. GROSS, M., AND PFISTER, H. 2007. Point-based graphics. Morgan Kaufmann.
13. HADWIGER, M., BEYER, J., JEONG, W.-K., AND PFISTER, H. 2012. Interactive volume exploration of petascale microscopy data streams using a visualization-driven virtual memory approach. Visualization and Computer Graphics, IEEE Transactions on 18, 12, 2285-2294.
14. HARRIS, M., SENGUPTA, S., AND OWENS, J. D. 2007. Parallel prefix sum (scan) with cuda. GPU gems 3, 39, 851-876.
15. HENRY, P., KRAININ, M., HERBST, E., REN, X., AND FOX, D. 2012. RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments. Int. J. Robotics Research 31 (Apr.), 647-663.
16. HIGUCHI, K., HEBERT, M., AND IKEUCHI, K. 1995. Building 3-D models from unregistered range images. Graphical Models and Image Processing 57, 4, 315-333.
17. HILTON, A., STODDART, A., ILLINGWORTH, J., AND WINDEATT, T. 1996. Reliable surface reconstruction from multiple range images. J. Computer Vision (Proc. ECCV), 117-126.
18. HOPPE, H., DEROSE, T., DUCHAMP, T., MCDONALD, J., AND STUETZLE, W. 1992. Surface reconstruction from unorganized points. ACM SIGGRAPH Computer Graphics 26, 2, 71-78.
19. IZADI, S., KIM, D., HILLIGES, O., MOLYNEAUX, D., NEWCOMBE, R., KOHLI, P., SHOTTON, J., HODGES, S., FREEMAN, D., DAVISON, A., AND FITZGIBBON, A. 2011. KinectFusion: Real-time 3D reconstruction and interaction using a moving depth camera. In Proc. ACM Symp. User Interface Software and Technology, 559-568.
20. JOHNSON, A. E., AND BING KANG, S. 1999. Registration and integration of textured 3d data. Image and vision computing 17, 2, 135-147.
21. KäMPE, V., SINTORN, E., AND ASSARSSON, U. 2013. High resolution sparse voxel dags. ACM Transactions on Graphics (TOG) 32, 4, 101.
22. KAZHDAN, M., BOLITHO, M., AND HOPPE, H. 2006. Poisson surface reconstruction. In Proc. EG Symp. Geometry Processing.
23. KELLER, M., LEFLOCH, D., LAMBERS, M., IZADI, S., WEYRICH, T., AND KOLB, A. 2013. Real-time 3d reconstruction in dynamic scenes using point-based fusion. In Proc. of Joint 3DIM/3DPVT Conference (3DV), IEEE, 1-8.
24. KRAUS, M., AND ERTL, T. 2002. Adaptive texture maps. In Proc. of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, Eurographics Association, 7-15.
25. LAINE, S., AND KARRAS, T. 2011. Efficient sparse voxel octrees. Visualization and Computer Graphics, IEEE Transactions on 17, 8, 1048-1059.
26. LEFEBVRE, S., AND HOPPE, H. 2006. Perfect spatial hashing. ACM Transactions on Graphics (TOG) 25, 3, 579-588.
27. LEFEBVRE, S., HORNUS, S., AND NEYRET, F., 2005. Gpu gems 2. chapter 37: Octree textures on the gpu.
28. LEVOY, M., PULLI, K., CURLESS, B., RUSINKIEWICZ, S., KOLLER, D., PEREIRA, L., GINZTON, M., ANDERSON, S., DAVIS, J., GINSBERG, J., ET AL. 2000. The digital michelangelo project: 3D scanning of large statues. In In Proc. Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., 131-144.
29. LORENSEN, W., AND CLINE, H. 1987. Marching cubes: A high resolution 3D surface construction algorithm. Computer Graphics 21, 4, 163-169.
30. LOW, K.-L. 2004. Linear least-squares optimization for point-toplane icp surface registration. Tech. rep., Chapel Hill, University of North Carolina.
31. NEWCOMBE, R. A., IZADI, S., HILLIGES, O., MOLYNEAUX, D., KIM, D., DAVISON, A. J., KOHLI, P., SHOTTON, J., HODGES, S., AND FITZGIBBON, A. 2011. KinectFusion: Real-time dense surface mapping and tracking. In Proc. IEEE Int. Symp. Mixed and Augmented Reality, 127-136.
32. NGUYEN, C., IZADI, S., AND LOVELL, D. 2012. Modeling Kinect sensor noise for improved 3D reconstruction and tracking. In Proc. Int. Conf. 3D Imaging, Modeling, Processing, Visualization and Transmission, 524-530.
33. PAN, J., AND MANOCHA, D. 2011. Fast gpu-based locality sensitive hashing for k-nearest neighbor computation. In Proc. of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM, 211-220.
34. POLLEFEYS, M., NIST ÉR, D., FRAHM, J., AKBARZADEH, A., MORDOHAI, P., CLIPP, B., ENGELS, C., GALLUP, D., KIM, S., MERRELL, P., ET AL. 2008. Detailed real-time urban 3D reconstruction from video. Int. J. Comp. Vision 78, 2, 143-167.
35. REICHL, F., CHAJDAS, M. G., BÜRGER, K., AND WESTERMANN, R. 2012. Hybrid sample-based surface rendering. In Vision, Modeling & Visualization, The Eurographics Association, 47-54.
36. ROTH, H., AND VONA, M. 2012. Moving volume KinectFusion. In British Machine Vision Conf.
37. RUSINKIEWICZ, S., HALL-HOLT, O., AND LEVOY, M. 2002. Real-time 3D model acquisition. ACM Transactions on Graphics (TOG) 21, 3, 438-446.
38. ST ÜCKLER, J., AND BEHNKE, S. 2012. Integrating depth and color cues for dense multi-resolution scene mapping using rgb-d cameras. In Proc. of the IEEE Int. Conf. on Multisensor Fusion and Information Integration (MFI),(Hamburg, Germany).
39. TESCHNER, M., HEIDELBERGER, B., MÜLLER, M., POMERANETS, D., AND GROSS, M. 2003. Optimized spatial hashing for collision detection of deformable objects. In Proc.of Vision, Modeling, Visualization VMV03, 47-54.
40. TURK, G., AND LEVOY, M. 1994. Zippered polygon meshes from range images. In In Proc. Computer graphics and interactive techniques, 311-318.
41. WEISE, T.,WISMER, T., LEIBE, B., AND VAN GOOL, L. 2009. In-hand scanning with online loop closure. In Proc. IEEE Int. Conf. Computer Vision Workshops, 1630-1637.
42. WHEELER, M., SATO, Y., AND IKEUCHI, K. 1998. Consensus surfaces for modeling 3D objects from multiple range images. In Proc. IEEE Int. Conf. Computer Vision, 917-924.
43. WHELAN, T., JOHANNSSON, H., KAESS, M., LEONARD, J., AND MCDONALD, J. 2012. Robust tracking for real-time dense rgb-d mapping with kintinuous. Tech. rep. Query date: 2012-10-25.
44. ZENG, M., ZHAO, F., ZHENG, J., AND LIU, X. 2012. Octree-based fusion for realtime 3D reconstruction. Graphical Models.
45. ZHOU, Q.-Y., AND KOLTUN, V. 2013. Dense scene reconstruction with points of interest. ACM Transactions on Graphics (TOG) 32, 4, 112.
46. ZHOU, K., GONG, M., HUANG, X., AND GUO, B. 2011. Dataparallel octrees for surface reconstruction. IEEE Trans. Vis. and Comp. Graph. 17, 5, 669-681.