Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices

IEEE Transactions on Visualization and Computer Graphics

Volumn 21, Issue 11, 2015, Pages 1241-1250

  Kähler, Olaf ^a   Prisacariu, Victor Adrian ^a   Ren, Carl Yuheng ^a   Sun, Xin ^a   Torr, Philip ^a   Murray, David ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

3D modelling; camera tracking; Kinect; mobile devices; real time; volumetric

Indexed keywords

CAMERAS; INTEGRATION; MOBILE DEVICES; MOBILE TELECOMMUNICATION SYSTEMS; PROGRAM PROCESSORS;

3D MODELLING; CAMERA TRACKING; KINECT; REAL TIME; VOLUMETRIC;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84943742416     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2015.2459891     Document Type: Article

References (28)

1. A. Baskeheev. An open source implementation of kinectfusion. http://play.pointclouds.org/news/2011/12/08/kinectfusion-open-source/. [accessed 4th September 2014].
2. J. Chen, D. Bautembach, and S. Izadi. Scalable real-time volumetric surface reconstruction. Transactions on Graphics, 32(4):113:1-113:16, 2013.
3. B. Curless and M. Levoy. A volumetric method for building complex models from range images. In Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pages 303-312, 1996.
4. R. Favier and F. Heredia. Using kinfu large scale to generate a textured mesh. http://pointclouds.org/documentation/tutorials/using-kinfu-large-scale.php. [accessed 4th September 2014].
5. N. Fioraio, J. Taylor, A. Fitzgibbon, L. D. Stefano, and S. Izadi. Largescale and drift-free surface reconstruction using online subvolume registration. In Computer Vision and Pattern Recognition, pages 4475-4483, 2015.
6. A. Handa, T. Whelan, J. McDonald, and A. Davison. A benchmark for rgb-d visual odometry, 3d reconstruction and slam. In International Conference on Robotics and Automation, pages 1524-1531, 2014.
7. P. Henry, D. Fox, A. Bhowmik, and R. Mongia. Patch volumes: Segmentation-based consistent mapping with rgb-d cameras. In International Conference on 3D Vision, pages 398-405, 2013.
8. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, and A. Fitzgibbon. Kinectfusion: Real-time 3d reconstruction and interaction using a moving depth camera. In User Interface Software and Technology, pages 559-568, 2011.
9. K. Kolev, P. Tanskanen, P. Speciale, and M. Pollefeys. Turning mobile phones into 3d scanners. In Computer Vision and Pattern Recognition, pages 3946-3953, 2014.
10. S. Madgwick, A. Harrison, and R. Vaidyanathan. Estimation of imu and marg orientation using a gradient descent algorithm. In International Conference on Rehabilitation Robotics, pages 1-7, 2011.
11. M. Meilland and A. Comport. On unifying key-frame and voxel-based dense visual slam at large scales. In International Conference on Intelligent Robots and Systems, 2013.
12. L. Nardi, B. Bodin, M. Z. Zia, J. Mawer, A. Nisbet, P. H. J. Kelly, A. J. Davison, M. Lujan, M. F. P. O'Boyle, G. Riley, N. Topham, and S. Furber. Introducing SLAMBench, a performance and accuracy benchmarking methodology for SLAM. In International Conference on Robotics and Automation, 2015.
13. R. Newcombe, S. Lovegrove, and A. Davison. Dtam: Dense tracking and mapping in real-time. In International Conference on Computer Vision, pages 2320-2327, 2011.
14. R. A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohli, J. Shotton, S. Hodges, and A. Fitzgibbon. Kinectfusion: Real-time dense surface mapping and tracking. In International Symposium on Mixed and Augmented Reality, pages 127-136, 2011.
15. M. Nießner, A. Dai, and M. Fisher. Combining inertial navigation and icp for real-time 3d surface reconstruction. In Eurographics (Short Papers), pages 13-16, 2014.
16. M. Nießner, M. Zollhöfer, S. Izadi, and M. Stamminger. Real-time 3d reconstruction at scale using voxel hashing. Transactions on Graphics, 32(6):169:1-169:11, 2013.
17. V. Pradeep, C. Rhemann, S. Izadi, C. Zach, M. Bleyer, and S. Bathiche. Monofusion: Real-time 3d reconstruction of small scenes with a single web camera. In International Symposium on Mixed and Augmented Reality, pages 83-88, 2013.
18. V. A. Prisacariu, O. Kähler, M. M. Cheng, J. Valentin, P. H. Torr, I. D. Reid, and D. W. Murray. A framework for the volumetric integration of depth images. arXiv:1410.0925 [cs.CV], 2014.
19. V. A. Prisacariu, O. Kähler, D. Murray, and I. Reid. Real-time 3d tracking and reconstruction on mobile phones. Transactions on Visualization and Computer Graphics, 21(5):557-570, 2015.
20. PROFACTOR. Reconstructme. http://reconstructme.net/. [accessed 4th September 2014].
21. G. Reitmayr. Kfusion. https://github.com/GerhardR/kfusion. [accessed 15th October 2014].
22. H. Roth and M. Vona. Moving volume kinectfusion. In British Machine Vision Conference (BMVC), pages 112.1-112.11, 2012.
23. T. Schöps, J. Engel, and D. Cremers. Semi-dense visual odometry for AR on a smartphone. In International Symposium on Mixed and Augmented Reality, pages 145-150, 2014.
24. F. Steinbruecker, J. Sturm, and D. Cremers. Volumetric 3d mapping in real-time on a cpu. In International Conference on Robotics and Automation, 2014.
25. P. Tanskanen, K. Kolev, L. Meier, F. Camposeco, O. Saurer, and M. Pollefeys. Live metric 3d reconstruction on mobile phones. In International Conference on Computer Vision, pages 65-72, 2013.
26. D. Thomas and A. Sugimoto. A flexible scene representation for 3d reconstruction using an rgb-d camera. In International Conference on Computer Vision, pages 2800-2807, 2013.
27. T. Whelan, M. Kaess, H. Johannsson, M. Fallon, J. J. Leonard, and J. McDonald. Real-time large-scale dense rgb-d slam with volumetric fusion. International Journal of Robotics Research, 2014.
28. M. Zeng, F. Zhao, J. Zheng, and X. Liu. Octree-based fusion for realtime 3d reconstruction. Graphical Models, 75(3):126-136, 2013.