3D Modeling on the Go: Interactive 3D Reconstruction of Large-Scale Scenes on Mobile Devices

Proceedings - 2015 International Conference on 3D Vision, 3DV 2015

Volumn , Issue , 2015, Pages 291-299

  Schops, Thomas ^a   Sattler, Torsten ^a   Hane, Christian ^a   Pollefeys, Marc ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Cameras; Image reconstruction; Mobile handsets; Real time systems; Sensors; Three dimensional displays; Uncertainty

Indexed keywords

CAMERAS; IMAGE RECONSTRUCTION; INTERACTIVE COMPUTER SYSTEMS; MOBILE DEVICES; REAL TIME SYSTEMS; SENSORS; STATISTICS; STEREO IMAGE PROCESSING;

FILTERING OPERATIONS; FREE SPACE MEASUREMENTS; INTERACTIVE 3D RECONSTRUCTION; INTERACTIVE FRAME RATES; MOBILE HANDSETS; SIGNED DISTANCE FUNCTION; THREE-DIMENSIONAL DISPLAY; UNCERTAINTY;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84961727530     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/3DV.2015.40     Document Type: Conference Paper

References (37)

1. A. Alahi, R. Ortiz, and P. Vandergheynst. FREAK: Fast retina keypoint. In CVPR, 2012. 5
2. J. Chen, D. Bautembach, and S. Izadi. Scalable real-time volumetric surface reconstruction. In SIGGRAPH, 2013. 2
3. B. Curless and M. Levoy. A volumetric method for building complex models from range images. In SIGGRAPH, 1996. 2
4. J. Engel, J. Sturm, and D. Cremers. Semi-dense visual odometry for a monocular camera. In ICCV, 2013. 2, 3, 4
5. N. Fioraio, J. Taylor, A. Fitzgibbon, L. Di Stefano, and S. Izadi. Large-scale and drift-free surface reconstruction using online subvolume registration. In CVPR, 2015. 8
6. D. Gallup, J.-M. Frahm, P. Mordohai, Q. Yang, and M. Pollefeys. Real-time plane-sweeping stereo with multiple sweeping directions. In CVPR, 2007. 2
7. A. Handa, T. Whelan, J. McDonald, and A. Davison. A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM. In ICRA, 2014. 5
8. C. Häne, L. Heng, G. H. Lee, A. Sizov, and M. Pollefeys. Real-time direct dense matching on fisheye images using plane-sweeping stereo. In 3DV, 2014. 3
9. J. A. Hesch, D. G. Kottas, S. L. Bowman, and S. I. Roumeliotis. Camera-IMU-based localization: Observability analysis and consistency improvement. The International Journal of Robotics Research, 2013. 2
10. V. H. Hiep, R. Keriven, P. Labatut, and J.-P. Pons. Towards high-resolution large-scale multi-view stereo. In CVPR, 2009. 2
11. D. Honegger, H. Oleynikova, and M. Pollefeys. Real-time and low latency embedded computer vision hardware based on a combination of FPGA and mobile CPU. In IROS, 2014. 7
12. C. Hoppe, M. Klopschitz, M. Donoser, and H. Bischof. Incremental surface extraction from sparse structure-frommotion point clouds. In BMVC, 2013. 2
13. M. Klingensmith, I. Dryanovski, S. Srinivasa, and J. Xiao. Chisel: Real time large scale 3D reconstruction onboard a mobile device. In RSS, 2015. 3, 6
14. K. Kolev, P. Tanskanen, P. Speciale, and M. Pollefeys. Turning mobile phones into 3D scanners. In CVPR, 2014. 2
15. V. Lempitsky and Y. Boykov. Global optimization for shape fitting. In CVPR, 2007. 2
16. W. E. Lorensen and H. E. Cline. Marching cubes: A high resolution 3D surface construction algorithm. In SIGGRAPH, 1987. 3
17. D. G. Lowe. Object recognition from local scale-invariant features. In International conference on computer vision, 1999. 5
18. P. Merrell, A. Akbarzadeh, L. Wang, P. Mordohai, J.-M. Frahm, R. Yang, D. Nistér, and M. Pollefeys. Real-time visibility-based fusion of depth maps. In ICCV, 2007. 2
19. R. A. Newcombe and A. J. Davison. Live dense reconstruction with a single moving camera. In CVPR, 2010. 2
20. R. A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohi, J. Shotton, S. Hodges, and A. Fitzgibbon. Kinectfusion: Real-time dense surface mapping and tracking. In ISMAR, 2011. 2
21. R. A. Newcombe, S. J. Lovegrove, and A. J. Davison. DTAM: Dense tracking and mapping in real-time. In ICCV, 2011. 2
22. M. Nießner, M. Zollhöfer, S. Izadi, and M. Stamminger. Real-time 3D reconstruction at scale using voxel hashing. In SIGGRAPH Asia, 2013. 2, 3
23. Q. Pan, G. Reitmayr, and T. Drummond. ProFORMA: Probabilistic feature-based on-line rapid model acquisition. In BMVC, 2009. 2
24. M. Pizzoli, C. Forster, and D. Scaramuzza. REMODE: Probabilistic, monocular dense reconstruction in real time. In ICRA, 2014. 2
25. M. Pollefeys, D. Nistér, J.-M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.-J. Kim, P. Merrell, et al. Detailed real-time urban 3D reconstruction from video. IJCV, 78(2-3):143-167, 2008. 2
26. V. Pradeep, C. Rhemann, S. Izadi, C. Zach, M. Bleyer, and S. Bathiche. MonoFusion: Real-time 3D reconstruction of small scenes with a single web camera. In ISMAR, 2013. 2, 5
27. O. Saurer, K. Koser, J.-Y. Bouguet, and M. Pollefeys. Rolling shutter stereo. In ICCV, 2013. 7
28. A. Seki, O. J. Woodford, S. Ito, B. Stenger, M. Hatakeyama, and J. Shimamura. Reconstructing Fukushima: A case study. In 3DV, 2014. 2
29. J. Shi and C. Tomasi. Good features to track. In CVPR, 1994. 2
30. F. Steinbruecker, J. Sturm, and D. Cremers. Volumetric 3D mapping in real-time on a CPU. In ICRA, 2014. 2
31. P. Tanskanen, K. Kolev, L. Meier, F. Camposeco, O. Saurer, and M. Pollefeys. Live metric 3D reconstruction on mobile phones. In ICCV, 2013. 2
32. G. Vogiatzis and C. Hernández. Video-based, real-time multi-view stereo. Image and Vision Computing, 29(7):434-441, 2011. 2
33. T. Whelan, M. Kaess, M. Fallon, H. Johannsson, J. Leonard, and J. McDonald. Kintinuous: Spatially extended KinectFusion. Technical report, 2012. 2
34. R. Yang and M. Pollefeys. Multi-resolution real-time stereo on commodity graphics hardware. In CVPR, 2003. 2, 3
35. S. Yu and M. Lhuillier. Incremental reconstruction of manifold surface from sparse visual mapping. In 3DIMPVT, 2012. 2
36. C. Zach, T. Pock, and H. Bischof. A globally optimal algorithm for robust TV-L1 range image integration. In ICCV, 2007. 2
37. K. Zhang, Y. Fang, D. Min, L. Sun, S. Yang, S. Yan, and Q. Tian. Cross-scale cost aggregation for stereo matching. In CVPR, 2014. 3