Superpixel meshes for fast edge-preserving surface reconstruction

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 2011-2020

  Bódis Szomoru, András ^a   Riemenschneider, Hayko ^a   Van Gool, Luc ^a,b  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; OBJECT RECOGNITION; PATTERN RECOGNITION; PIXELS; ROCK MECHANICS; SURFACE RECONSTRUCTION;

DEPTH ESTIMATION; GROUND CONTROL POINTS; IMAGE RECTIFICATION; MULTI-VIEW STEREO; ORDERS OF MAGNITUDE; PARALLELIZATIONS; SMOOTHNESS CONSTRAINTS; STRUCTURE FROM MOTION;

STEREO IMAGE PROCESSING;

EID: 84959218625     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298812     Document Type: Conference Paper

References (71)

1. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk. SLIC superpixels compared to state-of-the-art superpixel methods. PAMI, 34(11):2274-2282, 2012
2. S. Agarwal, N. Snavely, I. Simon, S. M. Seitz, and R. Szeliski. Building Rome in a day. In ICCV, 2009
3. M. Bergh, X. Boix, G. Roig, B. Capitani, and L. Van Gool. SEEDS: Superpixels extracted via energy-driven sampling. In ECCV, 2012
4. A. Bódis-Szomorú, H. Riemenschneider, and L. Van Gool. Fast, Approximate Piecewise-Planar Modeling Based on Sparse Structure-from-Motion and Superpixels. In CVPR, 2014
5. Y. Boykov and V. Kolmogorov. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. PAMI, 26(9):124-1137, 2004
6. Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph cuts. PAMI, 23(11):1222-1239, 2001
7. J. Canny. A computational approach to edge detection. PAMI, 8(6):679-698, 1986
8. J. C. Carr, R. K. Beatson, J. B. Cherrie, T. J. Mitchell, W. R. Fright, B. C. McCallum, and T. R. Evans. Reconstruction and representation of 3d objects with radial basis functions. In SIGGRAPH, 2001
9. A. Chauve, P. Labatut, and J. Pons. Robust piecewise-planar 3d reconstruction and completion from large-scale unstructured point data. In CVPR, 2010
10. N. Cornelis, K. Cornelis, and L. Van Gool. Fast compact city modeling for navigation pre-visualization. In CVPR, 2006
11. D. Crandall, A. Owens, N. Snavely, and D. Huttenlocher. Sfm with mrfs: Discrete-continuous optimization for largescale structure from motion. PAMI, 35(12):2841-2853, 2013
12. A. Delaunoy and M. Pollefeys. Photometric bundle adjustment for dense multi-view 3d modeling. In CVPR, 2014
13. H. Edelsbrunner, D. G. Kirkpatrick, and R. Seidel. On the shape of a set of points in the plane. IEEE Transactions on Information Theory, 29(4):551559, 1983
14. P. F. Felzenszwalb and D. P. Huttenlocher. Efficient graphbased image segmentation. IJCV, 59(2):167-181, 2004
15. F. Fraundorfer, K. Schindler, and H. Bischof. Piecewise planar scene reconstruction from sparse correspondences. IJCV, 24(4):395-406, 2006
16. P. Fua. A parallel stereo algorithm that produces dense depth maps and preserves image features. Machine Vision and Applications, 6(1):35-49, 1993
17. Y. Furukawa, B. Curless, S. Seitz, and R. Szeliski. Manhattan-world stereo. In CVPR, 2009
18. Y. Furukawa, B. Curless, S. Seitz, and R. Szeliski. Towards internet-scale multi-view stereo. In CVPR, 2010
19. Y. Furukawa and J. Ponce. Accurate, Dense, and Robust Multi-View Stereopsis. PAMI, 32(8):1362-1376, 2010
20. D. Gallup, J. Frahm, and M. Pollefeys. Piecewise planar and non-planar stereo for urban scene reconstruction. In CVPR, 2010
21. D. Gallup, J.-M. Frahm, P. Mordohai, Q. Yang, and M. Pollefeys. Real-time plane-sweeping stereo with multiple sweeping directions. In CVPR, 2007
22. D. Gallup, M. Pollefeys, and J.-M. Frahm. 3d reconstruction using an n-layer heightmap. In DAGM, 2010
23. I. Garcia-Dorado, I. Demir, and D. G. Aliaga. Automatic urban modeling using volumetric reconstruction with surface graph cuts. ComputersGraphics, 37(7):896-910, 2013
24. A. Geiger, M. Roser, and R. Urtasun. Efficient large-scale stereo matching. In ACCV, 2010
25. C. Harris and M. Stephens. A combined corner and edge detector. In Alvey Vision Conference (AVC), 1988
26. D. Hoiem, A. Efros, and M. Hebert. Recovering surface layout from an image. IJCV, 75(1), 2007
27. C. Hoppe, M. Klopschitz, M. Donoser, and H. Bischof. Incremental surface extraction from sparse structure-frommotion point clouds. In BMVC, 2013
28. C. Hoppe, M. Klopschitz, M. Rumpler, A. Wendel, S. Kluckner, H. Bischof, and G. Reitmayr. Online feedback for structure-from-motion image acquisition. In BMVC, 2012
29. M. Jancosek and T. Pajdla. Multi-view reconstruction preserving weakly-supported surfaces. In CVPR, 2011
30. M. Kazhdan, M. Bolitho, and H. Hoppe. Poisson surface reconstruction. In Eurographics, pages 61-70, 2006
31. V. Kolmogorov and R. Zabih. What energy functions can be minimized via graph cuts? PAMI, 26(2):147-159, 2004
32. J. Kopf, M. F. Cohen, and R. Szeliski. First-person hyperlapse videos,. In SIGGRAPH, 2014
33. P. Labatut, J. Pons, and R. Keriven. Efficient Multi-View Reconstruction of Large-Scale Scenes using Interest Points, Delaunay Triangulation and Graph Cuts. In ICCV, 2007
34. L. Ladicky, J. Shi, and M. Pollefeys. Pulling things out of perspective. In CVPR, 2014
35. D. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60(2):91-110, 2004
36. A. Martinovíc, J. Knopp, H. Riemenschneider, and L. Van Gool. 3d all the way: Semantic segmentation of urban scenes from start to end in 3d. In CVPR, 2015
37. A. Martinovic, M. Mathias, J. Weissenberg, and L. Van Gool. A Three-Layered Approach to Facade Parsing. In ECCV, 2012
38. B. Micusik and J. Kosecka. Multi-view superpixel stereo in urban environments. IJCV, 89(1):106-119, 2010
39. D. D. Morris and T. Kanade. Image-consistent surface triangulation. In CVPR, 2000
40. P. Musialski, P. Wonka, D. G. Aliaga, M. Wimmer, L. Van Gool, and W. Purgathofer. A survey of urban reconstruction. In EUROGRAPHICS, 2012
41. R. A. Newcombe and A. J. Davison. Live dense reconstruction with a single moving camera. In CVPR, 2010
42. Y. Ohtake, A. Belyaev, and H.-P. Seidel. A multi-scale approach to 3d scattered data interpolation with compactly supported basis functions. In Shape Modeling International, pages 153-161, 2003
43. J. Park, S. Sinha, Y. Matsushita, Y.-W. Tai, and In So Kweon. Multiview photometric stereo using planar mesh parameterization. In ICCV, 2013
44. M. Pollefeys, D. Nistér, J. M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S. J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewénius, R. Yang, G. Welch, and H. Towles. Detailed real-time urban 3d reconstruction from video. IJCV, 78(2-3):143-167, 2008
45. M. Pollefeys, L. Van Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch. Visual modeling with a hand-held camera. IJCV, 59(3):207-232, 2004
46. T. Pylvanainen, J. Berclaz, V. Hedau, T. Korah, M. Aanjaneya, and R. Grzeszczuk. 3d city modeling from streetlevel data for augmented reality applications. In 3DPVT, 2012
47. H. Riemenschneider, A. Bodis-Szomoru, J. Weissenberg, and L. Van Gool. Learning Where To Classify In Multi-View Semantic Segmentation. In ECCV, 2014
48. H. Riemenschneider, U. Krispel, W. Thaller, M. Donoser, S. Havemann, D. Fellner, and H. Bischof. Irregular lattices for complex shape grammar facade parsing. In CVPR, 2012
49. N. Salman and M. Yvinec. Surface reconstruction from multi-view stereo of large-scale outdoor scenes. International Journal of Virtual Reality, 9(1), 2010
50. A. Saxena, M. Sun, and A. Ng. 3-d reconstruction from sparse views using monocular vision. In ICCV, 2007
51. A. Saxena, M. Sun, and A. Ng. Make3d: Learning 3-d scene structure from a single still image. PAMI, 2008
52. S. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski. A comparison and evaluation of multi-view stereo reconstruction algorithms. In CVPR, 2006
53. S. Sinha, D. Steedly., and R. Szeliski. Piecewise Planar Stereo for Image-based Rendering. In ICCV, 2009
54. N. Snavely, S. M. Seitz, and R. Szeliski. Photo tourism: Exploring photo collections in 3d. In SIGGRAPH, 2006
55. C. Strecha, W. von Hansen, L. Van Gool, P. Fua, and U. Thoennessen. On benchmarking camera calibration and multi-view stereo for high resolution imagery. In CVPR, 2008
56. O. Teboul, L. Simon, P. Koutsourakis, and N. Paragios. Procedural modeling and image-based 3d reconstruction of complex architectures through random walks. In IJCV, 2010
57. E. Tola, C. Strecha, and P. Fua. Efficient large scale multiview stereo for ultra high resolution image sets. Machine Vision and Applications, 23(5):903-920, 2012
58. G. Vogiatzis, C. Hernandez, P. Torr, and R. Cipolla. Multiview Stereo via Volumetric Graph-cuts and Occlusion Robust Photo-Consistency. PAMI, 29(12):2241-2246, 2007
59. G. Vogiatzis, P. Torr, and R. Cipolla. Bayesian stochastic mesh optimisation for 3d reconstruction. In BMVC, 2003
60. H.-H. Vu, P. Labatut, J. Pons, and R. Keriven. High Accuracy and Visibility-Consistent Dense Multi-view Stereo. PAMI, 34(5):889-901, 2012
61. L. Wang and R. Yang. Global stereo matching leveraged by sparse ground control points. In CVPR, 2011
62. Z.-F. Wang and Z.-G. Zheng. A region based stereo matching algorithm using cooperative optimization. In CVPR, 2008
63. Y. Wei and L. Quan. Region-based progressive stereo matching. In CVPR, 2004
64. T. Werner and A. Zisserman. New techniques for automated architecture reconstruction from photographs. In ECCV, 2002
65. C. Wu. SiftGPU: A GPU implementation of Scale Invaraint Feature Transform (SIFT). http://cs. unc. edu/ccwu/siftgpu, 2007
66. C. Wu. VisualSFM: A Visual Structure from Motion System. http://ccwu. me/vsfm/, 2011
67. C. Wu. Towards linear-time incremental structure from motion. In 3DV, 2013
68. C. Wu, S. Agarwal, B. Curless, and S. M. Seitz. Multicore bundle adjustment. In CVPR, 2011
69. J. Xiao, T. Fang, P. Tan, P. Zhao, E. Ofek, and L. Quan. Image-based facade modeling. In SIGGRAPH Asia, 2008
70. Q. Yang, L. Wang, R. Yang, H. Stewenius, and D. Nister. Stereo matching with color-weighted correlation, hierarchical belief propagation, and occlusion handling. PAMI, 31(3):492-504
71. C. Zitnick and S. Kang. Stereo for image-based rendering using image over-segmentation. IJCV, 75(1):49-65, 2007.