Distinctive 2D and 3D features for automated large-scale scene analysis in urban areas

Computers and Graphics (Pergamon)

Volumn 49, Issue , 2015, Pages 47-57

  Weinmann, M ^a   Urban, S ^a   Hinz, S ^a   Jutzi, B ^a   Mallet, C ^b  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

^b UNIVERSITÉ PARIS EST   (France)

Author keywords

3D scene analysis; Classification; Feature; Large scale; Point cloud; Urban

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL EFFICIENCY; EFFICIENCY; SEMANTICS; THREE DIMENSIONAL COMPUTER GRAPHICS;

3D SCENE ANALYSIS; FEATURE; LARGE-SCALE; POINT CLOUD; URBAN;

BENCHMARKING;

EID: 84938196422     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2015.01.006     Document Type: Article

References (76)

1. P. Musialski, P. Wonka, D.G. Aliaga, M. Wimmer, L. van Gool, and W. Purgathofer A survey of urban reconstruction Comput Graph Forum 32 6 2013 146 177
2. Q.Y. Zhou, and U. Neumann Complete residential urban area reconstruction from dense aerial lidar point clouds Graph Model 75 3 2013 118 125
3. F. Lafarge, and P. Alliez Surface reconstruction through point set structuring Comput Graph Forum 32 2 2013 225 234
4. Q. Zheng, A. Sharf, G. Wan, Y. Li, N.J. Mitra, D. Cohen-Or, and et al. Non-local scan consolidation for 3d urban scenes ACM Trans Graph 29 4 2010 1 9 [Article no. 94]
5. D. Ceylan, N.J. Mitra, Y. Zheng, and M. Pauly Coupled structure-from-motion and 3d symmetry detection for urban facades ACM Trans Graph 33 1 2014 2:1 15
6. S. Pu, M. Rutzinger, G. Vosselman, and S. Oude Elberink Recognizing basic structures from mobile laser scanning data for road inventory studies ISPRS J Photogramm Remote Sens 66 6 2011 S28 S39
7. A. Velizhev, R. Shapovalov, and K. Schindler Implicit shape models for object detection in 3d point clouds ISPRS Ann Photogramm Remote Sens Spat Inf Sci I-3 2012 179 184
8. M. Bremer, V. Wichmann, and M. Rutzinger Eigenvalue and graph-based object extraction from mobile laser scanning point clouds ISPRS Ann Photogramm Remote Sens Spat Inf Sci II-5/W2 2013 55 60
9. A. Serna, and B. Marcotegui Detection, segmentation and classification of 3d urban objects using mathematical morphology and supervised learning ISPRS J Photogramm Remote Sens 93 2014 243 255
10. A. Boyko, and T. Funkhouser Extracting roads from dense point clouds in large scale urban environment ISPRS J Photogramm Remote Sens 66 6 2011 S02 S12
11. L. Zhou, and G. Vosselman Mapping curbstones in airborne and mobile laser scanning data Int J Appl Earth Obs Geoinf 18 1 2012 293 304
12. H. Guan, J. Li, Y. Yu, C. Wang, M. Chapman, and B. Yang Using mobile laser scanning data for automated extraction of road markings ISPRS J Photogramm Remote Sens 87 2014 93 107
13. A. Serna, and B. Marcotegui Urban accessibility diagnosis from mobile laser scanning data ISPRS J Photogramm Remote Sens 84 2013 23 32
14. H.B. Kim, and G. Sohn Random forests based multiple classifier system for power-line scene classification Int Arch Photogramm Remote Sens Spat Inf Sci XXXVIII-5/W12 2011 253 258
15. C.A. Vanegas, D.G. Aliaga, and B. Benes Automatic extraction of Manhattan-world building masses from 3d laser range scans IEEE Trans Vis Comput Graph 18 10 2012 1627 1637
16. K.M. Wurm, H. Kretzschmar, R. Kümmerle, C. Stachniss, and W. Burgard Identifying vegetation from laser data in structured outdoor environments Robot Auton Syst 62 5 2014 675 684
17. F. Lafarge, and C. Mallet Creating large-scale city models from 3d-point clouds: a robust approach with hybrid representation Int J Comput Vis 99 1 2012 69 85
18. Hebert M, Bagnell JA, Bajracharya M, Daniilidis K, Matthies LH, Mianzo L, et al. Semantic perception for ground robotics. In: Proceedings of SPIE 8387, unmanned systems technology XIV; 2012, p. 83870Y: 1-12.
19. A. Boulch, S. Houllier, R. Marlet, and O. Tournaire Semantizing complex 3d scenes using constrained attribute grammars Comput Graph Forum 32 5 2013 33 42
20. Hu H, Munoz D, Bagnell JA, Hebert M. Efficient 3-d scene analysis from streaming data. In: Proceedings of the IEEE international conference on robotics and automation; 2013. p. 2297-304.
21. J. Niemeyer, F. Rottensteiner, and U. Soergel Contextual classification of lidar data and building object detection in urban areas ISPRS J Photogramm Remote Sens 87 2014 152 165
22. Nüchter A, Lingemann K. Robotic 3D scan repository. Jacobs University Bremen gGmbH and University of Osnabrück; 2011. http://kos.informatik.uni-osnabrueck.de/3Dscans/ (last access: 30 August 2014).
23. Munoz D, Bagnell JA, Vandapel N, Hebert M. Contextual classification with functional max-margin Markov networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2009. p. 975-82.
24. Serna A, Marcotegui B, Goulette F, Deschaud JE. Paris-rue-Madame database: a 3d mobile laser scanner dataset for benchmarking urban detection, segmentation and classification methods. In: Proceedings of the international conference on pattern recognition applications and methods; 2014. p. 819-24.
25. Paparoditis N, Vallet B, Marcotegui B, Serna A. IQmulus & TerraMobilita contest - analysis of mobile laser scans (MLS) in dense urban environments. MATIS Laboratory, French National Mapping Agency (IGN) and Center for Mathematical Morphology (CMM), MINES ParisTech; 2014. http://data.ign.fr/benchmarks/UrbanAnalysis/ (last access: 30 August 2014).
26. Weinmann M, Jutzi B, Mallet C. Describing Paris: automated 3d scene analysis via distinctive low-level geometric features. In: Proceedings of the IQmulus workshop on processing large geospatial data; 2014a. p. 1-8.
27. M. Weinmann, B. Jutzi, and C. Mallet Feature relevance assessment for the semantic interpretation of 3d point cloud data ISPRS Ann Photogramm Remote Sens Spat Inf Sci II-5/W2 2013 313 318
28. M. Weinmann, B. Jutzi, and C. Mallet Semantic 3d scene interpretation: a framework combining optimal neighborhood size selection with relevant features ISPRS Ann Photogramm Remote Sens Spat Inf Sci II-3 2014 181 188
29. N. Chehata, L. Guo, and C. Mallet Airborne lidar feature selection for urban classification using random forests Int Arch Photogramm Remote Sens Spat Inf Sci XXXVIII-3/W8 2009 207 212
30. C. Mallet, F. Bretar, M. Roux, U. Soergel, and C. Heipke Relevance assessment of full-waveform lidar data for urban area classification ISPRS J Photogramm Remote Sens 66 6 2011 S71 S84
31. Tombari F, Salti S, Di Stefano L. Unique signatures of histograms for local surface description. In: Proceedings of the European conference on computer vision; 2010. p. 356-69.
32. A.E. Johnson, and M. Hebert Using spin images for efficient object recognition in cluttered 3d scenes IEEE Trans Pattern Anal Mach Intell 21 5 1999 433 449
33. Rusu RB, Marton ZC, Blodow N, Beetz M. Persistent point feature histograms for 3d point clouds. In: Proceedings of the international conference on intelligent autonomous systems; 2008. p. 119-28.
34. Rusu RB, Blodow N, Beetz M. Fast Point Feature Histograms (FPFH) for 3d registration. In: Proceedings of the IEEE international conference on robotics and automation; 2009. p. 3212-17.
35. R. Osada, T. Funkhouser, B. Chazelle, and D. Dobkin Shape distributions ACM Trans Graph 21 4 2002 807 832
36. R. Blomley, M. Weinmann, J. Leitloff, and B. Jutzi Shape distribution features for point cloud analysis - a geometric histogram approach on multiple scales ISPRS Ann Photogramm Remote Sens Spat Inf Sci II-3 2014 9 16
37. Behley J, Steinhage V, Cremers AB. Performance of histogram descriptors for the classification of 3d laser range data in urban environments. In: Proceedings of the IEEE international conference on robotics and automation; 2012. p. 4391-8.
38. B. Jutzi, and H. Gross Nearest neighbour classification on laser point clouds to gain object structures from buildings Int Arch Photogramm Remote Sens Spat Inf Sci XXXVIII-1-4-7/W5 2009
39. West KF, Webb BN, Lersch JR, Pothier S, Triscari JM, Iverson AE. Context-driven automated target detection in 3-d data. In: Proceedings of SPIE 5426; 2004. p. 133-43.
40. Lalonde JF, Unnikrishnan R, Vandapel N, Hebert M. Scale selection for classification of point-sampled 3d surfaces. In: Proceedings of the international conference on 3-D digital imaging and modeling; 2005. p. 285-92.
41. J. Demantké, C. Mallet, N. David, and B. Vallet Dimensionality based scale selection in 3d lidar point clouds Int Arch Photogramm Remote Sens Spat Inf Sci XXXVIII-5/W12 2011 97 102
42. B. Guo, X. Huang, F. Zhang, and G. Sohn Classification of airborne laser scanning data using JointBoost ISPRS J Photogramm Remote Sens 92 2014 124 136
43. C. Waldhauser, R. Hochreiter, J. Otepka, N. Pfeifer, S. Ghuffar, K. Korzeniowska, and et al. Automated classification of airborne laser scanning point clouds S. Koziel, L. Leifsson, X.S. Yang, Solving computationally expensive engineering problems 2014 Springer New York, USA 269 292
44. Fehr D, Cherian A, Sivalingam R, Nickolay S, Morellas V, Papanikolopoulos N. Compact covariance descriptors in 3d point clouds for object recognition. In: Proceedings of the IEEE international conference on robotics and automation; 2012. p. 1793-8.
45. Khoshelham K, Oude Elberink SJ. Role of dimensionality reduction in segment-based classification of damaged building roofs in airborne laser scanning data. In: Proceedings of the international conference on geographic object based image analysis; 2012. p. 372-7.
46. J. Niemeyer, F. Rottensteiner, and U. Soergel Conditional random fields for lidar point cloud classification in complex urban areas ISPRS Ann Photogramm Remote Sens Spat Inf Sci I-3 2012 263 268
47. M. Pauly, R. Keiser, and M. Gross Multi-scale feature extraction on point-sampled surfaces Comput Graph Forum 22 3 2003 281 289
48. D. Belton, and D.D. Lichti Classification and segmentation of terrestrial laser scanner point clouds using local variance information Int Arch Photogramm Remote Sens Spat Inf Sci XXXVI-5 2006 44 49
49. Mitra NJ, Nguyen A. Estimating surface normals in noisy point cloud data. In: Proceedings of the annual symposium on computational geometry; 2003. p. 322-8.
50. N. Brodu, and D. Lague 3d terrestrial lidar data classification of complex natural scenes using a multi-scale dimensionality criterion: applications in geomorphology ISPRS J Photogramm Remote Sens 68 2012 121 134
51. Xiong X, Munoz D, Bagnell JA, Hebert M. 3-d scene analysis via sequenced predictions over points and regions. In: Proceedings of the IEEE international conference on robotics and automation; 2011. p. 2609-16.
52. S. Xu, G. Vosselman, and S. Oude Elberink Multiple-entity based classification of airborne laser scanning data in urban areas ISPRS J Photogramm Remote Sens 88 2014 1 15
53. J. Secord, and A. Zakhor Tree detection in urban regions using aerial lidar and image data IEEE Geosci Remote Sens Lett 4 2 2007 196 200
54. Lodha SK, Fitzpatrick DM, Helmbold DP. Aerial lidar data classification using AdaBoost. In: Proceedings of the international conference on 3-D digital imaging and modeling; 2007. p. 435-42.
55. R. Shapovalov, A. Velizhev, and O. Barinova Non-associative Markov networks for 3d point cloud classification Int Arch Photogramm Remote Sens Spat Inf Sci XXXVIII-3A 2010 103 108
56. Najafi M, Taghavi Namin S, Salzmann M, Petersson L. Non-associative higher-order Markov networks for point cloud classification. In: Proceedings of the European conference on computer vision; 2014. p. 500-15.
57. Shapovalov R, Vetrov D, Kohli P. Spatial inference machines. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2013. p. 2985-92.
58. K. Schindler An overview and comparison of smooth labeling methods for land-cover classification IEEE Trans Geosci Remote Sens 50 11 2012 4534 4545
59. I. Lee, and T. Schenk Perceptual organization of 3d surface points Int Arch Photogramm Remote Sens Spat Inf Sci XXXIV-3A 2002 193 198
60. S. Filin, and N. Pfeifer Neighborhood systems for airborne laser data Photogramm Eng Remote Sens 71 6 2005 743 755
61. Linsen L, Prautzsch H. Local versus global triangulations. In: Proceedings of eurographics; 2001. p. 257-63.
62. J.H. Friedman, J.L. Bentley, and R.A. Finkel An algorithm for finding best matches in logarithmic expected time ACM Trans Math Softw 3 3 1977 209 226
63. Vosselman G, Klein R. Visualisation and structuring of point clouds. In: Vosselman G, Maas HG, editors. Airborne and terrestrial laser scanning, Dunbeath, UK: Whittles Publishing; 2010. p. 45-81.
64. S. Arya, D.M. Mount, N.S. Netanyahu, R. Silverman, and A.Y. Wu An optimal algorithm for approximate nearest neighbor searching in fixed dimensions J ACM 45 6 1998 891 923
65. H. Samet Foundations of multidimensional and metric data structures 2006 Morgan Kaufmann St. Louis, USA
66. Muja M, Lowe DG. Fast approximate nearest neighbors with automatic algorithm configuration. In: Proceedings of the international conference on computer vision theory and applications, vol. 1; 2009. p. 331-40.
67. C.E. Shannon A mathematical theory of communication Bell Syst Tech J 27 3 1948 379 423
68. F. Monnier, B. Vallet, and B. Soheilian Trees detection from laser point clouds acquired in dense urban areas by a mobile mapping system ISPRS Ann Photogramm Remote Sens Spat Inf Sci I-3 2012 245 250
69. L. Breiman Bagging predictors Mach Learn 24 2 1996 123 140
70. B. Efron Bootstrap methods: another look at the jackknife Ann Stat 7 1 1979 1 26
71. L. Breiman Random forests Mach Learn 45 1 2001 5 32
72. A. Criminisi, and J. Shotton Decision forests for computer vision and medical image analysis. Advances in computer vision and pattern recognition 2013 Springer London, UK
73. Zhou QY, Neumann U. A streaming framework for seamless building reconstruction from large-scale aerial lidar data. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2009. p. 2759-66.
74. F. Goulette, F. Nashashibi, I. Abuhadrous, S. Ammoun, and C. Laurgeau An integrated on-board laser range sensing system for on-the-way city and road modelling Int Arch Photogramm Remote Sens Spat Inf Sci XXXVI-1 2006
75. N. Paparoditis, J.P. Papelard, B. Cannelle, A. Devaux, B. Soheilian, N. David, and et al. Stereopolis II: a multi-purpose and multi-sensor 3d mobile mapping system for street visualisation and 3d metrology Rev Fr Photogramm Télédétect 200 2012 69 79
76. Brédif M, Vallet B, Serna A, Marcotegui B, Paparoditis N. TerraMobilita/IQmulus urban point cloud classification benchmark. In: Proceedings of the IQmulus workshop on processing large geospatial data; 2014. p. 1-6.