Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 105, Issue , 2015, Pages 286-304

  Weinmann, Martin ^a   Jutzi, Boris ^a   Hinz, Stefan ^a   Mallet, Clément ^b  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

^b UNIVERSITÉ PARIS EST   (France)

Author keywords

3D scene analysis; Classification; Feature extraction; Feature selection; Neighborhood selection; Point cloud

Indexed keywords

COMPUTER VISION; EXTRACTION; FEATURE EXTRACTION; REMOTE SENSING; SEMANTICS;

3D SCENE ANALYSIS; BENCHMARK DATASETS; GEOMETRIC FEATURE; MEMORY CONSUMPTION; NEIGHBORHOOD SELECTION; OPTIMAL NEIGHBORHOODS; POINT CLOUD; REPRODUCIBILITIES;

CLASSIFICATION (OF INFORMATION);

EID: 84939979079     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2015.01.016     Document Type: Article

References (99)

1. Arya S., Mount D.M., Netanyahu N.S., Silverman R., Wu A.Y. An optimal algorithm for approximate nearest neighbor searching in fixed dimensions. J. ACM 1998, 45(6):891-923.
2. Belton, D., Lichti, D.D., 2006. Classification and segmentation of terrestrial laser scanner point clouds using local variance information. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVI-5, pp. 44-49.
3. Blomley, R., Weinmann, M., Leitloff, J., Jutzi, B., 2014. Shape distribution features for point cloud analysis - a geometric histogram approach on multiple scales. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences II-3, pp. 9-16.
4. Boyko A., Funkhouser T. Extracting roads from dense point clouds in large scale urban environment. ISPRS J. Photogr. Remote Sens. 2011, 66(6):S02-S12.
5. Breiman L. Bagging predictors. Machine Learn. 1996, 24(2):123-140.
6. Breiman L. Random forests. Machine Learn. 2001, 45(1):5-32.
7. Bremer, M., Wichmann, V., Rutzinger, M., 2013. Eigenvalue and graph-based object extraction from mobile laser scanning point clouds. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences II-5/W2, pp. 55-60.
8. Brodu N., Lague D. 3d terrestrial lidar data classification of complex natural scenes using a multi-scale dimensionality criterion: applications in geomorphology. ISPRS J. Photogr. Remote Sens. 2012, 68:121-134.
9. Carlberg, M., Gao, P., Chen, G., Zakhor, A., 2009. Classifying urban landscape in aerial lidar using 3d shape analysis. In: Proceedings of the IEEE International Conference on Image Processing, IEEE, Cairo, Egypt, 7-10 November, pp. 1701-1704.
10. Chang C.C., Lin C.J. LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2(3):27:1-27:27.
11. Chehata, N., Guo, L., Mallet, C., 2009. Airborne lidar feature selection for urban classification using random forests. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVIII-3/W8, pp. 207-212.
12. Cortes C., Vapnik V. Support-vector networks. Machine Learn. 1995, 20(3):273-297.
13. Cover T., Hart P. Nearest neighbor pattern classification. IEEE Trans. Inform. Theory 1967, 13(1):21-27.
14. Criminisi A., Shotton J. Decision forests for computer vision and medical image analysis. Advances in Computer Vision and Pattern Recognition 2013, Springer, London, UK.
15. Demantké, J., Mallet, C., David, N., Vallet, B., 2011. Dimensionality based scale selection in 3d lidar point clouds. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVIII-5/W12, pp. 97-102.
16. Demantké, J., Vallet, B., Paparoditis, N., 2012. Streamed vertical rectangle detection in terrestrial laser scans for facade database production. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences I-3, pp. 99-104.
17. Efron B. Bootstrap methods: another look at the jackknife. Ann. Stat. 1979, 7(1):1-26.
18. Fayyad U.M., Irani K.B. Multi-interval discretization of continuous-valued attributes for classification learning. Proceedings of the International Joint Conference on Artificial Intelligence 1993, 1022-1027. Morgan Kaufman, Chambéry, France, 28 August - 3 September.
19. Filin S., Pfeifer N. Neighborhood systems for airborne laser data. Photogr. Eng. Remote Sens. 2005, 71(6):743-755.
20. Fisher R.A. The use of multiple measurements in taxonomic problems. Ann. Eugen. 1936, 7(2):179-188.
21. Freund Y., Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 1997, 55(1):119-139.
22. Friedman J.H., Bentley J.L., Finkel R.A. An algorithm for finding best matches in logarithmic expected time. ACM Trans. Math. Softw. 1977, 3(3):209-226.
23. Gerke, M., Xiao, J., 2013. Supervised and unsupervised MRF based 3d scene classification in multiple view airborne oblique images. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences II-3/W3, pp. 25-30.
24. Gini, C., 1912. Variabilite e mutabilita. Memorie di metodologia statistica.
25. Goulette F., Nashashibi, F., Abuhadrous, I., Ammoun, S., Laurgeau, C., 2006. An integrated on-board laser range sensing system for on-the-way city and road modelling. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVI-1.
26. Guan H., Li J., Yu Y., Wang C., Chapman M., Yang B. Using mobile laser scanning data for automated extraction of road markings. ISPRS J. Photogr. Remote Sens. 2014, 87:93-107.
27. Guo B., Huang X., Zhang F., Sohn G. Classification of airborne laser scanning data using JointBoost. ISPRS J. Photogr. Remote Sens. 2014, 92:124-136.
28. Guyon I., Elisseeff A. An introduction to variable and feature selection. J. Machine Learn. Res. 2003, 3:1157-1182.
29. Hall, M.A., 1999. Correlation-based feature subset selection for machine learning. Ph.D. thesis, Department of Computer Science, University of Waikato, New Zealand.
30. Hebert, M., Bagnell, J.A., Bajracharya, M., Daniilidis, K., Matthies, L.H., Mianzo, L., Navarro-Serment, L., Shi, J., Wellfare, M., 2012. Semantic perception for ground robotics. In: Proceedings of SPIE 8387, Unmanned Systems Technology XIV, SPIE, Baltimore, USA, 23 April, pp. 83870Y:1-12.
31. Hu H., Munoz D., Bagnell J.A., Hebert M. Efficient 3-d scene analysis from streaming data. Proceedings of the IEEE International Conference on Robotics and Automation 2013, 2297-2304. IEEE, Karlsruhe, Germany, 6-10 May.
32. John G.H., Langley P. Estimating continuous distributions in Bayesian classifiers. Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence 1995, 338-345. Morgan Kaufman, Montreal, Canada, 18-20 August.
33. Johnson A.E., Hebert M. Using spin images for efficient object recognition in cluttered 3d scenes. IEEE Trans. Pattern Anal. Machine Intell. 1999, 21(5):433-449.
34. Jutzi, B., Gross, H., 2009. Nearest neighbour classification on laser point clouds to gain object structures from buildings. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVIII-1-4-7/W5.
35. Khoshelham, K., Oude Elberink, S.J., 2012. Role of dimensionality reduction in segment-based classification of damaged building roofs in airborne laser scanning data. In: Proceedings of the International Conference on Geographic Object Based Image Analysis, Rio de Janeiro, Brazil, 7-9 May, pp. 372-377.
36. Kim E., Medioni G. Urban scene understanding from aerial and ground lidar data. Machine Vis. Appl. 2011, 22(4):691-703.
37. Kim, H.B., Sohn, G., 2011. Random forests based multiple classifier system for power-line scene classification. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVIII-5/W12, pp. 253-258.
38. Kolmogorov A.N. Grundbegriffe der Wahrscheinlichkeitsrechnung 1933, Springer, Berlin, Germany.
39. Kononenko I. Estimating attributes: analysis and extensions of RELIEF. Proceedings of the European Conference on Machine Learning 1994, 171-182. Springer, Catania, Italy, 6-8 April.
40. Lafarge F., Mallet C. Creating large-scale city models from 3d-point clouds: a robust approach with hybrid representation. Int. J. Comput. Vis. 2012, 99(1):69-85.
41. Lalonde J.F., Unnikrishnan R., Vandapel N., Hebert M. Scale selection for classification of point-sampled 3d surfaces. Proceedings of the International Conference on 3-D Digital Imaging and Modeling 2005, 285-292. IEEE, Ottawa, Canada, 13-16 June.
42. Lari, Z., Habib, A., 2012. Alternative methodologies for estimation of local point density index: moving towards adaptive lidar data processing. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXIX-B3, pp. 127-132.
43. Lee, I., Schenk, T., 2002. Perceptual organization of 3d surface points. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXIV-3A, pp. 193-198.
44. Lim E.H., Suter D. 3d terrestrial lidar classifications with super-voxels and multi-scale conditional random fields. Comput.-Aid. Des. 2009, 41(10):701-710.
45. Linsen, L., Prautzsch, H., 2001. Local versus global triangulations. In: Proceedings of Eurographics, Manchester, UK, 5-7 September, pp. 257-263.
46. Liu, H., Motoda, H., Setiono, R., Zhao, Z., 2010. Feature selection: an ever evolving frontier in data mining. In: Proceedings of the Fourth International Workshop on Feature Selection in Data Mining, Hyderabad, India, 21 June, pp. 4-13.
47. Lodha S.K., Fitzpatrick D.M., Helmbold D.P. Aerial lidar data classification using AdaBoost. Proceedings of the International Conference on 3-D Digital Imaging and Modeling 2007, 435-442. IEEE, Montreal, Canada, 21-23 August.
48. Mallet C., Bretar F., Roux M., Soergel U., Heipke C. Relevance assessment of full-waveform lidar data for urban area classification. ISPRS J. Photogr. Remote Sens. 2011, 66(6):S71-S84.
49. Mitra N.J., Nguyen A. Estimating surface normals in noisy point cloud data. Proceedings of the Annual Symposium on Computational Geometry 2003, 322-328. ACM, San Diego, USA, 8-10 June.
50. Monnier, F., Vallet, B., Soheilian, B., 2012. Trees detection from laser point clouds acquired in dense urban areas by a mobile mapping system. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences I-3, pp. 245-250.
51. Muja, M., Lowe, D.G., 2009. Fast approximate nearest neighbors with automatic algorithm configuration. In: Proceedings of the International Conference on Computer Vision Theory and Applications, Lisbon, Portugal, 5-8 February, pp. 331-340.
52. Munoz D., Bagnell J.A., Vandapel N., Hebert M. Contextual classification with functional max-margin Markov networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2009, 975-982. IEEE, Miami, USA, 20-25 June.
53. Najafi M., Taghavi Namin S., Salzmann M., Petersson L. Non-associative higher-order Markov networks for point cloud classification. Proceedings of the European Conference on Computer Vision 2014, 500-515. Springer, Zurich, Switzerland, 6-12 September.
54. Niemeyer, J., Rottensteiner, F., Soergel, U., 2012. Conditional random fields for lidar point cloud classification in complex urban areas. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences I-3, pp. 263-268.
55. Niemeyer J., Rottensteiner F., Soergel U. Contextual classification of lidar data and building object detection in urban areas. ISPRS J. Photogr. Remote Sens. 2014, 87:152-165.
56. Osada R., Funkhouser T., Chazelle B., Dobkin D. Shape distributions. ACM Trans. Graph. 2002, 21(4):807-832.
57. Oude Elberink, S., Kemboi, B., 2014. User-assisted object detection by segment based similarity measures in mobile laser scanner data. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-3, pp. 239-246.
58. Özuysal M., Fua P., Lepetit V. Fast keypoint recognition in ten lines of code. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2007, 1-8. IEEE, Minneapolis, USA, 17-22 June.
59. Pauly M., Keiser R., Gross M. Multi-scale feature extraction on point-sampled surfaces. Comput. Graph. Forum 2003, 22(3):281-289.
60. Pearson K. Mathematical contributions to the theory of evolution. III. Regression, heredity and panmixia. Philos. Trans. Roy. Soc. Lond. A 1896, 187:253-318.
61. Peng H., Long F., Ding C. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Machine Intell. 2005, 27(8):1226-1238.
62. Poullis C., You S. Automatic reconstruction of cities from remote sensor data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2009, 2775-2782. IEEE, Miami, USA, 20-25 June.
63. Press W.H., Flannery B.P., Teukolsky S.A., Vetterling W.T. Numerical Recipes in C 1988, Cambridge University Press, Cambridge, UK.
64. Pu S., Rutzinger M., Vosselman G., Oude Elberink S. Recognizing basic structures from mobile laser scanning data for road inventory studies. ISPRS J. Photogr. Remote Sens. 2011, 66(6):S28-S39.
65. Quinlan J.R. Induction of decision trees. Machine Learn. 1986, 1(1):81-106.
66. Riedmiller, M., Braun, H., 1993. A direct adaptive method for faster backpropagation learning: the RPROP algorithm. In: Proceedings of the IEEE International Conference on Neural Networks, San Francisco, USA, 28 March-1 April, pp. 586-591.
67. Rumelhart D.E., Hinton G.E., Williams R.J. Learning representations by back-propagating errors. Nature 1986, 323:533-536.
68. Rusu, R.B., Marton, Z.C., Blodow, N., Beetz, M., 2008. Persistent point feature histograms for 3d point clouds. In: Proceedings of the International Conference on Intelligent Autonomous Systems, Baden-Baden, Germany, 23-25 July, pp. 119-128.
69. Rusu R.B., Blodow N., Beetz M. Fast point feature histograms (FPFH) for 3d registration. Proceedings of the IEEE International Conference on Robotics and Automation 2009, 3212-3217. IEEE, Kobe, Japan, 12-17 May.
70. Saeys Y., Inza I., Larrañaga P. A review of feature selection techniques in bioinformatics. Bioinformatics 2007, 23(19):2507-2517.
71. Schapire R.E. The strength of weak learnability. Machine Learn. 1990, 5(2):197-227.
72. Schindler K. An overview and comparison of smooth labeling methods for land-cover classification. IEEE Trans. Geosci. Remote Sens. 2012, 50(11):4534-4545.
73. Schmidt A., Niemeyer J., Rottensteiner F., Soergel U. Contextual classification of full waveform lidar data in the Wadden Sea. IEEE Geosci. Remote Sens. Lett. 2014, 11(9):1614-1618.
74. Secord J., Zakhor A. Tree detection in urban regions using aerial lidar and image data. IEEE Geosci. Remote Sens. Lett. 2007, 4(2):196-200.
75. Serna A., Marcotegui B. Urban accessibility diagnosis from mobile laser scanning data. ISPRS J. Photogr. Remote Sens. 2013, 84:23-32.
76. Serna A., Marcotegui B. Detection, segmentation and classification of 3d urban objects using mathematical morphology and supervised learning. ISPRS J. Photogr. Remote Sens. 2014, 93:243-255.
77. Serna A., Marcotegui B., Goulette F., Deschaud J.E. Paris-rue-Madame database: a 3d mobile laser scanner dataset for benchmarking urban detection, segmentation and classification methods. Proceedings of the International Conference on Pattern Recognition Applications and Methods 2014, 819-824. ACM, Angers, France, 6-8 March.
78. Shannon C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27(3):379-423.
79. Shapovalov, R., Velizhev, A., Barinova, O., 2010. Non-associative Markov networks for 3d point cloud classification. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVIII-3A, pp. 103-108.
80. Shapovalov R., Vetrov D., Kohli P. Spatial inference machines. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2013, 2985-2992. IEEE, Portland, USA, 23-28 June.
81. Tokarczyk, P., Wegner, J.D., Walk, S., Schindler, K., 2013. Beyond hand-crafted features in remote sensing. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences II-3/W1, pp. 35-40.
82. Tombari F., Salti S., Di Stefano L. Unique signatures of histograms for local surface description. Proceedings of the European Conference on Computer Vision 2010, 356-369. Springer, Heraklion, Greece, 5-11 September.
83. Unnikrishnan R., Hebert M. Multi-scale interest regions from unorganized point clouds. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2008, 1-8. IEEE, Anchorage, USA, 23-28 June.
84. Vanegas C.A., Aliaga D.G., Benes B. Automatic extraction of manhattan-world building masses from 3d laser range scans. IEEE Trans. Visual. Comput. Graph. 2012, 18(10):1627-1637.
85. Velizhev, A., Shapovalov, R., Schindler, K., 2012. Implicit shape models for object detection in 3d point clouds. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences I-3, pp. 179-184.
86. Vosselman, G., 2013. Point cloud segmentation for urban scene classification. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-7/W2, pp. 257-262.
87. Waldhauser C., Hochreiter R., Otepka J., Pfeifer N., Ghuffar S., Korzeniowska K., Wagner G. Automated classification of airborne laser scanning point clouds. Solving Computationally Expensive Engineering Problems: Methods and Applications 2014, 269-292. Springer, New York, USA. S. Koziel, L. Leifsson, X.-S. Yang (Eds.).
88. Weinmann, M., Jutzi, B., Mallet, C., 2013. Feature relevance assessment for the semantic interpretation of 3d point cloud data. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences II-5/W2, pp. 313-318.
89. Weinmann, M., Jutzi, B., Mallet, C., 2014. Semantic 3d scene interpretation: a framework combining optimal neighborhood size selection with relevant features. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences II-3, pp. 181-188.
90. Weinmann M., Urban S., Hinz S., Jutzi B., Mallet C. Distinctive 2d and 3d features for automated large-scale scene analysis in urban areas. Comput. Graph. 2015, XXX. XXX-XXX.
91. West, K.F., Webb, B.N., Lersch, J.R., Pothier, S., Triscari, J.M., Iverson, A.E., 2004. Context-driven automated target detection in 3-d data. In: Proceedings of SPIE 5426, Automatic Target Recognition XIV, SPIE, Orlando, USA, 12 April, pp. 133-143.
92. Wurm K.M., Kretzschmar H., Kümmerle R., Stachniss C., Burgard W. Identifying vegetation from laser data in structured outdoor environments. Robot. Autonom. Syst. 2014, 62(5):675-684.
93. Xiong X., Munoz D., Bagnell J.A., Hebert M. 3-d scene analysis via sequenced predictions over points and regions. Proceedings of the IEEE International Conference on Robotics and Automation 2011, 2609-2616. IEEE, Shanghai, China, 9-13 May.
94. Xu S., Vosselman G., Oude Elberink S. Multiple-entity based classification of airborne laser scanning data in urban areas. ISPRS J. Photogr. Remote Sens. 2014, 88:1-15.
95. Yu L., Liu H. Feature selection for high-dimensional data: a fast correlation-based filter solution. Proceedings of the International Conference on Machine Learning 2003, 856-863. AAAI Press, Washington, USA, 21-24 August.
96. Yu T.H., Woodford O.J., Cipolla R. A performance evaluation of volumetric 3d interest point detectors. Int. J. Comput. Vis. 2013, 102(1-3):180-197.
97. Zhao, Z., Morstatter, F., Sharma, S., Alelyani, S., Anand, A., Liu, H., 2010. Advancing feature selection research - ASU feature selection repository. Technical Report, School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, USA.
98. Zhou Q.Y., Neumann U. Complete residential urban area reconstruction from dense aerial lidar point clouds. Graph. Models 2013, 75(3):118-125.
99. Zhou L., Vosselman G. Mapping curbstones in airborne and mobile laser scanning data. Int. J. Appl. Earth Observ. Geoinform. 2012, 18(1):293-304.