Detection of informal settlements from VHR images using convolutional neural networks

Remote Sensing

Volumn 9, Issue 11, 2017, Pages

  Mboga, Nicholus ^a   Persello, Claudio ^a   Bergado, John Ray ^a   Stein, Alfred ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Convolutional neural networks; Deep learning; Image classification; Informal settlements; Very high resolution satellite imagery

Indexed keywords

CONVOLUTION; DECISION MAKING; DEEP LEARNING; ECONOMICS; IMAGE CLASSIFICATION; IMAGE SEGMENTATION; LAND USE; NEURAL NETWORKS; SEMANTICS; SENSITIVITY ANALYSIS; SUPPORT VECTOR MACHINES;

CLASSIFICATION RESULTS; CLASSIFICATION TECHNIQUE; CONVOLUTIONAL NEURAL NETWORK; EXPERIMENTAL ANALYSIS; GREY-LEVEL CO-OCCURRENCE MATRIXES; INFORMAL SETTLEMENTS; SUPPORT VECTOR MACHINE (SVMS); VERY HIGH RESOLUTION SATELLITE IMAGERY;

SATELLITE IMAGERY;

EID: 85034779339     PISSN: None     EISSN: 20724292     Source Type: Journal    
DOI: 10.3390/rs9111106     Document Type: Article

References (61)

1. Kironde, J.M.L. The regulatory framework, unplanned development and urban poverty: Findings from Dar es Salaam, Tanzania. Land Use Policy 2006, 23, 460-472
2. UN-Habitat. The Challenge of Slums-Global Report on Human Settlements; UN-Habitat: Nairobi, Kenya, 2003
3. UN-Habitat. Habitat. Habitat III Issue Papers 22-Informal Settlements. In United Nations Conference on Housing and Sustainable Urban Development; UN-Habitat: Nairobi, Kenya, 2015; Volume 2015, pp. 1-8
4. Owen, K.K.; Wong, D.W. An approach to differentiate informal settlements using spectral, texture, geomorphology and road accessibility metrics. Appl. Geogr. 2013, 38, 107-118
5. Kuffer, M.; Barros, J.; Sliuzas, R.V. The development of a morphological unplanned settlement index using very-high-resolution (VHR) imagery. Comput. Environ. Urban Syst. 2014, 48, 138-152
6. Hofmann, P.; Strobl, J.; Blaschke, T.; Kux, H. Detecting informal settlements from Quickbird data in Rio de Janeiro using an object based approach. Object-Based Image Anal. 2008, 531-553
7. Kuffer, M.; Barros, J. Urban Morphology of Unplanned Settlements: The Use of Spatial Metrics in VHR Remotely Sensed Images. Procedia Environ. Sci. 2011, 7, 152-157
8. Shekhar, S. Detecting slums from Quickbird data in Pune using an object oriented approach. ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2012, XXXIX-B8, 519-524
9. Bergado, J.R.A.; Persello, C.; Gevaert, C. A deep learning approach to the classification of sub-decimeter resolution aerial images. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Beijing, China, 10-15 July 2016; pp. 1516-1519
10. Haralick, R.; Shanmugan, K.; Dinstein, I. Textural features for image classification. IEEE Trans. Syst. Man Cybern. 1973, 3, 610-621
11. Pesaresi, M.; Benediktsson, J.A. A New Approach for the Morphological Segmentation of High-Resolution Satellite Imagery. IEEE Trans. Geosci. Remote Sens. 2001, 39, 309-320
12. Kuffer, M.; Pfeffer, K.; Sliuzas, R.; Baud, I. Extraction of Slum Areas From VHR Imagery Using GLCM Variance. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2016, 9, 1830-1840
13. Kit, O.; Lüdeke, M.; Reckien, D. Texture-based identification of urban slums in Hyderabad, India using remote sensing data. Appl. Geogr. 2012, 32, 660-667
14. Ella, L.P.A.; van den Bergh, F.; van Wyk, B.J.; van Wyk, M.A. A Comparison of Texture Feature Algorithms for Urban Settlement Classification. In Proceedings of the 2008 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Boston, MA, USA, 6-11 July 2008; Volume 3, pp. III-1308-III-1311
15. Graesser, J.; Cheriyadat, A.; Vatsavai, R.R.; Chandola, V.; Long, J.; Bright, E. Image based characterization of formal and informal neighborhoods in an urban landscape. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2012, 5, 1164-1176
16. Fauvel, M.; Tarabalka, Y.; Benediktsson, J.A.; Chanussot, J.; Tilton, J.C. Advances in Spectral-Spatial Classification of Hyperspectral Images. Proc. IEEE 2013, 101, 652-675
17. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436-444
18. Schmidhuber, J. Deep Learning in neural networks: An overview. Neural Netw. 2015, 61, 85-117
19. Krizhevsky, A.; Sutskever, I.; Hinton, G.E. ImageNet Classification with Deep Convolutional Neural Networks. In Advances in Neural Information Processing Systems; Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q., Eds.; Curran Associates, Inc.: Red Hook, NY, USA, 2012; pp. 1097-1105
20. Ciresan, D.; Meier, U.; Schmidhuber, J. Multi-column Deep Neural Networks for Image Classification. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA, 16-21 June 2012; pp. 3642-3649
21. Paisitkriangkrai, S.; Sherrah, J.; Janney, P.; van den Hengel, A. Semantic Labeling of Aerial and Satellite Imagery. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2016, 9, 2868-2881
22. Längkvist, M.; Kiselev, A.; Alirezaie, M.; Loutfi, A. Classification and Segmentation of Satellite Orthoimagery Using Convolutional Neural Networks. Remote Sens. 2016, 8, 329
23. Alshehhi, R.; Reddy, P.; Lee, W.; Dalla, M. Simultaneous extraction of roads and buildings in remote sensing imagery with convolutional neural networks. ISPRS J. Photogramm. Remote Sens. 2017, 130, 139-149
24. Kussul, N.; Lavreniuk, M.; Skakun, S.; Shelestov, A. Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data. IEEE Geosci. Remote Sens. Lett. 2017, 14, 778-782
25. Mnih, V. Machine Learning for Aerial Image Labeling. Ph. D. Thesis, University of Toronto, Toronto, ON, Canada, 2013
26. Luus, F.P.S.; Salmon, B.P.; Van Den Bergh, F.; Maharaj, B.T.J. Multiview Deep Learning for Land-Use Classification. IEEE Geosci. Remote Sens. Lett. 2015, 12, 2448-2452
27. Castelluccio, M.; Poggi, G.; Sansone, C.; Verdoliva, L. Land Use Classification in Remote Sensing Images by Convolutional Neural Networks. arXiv 2015; 1-11, arXiv:1508.00092
28. Ševo, I.; Avramović, A. Convolutional Neural Network Based Automatic Object Detection on Aerial Images. IEEE Geosci. Remote Sens. Lett. 2016, 13, 740-744
29. Marmanis, D.; Datcu, M.; Esch, T.; Stilla, U. Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks. IEEE Geosci. Remote Sens. Lett. 2016, 13, 105-109
30. Volpi, M.; Tuia, D. Dense semantic labeling of sub-decimeter resolution images with convolutional neural networks. IEEE Geosci. Remote Sens. Lett. 2017, 55, 881-893
31. Goodfellow, I.; Bengio, Y.; Courville, A. Deep Learning; The MIT Press: Cambridge, MA, USA, 2016
32. Glorot, X.; Bengio, Y. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS), Sardinia, Italy, 13-15 May 2010; Volume 9, pp. 249-256
33. Nair, V.; Hinton, G.E. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on Machine Learning (ICML-10), Haifa, Israel, 21-25 June 2010; pp. 807-814
34. Kivinen, J.J.;Williams, C.K.I. Transformation equivariant Boltzmann machines. In Lecture Notes Computer Science(LNCS) (Including Its Subseries Lecture Notes Artificial Intelligence and Lecture Notes in Bioinformatics); Springer: Berlin/Heidelberg, Germany, 2011; Volume 6791, pp. 1-9
35. Zeiler, M.D.; Fergus, R. Stochastic pooling for regularization of deep convolutional neural networks. arXiv 2013, arXiv:1301.3557
36. Bottou, L. Large-scale machine learning with stochastic gradient descent. In Proceedings of COMPSTAT'2010; Springer: Cham, Swizerland, 2010; pp. 177-186
37. LeCun, Y.A.; Bottou, L.; Orr, G.B.; Müller, K.-R. Efficient BackProp. In Neural Networks: Tricks of the Trade, 2nd ed.; Montavon, G., Orr, G.B., Müller, K.-R., Eds.; Springer: Berlin/Heidelberg, Germany, 2012; pp. 9-48
38. Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; Salakhutdinov, R. Dropout: A SimpleWay to Prevent Neural Networks from Overfitting. J. Mach. Learn. Res. 2014, 15, 1929-1958
39. Sliuzas, R.V.; Hill, A.; Lindner, C.; Greiving, S. Dar es Salaam Land Use and Informal Settlement Data Set; NASA Socioe: Palisades, NY, USA, 2016
40. Sliuzas, R.V. Managing Informal Settlements: A Study Using Geo-Information in Dar es Salaam, Tanzania. Ph. D. Dissertation, Utrecht University, Utrecht, The Netherlands, 2004
41. Theano Development Team. Theano: A (Python) framework for fast computation of mathematical expressions. arXiv 2016, arXiv:1605.02688
42. R Core Team. R: A Language and Environment for Statistical Computing. Available online: https://www.rproject. org/(accessed on 23 October 2017)
43. Rossum, G. Python Reference Manual; CWI (Centre for Mathematics and Computer Science): Amsterdam, The Netherlands, 1995
44. Farabet, C.; Couprie, C.; Najman, L.; Lecun, Y. Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35, 1915-1929
45. Bruzzone, L.; Persello, C. Handbook of Pattern Recognition and Computer Vision. In Handbook of Pattern Recognition and Computer Vision; Chen, C.H., Ed.;World Scientific: Singapore, 2010; pp. 329-352
46. Ojala, T.; Pietikäinen, M.; Mäenpää, T. A generalized local binary pattern operator for multiresolution gray scale and rotation invariant texture classification. Adv. Pattern Recognit. 2001, 2013, 399-408
47. Ojala, T.; Pietikäinen, M.; Mäenpää, T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24, 971-987
48. Congalton, R.G. A review of assessing the accuracy of classifications of remotely sensed data. Remote Sens. Environ. 1991, 37, 35-46
49. He, K.; Zhang, X.; Ren, S.; Sun, J. Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2015, 37, 1904-1916
50. Zeiler, M.D.; Fergus, R. Visualizing and Understanding Convolutional Networks. In Computer Vision-ECCV 2014; Springer: Cham, Swizerland, 2014; Volume 8689, pp. 818-833
51. Simonyan, K.; Zisserman, A. Very Deep Convolutional Networks for Large-Scale Image Recognition. CoRR 2014
52. Maas, A.L.; Hannun, A.Y.; Ng, A.Y. Rectifier Nonlinearities Improve Neural Network Acoustic Models. In Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA, 16-21 June 2013; Volume 28, p. 6
53. Kohli, D.; Stein, A.; Sliuzas, R. Uncertainty analysis for image interpretations of urban slums. Comput. Environ. Urban Syst. 2016, 60, 37-49
54. Marconcini, M.; Esch, T.; Chrysoulakis, N.; Düzgün, H.S.; Tal, A.; Forth, T.H.; Aviv, T. Towards EO-based sustainable urban planning and management. In Proceedings of the 2013 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Melbourne, Australia, 21-26 July 2013; pp. 4273-4276
55. Sliuzas, R. Opportunities for enhancing communication in settlement upgrading with geographic information technology-based support tools. Habitat Int. 2003, 27, 613-628
56. Ward, P.M. Housing rehab for consolidated informal settlements: A newpolicy agenda for 2016 UN-Habitat III. Habitat Int. 2016, 50, 373-384
57. Hasan, A. Orangi Pilot Project: The expansion of work beyond Orangi and the mapping of informal settlements. Environ. Urban. 2006, 18, 451-480
58. Karanja, I. An enumeration and mapping of informal settlements in Kisumu, Kenya, implemented by their inhabitants. Environ. Urban. 2010, 22, 217-239
59. Abbott, J. An analysis of informal settlement upgrading and critique of existing methodological approaches. Habitat Int. 2002, 26, 303-315
60. Marais, L.; Ntema, J. The upgrading of an informal settlement in South Africa: Two decades onwards. Habitat Int. 2013, 39, 85-95
61. Musakwa, W.; Niekerk, A. Van Implications of land use change for the sustainability of urban areas: A case study of Stellenbosch, South Africa. Cities 2013, 32, 143-156