A supervised hierarchical segmentation of remote-sensing images using a committee of multi-scale convolutional neural networks

International Journal of Remote Sensing

Volumn 37, Issue 7, 2016, Pages 1671-1691

  Basaeed, Essa ^a   Bhaskar, Harish ^a   Hill, Paul ^b   Al Mualla, Mohammed ^a   Bull, David ^b  

^a KHALIFA UNIVERSITY   (United Arab Emirates)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CONVOLUTION; IMAGE SEGMENTATION; NEURAL NETWORKS; REMOTE SENSING;

CONVOLUTIONAL NEURAL NETWORK; FEATURE DETECTOR; HIERARCHICAL SEGMENTATION; MULTI SCALE ANALYSIS; OR APPLICATIONS; REGION BOUNDARIES; REMOTE SENSING IMAGES; SEGMENTATION TECHNIQUES;

FEATURE EXTRACTION;

ACCURACY ASSESSMENT; ARTIFICIAL NEURAL NETWORK; HIERARCHICAL SYSTEM; IMAGE PROCESSING; REMOTE SENSING;

EID: 84962719370     PISSN: 01431161     EISSN: 13665901     Source Type: Journal    
DOI: 10.1080/01431161.2016.1159745     Document Type: Article

References (48)

1. O.Abdel-Hamid,, A.Mohamed, H.Jiang, and G.Penn. 2012. “Applying Convolutional Neural Networks Concepts to Hybrid NN-HMM Model for Speech Recognition.” The IEEE International Conference on Acoustics Speech and Signal Processing, 4277–4280, Kyoto. doi:10.1109/icassp.2012.6288864.
2. M.Baatz,, and A.Schäpe. 2000. “Multiresolution Segmentation: An Optimization Approach for High Quality Multi-Scale Image Segmentation.” In Angewandte Geographische Informationsverarbeitung XII, edited by J. Strobl and T. Blaschke, 12–23. Heidelberg: Wichmann Verlag.
3. E.Basaeed,, H.Bhaskar, and M.Al-Mualla. 2013. “A Spectral Water Index Based on Visual Bands.” In Image and Signal Processing for Remote Sensing XIX, Vol. 8892889219. doi:10.1117/12.2028638.
4. M.Castelluccio,, G.Poggi, C.Sansone, and L.Verdoliva. 2015. “Land Use Classification in Remote Sensing Images by Convolutional Neural Networks.” http://arxiv.org/abs/1508.00092
5. G.Chander,, B.Markham, and D.Helder. 2009. “Summary of Current Radiometric Calibration Coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI Sensors.” Remote Sensing of Environment 113 (5): 893–903. doi:10.1016/j.rse.2009.01.007.
6. X.Chen,, S.Xiang, C.Liu, and C.Pan. 2014. “Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks.” IEEE Geoscience and Remote Sensing Letters 11 (10): 1797–1801. doi:10.1109/LGRS.2014.2309695.
7. D.Ciresan,, A.Giusti, L.Gambardella, and J.Schmidhuber. 2012. “Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images.” In Advances in Neural Information Processing Systems, Nevada, 2852–2860.
8. D.Ciresan,, A.Giusti, L.Gambardella, and J.Schmidhuber. 2013. “Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks.” In Medical Image Computing and Computer-Assisted Intervention, Vol. 8150 of Lecture Notes in Computer Science, edited by K.Mori, I.Sakuma, Y.Sato, C.Barillot, and N.Navab, 411–418. Heidelberg: Springer. doi:10.1007/978-3-642-40763-5_51.
9. D.Ciresan,, U.Meier, and J.Schmidhuber. 2012. “Multi-Column Deep Neural Networks for Image Classification.” IEEE Conference on Computer Vision and Pattern Recognition, 3642–3649, Providence, RI. IEEE. doi:10.1109/cvpr.2012.6248110.
10. R.Collobert,, and J.Weston. 2008. “A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning.”The 25th International Conference on Machine Learning, 160–167, Helsinki. doi:10.1145/1390156.1390177.
11. C.D’Elia,, G.Poggi, and G.Scarpa. 2003. “A Tree-Structured Markov Random Field Model for Bayesian Image Segmentation.” IEEE Transactions on Image Processing 12 (10): 1259–1273. doi:10.1109/TIP.2003.817257.
12. R.Gaetano,, G.Scarpa, and G.Poggi. 2009. “Recursive Texture Fragmentation and Reconstruction Segmentation Algorithm Applied to VHR Images.” IEEE International Geoscience and Remote Sensing Symposium, Vol. 4IV–101–IV–104, University of Cape Town, Cape Town, July. IEEE. doi:10.1109/igarss.2009.5417364.
13. L.Guigues,, J.Cocquerez, and H.Men. 2006. “Scale-Sets Image Analysis.” International Journal of Computer Vision 68 (3): 289–317. doi:10.1007/s11263-005-6299-0.
14. W.Hu,, Y.Huang, L.Wei, F.Zhang, and H.Li. 2015. “Deep Convolutional Neural Networks for Hyperspectral Image Classification.” Journal of Sensors 2015: 1–12. doi:10.1155/2015/258619.
15. Z.Hu,, Z.Wu, Q.Zhang, Q.Fan, and J.Xu. 2013. “A Spatially-Constrained Color–Texture Model for Hierarchical VHR Image Segmentation.” IEEE Geoscience and Remote Sensing Letters 10 (1): 120–124. doi:10.1109/LGRS.2012.2194693.
16. J.Jensen, 2004. Introductory Digital Image Processing. 3rd ed. Upper Saddle River, NJ: Prentice Hall.
17. C.Jung,, and C.Kim. 2010. “Segmenting Clustered Nuclei Using H-Minima Transform-Based Marker Extraction and Contour Parameterization.” IEEE Transactions on Biomedical Engineering 57 (10): 2600–2604. doi:10.1109/TBME.2010.2060336.
18. S.Kim,, W.Lee, D.Kwak, G.Biging, P.Gong, J.Lee, and H.Cho. 2011. “Forest Cover Classification by Optimal Segmentation of High Resolution Satellite Imagery.” Sensors 11 (12): 1943–1958. doi:10.3390/s110201943.
19. A.Krizhevsky,, I.Sutskever, and G.Hinton. 2012. “Imagenet Classification with Deep Convolutional Neural Networks.” In Advances in Neural Information Processing Systems, Vol. 25, edited by F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, 1097–1105. Pahrump, NV: Curran Associates, Inc.
20. Y.Lecun,, L.Bottou, Y.Bengio, and P.Haffner. 1998. “Gradient-Based Learning Applied to Document Recognition.” Proceedings of the IEEE 86 (11): 2278–2324. doi:10.1109/5.726791.
21. H.Li,, H.Gu, Y.Han, and J.Yang. 2008. “An Efficient Multi-Scale Segmentation for High-Resolution Remote Sensing Imagery Based on Statistical Region Merging and Minimum Heterogeneity Rule.” International Workshop on Earth Observation and Remote Sensing Applications, 1–6. Beijing, China: IEEE. July. doi:10.1109/eorsa.2008.4620351.
22. L.Li,, J.Ma, and Q.Wen. 2007. “Parallel Fine Spatial Resolution Satellite Sensor Image Segmentation Based on an Improved Pulse-Coupled Neural Network.” International Journal of Remote Sensing 28 (18): 4191–4198. doi:10.1080/01431160701442047.
23. J.Long,, E.Shelhamer, and T.Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” IEEE Conference on Computer Vision and Pattern Recognition, 3431–3440, Boston, MA. doi:10.1109/cvpr.2015.7298965.
24. P.Marpu,, M.Neubert, H.Herold, and I.Niemeyer. 2010. “Enhanced Evaluation of Image Segmentation Results.” Journal of Spatial Science 55 (1): 55–68. doi:10.1080/14498596.2010.487850.
25. S.Mikes,, M.Haindl, and G.Scarpa. 2012. “Remote Sensing Segmentation Benchmark.” IAPR Workshop on Pattern Recognition in Remote Sensing, 1–4, Tsukuba. doi:10.1109/pprs.2012.6398320
26. V.Mnih, 2013. “Machine learning for aerial image labeling.” Ph.D. thesis. University of Toronto, Toronto, Canda.
27. S.Myint,, P.Gober, A.Brazel, S.Grossman-Clarke, and Q.Weng. 2011. “Per-Pixel Vs. Object-Based Classification of Urban Land Cover Extraction Using High Spatial Resolution Imagery.” Remote Sensing of Environment 115 (5): 1145–1161. doi:10.1016/j.rse.2010.12.017.
28. T.Novack,, T.Esch, H.Kux, and U.Stilla. 2011. “Machine Learning Comparison between Worldview-2 and Quickbird-2 Simulated Imagery regarding Object-Based Urban Land Cover Classification.” Remote Sensing 3 (12): 2263–2282. doi:10.3390/rs3102263.
29. A.Payne,, H.Bhaskar, and L.Mihaylova. 2008. “Multi-Resolution Learning Vector Quantisation Based Automatic Colour Clustering.” In The 11th International Conference on Information Fusion, 1–6. Cologne, Germany: IEEE. Jun.
30. O.Penatti,, K.Nogueira, and J.Dos Santos. 2015. “Do Deep Features Generalize from Everyday Objects to Remote Sensing and Aerial Scenes Domains?” In The IEEE Conference on Computer Vision and Pattern Recognition Workshops, 44–51. Boston, MA IEEE. June. doi:10.1109/cvprw.2015.7301382. http://homepages.dcc.ufmg.br/jefersson/pdf/penatti2015cvprw.pdf
31. P.Salembier,, and L.Garrido. 2000. “Binary Partition Tree as an Efficient Representation for Image Processing, Segmentation, and Information Retrieval.” IEEE Transactions on Image Processing 9 (4): 561–576. doi:10.1109/83.841934.
32. G.Scarpa,, G.Masi, R.Gaetano, L.Verdoliva, and G.Poggi. 2013. “Dynamic Hierarchical Segmentation of Remote Sensing Images.” In Image Analysis and Processing, edited by A.Petrosino, no. 8156 In Lecture Notes in Computer Science, 371–380. Berlin: Springer. doi:10.1007/978-3-642-41181-6_38.
33. D.Scherer,, A.Müller, and S.Behnke. 2010. “Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition.” In Artificial Neural Networks, edited by K.Diamantaras, W.Duch, and L.Iliadis, no. 6354 In Lecture Notes in Computer Science, 92–101. Berlin: Springer. doi:10.1007/978-3-642-15825-4_10.
34. H.Schulz,, and S.Behnke. 2012. “Learning Object-Class Segmentation with Convolutional Neural Networks.” The 11th European Symposium on Artificial Neural Networks, Vol. 31, Bruges, April.
35. P.Sermanet,, and Y.LeCun. 2011. “Traffic Sign Recognition with Multi-Scale Convolutional Networks.” The International Joint Conference on Neural Networks, 2809–2813, San Jose, CA. doi:10.1109/ijcnn.2011.6033589.
36. P.Simard,, D.Steinkraus, and J.Platt. 2003. “Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis.” In The 12th International Conference on Document Analysis and Recognition. Vol 2958–958. Edinburgh: IEEE. doi:10.1109/icdar.2003.1227801.
37. F.Taher,, N.Werghi, H.Al-Ahmad, and C.Donner. 2013. “Extraction and Segmentation of Sputum Cells for Lung Cancer Early Diagnosis.” Algorithms 6 (3): 512–531. doi:10.3390/a6030512.
38. Y.Tarabalka,, J.Tilton, J.Benediktsson, and J.Chanussot. 2012. “A Marker-Based Approach for the Automated Selection of A Single Segmentation from A Hierarchical Set of Image Segmentations.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 5 (1): 262–272. doi:10.1109/JSTARS.2011.2173466.
39. J.Tilton,, Y.Tarabalka, P.Montesano, and E.Gofman. 2012. “Best Merge Region-Growing Segmentation with Integrated Nonadjacent Region Object Aggregation.” IEEE Transactions on Geoscience and Remote Sensing 50 (11): 4454–4467. doi:10.1109/TGRS.2012.2190079.
40. R.Trias-Sanz,, G.Stamon, and J.Louchet. 2008. “Using Colour, Texture, and Hierarchial Segmentation for High-Resolution Remote Sensing.” ISPRS Journal of Photogrammetry and Remote Sensing 63 (2): 156–168. doi:10.1016/j.isprsjprs.2007.08.005.
41. D.Tuia,, M.Volpi, M.Dalla Mura, A.Rakotomamonjy, and R.Flamary. 2014. “Automatic Feature Learning for Spatio-Spectral Image Classification with Sparse SVM.” IEEE Transactions on Geoscience and Remote Sensing 52 (10): 6062–6074. doi:10.1109/TGRS.2013.2294724.
42. S.Ungar,, J.Pearlman, J.Mendenhall, and D.Reuter. 2003. “Overview of the Earth Observing One (EO-1) mission.” IEEE Transactions on Geoscience and Remote Sensing 41 (6): 1149–1159. doi:10.1109/TGRS.2003.815999.
43. A.Visa,, K.Valkealahti, and O.Simula. 1991. “Cloud Detection Based on Texture Segmentation by Neural Network Methods.” IIEEE International Joint Conference on Neural Networks, Vol 21001–1006, Singapore. doi:10.1109/ijcnn.1991.170529.
44. Q.Weng,, and X.Hu. 2008. “Medium Spatial Resolution Satellite Imagery for Estimating and Mapping Urban Impervious Surfaces Using LSMA and ANN.” IEEE Transactions on Geoscience and Remote Sensing 46 (8): 2397–2406. doi:10.1109/TGRS.2008.917601.
45. H.Wu,, and X.Gu. 2015. “Towards Dropout Training for Convolutional Neural Networks.” Neural Networks 71: 1–10. doi:10.1016/j.neunet.2015.07.007.
46. J.Xiaoying, 2007. “Segmentation-Based Image Processing System.” US Patent 2009/0123070A1, filed November 17. http://patentimages.storage.googleapis.com/pdfs/US20090123070.pdf
47. J.Yue,, W.Zhao, S.Mao, and H.Liu. 2015. “Spectral-Spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks.” Remote Sensing Letters 6 (6): 468–477. doi:10.1080/2150704X.2015.1047045.
48. W.Zhang,, R.Li, H.Deng, L.Wang, W.Lin, S.Ji, and D.Shen. 2015. “Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation.” NeuroImage 108: 214–224. doi:10.1016/j.neuroimage.2014.12.061.