A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 140, Issue , 2018, Pages 133-144

  Zhang, Ce ^a   Pan, Xin ^b,c   Li, Huapeng ^b   Gardiner, Andy ^d   Sargent, Isabel ^d   Hare, Jonathon ^e   Atkinson, Peter M ^a  

^a LANCASTER UNIVERSITY   (United Kingdom)

^b NORTHEAST INSTITUTE OF GEOGRAPHY AND AGRICULTURAL ECOLOGY   (China)

^c CHANGCHUN INSTITUTE OF TECHNOLOGY   (China)

^d ORDNANCE SURVEY   (United Kingdom)

^e UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Convolutional neural network; Feature representation; Fusion decision; Multilayer perceptron; VFSR remotely sensed imagery

Indexed keywords

AERIAL PHOTOGRAPHY; CLASSIFICATION (OF INFORMATION); CONVOLUTION; IMAGE RESOLUTION; LEARNING SYSTEMS; MULTILAYER NEURAL NETWORKS; MULTILAYERS; NEURAL NETWORKS; PIXELS; REMOTE SENSING;

CLASSIFICATION ACCURACY; CLASSIFICATION CONFIDENCE; CONVOLUTIONAL NEURAL NETWORK; FEATURE REPRESENTATION; MACHINE LEARNING APPROACHES; MULTI LAYER PERCEPTRON; NEURAL NETWORK ALGORITHM; REMOTELY SENSED IMAGERY;

IMAGE CLASSIFICATION;

AERIAL PHOTOGRAPHY; ALGORITHM; ARTIFICIAL NEURAL NETWORK; DATA SET; IMAGE CLASSIFICATION; MACHINE LEARNING; PIXEL; REMOTE SENSING; SATELLITE IMAGERY; SATELLITE SENSOR; SPATIAL RESOLUTION;

EID: 85026643598     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2017.07.014     Document Type: Article

References (67)

1. Ardila, J.P., Tolpekin, V.A., Bijker, W., Stein, A., Markov-random-field-based super-resolution mapping for identification of urban trees in VHR images. ISPRS J. Photogramm. Remote Sens. 66 (2011), 762–775, 10.1016/j.isprsjprs.2011.08.002.
2. Arel, I., Rose, D.C., Karnowski, T.P., Deep machine learning – a new frontier in artificial intelligence research. IEEE Comput. Intell. Mag. 5 (2010), 13–18, 10.1109/MCI.2010.938364.
3. Atkinson, P.M., Tatnall, A.R.L., Introduction neural networks in remote sensing. Int. J. Remote Sens. 18 (1997), 699–709, 10.1080/014311697218700.
4. Attarchi, S., Gloaguen, R., Classifying complex mountainous forests with L-Band SAR and landsat data integration: a comparison among different machine learning methods in the Hyrcanian forest. Remote Sens. 6 (2014), 3624–3647, 10.3390/rs6053624.
5. Benediktsson, J.A., Ensemble classification algorithm for hyperspectral remote sensing data. IEEE Geosci. Remote Sens. Lett. 6 (2009), 762–766, 10.1109/LGRS.2009.2024624.
6. Berberoglu, S., Lloyd, C.D., Atkinson, P.M., Curran, P.J., The integration of spectral and textural information using neural networks for land cover mapping in the Mediterranean. Comput. Geosci. 26 (2000), 385–396, 10.1016/S0098-3004(99)00119-3.
7. Bezak, P., Bozek, P., Nikitin, Y., Advanced robotic grasping system using deep learning. Procedia Eng. 96 (2014), 10–20, 10.1016/j.proeng.2014.12.092.
8. Breiman, L., Bagging predictors. Mach. Learn. 24 (1996), 123–140.
9. Chen, S., Member, S., Wang, H., Xu, F., Member, S., Target classification using the deep convolutional networks for SAR images. IEEE Trans. Geosci. Remote Sens. 54 (2016), 4806–4817.
10. Chen, Y., Jiang, H., Li, C., Jia, X., Member, S., Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEE Trans. Geosci. Remote Sens. 54 (2016), 6232–6251, 10.1109/TGRS.2016.2584107.
11. Chen, Y., Lin, Z., Zhao, X., Wang, G., Gu, Y., Deep learning-based classification of hyperspectral data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 7 (2014), 2094–2107, 10.1109/JSTARS.2014.2329330.
12. Clinton, N., Yu, L., Gong, P., Geographic stacking: decision fusion to increase global land cover map accuracy. ISPRS J. Photogramm. Remote Sens. 103 (2015), 57–65, 10.1016/j.isprsjprs.2015.02.010.
13. Congalton, R.G., A review of assessing the accuracy of classifications of remotely sensed data. Remote Sens. Environ. 37 (1991), 35–46.
14. Dark, S.J., Bram, D., The modifiable areal unit problem (MAUP) in physical geography. Prog. Phys. Geogr. 31 (2007), 471–479, 10.1177/0309133307083294.
15. Del Frate, F., Pacifici, F., Schiavon, G., Solimini, C., Use of neural networks for automatic classification from high-resolution images. IEEE Trans. Geosci. Remote Sens. 45 (2007), 800–809, 10.1109/TGRS.2007.892009.
16. Demarchi, L., Canters, F., Cariou, C., Licciardi, G., Chan, J.C.W., Assessing the performance of two unsupervised dimensionality reduction techniques on hyperspectral APEX data for high resolution urban land-cover mapping. ISPRS J. Photogramm. Remote Sens. 87 (2014), 166–179, 10.1016/j.isprsjprs.2013.10.012.
17. Dong, Z., Pei, M., He, Y., Liu, T., Dong, Y., Jia, Y., Vehicle type classification using unsupervised convolutional neural network. IEEE Trans. Intell. Transp. Syst. 16 (2015), 2247–2256, 10.1109/ICPR.2014.39.
18. Du, P., Xia, J., Zhang, W., Tan, K., Liu, Y., Liu, S., Multiple classifier system for remote sensing image classification: a review. Sensors 12 (2012), 4764–4792, 10.3390/s120404764.
19. Farabet, C., Couprie, C., Najman, L., Lecun, Y., Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 35 (2013), 1915–1929, 10.1109/TPAMI.2012.231.
20. Fauvel, M., Chanussot, J., Benediktsson, J.A., A spatial-spectral kernel-based approach for the classification of remote-sensing images. Pattern Recognit. 45 (2012), 381–392, 10.1016/j.patcog.2011.03.035.
21. Fauvel, M., Chanussot, J., Benediktsson, J.A., Decision fusion for the classification of urban remote sensing images. IEEE Trans. Geosci. Remote Sens. 44 (2006), 2828–2838, 10.1109/TGRS.2006.876708.
22. Foody, G.M., Arora, M.K., An evaluation of some factors affecting the accuracy of classification by an artificial neural network. Int. J. Remote Sens. 18 (1997), 799–810, 10.1080/014311697218764.
23. Freund, Y., Iyer, R., Schapire, R.E., Singer, Y., An efficient boosting algorithm for combining preferences. J. Mach. Learn. Res. 4 (2003), 933–969.
24. Haralick, R.M., Shanmugam, K., Dinstein, I., Textural features for image classification. IEEE Trans. Syst. Man. Cybern. 3 (1973), 610–621, 10.1109/TSMC.1973.4309314.
25. Hu, F., Xia, G.-S., Hu, J., Zhang, L., Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sens. 7 (2015), 14680–14707, 10.3390/rs71114680.
26. Hu, F., Xia, G.S., Wang, Z., Huang, X., Zhang, L., Sun, H., Unsupervised feature learning via spectral clustering of multidimensional patches for remotely sensed scene classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8 (2015), 2015–2030, 10.1109/JSTARS.2015.2444405.
27. Huang, X., Lu, Q., Zhang, L., A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas. ISPRS J. Photogramm. Remote Sens. 90 (2014), 36–48, 10.1016/j.isprsjprs.2014.01.008.
28. Hughes, G.F., On the mean accuracy of statistical pattern recognizers. IEEE Trans. Inf. Theory 14 (1968), 55–63, 10.1109/TIT.1968.1054102.
29. Krizhevsky, A., Sutskever, I., Hinton, G.E., ImageNet classification with deep convolutional neural networks. NIPS2012: Neural Information Processing Systems. Lake Tahoe, Nevada, 2012, 1–9.
30. Längkvist, M., Kiselev, A., Alirezaie, M., Loutfi, A., Classification and segmentation of satellite orthoimagery using convolutional neural networks. Remote Sens. 8 (2016), 1–21, 10.3390/rs8040329.
31. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444, 10.1038/nature14539.
32. Lenz, I., Lee, H., Saxena, A., Deep learning for detecting robotic grasps. Int. J. Rob. Res. 34 (2015), 705–724, 10.1177/0278364914549607.
33. Löw, F., Conrad, C., Michel, U., Decision fusion and non-parametric classifiers for land use mapping using multi-temporal RapidEye data. ISPRS J. Photogramm. Remote Sens. 108 (2015), 191–204, 10.1016/j.isprsjprs.2015.07.001.
34. Mas, J.F., Flores, J.J., The application of artificial neural networks to the analysis of remotely sensed data. Int. J. Remote Sens. 29 (2008), 617–663, 10.1080/01431160701352154.
35. Masi, G., Cozzolino, D., Verdoliva, L., Scarpa, G., Wang, L., Zhou, G., Thenkabail, P.S., Pansharpening by convolutional neural networks. Remote Sens. 8 (2016), 1–22, 10.3390/rs8070594.
36. Mathieu, R., Freeman, C., Aryal, J., Mapping private gardens in urban areas using object-oriented techniques and very high-resolution satellite imagery. Landsc. Urban Plan. 81 (2007), 179–192, 10.1016/j.landurbplan.2006.11.009.
37. Min, J.H., Lee, Y.-C., Bankruptcy prediction using support vector machine with optimal choice of kernel function parameters. Expert Syst. Appl. 28 (2005), 603–614.
38. Mokhtarzade, M., Zoej, M.J.V., Road detection from high-resolution satellite images using artificial neural networks. Int. J. Appl. Earth Obs. Geoinf. 9 (2007), 32–40, 10.1016/j.jag.2006.05.001.
39. Othman, E., Bazi, Y., Alajlan, N., Alhichri, H., Melgani, F., Using convolutional features and a sparse autoencoder for land-use scene classification. Int. J. Remote Sens. 37 (2016), 2149–2167, 10.1080/01431161.2016.1171928.
40. Ozdarici-Ok, A., Ok, A., Schindler, K., Mapping of agricultural crops from single high-resolution multispectral images—data-driven smoothing vs. Parcel-based smoothing. Remote Sens. 7 (2015), 5611–5638, 10.3390/rs70505611.
41. Pacifici, F., Chini, M., Emery, W.J., A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification. Remote Sens. Environ. 113 (2009), 1276–1292, 10.1016/j.rse.2009.02.014.
42. Pingel, T.J., Clarke, K.C., McBride, W.A., An improved simple morphological filter for the terrain classification of airborne LIDAR data. ISPRS J. Photogramm. Remote Sens. 77 (2013), 21–30, 10.1016/j.isprsjprs.2012.12.002.
43. Powers, R.P., Hermosilla, T., Coops, N.C., Chen, G., Remote sensing and object-based techniques for mapping fine-scale industrial disturbances. Int. J. Appl. Earth Obs. Geoinf. 34 (2015), 51–57, 10.1016/j.jag.2014.06.015.
44. Regnauld, N., Mackaness, W.a., Creating a hydrographic network from its cartographic representation: a case study using Ordnance Survey MasterMap data. Int. J. Geogr. Inf. Sci. 20 (2006), 611–631, 10.1080/13658810600607402.
45. Reis, S., Tasdemir, K., Identification of hazelnut fields using spectral and gabor textural features. ISPRS J. Photogramm. Remote Sens. 66 (2011), 652–661, 10.1016/j.isprsjprs.2011.04.006.
46. Rodriguez-Galiano, V.F., Chica-Olmo, M., Abarca-Hernandez, F., Atkinson, P.M., Jeganathan, C., Random Forest classification of Mediterranean land cover using multi-seasonal imagery and multi-seasonal texture. Remote Sens. Environ. 121 (2012), 93–107, 10.1016/j.rse.2011.12.003.
47. Romero, A., Gatta, C., Camps-valls, G., Member, S., Unsupervised deep feature extraction for remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 54 (2016), 1349–1362, 10.1109/TGRS.2015.2478379.
48. Schmidhuber, J., Deep learning in neural networks: an overview. Neural Networks, 2015, 10.1016/j.neunet.2014.09.003.
49. Shi, H., Chen, L., Bi, F., Chen, H., Yu, Y., Accurate urban area detection in remote sensing images. IEEE Geosci. Remote Sens. Lett. 12 (2015), 1948–1952.
50. Strigl, D., Kofler, K., Podlipnig, S., 2010. Performance and scalability of GPU-based convolutional neural networks. In: 2010 18th Euromicro Conference on Parallel, Distributed and Network-Based Processing, pp. 317–324. http://dx.doi.org/10.1109/PDP.2010.43.
51. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A., 2015. Going deeper with convolutions. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–9. http://dx.doi.org/10.1109/CVPR.2015.7298594.
52. Tang, J., Deng, C., Huang, G.-B., Zhao, B., Compressed-domain ship detection on spaceborne optical image using deep neural network and extreme learning machine. IEEE Trans. Geosci. Remote Sens. 53 (2015), 1174–1185, 10.1109/TGRS.2014.2335751.
53. Wang, L., Shi, C., Diao, C., Ji, W., Yin, D., A survey of methods incorporating spatial information in image classification and spectral unmixing. Int. J. Remote Sens. 37 (2016), 3870–3910, 10.1080/01431161.2016.1204032.
54. Wolpert, D.H., Macready, W.G., No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1 (1997), 67–82, 10.1109/4235.585893.
55. Xia, G.S., Delon, J., Gousseau, Y., Shape-based invariant texture indexing. Int. J. Comput. Vis. 88 (2010), 382–403, 10.1007/s11263-009-0312-3.
56. Yang, W., Dai, D., Triggs, B., Xia, G.S., SAR-based terrain classification using weakly supervised hierarchical Markov aspect models. IEEE Trans. Image Process. 21 (2012), 4232–4243, 10.1109/TIP.2012.2199127.
57. Yang, W., Yin, X., Xia, G.S., Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans. Geosci. Remote Sens. 53 (2015), 4472–4482, 10.1109/TGRS.2015.2400449.
58. Yang, X., Qian, X., Mei, T., Learning salient visual word for scalable mobile image retrieval. Pattern Recognit. 48 (2015), 3093–3101, 10.1016/j.patcog.2014.12.017.
59. Yin, W., Yang, J., Yamamoto, H., Li, C., Object-based larch tree-crown delineation using high-resolution satellite imagery. Int. J. Remote Sens. 36 (2015), 822–844, 10.1080/01431161.2014.999165.
60. Yu, J., Weng, K., Liang, G., Xie, G., 2013. A vision-based robotic grasping system using deep learning for 3D object recognition and pose estimation. In: 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1175–1180. http://dx.doi.org/10.1109/ROBIO.2013.6739623.
61. Yue, J., Mao, S., Li, M., A deep learning framework for hyperspectral image classification using spatial pyramid pooling. Remote Sens. Lett. 7 (2016), 875–884, 10.1080/2150704X.2016.1193793.
62. Zhang, C., Kovacs, J.M., The application of small unmanned aerial systems for precision agriculture: a review. Precis. Agric. 13 (2012), 693–712, 10.1007/s11119-012-9274-5.
63. Zhang, C., Wang, T., Atkinson, P.M., Pan, X., Li, H., A novel multi-parameter support vector machine for image classification. Int. J. Remote Sens. 36 (2015), 1890–1906, 10.1080/01431161.2015.1029096.
64. Zhang, F., Du, B., Zhang, L., Scene classification via a gradient boosting random convolutional network framework. IEEE Trans. Geosci. Remote Sens. 54 (2016), 1793–1802, 10.1109/TGRS.2015.2488681.
65. Zhang, Q., Wang, J., Gong, P., Shi, P., Study of urban spatial patterns from SPOT panchromatic imagery using textural analysis. Int. J. Remote Sens. 24 (2003), 4137–4160, 10.1080/0143116031000070445.
66. Zhao, W., Du, S., Learning multiscale and deep representations for classifying remotely sensed imagery. ISPRS J. Photogramm. Remote Sens. 113 (2016), 155–165, 10.1016/j.isprsjprs.2016.01.004.
67. Zhong, Y., Zhao, J., Zhang, L., A hybrid object-oriented conditional random field classification framework for high spatial resolution remote sensing imagery. IEEE Trans. Geosci. Remote Sens. 52 (2014), 7023–7037, 10.1109/TGRS.2014.2306692.