An object-based and heterogeneous segment filter convolutional neural network for high-resolution remote sensing image classification

International Journal of Remote Sensing

Volumn 40, Issue 15, 2019, Pages 5892-5916

  Pan, Xin ^a   Zhao, Jian ^a   Xu, Jun ^a  

^a CHANGCHUN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; CONVOLUTION; DATA MINING; DECISION MAKING; DEEP LEARNING; ERRORS; IMAGE RESOLUTION; NEURAL NETWORKS; OBJECT RECOGNITION; POSITIVE IONS; REMOTE SENSING;

CLASSIFICATION ACCURACY; COMPLEX CHARACTERISTICS; CONVOLUTIONAL NEURAL NETWORK; DECISION MAKING PROCESS; HIGH RESOLUTION REMOTE SENSING IMAGES; REMOTE SENSING CLASSIFICATION; SEGMENTATION ALGORITHMS; SUPERVISED CLASSIFICATION;

IMAGE SEGMENTATION;

ACCURACY ASSESSMENT; ALGORITHM; ARTIFICIAL NEURAL NETWORK; IMAGE CLASSIFICATION; IMAGE PROCESSING; IMAGE RESOLUTION; REMOTE SENSING; SEGMENTATION;

EID: 85062362438     PISSN: 01431161     EISSN: 13665901     Source Type: Journal    
DOI: 10.1080/01431161.2019.1584687     Document Type: Article

References (40)

1. Akçay, H. G., and S., Aksoy. 2010. “Building Detection Using Directional Spatial Constraints.” In 2010 Ieee International Geoscience and Remote Sensing Symposium, Honolulu, Hawaii, United States. 1932–1935. doi:10.1109/Igarss.2010.5652842.
2. Blaschke, T., 2010. “Object Based Image Analysis for Remote Sensing.” Isprs Journal of Photogrammetry and Remote Sensing 65 (1): 2–16. doi:10.1016/j.isprsjprs.2009.06.004.
3. Blaschke, T., G. J., Hay, M., Kelly, S., Lang, P., Hofmann, E., Addink, R. Q., Feitosa, et al. 2014. “Geographic Object-Based Image Analysis–Towards a New Paradigm.” Isprs Journal of Photogrammetry and Remote Sensing 87: 180–191. doi:10.1016/j.isprsjprs.2013.09.014.
4. Fu, G., C. J., Liu, R., Zhou, T., Sun, and Q. J., Zhang. 2017. “Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network.” Remote Sensing 9: 5. doi:10.3390/Rs9050498.
5. Garcia-Pedrero, A., C., Gonzalo-Martin, D., Fonseca-Luengo, and M., Lillo-Saavedra. 2015. “A GEOBIA Methodology for Fragmented Agricultural Landscapes.” Remote Sensing 7 (1): 767–787. doi:10.3390/rs70100767.
6. Hinton, G. E., S., Osindero, and Y. W., Teh. 2006. “A Fast Learning Algorithm for Deep Belief Nets.” Neural Computation 18 (7): 1527–1554. doi:10.1162/neco.2006.18.7.1527.
7. Hu, F., G. S., Xia, J. W., Hu, and L. P., Zhang. 2015. “Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery.” Remote Sensing 7 (11): 14680–14707. doi:10.3390/rs71114680.
8. Ioffe, S., and C., Szegedy. 2015. “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift.” In Proceedings of the 32nd International Conference Machine Learning 1: 448–456.
9. Johnson, B., and Z. X., Xie. 2013. “Classifying a High Resolution Image of an Urban Area Using Super-Object Information.” Isprs Journal of Photogrammetry and Remote Sensing 83: 40–49. doi:10.1016/j.isprsjprs.2013.05.008.
10. Krizhevsky, A., I., Sutskever, and G. E., Hinton. 2017. “ImageNet Classification with Deep Convolutional Neural Networks.” Communications of the ACM 60 (6): 84–90. doi:10.1145/3065386.
11. LeCun, Y., Y., Bengio, and G., Hinton. 2015. “Deep Learning.” Nature 521: 436–444. doi:10.1038/nature14539.
12. Liu, Y., B., Fang, L., Wang, J., Bai, S., Xiang, and C., Pan. 2018. “Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network.” ISPRS Journal of Photogrammetry and Remote Sensing 145: 78–95. doi:10.1016/j.isprsjprs.2017.12.007.
13. Long, J., E., Shelhamer, and T., Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” In 2015 Ieee Conference on Computer Vision and Pattern Recognition (Cvpr), Boston, MA. 3431–3440.
14. Lv, X., D., Ming, Y. Y., Chen, and M., Wang. 2018. “Very High Resolution Remote Sensing Image Classification with SEEDS-CNN and Scale Effect Analysis for Superpixel CNN Classification.” International Journal of Remote Sensing online:1–27. doi:10.1080/01431161.2018.1513666.
15. Ma, L., M. C., Li, X. X., Ma, L., Cheng, P. J., Du, and Y. X., Liu. 2017. “A Review of Supervised Object-Based Land-Cover Image Classification.” Isprs Journal of Photogrammetry and Remote Sensing 130: 277–293. doi:10.1016/j.isprsjprs.2017.06.001.
16. Machala, M., and L., Zejdova. 2014. “Forest Mapping through Object-Based Image Analysis of Multispectral and LiDAR Aerial Data.” European Journal of Remote Sensing 47: 117–131. doi:10.5721/EuJRS20144708.
17. Maggiori, E., G., Charpiat, Y., Tarabalka, and P., Alliez. 2017. “Recurrent Neural Networks to Correct Satellite Image Classification Maps.” Ieee Transactions on Geoscience and Remote Sensing 55 (9): 4962–4971. doi:10.1109/Tgrs.2017.2697453.
18. Müllerová, J., J., Bruna, T., Bartalos, P., Dvorak, M., Vitkova, and P., Pysek. 2017. “Timing Is Important: Unmanned Aircraft vs. Satellite Imagery in Plant Invasion Monitoring.” Frontiers in Plant Science 8. doi:10.3389/Fpls.2017.00887.
19. Nogueira, K., O. A. B., Penatti, and J. A., Dos Santos. 2017. “Towards Better Exploiting Convolutional Neural Networks for Remote Sensing Scene Classification.” Pattern Recognition 61: 539–556. doi:10.1016/j.patcog.2016.07.001.
20. Pan, X., and J., Zhao. 2017. “A Central-Point-Enhanced Convolutional Neural Network for High-Resolution Remote-Sensing Image Classification.” International Journal of Remote Sensing 38 (23): 6554–6581. doi:10.1080/01431161.2017.1362131.
21. Pan, X., and J., Zhao. 2018. “High-Resolution Remote Sensing Image Classification Method Based on Convolutional Neural Network and Restricted Conditional Random Field.” Remote Sensing 10: 6. doi:10.3390/Rs10060920.
22. Peña-Barragán, J. M., M. K., Ngugi, R. E., Plant, and J., Six. 2011. “Object-Based Crop Identification Using Multiple Vegetation Indices, Textural Features and Crop Phenology.” Remote Sensing of Environment 115 (6): 1301–1316. doi:10.1016/j.rse.2011.01.009.
23. Qayyum, A., A. S., Malik, N. M., Saad, M., Iqbal, M. F., Abdullah, W., Rasheed, T. A. B. R., Abdullah, and M. Y., Bin Jafaar. 2017. “Scene Classification for Aerial Images Based on CNN Using Sparse Coding Technique.” International Journal of Remote Sensing 38 (8–10): 2662–2685. doi:10.1080/01431161.2017.1296206.
24. Ranzato, M., F. J., Huang, Y. L., Boureau, and Y., LeCun. 2007. “Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition.” In 2007 Ieee Conference on Computer Vision and Pattern Recognition, Minneapolis, MI. 1429-+. Vol 1–8.
25. Rawat, W., and Z. H., Wang. 2017. “Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review.” Neural Computation 29 (9): 2352–2449. doi:10.1162/neco_a_00990.
26. Sainath, T. N., B., Kingsbury, G., Saon, H., Soltau, A. R., Mohamed, G., Dahl, and B., Ramabhadran. 2015. “Deep Convolutional Neural Networks for Large-Scale Speech Tasks.” Neural Networks 64: 39–48. doi:10.1016/j.neunet.2014.08.005.
27. Salem, M., A. F., Ibrahim, and H. A., Ali. 2013. “Automatic Quick-Shift Method for Color Image Segmentation.” In 2013 8th International Conference on Computer Engineering & Systems (Icces), Cairo, Egypt. 245–251.
28. Sebari, I., and D. C., He. 2013. “Automatic Fuzzy Object-Based Analysis of VHSR Images for Urban Objects Extraction.” Isprs Journal of Photogrammetry and Remote Sensing 79: 171–184. doi:10.1016/j.isprsjprs.2013.02.006.
29. Szegedy, C., W., Liu, Y. Q., Jia, P., Sermanet, S., Reed, D., Anguelov, D., Erhan, V., Vanhoucke, and A., Rabinovich. 2015. “Going Deeper with Convolutions.” In 2015 Ieee Conference on Computer Vision and Pattern Recognition (Cvpr), Boston, MA. 1–9.
30. Vedaldi, A., and S., Soatto. 2008. “Quick Shift and Kernel Methods for Mode Seeking.” In Computer Vision - Eccv 2008, Pt Iv, Proceedings, Marseille, France. 705–718. Vol. 5305.
31. Wang, Q., J. Y., Gao, and Y., Yuan. 2018. “A Joint Convolutional Neural Networks and Context Transfer for Street Scenes Labeling.” Ieee Transactions on Intelligent Transportation Systems 19 (5): 1457–1470. doi:10.1109/Tits.2017.2726546.
32. Wu, G. M., X. W., Shao, Z. L., Guo, Q., Chen, W., Yuan, X. D., Shi, Y. W., Xu, and R., Shibasaki. 2018. “Automatic Building Segmentation of Aerial Imagery UsingMulti-Constraint Fully Convolutional Networks.” Remote Sensing 10: 3. doi:10.3390/Rs10030407.
33. Xia, G. S., J. W., Hu, F., Hu, B. G., Shi, X., Bai, Y. F., Zhong, L. P., Zhang, and X. Q., Lu. 2017. “AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification.” Ieee Transactions on Geoscience and Remote Sensing 55 (7): 3965–3981. doi:10.1109/Tgrs.2017.2685945.
34. Yu, Y. L., and F. X., Liu. 2018. “Dense Connectivity Based Two-Stream Deep Feature Fusion Framework for Aerial Scene Classification.” Remote Sensing 10 (7): 1158. doi:10.3390/Rs10071158.
35. Zanotta, D. C., M., Zortea, and M. P., Ferreira. 2018. “A Supervised Approach for Simultaneous Segmentation and Classification of Remote Sensing Images.” Isprs Journal of Photogrammetry and Remote Sensing 142: 162–173. doi:10.1016/j.isprsjprs.2018.05.021.
36. Zeiler, M. D., and R., Fergus. 2014. “Visualizing and Understanding Convolutional Networks.” In Computer Vision - Eccv 2014, Pt I 8689, Zurich, Switzerland. 818–833.
37. Zhang, C., X., Pan, H. P., Li, A., Gardiner, I., Sargent, J., Hare, and P. M., Atkinson. 2018a. “A Hybrid MLP-CNN Classifier for Very Fine Resolution Remotely Sensed Image Classification.” Isprs Journal of Photogrammetry and Remote Sensing 140: 133–144. doi:10.1016/j.isprsjprs.2017.07.014.
38. Zhang, C., I., Sargent, H., Li, A., Gardiner, J., Hare, and P. M., Atkinson. 2018b. “An Object-Based Convolutional Neural Network (OCNN) for Urban Land Use Classification.” Remote Sensing of Environment 216: 57–70. doi:10.1016/j.rse.2018.06.034.
39. Zhang, F., B., Du, and L. P., Zhang. 2016. “Scene Classification via a Gradient Boosting Random Convolutional Network Framework.” Ieee Transactions on Geoscience and Remote Sensing 54 (3): 1793–1802. doi:10.1109/Tgrs.2015.2488681.
40. Zhao, W. Z., S. H., Du, and W. J., Emery. 2017. “Object-Based Convolutional Neural Network for High-Resolution Imagery Classification.” Ieee Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (7): 3386–3396. doi:10.1109/Jstars.2017.2680324.