Large patch convolutional neural networks for the scene classification of high spatial resolution imagery

Journal of Applied Remote Sensing

Volumn 10, Issue 2, 2016, Pages

  Zhong, Yanfei ^a   Fei, Feng ^a   Zhang, Liangpei ^a  

^a WUHAN UNIVERSITY   (China)

Author keywords

deep convolutional neural networks; high spatial resolution image; large patch sampling; remote sensing; scene classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONVOLUTION; IMAGE CLASSIFICATION; IMAGE RESOLUTION; LAND USE; NEURAL NETWORKS; REMOTE SENSING; SEMANTICS;

CONVOLUTIONAL NEURAL NETWORK; FULLY CONNECTED NETWORKS; HIGH SPATIAL RESOLUTION; HIGH SPATIAL RESOLUTION IMAGERY; HIGH SPATIAL RESOLUTION IMAGES; OBJECT ORIENTED CLASSIFICATION; REMOTE SENSING SENSORS; SCENE CLASSIFICATION;

DEEP NEURAL NETWORKS;

EID: 84967166415     PISSN: None     EISSN: 19313195     Source Type: Journal    
DOI: 10.1117/1.JRS.10.025006     Document Type: Article

References (50)

1. T. Blaschke, "Object based image analysis for remote sensing," ISPRS J. Photogramm. Remote Sens. 65(1), 2-16 (2010).
2. X. Zhang, B. Wu, and Q. Li, "Research on classification of high-resolution remote sensing image," Proc. SPIE 6786, 67862Z (2007).
3. X. Wang, X. Chen, and M. Li, "Classification of high spatial resolution remote sensing image using SVM and local spatial statistics Getis-Ord Gi," Proc. SPIE 8006, 80060N (2011).
4. Z. Chen et al., "High resolution remote sensing image classification with multiple classifiers based on mixed combining rule," Proc. SPIE 6788, 67881J (2007).
5. A. Hauptmann et al., "Can high-level concepts fill the semantic gap in video retrieval? A case study with broadcast news," IEEE Trans. Multimedia 9, 958-966 (2007).
6. L. Zhou, Z. Zhou, and D. Hu, "Scene classification using a multi-resolution bag-of-features model," Pattern Recognit. 46(1), 424-433 (2013).
7. J. Qin and N. H. Yung, "Scene categorization via contextual visual words," Pattern Recognit. 43(5), 1874-1888 (2010).
8. F. Hu et al., "Unsupervised feature learning via spectral clustering of multidimensional patches for remotely sensed scene classification," IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8, 2015-2030 (2015).
9. A. Bosch, X. Muñoz, and R. Martí, "Which is the best way to organize/classify images by content?," Image Vision Comput. 25(6), 778-791 (2007).
10. A. Vailaya, A. Jain, and H. J. Zhang, "On image classification: city vs. landscape," in Proc. IEEE Workshop on Content-Based Access of Image and Video Libraries, pp. 3-8, IEEE (1998).
11. N. Serrano, A. E. Savakis, and J. Luo, "Improved scene classification using efficient lowlevel features and semantic cues," Pattern Recognit. 37(9), 1773-1784 (2004).
12. B. Zhao et al., "The Fisher Kernel coding framework for high spatial resolution scene classification," Remote Sens. 8(2), 157 (2016).
13. B. Zhao, Y. Zhong, and L. Zhang, "A spectral-structural bag-of-features scene classifier for very high spatial resolution remote sensing imagery," ISPRS J. Photogramm. Remote Sens. 116, 73-85 (2016).
14. B. Zhao et al., "Dirichlet-derived multiple topic scene classification model for high spatial resolution remote sensing imagery," IEEE Trans. Geosci. Remote Sens. 54(4), 2108-2123 (2016).
15. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: spatial pyramid matching for recognizing natural scene categories," in IEEE Conf. on Computer Vision and Pattern Recognition, Vol. 2, pp. 2169-2178, IEEE (2006).
16. J. Yang et al., "Evaluating bag-of-visual-words representations in scene classification," in Proc. of the Int. Workshop on Multimedia Information Retrieval, pp. 197-206, ACM (2007).
17. D. Gökalp and S. Aksoy, "Scene classification using bag-of-regions representations," in IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1-8, IEEE (2007).
18. Y. Yang and S. Newsam, "Bag-of-visual-words and spatial extensions for land-use classification," in Proc. of the 18th SIGSPATIAL Int. Conf. on Advances in Geographic Information Systems (GIS '10), pp. 270-279, ACM (2010).
19. A. Bosch, A. Zisserman, and X. Muñoz, "Scene classification via pLSA," in Computer Vision-ECCV 2006, pp. 517-530, Springer (2006).
20. G. Cheng et al., "Automatic landslide detection from remote-sensing imagery using a scene classification method based on BoVWand pLSA," Int. J. Remote Sens. 34(1), 45-59 (2013).
21. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res. 3, 993-1022 (2003).
22. L. Cao and L. Fei-Fei, "Spatially coherent latent topic model for concurrent segmentation and classification of objects and scenes," in IEEE 11th Int. Conf. on Computer Vision, pp. 1-8, IEEE (2007).
23. M. Liénou, H. Maître, and M. Datcu, "Semantic annotation of satellite images using latent Dirichlet allocation," IEEE Geosci. Remote Sens. Lett. 7(1), 28-32 (2010).
24. C. Vaduva, I. Gavat, and M. Datcu, "Latent Dirichlet allocation for spatial analysis of satellite images," IEEE Trans. Geosci. Remote Sens. 51(5), 2770-2786 (2013).
25. Y. Zhong, Q. Zhu, and L. Zhang, "Scene classification based on the multifeature fusion probabilistic topic model for high spatial resolution remote sensing imagery," IEEE Trans. Geosci. Remote Sens. 53, 6207-6222 (2015).
26. F. Zhang, B. Du, and L. Zhang, "Saliency-guided unsupervised feature learning for scene classification," IEEE Trans. Geosci. Remote Sens. 53(4), 2175-2184 (2015).
27. Y. Yang and S. Newsam, "Spatial pyramid co-occurrence for image classification," in IEEE Int. Conf. on Computer Vision (ICCV '11), pp. 1465-1472, IEEE, Barcelona (2011).
28. A. Cheriyadat, "Aerial scene recognition using efficient sparse representation," in Proc. of the Eighth Indian Conf. on Computer Vision, Graphics and Image Processing, p. 11, ACM (2012).
29. C. Chen et al., "Gabor-filtering-based completed local binary patterns for land-use scene classification," in IEEE Int. Conf. on Multimedia Big Data (BigMM), pp. 324-329 (2015).
30. C. Chen et al., "Land-use scene classification using multi-scale completed local binary patterns," Signal Image Video Process. 10(4), 745-752 (2015)
31. W. Shao et al., "A hierarchical scheme of multiple feature fusion for high-resolution satellite scene categorization," in Computer Vision Systems, pp. 324-333, Springer, Switzerland (2013).
32. G. Sheng et al., "High-resolution satellite scene classification using a sparse coding based multiple feature combination," Int. J. Remote Sens. 33(8), 2395-2412 (2012).
33. Y. Bengio, "Learning deep architectures for AI," FNT Mach. Learn. 2(1), 1-127 (2009).
34. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature 521(7553), 436-444 (2015).
35. L. Zhang et al., "Deep learning for remote sensing image understanding," J. Sensors 501, 173691 (2015).
36. R. Collobert, K. Kavukcuoglu, and C. Farabet, "Torch7: a MATLAB-like environment for machine learning," in BigLearn, NIPS Workshop, (EPFL-CONF-192376) (2011).
37. S. Chetlur et al., "CuDNN: efficient primitives for deep learning," CoRR, arXiv preprint arXiv:1410.0759 (2014).
38. J. Deng et al., "Imagenet: a large-scale hierarchical image database," in IEEE Conf. on Computer Vision and Pattern Recognition, pp. 248-255, IEEE (2009).
39. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems, pp. 1097-1105 (2012).
40. C. Szegedy et al., "Going deeper with convolutions," arXiv preprint arXiv:1409.4842 (2014).
41. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," CoRR, arXiv preprint arXiv:1409.1556 (2014).
42. M. Castelluccio et al., "Land use classification in remote sensing images by convolutional neural networks," CoRR, arXiv preprint arXiv:1508.00092 (2015).
43. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol. 160(1), 106-154 (1962).
44. K. Fukushima, "Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position," Biol. Cybern. 36(4), 193-202 (1980).
45. N. Srivastava et al., "Dropout: a simple way to prevent neural networks from overfitting," J. Mach. Learn. Res. 15(1), 1929-1958 (2014).
46. K. He et al., "Spatial pyramid pooling in deep convolutional networks for visual recognition," in Computer Vision-ECCV 2014, pp. 346-361, Springer (2014).
47. M. Lin, Q. Chen, and S. Yan, "Network in network," CoRR, abs/1312.4400 (2013).
48. Y. A. LeCun et al., "Efficient backprop," in Neural Networks: Tricks of the Trade, pp. 9-48, Springer (2012).
49. A. M. Cheriyadat, "Unsupervised feature learning for aerial scene classification," IEEE Trans. Geosci. Remote Sens. 52(1), 439-451 (2014).
50. T. Schaul, S. Zhang, and Y. LeCun, "No more pesky learning rates," in Proceedings of the 30th International Conference on Machine Learning, pp. 343-351, arXiv preprint arXiv:1206.1106 (2012).