PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 145, Issue , 2018, Pages 197-209

  Zhou, Weixun ^a   Newsam, Shawn ^b   Li, Congmin ^a   Shao, Zhenfeng ^a  

^a WUHAN UNIVERSITY   (China)

^b Merced   (United States)

Author keywords

Benchmark dataset; Content based image retrieval (CBIR); Convolutional neural networks; Deep learning; Handcrafted features; Remote sensing

Indexed keywords

BENCHMARKING; CLASSIFICATION (OF INFORMATION); CONTENT BASED RETRIEVAL; DEEP LEARNING; LAND USE; NEURAL NETWORKS;

BENCHMARK DATASETS; CONTENT-BASED IMAGE RETRIEVAL; CONVOLUTIONAL NEURAL NETWORK; HANDCRAFTED FEATURES; HIGH RESOLUTION IMAGERY; LEARNING-BASED APPROACH; PERFORMANCE EVALUATIONS; REMOTE SENSING IMAGE RETRIEVAL;

REMOTE SENSING;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; BENCHMARKING; DATA SET; IMAGE PROCESSING; PERFORMANCE ASSESSMENT; REMOTE SENSING; SATELLITE IMAGERY;

EID: 85040575209     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2018.01.004     Document Type: Article

References (49)

1. Agouris, P., Carswell, J., Stefanidis, A., An environment for content-based image retrieval from large spatial databases. ISPRS J. Photogramm. Remote Sens. 54 (1999), 263–272.
2. Alshehhi, R., Marpu, P.R., Woon, W.L., Dalla Mura, M., Simultaneous extraction of roads and buildings in remote sensing imagery with convolutional neural networks. ISPRS J. Photogramm. Remote Sens. 130 (2017), 139–149.
3. Aptoula, E., Remote sensing image retrieval with global morphological texture descriptors. IEEE Trans. Geosci. Remote Sens. 52 (2014), 3023–3034.
4. Aptoula, E., Bag of morphological words for content-based geographical retrieval. Content-Based Multimed. Index. (CBMI), 2014 12th Int. Work., 2014, IEEE, 1–5.
5. Bosch, A., Zisserman, A., Munoz, X., Representing shape with a spatial pyramid kernel. Proc. 6th ACM Int. Conf. Image Video Retr., 2007, ACM, 401–408.
6. Bosilj, P., Aptoula, E., Lefèvre, S., Kijak, E., Retrieval of remote sensing images with pattern spectra descriptors. ISPRS Int. J. Geo-Inform., 5, 2016, 228.
7. Cao, Y., Wang, C., Li, Z., Zhang, L., Zhang, L., Spatial-bag-of-features. Comput. Vis. Pattern Recognit. (CVPR), 2010 IEEE Conf., 2010, IEEE, 3352–3359.
8. Chandrasekhar, V., Lin, J., Morère, O., Goh, H., Veillard, A., A practical guide to CNNs and Fisher Vectors for image instance retrieval. Signal Process. 128 (2016), 426–439.
9. Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A., 2014. Return of the Devil in the Details: Delving Deep into Convolutional Nets, arXiv preprint arXiv:1405.3531.
10. Cheng, G., Han, J., Lu, X., Remote sensing image scene classification: benchmark and state of the art. Proc. IEEE, 2017.
11. Cheriyadat, A.M., Unsupervised feature learning for aerial scene classification. IEEE Trans. Geosci. Remote Sens. 52 (2014), 439–451.
12. Dalal, N., Triggs, B., Histograms of oriented gradients for human detection. Comput. Vis. Pattern Recognition, 2005. CVPR 2005. IEEE Conf., 2005, IEEE, 886–893.
13. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L., ImageNet: a large-scale hierarchical image database. 2009 IEEE Conf. Comput. Vis. Pattern Recognit., 2009, IEEE, 2–9.
14. Gordo, A., Almazán, J., Revaud, J., Larlus, D., Deep image retrieval: learning global representations for image search. Eur. Conf. Comput. Vis., 2016, Springer, 241–257.
15. Han, W., Feng, R., Wang, L., Cheng, Y., A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification. ISPRS J. Photogramm. Remote Sens. 145 (2018), 23–43.
16. He, K., Zhang, X., Ren, S., Sun, J., Deep residual learning for image recognition. Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, 770–778.
17. Jégou, H., Douze, M., Schmid, C., Pérez, P., Aggregating local descriptors into a compact representation. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, 3304–3311.
18. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T., Caffe: convolutional architecture for fast feature embedding. ACM Int. Conf. Multimed., 2014, ACM, 675–678.
19. Krizhevsky, A., Sutskever, I., Hinton, G.E., ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25 (2012), 1–9.
20. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521:7553 (2015), 436–444.
21. Li, Y., Zhang, Y., Tao, C., Zhu, H., Content-based high-resolution remote sensing image retrieval via unsupervised feature learning and collaborative affinity metric fusion. Remote Sens., 8, 2016, 709.
22. Lowe, D.G., Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60 (2004), 91–110.
23. Ma, X., Wang, H., Wang, J., Semisupervised classification for hyperspectral image based on multi-decision labeling and deep feature learning. ISPRS J. Photogramm. Remote Sens. 120 (2016), 99–107.
24. Napoletano, P., 2016. Visual descriptors for content-based retrieval of remote sensing images, arXiv preprint arXiv:1602.00970 (2016).
25. Ojala, T., Pietikainen, M., Maenpaa, T., Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002), 971–987.
26. Oliva, A., Torralba, A., Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42 (2001), 145–175.
27. Özkan, S., Ateş T., Tola, E., Soysal, M., Esen, E., Performance analysis of state-of-the-art representation methods for geographical image retrieval and categorization. IEEE Geosci. Remote Sens. Lett. 11 (2014), 1996–2000.
28. Penatti, O.A.B., Nogueira, K., dos Santos, J.A., Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Work, 2015, 44–51.
29. Perronnin, F., Sánchez, J., Mensink, T., Improving the Fisher Kernel for large-scale image classification. Eur. Conf. Comput. Vis., 2010, Springer, 143–156.
30. Scott, G.J., Klaric, M.N., Davis, C.H., Shyu, C.R., Entropy-balanced bitmap tree for shape-based object retrieval from large-scale satellite imagery databases. IEEE Trans. Geosci. Remote Sens. 49 (2011), 1603–1616.
31. Shao, Z., Zhou, W., Zhang, L., Hou, J., Improved color texture descriptors for remote sensing image retrieval. J. Appl. Remote Sens., 8, 2014, 83584.
32. Shao, Z., Zhou, W., Cheng, Q., Diao, C., Zhang, L., An effective hyperspectral image retrieval method using integrated spectral and textural features. Sens. Rev. 35 (2015), 274–281.
33. Shechtman, E., Irani, M., Matching local self-similarities across images and videos. Comput. Vis. Pattern Recognition, 2007. CVPR 2007. IEEE Conf., 2007, IEEE, 1–8.
34. Sheng, G., Yang, W., Xu, T., Sun, H., High-resolution satellite scene classification using a sparse coding based multiple feature combination. Int. J. Remote Sens. 33 (2012), 2395–2412.
35. Simonyan, K., Zisserman, A., 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition, arXiv preprint arXiv:1409.1556.
36. Sivic, J., Zisserman, A., Video Google: a text retrieval approach to object matching in videos. Proc. Ninth IEEE Int. Conf. Comput. Vis., 2003, 1470–1477.
37. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A., Going deeper with convolutions. Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, 1–9.
38. Wan, J., Wang, D., Hoi, S.C.H., Wu, P., Zhu, J., Zhang, Y., Li, J., Deep learning for content-based image retrieval: a comprehensive study. Proc. 22nd ACM Int. Conf. Multimed., 2014, ACM, 157–166.
39. Wang, Y., Zhang, L., Tong, X., Zhang, L., Zhang, Z., Liu, H., Xing, X., Mathiopoulos, P.T., A three-layered graph-based learning approach for remote sensing image retrieval. IEEE Trans. Geosci. Remote Sens. 54 (2016), 6020–6034.
40. Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L., Lu, X., AID: a benchmark data set for performance evaluation of aerial scene classification. IEEE Trans. Geosci. Remote Sens., 2017.
41. Yandex, A.B., Lempitsky, V., Aggregating local deep features for image retrieval. Proc. IEEE Int. Conf. Comput. Vis., 2016, 1269–1277.
42. Yang, Y., Newsam, S., Geographic image retrieval using local invariant features. IEEE Trans. Geosci. Remote Sens. 51 (2013), 818–832.
43. Yang, J., Liu, J., Dai, Q., An improved Bag-of-Words framework for remote sensing image retrieval in large-scale image databases. Int. J. Digit. Earth. 8 (2015), 273–292.
44. Zhang, M., Zhang, L., Mathiopoulos, P.T., Ding, Y., Wang, H., Perception-based shape retrieval for 3D building models. ISPRS J. Photogramm. Remote Sens. 75 (2013), 76–91.
45. Zhao, W., Du, S., Wang, Q., Emery, W.J., Contextually guided very-high-resolution imagery classification with semantic segments. ISPRS J. Photogramm. Remote Sens. 132 (2017), 48–60.
46. Zhou, W., Shao, Z., Diao, C., Cheng, Q., High-resolution remote-sensing imagery retrieval using sparse features by auto-encoder. Remote Sens. Lett. 6 (2015), 775–783.
47. Zhou, W., Newsam, S., Li, C., Shao, Z., Learning low dimensional convolutional neural networks for high-resolution remote sensing image retrieval. Remote Sens., 9, 2017, 489.
48. Zhu, X., Shao, Z., Using no-parameter statistic features for texture image retrieval. Sens. Rev. 31 (2011), 144–153.
49. Zou, Q., Ni, L., Zhang, T., Wang, Q., Deep learning based feature selection for remote sensing scene classification. IEEE Geosci. Remote Sens. Lett. 12 (2015), 2321–2325.