Large-Scale Remote Sensing Image Retrieval by Deep Hashing Neural Networks

IEEE Transactions on Geoscience and Remote Sensing

Volumn 56, Issue 2, 2018, Pages 950-965

  Li, Yansheng ^a   Zhang, Yongjun ^a   Huang, Xin ^a   Zhu, Hu ^b   Ma, Jiayi ^a  

^a WUHAN UNIVERSITY   (China)

^b Nanjing University of Posts and Telecommunications   (China)

Author keywords

Deep hashing neural networks (DHNNs); large scale remote sensing image retrieval; remote sensing big data (RSBD) mining; supervised learning from scratch; transfer learning

Indexed keywords

BIG DATA; DATA MINING; DEEP NEURAL NETWORKS; LEARNING SYSTEMS; NEURAL NETWORKS; REMOTE SENSING; SEARCH ENGINES; SUPERVISED LEARNING;

DEEP FEATURE LEARNING; DEEP HASHING NEURAL NETWORKS (DHNNS); HIGH DIMENSIONAL FEATURE; LEARNING NEURAL NETWORKS; MANUALS; REMOTE SENSING IMAGE RETRIEVAL; STATE-OF-THE-ART METHODS; TRANSFER LEARNING;

IMAGE RETRIEVAL;

ANALYTICAL METHOD; ARTIFICIAL NEURAL NETWORK; COMPLEXITY; DATA MINING; DATA SET; DESIGN; IMAGE PROCESSING; MAP; MAPPING; REMOTE SENSING; SUPERVISED LEARNING;

EID: 85041331909     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2756911     Document Type: Article

References (59)

1. M. Chi, A. Plaza, J. A. Benediktsson, Z. Sun, J. Shen, and Y. Zhu, "Big data for remote sensing: Challenges and opportunities, " Proc. IEEE, vol. 104, no. 11, pp. 2207-2219, Nov. 2016.
2. Y. Ma et al., "Remote sensing big data computing: Challenges and opportunities, " Future Generat. Comput. Syst., vol. 51, pp. 47-60, Oct. 2015.
3. L. Wang, H. Zhong, R. Ranjan, A. Zomaya, and P. Liu, "Estimating the statistical characteristics of remote sensing big data in the wavelet transform domain, " IEEE Trans. Emerg. Topics Comput., vol. 2, no. 3, pp. 324-337, Sep. 2014.
4. G. J. Scott, M. N. Klaric, C. H. Davis, and C.-R. Shyu, "Entropy-balanced bitmap tree for shape-based object retrieval from large-scale satellite imagery databases, " IEEE Trans. Geosci. Remote Sens., vol. 49, no. 5, pp. 1603-1616, May 2011.
5. K. W. Tobin et al., "Automated feature generation in large-scale geospa-tial libraries for content-based indexing, " Photogramm. Eng. Remote Sens., vol. 72, no. 5, pp. 531-540, 2006.
6. C.-R. Shyu, M. Klaric, G. J. Scott, A. S. Barb, C. H. Davis, and K. Palaniappan, "GeoIRIS: Geospatial Information Retrieval and Indexing System-Content mining, semantics modeling, and complex queries, " IEEE Trans. Geosci. Remote Sens., vol. 45, no. 4, pp. 839-852, Apr. 2007.
7. P. Li and P. Ren, "Partial randomness hashing for large-scale remote sensing image retrieval, " IEEE Geosci. Remote Sens. Lett., vol. 14, no. 3, pp. 464-468, Mar. 2017.
8. B. Demir and L. Bruzzone, "Hashing-based scalable remote sensing image search and retrieval in large archives, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 2, pp. 892-904, Feb. 2016.
9. B. Demir and L. Bruzzone, "A novel active learning method in relevance feedback for content-based remote sensing image retrieval, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2323-2334, May 2015.
10. M. Wang and T. Song, "Remote sensing image retrieval by scene semantic matching, " IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 2874-2886, May 2013.
11. Y. Yang and S. Newsam, "Geographic image retrieval using local invariant features, " IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 818-832, Feb. 2013.
12. E. Aptoula, "Remote sensing image retrieval with global morphological texture descriptors, " IEEE Trans. Geosci. Remote Sens., vol. 52, no. 5, pp. 3023-3034, May 2014.
13. Y. Hongyu, L. Bicheng, and C. Wen, "Remote sensing imagery retrieval based-on Gabor texture feature classification, " in Proc. 7th Int. Conf. Signal Process., Aug./Sep. 2004, pp. 733-736.
14. S. Newsam, L. Wang, S. Bhagavathy, and B. S. Manjunath, "Using texture to analyze and manage large collections of remote sensed image and video data, " Appl. Opt., vol. 43, no. 2, pp. 210-217, 2004.
15. B. Luo, J. F. Aujol, Y. Gousseau, and S. Ladjal, "Indexing of satellite images with different resolutions by wavelet features, " IEEE Trans. Image Process., vol. 17, no. 8, pp. 1465-1472, Aug. 2008.
16. R. Rosu, M. Donias, L. Bombrun, S. Said, O. Regniers, and J.-P. Da Costa, "Structure tensor Riemannian statistical models for CBIR and classification of remote sensing images, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 1, pp. 248-260, Jan. 2017.
17. W. Zhou, Z. Shao, C. Diao, and Q. Cheng, "High-resolution remote-sensing imagery retrieval using sparse features by auto-encoder, " Remote Sens. Lett., vol. 6, no. 10, pp. 775-783, 2015.
18. W. Zhou, S. Newsam, C. Li, and Z. Shao, "Learning low dimensional convolutional neural networks for high-resolution remote sensing image retrieval, " Remote Sens., vol. 9, no. 5, pp. 489-508, 2017.
19. Z. Du, X. Li, and X. Lu, "Local structure learning in high resolution remote sensing image retrieval, " Neurocomputing, vol. 207, pp. 813-822, Sep. 2016.
20. Y. Li, Y. Zhang, C. Tao, and H. Zhu, "Content-based high-resolution remote sensing image retrieval via unsupervised feature learning and collaborative affinity metric fusion, " Remote Sens., vol. 8, no. 9, pp. 709-723, 2016.
21. Y. Li, C. Tao, Y. Tan, K. Shang, and J. Tian, "Unsupervised multilayer feature learning for satellite image scene classification, " IEEE Geosci. Remote Sens. Lett., vol. 13, no. 2, pp. 157-161, Feb. 2016.
22. Y. Wang et al., "A three-layered graph-based learning approach for remote sensing image retrieval, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 10, pp. 6020-6034, Oct. 2016.
23. M. Muja and D. G. Lowe, "Fast approximate nearest neighbors with automatic algorithm configuration, " in Proc. VISAPP Int. Conf. Comput. Vis. Theory Appl., 2009, pp. 331-340.
24. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets, " Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
25. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Proc. 26th Annu. Conf. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
26. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning, " Nature, vol. 521, pp. 436-444, May 2015.
27. H. Zhu, M. Long, J. Wang, and Y. Cao, "Deep hashing network for efficient similarity retrieval, " in Proc. 30th AAAI Conf. Artif. Intell., 2016, pp. 2415-2421.
28. H. Liu, R. Wang, S. Shan, and X. Chen, "Deep supervised hashing for fast image retrieval, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2016, pp. 2064-2072.
29. W.-J. Li, S. Wang, and W.-C. Kang, "Feature learning based deep supervised hashing with pairwise labels, " in Proc. 25th Int. Joint Conf. Artif. Intell., 2016, pp. 1711-1717.
30. F. Shen, C. Shen, W. Liu, and H. T. Shen, "Supervised discrete hashing, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 37-45.
31. W.-C. Kang, W.-J. Li, and Z.-H. Zhou, "Column sampling based discrete supervised hashing, " in Proc. 30th AAAI Conf. Artif. Intell., 2016, pp. 1230-1236.
32. S. Chaib, H. Liu, Y. Gu, and H. Yao, "Deep feature fusion for VHR remote sensing scene classification, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 8, pp. 4775-4784, Aug. 2017.
33. G.-S. Xia et al., "AID: A benchmark data set for performance evaluation of aerial scene classification, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 7, pp. 3965-3981, Jul. 2017.
34. G. J. Scott, M. R. England, W. A. Starms, R. A. Marcum, and C. H. Davis, "Training deep convolutional neural networks for land-cover classification of high-resolution imagery, " IEEE Geosci. Remote Sens. Lett., vol. 14, no. 4, pp. 549-553, Apr. 2017.
35. G. Cheng, J. Han, and X. Lu, "Remote sensing image scene classification: Benchmark and state of the art, " Proc. IEEE, vol. 105, no. 10, pp. 1865-1883, Oct. 2017.
36. Y. Chen, Z. Lin, X. Zhao, G. Wang, and Y. Gu, "Deep learning-based classification of hyperspectral data, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2094-2107, Jun. 2014.
37. Y. Chen, H. Jiang, C. Li, X. Jia, and P. Ghamisi, "Deep feature extraction and classification of hyperspectral images based on convolutional neural networks, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 10, pp. 6232-6251, Oct. 2016.
38. L. Jiao, M. Liang, H. Chen, S. Yang, H. Liu, and X. Cao, "Deep fully convolutional network-based spatial distribution prediction for hyperspectral image classification, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 10, pp. 5585-5599, Oct. 2017.
39. H. Liu, S. Yang, S. Gou, D. Zhu, R. Wang, and L. Jiao, "Polarimetric SAR feature extraction with neighborhood preservation-based deep learning, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 4, pp. 1456-1466, Apr. 2017.
40. J. Geng, H. Wang, J. Fan, and X. Ma, "Deep supervised and contractive neural network for SAR image classification, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 4, pp. 2442-2459, Apr. 2017.
41. G. Cheng, P. Zhou, and J. Han, "Learning rotation-invariant convo-lutional neural networks for object detection in VHR optical remote sensing images, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 12, pp. 7405-7415, Dec. 2016.
42. Y. Long, Y. Gong, Z. Xiao, and Q. Liu, "Accurate object localization in remote sensing images based on convolutional neural networks, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 5, pp. 2486-2498, May 2017.
43. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 2-9.
44. Y. Yang and S. Newsam, "Bag-of-visual-words and spatial extensions for land-use classification, " in Proc. Int. Conf. Adv. Geogr. Inf. Syst., 2010, pp. 270-279.
45. S. Basu, S. Ganguly, S. Mukhopadhyay, R. DiBiano, M. Karki, and R. Nemani, "DeepSat-A learning framework for satellite imagery, " in Proc. 23rd SIGSPATIAL Int. Conf. Adv. Geogr. Inf. Syst., 2015, Art. no. 37.
46. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, "The devil is in the details: An evaluation of recent feature encoding methods, " in Proc. Brit. Mach. Vis. Conf., 2014, vol. 2. no. 4.
47. W. Liu, J. Wang, R. Ji, Y.-G. Jiang, and S.-F. Chang, "Supervised hashing with kernels, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2074-2081.
48. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope, " Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
49. P. Welinder and P. Perona, "Online crowdsourcing: Rating annotators and obtaining cost-effective labels, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2010, pp. 25-32.
50. H. Li, B. Yu, and D. Zhou, "Error rate analysis of labeling by crowd-sourcing, " in Proc. Int. Conf. Mach. Learn. Workshop, Mach. Learn. Meets Crowdsourcing, 2013, pp. 1-22.
51. V. Mnih and G. E. Hinton, "Learning to label aerial images from noisy data, " in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 567-574.
52. Z. Zhong, B. Fan, K. Ding, H. Li, S. Xiang, and C. Pan, "Efficient multiple feature fusion with hashing for hyperspectral imagery classification: A comparative study, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 8, pp. 4461-4478, Aug. 2016.
53. J. Ma, H. Zhou, J. Zhao, Y. Gao, J. Jiang, and J. Tian, "Robust feature matching for remote sensing image registration via locally linear transforming, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 12, pp. 6469-6481, Dec. 2015.
54. J. Ma, J. Zhao, J. Tian, X. Bai, and Z. Tu, "Regularized vector field learning with sparse approximation for mismatch removal, " Pattern Recognit., vol. 46, no. 12, pp. 3519-3532, 2013.
55. J. Ma, C. Chen, C. Li, and J. Huang, "Infrared and visible image fusion via gradient transfer and total variation minimization, " Inf. Fusion, vol. 31, pp. 100-109, Sep. 2016.
56. Y. Li, Y. Tan, J. Deng, Q. Wen, and J. Tian, "Cauchy graph embedding optimization for built-up areas detection from high-resolution remote sensing images, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 5, pp. 2078-2096, May 2015.
57. X. Huang, H. Liu, and L. Zhang, "Spatiotemporal detection and analysis of urban villages in mega city regions of China using high-resolution remotely sensed imagery, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 7, pp. 3639-3657, Jul. 2015.
58. Y. Li, X. Huang, and H. Liu, "Unsupervised deep feature learning for urban village detection from high-resolution remote sensing images, " Photogramm. Eng. Remote Sens., vol. 83, no. 8, pp. 567-579, 2017.
59. J. Fan, T. Chen, and S. Lu, "Unsupervised feature learning for land-use scene recognition, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 4, pp. 2250-2261, Apr. 2017.