Weakly supervised target detection in remote sensing images based on transferred deep features and negative bootstrapping

Multidimensional Systems and Signal Processing

Volumn 27, Issue 4, 2016, Pages 925-944

  Zhou, Peicheng ^a   Cheng, Gong ^a   Liu, Zhenbao ^a   Bu, Shuhui ^a   Hu, Xintao ^a  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

Author keywords

Negative bootstrapping; Remote sensing images; Target detection; Transferred deep features; Weakly supervised learning

Indexed keywords

COMPUTER VISION; FEATURE EXTRACTION; IMAGE PROCESSING; IMAGE RECONSTRUCTION; NEURAL NETWORKS; PALMPRINT RECOGNITION; SUPERVISED LEARNING; TARGET TRACKING;

BOOTSTRAPPING SCHEME; COMPREHENSIVE EVALUATION; CONVOLUTIONAL NEURAL NETWORK; DISCRIMINATIVE TRAINING; NEGATIVE BOOTSTRAPPING; REMOTE SENSING IMAGES; TRANSFERRED DEEP FEATURES; WEAKLY SUPERVISED LEARNING;

REMOTE SENSING;

EID: 84948658948     PISSN: 09236082     EISSN: 15730824     Source Type: Journal    
DOI: 10.1007/s11045-015-0370-3     Document Type: Article

References (51)

1. Bosch, A., Zisserman, A., & Munoz, X. (2007). Representing shape with a spatial pyramid kernel. In Proceedings of the 6th ACM international conference on Image and video retrieval (pp. 401–408).
2. Capobianco, L., Garzelli, A., & Camps-Valls, G. (2009). Target detection with semisupervised kernel orthogonal subspace projection. IEEE Transactions on Geoscience and Remote Sensing, 47(11), 3822–3833.
3. Chang, C.-C., & Lin, C.-J. (2011). LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3), 27.
4. Cheng, G., Guo, L., Zhao, T., Han, J., Li, H., & Fang, J. (2013a). Automatic landslide detection from remote-sensing imagery using a scene classification method based on boVW and pLSA. International Journal of Remote Sensing, 34(1), 45–59.
5. Cheng, G., Han, J., Guo, L., & Liu, T. (2015a). Learning coarse-to-fine sparselets for efficient object detection and scene classification. In Proceedings of the 28th IEEE conference on computer vision and pattern recognition (pp. 1173–1181).
6. Cheng, G., Han, J., Guo, L., Liu, Z., Bu, S., & Ren, J. (2015b). Effective and efficient midlevel visual elements-oriented land-use classification using VHR remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 53(8), 4238–4249.
7. Cheng, G., Han, J., Guo, L., Qian, X., Zhou, P., Yao, X., et al. (2013b). Object detection in remote sensing imagery using a discriminatively trained mixture model. ISPRS Journal of Photogrammetry and Remote Sensing, 85, 32–43.
8. Cheng, G., Han, J., Zhou, P., & Guo, L. (2014). Multi-class geospatial object detection and geographic image classification based on collection of part detectors. ISPRS Journal of Photogrammetry and Remote Sensing, 98, 119–132.
9. Cheng, G., Zhou, P., Han, J., Guo, L., & Han, J. (2015c). Auto-encoder-based shared mid-level visual dictionary learning for scene classification using very high resolution remote sensing images. IET Computer Vision, 9(5), 639–647.
10. Cramer, M. (2010). The DGPF-test on digital airborne camera evaluation—Overview and test design. Photogrammetrie-Fernerkundung-Geoinformation, 2, 73–82.
11. Csurka, G., Dance, C., Fan, L., Willamowski, J., & Bray, C. (2004). Visual categorization with bags of keypoints. In Workshop on statistical learning in computer vision, ECCV (pp. 1–2).
12. Deng, J., Berg, A., Satheesh, S., Su, H., Khosla, A., & Fei-Fei, L. (2012). ImageNet large scale visual recognition competition 2012 (ILSVRC2012).
13. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., & Tzeng, E., et al. (2013). Decaf: A deep convolutional activation feature for generic visual recognition. arXiv preprint arXiv:1310.1531.
14. Feng, Y., Ren, J., & Jiang, J. (2011). Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications. IEEE Transactions on Broadcasting, 57(2 PART 2), 500–509.
15. Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2013). Rich feature hierarchies for accurate object detection and semantic segmentation. arXiv preprint arXiv:1311.2524.
16. Han, J., He, S., Qian, X., Wang, D., Guo, L., & Liu, T. (2013a). An object-oriented visual saliency detection framework based on sparse coding representations. IEEE Transactions on Circuits and Systems for Video Technology, 23(12), 2009–2021.
17. Han, J., Ji, X., Hu, X., Zhu, D., Li, K., Jiang, X., et al. (2013b). Representing and retrieving video shots in human-centric brain imaging space. IEEE Transactions on Image Processing, 22(7), 2723–2736.
18. Han, J., Ngan, K. N., Li, M., & Zhang, H.-J. (2006). Unsupervised extraction of visual attention objects in color images. IEEE Transactions on Circuits and Systems for Video Technology, 16(1), 141–145.
19. Han, J., Zhang, D., Cheng, G., Guo, L., & Ren, J. (2015a). Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning. IEEE Transactions on Geoscience and Remote Sensing, 53(6), 3325–3337.
20. Han, J., Zhang, D., Hu, X., Guo, L., Ren, J., & Wu, F. (2015b). Background prior based salient object detection via deep reconstruction residual. IEEE Transactions on Circuits and Systems for Video Technology, 25(8), 1309–1321.
21. Han, J., Zhang, D., Wen, S., Guo, L., Liu, T., & Li, X. (2015c). Two-stage learning to predict human eye fixations via SDAEs. IEEE Transactions on Cybernetics, online published.
22. Han, J., Zhou, P., Zhang, D., Cheng, G., Guo, L., Liu, Z., et al. (2014). Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding. ISPRS Journal of Photogrammetry and Remote Sensing, 89, 37–48.
23. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., & Girshick, R., et al. (2014). Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the ACM international conference on multimedia (pp. 675–678).
24. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In P. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, & K. Q. Weinberger (Eds.), Advances in neural information processing systems (pp. 1097–1105). South Lake Tahoe, NV: NIPS foundation.
25. Li, S., Si, S., Dui, H., Cai, Z., & Sun, S. (2014). A novel decision diagrams extension method. Reliability Engineering & System Safety, 126, 107–115.
26. Li, X., Snoek, C. G., Worring, M., Koelma, D., & Smeulders, A. W. (2013). Bootstrapping visual categorization with relevant negatives. IEEE Transactions on Multimedia, 15(4), 933–945.
27. Li, X., Snoek, C. G., Worring, M., & Smeulders, A. W. (2011). Social negative bootstrapping for visual categorization. In Proceedings of the 1st ACM international conference on multimedia retrieval.
28. Liu, L., Shao, L., Zheng, F., & Li, X. (2014). Realistic action recognition via sparsely-constructed Gaussian processes. Pattern Recognition, 47(12), 3819–3827.
29. Liu, Q., Liao, X., & Carin, L. (2008). Detection of unexploded ordnance via efficient semisupervised and active learning. IEEE Transactions on Geoscience and Remote Sensing, 46(9), 2558–2567.
30. Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.
31. Natsev, A. P., Naphade, M. R., & TešiĆ, J. (2005). Learning the semantics of multimedia queries and concepts from a small number of examples. In Proceedings of the 13th annual ACM international conference on multimedia (pp. 598–607).
32. Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014). Learning and transferring mid-level image representations using convolutional neural networks. In 27th IEEE Conference on computer vision and pattern recognition (pp. 1717–1724).
33. Pandey, M., & Lazebnik, S. (2011). Scene recognition and weakly supervised object localization with deformable part-based models. In Proceedings of the 2011 IEEE international conference on computer vision (pp. 1307–1314).
34. Ren, J., & Jiang, J. (2009). Hierarchical modeling and adaptive clustering for real-time summarization of rush videos. IEEE Transactions on Multimedia, 11(5), 906–917.
35. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013). Overfeat: Integrated recognition, localization and detection using convolutional networks. arXiv preprint arXiv:1312.6229.
36. Shao, L., Liu, L., & Li, X. (2014a). Feature learning for image classification via multiobjective genetic programming. IEEE Transactions on Neural Networks and Learning Systems, 25(7), 1359–1371.
37. Shao, L., Wu, D., & Li, X. (2014b). Learning deep and wide: A spectral method for learning deep networks. IEEE Transactions on Neural Networks and Learning Systems, 25(12), 2303–2308.
38. Shi, Z., Hospedales, T. M., & Xiang, T. (2013). Bayesian joint topic modelling for weakly supervised object localisation. In Proceedings of the 2013 IEEE international conference on computer vision (pp. 2984–2991).
39. Sirmacek, B., & Unsalan, C. (2009). Urban-area and building detection using SIFT keypoints and graph theory. IEEE Transactions on Geoscience and Remote Sensing, 47(4), 1156–1167.
40. Siva, P., Russell, C., & Xiang, T. (2012). In defence of negative mining for annotating weakly labelled data. In Proceedings of the 12th European conference on computer vision (pp. 594–608).
41. Siva, P., & Xiang, T. (2011). Weakly supervised object detector learning with model drift detection. In Proceedings of the 2011 IEEE international conference on computer vision (pp. 343–350).
42. Sun, H., Sun, X., Wang, H., Li, Y., & Li, X. (2012). Automatic target detection in high-resolution remote sensing images using spatial sparse coding bag-of-words model. IEEE Geoscience and Remote Sensing Letters, 9(1), 109–113.
43. Tao, D., Tang, X., Li, X., & Wu, X. (2006). Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(7), 1088–1099.
44. Tello, M., López-Martínez, C., & Mallorqui, J. J. (2005). A novel algorithm for ship detection in SAR imagery based on the wavelet transform. IEEE Geoscience and Remote Sensing Letters, 2(2), 201–205.
45. Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., & Gong, Y. (2010). Locality-constrained linear coding for image classification. In IEEE Conference on computer vision and pattern recognition (pp. 3360–3367).
46. Yang, W., Dai, D., Triggs, B., & Xia, G.-S. (2012). SAR-based terrain classification using weakly supervised hierarchical Markov aspect models. IEEE Transactions on Image Processing, 21(9), 4232–4243.
47. Zhang, D., Han, J., Cheng, G., Liu, Z., Bu, S., & Guo, L. (2015). Weakly Supervised Learning for Target Detection in Remote Sensing Images. IEEE Geoscience and Remote Sensing Letters, 12(4), 701–705.
48. Zhang, L., Zhen, X., & Shao, L. (2014). Learning object-to-class kernels for scene classification. IEEE Transactions on Image Processing, 23(8), 3241–3253.
49. Zhao, C., Li, X., Ren, J., & Marshall, S. (2013). Improved sparse representation using adaptive spatial support for effective target detection in hyperspectral imagery. International Journal of Remote Sensing, 34(24), 8669–8684.
50. Zhou, P., Zhang, D., Cheng, G., & Han, J. (2015). Negative bootstrapping for weakly supervised target detection in remote sensing images. InProceedings of the 2015 IEEE international conference on multimedia big data (pp. 318–323).
51. Zhu, F., & Shao, L. (2014). Weakly-supervised cross-domain dictionary learning for visual recognition. International Journal of Computer Vision, 109(1–2), 42–59.