Rotation-insensitive and context-augmented object detection in remote sensing images

IEEE Transactions on Geoscience and Remote Sensing

Volumn 56, Issue 4, 2018, Pages 2337-2348

  Li, Ke ^a   Cheng, Gong ^b   Bu, Shuhui ^b   You, Xiong ^a  

^a INFORMATION ENGINEERING UNIVERSITY   (China)

^b NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

Author keywords

Convolutional neural networks (CNNs); Object detection; Remote sensing images; Restricted Boltzmann machine (RBM)

Indexed keywords

DEEP LEARNING; NEURAL NETWORKS; OBJECT RECOGNITION; REMOTE SENSING;

COMPREHENSIVE EVALUATION; CONTEXTUAL PROPERTIES; CONVOLUTIONAL NEURAL NETWORK; DETECTION FRAMEWORK; GEO-SPATIAL OBJECTS; LEARNING-BASED METHODS; REMOTE SENSING IMAGES; RESTRICTED BOLTZMANN MACHINE;

OBJECT DETECTION;

DETECTION METHOD; IMAGE PROCESSING; MACHINERY; NUMERICAL METHOD; REMOTE SENSING; SATELLITE IMAGERY;

EID: 85040060192     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2778300     Document Type: Article

References (57)

1. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Adv. Neural Inform. Process. Syst., 2012, pp. 1097-1105.
2. S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards realtime object detection with region proposal networks," in Proc. Adv. Neural Inform. Process. Syst., 2015, pp. 91-99.
3. D. Zhang, D. Meng, and J. Han, "Co-saliency detection via a self-paced multiple-instance learning framework," IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 5, pp. 865-878, May 2017.
4. Y. Tian, C. Chen, and M. Shah, "Cross-view image matching for geolocalization in urban environments," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., Jul. 2017, pp. 3608-3616.
5. G. Cheng, P. Zhou, and J. Han, "Duplex metric learning for image set classification," IEEE Trans. Image Process., vol. 27, no. 1, pp. 281-292, Jan. 2018.
6. D. Zhang, J. Han, L. Jiang, S. Ye, and X. Chang, "Revealing event saliency in unconstrained video collection," IEEE Trans. Image Process., vol. 26, no. 4, pp. 1746-1758, 2017.
7. R. Girshick, "Fast R-CNN," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 1440-1448.
8. G. Cheng, P. Zhou, and J. Han, "Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 12, pp. 7405-7415, Dec. 2016.
9. X. Lu, X. Zheng, and Y. Yuan, "Remote sensing scene classification by unsupervised representation learning," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 9, pp. 5148-5157, Sep. 2017.
10. G. Cheng, Z. Li, X. Yao, L. Guo, and Z. Wei, "Remote sensing image scene classification using bag of convolutional features," IEEE Geosci. Remote Sens. Lett., vol. 14, no. 10, pp. 1735-1739, Oct. 2017.
11. Z. Du, X. Li, and X. Lu, "Local structure learning in high resolution remote sensing image retrieval," Neurocomputing, vol. 207, pp. 813-822, Sep. 2016.
12. K. Li, C. Zou, S. Bu, Y. Liang, J. Zhang, and M. Gong, "Multi-modal feature fusion for geographic image annotation," Pattern Recognit., vol. 73, pp. 1-14, Jan. 2018.
13. G. Cheng, J. Han, and X. Lu, "Remote sensing image scene classification: Benchmark and state of the art," Proc. IEEE, vol. 105, no. 10, pp. 1865-1883, Oct. 2017.
14. L. W. Sommer, T. Schuchert, and J. Beyerer, "Generating object proposals for improved object detection in aerial images," in Proc. SPIE Secur. + Defence, Oct. 2016, p. 99880N.
15. Y. Long, Y. Gong, Z. Xiao, and Q. Liu, "Accurate object localization in remote sensing images based on convolutional neural networks," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 5, pp. 2486-2498, May 2017.
16. A. Marcu and M. Leordeanu. (2010). "Dual local-global contextual pathways for recognition in aerial imagery." [Online]. Available: https://arxiv.org/abs/1605.05462
17. X. Yao, J. Han, D. Zhang, and F. Nie, "Revisiting co-saliency detection: A novel approach based on two-stage multi-view spectral rotation co-clustering," IEEE Trans. Image Process., vol. 26, no. 7, pp. 3196-3209, Jul. 2017.
18. R. Hou, C. Chen, and M. Shah, "Tube convolutional neural network (TCNN) for action detection in videos," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2017, pp. 5822-5831.
19. T. Tang, S. Zhou, Z. Deng, H. Zou, and L. Lei, "Vehicle detection in aerial images based on region convolutional neural networks and hard negative example mining," Sensors, vol. 17, no. 2, p. E336, 2017.
20. Y. Yang, Y. Zhuang, F. Bi, H. Shi, and Y. Xie, "M-FCN: Effective fully convolutional network-based airplane detection framework," IEEE Geosci. Remote Sens. Lett., vol. 14, no. 8, pp. 1293-1297, Aug. 2017.
21. J. Han, D. Zhang, G. Cheng, L. Guo, and J. Ren, "Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 6, pp. 3325-3337, Jun. 2015.
22. G. Jun and J. Ghosh, "Semisupervised learning of hyperspectral data with unknown land-cover classes," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 1, pp. 273-282, Jan. 2013.
23. G. Cheng and J. Han, "A survey on object detection in optical remote sensing images," ISPRS J. Photogramm. Remote Sens., vol. 117, pp. 11-28, Jul. 2016.
24. B. Alexe, T. Deselaers, and V. Ferrari, "What is an object?" in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2010, pp. 73-80.
25. J. Carreira and C. Sminchisescu, "CPMC: Automatic object segmentation using constrained parametric min-cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1312-1328, Jul. 2012.
26. J. R. R. Uijlings, K. E. A. van de Sande, T. Gevers, and A. W. M. Smeulders, "Selective search for object recognition," Int. J. Comput. Vis., vol. 104, no. 2, pp. 154-171, Apr. 2013.
27. M.-M. Cheng, Z. Zhang, W.-Y. Lin, and P. Torr, "BING: Binarized normed gradients for objectness estimation at 300 fps," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2014, pp. 3286-3293.
28. C. L. Zitnick and P. Dollár, "Edge boxes: Locating object proposals from edges," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 391-405.
29. C. Szegedy, S. Reed, D. Erhan, D. Anguelov, and S. Ioffe. (2014). "Scalable, high-quality object detection." [Online]. Available: https://arxiv.org/abs/1412.1441
30. P. O. Pinheiro, R. Collobert, and P. Dollár, "Learning to segment object candidates," in Proc. Adv. Neural Inform. Process. Syst., 2015, pp. 1990-1998.
31. W. Kuo, B. Hariharan, and J. Malik, "DeepBox: Learning objectness with convolutional networks," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 2479-2487.
32. F. Zhang, B. Du, L. Zhang, and M. Xu, "Weakly supervised learning based on coupled convolutional neural networks for aircraft detection," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 9, pp. 5553-5563, Sep. 2016.
33. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
34. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, vol. 1. no. 1, pp. 886-893.
35. C. Chen, B. Zhang, H. Su, W. Li, and L. Wang, "Land-use scene classification using multi-scale completed local binary patterns," Signal, Image Video Process., vol. 10, no. 4, pp. 745-752, 2016.
36. L. Huang, C. Chen, W. Li, and Q. Du, "Remote sensing image scene classification using multi-scale completed local binary patterns and fisher vectors," Remote Sens., vol. 8, no. 6, p. 483, 2016.
37. S. Chaib, H. Liu, Y. Gu, and H. Yao, "Deep feature fusion for VHR remote sensing scene classification," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 8, pp. 4775-4784, Aug. 2017.
38. X. Bian, C. Chen, L. Tian, and Q. Du, "Fusing local and global features for high-resolution scene classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 6, pp. 2889-2901, Jun. 2017.
39. X. Lu and X. Li, "Multiresolution imaging," IEEE Trans. Cybern., vol. 44, no. 1, pp. 149-160, Jan. 2014.
40. X. Lu, Y. Yuan, and P. Yan, "Alternatively constrained dictionary learning for image superresolution," IEEE Trans. Cybern., vol. 44, no. 3, pp. 366-377, Mar. 2014.
41. Y. Zhu, R. Urtasun, R. Salakhutdinov, and S. Fidler, "segDeepM: Exploiting segmentation and context in deep neural networks for object detection," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 4703-4711.
42. S. Gidaris and N. Komodakis, "Object detection via a multi-region and semantic segmentation-aware CNN model," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 1134-1142.
43. L. Zhang, Z. Shi, and J. Wu, "A hierarchical oil tank detector with deep surrounding features for high-resolution optical satellite imagery," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 10, pp. 4895-4909, Oct. 2015.
44. S. Bell, C. L. Zitnick, K. Bala, and R. Girshick, "Inside-outside net: Detecting objects in context with skip pooling and recurrent neural networks," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2016, pp. 2874-2883.
45. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
46. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
47. N. Srivastava and R. R. Salakhutdinov, "Multimodal learning with deep boltzmann machines," in Proc. Adv. Neural Inform. Process. Syst., 2012, pp. 2222-2230.
48. W. Diao, X. Sun, X. Zheng, F. Dou, H. Wang, and K. Fu, "Efficient saliency-based object detection in remote sensing images using deep belief networks," IEEE Geosci. Remote Sens. Lett., vol. 13, no. 2, pp. 137-141, Feb. 2016.
49. P. Zhong, Z. Gong, S. Li, and C.-B. Schönlieb, "Learning to diversify deep belief networks for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 6, pp. 3516-3530, Jun. 2017.
50. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng, "Multimodal deep learning," in Proc. Int. Conf. Mach. Learn., 2011, pp. 689-696.
51. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 818-833.
52. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 580-587.
53. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, "Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations," in Proc. Int. Conf. Mach. Learn., 2009, pp. 609-616.
54. A. Ghodrati, A. Diba, M. Pedersoli, T. Tuytelaars, and L. Van Gool, "DeepProposal: Hunting objects by cascading deep convolutional layers," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 2578-2586.
55. H. Larochelle, M. Mandel, R. Pascanu, and Y. Bengio, "Learning algorithms for the classification restricted Boltzmann machine," J. Mach. Learn. Res., vol. 13, pp. 643-669, Mar. 2012.
56. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
57. G. Cheng, J. Han, P. Zhou, and L. Guo, "Multi-class geospatial object detection and geographic image classification based on collection of part detectors," ISPRS J. Photogramm. Remote Sens., vol. 98, pp. 119-132, Dec. 2014.