Automatic ship classification from optical aerial images with convolutional neural networks

Remote Sensing

Volumn 10, Issue 4, 2018, Pages

  Gallego, Antonio Javier ^a   Pertusa, Antonio ^a   Gil, Pablo ^a  

^a UNIVERSITY OF ALICANTE   (Spain)

Author keywords

Aerial image classification; Convolutional neural networks; Deep learning; Maritime surveillance; Optical remote sensing; Ships classification

Indexed keywords

AERIAL PHOTOGRAPHY; ANTENNAS; CONVOLUTION; DEEP LEARNING; NEAREST NEIGHBOR SEARCH; NETWORK ARCHITECTURE; NEURAL NETWORKS; OPTICAL DATA PROCESSING; REMOTE SENSING; SHIPS;

AERIAL IMAGES; AUTOMATIC CLASSIFICATION; CONVOLUTIONAL NEURAL NETWORK; CONVOLUTIONAL NEURAL NETWORKS (CNN); IMAGE PROCESSING AND COMPUTER VISION; K-NEAREST NEIGHBOR METHOD; MARITIME SURVEILLANCE; OPTICAL REMOTE SENSING;

IMAGE CLASSIFICATION;

EID: 85045970125     PISSN: None     EISSN: 20724292     Source Type: Journal    
DOI: 10.3390/rs10040511     Document Type: Article

References (62)

1. Crisp, D. The State-of-the-Art in Ship Detection in Synthetic Aperture Radar Imagery. Australian Government, Department of Defense: Canberra, Australia, 2004; p. 115
2. Greidanus, H.; Kourti, N. Findings of the DECLIMS project-Detection and Classification of Marine Traffic from Space. In Proceedings of the SEASAR 2006: Advances in SAR Oceanography from ENVISAT and ERS Missions, Frascati, Italy, 23-26 January 2006
3. Marino, A.; Sanjuan-Ferrer, M.J.; Hajnsek, I.; Ouchi, K. Ship Detectionwith Spectral Analysis of Synthetic Aperture Radar: A Comparison of New andWell-Known Algorithms. Remote Sens. 2015, 7, 5416, doi:10.3390/rs70505416
4. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436-444, doi:10.1038/nature14539
5. Lure, F.Y.M.; Rau, Y.C. Detection of Ship Tracks in AVHRR Cloud Imagery with Neural Networks. In Proceedings of the 1994 IEEE International Geoscience and Remote Sensing Symposium (IGARSS '94), Pasadena, CA, USA, 8-12 August 1994; pp. 1401-1403, doi:10.1109/IGARSS.1994.399451
6. Weiss, J.; Luo, R.;Welch, R. Automatic detection of ship tracks in satellite imagery. In Proceedings of the IEEE International Geoscience and Remote Sensing (IGARSS '97), Remote Sensing-A Scientific Vision for Sustainable Development, Singapore, 3-8 August 1997; Volume 1, pp. 160-162, doi:10.1109/IGARSS. 1997.615827
7. Corbane, C.; Marre, F.; Petit, M. Using SPOT-5 HRG Data in Panchromatic Mode for Operational Detection of Small Ships in Tropical Area. Sensors 2008, 8, 2959-2973, doi:10.3390/s8052959
8. Corbane, C.; Najman, L.; Pecoul, E.; Demagistri, L.; Petit, M. A Complete Processing Chain for Ship Detection Using Optical Satellite Imagery. Int. J. Remote Sens. 2010, 31, 5837-5854, doi:10.1080/01431161.2010.512310
9. Zhu, C.; Zhou, H.; Wang, R.; Guo, J. A Novel Hierarchical Method of Ship Detection from Spaceborne Optical Image Based on Shape and Texture Features. IEEE Trans. Geosci. Remote Sens. 2010, 48, 3446-3456, doi:10.1109/TGRS.2010.2046330
10. Bi, F.; Liu, F.; Gao, L. A hierarchical salient-region based algorithm for ship detection in remote sensing images. In Lecture Notes in Electrical Engineering; Springer: Berlin/Heidelberg, Germany, 2010; Volume 67, pp. 729-738, doi:10.1007/978-3-642-12990-2_85
11. Xia, Y.;Wan, S.; Jin, P.; Yue, L. A Novel Sea-Land Segmentation Algorithm Based on Local Binary Patterns for Ship Detection. Int. J. Signal Process. Image Process. Pattern Recognit. 2014, 7, 237-246
12. Yang, G.; Li, B.; Ji, S.; Gao, F.; Xu, Q. Ship Detection From Optical Satellite Images Based on Sea Surface Analysis. IEEE Geosci. Remote Sens. Lett. 2014, 11, 641-645, doi:10.1109/LGRS.2013.2273552
13. Marques, J.S.; Bernardino, A.; Cruz, G.; Bento, M. An algorithm for the detection of vessels in aerial images. In Proceedings of the 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Seoul, Korea, 26-29 August 2014; pp. 295-300, doi:10.1109/AVSS.2014.6918684
14. Yang, F.; Xu, Q.; Gao, F.; Hu, L. Ship detection from optical satellite images based on visual search mechanism. In Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy, 26-31 July 2015; pp. 3679-3682, doi:10.1109/IGARSS.2015.7326621
15. Tang, J.; Deng, C.; Huang, G.B.; Zhao, B. Compressed-Domain Ship Detection on Spaceborne Optical Image Using Deep Neural Network and Extreme Learning Machine. IEEE Trans. Geosci. Remote Sens. 2015, 53, 1174-1185, doi:10.1109/TGRS.2014.2335751
16. Yao, Y.; Jiang, Z.; Zhang, H.; Zhao, D.; Cai, B. Ship detection in optical remote sensing images based on deep convolutional neural networks. J. Appl. Remote Sens. 2017, 11, doi:10.1117/1.JRS.11.042611
17. Hu, F.; Xia, G.S.; Wang, Z.; Huang, X.; Zhang, L.; Sun, H. Unsupervised Feature Learning Via Spectral Clustering of Multidimensional Patches for Remotely Sensed Scene Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2015, 8, 2015-2030
18. Zou, Z.; Shi, Z. Ship Detection in Spaceborne Optical Image With SVD Networks. IEEE Trans. Geosci. Remote Sens. 2016, 54, 5832-5845, doi:10.1109/TGRS.2016.2572736
19. Zhang, R.; Yao, J.; Zhang, K.; Feng, C.; Zhang, J. S-CNN Ship Detection from High-Resolution Remote Sensing Images. ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2016, 423-430, doi:10.5194/isprs-archives-XLI-B7-423-2016
20. Cheng, G.; Han, J. A survey on object detection in optical remote sensing images. SPRS J. Photogramm. Remote Sens. 2016, 117, 11-28, doi:10.1016/j.isprsjprs.2016.03.014
21. Bengio, Y.; Courville, A.; Vincent, P. Representation Learning: A Review and New Perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35, 1798-1828, doi:10.1109/TPAMI.2013.50
22. Lin, H.; Shi, Z.; Zou, Z. Fully ConvolutionalNetworkWith Task Partitioning for Inshore Ship Detection in Optical Remote Sensing Images. IEEE Geosci. Remote Sens. Lett. 2017, 14, 1665-1669, doi:10.1109/LGRS.2017.2727515
23. Yang, W.; Dai, D.; Triggs, B.; Xia, G.S. SAR-Based Terrain Classification UsingWeakly Supervised Hierarchical Markov Aspect Models. IEEE Trans. Image Process. 2012, 21, 4232-4243, doi:10.1109/TIP.2012.2199127
24. Arel, I.; Rose, D.C.; Karnowski, T.P. Deep Machine Learning-A New Frontier in Artificial Intelligence Research. IEEE Comput. Intell. Mag. 2010, 5, 13-18, doi:10.1109/MCI.2010.938364
25. Schmidhuber, J. Deep learning in neural networks: An overview. Neural Netw. 2015, 61, 85-117, doi:10.1016/j.neunet.2014.09.003
26. Martinez, H.P.; Bengio, Y.; Yannakakis, G.N. Learning deep physiological models of affect. IEEE Comput. Intell. Mag. 2013, 8, 20-33, doi:10.1109/MCI.2013.2247823
27. Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; Salakhutdinov, R. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. J. Mach. Learn. Res. 2014, 15, 1929-1958
28. LeCun, Y.; Bottou, L.; Bengio, Y.; Haffner, P. Gradient-based learning applied to document recognition. Proc. IEEE 1998, 86, 2278-2323, doi:10.1109/5.726791
29. LeCun, Y.; Boser, B.; Denker, J.S.; Henderson, D.; Howard, R.E.; Hubbard, W.; Jackel, L.D. Backpropagation Applied to Handwritten Zip Code Recognition. Neural Comput. 1989, 1, 541-551, doi:10.1162/neco.1989.1.4.541
30. Krizhevsky, A.; Sutskever, I.; Hinton, G.E. ImageNet Classification with Deep Convolutional Neural Networks. In Proceedings of the The Twenty-sixth Annual Conference on Neural Information Processing Systems (NIPS), Stateline, NV, USA, 3-8 December 2012
31. Szegedy, C.; Liu, W.; Jia, Y.; Sermanet, P.; Reed, S.; Anguelov, D.; Erhan, D.; Vanhoucke, V.; Rabinovich, A. Going deeper with convolutions. In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, 7-12 June 2015; pp. 1-9, doi:10.1109/CVPR.2015.7298594
32. He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 June 2016
33. Zhu, X.X.; Tuia, D.; Mou, L.; Xia, G.S.; Zhang, L.; Xu, F.; Fraundorfer, F. Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources. IEEE Geosci. Remote Sens. Mag. 2017, 5, 8-36, doi:10.1109/MGRS.2017.2762307
34. Hu, F.; Xia, G.S.; Hu, J.; Zhang, L. Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery. Remote Sens. 2015, 7, 14680-14707, doi:10.3390/rs71114680
35. Zhang, L.; Zhang, L.; Du, B. Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art. IEEE Geosci. Remote Sens. Mag. 2016, 4, 22-40, doi:10.1109/MGRS.2016.2540798
36. Ball, J.E.; Anderson, D.T.; Chan, C.S. Comprehensive survey of deep learning in remote sensing: Theories, tools, and challenges for the community. J. Appl. Remote Sens. 2017, 11, 042609, doi:10.1117/1.JRS.11.042609
37. Pascanu, R.; Montufar, G.; Bengio, Y. On the number of inference regions of deep feed forward networks with piece-wise linear activations. In Proceedings of the International Conference on Learning Representations, Banff, AB, Canada, 14-16 April 2014
38. Simonyan, K.; Zisserman, A. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv 2014, arXiv:1409.1556
39. Szegedy, C.; Vanhoucke, V.; Ioffe, S.; Shlens, J.;Wojna, Z. Rethinking the Inception Architecture for Computer Vision. arXiv 2015, arXiv:abs/1512.00567
40. Chollet, F. Xception: Deep Learning with Depthwise Separable Convolutions. arXiv 2016, arXiv:abs/1610.02357
41. Glorot, X.; Bordes, A.; Bengio, Y. Deep Sparse Rectifier Neural Networks. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics (AISTATS), Fort Lauderdale, FL, USA, 11-13 April 2011; Volume 15, pp. 315-323
42. Azizpour, H.; Razavian, A.S.; Sullivan, J. Factors of Transferability for a Generic ConvNet Representation. IEEE Trans. Pattern Anal. Mach. Intell. 2016, 38, doi:10.1109/TPAMI.2015.2500224
43. Yosinski, J.; Clune, J.; Bengio, Y.; Lipson, H. How transferable are features in deep neural networks? In Advances in Neural Information Processing Systems (NIPS); Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., Weinberger, K.Q., Eds.; MIT Press Ltd.: Cambridge, MA, USA, 2014; pp. 3320-3328
44. Deng, J.; Dong, W.; Socher, R.; Li, L.J.; Li, K.; Fei-Fei, L. ImageNet: A large-scale hierarchical image database. In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 20-25 June 2009; pp. 248-255, doi:10.1109/CVPR.2009.5206848
45. Bottou, L. Large-scale machine learning with stochastic gradient descent. In Proceedings of the 19th International Conference on Computational Statistics (COMPSTAT 2010), Paris, France, 22-27 August 2010; Springer: Berlin, Germany, 2010; pp. 177-186
46. Zeiler, M.D. ADADELTA: An Adaptive Learning Rate Method. arXiv 2012, arXiv:abs/1212.5701
47. Sharif Razavian, A.; Azizpour, H.; Sullivan, J.; Carlsson, S. CNN Features Off-the-Shelf: An Astounding Baseline for Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)Workshops, Columbus, OH, USA, 23-28 June 2014
48. Zheng, L.; Zhao, Y.; Wang, S.; Wang, J.; Tian, Q. Good Practice in CNN Feature Transfer. arXiv 2016, arXiv:abs/1604.00133
49. Cheng, G.; Han, J.; Zhou, P.; Guo, L. Multi-class geospatial object detection and geographic image classification based on collection of part detectors. ISPRS J. Photogramm. Remote Sens. 2014, 98, 119-132, doi:10.1016/j.isprsjprs.2014.10.002
50. Kohavi, R. A Study ofCross-validation and Bootstrap forAccuracy Estimation andModel Selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI '95), Montreal, QC, Canada, 20-25 August 1995;Morgan Kaufmann Publishers Inc.: San Francisco, CA, USA, 1995; Volume 2, pp. 1137-1143
51. Shalabi, L.A.; Shaaban, Z.; Kasasbeh, B. DataMining: A Preprocessing Engine. J. Comput. Sci. 2006, 2, 735-739
52. Chatfield, K.; Simonyan, K.; Vedaldi, A.; Zisserman, A. Return of the Devil in the Details: Delving Deep into Convolutional Nets. In Proceedings of the British Machine Vision Conference, Nottingham, UK, 1-5 September 2014; pp. 1-11, doi:10.5244/C.28.6
53. Kang, L.; Ye, P.; Li, Y.; Doermann, D. Convolutional Neural Networks for No-Reference Image Quality Assessment. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 23-28 June 2014; pp. 1733-1740, doi:10.1109/CVPR.2014.224
54. Dodge, S.; Karam, L. Understanding how image quality affects deep neural networks. In Proceedings of the 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), Lisbon, Portugal, 6-8 June 2016; pp. 1-6, doi:10.1109/QoMEX.2016.7498955
55. Demsar, J. Statistical Comparisons of Classifiers over Multiple Data Sets. J. Mach. Learn. Res. 2006, 7, 1-30
56. Dalal, N.; Triggs, B. Histograms of oriented gradients for human detection. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05), San Diego, CA, USA, 20-25 June 2005; Volume 1, pp. 886-893, doi:10.1109/CVPR.2005.177
57. Rublee, E.; Rabaud, V.; Konolige, K.; Bradski, G. ORB: An Efficient Alternative to SIFT or SURF. In Proceedings of the 2011 International Conference on Computer Vision (ICCV '11), Barcelona, Spain, 6-13 November 2011; IEEE Computer Society: Washington, DC, USA, 2011; pp. 2564-2571, doi:10.1109/ICCV.2011.6126544
58. Xu, S.; Fang, T.; Li, D.;Wang, S. Object Classification of Aerial ImagesWith Bag-of-VisualWords. IEEE Geosci. Remote Sens. Lett. 2010, 7, 366-370, doi:10.1109/LGRS.2009.2035644
59. Sun, H.; Sun, X.; Wang, H.; Li, Y.; Li, X. Automatic Target Detection in High-Resolution Remote Sensing Images Using Spatial Sparse Coding Bag-of-Words Model. IEEE Geosci. Remote Sens. Lett. 2012, 9, 109-113, doi:10.1109/LGRS.2011.2161569
60. Malisiewicz, T.; Gupta, A.; Efros, A.A. Ensemble of exemplar-SVMs for Object Detection and Beyond. In Proceedings of the 2011 International Conference on Computer Vision (ICCV '11), 6-13 November 2011; IEEE Computer Society: Washington, DC, USA, 2011; pp. 89-96, doi:10.1109/ICCV.2011.6126229
61. Han, J.; Zhou, P.; Zhang, D.; Cheng, G.; Guo, L.; Liu, Z.; Bu, S.; Wu, J. Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding. ISPRS J. Photogramm. Remote Sens. 2014, 89, 37-48, doi:10.1016/j.isprsjprs.2013.12.011
62. Yang, W.; Yin, X.; Xia, G.S. Learning High-level Features for Satellite Image Classification With Limited Labeled Samples. IEEE Trans. Geosci. Remote Sens. 2015, 53, 4472-4482, doi:10.1109/TGRS.2015.2400449