Toward Fast and Accurate Vehicle Detection in Aerial Images Using Coupled Region-Based Convolutional Neural Networks

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 10, Issue 8, 2017, Pages 3652-3664

  Deng, Zhipeng ^a   Sun, Hao ^a   Zhou, Shilin ^a   Zhao, Juanping ^b   Zou, Huanxin ^a  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Attribute learning; convolutional neural networks; vehicle detection; vehicle proposal network

Indexed keywords

CONVOLUTION; IMAGE PROCESSING; IMAGE SEGMENTATION; LEARNING ALGORITHMS; MOBILE ANTENNAS; NEURAL NETWORKS; OBJECT DETECTION;

COMPREHENSIVE EVALUATION; CONVOLUTIONAL NEURAL NETWORK; DETECTION PERFORMANCE; HIERARCHICAL FEATURES; LOCALIZATION PERFORMANCE; REPRESENTATION POWER; SLIDING WINDOW SEARCHES; SMALL OBJECT DETECTION;

VEHICLES;

ARTIFICIAL NEURAL NETWORK; DETECTION METHOD; IMAGE ANALYSIS; TRANSPORT VEHICLE;

BAVARIA; GERMANY; MUNICH;

EID: 85018879666     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2017.2694890     Document Type: Article

References (52)

1. J. Leitloff, D. Rosenbaum, F. Kurz, O. Meynberg, and P. Reinartz, "An operational system for estimating road traffic information from aerial images, " Remote Sens., vol. 6, no. 11, pp. 11315-11341, 2014.
2. K. Liu and G. Mattyus, "Fast multiclass vehicle detection on aerial images, " IEEE Geosci. Remote Sens. Lett., vol. 12, no. 9, pp. 1938-1942, Sep. 2015.
3. T. Moranduzzo and F. Melgani, "Automatic car counting method for unmanned aerial vehicle images, " IEEE Trans. Geosci. Remote Sens., vol. 52, no. 3, pp. 1635-1647, Mar. 2014.
4. T. Moranduzzo and F. Melgani, "Detecting cars in uav images with a catalog-based approach, " IEEE Trans. Geosci. Remote Sens., vol. 52, no. 10, pp. 6356-6367, Oct. 2014.
5. Z. Chen et al., "Vehicle detection in high-resolution aerial images based on fast sparse representation classification and multiorder feature, " IEEE Trans. Intell. Transp. Syst., vol. 17, no. 8, pp. 2296-2309, Aug. 2016.
6. D. E. Bar and S. Raboy, "Moving car detection and spectral restoration in a single satellite worldview-2 imagery, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 5, pp. 2077-2087, Oct. 2013.
7. W. Liu, F. Yamazaki, and T. T. Vu, "Automated vehicle extraction and speed determination from quickbird satellite images, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 4, no. 1, pp. 75-82, Mar. 2011.
8. H.-Y. Cheng, C.-C. Weng, and Y.-Y Chen, "Vehicle detection in aerial surveillance using dynamic bayesian networks, " IEEE Trans. Image Process., vol. 21, no. 4, pp. 2152-2159, Apr. 2012.
9. W. Shao, W. Yang, G. Liu, and J. Liu, "Car detection from high-resolution aerial imagery using multiple features, " in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2012, pp. 4379-4382.
10. S. Kluckner, G. Pacher, H. Grabner, H. Bischof, and J. Bauer, "A 3d teacher for car detection in aerial images, " in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
11. A. Kembhavi, D. Harwood, and L. S. Davis, "Vehicle detection using partial least squares, " IEEE Trans. Pattern Anal. Mach. Intell, vol. 33, no. 6, pp. 1250-1265, Jun. 2011.
12. Z. Chen et al, "Vehicle detection in high-resolution aerial images via sparse representation and superpixels, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 1, pp. 103-116, Jan. 2016.
13. X. Chen, S. Xiang, C. L. Liu, and C. H. Pan, "Vehicle detection in satellite images by hybrid deep convolutional neural networks, " IEEE Geosci. Remote Sens. Lett, vol. 11, no. 10, pp. 1797-1801, Oct. 2014.
14. T. Moranduzzo and F. Melgani, "A sift-svm method for detecting cars in uav images, " in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2012, pp. 6868-6871.
15. S. Tuermer, F. Kurz, P. Reinartz, and U. Stilla, "Airborne vehicle detection in dense urban areas using hog features and disparity maps, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 6, pp. 2327-2337, Dec. 2013.
16. Z. Zheng, G. Zhou, Y Wang, and Y Liu, "A novel vehicle detection method with high resolution highway aerial image, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 6, pp. 2338-2343, Dec. 2013.
17. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Region-based convolutional networks for accurate object detection and segmentation, " IEEE Trans. Pattern Anal. Mach. Intell, vol. 38, no. 1, pp. 142-158, Jan. 2016.
18. K. He, X. Zhang, S. Ren, and J. Sun, "Spatial pyramid pooling in deep convolutional networks for visual recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 9, pp. 1904-1916, Sep. 2015.
19. R. Girshick, "Fastr-cnn, " in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1440-1448.
20. J. R. R. Uijlings, K. E. A. V D. Sande, T. Gevers, and A. W. M. Smeulders, "Selective search for object recognition, " Int. J. Comput. Vis., vol. 104, no. 2, pp. 154-171, 2013.
21. S. Ren, K. He, R. Girshick, and J. Sun, "Faster r-cnn: Towards real-time object detection with region proposal networks, " in Proc. 25th Int. Conf. Neural Inf. Process. Syst, 2015, pp. 91-99.
22. A. Krizhevsky, I. Sutskever, and G E. Hinton, "Imagenet classification with deep convolutional neural networks, " in Proc. 25th Int. Conf. Neural Inf. Process. Syst, 2012, pp. 1097-1105.
23. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks, " in Proc. Eur. Conf. Comput. Vis., 2014, pp. 818-833.
24. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2016, pp. 770-118.
25. J. Han, D. Zhang, G. Cheng, L. Guo, and J. Ren, "Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 6, pp. 3325-3337, Jun. 2015.
26. F. Zhang, B. Du, and L. Zhang, "Saliency-guided unsupervised feature learning for scene classification, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 2175-2184, Apr. 2015.
27. J. Han et al., "Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding, " ISPRS J. Photogramm. Remote Sens., vol. 89, pp. 37-48, 2014.
28. B. Du, Y Zhang, L. Zhang, and D. Tao, "Beyond the sparsity-based target detector: A hybrid sparsity and statistics-based detector for hyperspectral images, " IEEE Trans. Image Process., vol. 25, no. 11, pp. 5345-5357, Nov. 2016.
29. X. Li, L. Mou, and X. Lu, "Scene parsing from an map perspective, " IEEE Trans. Cybern., vol. 45, no. 9, pp. 1876-1886, Sep. 2015.
30. X. Lu, X. Li, and L. Mou, "Semi-supervised multitask learning for scene recognition, " IEEE Trans. Cybern., vol. 45, no. 9, pp. 1967-1976, Sep. 2015.
31. L. Zhang and Y. Zhang, "Airport detection and aircraft recognition based on two-layer saliency model in high spatial resolution remote-sensing images, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 4, pp. 1511-1524, Apr. 2017.
32. N. Yokoya and A. Iwasaki, "Object detection based on sparse representation and hough voting for optical remote sensing imagery, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 5, pp. 2053-2062, May 2015.
33. M. M. U. Rathore, A. Paul, A. Ahmad, and B. Chen, "Real-time big data analytical architecture for remote sensing application, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 10, pp. 4610-4621, Oct. 2015.
34. X. Huang, W. Yuan, J. Li, and L. Zhang, "A new building extraction postprocessing framework for high-spatial-resolution remote-sensing imagery, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 2, pp. 654-668, Feb. 2017.
35. D. Konstantinidis, T. Stathaki, V. Argyriou, and N. Grammalidis, "Building detection using enhanced hogclbp features and region refinement processes, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 3, pp. 888-905, Mar. 2017.
36. I. Sevo and A. Avramovic, "Convolutional neural network based automatic object detection on aerial images, " IEEE Geosci. Remote Sens. Lett, vol. 13, no. 5, pp. 740-744, May 2016.
37. F. Zhang, B. Du, L. Zhang, and M. Xu, "Weakly supervised learning based on coupled convolutional neural networks for aircraft detection, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 9, pp. 5553-5563, Sep. 2016.
38. P. Zhou, G. Cheng, Z. Liu, S. Bu, and X. Hu, "Weakly supervised target detection in remote sensing images based on transferred deep features and negative bootstrapping, " Multidimensional Syst. Signal Process., vol. 27, no. 4, pp. 925-944, 2016.
39. W. Diao, X. Sun, X. Zheng, F. Dou, H. Wang, and K. Fu, "Efficient saliency-based object detection in remote sensing images using deep belief networks, " IEEE Geosci. Remote Sens. Lett, vol. 13, no. 2, pp. 137-141, Feb. 2016.
40. G. Cheng, P. Zhou, and J. Han, "Learning rotation-invariant convolutional neural networks for object detection in vhr optical remote sensing images, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 12, pp. 7405-7415, Dec. 2016.
41. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit, 2015, pp. 1337-1342.
42. B. Hariharan, P. Arbelaez, R. Girshick, and J. Malik, "Hypercolumns for object segmentation and fine-grained localization, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit, 2015, pp. 447-456.
43. T. Kong, A. Yao, Y. Chen, and F Sun, "Hypernet: towards accurate region proposal generation and joint object detection, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2016, pp. 845-853.
44. K.-H. Kim, S. Hong, B. Roh, Y. Cheon, and M. Park, "Pvanet: Deep but lightweight neural networks for real-time object detection, " in Proc. Conf.on Neu. Inf. Proc. Syst. 2016, pp. 1-7.
45. S. Bell, C. L. Zitnick, K. Bala, and R. Girshick, "Inside-outside net: Detecting objects in context with skip pooling and recurrent neural networks, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit, 2016, pp. 2874-2883.
46. Y Jia et al., "Caffe: Convolutional architecture for fast feature embedding, " in Proc. ACM Int. Conf. Multimedia, 2014, pp. 675-678.
47. Y Lecun et al, "Backpropagation applied to handwritten zip code recog-nition, " Neural Comput, vol. 1, no. 4, pp. 541-551, 2008.
48. G. Cheng, J. Han, P. Zhou, and L. Guo, "Multi-class geospatial object detection and geographic image classification based on collection of part detectors, " ISPRS J. Photogramm. Remote Sens., vol. 98, no. 1, pp. 119-132, 2014.
49. G. Cheng and J. Han, "A survey on object detection in optical remote sensing images, " ISPRS J. Photogramm. Remote Sens., vol. 117, pp. 11-28, 2016.
50. P. Dollar, R. Appel, S. Belongie, and P. Perona, "Fast feature pyramids for object detection, " IEEE Trans. Pattern Anal. Mach. Intell, vol. 36, no. 8, pp. 1532-1545, Aug. 2014.
51. P. Dollar, "Piotr's Computer Vision Matlab Toolbox (PMT), " 2016. [Online]. Available: https://github.com/pdollar/toolbox
52. L. V. D. Maaten and G. Hinton, "Viualizing data using t-SNE, " J. Mach. Learn. Res., vol. 9, no. 2605, pp. 2579-2605, 2008.