Airborne vehicle detection in dense urban areas using HoG features and disparity maps

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 6, Issue 6, 2013, Pages 2327-2337

  Tuermer, Sebastian ^a   Kurz, Franz ^a   Reinartz, Peter ^a   Stilla, Uwe ^b  

^a GERMAN AEROSPACE CENTER DLR   (Germany)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

aerial images; image sequence analysis; traffic; Vehicle detection

Indexed keywords

AERIAL IMAGES; EXTERIOR ORIENTATION; EXTRACTION PROCESS; HISTOGRAM OF ORIENTED GRADIENTS (HOG); IMAGE SEQUENCE ANALYSIS; REALTIME PROCESSING; REGION GROWING ALGORITHM; VEHICLE DETECTION;

DATABASE SYSTEMS; IMAGE SEGMENTATION; TELECOMMUNICATION TRAFFIC;

ROADS AND STREETS;

AIRBORNE SENSING; AUTOMOBILE; DETECTION METHOD; DIGITAL ELEVATION MODEL; IMAGE ANALYSIS; IMAGE CLASSIFICATION; MAPPING; PATTERN RECOGNITION; TRAFFIC MANAGEMENT; URBAN AREA;

BAVARIA; GERMANY; MUNICH;

EID: 84890120460     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2013.2242846     Document Type: Article

References (59)

1. M. A. G. Clark, "Induction loop vehicle detector," US Patent 4, 568, 937, Feb. 4, 1986.
2. L. Davidson and E. Valentine, "Wireless induction loop control system," US Patent 6, 265, 788, Jul. 24, 2001.
3. R. Shillman and D. Schatz, "Video traffic monitoring and signaling apparatus," US Patent 8, 018, 352, Sep. 13, 2011.
4. I. Y. Matsur, "Traffic monitoring system," US Patent 8, 260, 533, Sep. 4, 2012.
5. H. Bischof, M. Godec, C. Leistner, B. Rinner, and A. Starzacher, "Autonomous audio-supported learning of visual classifiers for traffic monitoring," IEEE Intelligent Syst., vol. 25, no. 3, pp. 15-23, 2010.
6. U. Albrecht, J. Heimann, and W. Schulz, "Method and system for the prognosis of the traffic stream," EP Patent 0755 039 A2, 1995.
7. S. Hinz, R. Bamler, and U. Stilla, "Editorial theme issue: Airborne und spaceborne traffic monitoring," ISPRS J. Photogramm. Remote Sens., vol. 61, no. 3-4, pp. 135-136, 2006. (Pubitemid 44830108)
8. X. Jin and C. H. Davis, "Vehicle detection from high-resolution satellite imagery using morphological shared-weight neural networks," Image Vision Comput., vol. 25, no. 9, pp. 1422-1431, 2007. (Pubitemid 46899285)
9. S. O. Larsen, H. Koren, and R. Solberg, "Traffic monitoring using very high resolution satellite imagery," Photogramm. Eng. Remote Sens., vol. 75, no. 7, pp. 859-869, 2009.
10. J. Leitloff, S. Hinz, and U. Stilla, "Vehicle extraction from very high resolution satellite images of city areas," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 7, pp. 2795-2806, 2010.
11. B. Salehi, Y. Zhang, and M. Zhong, "Automatic moving vehicles infor mation extraction from single-pass Worldview-2 imagery," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 5, no. 1, pp. 135-145, 2012.
12. L. Meng and J. Kerekes, "Object tracking using high resolution satellite imagery," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 5, no. 1, pp. 146-152, 2012.
13. F. K. Nejadasl, B. G. Gorte, and S. P. Hoogendoorn, "Optical flow based vehicle tracking strengthened by statistical decisions," ISPRS J. Photogramm. Remote Sens., vol. 61, no. 3-4, pp. 159-169, 2006. (Pubitemid 44821775)
14. T. P. Breckon, S. E. Barnes, M. L. Eichner, and K. Wahren, "Autonomous real-time vehicle detection from a medium-level UAV," in Proc. 24th Int.Unmanned Air Vehicle Systems Conf., 2008.
15. J. Gleason, A. V. Nefian, X. Bouyssounousse, T. Fong, and G. Bebis, "Vehicle detection from aerial imagery," in IEEE Int. Conf. Robotics and Automation (ICRA), 2011.
16. R. Gui and Z. Wang, "Detecting vehicle target in sar image with high moment," in Radar Symp. (IRS), Leipzig, Oct. 2011, pp. 391-395.
17. O. Maksymiuk, M. Schmitt, A. R. Brenner, and U. Stilla, "First investigations on detection of stationary vehicles in airborne decimeter resolution sar data by supervised learning," in IEEE Int. Geoscience and Remote Sensing Symp. (IGARSS 2012), 2012, pp. 3584-3587.
18. S. Baumgartner and G. Krieger, "Fast GMTI algorithm for traffic monitoring based on a priori knowledge," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 11, pp. 4626-4641, 2011.
19. U. Stilla, E. Michaelsen, U. Soergel, S. Hinz, and J. Ender, "Airborne monitoring of vehicle activity in urban areas," International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 34, pt. B3, pp. 973-979, 2004.
20. W. Yao and U. Stilla, "Comparison of two methods for vehicle extraction from airborne lidar data toward motion analysis," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 4, pp. 607-611, 2011.
21. W. Yao, M. Zhang, S. Hinz, and U. Stilla, "Airborne traffic monitoring in large areas using lidar data," Int. J. Remote Sens., vol. 33, no. 12, pp. 3930-3945, 2012.
22. M. Kirchhof and U. Stilla, "Detection of moving objects in airborne thermal videos," ISPRS J. Photogramm. Remote Sens., vol. 61, no. 3-4, pp. 187-196, 2006. (Pubitemid 44821768)
23. W. Yao, S. Hinz, and U. Stilla, "Automatic estimation of vehicle activity from airborne thermal infrared video of urban areas by trajectory classification," Photogrammetrie-Fernerkundung-Geoinformation (PFG), vol. 2009, no. 5, pp. 393-406, 2009.
24. P. Burlina, V. Parameswaran, and R. Chellappa, "Sensitivity analysis and learning strategies for context-based vehicle detection algorithms," in DARPA IU Workshop, College Park, MD, 1997, Center for Automation Research, University of Maryland.
25. H. Moon, R. Chellappa, and A. Rosenfeld, "Performance analysis of a simple vehicle detection algorithm," Image and Vision Computing, vol. 20, no. 1, pp. 1-13, 2002. (Pubitemid 33147068)
26. K. Kozempel and R. Reulke, "Fast vehicle detection and tracking in aerial image bursts," in ISPRS City Models, Roads and Traffic (CMRT), Paris, France, Sep. 2009, vol. 38, no. 3/W4, pp. 175-180.
27. T. Zhao and R. Nevatia, "Car detection in low resolution aerial image," Image and Vision Computing, vol. 21, no. 8, pp. 693-703, Jul. 2003.
28. S. Hinz, "Detection of vehicles and vehicle queues in high resolution aerial images," Photogrammetrie-Fernerkundung-Geoinformation (PFG), vol. 3, no. 4, pp. 201-213, 2004.
29. P. Reinartz, M. Lachaise, E. Schmeer, T. Krauss, and H. Runge, "Traffic monitoring with serial images from airborne cameras," ISPRS J. Photogramm. Remote Sens., vol. 61, no. 3-4, pp. 149-158, 2006. (Pubitemid 44821769)
30. G. Palubinskas, F. Kurz, and P. Reinartz, "Detection of traffic congestion in optical remote sensing imagery," in IEEE Int. Geoscience and Remote Sensing Symp. (IGARSS 2008), Boston, MA, USA, Jul. 2008.
31. J. Xiao, H. Cheng, H. Sawhney, and F. Han, "Vehicle detection and tracking in wide field-of-view aerial video," in IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2010, pp. 679-684.
32. V. Reilly, H. Idrees, and M. Shah, "Detection and tracking of large number of targets in wide area surveillance," in Eur. Conf. Computer Vi si on (EC C V), 2010.
33. H. Grabner, T. T. Nguyen, B. Gruber, and H. Bischof, "On-line boosting-based car detection from aerial images," ISPRS J. Photogramm. Remote Sens., vol. 63, no. 3, pp. 382-396, 2008.
34. S. Kluckner, G. Pacher, H. Grabner, and H. Bischof, "A 3D teacher for car detection in aerial images," in ICCV, Rio de Janeiro, Brazil, 2007.
35. D. Lenhart, S. Hinz, J. Leitloff, and U. Stilla, "Automatic traffic monitoring based on aerial image sequences," Pattern Recognition and Image Analysis, vol. 18, no. 3, pp. 400-405, 2008.
36. J.-Y. Choi and Y.-K. Yang, "Vehicle detection from aerial images using local shape information," in Pacific Rim Symp. Advances in Image and Video Technology (PSIVT), Berlin, Heidelberg, Germany, 2009, pp. 227-236, Springer-Verlag.
37. A. C. Holt, E. Y. W. Seto, T. Rivard, and G. Peng, "Object-based detection and classification of vehicles from high-resolution aerial photography," Photogrammetric Engineering and Remote Sensing (PE&RS), vol. 75, no. 7, pp. 871-880, July 2009.
38. A. Kembhavi, D. Harwood, and L. Davis, "Vehicle detection using partial least squares," IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI), vol. 33, no. 6, pp. 1250-1265, Jun. 2011.
39. [Online]. Available: http://corporate.navteq.com
40. [Online]. Available: http://navigation.teleatlas.com/
41. [Online]. Available: http://www.openstreetmap.org/
42. H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "Surf: Speeded up robust features," Computer Vision and Image Understanding (CVIU), vol. 110, no. 3, pp. 346-359, 2008.
43. H. Hirschmueller, "Stereo processing by semi-global matching and mutual information," Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 328-341, 2008.
44. P. d'Angelo and P. Reinartz, "Semiglobal matching results on the isprs stereo matching benchmark," in High-Resolution Earth Imaging for Geospatial Information, Hanover, Germany, 2011.
45. R. Zabih and J. Woodfill, "Non-parametric local transforms for computing visual correspondence," in Eur. Conf. Computer Vision (ECCV), 1994, pp. 151-158.
46. H. Hirschmueller and D. Scharstein, "Evaluation of stereo matching costs on image with radiometric differences," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 9, pp. 1582-1599, 2009.
47. R. W. Hamming, "Error detecting and error correcting codes," Bell Syst. Tech. J., vol. 29, no. 2, pp. 147-160, 1950.
48. J. Kittler and J. Illingworth, "Minimum error thresholding," Pattern Recognition, vol. 19, pp. 41-47, 1986.
49. M. Sezgin and B. Sankur, "Survey over image thresholding techniques and quantitative performance evaluation," J. Electronic Imaging, vol. 13, no. 1, pp. 146-165, 2004.
50. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA, 2005, vol. 1, pp. 886-893, IEEE Computer Society. (Pubitemid 43897286)
51. D. G. Lowe, "Object recognition from local scale-invariant features," in Int. Conf. Computer Vision (ICCV), 1999, vol. 2, pp. 1150-1157.
52. S. Tuermer, J. Leitloff, P. Reinartz, and U. Stilla, "Automatic vehicle detection in aerial image sequences of urban areas using 3D HOG features," in Int. Archives of Photogrammetry, Remote Sensing and the Spatial Information Sciences, Paris, France, Sep. 2010, vol. XXXVIII, no. 3.
53. R. Schapire, "Strength of weak learnability," Machine Learning, vol. 5, pp. 197-227, 1990. (Pubitemid 20721695)
54. Y. Freund, "Boosting a weak learning algorithm by majority," in 3rd Annual Workshop on Computational Learning Theory, 1990.
55. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Computer and System Sciences, vol. 55, no. 1, pp. 119-139, 1997. (Pubitemid 127433398)
56. R. Polikar, "Ensemble based systems in decision making," IEEE Circuits and Systems Mag., vol. 6, no. 3, pp. 21-45, 2006.
57. F. Kurz, S. Tuermer, O. Meynberg, D. Rosenbaum, J. Leitloff, H. Runge, and P. Reinartz, "Low-cost optical camera systems for real time mapping applications," Photogrammetrie-Fernerkundung-Geoin-formation (PFG), vol. 2012, no. 2, pp. 159-176, 2012.
58. C. S. Fraser, "Digital camera self-calibration," ISPRS J. Photogramm. Remote Sens., vol. 52, no. 4, pp. 149-159, 1997. (Pubitemid 27383726)
59. A. Makarau, R. Richter, R. Muller, and P. Reinartz, "Adaptive shadow detection using a blackbody radiator model," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 6, pp. 2049-2059, 2011.