Looking at vehicles on the road: A survey of vision-based vehicle detection, tracking, and behavior analysis

IEEE Transactions on Intelligent Transportation Systems

Volumn 14, Issue 4, 2013, Pages 1773-1795

  Sivaraman, Sayanan ^a   Trivedi, Mohan Manubhai ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Computer vision; Intelligent vehicles; Machine learning; Object detection; Object tracking

Indexed keywords

BEHAVIOR UNDERSTANDING; FUTURE RESEARCH DIRECTIONS; OBJECT DETECTION; OBJECT TRACKING; PERFORMANCE METRICS; SPATIOTEMPORAL MEASUREMENT; VEHICLE DETECTION; VISION-BASED VEHICLE DETECTION;

COMPUTER VISION; IMAGE PROCESSING; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; LEARNING SYSTEMS; ROADS AND STREETS; SENSORS; SURVEYS; TRACKING (POSITION);

STEREO VISION;

EID: 84890437069     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2013.2266661     Document Type: Article

References (198)

1. Department of Transportation National Highway Traffic Safety Administration, Traffic safety facts 2011. [Online]. Available: http://www-nrd. nhtsa.dot.gov
2. Z. Sun, G. Bebis, and R. Miller, "On-road vehicle detection: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 694-711, May 2006.
3. A. Barth and U. Franke, "Tracking oncoming and turning vehicles at intersections," in Proc. 13th Int. IEEE ITSC, Sep. 2010, pp. 861-868.
4. S. Sivaraman, B. T. Morris, and M. M. Trivedi, "Learning multi-lane trajectories using vehicle-based vision," in Proc. IEEE Int. Conf. Comput. Vision Workshop, 2011, pp. 2070-2076.
5. S. Sivaraman and M. M. Trivedi, "Combining monocular and stereovision for real-time vehicle ranging and tracking on multilane highways," in Proc. IEEE Intell. Transp. Syst. Conf., 2011, pp. 1249-1254.
6. D. Kasper, G. Weidl, T. Dang, G. Breuel, A. Tamke, and W. Rosenstiel, "Object-oriented Bayesian networks for detection of lane change maneuvers," in Proc. IEEE IV, Jun. 2011, pp. 673-678.
7. X. Mao, D. Inoue, S. Kato, and M. Kagami, "Amplitude-modulated laser radar for range and speed measurement in car applications," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 1, pp. 408-413, Mar. 2012.
8. S. Tokoro, K. Kuroda, A. Kawakubo, K. Fujita, and H. Fujinami, "Electronically scanned millimeter-wave radar for pre-crash safety and adaptive cruise control system," in Proc. IEEE Intell. Veh. Symp., Jun. 2003, pp. 304-309.
9. J. Levinson, J. Askeland, J. Becker, J. Dolson, D. Held, S. Kammel, J. Kolter, D. Langer, O. Pink, V. Pratt, M. Sokolsky, G. Stanek, D. Stavens, A. Teichman, M. Werling, and S. Thrun, "Towards fully autonomous driving: Systems and algorithms," in Proc. IEEE IV, Jun. 2011, pp. 163-168.
10. S. Sato, M. Hashimoto, M. Takita, K. Takagi, and T. Ogawa, "Multilayer lidar-based pedestrian tracking in urban environments," in Proc. IEEE IV, Jun. 2010, pp. 849-854.
11. F. Garcia, P. Cerri, A. Broggi, J. M. Armingo, and A. de la Escalera, Vehicle Detection Based on Laser Radar. New York, NY, USA: Springer-Verlag, 2009.
12. Y. Ma, S. Soatto, J. Kosecka, and S. S. Sastry, An Invitation to 3-D Vision: From Images to Geometric Models. New York, NY, USA: Springer-Verlag, 2003.
13. S. Sivaraman and M. Trivedi, "Integrated lane and vehicle detection, localization, and tracking: A synergistic approach," IEEE Trans. Intell. Transp. Syst., vol. 14, no. 2, pp. 907-917, Jun. 2013.
14. M. Mahlisch, R. Schweiger, W. Ritter, and K. Dietmayer, "Sensorfusion using spatio-temporal aligned video and lidar for improved vehicle detection," in Proc. IEEE Intell. Veh. Symp., 2006, pp. 424-429. (Pubitemid 47129707)
15. A. Wedel and U. Franke, "Monocular video serves radar-based emergency braking," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 93-98.
16. J. Diaz Alonso, E. Ros Vidal, A. Rotter, and M. Muhlenberg, "Lanechange decision aid system based on motion-driven vehicle tracking," IEEE Trans. Veh. Technol., vol. 57, no. 5, pp. 2736-2746, Sep. 2008.
17. K.-T. Song and H.-Y. Chen, "Lateral driving assistance using optical flow and scene analysis," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 624-629.
18. N. Blanc, B. Steux, and T. Hinz, "LaRASideCam: A fast and robust vision-based blindspot detection system," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 480-485.
19. B.-F. Lin, Y.-M. Chan, L.-C. Fu, P.-Y. Hsiao, L.-A. Chuang, S.-S. Huang, and M.-F. Lo, "Integrating appearance and edge features for sedan vehicle detection in the blind-spot area," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 2, pp. 737-747, Jun. 2012.
20. T. Gandhi and M. M. Trivedi, "Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera," Mach. Vis. Appl., vol. 16, no. 2, pp. 85-95, Feb. 2005. (Pubitemid 40536232)
21. T. Gandhi and M. Trivedi, "Vehicle surround capture: Survey of techniques and a novel omni-video-based approach for dynamic panoramic surround maps," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 3, pp. 293-308, Sep. 2006. (Pubitemid 44376116)
22. W.-C. Chang and C.-W. Cho, "Real-time side vehicle tracking using parts-based boosting," in Proc. IEEE Int. Conf. SMC, 2008, pp. 3370-3375.
23. A. Broggi, A. Cappalunga, S. Cattani, and P. Zani, "Lateral vehicles detection using monocular high resolution cameras on TerraMax," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 1143-1148.
24. W. Liu, X. Wen, B. Duan, H. Yuan, and N. Wang, "Rear vehicle detection and tracking for lane change assist," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 252-257.
25. C. Hoffmann, "Fusing multiple 2D visual features for vehicle detection," in Proc. IEEE Intell. Veh. Symp., 2006, pp. 406-411. (Pubitemid 47129704)
26. C. Hilario, J. Collado, J. Armingol, and A. de la Escalera, "Pyramidal image analysis for vehicle detection," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 88-93. (Pubitemid 44055107)
27. J. Arrospide, L. Salgado, M. Nieto, and F. Jaureguizar, "On-board robust vehicle detection and tracking using adaptive quality evaluation," in Proc. 15th IEEE ICIP, Oct. 2008, pp. 2008-2011.
28. Y.-M. Chan, S.-S. Huang, L.-C. Fu, and P.-Y. Hsiao, "Vehicle detection under various lighting conditions by incorporating particle filter," in Proc. IEEE ITSC, 2007, pp. 534-539.
29. Z. Kim, "Realtime obstacle detection and tracking based on constrained Delaunay triangulation," in Proc. IEEE ITSC, Sep. 2006, pp. 548-553. (Pubitemid 351492225)
30. J. Nuevo, I. Parra, J. Sjoberg, and L. Bergasa, "Estimating surrounding vehicles' pose using computer vision," in Proc. 13th ITSC, Sep. 2010, pp. 1863-1868.
31. C. Idler, R. Schweiger, D. Paulus, M. Mahlisch, and W. Ritter, "Realtime vision based multi-target-tracking with particle filters in automotive applications," in Proc. IEEE Intell. Veh. Symp., 2006, pp. 188-193. (Pubitemid 47129668)
32. H.-Y. Chang, C.-M. Fu, and C.-L. Huang, "Real-time vision-based preceding vehicle tracking and recognition," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 514-519. (Pubitemid 44055179)
33. B. Aytekin and E. Altug, "Increasing driving safety with a multiple vehicle detection and tracking system using ongoing vehicle shadow information," in Proc. IEEE Int. Conf. SMC, Oct. 2010, pp. 3650-3656.
34. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. CVPR, 2005, pp. 886-893. (Pubitemid 43897286)
35. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Comput. Vis. Pattern Recog. Conf., 2001, pp. I-511-I-518.
36. S. Teoh and T. Brunl (2012, Sep.). Symmetry-based monocular vehicle detection system. Mach. Vis. Appl. [Online]. 23(5), pp. 831-842. Available: http://dx.doi.org/10.1007/s00138-011-0355-7
37. S. Sivaraman and M. M. Trivedi, "Active learning for on-road vehicle detection: A comparative study," Mach. Vis. Appl.-Special Issue Car Navigation and Vehicle Systems, pp. 1-13, Dec. 2011.
38. M. Cheon, W. Lee, C. Yoon, and M. Park, "Vision-based vehicle detection system with consideration of the detecting location," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 3, pp. 1243-1252, Sep. 2012.
39. R. Wijnhoven and P. de With, "Unsupervised sub-categorization for object detection: Finding cars from a driving vehicle," in Proc. IEEE ICCV Workshops, Nov. 2011, pp. 2077-2083.
40. T. Machida and T. Naito, "GPU and CPU cooperative accelerated pedestrian and vehicle detection," in Proc. IEEE ICCV Workshops, Nov. 2011, pp. 506-513.
41. R. M. Z. Sun and G. Bebis, "Monocular precrash vehicle detection: Features and classifiers," IEEE Trans. Image Process., vol. 15, no. 7, pp. 2019-2034, Jul. 2006. (Pubitemid 43985079)
42. D. Ponsa, A. Lopez, F. Lumbreras, J. Serrat, and T. Graf, "3D vehicle sensor based on monocular vision," in Proc. IEEE Intell. Transp. Syst., Sep. 2005, pp. 1096-1101. (Pubitemid 44250354)
43. D. Ponsa, A. Lopez, J. Serrat, F. Lumbreras, and T. Graf, "Multiple vehicle 3D tracking using an unscented Kalman," in Proc. IEEE Intell. Transp. Syst., Sep. 2005, pp. 1108-1113. (Pubitemid 44250356)
44. J. Cui, F. Liu, Z. Li, and Z. Jia, "Vehicle localization using a single camera," in Proc. IEEE IV, Jun. 2010, pp. 871-876.
45. G. Y. Song, K. Y. Lee, and J. W. Lee, "Vehicle detection by edgebased candidate generation and appearance-based classification," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 428-433.
46. D. Withopf and B. Jahne, "Learning algorithm for real-time vehicle tracking," in Proc. IEEE ITSC, Sep. 2006, pp. 516-521. (Pubitemid 351492220)
47. A. Haselhoff, S. Schauland, and A. Kummert, "A signal theoretic approach to measure the influence of image resolution for appearancebased vehicle detection," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 822-827.
48. A. Haselhoff and A. Kummert, "A vehicle detection system based on Haar and triangle features," in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 261-266.
49. S. Sivaraman and M. Trivedi, "A general active-learning framework for on-road vehicle recognition and tracking," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 2, pp. 267-276, Jun. 2010.
50. A. Haselhoff and A. Kummert, "An evolutionary optimized vehicle tracker in collaboration with a detection system," in Proc. 12th Int. IEEE Conf. ITSC, Oct. 2009, pp. 1-6.
51. S. Sivaraman and M. M. Trivedi, "Real-time vehicle detection using parts at intersections," in Proc. IEEE Intell. Transp. Syst. Conf., 2012, pp. 1519-1524.
52. P. Negri, X. Clady, S. M. Hanif, and L. Prevost, "A cascade of boosted generative and discriminative classifiers for vehicle detection," EURASIP J. Adv. Signal Process., vol. 2008, p. 136, Jan. 2008.
53. D. Lowe, "Object recognition from local scale-invariant features," in Proc. Int. Conf. Comput. Vis., 1999, pp. 1150-1157. (Pubitemid 32079997)
54. X. Zhang, N. Zheng, Y. He, and F. Wang, "Vehicle detection using an extended hidden random field model," in Proc. 14th Int. IEEE Conf. ITSC, Oct. 2011, pp. 1555-1559.
55. H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "SURF: Speeded up robust features," Comput. Vis. Image Understand., vol. 110, no. 3, pp. 346-359, 2008.
56. Y. Zhang, S. Kiselewich, and W. Bauson, "Legendre and Gabor moments for vehicle recognition in forward collision warning," in Proc. IEEE ITSC, Sep. 2006, pp. 1185-1190. (Pubitemid 351492332)
57. C.-C. R. Wang and J.-J. Lien, "Automatic vehicle detection using local features: A statistical approach," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 1, pp. 83-96, Mar. 2008. (Pubitemid 351337433)
58. O. Ludwig and U. Nunes, "Improving the generalization properties of neural networks: An application to vehicle detection," in Proc. 11th Int. IEEE Conf. ITSC, Oct. 2008, pp. 310-315.
59. C. Cortes and V. Vapnik, "Support vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, Sep. 1995.
60. Y. Freund and R. Schapire, "A short introduction to boosting," J. Jpn. Soc. Artif. Intell., vol. 14, no. 5, pp. 771-780, Sep. 1999.
61. Q. Yuan, A. Thangali, V. Ablavsky, and S. Sclaroff, "Learning a family of detectors via multiplicative kernels," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 514-530, Mar. 2011.
62. T. Liu, N. Zheng, L. Zhao, and H. Cheng, "Learning based symmetric features selection for vehicle detection," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 124-129. (Pubitemid 44055113)
63. A. Khammari, F. Nashashibi, Y. Abramson, and C. Laurgeau, "Vehicle detection combining gradient analysis and AdaBoost classification," in Proc. IEEE Intell. Transp. Syst., Sep. 2005, pp. 66-71.
64. I. Kallenbach, R. Schweiger, G. Palm, and O. Lohlein, "Multi-class object detection in vision systems using a hierarchy of cascaded classifiers," in Proc. IEEE Intell. Veh. Symp., 2006, pp. 383-387. (Pubitemid 47129700)
65. T. Son and S. Mita, "Car detection using multi-feature selection for varying poses," in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 507-512.
66. D. Acunzo, Y. Zhu, B. Xie, and G. Baratoff, "Context-adaptive approach for vehicle detection under varying lighting conditions," in Proc. IEEE ITSC, 2007, pp. 654-660.
67. W.-C. Chang and C.-W. Cho, "Online boosting for vehicle detection," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 3, pp. 892-902, Jun. 2010.
68. C. Caraffi, T. Vojii, J. Trefny, J. Sochman, and J. Matas, "A system for real-time detection and tracking of vehicles from a single car-mounted camera," in Proc. 15th Int. IEEE Conf. ITSC, 2012, pp. 975-982.
69. A. Jazayeri, H. Cai, J. Y. Zheng, and M. Tuceryan, "Vehicle detection and tracking in car video based on motion model," IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 583-595, Jun. 2011.
70. A. Chavez-Aragon, R. Laganiere, and P. Payeur, "Vision-based detection and labeling of multiple vehicle parts," in Proc. 14th Int. IEEE Conf. ITSC, Oct. 2011, pp. 1273-1278.
71. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
72. P. Felzenszwalb, R. Girshick, and D. McAllester, "Cascade object detection with deformable part models," in Proc. IEEE Comput. Vis. Pattern Recog., 2010, pp. 2241-2248.
73. A. Takeuchi, S. Mita, and D. McAllester, "On-road vehicle tracking using deformable object model and particle filter with integrated likelihoods," in Proc. IEEE IV, Jun. 2010, pp. 1014-1021.
74. H. Niknejad, S. Mita, D. McAllester, and T. Naito, "Vision-based vehicle detection for nighttime with discriminately trained mixture of weighted deformable part models," in Proc. 14th Int. IEEE Conf. ITSC, 2011, pp. 1560-1565.
75. H. Tehrani Niknejad, A. Takeuchi, S. Mita, and D. McAllester, "On-road multivehicle tracking using deformable object model and particle filter with improved likelihood estimation," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 2, pp. 748-758, Jun. 2012.
76. S. Sivaraman and M. Trivedi, "Vehicle detection by independent parts for urban driver assistance," IEEE Trans. Intell. Transp. Syst., 2013, DOI 10.1109/TITS.2013.2264314.
77. Y. Zhu, D. Comaniciu, M. Pellkofer, and T. Koehler, "Reliable detection of overtaking vehicles using robust information fusion," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 4, pp. 401-414, Dec. 2006. (Pubitemid 44925812)
78. P. Chang, D. Hirvonen, T. Camus, and B. Southall, "Stereo-based object detection, classification, and quantitative evaluation with automotive applications," in Proc. IEEE Comput. Soc. Conf. CVPR Workshops, Jun. 2005, p. 62.
79. I. Cabani, G. Toulminet, and A. Bensrhair, "Contrast-invariant obstacle detection system using color stereo vision," in Proc. 11th Int. IEEE Conf. ITSC, Oct. 2008, pp. 1032-1037.
80. U. Franke, C. Rabe, H. Badino, and S. Gehrig, "6D-vision: Fusion of stereo and motion for robust environment perception," in Proc. DAGM, 2005, pp. 216-223. (Pubitemid 41520657)
81. H. Badino, R. Mester, J. Wolfgang, and U. Franke, "Free space computation using stochastic occupancy grids and dynamic programming," in Proc. ICCV Workshop Dyn. Vis., 2007, pp. 144-156.
82. A. Barth and U. Franke, "Estimating the driving state of oncoming vehicles from a moving platform using stereo vision," IEEE Trans. Intell Transp. Syst., vol. 10, no. 4, pp. 560-571, Dec. 2009.
83. A. Broggi, A. Cappalunga, C. Caraffi, S. Cattani, S. Ghidoni, P. Grisleri, P. Porta, M. Posterli, and P. Zani, "TerraMax vision at the urban challenge 2007," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 1, pp. 194-205, Mar. 2010.
84. R. Danescu, F. Oniga, and S. Nedevschi, "Modeling and tracking the driving environment with a particle-based occupancy grid," IEEE Trans. Intell. Transp. Syst., vol. 12, no. 4, pp. 1331-1342, Dec. 2011.
85. F. Erbs, A. Barth, and U. Franke, "Moving vehicle detection by optimal segmentation of the dynamic stixel world," in Proc. IEEE IV, Jun. 2011, pp. 951-956.
86. M. Perrollaz, J.-D. Yoder, A. Nègre, A. Spalanzani, and C. Laugier, "A visibility-based approach for occupancy grid computation in disparity space," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 3, pp. 1383-1393, Sep. 2012.
87. J. Wang, G. Bebis, and R. Miller, "Overtaking vehicle detection using dynamic and quasi-static background modeling," in Proc. IEEE CVPR, Jun. 2005, p. 64.
88. S. Cherng, C.-Y. Fang, C.-P. Chen, and S.-W. Chen, "Critical motion detection of nearby moving vehicles in a vision-based driver-assistance system," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 1, pp. 70-82, Mar. 2009.
89. J. Arrospide, L. Salgado, and M. Nieto, "Vehicle detection and tracking using homography-based plane rectification and particle filtering," in Proc. IEEE IV, Jun. 2010, pp. 150-155.
90. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Imag. Understand. Workshop, 1981, pp. 674-679. (Pubitemid 14478744)
91. E. Martinez, M. Diaz, J. Melenchon, J. Montero, I. Iriondo, and J. Socoro, "Driving assistance system based on the detection of head-on collisions," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 913-918.
92. D. Baehring, S. Simon, W. Niehsen, and C. Stiller, "Detection of close cut-in and overtaking vehicles for driver assistance based on planar parallax," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 290-295. (Pubitemid 44055141)
93. K. Yamaguchi, T. Kato, and Y. Ninomiya, "Vehicle ego-motion estimation and moving object detection using a monocular camera," in Proc. 18th ICPR, vol. 4, pp. 610-613.
94. K. Yamaguchi, T. Kato, and Y. Ninomiya, "Moving obstacle detection using monocular vision," in Proc. IEEE Intell. Veh. Symp., 2006, pp. 288-293. (Pubitemid 47129685)
95. I. Sato, C. Yamano, and H. Yanagawa, "Crossing obstacle detection with a vehicle-mounted camera," in Proc. IEEE IV, Jun. 2011, pp. 60-65.
96. A. Geiger and B. Kitt, "Object flow: A descriptor for classifying traffic motion," in Proc. IEEE Intell. Veh. Symp., San Diego, USA, Jun. 2010, pp. 287-293.
97. A. Geiger, "Monocular road mosaicing for urban environments," in Proc. IEEE IV, Xi'an, China, Jun. 2009, pp. 140-145.
98. J. Velten, S. Schauland, A. Gavriilidis, T. Schwerdtfeger, F. Boschen, and A. Kummert, "Tomographical scene reconstruction in the active safety car project," in Proc. 15th Int. IEEE Conf. ITSC, 2012, pp. 307-312.
99. I. Cabani, G. Toulminet, and A. Bensrhair, "Color-based detection of vehicle lights," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 278-283. (Pubitemid 44055139)
100. Y.-L. Chen, C.-T. Lin, C.-J. Fan, C.-M. Hsieh, and B.-F. Wu, "Visionbased nighttime vehicle detection and range estimation for driver assistance," in Proc. IEEE Int. Conf. SMC, Oct. 2008, pp. 2988-2993.
101. S. Gormer, D. Muller, S. Hold, M. Meuter, and A. Kummert, "Vehicle recognition and TTC estimation at night based on spotlight pairing," in Proc. 12th Int. IEEE Conf. ITSC, Oct. 2009, pp. 1-6.
102. A. Fossati, P. Schönmann, and P. Fua, "Real-time vehicle tracking for driving assistance," Mach. Vis. Appl., vol. 22, no. 2, pp. 439-448, Mar. 2010.
103. R. O'Malley, E. Jones, and M. Glavin, "Rear-lamp vehicle detection and tracking in low-exposure color video for night conditions," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 2, pp. 453-462, Jun. 2010.
104. J. C. Rubio, J. Serrat, A. M. Lopez, and D. Ponsa, "Multiple-target tracking for intelligent headlights control," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 2, pp. 594-605, Jun. 2012.
105. X. Zhang and N. Zheng, "Vehicle detection under varying poses using conditional random fields," in Proc. 13th Int. IEEE Conf. ITSC, Sep. 2010, pp. 875-880.
106. P. Rybski, D. Huber, D. Morris, and R. Hoffman, "Visual classification of coarse vehicle orientation using histogram of oriented gradients features," in Proc. IEEE IV Symp., Jun. 2010, pp. 921-928.
107. M. Grinberg, F. Ohr, and J. Beyerer, "Feature-based probabilistic data association (FBPDA) for visual multi-target detection and tracking under occlusions and split and merge effects," in Proc. 12th IEEE Int. Conf. ITSC, Oct. 2009, pp. 1-8.
108. J. I. Woodlill, R. Buck, D. Jurasek, G. Gordon, and T. Brown, "3D vision: Developing an embedded stereo-vision system," Computer, vol. 40, no. 5, pp. 106-108, May 2007.
109. H. Hirschmuller, "Accurate and efficient stereo processing by semiglobal matching and mutual information," in Proc. IEEE Comput. Vis. Pattern Recog., 2005, pp. 807-814.
110. A. Geiger, M. Roser, and R. Urtasun, "Efficient large-scale stereo matching," in Proc. ACCV, Queenstown, New Zealand, Nov. 2010, pp. 25-38.
111. I. Haller, C. Pantilie, F. Oniga, and S. Nedevschi, "Real-time semi-global dense stereo solution with improved sub-pixel accuracy," in Proc. IEEE IV Symp., Jun. 2010, pp. 369-376.
112. F. Oniga and S. Nedevschi, "Processing dense stereo data using elevation maps: Road surface, traffic isle, and obstacle detection," IEEE Trans. Veh. Technol., vol. 59, no. 3, pp. 1172-1182, Mar. 2010.
113. R. Labayrade, D. Aubert, and J.-P. Tarel, "Real time obstacle detection on non flat road geometry through v-disparity representation," in Proc. IEEE Intell. Veh. Symp., Jun. 2002, pp. 646-651.
114. A. Vatavu, R. Danescu, and S. Nedevschi, "Real-time dynamic environment perception in driving scenarios using difference fronts," in Proc. IEEE IV Symp., Jun. 2012, pp. 717-722.
115. R. O. Duda and P. E. Hart, "Use of the Hough transformation to detect lines and curves in pictures," Commun. ACM, vol. 15, no. 1, pp. 11-15, Jan. 1972.
116. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981.
117. H. Lategahn, T. Graf, C. Hasberg, B. Kitt, and J. Effertz, "Mapping in dynamic environments using stereo vision," in Proc. IEEE IV Symp., Jun. 2011, pp. 150-156.
118. Y.-C. Lim, C.-H. Lee, S. Kwon, and J. Kim, "Event-driven track management method for robust multi-vehicle tracking," in Proc. IEEE IV Symp., Jun. 2011, pp. 189-194.
119. A. Broggi, C. Caraffi, R. Fedriga, and P. Grisleri, "Obstacle detection with stereo vision for off-road vehicle navigation," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2005, p. 65.
120. A. Broggi, A. Cappalunga, C. Caraffi, S. Cattani, S. Ghidoni, P. Grisleri, P.-P. Porta, M. Posterli, P. Zani, and J. Beck, "The passive sensing suite of the TerraMax autonomous vehicle," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 769-774.
121. A. Broggi, C. Caraffi, P. Porta, and P. Zani, "The single frame stereo vision system for reliable obstacle detection used during the 2005 DARPA Grand Challenge on TerraMax," in Proc. IEEE ITSC, Sep. 2006, pp. 745-752. (Pubitemid 351492258)
122. N. Ben Romdhane, M. Hammami, and H. Ben-Abdallah, "A generic obstacle detection method for collision avoidance," in Proc. IEEE IV Symp., Jun. 2011, pp. 491-496.
123. M. Perrollaz, A. Spalanzani, and D. Aubert, "Probabilistic representation of the uncertainty of stereo-vision and application to obstacle detection," in Proc. IEEE IV Symp., Jun. 2010, pp. 313-318.
124. S. Kubota, T. Nakano, and Y. Okamoto, "A global optimization algorithm for real-time on-board stereo obstacle detection systems," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 7-12.
125. A. Broggi, S. Cattani, E. Cardarelli, B. Kriel, M. McDaniel, and H. Chang, "Disparity space image's features analysis for error prediction of a stereo obstacle detector for heavy duty vehicles," in Proc. 14th Int. IEEE Conf. ITSC, Oct. 2011, pp. 80-86.
126. T. Kowsari, S. Beauchemin, and J. Cho, "Real-time vehicle detection and tracking using stereo vision and multi-view AdaBoost," in Proc. 14th Int. IEEE Conf. ITSC, Oct. 2011, pp. 1255-1260.
127. B. Kitt, B. Ranft, and H. Lategahn, "Detection and tracking of independently moving objects in urban environments," in Proc. 13th Int. IEEE Conf. ITSC, Sep. 2010, pp. 1396-1401.
128. A. Bak, S. Bouchafa, and D. Aubert, "Detection of independently moving objects through stereo vision and ego-motion extraction," in Proc. IEEE IV Symp., Jun. 2010, pp. 863-870.
129. W. van der Mark, J. van den Heuvel, and F. Groen, "Stereo based obstacle detection with uncertainty in rough terrain," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 1005-1012.
130. B. Barrois, S. Hristova, C. Wohler, F. Kummert, and C. Hermes, "3D pose estimation of vehicles using a stereo camera," in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 267-272.
131. C. Hermes, J. Einhaus, M. Hahn, C. Wöhler, and F. Kummert, "Vehicle tracking and motion prediction in complex urban scenarios," in Proc. IEEE IV Symp., Jun. 2010, pp. 26-33.
132. S. Lefebvre and S. Ambellouis, "Vehicle detection and tracking using mean shift segmentation on semi-dense disparity maps," in Proc. IEEE IV Symp., Jun. 2012, pp. 855-860.
133. C. Rabe, U. Franke, and S. Gehrig, "Fast detection of moving objects in complex scenarios," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 398-403.
134. P. Lenz, J. Ziegler, A. Geiger, and M. Roser, "Sparse scene flow segmentation for moving object detection in urban environments," in Proc. IEEE Intell. Veh. Symp., Baden-Baden, Germany, Jun. 2011, pp. 926-932.
135. Y.-C. Lim, C.-H. Lee, S. Kwon, and J.-H. Lee, "A fusion method of data association and virtual detection for minimizing track loss and false track," in Proc. IEEE IV Symp., Jun. 2010, pp. 301-306.
136. J. Morat, F. Devernay, and S. Cornou, "Tracking with stereo-vision system for low speed following applications," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 955-961.
137. S. Bota and S. Nedevschi, "Tracking multiple objects in urban traffic environments using dense stereo and optical flow," in Proc. 14th Int. IEEE Conf. ITSC, Oct. 2011, pp. 791-796.
138. G. Catalin and S. Nedevschi, "Object tracking from stereo sequences using particle filter," in Proc. 4th Int. Conf. ICCP, Aug. 2008, pp. 279-282.
139. A. Vatavu and S. Nedevschi, "Real-time modeling of dynamic environments in traffic scenarios using a stereo-vision system," in Proc. 15th Int. IEEE Conf. ITSC, 2012, pp. 722-727.
140. C. Pantilie and S. Nedevschi, "Real-time obstacle detection in complex scenarios using dense stereo vision and optical flow," in Proc. 13th Int. Conf. ITSC, Sep. 2010, pp. 439-444.
141. K. Y. Lee, J. W. Lee, and M. R. Cho, "Detection of road obstacles using dynamic programming for remapped stereo images to a top-view," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 765-770. (Pubitemid 44055221)
142. M. Perrollaz, J. Yoder, and C. Laugier, "Using obstacles and road pixels in the disparity-space computation of stereo-vision based occupancy grids," in Proc. 13th Int. IEEE Conf. ITSC, Sep. 2010, pp. 1147-1152.
143. Y. Zhu, D. Comaniciu, V. Ramesh, M. Pellkofer, and T. Koehler, "An integrated framework of vision-based vehicle detection with knowledge fusion," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 199-204. (Pubitemid 44055126)
144. X. Mei and H. Ling, "Robust visual tracking and vehicle classification via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 11, pp. 2259-2272, Nov. 2011.
145. A. Yilmaz, O. Javed, and M. Shah (2006, Dec.). Object tracking: A survey. ACM Comput. Surv. [Online]. 38(4), p. 13. Available: http://doi. acm.org/10.1145/1177352.1177355
146. C. Hilario, J. Collado, J. Armingol, and A. de la Escalera, "Visual perception and tracking of vehicles for driver assistance systems," in Proc. IEEE Intell. Veh. Symp., 2006, pp. 94-99. (Pubitemid 47129653)
147. S. Moqqaddem, Y. Ruichek, R. Touahni, and A. Sbihi, "A spectral clustering and Kalman filtering based objects detection and tracking using stereo vision with linear cameras," in Proc. IEEE IV Symp., Jun. 2011, pp. 902-907.
148. A. Barth and U. Franke, "Where will the oncoming vehicle be the next second?" in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 1068-1073.
149. G. Stein, Y. Gdalyahu, and A. Shashua, "Stereo-assist: Top-down stereo for driver assistance systems," in Proc. IEEE IV Symp., Jun. 2010, pp. 723-730.
150. G. Toulminet, M. Bertozzi, S. Mousset, A. Bensrhair, and A. Broggi, "Vehicle detection by means of stereo vision-based obstacles features extraction and monocular pattern analysis," IEEE Trans. Image Process., vol. 15, no. 8, pp. 2364-2375, Aug. 2006. (Pubitemid 44089108)
151. F. Rattei, P. Kindt, A. Probstl, and S. Chakraborty, "Shadow-based vehicle model refinement and tracking in advanced automotive driver assistance systems," in Proc. 9th IEEE Symp. ESTIMedia, Oct. 2011, pp. 46-55.
152. B. Alefs, "Embedded vehicle detection by boosting," in Proc. IEEE ITSC, Sep. 2006, pp. 536-541. (Pubitemid 351492223)
153. G. Gritsch, N. Donath, B. Kohn, and M. Litzenberger, "Night-time vehicle classification with an embedded, vision system," in Proc. 12th IEEE Int. Conf. ITSC, Oct. 2009, pp. 1-6.
154. J. Kaszubiak, M. Tornow, R. Kuhn, B. Michaelis, and C. Knoeppel, "Real-time vehicle and lane detection with embedded hardware," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 619-624. (Pubitemid 44055196)
155. G. Stein, E. Rushinek, G. Hayun, and A. Shashua, "A computer vision system on a chip: A case study from the automotive domain," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2005, p. 130.
156. S. Toral, F. Barrero, and M. Vargas, "Development of an embedded vision based vehicle detection system using an ARM video processor," in Proc. 11th Int. IEEE Conf. ITSC, Oct. 2008, pp. 292-297.
157. C. Banz, H. Blume, and P. Pirsch, "Real-time semi-global matching disparity estimation on the GPU," in Proc. IEEE ICCV Workshops, Nov. 2011, pp. 514-521.
158. F. Homm, N. Kaempchen, J. Ota, and D. Burschka, "Efficient occupancy grid computation on the GPU with lidar and radar for road boundary detection," in Proc. IEEE IV Symp., Jun. 2010, pp. 1006-1013.
159. X. Liu, Z. Sun, and H. He, "On-road vehicle detection fusing radar and vision," in Proc. IEEE ICVES, Jul. 2011, pp. 150-154.
160. R. Chavez-Garcia, J. Burlet, T.-D. Vu, and O. Aycard, "Frontal object perception using radar and mono-vision," in Proc. IEEE IV Symp., Jun. 2012, pp. 159-164.
161. M. Nishigaki, S. Rebhan, and N. Einecke, "Vision-based lateral position improvement of radar detections," in Proc. IEEE ITSC, 2012, pp. 90-97.
162. R. Schubert, G. Wanielik, and K. Schulze, "An analysis of synergy effects in an omnidirectional modular perception system," in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 54-59.
163. E. Richter, R. Schubert, and G. Wanielik, "Radar and vision based data fusion-Advanced filtering techniques for a multi object vehicle tracking system," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 120-125.
164. F. Garcia, P. Cerri, A. Broggi, A. de la Escalera, and J. M. Armingol, "Data fusion for overtaking vehicle detection based on radar and optical flow," in Proc. IEEE IV Symp., Jun. 2012, pp. 494-499.
165. G. Alessandretti, A. Broggi, and P. Cerri, "Vehicle and guard rail detection using radar and vision data fusion," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 1, pp. 95-105, Mar. 2007. (Pubitemid 46376157)
166. M. Bertozzi, L. Bombini, P. Cerri, P. Medici, P. Antonello, and M. Miglietta, "Obstacle detection and classification fusing radar and vision," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 608-613.
167. U. Kadow, G. Schneider, and A. Vukotich, "Radar-vision based vehicle recognition with evolutionary optimized and boosted features," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 749-754.
168. J. Fritsch, T. Michalke, A. Gepperth, S. Bone, F. Waibel, M. Kleinehagenbrock, J. Gayko, and C. Goerick, "Towards a human-like vision system for driver assistance," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 275-282.
169. F. Liu, J. Sparbert, and C. Stiller, "IMMPDA vehicle tracking system using asynchronous sensor fusion of radar and vision," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 168-173.
170. B. Alefs, D. Schreiber, and M. Clabian, "Hypothesis based vehicle detection for increased simplicity in multi-sensor ACC," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 261-266. (Pubitemid 44055136)
171. Y. Tan, F. Han, and F. Ibrahim, "A radar guided vision system for vehicle validation and vehicle motion characterization," in Proc. IEEE ITSC, Oct. 3-30, 2007, pp. 1059-1066.
172. Z. Ji, M. Luciw, J. Weng, and S. Zeng, "Incremental online object learning in a vehicular radar-vision fusion framework," IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 402-411, Jun. 2011.
173. T. Shen, G. Schamp, T. Cooprider, and F. Ibrahim, "Stereo vision based full-range object detection and tracking," in Proc. 14th Int. IEEE Conf. ITSC, Oct. 2011, pp. 925-930.
174. S. Wu, S. Decker, P. Chang, T. Camus, and J. Eledath, "Collision sensing by stereo vision and radar sensor fusion," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 4, pp. 606-614, Dec. 2009.
175. L. Huang and M. Barth, "Tightly-coupled lidar and computer vision integration for vehicle detection," in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 604-609.
176. C. Premebida, G. Monteiro, U. Nunes, and P. Peixoto, "A lidar and vision-based approach for pedestrian and vehicle detection and tracking," in Proc. IEEE ITSC, Oct. 3-30, 2007, pp. 1044-1049.
177. S. Matzka, A. Wallace, and Y. Petillot, "Efficient resource allocation for attentive automotive vision systems," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 2, pp. 859-872, Jun. 2012.
178. S. Rodriguez, F. V. Freandmont, P. Bonnifait, and V. Cherfaoui, "Visual confirmation of mobile objects tracked by a multi-layer lidar," in Proc. 13th Int. IEEE Conf. ITSC, Sep. 2010, pp. 849-854.
179. Q. Baig, O. Aycard, T. D. Vu, and T. Fraichard, "Fusion between laser and stereo vision data for moving objects tracking in intersection like scenario," in Proc. IEEE IV Symp., Jun. 2011, pp. 362-367.
180. O. Aycard, Q. Baig, S. Bota, F. Nashashibi, S. Nedevschi, C. Pantilie, M. Parent, P. Resende, and T.-D. Vu, "Intersection safety using lidar and stereo vision sensors," in Proc. IEEE IV Symp., Jun. 2011, pp. 863-869.
181. M. Haberjahn and M. Junghans, "Vehicle environment detection by a combined low and mid level fusion of a laser scanner and stereo vision," in Proc. 14th Int. IEEE Conf. ITSC, Oct. 2011, pp. 1634-1639.
182. W. Yao, H. Zhao, F. Davoine, and H. Zha, "Learning lane change trajectories from on-road driving data," in Proc. IEEE IV Symp., Jun. 2012, pp. 885-890.
183. A. Doshi and M. Trivedi, "On the roles of eye gaze and head dynamics in predicting driver's intent to change lanes," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 3, pp. 453-462, Sep. 2009.
184. C. Hermes, C. Wohler, K. Schenk, and F. Kummert, "Long-term vehicle motion prediction," in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 652-657.
185. J. Wiest, M. Hoffken, U. Kresel, and K. Dietmayer, "Probabilistic trajectory prediction with Gaussian mixture models," in Proc. IEEE IV Symp., Jun. 2012, pp. 141-146.
186. T. Gindele, S. Brechtel, and R. Dillmann, "A probabilistic model for estimating driver behaviors and vehicle trajectories in traffic environments," in Proc. 13th Int. IEEE Conf. ITSC, Sep. 2010, pp. 1625-1631.
187. E. Kafer, C. Hermes, C. Woandhler, F. Kummert, and H. Ritter, "Recognition and prediction of situations in urban traffic scenarios," in Proc. 20th ICPR, Aug. 2010, pp. 4234-4237.
188. H.-T. Lin, C.-J. Lin, and R. C. Weng, "A note on Platt's probabilistic outputs for support vector machines," Mach. Learn., vol. 68, no. 3, pp. 267-276, Oct. 2007. (Pubitemid 47312490)
189. A. Joshi, F. Porikli, and N. Papanikolopoulos, "Scalable active learning for multiclass image classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2259-2273, Nov. 2012.
190. A. Westenberger, B. Duraisamy, M. Munz, M. Muntzinger, M. Fritzsche, and K. Dietmayer, "Impact of out-of-sequencemeasurements on the joint integrated probabilistic data association filter for vehicle safety systems," in Proc. IEEE IV Symp., Jun. 2012, pp. 438-443.
191. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc., vol. 39, no. 1, pp. 1-38, 1977.
192. A. Doshi, B. Morris, and M. Trivedi, "On-road prediction of driver's intent with multimodal sensory cues," IEEE Pervasive Comput., vol. 10, no. 3, pp. 22-34, Jul.-Sep. 2011.
193. S. Calderara, A. Prati, and R. Cucchiara, "Mixtures of von Mises distributions for people trajectory shape analysis," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 4, pp. 457-471, Apr. 2011.
194. Caltech computational vision Caltech cars 1999. [Online]. Available: http://www.vision.caltech.edu/html-files/archive.html
195. Caltech computational vision Caltech cars 2001. [Online]. Available: http://www.vision.caltech.edu/html-files/archive.html
196. R. Kasturi, D. Goldgof, P. Soundararajan, V. Manohar, J. Garofolo, R. Bowers, M. Boonstra, V. Korzhova, and J. Zhang, "Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 319-336, Feb. 2009.
197. Performance evaluation of tracking and surveillance, PETS 2001. [Online]. Available: http://www.cvg.cs.rdg.ac.uk/PETS2001/pets2001-dataset.html
198. A. Geiger, P. Lenz, and R. Urtasun, "Are we ready for autonomous driving?" in Proc. CVPR, Providence, USA, Jun. 2012, pp. 3354-3361.