Integrated lane and vehicle detection, localization, and tracking: A synergistic approach

IEEE Transactions on Intelligent Transportation Systems

Volumn 14, Issue 2, 2013, Pages 906-917

  Sivaraman, Sayanan ^a   Trivedi, Mohan Manubhai ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Active safety; computer vision; driver assistance; intelligent vehicles; lane departure; lane tracking; vehicle tracking

Indexed keywords

ACTIVE SAFETY; DRIVER ASSISTANCE; FRAMES PER SECONDS; INTEGRATED SYSTEMS; LANE AND VEHICLE DETECTION; LANE DEPARTURE; LANE TRACKING; SPECIFIC HARDWARE;

AUTOMOBILE DRIVERS; COMPUTER VISION; INTELLIGENT VEHICLE HIGHWAY SYSTEMS;

TRACKING (POSITION);

EID: 84878689132     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2013.2246835     Document Type: Article

References (46)

1. World Report on Road Traffic Injury Prevention, World Health Org., Geneva, Switzerland, 2009. [Online]. Available: http://www.who. int/violence-injury
2. A. Doshi, S. Y. Cheng, and M. Trivedi, "A novel active heads-up display for driver assistance, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 1, pp. 85-93, Feb. 2009.
3. E. Murphy-Chutorian and M. Trivedi, "Head pose estimation and augmented reality tracking: An integrated system and evaluation for monitoring driver awareness, " IEEE Trans. Intell. Transp. Syst., vol. 11, no. 2, pp. 300-311, Jun. 2010.
4. J. McCall and M. Trivedi, "Video-based lane estimation and tracking for driver assistance: Survey, system, and evaluation, " IEEE Trans. Intell. Transp. Syst., vol. 7, no. 1, pp. 20-37, Mar. 2006.
5. H. Gomez-Moreno, S. Maldonado-Bascon, P. Gil-Jimenez, and S. Lafuente-Arroyo, "Goal evaluation of segmentation algorithms for traffic sign recognition, " IEEE Trans. Intell. Transp. Syst., vol. 11, no. 4, pp. 917-930, Dec. 2010.
6. A. Doshi and M. Trivedi, "On the roles of eye gaze and head dynamics in predicting driver's intent to change lanes, " IEEE Trans. Intell. Transp. Syst., vol. 10, no. 3, pp. 453-462, Sep. 2009.
7. J. McCall and M. Trivedi, "Driver behavior and situation aware brake assistance for intelligent vehicles, " Proc. IEEE, vol. 95, no. 2, pp. 374-387, Feb. 2007.
8. S. Cheng andM. Trivedi, "Turn-intent analysis using body pose for intelligent driver assistance, " IEEE Pervasive Comput., vol. 5, no. 4, pp. 28-37, Oct.-Dec. 2006.
9. S. Cheng and M. Trivedi, "Lane tracking with omnidirectional cameras: Algorithms and evaluation, " EURASIP J. Embedded Syst., vol. 2007, no. 1, p. 5, Jan. 2007.
10. S. Krotosky and M. Trivedi, "On color-, infrared-, and multimodal-stereo approaches to pedestrian detection, " IEEE Trans. Intell. Transp. Syst., vol. 8, no. 4, pp. 619-629, Dec. 2007. (Pubitemid 350231639)
11. A. Broggi, P. Cerri, S. Ghidoni, P. Grisleri, and H. G. Jung, "A new approach to urban pedestrian detection for automatic braking, " IEEE Trans. Intell. Transp. Syst., vol. 10, no. 4, pp. 594-605, Dec. 2009.
12. L. Oliveira, U. Nunes, and P. Peixoto, "On exploration of classifier ensemble synergism in pedestrian detection, " IEEE Trans. Intell. Transp. Syst., vol. 11, no. 1, pp. 16-27, Mar. 2010.
13. Z. Sun, G. Bebis, and R. Miller, "Monocular precrash vehicle detection: Features and classifiers, " IEEE Trans. Image Process., vol. 15, no. 7, pp. 2019-2034, Jul. 2006. (Pubitemid 43985079)
14. S. Sivaraman and M. Trivedi, "A general active-learning framework for on-road vehicle recognition and tracking, " IEEE Trans. Intell. Transp. Syst., vol. 11, no. 2, pp. 267-276, Jun. 2010.
15. R. O'Malley, E. Jones, and M. Glavin, "Rear-lamp vehicle detection and tracking in low-exposure color video for night conditions, " IEEE Trans. Intell. Transp. Syst., vol. 11, no. 2, pp. 453-462, Jun. 2010.
16. T. Gandhi and M. Trivedi, "Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera, " Mach. Vis. Appl., vol. 16, no. 2, pp. 85-95, Feb. 2005. (Pubitemid 40536232)
17. S. Sivaraman and M. Trivedi, "Real-time vehicle detection using parts at intersections, " in Proc. 15th Int. IEEE ITSC, Sep. 2012, pp. 1519-1524.
18. M. M. Trivedi, T. Gandhi, and J. McCall, "Looking-in and looking-out of a vehicle: Computer-vision-based enhanced vehicle safety, " IEEE Trans. Intell. Transp. Syst., vol. 8, no. 1, pp. 108-120, Mar. 2007. (Pubitemid 46376159)
19. M. Bertozzi and A. Broggi, "GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection, " IEEE Trans. Image Process., vol. 7, no. 1, pp. 62-81, Jan. 1998. (Pubitemid 128745323)
20. M. Meuter, S. Muller-Schneiders, A. Mika, S. Hold, C. Nunn, and A. Kummert, "A novel approach to lane detection and tracking, " in Proc. 12th Int. IEEE ITSC, Oct. 2009, pp. 1-6.
21. T. Veit, J.-P. Tarel, P. Nicolle, and P. Charbonnier, "Evaluation of road marking feature extraction, " in Proc. 11th Int. IEEE Conf. ITSC, Oct. 2008, pp. 174-181.
22. J. McCall, D. Wipf, M. Trivedi, and B. Rao, "Lane change intent analysis using robust operators and sparse Bayesian learning, " IEEE Trans. Intell. Transp. Syst., vol. 8, no. 3, pp. 431-440, Sep. 2007. (Pubitemid 47383466)
23. A. López, J. Serrat, C. Canero, and F. Lumbreras, "Robust lane lines detection and quantitative assessment, " in Proc. Pattern Recognit. Image Anal., 2007, pp. 274-281.
24. Z. Kim, "Robust lane detection and tracking in challenging scenarios, " IEEE Trans. Intell. Transp. Syst., vol. 9, no. 1, pp. 16-26, Mar. 2008. (Pubitemid 351337427)
25. H. Loose, U. Franke, and C. Stiller, "Kalman particle filter for lane recognition on rural roads, " in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 60-65.
26. M. Isard and A. Blake, "Condensation-Conditional density propagation for visual tracking, " Int. J. Comput. Vis., vol. 29, no. 1, pp. 5-28, Aug. 1998. (Pubitemid 128523364)
27. R. Danescu and S. Nedevschi, "Probabilistic lane tracking in difficult road scenarios using stereovision, " IEEE Trans. Intell. Transp. Syst., vol. 10, no. 2, pp. 272-282, Jun. 2009.
28. S. Sivaraman and M. Trivedi, "Improved vision-based lane tracker performance using vehicle localization, " in Proc. IEEE IV Symp., Jun. 2010, pp. 676-681.
29. A. Jazayeri, H. Cai, J. Y. Zheng, and M. Tuceryan, "Vehicle detection and tracking in car video based on motion model, " IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 583-595, Jun. 2011.
30. A. Kembhavi, D. Harwood, and L. Davis, "Vehicle detection using partial least squares, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 6, pp. 1250-1265, Jun. 2011.
31. A. Takeuchi, S. Mita, and D. McAllester, "On-road vehicle tracking using deformable object model and particle filter with integrated likelihoods, " in Proc. IEEE IV Symp., Jun. 2010, pp. 1014-1021.
32. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features, " in Proc. IEEE Comput. Soc. Conf. CVPR, 2001, vol. 1, pp. I-511-I-518. (Pubitemid 34063813)
33. D. Ponsa, A. Lopez, F. Lumbreras, J. Serrat, and T. Graf, "3D vehicle sensor based on monocular vision, " in Proc. IEEE Intell. Transp. Syst., Sep. 2005, pp. 1096-1101. (Pubitemid 44250354)
34. A. Haselhoff and A. Kummert, "An evolutionary optimized vehicle tracker in collaboration with a detection system, " in Proc. 12th Int. IEEE ITSC, Oct. 2009, pp. 1-6.
35. Y. Freund, R. Schapire, and N. Abe, "A short introduction to boosting, " J. Jpn. Soc. Artif. Intell., vol. 14, no. 5, pp. 771-780, Sep. 1999.
36. A. Haselhoff and A. Kummert, "A vehicle detection system based on Haar and Triangle features, " in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 261-266.
37. Y.-M. Chan, S.-S. Huang, L.-C. Fu, and P.-Y. Hsiao, "Vehicle detection under various lighting conditions by incorporating particle filter, " in Proc. IEEE ITSC, Sep. 30/Oct., 3, 2007, pp. 534-539.
38. S.-Y. Hung, Y.-M. Chan, B.-F. Lin, L.-C. Fu, P.-Y. Hsiao, and S.-S. Huang, "Tracking and detection of lane and vehicle integrating lane and vehicle information using PDAF tracking model, " in Proc. 12th Int. IEEE ITSC, Oct. 2009, pp. 1-6.
39. J. K. S. S. S. Y. Ma and S. Soatto, An Invitation to 3-D Vision: From Images to Geometric Models. New York, NY, USA: Springer-Verlag, 2004.
40. M. Fischler and R. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography, " Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981. (Pubitemid 12444102)
41. S. Sivaraman and M. Trivedi, "Active learning for on-road vehicle detection: A comparative study, " Mach. Vis. Appl., vol. 16, pp. 1-13, Dec. 2011.
42. M. Enzweiler and D. Gavrila, "A mixed generative-discriminative framework for pedestrian classification, " in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
43. L. A. R. J. Elliot and J. B. Moore, Hidden Markov Models: Estimation and Control. New York, NY, USA: Springer-Verlag, 1995.
44. B. Morris and M. Trivedi, "Unsupervised learning of motion patterns of rear surrounding vehicles, " in Proc. IEEE ICVES, Nov. 2009, pp. 80-85.
45. S. Sivaraman, B. Morris, andM. Trivedi, "Learning multi-lane trajectories using vehicle-based vision, " in Proc. IEEE ICCV Workshops, Nov. 2011, pp. 2070-2076.
46. S. Sivaraman and M. Trivedi, "Combining monocular and stereo-vision for real-time vehicle ranging and tracking on multilane highways, " in Proc. 14th Int. IEEE ITSC, Oct. 2011, pp. 1249-1254.