Video-based lane estimation and tracking for driver assistance: Survey, system, and evaluation

IEEE Transactions on Intelligent Transportation Systems

Volumn 7, Issue 1, 2006, Pages 20-37

  McCall, Joel C ^a   Trivedi, Mohan M ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UCSD ^*  (United States)

Author keywords

Active safety systems; Intelligent vehicles; Lane detection; Lane departure warning; Machine vision; Performance metrics

Indexed keywords

ACTIVE SAFETY SYSTEMS; LANE DETECTION; LANE-DEPARTURE WARNING; PERFORMANCE METRICS;

AUTOMOBILE DRIVERS; GROUND VEHICLE PARTS AND EQUIPMENT; HIGHWAY MARKINGS; TRACKING (POSITION);

INTELLIGENT VEHICLE HIGHWAY SYSTEMS;

EID: 33644981417     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2006.869595     Document Type: Review

References (45)

1. J. McCall and M. M. Trivedi, "Visual context capture and analysis for driver attention monitoring," in Proc. IEEE Conf. Intelligent Transportation Systems, Washington, DC, Oct. 2004, pp. 332-337.
2. D. D. Salvucci, "Inferring driver intent: A case study in lane-change detection," in Proc. Human Factors Ergonomics Society 48th Annu. Meeting, New Orleans, LA, 2004, pp. 2228-2231.
3. N. Kuge, T. Yamamura, and O. Shimoyama, A Driver Behavior Recognition Method Based on a Driver Model Framework. Warrendale, PA: Soc. Automot. Eng., 1998.
4. W. Kwon and S. Lee, "Performance evaluation of decision making strategies for an embedded lane departure warning system," J. Robot. Syst., vol. 19, no. 10, pp. 499-509, Sep. 2002.
5. F. Heimes and H.-H. Nagel, "Towards active machine-vision-based driver assistance for urban areas," Int. J. Comput. Vis., vol. 50, no. 1, pp. 5-34, Oct. 2002.
6. W. Enkelmann, "Video-based driver assistance - From basic functions to applications," Int. J. Comput. Vis., vol. 45, no. 3, pp. 201-221, Dec. 2001.
7. The Johns Hopkins University Applied Physics Laboratory, "Survey of on-board technologies applicable to commercial vehicle operations," U.S. Dept. Transportation, Washington, D.C., Tech. Rep. 1998. [Online], Available: http://cvisn.fmcsa.dot.gov/downdocs/cvisndocs/1_general/onboard_tech_survey.pdf
8. J. McCall, D. Wipf, M. M. Trivedi, and B. Rao, "Lane change intent analysis using robust operators and sparse Bayesian learning," in Proc. IEEE Int. Workshop Machine Vision Intelligent Vehicles/IEEE Int. Conf. Computer Vision and Pattern Recognition, San Diego, CA, Jun. 2005, pp. 59-66.
9. J. McCall, O. Achler, M. M. Trivedi, P. Fastrez, D. Forster, J. B. Haue, J. Hollan, and E. Boer, "A collaborative approach for human-centered driver assistance systems," in Proc. 7th IEEE Conf. Intelligent Transportation Systems, Washington, DC, Oct. 2004, pp. 663-667.
10. H. Godthelp, P. Milgram, and G. J. Blaauw, "The development of a time-related measure to describe driving strategy," Hum. Factors, vol. 26, no. 3, pp. 257-268, 1984.
11. K. Kluge, "Performance evaluation of vision-based lane sensing: Some preliminary tools, metrics, and results," in Proc. IEEE Intelligent Transportation Systems Conf. Boston, MA, 1997, pp. 723-728.
12. C. Taylor, J. Košecká, R. Blasi, and J. Malik, "A comparative study of vision-based lateral control strategies for autonomous highway driving," Int. J. Robot. Res., vol. 18, no. 5, pp. 442-453, May 1999.
13. B. Ma, S. Lakshmanan, and A. O. Hero, "Simultaneous detection of lane and pavement boundaries using model-based multisensor fusion," IEEE Trans. Intell. Transp. Syst., vol. 1, no. 5, pp. 135-147, Sep. 2000.
14. V. Kastrinaki, M. Zervakis, and K. Kalaitzakis, "A survey of video processing techniques for traffic applications," Image Vis. Comput., vol. 21, no. 4, pp. 359-381, Apr. 2003.
15. M. Bertozzi, A. Broggi, M. Cellario, A. Fascioli, P. Lombardi, and M. Porta, "Artificial vision in road vehicles," Proc. IEEE - Special Issue on Technology and Tools for Visual Perception, vol. 90, no. 7, pp. 1258-1271, Jul. 2002.
16. E. D. Dickmanns and B. D. Mysliwetz, "Recursive 3-D road and relative ego-state recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 199-213, Feb. 1992.
17. Y. Wang, E. Teoh, and D. Shen, "Lane detection and tracking using B-snake," Image Vis. Comput., vol. 22, no. 4, pp. 269-280, Apr. 2004.
18. J. Goldbeck, B. Huertgen, S. Ernst, and L. Kelch, "Lane following combining vision and DGPS," Image Vis. Comput., vol. 18, no. 5, pp. 425-433, Apr. 2000.
19. D. Pomerleau, "Neural network vision for robot driving," in The Handbook of Brain Theory and Neural Networks, M. Arbib, Ed. Cambridge, MA: MIT Press, 1995.
20. M. Bertozzi and A. Broggi, "GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection," IEEE Trans. Image Process., vol. 7, no. 1, pp. 62-81, Jan. 1998.
21. K. Kluge and S. Lakshmanan, "A deformable template approach to lane detection," in Proc. IEEE Intelligent Vehicles Symp., Detroit, MI, 1995, pp. 54-59.
22. S. Nedevschi, R. Schmidt, T. Graf, R. Danescu, D. Frentiu, T. Marita, F. Oniga, and C. Pocol, "3D lane detection system based on Stereovision," in Proc. IEEE Intelligent Transportation Systems Conf. Washington, DC, Oct. 2004, pp. 161-166.
23. Y. Otsuka, S. Muramatsu, H. Takenaga, Y. Kobayashi, and T. Monj, "Multitype lane markers recognition using local edge direction," in Proc. IEEE Intelligent Vehicles Symp., Versailles, France, Jun. 2002, vol. 2, pp. 604-609.
24. C. Kreucher and S. Lakshmanan, "LANA: A lane extraction algorithm that uses frequency domain features," IEEE Trans. Robot. Autom., vol. 15, no. 2, pp. 343-350, Apr. 1999.
25. D. Pomerleau and T. Jochem, "Rapidly adapting machine vision for automated vehicle steering," IEEE Expert - Special Issue on Intelligent System and Their Applications, vol. 11, no. 2, pp. 19-27, Apr. 1996.
26. Q. Li, N. Zheng, and H. Cheng, "Springrobot: A prototype autonomous vehicle and its algorithms for lane detection," IEEE Trans. Intell. Transp. Syst., vol. 5, no. 4, pp. 300-308, Dec. 2004.
27. J. B. McDonald, "Detecting and tracking road markings using the Hough transform," in Proc. Irish Machine Vision and Image Processing Conf., Maynooth, Ireland, 2001, pp. 1-9.
28. D.-J. Kang and M.-H. Jung, "Road lane segmentation using dynamic programming for active safety vehicles," Pattern Recognit. Lett., vol. 24, no. 16, pp. 3177-3185, Dec. 2003.
29. N. Apostoloff and A. Zelinsky, "Robust vision based lane tracking using multiple cues and particle filtering," in Proc. IEEE Intelligent Vehicles Symp., Columbus, OH, Jun. 2003, pp. 558-563.
30. B. Southall and C. J. Taylor, "Stochastic road shape estimation," in Proc. Int. Conf. Computer Vision, Vancouver, BC, Canada, 2001, pp. 205-212.
31. S. Lee and W. Kwon, "Robust lane keeping from novel sensor fusion," in Proc. IEEE Int. Conf. Robotics and Automation, Seoul, Korea, 2001, vol. 4, pp. 3704-3709.
32. F. Chausse, R. Aufrere, and R. Chapuis, "Recovering the 3D shape of a road by on-board monocular vision," in Proc. 15th Int. Conf. Pattern Recognition, Barcelona, Spain, 2000, pp. 325-328.
33. K. Kluge and C. Thorpe, "The YARF system for vision-based road following," Math. Comput. Model., vol. 22, no. 4-7, pp. 213-233, Aug. 1995.
34. C. Kreucher, S. Lakshmanan, and K. Kluge, "A driver warning system based on the LOIS lane detection algorithm," in Proc. IEEE Int. Conf. Intelligent Vehicles, Stuttgart, Germany, Oct. 1998, pp. 17-22.
35. R. Risack, N. Mohler, and W. Enkelmann, "A video-based lane keeping assistant," in Proc. IEEE Intelligent Vehicles Symp., Dearborn, MI, Oct. 2000, pp. 506-511.
36. S. Baluja, "Evolution of an artificial neural network based autonomous land vehicle controller," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 26, no. 3, pp. 450-463, Jun. 1996.
37. J. W. Lee, "A machine vision system for lane-departure detection," Comput. Vis. Image Underst., vol. 86, no. 1, pp. 52-78, Apr. 2002.
38. J. W. Lee, C.-D. Kee, and U. K. Yi, "A new approach for lane departure identification," in Proc. IEEE Intelligent Vehicles Symp., Columbus, OH, 2003, pp. 100-105.
39. W. T. Freeman and E. H. Adelson, "The design and use of steerable filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 9, pp. 891-906, Sep. 1991.
40. S. Szabo, K. Murphy, and M. Juberts, "The AUTONAV/DOT project: Baseline measurement system for evaluation of roadway departure warning systems," National Institute of Standards and Technology, Gaithersburg, MD, NISTTR 6300, 1999.
41. J. McCall, O. Achler, and M. M. Trivedi, "Design of an instrumented vehicle testbed for developing human centered driver support system," in Proc. IEEE Intelligent Vehicles Symp., Parma, Italy, Jun. 2004, pp. 483-488.
42. J.-Y. Bouguet, Camera Calibration Toolbox for Matlab. [Online], Available: http://www.vision.caltech.edu/bouguetj/calib_doc/
43. K. Huang, M. M. Trivedi, and T. Gandhi, "Driver's view and vehicle surround estimation using omnidirectional video stream," in Proc. IEEE Intelligent Vehicles Symp., Columbus, OH, Sep. 2003, pp. 444-449.
44. T. Gandhi and M. M. Trivedi, "Parametric ego-motion estimation for vehicle surround analysis using omni-directional camera," Mach. Vis. Appl., vol. 16, no. 2, pp. 85-89, Feb. 2005.
45. M. M. Trivedi, S. Y. Cheng, E. M. C. Childers, and S. J. Krotosky, "Occupant posture analysis with stereo and thermal infrared video: Algorithms and experimental evaluation," IEEE Trans. Veh. Technol., vol. 53, no. 6, pp. 1698-1712, Nov. 2004.