A survey of video processing techniques for traffic applications

Image and Vision Computing

Volumn 21, Issue 4, 2003, Pages 359-381

  Kastrinaki, V ^a   Zervakis, M ^a   Kalaitzakis, K ^a  

^a TECHNICAL UNIVERSITY OF CRETE   (Greece)

Author keywords

Automatic lane finding; Automatic vehicle guidance; Dynamic scene analysis; Object detection; Traffic monitoring

Indexed keywords

ALGORITHMS; KALMAN FILTERING; OBJECT RECOGNITION; VIDEO SIGNAL PROCESSING;

TRAFFIC MONITORING;

IMAGE ANALYSIS;

EID: 0037381588     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0262-8856(03)00004-0     Document Type: Article

References (128)

1. Stewart B.D., Reading I., Thomson M.S., Binnie T.D., Dickinson K.W., Wan C.L. Adaptive lane finding in road traffic image analysis. Proceedings of Seventh International Conference on Road Traffic Monitoring and Control, IEE, London. 1994.
2. Xie M., Trassoudaine L., Alizon J., Gallice J. Road obstacle detection and tracking by an active and intelligent sensing strategy. Machine Vision and Applications. 7:1994;165-177.
3. Broggi A., Berte S. Vision-based road detection in automotive systems: a real-time expectation-driven approach. Journal of Artificial Intelligence Research. 3:1995;325-348.
4. Bertozzi M., Broggi A. GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Transaction Image Processing. 7:(1):1998.
5. Wan C.L., Dickinson K.W., Binnie T.D. A cost-effective image sensor system for transport applications utilising a miniature CMOS single chip camera. IFAC Transportation systems, Tianjin, Proceedings. 1994.
6. Bertozzi M., Broggi A. Vision-based vehicle guidance. Computer Vision. 30:(7):1997.
7. Weber J., Koller D., Luong Q.-T., Malik J. New results in stereo-based automatic vehicle guidance. Proceedings of IEEE Intelligent Vehicles 95, Detroit. 1995;530-535.
8. Luong Q.-T., Weber J., Koller D., Malik J. An integrated stereo-based approach to automatic vehicle guidance. Proceedings of the Fifth ICCV, Boston. 1995;12-20.
9. Soumelidis A., Kovacs G., Bokor J., Gaspar P., Palkovics L., Gianone L. Automatic detection of the lane departure of vehicles. IFAC Transportation Systems Chania, Greece. 1997.
10. LeBlanc D.J., Johnson G.E., Venhovens P.J.T., Gerber G., DeSonia R., Ervin R., Lin C.F., Ulsoy A.G., Pilutti T.E. CAPC: a road-departure prevention system. IEEE Control Systems. December:1996.
11. Thorpe C., Hebert M.H., Kanade T., Shafer S.A. Vision and navigation for the carnegie-mellon navlab. IEEE Transactions on Pattern Analysis and Machine Intelligence. 10:(3):1988.
12. Turk M.A., Morgenthaler D.G., Gremban K.D., Marra M. VITS - a vision system for autonomous land vehicle navigation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 10:(3):1988.
13. Buluswar S.D., Draper B.A. Color machine vision for autonomous vehicles. Engineering Applications of Artificial Intelligence. 11:1998;245-256.
14. Betke M., Haritaoglu E., Davis L.S. Real-time multiple vehicle detection and tracking from a moving vehicle. Machine Vision and Applications. 12:2000;69-83.
15. Zhang J., Nagel H. Texture-based segmentation of road images. Proceedings of IEEE, Symposium on Intelligent Vehicles 94. 1994;IEEE Press, Piscataway, NJ.
16. Badenas J., Bober M., Pla F. Segmenting traffic scenes from grey level and motion information. Pattern Analysis and Applications. 4:2001;28-38.
17. Kluge K., Johnson G. Statistical characterization of the visual characteristics of painted lane markings. Proceedings of IEEE Intelligent Vehicles 95, Detroit. 1995;488-493.
18. Kasprzak W. An iconic classification scheme for video-based traffic sensor tasks. Skarbek W. CAIP 2001. 2001;725-732 Springer, Berlin.
19. Enkelmann W., Struck G., Geisler J. ROMA - a system for model-based analysis of road markings. Proceedings of IEEE Intelligent Vehicles 95, Detroit. 1995;356-360.
20. Nooralahiyan A.Y., Kirby H.R. Vehicle classification by acoustic signature. Mathematical and Computer Modeling. 27:(9-11):1998.
21. Broggi A. Parallel and local feature extraction: a real-time approach to road boundary detection. IEEE Transaction on Image Processing. 4:(2):1995;217-223.
22. Beucher S., Bilodeau M. Road segmentation and obstacle detection by a fast watershed transform. Proceedings of IEEE Intelligent Vehicles 94, Paris, France. October:1994;296-301.
23. Yu X., Beucher S., Bilodeu M. Road tracking, lane segmentation and obstacle recognition by mathematical morphology. Proceedings of IEEE Intelligent Vehicles 92. 1992;166-170.
24. Kreucher C., Lakshmanan S. LANA: a lane extraction algorithm that uses frequency domain features. IEEE Transactions on Robotics and Automation. 15:(2):1999.
25. Yuille A.L., Coughlan J.M. Fundamental limits of Bayesian inference: order parameters and phase transitions for road tracking. IEEE Pattern Analysis and Machine Intelligence. 22:(2):2000;160-173. February.
26. Wang Y., Shen D., Teoh E.K. Lane detection using spline model. Pattern Recognition Letters. 21:1994;677-689.
27. Kluge K., Lakshmanan S. A deformable-template approach to lane detection. IEEE Proceedings of Intelligent Vehicles 95. 1995;54-59.
28. Taylor C.J., Malik J., Weber J. A real time approach to stereopsis and lane-finding. IFAC Transportation Systems Chania, Greece. 1997.
29. Geman D., Jedynak B. An active testing model for tracking roads in satellite images. IEEE Pattern Analysis and Machine Intelligence. 18:(1):1996;1-14.
30. E.D. Dickmanns, Vehicle Guidance By Computer Vision, Papageorgiou Markos (Ed.), Concise Encyclopedia of Traffic and Transportation Systems.
31. Dickmanns E.D., Mysliwetz B., Christians T. An integrated spatio-temporal approach to automatic visual guidance of autonomous vehicles. IEEE Transactions on Systems, Man, and Cybernetics. 20:(6):1990.
32. Michalopoulos P.G., Panda D.P. Derivation of advanced traffic parameters through video imaging. IFAC Transportation Systems Chania, Greece. 1997.
33. Morgenthaler D.G., Hennessy S.J., DeMenthon D. Range-video fusion and comparison of inverse perspective algorithms in static images. IEEE Transactions on Systems Man and Cybernetics. 20:1990;1301-1312.
34. Dickmanns E.D., Mysliwetz B.D. Recursive 3D road and relative ego-state recognition. IEEE Pattern Analysis and Machine Intelligence. 14:(2):1992;199-213.
35. M. Papageorgiou, Video sensors, Papageorgiou Markos (Ed.), Concise Encyclopedia of traffic and transportation systems, pp. 610-615.
36. Enkelmann W. Obstacle detection by evaluation of optical flow field from image sequences. Proceedings of European Conference on Computer Vision, Antibes, France. 427:1990;134-138.
37. Ross B. A practical stereo vision system. Proceedings of International Conference on Computer Vision and Pattern Recognition, Seattle, WA. 1993;148-153.
38. Bertozzi M., Broggi A., Castelluccio S. A real-time oriented system for vehicle detection. Journal of System Architecture. 43:1997;317-325.
39. Thomanek F., Dickmanns E.D., Dickmanns D. Multiple object recognition and scene interpretation for autonomous road vehicle guidance. Proceedings of IEEE Intelligent Vehicles 94, Paris, France. 1994;231-236.
40. Foresti G.L., Murino V., Regazzoni C. Vehicle recognition and tracking from road image sequences. IEEE Transactions on Vehicular Technology. 48:(1):1999;301-317.
41. Foresti G.L., Murino V., Regazzoni C.S., Vernazza G. A distributed approach to 3D road scene recognition. IEEE Transactions on Vehicular Technology. 43:(2):1994.
42. Nagel H.-H., Enkelmann W. An investigation of smoothness constrains for the estimation of displacement vector fields from image sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1986;565-593.
43. Tan T.N., Sullivan G.D., Baker K.D. Model-based location and recognition of road vehicles. International Journal of Computer Vision. 27:(1):1998;5-25.
44. Koller D., Daniilidis K., Nagel H. Model-based object tracking in monocular image sequences of road traffic scenes. International Journal Computer Vision. 10:1993;257-281.
45. Dickmanns E.D., Graefe V. Dynamic monocular machine vision. Machine vision and applications. 1:1988;223-240.
46. Park Y. Shape-resolving local thresholding for object detection. Pattern Recognition Letters. 22:2001;883-890.
47. Blosseville J.M., Krafft C., Lenoir F., Motyka V., Beucher S. TITAN: new traffic measurements by image processing. IFAC Transportation systems, Tianjin, Proceedings. 1994.
48. Won Y., Nam J., Lee B.-H. Image pattern recognition in natural environment using morphological feature extraction. Ferri F.J. SSPR&SPR 2000. 2001;806-815 Springer, Berlin.
49. Shimizu K., Shigehara N. Image processing system used cameras for vehicle surveillance. IEE Second International Conference on Road Traffic Monitoring, Conference Publication Number 299. February:1989;61-65.
50. Fathy M., Siyal M.Y. An image detection technique based on morphological edge detection and background differencing for real-time traffic analysis. Pattern Recognition Letters. 16:1995;1321-1330.
51. Hoose N. Computer vision as a traffic surveillance tool. IFAC Transportation systems, Tianjin, Proceedings. 1994.
52. Li X., Liu Z.-Q., Leung K.-M. Detection of vehicles from traffic scenes using fuzzy integrals. Pattern Recognition. 35:2002;967-980.
53. Moon H., Chellapa R., Rosenfeld A. Performance analysis of a simple vehicle detection algorithm. Image and Vision Computing. 20:2002;1-13.
54. Kuehnel A. Symmetry based recognition of the vehicle rears. Pattern Recognition Letters. 12:1991;249-258. North Holland, Amsterdam.
55. Fathy M., Siyal M.Y. A window-based image processing technique for quantitative and qualitative analysis of road traffic parameters. IEEE Transactions on Vehicular Technology. 47:(4):1998.
56. Hogg D.C., Sullivan G.D., Baker K.D., Mott D.H. Recognition of vehicles in traffic scenes using geometric models. IEE, Proceedings of the International Conference on Road Traffic Data Collection, London. 1984;115-119. London.
57. Klausmann P., Kroschel K., Willersinn D. Performance prediction of vehicle detection algorithms. Pattern Recognition. 32:1999;2063-2065.
58. Dickinson K.W., Wan C.L. Road traffic monitoring using the TRIP II system. IEE Second International Conference on Road Traffic Monitoring, Conference Publication Number 299. February:1989;56-60.
59. Sullivan G.D., Baker K.D., Worrall A.D., Attwood C.I., Remagnino P.M. Model-based vehicle detection and classification using orthographic approximations. Image and Vision Computing. 15:1997;649-654.
60. Houghton A.D., Hobson G.S., Seed N.L., Tozer R.C. Automatic vehicle recognition. IEE Second International Conference on Road Traffic Monitoring, Conference Publication Number 299. February:1989;71-78.
61. Wan C.L., Dickinson K.W. Road traffic monitoring using image processing - a survey of systems, techniques and applications. IFAC Control Computers, Communications in Transportation, Paris, France. 1989.
62. Mantri S., Bullock D. Analysis of feedforward-backpropagation neural networks used in vehicle detection. Transportation Research Part C. 3:(3):1995;161-174.
63. Hoose N. IMPACT: an image analysis tool for motorway analysis and surveillance. Traffic Engineering Control Journal. 1992;140-147.
64. Paragios N., Deriche R. Geodesic active contours and level sets for the detection and tracking of moving objects. IEEE Transactions on Pattern Analysis and Machine Intelligence. 22:(3):2000;266-280.
65. Aach T., Kaup A. Bayesian algorithms for adaptive change detection in image sequences using Markov random fields. Signal Processing: Image Communication. 7:1995;147-160.
66. Paragios N., Tziritas G. Adaptive detection and localization of moving objects in image sequences. Signal Processing: Image Communication. 14:1999;277-296.
67. Kim J.B., Park H.S., Park M.H., Kim H.J. A real-time region-based motion segmentation using adaptive thresholding and K-means clustering. Brooks M., Corbett D., Stumptner M. AI 2001. 2001;213-224 Springer, Berlin.
68. Dubuisson M., Jain A. Contour extraction of moving objects in complex outdoor scenes. International Journal of Computer Vision. 14:1995;83-105.
69. Hoose N. Computer Image Processing in Traffic Engineering. 1991;Taunton Research Studies Press, UK.
70. Badenas J., Sanchiz J.M., Pla F. Motion-based segmentation and region tracking in image sequences. Pattern Recognition. 34:2001;661-670.
71. Wohler C., Anlauf J.K. Real-time object recognition on image sequences with the adaptable time delay neural network algorithm - applications for autonomous vehicles. Image and Vision Computing. 19:2001;593-618.
72. Lee K.W., Ryu S.W., Lee S.J., Park K.T. Motion based object tracking with mobile. Camera Electronics Letters. 34:(3):1998;256-258.
73. Coifman B., Beymer D., McLauchlan P., Malik J. A real-time computer vision system for vehicle tracking and traffic surveillance. Transportation Research Part C. 6:1998;271-288.
74. Jung Y.-K., Ho Y.-S. A feature-based vehicle tracking system in congested traffic video sequences. Shum H.-Y., Liao M., Chang S.F. PCM 2001. 2001;190-197 Springer, Berlin.
75. Techmer A. Real-time motion based vehicle segmentation in traffic lanes. Radig B., Florczyk S. DAGM 2001. 2001;202-207 Springer, Berlin.
76. Fraile R., Maybank S.J. Building 3D models of vehicles for computer vision. Huijsmans D., Smeulders A. Visual'99. 1999;697-702 Springer, Berlin.
77. Gloyer B., Aghajan H.K., Siu K.-Y., Kailath T. Video-based monitoring system using recursive vehicle tracking. Proceedings of IS&T/SPIE Symposium on Electronic Image: Science & Technology - Image and Video Processing. 1995.
78. Horn B.K.P., Schunck B.G. Determining optical flow. Artificial Intelligence. 17:1981;185-203.
79. Enkelmann W., Kories R., Nagel H.-H., Zimmermann G. An experimental investigation of estimation approaches for optical flow fields. Martin W.N., Aggarwal J.K. Motion Understanding: Robot and Human Vision. 1987;189-226 Kluwer, Dordrecht.
80. Kories R., Nagel H.-H., Zimmermann G. Motion detection in image sequences: an evaluation of feature detectors. Proceedings of International Joint Conference on Pattern Recognition, Montreal. 1984;778-780.
81. Enkelmann W. Interpretation of traffic scenes by evaluation of optical flow fields from image sequences. IFAC Control Computers, Communications in Transportation, Paris, France. 1989.
82. Nagel H.H. Constraints for the estimation of displacement vector fields from image sequences. Proceedings of Intelligent Joint Conference on Artificial Intelligence, Karlsruhe/FRG. August:1983;945-951.
83. Giachetti A., Campani M., Torre V. The use of optical flow for road navigation. IEEE Transactions on Robotics and Automation. 14:(1):1998.
84. Kories R., Zimmermann G. Workshop on Motion: Representation and Analysis, Kiawah Island Resort, Charleston/SC. Workshop on Motion: Representation and Analysis, Kiawah Island Resort, Charleston/SC. May:1986;IEEE Computer Society Press. pp. 101-106.
85. Velastin S.A., Yin J.H., Vicencio-Silva M.A., Davies A.C., Allsop R.E., Penn A. Image processing for on-line analysis of crowds in public areas. IFAC Transportation systems, Tianjin, Proceedings. 1994.
86. Enkelmann W. Investigations of multigrid algorithms for the estimation of optical flow fields in image sequences. Computer Vision, Graphics, and Image Processing. 1988;150-177.
87. Carlsson S., Eklundh J.O. Object detection using model-based prediction and motion parallax. Proceedings of Europe Conference on Computer Vision, Antibes, France. 427:1990;297-306.
88. Bruss A.R., Horn B.K.P. Passive navigation. Computer Vision, Graphics, and Image Processing. 21:1983;3-20.
89. Dreschler L., Nagel H.-H. Volumetric model and 3D-trajectory of a moving car derived from monocular TV - frame sequences of a street scene. Computer Vision, Graphics, and Image Processing. 20:1982;199-228.
90. Irani M., Anandan P. A unified approach to moving object detection in 2D and 3D scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence. 20:(6):1998;577-589.
91. Irani M., Rousso B., Peleg S. Recovery of egomotion using region alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence. 19:(3):1997;268-272.
92. Nagai A., Kuno Y., Shirai Y. Detection of moving objects against a changing background. Systems and Computer in Japan. 30:(11):1999;107-116.
93. Smith S.M., Brady J.M. A scene segmenter; visual tracking of moving vehicles. Engineering Applications of Artificial Intelligence. 7:(2):1994;191-204.
94. Mallot H.A., Bulthoff H.H., Little J.J., Bohrer S. Inverse perspective mapping simplifies optical flow computation and obstacle detection. Biological Cybernetics. 64:1991;177-185.
95. Tsugawa S. Vision-based vehicles in Japan: machine vision systems and driving control systems. IEEE Transactions on Industrial Electronics. 41:(4):1994;398-405.
96. Pomerleau D., Jocchem T. Rapidly adaptive machine vision for automated vehicle steering. IEEE Machine Vision. April:1996;19-27.
97. Matthies L. Stereo vision for planetary rovers: stochastic modeling to near real-time implementation. International Journal of Computer Vision. 8:1992;71-91.
98. Schick J., Dickmanns E.D. Simultaneous estimation of 3D shape and motion of objects by computer vision. Proceedings of IEEE Workshop on Visual Motion, Princeton, NJ. October:1991;256-261.
99. Mammar S., Blosseville J.M. Traffic variables recovery. IFAC Transportation Systems, Tianjin, Proceedings. 1994.
100. Michalopoulos P.G., Jacobson R.D., Anderson C.A., DeBruycker T.B. Automatic Incident Detection Through Video Image Processing. Traffic Engineering+Control. February:1993;66-75.
101. Michalopoulos P.G. Vehicle detection video through image processing: the autoscope system. IEEE Transactions on Vehicular Technology. 40:(1):1991.
102. Postaire J.G., Stelmaszyk P., Bonnet P. A visual surveillance system for traffic collision avoidance control. IFAC Transportation Symposium International Federation of Automatic Control, Laxenburg, Austria. 1986.
103. Takaba S., et al. A traffic flow measuring system using a solid state sensor. Proceedings of IEE Conference on Road Traffic Data Collection, London, UK. 1984.
104. Rourke A., Bell M.G.H. Applications of low cost image processing technology in transport. Proceedings of the World Conference on Transport Research, Japan. 1989;169-183.
105. Zhu Z., Xu G., Yang B., Shi D., Lin X. VISATRAM: a real-time vision system for automatic traffic monitoring. Image and Vision Computing. 18:2000;781-794.
106. Kluge K. Extracting road curvature and orientation from image edge points without perceptual grouping into features. Proceedings of IEEE Intelligent Vehicles Symposium'94. 1994;109-111.
107. Kenue S.K. LANELOK: an algorithm for extending the lane sensing operation range to 100 feet. Procedings of SPIE-Mobile Robots V. 1388:1991;222-233.
108. Beauvais M., Lakshmanan S. CLARK: a heterogeneous sensor fusion method for finding lanes and obstacles. Image and Vision Computing. 18:(5):2000;397-413.
109. Pomerleau D. Ralph: rapidly adapting lateral position handler. Proceedings of IEEE Intelligent Vehicles'95, Detroit, MI. 1995;506-511.
110. Goto Y., Matsuzaki K., Kweon I., Obatake T. CMU sidewalk navigation system: a blackboard outdoor navigation system using sensor fusion with color-range images. Proceedings of First Joint Conference ACM/IEEE. November:1986.
111. Crisman J.D., Thorpe C.E. SCARF: a color vision system that tracks roads and intersections. IEEE Transactions on Robotics and Automation. 9:(1):1993.
112. Jochem T.M., Pomereau D.A., Thorpe C.E. Maniac, a next generation neurally based autonomous road follower. Proceedings of International Conference on Intelligent Autonomous Systems: IAS-3, Pittsburgh, PA. February:1993.
113. Nagel H.H., Heimes F., Fleischer K., Haag M., Leuck H., Noltemeier S. Quantitative comparison between trajectory estimates obtained from a binocular camera setup within a moving road vehicle and from the outside by a stationary monocular camera. Image and Vision Computing. 18:2000;435-444.
114. Zheng Q., Chellappa R. Automatic feature point extraction and tracking in image sequences for arbitrary camera motion. International Journal of Computer Vision. 15:1995;31-76.
115. Coombs D., Herman M., Hong T., Nashman M. Real-time obstacle avoidance using central flow divergence, and peripheral flow. IEEE Transactions on Robotics and Automation. 14:(1):1998;49-59.
116. Kehtarnavaz N., Griswold N.C., Lee J.S. Visual control of an autonomous vehicle (BART) - the vehicle-following problem. IEEE Transactions on Vehicular Technology. 40:(3):1991;654-662.
117. Shladover S.E., Desoer D.A., Hedrick J.K., Tomizuka M., Walrand J., Zhang W.-B., McMahon D.H., Peng H., Sheikholeslam S., McKeown N. Automatic vehicle control developments in the PATH program. IEEE Transactions on Vehicular Technology. 40:(1):1991;114-129.
118. Kato S., Tsugawa S. Cooperative driving of autonomous vehicles based on localization, inter-vehicle communications and vision systems. JSAE Review. 22:2001;503-509.
119. Trivedi M.M., Abidi M.A., Eason R.O., Gonzalez R.C. Developing robotics systems with multiple sensors. IEEE Transactions on Systems, Man, and Cybernetics. 20:(6):1990;1285-1300.
120. Chavand F., Colle E., Chekhan Y., N'zi E.C. 3D measurements using a video and a range finder. IEEE Transactions on Instrumentation and Measurement. 46:(6):1997;1229-1235.
121. Magee M.J., Boyter B.A., Chien C.H., Aggarwal J.K. Experiments in intensity guided range sensing recognition of three-dimensional objects. IEEE Pattern Analysis and Machine Intelligence. 7:1985;629-637.
122. Burt P.J. Smart sensing within a pyramid vision machine. Proceedings of IEEE. 76:1988;1006-1115.
123. Jain A., Newman T., Goulish M. Range-intensity histogram for segmenting LADAR images. Pattern Recognition Letters. 13:1992;41-56.
124. Pomerleau D.A. Advances in Neural Information Processing. Advances in Neural Information Processing. 1:1989;Morgan-Kaufman, San Francisco, CA. pp. 305-313.
125. Handmann U., Kalinke T., Tzomakas C., Werner M., Seelen W. An image processing systems for driver assistance. Image and Vision Computing. (18):2000;367-376.
126. Schodel H. Utilization of fuzzy techniques in intelligent sensors. Fuzzy Sets and Systems. 63:1994;271-292.
127. Sandakly F., Giraudon G. 3D scene interpretation for a mobile robot. Robotics and Autonomous Systems. 21:1997;399-414.
128. Wu Y.-G., Yang J.-Y., Liu K. Obstacle detection and environment modeling based on multisensor fusion for robot navigation. Artificial Intelligence in Engineering. 10:1996;323-333.