Detection and 3D reconstruction of traffic signs from multiple view color images

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 77, Issue , 2013, Pages 1-20

  Soheilian, Bahman ^a   Paparoditis, Nicolas ^a   Vallet, Bruno ^a  

^a UNIVERSITÉ PARIS EST   (France)

Author keywords

Color segmentation; Constrained multi view reconstruction; Geometric shape estimation; Template matching; Traffic sign

Indexed keywords

ALGORITHMS; COLOR; IMAGE MATCHING; IMAGE SEGMENTATION; ROADS AND STREETS; TEMPLATE MATCHING; THREE DIMENSIONAL COMPUTER GRAPHICS; TRAFFIC SIGNS;

3-D RECONSTRUCTION ALGORITHMS; 3-D SHAPE; 3D RECONSTRUCTION; ACCURACY AND PRECISION; COLOR IMAGES; COLOR SEGMENTATION; COLOR-BASED SEGMENTATION; DETECTION ALGORITHM; EDGE POINT; EPIPOLAR GEOMETRY; GEOMETRIC SHAPE; HYPOTHESIS GENERATION AND VERIFICATION; IMAGE PLANE; IMAGE-BASED; LOCALIZATION AND NAVIGATION; MULTI-VIEW IMAGE; MULTI-VIEW RECONSTRUCTION; MULTI-VIEWS; MULTIPLE VIEWS; PERSPECTIVE DISTORTION; RECONSTRUCTION PROCESS; REGION OF INTEREST; ROAD SIGNS; STEREO MATCHING; SYNTHETIC IMAGES; TEXTURAL INFORMATION;

THREE DIMENSIONAL;

ALGORITHM; COLOR; GEOMETRY; PIPELINE; PRECISION; RECONSTRUCTION; SEGMENTATION; THREE-DIMENSIONAL MODELING;

EID: 84873046663     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2012.11.009     Document Type: Article

References (47)

1. Aoyagi, Y., Asakura, T., 1996. Detection and recognition of traffic sign in scene image using genetic algorithms and neural networks. In: Proc. Society of Instrument and Control Engineers Annual Conference, July 24-26 1996, SICE, Tottori, Japon, pp. 1343-1348.
2. Belaroussi, R., Tarel, J.P., 2009a. Angle vertex and bisector geometric model for triangular road sign detection. In: Proc. Workshop on Applications of Computer Vision, 7-8 December 2009, IEEE, Snowbird, Utah, USA, pp. 1-7.
3. Belaroussi, R., Tarel, J.P., 2009b. A real-time road sign detection using bilateral chinese transform. In: Proc. International Symposium on Visual Computing, 30 November-2 December 2009, IEEE, Las Vegas, Nevada, USA, pp. 1161-1170.
4. Belaroussi, R., Foucher, P., Tarel, J., Soheilian, B., Charbonnier, P., Paparoditis, N., 2010. Road sign detection in images: a case study. In: Proc. International Conference on Pattern Recognition, 23-26 August 2010, IAPR, Istanbul, Turkey, pp. 484-488.
5. Charmette, B., Royer, E., Chausse, F., 2009. Matching planar features for robot localization. In: Proc. International Symposium on Advances in Visual Computing, 30 November-2 December 2009, IEEE, Las Vegas, Nevada, USA, pp. 201-210.
6. De La Escalera A., Moreno L., Salichs M., Armingol J. Road traffic sign detection and classification. IEEE Transactions on Industrial Electronics 1997, 44(6):848-859.
7. De la Escalera A., Armingol J., Pastor J., Rodriguez F. Visual sign information extraction and identification by deformable models for intelligent vehicles. IEEE Transactions on Intelligent Transportation Systems 2004, 5(2):57-68.
8. Deriche R. Using canny's criteria to derive a recursively implemented optimal edge detector. International Journal of Computer Vision 1987, 1(2):167-187.
9. Devernay, F., 1995. A Non-Maxima Suppression Method for Edge Detection with Sub-Pixel Accuracy. Tech. Rep. RR-2724. INRIA. (accessed 26.10.12). http://hal.inria.fr/inria-00073970/en/.
10. Fang C.-Y., Chen S.-W., Fuh C.-S. Road-sign detection and tracking. IEEE Transactions on Vehicular Technology 2003, 52(5):1329-1341.
11. Farag, A., Abdel-Hakim, A., 2004. Detection, categorization and recognition of road signs for autonomous navigation. In: Proc. Advanced Concepts in Intelligent Vision Systems, 31 August-3 September 2004, Brussels, Belgium, pp. 125-130.
12. Fischler M.A., Bolles R.C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 1981, 24(6):381-395.
13. Fleyeh, H., 2008. Traffic and Road Sign Recognition. Ph.D. Thesis. Napier University, Edinburgh, Scotland, 2008.
14. Foucher, P., Charbonnier, P., Kebbous, H., 2009. Evaluation of a road sign pre-detection system by image analysis. In: Proc. International Conference on Computer Vision Theory and Applications, 5-8 February 2009, Lisbon, Portugal, pp. 362-367.
15. Fu, M., Huang, Y., 2010. A survey of traffic sign recognition. In: Proc. International Conference on Wavelet Analysis and Pattern Recognition, 11-14 July 2010, IEEE, Qingdao, China, pp. 119-124.
16. Gao X., Podladchikova L., Shaposhnikov D., Hong K., Shevtsova N. Recognition of traffic signs based on their colour and shape features extracted using human vision models. Journal of Visual Communication and Image Representation 2006, 17(4):675-685.
17. Gao X., Hong K., Passmore P., Podladchikova L., Shaposhnikov D. Colour vision model-based approach for segmentation of traffic signs. EURASIP Journal on Image and Video Processing 2008, 7. (accessed 25.10.12).
18. Garcia-Garrido, M.A., Sotelo, M.A., Martm-Gorostiza, E., 2006. Fast traffic sign detection and recognition under changing lighting conditions. In: Proc. Conference on Intelligent Transportation Systems, 17-20 September 2006, IEEE, Toronto, Canada, pp. 811-816.
19. Gil-Jimenez, P., Lafuente-Arroyo, S., Gomez-Moreno, H., Lopez-Ferreras, F., Maldonado-Baseon, S., 2005. Traffic sign shape classification evaluation II: FFT applied to the signature of blobs. In: Proc. Intelligent Vehicles Symposium, 6-8 June 2005, IEEE, Las Vegas, Nevada, USA, pp. 607-612.
20. Habib A.F., Uebbing R., Novak K. Automatic extraction of road signs from terrestrial color imagery. Photogrammetric Engineering and Remote Sensing 1999, 65(5):597-601.
21. Hsu S.-H., Huang C.-L. Road sign detection and recognition using matching pursuit method. Image and Vision Computing 2001, 19(3):119-129.
22. Ibanez L., Schroeder W., Ng L., Cates J. The ITK Software Guide 2003, Kitware, Inc., ISBN 1-930934-10-6 (accessed 25.10.12).
23. Ishizuka, Y., Hirai, Y., 2004. Segmentation of road sign symbols using opponent-color filters. In: Proc. Intelligent Transportation Systems World Congress, 18-21 October 2004, Nagoya, Japan, 8p. (CDROM).
24. Lafuente-Arroyo, S., Gil-Jimenez, P., Maldonado-Bascon, R., Lopez-Ferreras, F., Maldonado-Bascon, S., 2005. Traffic sign shape classification evaluation I: SVM using distance to borders. In: Proc. Intelligent Vehicles Symposium, 6-8 June 2005, IEEE, Las Vegas, Nevada, USA, pp. 557-562.
25. Lafuente-Arroyo, S., Maldonado-Bascon, S., Gil-Jimenez, P., Acevedo-Rodriguez, J., Lopez-Sastre, R.J., 2007. A tracking system for automated inventory of road signs. In: Proc. Intelligent Vehicles Symposium, 13-15 June 2007, IEEE, Istanbul, Turkey, pp. 166-171.
26. Li, Y., Pankanti, S., Guan, W., 2010. Real-time traffic sign detection: an evaluation study. In: Proc. International Conference on Pattern Recognition, 23-26 August 2010, IAPR, Istanbul, Turkey, pp. 3033-3036.
27. Meilland, M., Comport, A.I., Rives, P., 2010. A spherical robot-centered representation for urban navigation. In: Proc. International Conference on Intelligent Robots Systems, 18-22 October 2010, IEEE/RSJ, Taipei, Taiwan, pp. 5196-5201.
28. Meuter, M., Kummert, A., Muller-Schneiders, S., 2008. 3D traffic sign tracking using a particle filter. In: Proc. 11th International Conference on Intelligent Transportation Systems, 12-15 October 2008, IEEE, Beijing, China, pp. 168-173.
29. Ministère de l'écologie, de l'énergie, du Développement durable et de l'Amenagement du territoire, 2008. Instruction interministérielle sur la signalisation routière - Version consolidée - Deuxième - Cinquième parties. Paris, France.
30. Paparoditis N., Papelard J.P., Cannelle B., Devaux A., Soheilian B., David N., Houzay E. Stereopolis II: a multi-purpose and multi-sensor 3D mobile mapping system for street visualisation and 3D metrology. Revue Française de Photogrammétrie et de Télédétection 2012, 200:69-79.
31. Piccioli, G., Micheli, E.D., Campani, M., 1994. A robust method for road sign detection and recognition. In: Proc. European Conference on Computer Vision, 2-6 May 1994, IEEE, Stockholm, Sweden, pp. 493-500.
32. Piccioli G., Micheli E.D., Parodi P., Campani M. Robust method for road sign detection and recognition. Image and Vision Computing 1996, 14(3):209-223.
33. Priese, L., Lakmann, R., Rehrmann, V., 1995. Ideogram identification in a realtime traffic sign recognition system. In: Proc. Intelligent Vehicles Symposium, 25-26 September 1995, IEEE, Detroit, Michigan, USA, pp. 310-314.
34. Prieto M.S., Allen A.R. Using self-organising maps in the detection and recognition of road signs. Image and Vision Computing 2009, 27(6):673-683.
35. Quan L. Conic reconstruction and correspondence from two views. IEEE Transactions on Pattern Analysis and Machine Intelligence 1996, 18(2):151-160.
36. Reina, A.V., Sastre, R.J.L., Arroyo, S.L., Jiménez, P.G., 2006. Adaptive traffic road sign panels text extraction. In: Proc. International Conference on Signal Processing, Robotics and Automation, 15-17 February 2006, WSEAS, Madrid, Spain, pp. 295-300.
37. Rosin P. Measuring shape: ellipticity, rectangularity, and triangularity. Machine Vision and Applications 2003, 14(3):172-184.
38. Ruta A., Li Y., Liu X. Real-time traffic sign recognition from video by class-specific discriminative features. Pattern Recognition 2010, 43(1):416-430.
39. Soheilian B., Paparoditis N., Boldo D. 3D road marking reconstruction from street-level calibrated stereo pairs. ISPRS Journal of Photogrammetry and Remote Sensing 2010, 65(4):347-359.
40. Song G., Wang H. A fast and robust ellipse detection algorithm based on pseudo-random sample consensus. Computer Analysis of Images and Patterns 2007, 4673(0302-9743):669-676.
41. Stallkamp J., Schlipsing M., Salmen J., Igel C. Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Networks 2012, 32:323-332.
42. Timofte, R., Zimmermann, K., Van Gool, L., 2009. Multi-view traffic sign detection, recognition, and 3D localisation. In: Proc. Workshop on Applications of Computer Vision, 7-8 December 2009, IEEE, Snowbird, Utah, USA, pp. 1-8.
43. Vallet B., Houzay E. Fast and accurate visibility computation in urban scenes. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences 2011, 38(Part 3 W22):77-82.
44. Wang K.C., Hou Z., Gong W. Automated road sign inventory system based on stereo vision and tracking. Computer-Aided Civil and Infrastructure Engineering 2010, 25(6):468-477.
45. Zhang S., Liu Z. A robust, real-time ellipse detector. Pattern Recognition 2005, 38(2):273-287.
46. Zheng, Y.-J., Ritter, W., Janssen, R., 1994. An adaptive system for traffic sign recognition. In: Proc. Intelligent Vehicles Symposium, 24-26 October 1994, IEEE, Paris, France, pp. 165-170.
47. Zhu, S., Liu, L., 2006. Traffic sign recognition based on color standardization. In: Proc. International Conference on Information Acquisition, 20-23 August 2006, IEEE, Shandong, China, pp. 951-955.