Vision-based traffic sign detection and analysis for intelligent driver assistance systems: Perspectives and survey

IEEE Transactions on Intelligent Transportation Systems

Volumn 13, Issue 4, 2012, Pages 1484-1497

  Møgelmose, Andreas ^a   Trivedi, Mohan Manubhai ^b   Moeslund, Thomas B ^a  

^a AALBORG UNIVERSITY   (Denmark)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Active safety; human centered computing; machine learning; machine vision; object detection

Indexed keywords

ACTIVE SAFETY; DETECTION SYSTEM; DRIVER ASSISTANCE; EUROPEAN TRAFFIC; HUMAN-CENTERED COMPUTING; IMAGE DATABASE; INTELLIGENT DRIVER ASSISTANCE SYSTEMS; OBJECT DETECTION; PUBLIC DATABASE; RESEARCH ISSUES; SIGN DETECTION; TRAFFIC SIGN DETECTION; TRAFFIC SIGN RECOGNITION; VISION BASED;

AUTOMOBILE DRIVERS; COMPUTER VISION; FEATURE EXTRACTION; LEARNING SYSTEMS; RESEARCH; SURVEYS;

TRAFFIC SIGNS;

EID: 84870547834     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2012.2209421     Document Type: Article

References (69)

1. M. Trivedi, T. Gandhi, and J. McCall, "Looking-in and looking-out of a vehicle: Computer-vision-based enhanced vehicle safety, " IEEE Trans. Intell. Transp. Syst., vol. 8, no. 1, pp. 108-120, Mar. 2007. (Pubitemid 46376159)
2. M. Trivedi and S. Cheng, "Holistic sensing and active displays for intelligent driver support systems, " Computer, vol. 40, no. 5, pp. 60-68, May 2007.
3. C. Tran and M. M. Trivedi, "Vision for driver assistance: Looking at people in a vehicle, " in Guide to Visual Analysis of Humans: Looking at People, T. B. Moeslund, L. Sigal, V. Krueger, and A. Hilton, Eds. New York: Springer-Verlag, 2011.
4. B. Morris and M. Trivedi, "Vehicle iconic surround observer: Visualization platform for intelligent driver support applications, " in Proc. IEEE IV Symp., 2010, pp. 168-173.
5. M.-Y. Fu and Y.-S. Huang, "A survey of traffic sign recognition, " in Proc. ICWAPR, Jul. 2010, pp. 119-124.
6. H. Fleyeh and M. Dougherty, "Road and traffic sign detection and recognition, " in Proc. 10th EWGT Meet./16th Mini-EURO Conf., 2005, pp. 644-653.
7. H. Gomez-Moreno, S. Maldonado-Bascon, P. Gil-Jimenez, and S. Lafuente-Arroyo, "Goal evaluation of segmentation algorithms for traffic sign recognition, " IEEE Trans. Intell. Transp. Syst., vol. 11, no. 4, pp. 917-930, Dec. 2010.
8. S. Houben, "A single target voting scheme for traffic sign detection, " in Proc. IEEE IV Symp., Jun. 2011, pp. 124-129.
9. D. Shinar, Traffic Safety and Human Behaviour. Bingley, U. K. : Emerald, 2007.
10. A. Doshi and M. Trivedi, "Attention estimation by simultaneous observation of viewer and view, " in Proc. IEEE Comput. Soc. Conf. CVPRW, 2010, pp. 21-27.
11. E. Murphy-Chutorian, A. Doshi, and M. Trivedi, "Head pose estimation for driver assistance systems: A robust algorithm and experimental evaluation, " in Proc. IEEE ITSC, 2007, pp. 709-714.
12. A. Doshi, S. Cheng, and M. Trivedi, "A novel active heads-up display for driver assistance, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 1, pp. 85-93, Feb. 2009.
13. A. De la Escalera, J. Armingol, and M. Mata, "Traffic sign recognition and analysis for intelligent vehicles, " Image Vis. Comput., vol. 21, no. 3, pp. 247-258, Mar. 2003.
14. Convention on Road Signs and Signals of 1968, United Nations Economic Commission for Europe, Geneva, Switzerland, 2006.
15. California Manual on Uniform Traffic Control Devices for Streets and Highways, State of California, Dept. Transp, Sacramento, CA, 2006.
16. A. Vázquez-Reina, S. Lafuente-Arroyo, P. Siegmann, S. Maldonado-Bascón, and F. Acevedo-Rodríguez, "Traffic sign shape classification based on correlation techniques, " in Proc. 5th WSEAS Int. Conf. Signal Process., Comput. Geometry Artif. Vis., 2005, pp. 149-154.
17. X. Gao, L. Podladchikova, D. Shaposhnikov, K. Hong, and N. Shevtsova, "Recognition of traffic signs based on their colour and shape features extracted using human vision models, " J. Vis. Commun. Image Represent., vol. 17, no. 4, pp. 675-685, 2006. (Pubitemid 43767278)
18. R. Timofte, K. Zimmermann, and L. Van Gool, "Multi-view traffic sign detection, recognition, and 3D localisation, " in Proc. WACV, 2009, pp. 1-8.
19. Y. Xie, L.-F. Liu, C.-H. Li, and Y.-Y. Qu, "Unifying visual saliency with HOG feature learning for traffic sign detection, " in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 24-29.
20. A. Ruta, F. Porikli, S. Watanabe, and Y. Li, "In-vehicle camera traffic sign detection and recognition, " in Machine Vision and Applications. New York: Springer-Verlag, 2011, pp. 359-375. [Online]. Available: http://dx. doi. org/10. 1007/s00138-009-0231-x
21. R. Kastner, T. Michalke, T. Burbach, J. Fritsch, and C. Goerick, "Attention-based traffic sign recognition with an array of weak classifiers, " in Proc. IEEE IV Symp., Jun. 2010, pp. 333-339.
22. J. Stallkamp, M. Schlipsing, J. Salmen, and C. Igel, "The german traffic sign recognition benchmark: A multi-class classification competition, " in Proc. IJCNN, 2011, pp. 1453-1460. [Online]. Available: http://benchmark. ini. rub. de/?section=gtsrb
23. J. Stallkamp, M. Schlipsing, J. Salmen, and C. Igel, "Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition, " Neural Netw., vol. 32, pp. 323-332, Aug. 2012. [Online]. Available: http://www. sciencedirect. com/science/article/pii/S0893608012000457
24. R. Timofte, K. Zimmermann, and L. Van Gool, "Multi-view traffic sign detection, recognition, and 3D localisation, " in Machine Vision and Applications. New York: Springer-Verlag, Dec. 2011, pp. 1-15. [Online]. Available: http://dx. doi. org/10. 1007/s00138-011-0391-3
25. F. Larsson and M. Felsberg, "Using Fourier descriptors and spatial models for traffic sign recognition, " in Proc. Image Anal., 2011, pp. 238-249.
26. C. Grigorescu and N. Petkov, "Distance sets for shape filters and shape recognition, " IEEE Trans. Image Process., vol. 12, no. 10, pp. 1274-1286, Oct. 2003.
27. R. Belaroussi, P. Foucher, J. Tarel, B. Soheilian, P. Charbonnier, and N. Paparoditis, "Road sign detection in images: A case study, " in Proc. ICPR, Istanbul, Turkey, 2010, pp. 484-488.
28. R. Rajesh, K. Rajeev, K. Suchithra, V. Lekhesh, V. Gopakumar, and N. Ragesh, "Coherence vector of oriented gradients for traffic sign recognition using neural networks, " in Proc. IJCNN, Aug. 5-31, 2011, pp. 907-910.
29. D. Ciresan, U. Meier, J. Masci, and J. Schmidhuber, "A committee of neural networks for traffic sign classification, " in Proc. IJCNN, 2011, pp. 1918-1921.
30. F. Zaklouta, B. Stanciulescu, and O. Hamdoun, "Traffic sign classification using K-d trees and Random Forests, " in Proc. IJCNN, Aug. 5-31, 2011, pp. 2151-2155.
31. P. Sermanet and Y. LeCun, "Traffic sign recognition with multi-scale convolutional networks, " in Proc. IJCNN, 2011, pp. 2809-2813.
32. F. Boi and L. Gagliardini, "A support vector machines network for traffic sign recognition, " in Proc. IJCNN, 2011, pp. 2210-2216.
33. P. Gil Jiménez, S. Bascón, H. Moreno, S. Arroyo, and F. Ferreras, "Traffic sign shape classification and localization based on the normalized FFT of the signature of blobs and 2D homographies, " Signal Process., vol. 88, no. 12, pp. 2943-2955, Dec. 2008.
34. A. Ruta, Y. Li, and X. Liu, "Real-time traffic sign recognition from video by class-specific discriminative features, " Pattern Recognit., vol. 43, no. 1, pp. 416-430, Jan. 2010.
35. G. Loy and N. Barnes, "Fast shape-based road sign detection for a driver assistance system, " in Proc. IEEE/RSJ Int. Conf. IROS, 2004, vol. 1, pp. 70-75. (Pubitemid 40275579)
36. B. Hoferlin and K. Zimmermann, "Towards reliable traffic sign recognition, " in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 324-329.
37. X. Baro, S. Escalera, J. Vitria, O. Pujol, and P. Radeva, "Traffic sign recognition using evolutionary adaboost detection and forest-ECOC classification, " IEEE Trans. Intell. Transp. Syst., vol. 10, no. 1, pp. 113-126, Mar. 2009.
38. Y. Gu, T. Yendo, M. Tehrani, T. Fujii, and M. Tanimoto, "Traffic sign detection in dual-focal active camera system, " in Proc. IEEE IV Symp, Jun. 2011, pp. 1054-1059.
39. G. Overett and L. Petersson, "Large scale sign detection using HOG feature variants, " in Proc. IEEE IV Symp., Jun. 2011, pp. 326-331.
40. C. Keller, C. Sprunk, C. Bahlmann, J. Giebel, and G. Baratoff, "Realtime recognition of U. S. speed signs, " in Proc. IEEE IV Symp., Jun. 2008, pp. 518-523.
41. W.-J. Kuo and C.-C. Lin, "Two-stage road sign detection and recognition, " in Proc. IEEE Int. Conf. Multimedia Expo., Jul. 2007, pp. 1427-1430.
42. Y.-Y. Nguwi and A. Kouzani, "Detection and classification of road signs in natural environments, " Neural Comput. Appl., vol. 17, no. 3, pp. 265-289, Jun. 2008. [Online]. Available: http://dx. doi. org/10. 1007/s00521-007-0120-z
43. F. Ren, J. Huang, R. Jiang, and R. Klette, "General traffic sign recognition by feature matching, " in Proc. 24th Int. Conf. IVCNZ, Nov. 2009, pp. 409-414.
44. S. Xu, "Robust traffic sign shape recognition using geometric matching, " IET Intell. Transp. Syst., vol. 3, no. 1, pp. 10-18, Mar. 2009.
45. H.-H. Chiang, Y.-L. Chen, W.-Q. Wang, and T.-T. Lee, "Road speed sign recognition using edge-voting principle and learning vector quantization network, " in Proc. ICS, Dec. 2010, pp. 246-251.
46. X. Qingsong, S. Juan, and L. Tiantian, "A detection and recognition method for prohibition traffic signs, " in Proc. Int. Conf. IASP, Apr. 2010, pp. 583-586.
47. S. Maldonado-Bascon, S. Lafuente-Arroyo, P. Gil-Jimenez, H. Gomez-Moreno, and F. López-Ferreras, "Road-sign detection and recognition based on support vector machines, " IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 264-278, Jun. 2007. (Pubitemid 46873208)
48. S. Lafuente-Arroyo, S. Salcedo-Sanz, S. Maldonado-Bascón, J. A. Portilla-Figueras, and R. J. López-Sastre, "A decision support system for the automatic management of keep-clear signs based on support vector machines and geographic information systems, " Expert Syst. Appl., vol. 37, no. 1, pp. 767-773, Jan. 2010. [Online]. Available: http://dl. acm. org/citation. cfm?id=1628324. 1628558
49. H. Liu, D. Liu, and J. Xin, "Real-time recognition of road traffic sign in motion image based on genetic algorithm, " in Proc. Int. Conf. Mach. Learn. Cybern., 2002, vol. 1, pp. 83-86.
50. X. Gao, K. Hong, P. Passmore, L. Podladchikova, and D. Shaposhnikov, "Colour vision model-based approach for segmentation of traffic signs, " J. Image Video Process., vol. 2008, pp. 6:1-6:7, Jan. 2008. [Online]. Available: http://dx. doi. org/10. 1155/2008/386705
51. V. Prisacariu, R. Timofte, K. Zimmermann, I. Reid, and L. Van Gool, "Integrating object detection with 3D tracking towards a better driver assistance system, " in Proc. 20th ICPR, Aug. 2010, pp. 3344-3347.
52. D. Deguchi, M. Shirasuna, K. Doman, I. Ide, and H. Murase, "Intelligent traffic sign detector: Adaptive learning based on online gathering of training samples, " in Proc. IEEE IV Symp., 2011, pp. 72-77.
53. P. Viola and M. Jones, "Robust real-time object detection, " Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2001.
54. N. Barnes and G. Loy, "Real-time regular polygonal sign detection, " in Field and Service Robotics. New York: Springer-Verlag, 2006, pp. 55-66. (Pubitemid 44425894)
55. N. Barnes, A. Zelinsky, and L. Fletcher, "Real-time speed sign detection using the radial symmetry detector, " IEEE Trans. Intell. Transp. Syst., vol. 9, no. 2, pp. 322-332, Jun. 2008.
56. C. Nunn, A. Kummert, and S. Muller-Schneiders, "A two stage detection module for traffic signs, " in Proc. IEEE ICVES, Sep. 2008, pp. 248-252.
57. M. Meuter, C. Nunn, S. M. Gormer, S. Muller-Schneiders, and A. Kummert, "A decision fusion and reasoning module for a traffic sign recognition system, " IEEE Trans. Intell. Transp. Syst., vol. 12, no. 4, pp. 1126-1134, Dec. 2011.
58. M. A. Garcia-Garrido, M. Ocana, D. F. Llorca, M. A. Sotelo, E. Arroyo, and A. Llamazares, "Robust traffic signs detection by means of vision and V2I communications, " in Proc. 14th Int. IEEE ITSC, Oct. 2011, pp. 1003-1008.
59. A. Gonzalez, M. Garrido, D. Llorca, M. Gavilan, J. Fernandez, P. Alcantarilla, I. Parra, F. Herranz, L. Bergasa, M. Sotelo, and P. Revenga de Toro, "Automatic traffic signs and panels inspection system using computer vision, " IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 485-499, Jun. 2011.
60. F. Moutarde, A. Bargeton, A. Herbin, and L. Chanussot, "Robust onvehicle real-time visual detection of American and European speed limit signs, with a modular traffic signs recognition system, " in Proc. IEEE Intell. Veh. Symp., 2007, pp. 1122-1126.
61. R. Belaroussi and J.-P. Tarel, "Angle vertex and bisector geometric model for triangular road sign detection, " in Proc. WACV, Dec. 2009, pp. 1-7.
62. A. Ruta, Y. Li, and X. Liu, "Towards real-time traffic sign recognition by class-specific discriminative features, " in Proc. 18th Brit. Mach. Vis. Conf., 2007, vol. 1, pp. 399-408.
63. B. Alefs, G. Eschemann, H. Ramoser, and C. Beleznai, "Road sign detection from edge orientation histograms, " in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 993-998.
64. N. Pettersson, L. Petersson, and L. And ersson, "The histogram feature-A resource-efficient weak classifier, " in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 678-683.
65. I. Creusen, R. Wijnhoven, E. Herbschleb, and P. deWith, "Color exploitation in hog-based traffic sign detection, " in Proc. 17th IEEE ICIP, Sep. 2010, pp. 2669-2672.
66. C. Bahlmann, Y. Zhu, V. Ramesh, M. Pellkofer, and T. Koehler, "A system for traffic sign detection, tracking, and recognition using color, shape, and motion information, " in Proc. IEEE Intell. Veh. Symp., 2005, pp. 255-260. (Pubitemid 44055135)
67. G. Loy and A. Zelinsky, "Fast radial symmetry for detecting points of interest, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 8, pp. 959-973, Aug. 2003.
68. N. Barnes and A. Zelinsky, "Real-time radial symmetry for speed sign detection, " in Proc. IEEE Intell. Veh. Symp., Jun. 2004, pp. 566-571.
69. A. Doshi and M. Trivedi, "Satellite imagery based adaptive background models and shadow suppression, " Signal, Image Video Process., vol. 1, no. 2, pp. 119-132, Jun. 2007.