Evaluation of Multiclass Traffic Sign Detection and Classification Methods for U.S. Roadway Asset Inventory Management

Journal of Computing in Civil Engineering

Volumn 30, Issue 2, 2016, Pages

  Balali, Vahid ^a   Golparvar Fard, Mani ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

Asset inventory management; Classification; Detection; Multiclass; Traffic sign

Indexed keywords

CLASSIFICATION (OF INFORMATION); COLOR; COMPUTER VISION; DATA ACQUISITION; ERROR DETECTION; GRAPHIC METHODS; HIGHWAY ADMINISTRATION; HIGHWAY PLANNING; INVENTORY CONTROL; SUPPORT VECTOR MACHINES; VIDEO STREAMING;

CLASSIFICATION OF TRAFFIC SIGNS; COMPUTER VISION ALGORITHMS; DISCRIMINATIVE CLASSIFIERS; HIGHWAY ASSET MANAGEMENT; HISTOGRAMS OF ORIENTED GRADIENTS (HOG); INVENTORY MANAGEMENT; LABOR INTENSIVE PROCESS; MULTICLASS;

TRAFFIC SIGNS;

EID: 84959019115     PISSN: 08873801     EISSN: None     Source Type: Journal    
DOI: 10.1061/(ASCE)CP.1943-5487.0000491     Document Type: Article

References (79)

1. Ai, C., and, Tsai, Y. (2012). " Hybrid active contour-incorporated sign detection algorithm." J. Comput. Civ. Eng., 10.1061/(ASCE)CP.1943-5487.0000110, 28-36. JCCEE5 0887-3801
2. Ai, C., and, Tsai, Y. (2014). " Geometry preserving active polygon-incorporated sign detection algorithm." J. Comput. Civ. Eng., 10.1061/(ASCE)CP.1943-5487.0000422, 04014092. JCCEE5 0887-3801
3. Alefs, B., Eschemann, G., Ramoser, H., and, Beleznai, C. (2007). " Road sign detection from edge orientation histograms." Intelligent Vehicles Symp., IEEE, 993-998.
4. Ali, N., Sobran, N., Ghazaly, M. M., Shukor, S. A., and, Ibrahim, A. F. T. (2014). " Traffic sign detection and classification for driver assistant system." 8th Int. Conf. on Robotic, Vision, Signal Processing & Power Applications, H. A. Mat Sakim and M. T. Mustaffa., eds., Springer, Singapore, 277-283.
5. ASCE. (2013). " National infrastructure report card." Reston, VA.
6. Bahlmann, C., Ying, Z., Ramesh, V., Pellkofer, M., and, Koehler, T. (2005). " A system for traffic sign detection, tracking, and recognition using color, shape, and motion information." Intelligent Vehicles Symp., IEEE, 255-260.
7. Balali, V., Depwe, E., and, Golparvar-Fard, M. (2015). " Multi-class traffic sign detection and classification using Google Street view images." Transportation Research Board 94th Annual Meeting, Transportation Research Board, Washington, DC.
8. Balali, V., and, Golparvar-Fard, M. (2014 a). " Scalable non-parametric parsing for segmentation and recognition of high-quantity low-cost highway assets from car-mounted video streams." Construction Research Congress (CRC), ASCE, Reston, VA, 120-129.
9. Balali, V., and, Golparvar-Fard, M. (2014 b). " Video-based detection and classification of US traffic signs and mile markers using color candidate extraction and feature-based recognition." Int. Conf. on Computing in Civil and Building Engineering (ICCCBE), ASCE, Reston, VA, 858-866.
10. Balali, V., and, Golparvar-Fard, M. (2015). " Segmentation and recognition of roadway assets from car-mounted camera video streams using a scalable non-parametric image parsing method." J. Autom. Constr., 49, 27-39. 10.1016/j.autcon.2014.09.007 AUCOES 0926-5805
11. Balali, V., Golparvar-Fard, M., and, de la Garza, J. M. (2013). " Video-based highway asset recognition and 3D localization." Comput. Civ. Eng., 379-386. 10.1061/9780784413029
12. Ballerini, R., Cinque, L., Lombardi, L., and, Marmo, R. (2005). " Rectangular traffic sign recognition." Image analysis and processing-ICIAP 2005, F. Roli and S. Vitulano., eds., Springer, Berlin, 1101-1108.
13. Baro, X., Escalera, S., Vitria, J., Pujol, O., and, Radeva, P. (2009). " Traffic sign recognition using evolutionary adaboost detection and forest-ECOC classification." IEEE Trans. Intell. Transp. Syst., 10 (1), 113-126. 10.1109/TITS.2008.2011702 1524-9050
14. Brkic, K. (2013). " An overview of trafic sign detection methods." Dept. of Electronics, Microelectronics, Computer and Intelligent Systems, Faculty of Electrical Engineering and Computing, Unska, Zagreb, Croatia.
15. Burges, C. C. (1998). " A tutorial on support vector machines for pattern recognition." Data Min. Knowl. Discovery, 2 (2), 121-167. 10.1023/A:1009715923555
16. Chiang, H. H., Chen, Y. L., Wang, W. Q., and, Lee, T. T. (2010). " Road speed sign recognition using edge-voting principle and learning vector quantization network." Int. Computer Symp. (ICS), IEEE, 246-251.
17. Cimpoi, M. (2011). " Traffic sign detection and classification in video mode." eRAF J. Comput., 3, 10-16.
18. Creusen, I. M., Wijnhoven, R. G., Herbschleb, E., and, de With, P. H. N. (2010). " Color exploitation in hog-based traffic sign detection." 17th IEEE Int. Conf. on Image Processing (ICIP), IEEE, 2669-2672.
19. Dalal, N., and, Triggs, B. (2005). " Histograms of oriented gradients for human detection." Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR), Vol. 1, IEEE, 886-893.
20. DARPA (Defense Advanced Research Projects Agency). (2012). " DARPA grand challenge." Arlington, VA.
21. de la Escalera, A., Armingol, J. M., and, Mata, M. (2003). " Traffic sign recognition and analysis for intelligent vehicles." Image Vision Comput., 21 (3), 247-258. 10.1016/S0262-8856(02)00156-7
22. de la Escalera, A., Armingol, J. M., Pastor, J. M., and, Rodríguez, F. J. (2004). " Visual sign information extraction and identification by deformable models for intelligent vehicles." IEEE Trans. Intell. Transp. Syst., 5 (2), 57-68. 10.1109/TITS.2004.828173 1524-9050
23. de la Garza, J., Howerton, C., and, Sideris, D. (2011). " A study of implementation of IP-S2 mobile mapping technology for highway asset condition assessment." Computing in Civil Engineering, ASCE, Reston, VA, 1-8.
24. de la Garza, J. M., Yates, N. J., and, Arrington, C. A. (2010). " Improving highway asset management with RFID technology." Managing IT in Construction/Managing Construction for Tomorrow, London.
25. Fang, C.-Y., Chen, S.-W., and, Fuh, C.-S. (2003). " Road-sign detection and tracking." IEEE Trans. Veh. Technol., 52 (5), 1329-1341. 10.1109/TVT.2003.810999
26. Fatmehsan, Y. R., Ghahari, A., and, Zoroofi, R. A. (2010). " Gabor wavelet for road sign detection and recognition using a hybrid classifier." Int. Conf. on Multimedia Computing and Information Technology (MCIT), IEEE, 25-28.
27. Felzenszwalb, P. F., Girshick, R. B., McAllester, D., and, Ramanan, D. (2010). " Object detection with discriminatively trained part-based models." IEEE Trans. Pattern Anal. Mach. Intell., 32 (9), 1627-1645. 10.1109/TPAMI.2009.167 ITPIDJ 0162-8828
28. FHWA (Federal Highway Administration). (2003). " Manual on uniform trafic control devices (MUTCD)." U.S. Dept. of Transportation, Washington, DC.
29. Gao, X. W., Podladchikova, L., and, Shaposhnikov, D. (2003). " Application of vision models to traffic sign recognition." Artificial neural networks and neural information processing-ICANN/ICONIP 2003, O. Kaynak, E. Alpaydin, E. Oja, and L. Xu., eds., Springer, Berlin, 1100-1105.
30. Gao, X. W., Podladchikova, L., Shaposhnikov, D., Hong, K., and, Shevtsova, N. (2006). " Recognition of traffic signs based on their colour and shape features extracted using human vision models." J. Visual Commun. Image Represent., 17 (4), 675-685. 10.1016/j.jvcir.2005.10.003 JVCRE7 1047-3203
31. Geronimo, D., Lopez, A. M., Sappa, A. D., and, Graf, T. (2010). " Survey of pedestrian detection for advanced driver assistance systems." IEEE Trans. Pattern Anal. Mach. Intell., 32 (7), 1239-1258. 10.1109/TPAMI.2009.122 ITPIDJ 0162-8828
32. Gil-Jimenez, P., Gomez-Moreno, H., Siegmann, P., Lafuente-Arroyo, S., and, Maldonado-Bascon, S. (2007). " Traffic sign shape classification based on support vector machines and the FFT of the signature of blobs." Intelligent Vehicles Symp., IEEE, 375-380.
33. Gil-Jiménez, P., Lafuente-Arroyo, S., Maldonado-Bascón, S., and, Gómez-Moreno, H. (2005). " Shape classification algorithm using support vector machines for traffic sign recognition." Computational Intelligence and Bioinspired Systems, Springer, Berlin, 873-880.
34. Golparvar-Fard, M., Balali, V., and, de la Garza, J. (2015). " Segmentation and recognition of highway assets using image-based 3D point clouds and semantic Texton forests." J. Comput. Civ. Eng., 10.1061/(ASCE)CP.1943-5487.0000283, 04014023. JCCEE5 0887-3801
35. Gomez-Moreno, H., Maldonado-Bascon, S., Gil-Jimenez, P., and, Lafuente-Arroyo, S. (2010). " Goal evaluation of segmentation algorithms for traffic sign recognition." IEEE Trans. Intell. Transp. Syst., 11 (4), 917-930. 10.1109/TITS.2010.2054084 1524-9050
36. Gong, J., Zhou, H., Gordon, C., and, Jalayer, M. (2012). " Mobile terrestrial laser scanning for highway inventory data collection." Computing in Civil Engineering, ASCE, Reston, VA, 545-552.
37. Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., and, Igel, C. (2013). " Detection of traffic signs in real-world images: The German traffic sign detection benchmark." The 2013 Int. Joint Conf. on Neural Networks (IJCNN), IEEE, 1-8.
38. Hu, Z., and, Tsai, Y. (2011). " Generalized image recognition algorithm for sign inventory." J. Comput. Civ. Eng., 10.1061/(ASCE)CP.1943-5487.0000076, 149-158. JCCEE5 0887-3801
39. Huang, Y. S., Le, Y. S., and, Cheng, F. H. (2012). " A method of detecting and recognizing speed-limit signs." 8th Int. Conf. on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), IEEE, 371-374.
40. Huang, Y. S., and, Lee, Y. S. (2010). " Detection and recognition of speed limit signs." Int. Computer Symp. (ICS), IEEE, 107-112.
41. Jalayer, M., Gong, J., Zhou, H., and, Grinter, M. (2014). " Evaluation of remote sensing technologies for collecting roadside feature data to support highway safety manual implementation." J. Transp. Safety Security, in press.
42. Keller, C. G., Sprunk, C., Bahlmann, C., Giebel, J., and, Baratoff, G. (2008). " Real-time recognition of US speed signs." Intelligent Vehicles Symp., IEEE, 518-523.
43. Khan, J. F., Bhuiyan, S. M., and, Adhami, R. R. (2011). " Image segmentation and shape analysis for road-sign detection." IEEE Trans. Intell. Transp. Syst., 12 (1), 83-96. 10.1109/TITS.2010.2073466 1524-9050
44. Kim, J., Jung, K., and, Hyun, C. (2005). " A study on an efficient sign recognition algorithm for a ubiquitous traffic system on DSP." Computational science and its applications-ICCSA 2005, O. Gervasi, M. Gavrilova, V. Kumar, A. Laganà, H. Lee, Y. Mun, D. Taniar, and C. Tan., eds., Springer, Berlin, 1177-1186.
45. Kuo, W. J., and, Lin, C. C. (2007). " Two-stage road sign detection and recognition." Int. Conf. on Multimedia and Expo, IEEE, 1427-1430.
46. Larson, C. D., and, Skrypczuk, O. (2004). " Comprehensive data collection supporting asset management at Virginia DOT." Transportation Research Board 83rd Annual Meeting, Transportation Research Board, Washington, DC.
47. Larsson, F., and, Felsberg, M. (2011). " Using fourier descriptors and spatial models for traffic sign recognition." Proc., 17th Scandinavian Conf. on Image Analysis, Springer, Ystad, Sweden, 238-249.
48. Lopez, L. D., and, Fuentes, O. (2007). " Color-based road sign detection and tracking." Proc., 4th Int. Conf. on Image Analysis and Recognition, Springer, Montreal, Canada, 1138-1147.
49. Loy, G., and, Barnes, N. (2004). " Fast shape-based road sign detection for a driver assistance system." Int. Conf. on Intelligent Robots and Systems, Vol. 1, IEEE, 70-75.
50. Maldonado-Bascon, S., Lafuente-Arroyo, S., Gil-Jimenez, P., Gomez-Moreno, H., and, Lopez-Ferreras, F. (2007). " Road-sign detection and recognition based on support vector machines." IEEE Trans. Intell. Transp. Syst., 8 (2), 264-278. 10.1109/TITS.2007.895311 1524-9050
51. Mathias, M., Timofte, R., Benenson, R., and, Van Gool, L. (2013). " Traffic sign recognition: How far are we from the solution? " Int. Joint Conf. on Neural Networks (IJCNN), IEEE, 1-8.
52. Meuter, M., Kummert, A., and, Muller-Schneiders, S. (2008). " 3D traffic sign tracking using a particle filter." 11th Int. IEEE Conf. on Intelligent Transportation Systems (ITSC), IEEE, 168-173.
53. Miura, J., Kanda, T., and, Shirai, Y. (2000). " An active vision system for real-time traffic sign recognition." Proc., Intelligent Transportation Systems, IEEE, 52-57.
54. Mogelmose, A., Trivedi, M. M., and, Moeslund, T. B. (2012 a). " Learning to detect traffic signs: Comparative evaluation of synthetic and real-world datasets." 21st Int. Conf. on Pattern Recognition (ICPR), IEEE, 3452-3455.
55. Mogelmose, A., Trivedi, M. M., and, Moeslund, T. B. (2012 b). " Vision-based traffic sign detection and analysis for intelligent driver assistance systems: Perspectives and survey." IEEE Trans. Intell. Transp. Syst., 13 (4), 1484-1497. 10.1109/TITS.2012.2209421 1524-9050
56. Mordohai, P., et al. (2007). " Real-time video-based reconstruction of urban environments." Int. Society for Photogrammetry and Remote Sensing (ISPRS), 4.
57. Overett, G., Tychsen-Smith, L., Petersson, L., Pettersson, N., and, Andersson, L. (2014). " Creating robust high-throughput traffic sign detectors using centre-surround HOG statistics." J. Mach. Vision Appl., 25 (3), 713-726.
58. Pettersson, N., Petersson, L., and, Andersson, L. (2008). " The histogram feature-A resource-efficient weak classifier." Intelligent Vehicles Symp., IEEE, 678-683.
59. Prisacariu, V., and, Reid, I. (2009). " fastHOG-A real-time GPU implementation of HOG." Dept. of Engineering Science.
60. Prisacariu, V. A., Timofte, R., Zimmermann, K., Reid, I., and, van Gool, L. (2010). " Integrating object detection with 3D tracking towards a better driver assistance system." 20th Int. Conf. on Pattern Recognition (ICPR), IEEE, 3344-3347.
61. Qingsong, X., Juan, S., and, Tiantian, L. (2010). " A detection and recognition method for prohibition traffic signs." Int. Conf. on Image Analysis and Signal Processing (IASP), IEEE, 583-586.
62. Ren, F., Huang, J., Jiang, R., and, Klette, R. (2009). " General traffic sign recognition by feature matching." 24th Int. Conf. on Image and Vision Computing (IVCNZ), IEEE, New Zealand, 409-414.
63. Ruta, A., Li, Y., and, Liu, X. (2010). " Real-time traffic sign recognition from video by class-specific discriminative features." Pattern Recognit., 43 (1), 416-430. 10.1016/j.patcog.2009.05.018
64. Saitoh, S. (1988). " Theory of reproducing kernels and its applications." Longman Scientific & Technical, Vol. 189, Wiley, New York.
65. Scaramuzza, D., Fraundorfer, F., Pollefeys, M., and, Siegwart, R. (2009). " Absolute scale in structure from motion from a single vehicle mounted camera by exploiting nonholonomic constraints." 12th Int. Conf. on Computer Vision, IEEE, 1413-1419.
66. Soheilian, B., Paparoditis, N., and, Vallet, B. (2013). " Detection and 3D reconstruction of traffic signs from multiple view color images." ISPRS J. Photogramm. Remote Sens., 77, 1-20. 10.1016/j.isprsjprs.2012.11.009 IRSEE9 0924-2716
67. Stallkamp, J., Schlipsing, M., Salmen, J., and, Igel, C. (2011). " The German traffic sign recognition benchmark: A multi-class classification competition." Int. Joint Conf. on Neural Networks (IJCNN), IEEE, 1453-1460.
68. Stallkamp, J., Schlipsing, M., Salmen, J., and, Igel, C. (2012). " Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition." Neural Networks, 32, 323-332. 10.1016/j.neunet.2012.02.016 NNETEB 0893-6080
69. Timofte, R., Zimmermann, K., and, Van Gool, L. (2014). " Multi-view traffic sign detection, recognition, and 3D localization." J. Mach. Vision Appl., 25 (3), 633-647. 10.1007/s00138-011-0391-3
70. Tsai, Y., Kim, P., and, Wang, Z. (2009). " Generalized traffic sign detection model for developing a sign inventory." J. Comput. Civ. Eng., 10.1061/(ASCE)0887-3801(2009)23:5(266), 266-276. JCCEE5 0887-3801
71. Tsai, Y., and, Wu, J. (2002). " Shape- and texture-based 1-D image processing algorithm for real-time stop sign road inventory data collection." J. Intell. Transp. Syst., 7 (3-4), 213-234. 10.1080/714040817 1547-2450
72. Viola, P., and, Jones, M. (2001). " Robust real-time object detection." Int. J. Comput. Vision, 4, 34-47. 1573-1405
73. Walters, R. C., and, Jaselskis, E. (2005). " Using scanning lasers for real-time pavement thickness measurement." Int. Conf. on Computing in Civil Engineering, ASCE, Reston, VA, 1-11.
74. Wu, J., and, Tsai, Y. (2005). " Real-time speed limit sign recognition based on locally adaptive thresholding and depth-first-search." Photogramm. Eng. Remote Sens., 71 (4), 405-414. 10.14358/PERS.71.4.405
75. Wu, J., and, Tsai, Y. (2006). " Enhanced roadway inventory using a 2-D sign video image recognition algorithm." Comput.-Aided Civ. Infrastruct. Eng., 21 (5), 369-382. 10.1111/mice.2006.21.issue-5
76. Xie, Y., Liu, L. F., Li, C. H., and, Qu, Y. Y. (2009). " Unifying visual saliency with HOG feature learning for traffic sign detection." Intelligent Vehicles Symp., IEEE, 24-29.
77. Yangxing, L. I. U., and, Ikenaga, T. (2006). " Geometrical, physical and text/symbol analysis based approach of traffic sign detection system." IEICE Trans. Inform. Syst., 90 (1), 208-216.
78. Zhou, H., Jalayer, M., Gong, J., Hu, S., and, Grinter, M. (2013). " Investigation of methods and approaches for collecting and recording highway inventory data." Research Rep. FHWA-ICT-13-022, Illinois Center for Transportation (ICT), Champaign, IL.
79. Zhu, S. D., Yi, Z., and, Xiao-feng, L. (2005). " Detection for triangle traffic sign based on neural network." Int. Conf. on Vehicular Electronics and Safety, IEEE, 25-28.