Review of vision-based steel surface inspection systems

Journal of Computing in Higher Education

Volumn 2014, Issue 1, 2014, Pages

  Neogi, Nirbhar ^a   Mohanta, Dusmanta K ^a   Dutta, Pranab K ^b  

^a BIRLA INSTITUTE OF TECHNOLOGY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Automated visual inspection; Defect classification; Defect detection; Steel surface inspection

Indexed keywords

EID: 84915748345     PISSN: 10421726     EISSN: 18671233     Source Type: Journal    
DOI: 10.1186/1687-5281-2014-50     Document Type: Review

References (95)

1. Dupont F, Odet C, Carton M: Optimization of the recognition of defects in flat steel products with the cost matrices theory.NDT&E International 1997,30(1):3–10. URL:http://www.engr.wisc.edu/mpac/pdf/paper13.pdf, accessed July '12 10.1016/S0963-8695(96)00045-X
2. Jia H, Murphey YL, Shi J, Chang T: An Intelligent Real-time Vision System for Surface Defect Detection. IEEE-Proceedings of the 17th International Conference on Pattern Recognition; 2004:2–5.
3. Sharifzadeh M, Alirezaee S, Amirfattahi R, Sadri S: Detection of Steel Defect Using the Image Processing Algorithms. IEEE International Multitopic Conference; 2008:125–127.
4. Verlag Stahleisen GmbH, Germany;http://www.stahleisen.de
5. Park C, Won SC: An automated web surface for hot wire rod using undecimated wavelet transform and support vector machine. Industrial Electronics, IECON'09, 35th Annual Conference of IEEE; 2009:2411–2415.
6. Xie X: A review of recent advances in surface defect detection using texture analysis techniques.Electron. Lett. Compu. Vision Image Anal. 2008,7(3):1–22.
7. Kumar A: Computer-vision-based fabric defect detection: a survey.IEEE Trans. Ind. Electron. 2008,55(1):348–363.
8. Shirvaikar M: Trends in automated visual inspection.J. Real-Time Image Proc. 2006,1(1):41–43. 10.1007/s11554-006-0009-6
9. Li Y, Peihua G: Free-form surface inspection techniques state of the art review.ELSEVIER, Computer-Aided Des. 2004, 36:1395–1417. 10.1016/j.cad.2004.02.009
10. Materka A, Strzelecki M: Texture Analysis Methods – A Review. Technical University of Lodz, Institute of Electronics, COST B11 report, Brussels; 1998:1–33.
11. Newman TS, Jain AK: A survey of automated visual inspection.Comput. Vis. Image Underst. 1995,61(2):231–262. 10.1006/cviu.1995.1017
12. Chin RT, Harlow CA: Automated visual inspection: a survey.IEEE Trans. Pattern Anal. Mach. Intell. 1982,PAMI-4(6):557–573.
13. Sharma M, Markou M, Singh S: Evaluation of Texture Methods for Image Analysis. IEEE The Seventh Australian and New Zealand Intelligent Information Systems Conference; 2001:1–8.
14. Tuceryan M, Jain AK: Texture AnalysisThe Handbook of Pattern Recognition and Computer Vision. 2nd edition. Edited by: Chen CH, Pau LF, Wang PSP. World Scientific Publishing Co; 1998:207–248.
15. Gonzalez RC, Woods RE: Digital Image Processing. 3rd edition. Pearson Education; 2008.
16. Haykins S Low Price Edition, 4th Indian Reprint, 2003 by Simon Haykin Paperback. In Neural Networks A Comprehensive Foundation. 2nd edition. Pearson Education; 1999. ISBN ISBN-13: 978–81–7808–300–1, ISBN: 81–7808–300–0
17. Guha P M. Tech dissertation. In Automated Visual Inspection of Steel Surface, Texture Segmentation and Development of a Perceptual Similarity Measure. IIT, Kanpur; 2001.
18. Pernkopfa F, O’Leary P: Image acquisition techniques for automatic visual inspection of metallic surfaces.NDT&E International 2003, 36:609–617. 10.1016/S0963-8695(03)00081-1
19. Seulin R, Merienne F, Gorria P: Dynamic lighting system for specular surface inspection.Proc. SPIE 2001, 4301:199–206. 10.1117/12.420913
20. Mundy JL: Visual inspection of metal surfaces, National Computer Conference. 1979, 227–231.
21. Muehlemann M: Standardizing Defect Detection for the Surface Inspection of Large Web Steel. Illumination Technologies Inc; 2000. URL: http://www.illuminationtech.com/documents/surface_inspection.pdf, 2000, pp. 1–9, access July '12
22. Pernkopf F: Detection of surface defects on raw steel blocks using Bayesian network classifiers.Pattern Anal. Appl. 2004, 7:333–342. 10.1007/s10044-004-0232-3
23. Liu Y, Kong L, Wang X, Jiang F: Research on Image acquisition of Automatic Surface Vision Inspection Systems for steel sheet. 3rd International Conference on IEEE Advanced Computer Theory and Engineering(ICACTE); 2010:v6–189–192.
24. Wu G, Kwak H, Jang S, Xu K, Xu J: Design of Online Surface Inspection System of Hot Rolled strips. Proceedings of the IEEE International Conference on Automation and Logistics Qingdao, China; 2008:2291–2295.
25. Zhao J, Yang Y, Li G: The Cold Rolling Strip Surface Defect On-Line Inspection System Based on Machine Vision. Second Pacific-Asia Conference on IEEE Circuits, Communications and System (PACCS); 2010:402–405.
26. Toshihiro S, Hideki T, Yasuo T: Automatic Surface Inspection System for Tin Mill Black Plate (TMBP).JFE TECHNICAL REPORT 2007, 9:60–63.
27. Järvinen J, Rauhamaa J: Real-time inspection of steel strip, European stainless steel conference. 2003. URL: http://www05.abb.com/global/scot/scot227.nsf/veritydisplay/40b5916e13f4c0b5c125764a003a3352/$file/. accessed July '12
28. Gangadaran M, Mitra S, Kumar D, Kumar R, Saha SK, Gupta P, Prasad BK, Singh AKP, Gangadaran M, Mitra S, Kumar D, Kumar R, Saha SK, Gupta P, Prasad BK, Singh AKP: Online Surface Inspection System for Hot Rolled flat surface, a journey of development, ISIS INDIA. International Surface Inspection Summit, ISIS INDIA; 2012.
29. Choi DC, Jeon YJ, Yun JP, Kim SW: Pinhole detection in steel slab images using Gabor filter and morphological features.Appl Opt 2011,50(26):5122–5129. 10.1364/AO.50.005122
30. Simonis MP: Strip Surface Inspection, MILLENNIUM STEEL. 2006, 218–222. URL: http://www.millennium-steel.com/articles/pdf/2006/pp218-222%20MS06.pdf, accessed July '12
31. Yazdchi MR, Mahyari AG, Nazeri A: Detection and Classification of Surface Defects of Cold Rolling Mill Steel Using Morphology and Neural Network.1071–1076. IEEE CIMCA 2008, IAWTIC 2008, and ISE 2008
32. Popat M, Barai SV: Defect detection and classification using machine learning classifier. URL: http://www.ndt.net/article/wcndt2004/pdf/in-process_ndt-nde/788_popat.pdf, accessed July '12
33. Yun JP, Park C, Yun SW, Bae H, Choi S: Surface Defect Inspection System for hot Scarfed Slab ISIS INDIA 2012. International Surface Inspection Summit; 2012.
34. Maenpaa T: Surface Quality Assessment with Advanced Texture Analysis Techniques. Proc. of International Surface Inspection Summit, Luxembourg; 2006.
35. Weiwei L, Yunhui Y, Jun L, Yao Z, Hongwei S: Automated On-Line Fast Detection for Surface Defect of Steel Strip Based on Multivariate Discriminant Function. IEEE Second International Symposium on Intelligent Information Technology Application; 2008:493–497.
36. Caleb P, Steuer M: Classification of surface defects on hot rolled steel using adaptive learning methods, KES’2000. Fourth international conference on knowledge-based intelligent engineering systems and allied technologies.Proc. 2000, 1:103–108.
37. Ünsalan C, Erçil A: Automated Inspection of Steel Structures, Recent Advances in Mechatronics. Springer-Verlag Ltd., Singapore; 1999:468–480.
38. Jeon Y, Yun JP, Choi D, Kim SW: Defect Detection Algorithm for Corner Cracks in Steel Billet using Discrete Wavelet Transform, ICROS-SICE International Joint Conference. 2009, 2769–2773.
39. Yun JP, Choi SH, Seo B, Park CH, Kim SW Proceedings of the 17th World Congress. In Defects Detection of Billet Surface Using Optimized Gabor Filters. The International Federation of Automatic Control, Korea; 2008:77–82.
40. Guo JH, Meng XD, Xiong MD: Study on defection segmentation for steel surface image based on image edge detection and fisher discriminant.J. Phys. Conf. Ser. 2006, 48:364–368.
41. Xiu-yong W, Ke X, Jin-wu X: Application of Undecimated Wavelet Transform to Surface Defect Detection of Hot Rolled Steel Plates. IEEE Congress on Image and, Signal Processing; 2008:528–532.
42. Cord A, Bach F, Jeulin D: Texture classification by statistical learning from morphological image processing: application to metallic surfaces.J. Microsc. 2010,239(2):159–166.
43. Martins LAO, Padua FLC, Almeida PEM: Automatic detection of surface defects on rolled steel using Computer Vision and Artificial Neural Networks, IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society. 2010, 1081–1086.
44. Yun JP, Park C, Bae H, Hwang H, Choi S International Conference on Control, Automation and Systems 2010, vol. 1. In Vertical Scratch Detection Algorithm for High-speed Scale-covered Steel BIC (Bar in Coil). KINTEX, Gyeonggi-do, Korea; 2010:342–345.
45. Zhenga H, Kong LX, Nahavandi S: Automatic inspection of metallic surface defects using genetic algorithms.ELSEVIER, J. Mater. Proc. Technol. 2002, 125–126:427–433.
46. Suresh BR, Fundakowski RA, Levitt TS, Overland JE: A real-time automated visual inspection system for hot steel slabs.IEEE Trans. Pattern Anal. Mach. Intell. 1983,PAMI-5(6):563–572.
47. Choi DC, Jeon YJ, Lee SJ, Yun JP, Kim SW: Oilmarks Detection Algorithm in Steel Plates, Latest Trends on Systems. I:239–242. ISBN 978–1-61804–243–9
48. Bulnes FG, Usamentiaga R, Garc’ıa DF, Molleda J: Vision-based sensor for early detection of periodical defects in Web materials.Sensors 2012, 12:10788–10809. doi:10.3390/s120810788 10.3390/s120810788
49. Shui-shan Y, Yong-hui HE, Zhen-long W, Wan-sheng Z: A Method of Steel Strip Image Segmentation Based on Local Gray Information. IEEE Internationla conference on Industrial Technology; 2008:1–4. ICIT
50. Djukic D, Spuzic S: Statistical Discriminator of Surface Defects on Hot Rolled Steel (Proceedings of Image and Vision Computing). University of Waikato, Hamilton, New Zealand; 2007:158–163.
51. Saridis GN, Brandin DM: An automatic surface inspection system for flat rolled steel, IEEE conference on decision and control including the 15th symposium on adaptive processes. 1976, 15:392–397.
52. Yichi Z, Lv W, Xuedong L: Defects Detection of Cold-roll Steel Surface Based on MATLAB, IEEE Third International Conference on Measuring Technology and Mechatronics Automation. 2011, 827–830.
53. Yang Y, Li Q, Chen P, Ang XZ: Strip Surface Defect Detection Algorithm Based on Background Difference. Second Pacific-Asia Conference on IEEE Circuits, Communications and System (PACCS); 2010:23–26.
54. Bo T, Jian-yi K, Xing-dong W, Li C, Tang B, Kong J, Wang X, Chen L: Surface Inspection System of Steel Strip Based on Machine Vision. IEEE First International Workshop on Database Technology and Applications; 2009:359–362.
55. Yun SW, Kong NW, Lee G, Park PG: Development of Defect Detection Algorithm in Cold Rolling. International Conference on Control, Automation and Systems; 2008:1729–1733.
56. Cong JH, Yan YH, Zhang HA, Li J: Real-time surface defects inspection of steel strip based on difference image, international symposium on photoelectronic detection and imaging, related technologies and applications.Proc of SPIE 2007, 6625:1–9.
57. Wu G: Online Surface Inspection Technology of Cold Rolled Strips. URL: http://cdn.intechweb.org/pdfs/9061.pdf, accessed July '12
58. Li W, Lu C, Zhang J: A local annular contrast based real time inspection algorithm for steel bar surface defects.Appl. Surf. Sci. 2010. doi:10.1016/j.apsusc.2012.03.007
59. Liu Y, Hsu Y, Sun Y, Tsai S, Ho C, Chen C: A Computer Vision System for Automatic Steel Surface Inspection. The fifth IEEE conference on Industrial Electronics and Applications (ICIEA); 2010:1667–1670.
60. Li J, Shi J, Chang TS: On-Line Seam Detection in Rolling Processes Using Snake Projection and Discrete Wavelet Transform.Transactions of the ASME 2007, 129:926–933.
61. Choi SH, Yun JP, Seo B, Park Y, Kim SW: Real-time defects detection algorithm for high-speed steel bar in coil, world academy of science.Eng Technol 2007, 25:66–70.
62. Wu G, Zhang H, Sun X, Xu J, Xu K: A Bran-new Feature Extraction Method and its application to Surface Defect Recognition of Hot Rolled Strips. Proceedings of the IEEE International Conference on Automation and Logistics, Jinan, China; 2007:2069–2074. doi:10.1109/ICAL.2007.4338916
63. Yazdchi M, Yazdi M, Mahyari AG: Steel Surface Defect Detection Using Texture Segmentation Based on Multifractal Dimension. IEEE International Conference on Digital Image Processing; 2009:346–350.
64. Jeon YJ, Choi DC, Lee SJ, Yun JP, Kim SW: Defect detection for corner cracks in steel billets using a wavelet reconstruction method.J. Opt. Soc. Am. A 2014,31(2):227–237. 10.1364/JOSAA.31.000227
65. Choi DC, Jeon YJ, Yun JP, Yun SW, Kim SW: An algorithm for detecting seam cracks in steel plates.World Acad Sci Eng Technol 2012, 6:1456–1459.
66. Jeon YJ, Choi DC, Yun JP, Park C, Bae H, Kim SW: Automated inspection algorithm for thick plate using dual light switching lighting method.World Acad Sci Eng Technol 2012, 6:1525–1528.
67. Jeon Y, Choi D, Yun J, Park C, Kim SW: Detection of Scratch Defects on Slab Surface, 1th International Conference on Control, Automation and Systems. 2011, 1274–1278.
68. Yun JP, Choi SH, Kim SW: Vision-based defect detection of scale-covered steel billet surfaces.Opt Eng 2009,48(3):1–9. 037205
69. Yun JP, Choi SH, Jeon Y, Choi D, Kim SW: Detection of line defects in steel billets using undecimated wavelet transform. International Conference on Control, Automation and Systems; 2008:1725–1728.
70. Ghorai S, Mukherjee A, Gangadaran M, Dutta PK: Automatic defect detection on Hot-rolled flat steel products.IEEE Trans Instrum Meas 2013,62(3):612–621.
71. Jiuliang Z, Weiwei L, Feng Y, Jun L, Yao Z, Yunhui Y: Research on Surface Quality Evaluation System of Steel Strip Based on Computer Vision. IEEE Third International Symposium on Intelligent Information Technology Application; 2009:32–35.
72. Lee CS, Choi C-H, Choi JY, Kim YK, Choi SH: Feature Extraction Algorithm Based on Adaptive Wavelet Packet for Surface Defect Classification, Image (Rochester, N.Y.). IEEE International conference on Image Processing; 1996:673–676. Proceedings
73. Yun JP, Choi DC, Jeon YJ, Park C, Kim SW: Defect inspection system for steel wire rods produced by hot rolling process.Int. J. Adv. Manuf. Technol. 2014, 70:1625–1634. 10.1007/s00170-013-5397-8
74. Zhang J, Kang D, Won S: Detection of Scratch Defects for Wire Rod in Steelmaking Process. International Conference on Control, Automation and Systems (Korea; 2010:319–323).
75. Park C, Choi S, Won S: Vision-based inspection for periodic defects in steel wire rod production.Opt Eng 2010,49(1):1–10. 017202
76. Blackledge JM, Dubovitskiy DA: A surface inspection machine vision system that includes fractal texture analysis, international society for advanced science and technology.J Intell Syst 2008,3(2):76–89.
77. Peng K, Zhang X: Classification Technology for Automatic Surface Defects Detection of Steel Strip Based on Improved BP Algorithm. IEEE Fifth International Conference on Natural Computation; 2009:110–114.
78. Kang G, Liu H: Surface defects inspection of cold rolled strips based on neural network. IEEE Proceedings of the Fourth International Conference on Machine Learning and Cybernetics, Guangzhou; 2005:18–21.
79. Kim KM, Lee BJ, Lyou K, Park GT: Design of a Binary Decision Tree Using the Genetic Algorithm and K-Means Algorithm for Recognition of the Defect Patterns of Cold Mill Strip. IEEE International Fuzzy Systems Conference Proceedings, Seoul, Korea; 1999:11_1081–11_1085.
80. Masci J, Meier U, Ciresan D, Fricout G: Steel Defect Classification with Max-Pooling Convolutional Neural Networks. URL: http://www.idsia.ch/~masci/papers/2012_ijcnn.pdf, accessed July '12
81. Suvdaa B, Ahn J, Ko J: Surface defects detection and classification using SIFT and voting strategy.International Journal of Software Engineering and Its Applications 2012,6(2):168–170.
82. Yunhui Y, Kechen S, Zhitao X, Xuehui F: The Strip Steel Surface Defects Classification Method Based on Weak Classifier Adaptive Enhancement, IEEE Third International Conference on Measuring Technology and Mechatronics Automation. 2011, 958–961.
83. Choi K, Koo K, Lee J: Development of defect classification algorithm for POSCO rolling strip surface inspection system.SICE-ICASE International Joint Conference 2006, 10:2499–2502.
84. Jonker PP, Duin RPW, Ridder DD: Pattern recognition for metal defect detection.Steel Grips 2003,1(1):20–23.
85. Agarwal K, Shivpuri R, Zhu Y, Chang T, Huang H: Process knowledge based multi-class support vector classification (PK-MSVM) approach for surface defects in hot rolling.ELSEVIER, Expert Systems with Applications 2011, 38:7251–7262. 10.1016/j.eswa.2010.12.026
86. Ayani A, Lago A, Cruz A: Surface Inspection of hot Rolled Seamless Tube, Journals-Chernye Metally (Ferrous Metals). 2009. #4
87. Borselli A, Colla V, Vannucci M, Veroli M: A Fuzzy Inference System Applied to Defect Detection in Flat Steel Production. IEEE International Conference on Fuzzy Systems (FUZZ); 2010:1–6.
88. Cateni S, Colla V, Vannucci M, Borselli A: Fuzzy Inference Systems Applied to Image Classification in the Industrial Field, Fuzzy Inference System - Theory and Applications. 2012.
89. Olsson J, Gruber S: Web process inspection using neural classification of scattering light.IEEE Transaction on Industrial Electronics 1993,40(2):1443–1448.
90. Xu H, Jiao H, Kiehl R, Yu W, Li F: Surface quality inspection and quality data application for Hot strip coil. URL: http://www.isisworld.com/files/pdfs/prog/24_A_1415_Xu_Surface_Quality_Inspection_and_Quality_Data_Application_for_Hot_Strip_Coil.pdf. - accessed in July '2012
91. Jin N, Zhou S, Chang T: Identification of Impacting Factors of Surface Defects in hot Rolling Processes Using Multi-Level Regression Analysis.Transactions of NAMRI/SME 2004, 32:557–564.
92. Huang H, Gutchess D, Chang T: Imaging-based In-Line Surface Defect Inspection for Bar Rolling, AIST Iron & Steel Conference and Exposition. AIST Digital Library, Nashville, TN; 2004.
93. Tivolle A, Legrand J, Keods: Fully Integrated Management of Automatic Surface Inspection Systems. India; 2012. ISIS
94. Yang S, He Y, Wang Z, Zhao W: Development and Perspective of Automatic Strip Surface Inspection System Based on Machine Vision. Metallurgical Industry Automation, 2008–02, CNKI Journal, China; 2008.
95. Chang TS, Gutchess D, Huang HH Annual Portfolio Review.The Advancement in Surface Quality Assurance for hot Rolled Steel Bars, DOE Sensors & Automation 2005, 1–19.