{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T03:54:15Z","timestamp":1778558055484,"version":"3.51.4"},"reference-count":38,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T00:00:00Z","timestamp":1581465600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To create an intelligent surface region of interests (ROI) 3D quantitative inspection strategy a reality in the continuous casting (CC) production line, an improved 3D laser image scanning system (3D-LDS) was established based on binocular imaging and deep-learning techniques. In 3D-LDS, firstly, to meet the requirements of the industrial application, the CCD laser image scanning method was optimized in high-temperature experiments and secondly, we proposed a novel region proposal method based on 3D ROI initial depth location for effectively suppressing redundant candidate bounding boxes generated by pseudo-defects in a real-time inspection process. Thirdly, a novel two-step defects inspection strategy was presented by devising a fusion deep CNN model which combined fully connected networks (for defects classification\/recognition) and fully convolutional networks (for defects delineation). The 3D-LDS\u2019 dichotomous inspection method of defects classification and delineation processes are helpful in understanding and addressing challenges for defects inspection in CC product surfaces. The applicability of the presented methods is mainly tied to the surface quality inspection for slab, strip and billet products.<\/jats:p>","DOI":"10.3390\/s20040980","type":"journal-article","created":{"date-parts":[[2020,2,20]],"date-time":"2020-02-20T03:20:03Z","timestamp":1582168803000},"page":"980","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7314-0771","authenticated-orcid":false,"given":"Liming","family":"Zhao","sequence":"first","affiliation":[{"name":"Research Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fangfang","family":"Li","sequence":"additional","affiliation":[{"name":"Research Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Research Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaodong","family":"Xu","sequence":"additional","affiliation":[{"name":"Research Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hong","family":"Xiao","sequence":"additional","affiliation":[{"name":"Research Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Feng","sequence":"additional","affiliation":[{"name":"Research Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1700312","DOI":"10.1002\/srin.201700312","article-title":"Review on modeling and simulation of continuous casting","volume":"89","author":"Thomas","year":"2018","journal-title":"Steel Res. Int."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/S0952-1976(03)00072-1","article-title":"Mathematical modeling and optimization strategies (genetic algorithm and knowledge base) applied to the continuous casting of steel","volume":"16","author":"Santos","year":"2003","journal-title":"Eng. Appl. of Artif. Intell."},{"key":"ref_3","first-page":"109","article-title":"Assessment of Surface Defects in the Continuously Cast Steel","volume":"4","author":"Popa","year":"2011","journal-title":"Acta Tech. Corviniensis-Bull. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1016\/j.apsusc.2013.09.002","article-title":"A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects","volume":"285","author":"Song","year":"2013","journal-title":"Appl. Surf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/S1006-706X(13)60102-8","article-title":"Surface Detection of Continuous Casting Slabs Based on Curvelet Transform and Kernel Locality Preserving Projections","volume":"20","author":"AI","year":"2013","journal-title":"Int. J. Iron Steel Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1063\/1.4901222","article-title":"Defect detection in slab surface: A novel dual charge-coupled device imaging-based fuzzy connectedness strategy","volume":"85","author":"Zhao","year":"2014","journal-title":"Rev. Sci. Instrum."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1179\/030192310X12683075004753","article-title":"Experiment study of surface defects in continuous casting using developed laser scanning system","volume":"38","author":"Ouyang","year":"2011","journal-title":"Ironmak. Steelmak."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1179\/1743281211Y.0000000025","article-title":"Surface Defects Inspection Method in Hot Slab Continuous Casting Process","volume":"38","author":"Zhao","year":"2011","journal-title":"Ironmak. Steelmak."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Hsu, C.Y., Huang, J.W., Kang, L.W., and Weng, M.F. (2016, January 26\u201328). Fast image stitching for continuous casting steel billet images. Proceedings of the IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), Seoul, Korea.","DOI":"10.1109\/ICCE-Asia.2016.7804815"},{"key":"ref_10","unstructured":"Hsu, C.Y., Kang, L.W., Lin, C.Y., Yeh, C.H., and Lin, C.T. (2014). Vision-Based Detection of Steel Billet Surface Defects via Fusion of Multiple Image Features, IOS Press."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s40436-014-0057-2","article-title":"Toward intelligent manufacturing: Label characters marking and recognition method for steel products with machine vision","volume":"2","author":"Zhao","year":"2014","journal-title":"Adv. Manuf."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1179\/1743281211Y.0000000005","article-title":"Experimental study on quantitative surface defect depth detection based on laser scanning technology in continuous casting","volume":"38","author":"Ouyang","year":"2011","journal-title":"Ironmak. Steelmak."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"113605","DOI":"10.1117\/1.OE.51.11.113605","article-title":"Feature extraction based on contourlet transform and its application to surface inspection of metals","volume":"11","author":"Ai","year":"2012","journal-title":"Opt. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3901\/JME.2010.08.001","article-title":"3D Detection Technique of Surface Defects for Steel Rails Based on Linear Lasers","volume":"46","author":"Xu","year":"2010","journal-title":"J. Mech. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"He, Y., Song, K., Meng, Q., and Yan, Y. (2019). An End-to-end Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features. IEEE Trans. Instrum. Meas.","DOI":"10.1109\/TIM.2019.2915404"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jiang, Z., Zhang, W., and Cui, L. (2018). Research of three dimensional laser scanning coordinate measuring machine. MATEC Web of Conferences, EDP Sciences.","DOI":"10.1051\/matecconf\/201823202015"},{"key":"ref_17","unstructured":"Marc, G., and Li, G. (2018, January 13\u201316). Inspection of Aircraft Engine Components Using Induction Thermography. Proceedings of the IEEE Canadian Conference on Electrical & Computer Engineering (CCECE), Quebec City, QC, Canada."},{"key":"ref_18","first-page":"881","article-title":"Surface defect recognition for moderately thick plates based on a SIFT operator","volume":"58","author":"Peng","year":"2018","journal-title":"J. Tsinghua Univ. (Sci. Technol.)"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhao, L., Zhang, Y., Xu, X., Xiao, H., and Huang, C. (2016). Defect inspection in hot slab surface: Multi-source CCD imaging based fuzzy-rough sets method. Proc. SPIE 9971, Applications of Digital Image Processing, SPIE.","DOI":"10.1117\/12.2239254"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ferguson, M., Ak, R., Lee, Y.T.T., and Law, K.H. (2017, January 11\u201314). Automatic localization of casting defects with convolutional neural networks. Proceedings of the IEEE International Conference on Big Data (Big Data), Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258115"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lee, J.H., Oh, H.M., and Kim, M.Y. (2019, January 11\u201313). Deep learning based 3D defect detection system using photometric stereo illumination. Proceedings of the International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan.","DOI":"10.1109\/ICAIIC.2019.8669005"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.optlaseng.2019.01.011","article-title":"Surface defect classification of steels with a new semi-supervised learning method","volume":"117","author":"Di","year":"2019","journal-title":"Opt. Lasers Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"102144","DOI":"10.1016\/j.ndteint.2019.102144","article-title":"Approaches for improvement of the X-ray image defect detection of automobile casting aluminum parts based on deep learning","volume":"107","author":"Du","year":"2019","journal-title":"NDT E Int."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Veitch-Michaelis, J., Tao, Y., Walton, D., Muller, J.P., Crutchley, B., Storey, J., Paterson, C., and Chown, A. (2016, January 1). Crack Detection in \u201cAs-Cast\u201d Steel Using Laser Triangulation and Machine Learning. Proceedings of the 13th Conference on Computer and Robot Vision (CRV), Victoria, BC, Canada.","DOI":"10.1109\/CRV.2016.55"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Dong, H., Song, K., He, Y., Xu, J., Yan, Y., and Meng, Q. (2020). PGA-Net: Pyramid Feature Fusion and Global Context Attention Network for Automated Surface Defect Detection. IEEE Trans. Ind. Inform.","DOI":"10.1109\/TII.2019.2958826"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Saiz, F.A., Serrano, I., Barandiar\u00e1n, I., and S\u00e1nchez, J.R. (2018, January 25). A Robust and Fast Deep Learning-Based Method for Defect Classification in Steel Surfaces. Proceedings of the International Conference on Intelligent Systems (IS), Funchal-Madeira, Portugal.","DOI":"10.1109\/IS.2018.8710501"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1179\/030192310X12816231892341","article-title":"Simulation study on radiative imaging of pulverised coal combustion in blast furnace raceway","volume":"38","author":"Ouyang","year":"2011","journal-title":"Ironmak. Steelmak."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1007\/s00138-008-0135-1","article-title":"Computer vision system for high temperature measurements of surface properties","volume":"20","author":"Fabijanska","year":"2009","journal-title":"Mach. Vis. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.bios.2016.07.115","article-title":"A review of recent progress in lens-free imaging and sensing","volume":"88","author":"Roy","year":"2017","journal-title":"Biosens. Bioelectron."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","article-title":"Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning","volume":"35","author":"Shin","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_32","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (, January June). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_33","unstructured":"Olaf, R., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/s00521-016-2401-x","article-title":"Text classification based on deep belief network and softmax regression","volume":"1","author":"Jiang","year":"2018","journal-title":"Neural Comput. Appl."},{"key":"ref_35","unstructured":"Jiwoong, I.D., Tao, M., and Branson, K. (2016). An empirical analysis of the optimization of deep network loss surfaces. arXiv."},{"key":"ref_36","unstructured":"Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv."},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Shamir, R.R., Duchin, Y., Kim, J., Sapiro, G., and Harel, N. (2019). Continuous dice coefficient: A method for evaluating probabilistic segmentations. arXiv.","DOI":"10.1101\/306977"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/4\/980\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:57:07Z","timestamp":1760173027000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/4\/980"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,12]]},"references-count":38,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20040980"],"URL":"https:\/\/doi.org\/10.3390\/s20040980","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,12]]}}}