{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T09:48:20Z","timestamp":1772790500594,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2021,7,25]],"date-time":"2021-07-25T00:00:00Z","timestamp":1627171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Korean government (MSIT)","award":["2017-0-00162"],"award-info":[{"award-number":["2017-0-00162"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this study, we present a framework for product quality inspection based on deep learning techniques. First, we categorize several deep learning models that can be applied to product inspection systems. In addition, we explain the steps for building a deep-learning-based inspection system in detail. Second, we address connection schemes that efficiently link deep learning models to product inspection systems. Finally, we propose an effective method that can maintain and enhance a product inspection system according to improvement goals of the existing product inspection systems. The proposed system is observed to possess good system maintenance and stability owing to the proposed methods. All the proposed methods are integrated into a unified framework and we provide detailed explanations of each proposed method. In order to verify the effectiveness of the proposed system, we compare and analyze the performance of the methods in various test scenarios. We expect that our study will provide useful guidelines to readers who desire to implement deep-learning-based systems for product inspection.<\/jats:p>","DOI":"10.3390\/s21155039","type":"journal-article","created":{"date-parts":[[2021,7,25]],"date-time":"2021-07-25T22:07:00Z","timestamp":1627250820000},"page":"5039","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Product Inspection Methodology via Deep Learning: An Overview"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1671-2075","authenticated-orcid":false,"given":"Tae-Hyun","family":"Kim","sequence":"first","affiliation":[{"name":"Data Science Team, Hyundai Mobis, Seoul 06141, Korea"}]},{"given":"Hye-Rin","family":"Kim","sequence":"additional","affiliation":[{"name":"Data Science Team, Hyundai Mobis, Seoul 06141, Korea"}]},{"given":"Yeong-Jun","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence Convergence, Chonnam National University, Gwangju 61186, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,25]]},"reference":[{"key":"ref_1","unstructured":"Putera, S.I., and Ibrahim, Z. (2010, January 22\u201324). Printed circuit board defect detection using mathematical morphology and MATLAB image processing tools. Proceedings of the 2010 2nd International Conference on Education Technology and Computer, Shanghai, China."},{"key":"ref_2","first-page":"1897","article-title":"PCB defect detection using image processing and embedded system","volume":"3","author":"Dave","year":"2016","journal-title":"Int. Res. J. Eng. Technol. (IRJET)"},{"key":"ref_3","first-page":"1528","article-title":"CNN-based reference comparison method for classifying bare PCB defects","volume":"2018","author":"Wei","year":"2018","journal-title":"J. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"093104","DOI":"10.1117\/1.OE.56.9.093104","article-title":"Yarn-dyed fabric defect classification based on convolutional neural network","volume":"56","author":"Jing","year":"2017","journal-title":"Opt. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.ifacol.2018.09.412","article-title":"Real-time detection of steel strip surface defects based on improved yolo detection network","volume":"51","author":"Li","year":"2018","journal-title":"IFAC-PapersOnLine"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, X., Zhou, Y., and Chen, H. (2019, January 12\u201314). Rail surface defect detection based on deep learning. Proceedings of the Eleventh International Conference on Graphics and Image Processing (ICGIP 2019), Hangzhou, China.","DOI":"10.1117\/12.2557212"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_8","unstructured":"Soini, A. (2001, January 19\u201321). Machine vision technology take-up in industrial applications. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis (ISPA 2001), Pula, Croatia."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.compind.2018.03.030","article-title":"Automated vision system for quality inspection of slate slabs","volume":"99","author":"Iglesias","year":"2018","journal-title":"Comput. Ind."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhang, J., Ma, M., Chen, Z., Yue, S., He, T., and Xu, X. (2018). A high precision quality inspection system for steel bars based on machine vision. Sensors, 18.","DOI":"10.3390\/s18082732"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/s10845-008-0074-8","article-title":"A case-based evolutionary model for defect classification of printed circuit board images","volume":"19","author":"Chang","year":"2008","journal-title":"J. Intell. Manuf."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chaudhary, V., Dave, I.R., and Upla, K.P. (2017, January 22\u201324). Automatic visual inspection of printed circuit board for defect detection and classification. Proceedings of the 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), Chennai, India.","DOI":"10.1109\/WiSPNET.2017.8299858"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"101101","DOI":"10.1016\/j.aei.2020.101101","article-title":"Predictive model-based quality inspection using Machine Learning and Edge Cloud Computing","volume":"45","author":"Schmitt","year":"2020","journal-title":"Adv. Eng. Inform."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Benbarrad, T., Salhaoui, M., Kenitar, S.B., and Arioua, M. (2021). Intelligent Machine Vision Model for Defective Product Inspection Based on Machine Learning. J. Sens. Actuator Netw., 10.","DOI":"10.3390\/jsan10010007"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yang, Y., Pan, L., Ma, J., Yang, R., Zhu, Y., Yang, Y., and Zhang, L. (2020). A High-Performance Deep Learning Algorithm for the Automated Optical Inspection of Laser Welding. Appl. Sci., 10.","DOI":"10.3390\/app10030933"},{"key":"ref_17","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_18","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"49885","DOI":"10.1109\/ACCESS.2020.2979755","article-title":"A steel surface defect recognition algorithm based on improved deep learning network model using feature visualization and quality evaluation","volume":"8","author":"Guan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hao, R., Lu, B., Cheng, Y., Li, X., and Huang, B. (2020). A steel surface defect inspection approach towards smart industrial monitoring. J. Intell. Manuf., 1\u201311.","DOI":"10.1007\/s10845-020-01670-2"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wang, X., Gao, Y., Dong, J., Qin, X., Qi, L., Ma, H., and Liu, J. (2018, January 26\u201328). Surface defects detection of paper dish based on Mask R-CNN. Proceedings of the Third International Workshop on Pattern Recognition, Beijing, China.","DOI":"10.1117\/12.2502097"},{"key":"ref_22","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_23","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/j.jmsy.2020.03.009","article-title":"Automated defect inspection system for metal surfaces based on deep learning and data augmentation","volume":"55","author":"Yun","year":"2020","journal-title":"J. Manuf. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5748","DOI":"10.1109\/TIE.2019.2931220","article-title":"Fault diagnosis in microelectronics attachment via deep learning analysis of 3-D laser scans","volume":"67","author":"Dimitriou","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4498","DOI":"10.1109\/TIE.2020.2984453","article-title":"Inspection of Imprint Defects in Stamped Metal Surfaces Using Deep Learning and Tracking","volume":"68","author":"Block","year":"2021","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal Loss for Dense Object Detection. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kotsiopoulos, T., Leontaris, L., Dimitriou, N., Ioannidis, D., Oliveira, F., Sacramento, J., Amanatiadis, S., Karagiannis, G., Votis, K., and Tzovaras, D. (2020). Deep multi-sensorial data analysis for production monitoring in hard metal industry. Int. J. Adv. Manuf. Technol., 14.","DOI":"10.1007\/s00170-020-06173-1"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1016\/j.apsusc.2013.09.002","article-title":"A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects","volume":"285","author":"Song","year":"2013","journal-title":"Appl. Surf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1007\/s10845-019-01476-x","article-title":"Segmentation-based deep-learning approach for surface-defect detection","volume":"31","author":"Tabernik","year":"2020","journal-title":"J. Intell. Manuf."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bao, Y., Song, K., Liu, J., Wang, Y., Yan, Y., Yu, H., and Li, X. (2021). Triplet-Graph Reasoning Network for Few-shot Metal Generic Surface Defect Segmentation. IEEE Trans. Instrum. Meas.","DOI":"10.1109\/TIM.2021.3083561"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_36","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial networks. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_38","unstructured":"Karras, T., Aila, T., Laine, S., and Lehtinen, J. (2017). Progressive growing of gans for improved quality, stability, and variation. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Tan, M., Pang, R., and Le, Q.V. (2020, January 13\u201319). Efficientdet: Scalable and efficient object detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ben-David, S., Blitzer, J., Crammer, K., and Pereira, F. (2007, January 3\u20136). Analysis of representations for domain adaptation. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.","DOI":"10.7551\/mitpress\/7503.003.0022"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"150","DOI":"10.5626\/KTCP.2020.26.3.150","article-title":"A PCB Inspection with Semi-Supervised ADDA Networks","volume":"26","author":"Kim","year":"2020","journal-title":"KIISE Trans. Comput. Pract."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/S1364-6613(99)01294-2","article-title":"Catastrophic forgetting in connectionist networks","volume":"3","author":"French","year":"1999","journal-title":"Trends Cogn. Sci."},{"key":"ref_46","unstructured":"Tong, S., and Chang, E. (October, January 30). Support vector machine active learning for image retrieval. Proceedings of the Ninth ACM International Conference on Multimedia, Ottawa, ON, Canada."},{"key":"ref_47","unstructured":"Jung, A.B., Wada, K., Crall, J., Tanaka, S., Graving, J., Reinders, C., Yadav, S., Banerjee, J., Vecsei, G., and Kraft, A. (2020, February 01). Imgaug. Available online: https:\/\/github.com\/aleju\/imgaug."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Haniff, H., Sulaiman, M., Shah, H., and Teck, L. (2011, January 25\u201328). Shape-based matching: Defect inspection of glue process in vision system. Proceedings of the 2011 IEEE Symposium on Industrial Electronics and Applications, Langkawi, Malaysia.","DOI":"10.1109\/ISIEA.2011.6108771"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kletti, J. (2007). Manufacturing Execution System-MES, Springer.","DOI":"10.1007\/978-3-540-49744-8"},{"key":"ref_53","unstructured":"Reis, R.A., and Webb John, W. (1998). Programmable Logic Controllers: Principles and Applications, Prentice Hall."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/15\/5039\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:34:47Z","timestamp":1760164487000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/15\/5039"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,25]]},"references-count":53,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21155039"],"URL":"https:\/\/doi.org\/10.3390\/s21155039","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,25]]}}}