{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T05:46:13Z","timestamp":1782452773970,"version":"3.54.5"},"reference-count":27,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,1,24]],"date-time":"2022-01-24T00:00:00Z","timestamp":1642982400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents an automatic system for the quality control of metallic components using a photometric stereo-based sensor and a customized semantic segmentation network. This system is designed based on interoperable modules, and allows capturing the knowledge of the operators to apply it later in automatic defect detection. A salient contribution is the compact representation of the surface information achieved by combining photometric stereo images into a RGB image that is fed to a convolutional segmentation network trained for surface defect detection. We demonstrate the advantage of this compact surface imaging representation over the use of each photometric imaging source of information in isolation. An empirical analysis of the performance of the segmentation network on imaging samples of materials with diverse surface reflectance properties is carried out, achieving Dice performance index values above 0.83 in all cases. The results support the potential of photometric stereo in conjunction with our semantic segmentation network.<\/jats:p>","DOI":"10.3390\/s22030882","type":"journal-article","created":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T21:07:11Z","timestamp":1643144831000},"page":"882","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Photometric Stereo-Based Defect Detection System for Steel Components Manufacturing Using a Deep Segmentation Network"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6065-7029","authenticated-orcid":false,"given":"F\u00e1tima A.","family":"Saiz","sequence":"first","affiliation":[{"name":"Vicomtech Foundation, Basque Research and Technology Alliance (BRTA), Mikeletegi 57, 20009 Donostia-San Sebasti\u00e1n, Spain"},{"name":"Computational Intelligence Group, Computer Science Faculty, University of the Basque Country, UPV\/EHU, 20018 Donostia-San Sebasti\u00e1n, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"I\u00f1igo","family":"Barandiaran","sequence":"additional","affiliation":[{"name":"Vicomtech Foundation, Basque Research and Technology Alliance (BRTA), Mikeletegi 57, 20009 Donostia-San Sebasti\u00e1n, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1439-2178","authenticated-orcid":false,"given":"Ander","family":"Arbelaiz","sequence":"additional","affiliation":[{"name":"Vicomtech Foundation, Basque Research and Technology Alliance (BRTA), Mikeletegi 57, 20009 Donostia-San Sebasti\u00e1n, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7373-4097","authenticated-orcid":false,"given":"Manuel","family":"Gra\u00f1a","sequence":"additional","affiliation":[{"name":"Computational Intelligence Group, Computer Science Faculty, University of the Basque Country, UPV\/EHU, 20018 Donostia-San Sebasti\u00e1n, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1108\/09576069310023838","article-title":"Manual, hybrid and automated inspection literature and current research","volume":"4","author":"Kopardekar","year":"1993","journal-title":"Integr. Manuf. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/BF02478259","article-title":"A logical calculus of the ideas immanent in nervous activity","volume":"5","author":"McCulloch","year":"1943","journal-title":"Bull. Math. Biophys."},{"key":"ref_3","unstructured":"Hebb, D.O. (1949). The Organisation of Behaviour: A Neuropsychological Theory, Science Editions."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1037\/h0042519","article-title":"The perceptron: A probabilistic model for information storage and organization in the brain","volume":"65","author":"Rosenblatt","year":"1958","journal-title":"Psychol. Rev."},{"key":"ref_5","unstructured":"Ivakhnenko, A. (1966). Cybernetic Predicting Devices, Purdue University."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.inffus.2020.09.006","article-title":"A survey on deep learning in medicine: Why, how and when?","volume":"66","author":"Piccialli","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_7","unstructured":"Minaee, S., Abdolrashidi, A., Su, H., Bennamoun, M., and Zhang, D. (2021). Biometrics Recognition Using Deep Learning: A Survey. arXiv."},{"key":"ref_8","first-page":"63","article-title":"Deep Learning for Robotics","volume":"9","author":"Mouha","year":"2021","journal-title":"J. Data Anal. Inf. Process."},{"key":"ref_9","unstructured":"Chilimbi, T., Suzue, Y., Apacible, J., and Kalyanaraman, K. (2014, January 6\u20138). Project Adam: Building an Efficient and Scalable Deep Learning Training System. Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14), Broomfield, CO, USA."},{"key":"ref_10","unstructured":"Gjoreski, H., Bizjak, J., Gjoreski, M., and Gams, M. (2016, January 9\u201315). Comparing deep and classical machine learning methods for human activity recognition using wrist accelerometer. Proceedings of the IJCAI 2016 Workshop on Deep Learning for Artificial Intelligence, New York, NY, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Artusi, A., Banterle, F., and Chetverikov, D. (2011). A Survey of Specularity Removal Methods, Wiley Online Library.","DOI":"10.1111\/j.1467-8659.2011.01971.x"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2711","DOI":"10.1364\/AO.48.002711","article-title":"Simple and efficient method for specularity removal in a image","volume":"48","author":"Shen","year":"2009","journal-title":"Appl. Opt."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Huang, S., Xu, K., Li, M., and Wu, M. (2019). Improved Visual Inspection through 3D Image Reconstruction of Defects Based on the Photometric Stereo Technique. Sensors, 19.","DOI":"10.3390\/s19224970"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Fang, X., Luo, Q., Zhou, B., Li, C., and Tian, L. (2020). Research progress of automated visual surface defect detection for industrial metal planar materials. Sensors, 20.","DOI":"10.3390\/s20185136"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1117\/12.956740","article-title":"Photometric stereo: A reflectance map technique for determining surface orientation from image intensity","volume":"Volume 155","author":"Woodham","year":"1979","journal-title":"Image Understanding Systems and Industrial Applications I"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Soukup, D., and Huber-M\u00f6rk, R. (2014, January 8\u201310). Convolutional neural networks for steel surface defect detection from photometric stereo images. Proceedings of the International Symposium on Visual Computing, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-14249-4_64"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4205","DOI":"10.1007\/s12652-020-01803-8","article-title":"Localization and segmentation of metal cracks using deep learning","volume":"12","author":"Aslam","year":"2021","journal-title":"J. Ambient. Intell. Humaniz. Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/S1076-6332(03)00671-8","article-title":"Statistical validation of image segmentation quality based on a spatial overlap index1: Scientific reports","volume":"11","author":"Zou","year":"2004","journal-title":"Acad. Radiol."},{"key":"ref_19","first-page":"1","article-title":"Deep Learning-Based Generic Automatic Surface Defect Inspection (ASDI) With Pixelwise Segmentation","volume":"70","author":"Wu","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_20","unstructured":"Horn, B.K., and Brooks, M.J. (1989). Shape from Shading, MIT Press."},{"key":"ref_21","first-page":"531","article-title":"Shape from shading and photometric stereo methods","volume":"2","author":"Klette","year":"1998","journal-title":"Handb. Comput. Vis. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1239","DOI":"10.1109\/TPAMI.2003.1233898","article-title":"The 4-Source Photometric Stereo Technique for Three-Dimensional Surfaces in the Presence of Highlights and Shadows","volume":"25","author":"Barsky","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1017\/S0305004100030401","article-title":"A generalized inverse for matrices","volume":"Volume 51","author":"Penrose","year":"1955","journal-title":"Mathematical Proceedings of the Cambridge Philosophical Society"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5637","DOI":"10.1007\/s10462-020-09830-9","article-title":"Image segmentation evaluation: A survey of methods","volume":"53","author":"Wang","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, H., Xiong, P., Fan, H., and Sun, J. (2019). DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation. arXiv.","DOI":"10.1109\/CVPR.2019.00975"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.","DOI":"10.1007\/978-3-319-24574-4_28"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/882\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:06:39Z","timestamp":1760133999000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/882"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,24]]},"references-count":27,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22030882"],"URL":"https:\/\/doi.org\/10.3390\/s22030882","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,24]]}}}