{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T18:29:28Z","timestamp":1776709768587,"version":"3.51.2"},"reference-count":35,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T00:00:00Z","timestamp":1600300800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51705273"],"award-info":[{"award-number":["51705273"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Locating and identifying the components mounted on a printed circuit board (PCB) based on machine vision is an important and challenging problem for automated PCB inspection and automated PCB recycling. In this paper, we propose a PCB semantic segmentation method based on depth images that segments and recognizes components in the PCB through pixel classification. The image training set for the PCB was automatically synthesized with graphic rendering. Based on a series of concentric circles centered at the given depth pixel, we extracted the depth difference features from the depth images in the training set to train a random forest pixel classifier. By using the constructed random forest pixel classifier, we performed semantic segmentation for the PCB to segment and recognize components in the PCB through pixel classification. Experiments on both synthetic and real test sets were conducted to verify the effectiveness of the proposed method. The experimental results demonstrate that our method can segment and recognize most of the components from a real depth image of the PCB. Our method is immune to illumination changes and can be implemented in parallel on a GPU.<\/jats:p>","DOI":"10.3390\/s20185318","type":"journal-article","created":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T08:29:43Z","timestamp":1600331383000},"page":"5318","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":35,"title":["Semantic Segmentation of a Printed Circuit Board for Component Recognition Based on Depth Images"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0327-5205","authenticated-orcid":false,"given":"Dongnian","family":"Li","sequence":"first","affiliation":[{"name":"School of Mechanical &amp; Automotive Engineering, Qingdao University of Technology, Qingdao 266525, China"}]},{"given":"Changming","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical &amp; Automotive Engineering, Qingdao University of Technology, Qingdao 266525, China"}]},{"given":"Chengjun","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Mechanical &amp; Automotive Engineering, Qingdao University of Technology, Qingdao 266525, China"}]},{"given":"Zhengxu","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Mechanical &amp; Automotive Engineering, Qingdao University of Technology, Qingdao 266525, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1109\/TII.2006.877265","article-title":"Application of neural networks in optical inspection and classification of solder joints in surface mount technology","volume":"2","author":"Acciani","year":"2006","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4110","DOI":"10.1016\/j.ijleo.2012.12.030","article-title":"Solder joint inspection based on neural network combined with genetic algorithm","volume":"124","author":"Hao","year":"2013","journal-title":"Optik"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1109\/6104.846932","article-title":"Solder joints inspection using a neural network and fuzzy rule-based classification method","volume":"23","author":"Ko","year":"2000","journal-title":"IEEE T. Electron. Pack."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1016\/j.rcim.2014.03.003","article-title":"An inspection and classification method for chip solder joints using color grads and Boolean rules","volume":"30","author":"Wu","year":"2014","journal-title":"Robot. Cim. Int. Manuf."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"101004","DOI":"10.1016\/j.aei.2019.101004","article-title":"Soldering defect detection in automatic optical inspection","volume":"43","author":"Dai","year":"2020","journal-title":"Adv. Eng. Inform."},{"key":"ref_6","first-page":"516","article-title":"Classification of solder joint using feature selection based on Bayes and support vector machine","volume":"3","author":"Wu","year":"2013","journal-title":"IEEE Trans. Comp. Pack. Man."},{"key":"ref_7","first-page":"2018","article-title":"Solder joint inspection method for chip component using improved AdaBoost and decision tree","volume":"1","author":"Hongwei","year":"2011","journal-title":"IEEE Trans. Comp. Pack. Man."},{"key":"ref_8","first-page":"300","article-title":"IC solder joint inspection via robust principle component analysis","volume":"7","author":"Cai","year":"2017","journal-title":"IEEE Trans. Comp. Pack. Man."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3002","DOI":"10.1016\/j.microrel.2012.06.135","article-title":"Defect detection of flip-chip solder joints using modal analysis","volume":"52","author":"Liu","year":"2012","journal-title":"Microelectron. Reliab."},{"key":"ref_10","first-page":"161","article-title":"A new IC solder joint inspection method for an automatic optical inspection system based on an improved visual background extraction algorithm","volume":"6","author":"Cai","year":"2015","journal-title":"IEEE Trans. Comp. Pack. Man."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1109\/28.753638","article-title":"Printed circuit board inspection using image analysis","volume":"35","author":"Loh","year":"1999","journal-title":"IEEE Trans. Ind. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/s00170-006-0730-0","article-title":"Automated inspection of PCB components using a genetic algorithm template-matching approach","volume":"35","author":"Crispin","year":"2007","journal-title":"Int. J. Adv. Manuf. Tech."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1007\/s00170-010-2850-9","article-title":"Algorithm of locating PCB components based on colour distribution of solder joints","volume":"53","author":"Zeng","year":"2011","journal-title":"Int. J. Adv. Manuf. Tech."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Herchenbach, D., Li, W., and Breier, M. (2013, January 29\u201331). Segmentation and classification of THCs on PCBAs. Proceedings of the 2013 11th IEEE International Conference on Industrial Informatics (INDIN), Bochum, Germany.","DOI":"10.1109\/INDIN.2013.6622858"},{"key":"ref_15","unstructured":"Li, W., Esders, B., and Breier, M. (2013, January 29\u201331). SMD segmentation for automated PCB recycling. Proceedings of the 2013 11th IEEE International Conference on Industrial Informatics (INDIN), Bochum, Germany."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lim, D.U., Kim, Y.G., and Park, T.H. (2019, January 25\u201327). SMD classification for automated optical inspection machine using convolution neural network. Proceedings of the 2019 Third IEEE International Conference on Robotic Computing (IRC), Naples, Italy.","DOI":"10.1109\/IRC.2019.00072"},{"key":"ref_17","unstructured":"De Oliveira, T.J.M., Wehrmeister, M.A., and Nassu, B.T. (2017, January 17\u201318). Detecting modifications in printed circuit boards from fuel pump controllers. Proceedings of the 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Niter\u00f3i, Brazil."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lin, S.C., Chou, C.H., and Su, C.H. (2007, January 5\u20138). A development of visual inspection system for surface mounted devices on printed circuit board. Proceedings of the IECON 2007-33rd Annual Conference of the IEEE Industrial Electronics Society, Taipei, Taiwan.","DOI":"10.1109\/IECON.2007.4459975"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1016\/j.rcim.2011.03.007","article-title":"Design and development of automatic visual inspection system for PCB manufacturing","volume":"27","author":"Mar","year":"2011","journal-title":"Robot. Cim. Int. Manuf."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/S0360-8352(01)00016-X","article-title":"A three-dimensional automated visual inspection system for SMT assembly","volume":"40","author":"Guerra","year":"2001","journal-title":"Comput. Ind. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Leta, F.R., and Feliciano, F.F. (2008, January 25\u201328). Computational system to detect defects in mounted and bare PCB based on connectivity and image correlation. Proceedings of the 2008 15th International Conference on Systems, Signals and Image Processing, Bratislava, Slovakia.","DOI":"10.1109\/IWSSIP.2008.4604434"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1109\/TSMCB.2003.817037","article-title":"A Bayesian framework for multilead SMD post-placement quality inspection","volume":"34","author":"Zervakis","year":"2004","journal-title":"IEEE Trans. Syst. Man Cybern. B"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mashohor, S., Evans, J.R., and Erdogan, A.T. (2006, January 15\u201318). Automatic hybrid genetic algorithm based printed circuit board inspection. Proceedings of the First NASA\/ESA Conference on Adaptive Hardware and Systems (AHS\u201906), Istanbul, Turkey.","DOI":"10.1109\/AHS.2006.28"},{"key":"ref_24","first-page":"2088","article-title":"Automated PCB identification and defect-detection system (APIDS)","volume":"9","author":"Rehman","year":"2019","journal-title":"Int. J. Electr. Comput. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"633","DOI":"10.3390\/s18020633","article-title":"Exploring 3D human action recognition: From offline to online","volume":"18","author":"Li","year":"2018","journal-title":"Sensors"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. (2011, January 20\u201325). Real-time human pose recognition in parts from single depth images. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995316"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2821","DOI":"10.1109\/TPAMI.2012.241","article-title":"Efficient human pose estimation from single depth images","volume":"35","author":"Shotton","year":"2013","journal-title":"IEEE Trans. Pattern. Anal."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Girshick, R., Shotton, J., Kohli, P., Criminisi, A., and Fitzgibbon, A. (2011, January 6\u201313). Efficient regression of general-activity human poses from depth images. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126270"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Fossati, A., Gall, J., Grabner, H., Ren, X., and Konolige, K. (2013). Real time hand pose estimation using depth sensors. Consumer Depth Cameras for Computer Vision, Advances in Computer Vision and Pattern Recognition, Springer.","DOI":"10.1007\/978-1-4471-4640-7"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Keskin, C., K\u0131ra\u00e7, F., Kara, Y.E., and Akarun, L. (2012, January 7\u201313). Hand pose estimation and hand shape classification using multi-layered randomized decision forests. Proceedings of the 2012 European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33783-3_61"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., and Wei, Y. (2015, January 18\u201323). Accurate, robust, and flexible real-time hand tracking. Proceedings of the 33rd Annual Acm Conference on Human Factors in Computing Systems (CHI\u201915), Seoul, Korea.","DOI":"10.1145\/2702123.2702179"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1145\/2629500","article-title":"Real-time continuous pose recovery of human hands using convolutional networks","volume":"33","author":"Tompson","year":"2014","journal-title":"ACM Trans. Graphic."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Pramerdorfer, C., and Kampel, M. (2015, January 11\u201314). PCB recognition using local features for recycling purposes. Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), Berlin, Germany.","DOI":"10.5220\/0005289200710078"},{"key":"ref_34","unstructured":"Breiman, L. (1984). Classification and Regression Trees, Routledge. [1st ed.]."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5318\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:10:54Z","timestamp":1760177454000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5318"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,17]]},"references-count":35,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185318"],"URL":"https:\/\/doi.org\/10.3390\/s20185318","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,17]]}}}