{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T14:51:47Z","timestamp":1774968707787,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,31]],"date-time":"2023-01-31T00:00:00Z","timestamp":1675123200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Research and Development Program in Jiangsu  Province","award":["BE2022828"],"award-info":[{"award-number":["BE2022828"]}]},{"name":"Key Research and Development Program in Jiangsu  Province","award":["62001112"],"award-info":[{"award-number":["62001112"]}]},{"name":"Young Scientists Fund of the National Natural Science Foundation of  China","award":["BE2022828"],"award-info":[{"award-number":["BE2022828"]}]},{"name":"Young Scientists Fund of the National Natural Science Foundation of  China","award":["62001112"],"award-info":[{"award-number":["62001112"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Poor chip solder joints can severely affect the quality of the finished printed circuit boards (PCBs). Due to the diversity of solder joint defects and the scarcity of anomaly data, it is a challenging task to automatically and accurately detect all types of solder joint defects in the production process in real time. To address this issue, we propose a flexible framework based on contrastive self-supervised learning (CSSL). In this framework, we first design several special data augmentation approaches to generate abundant synthetic, not good (sNG) data from the normal solder joint data. Then, we develop a data filter network to distill the highest quality data from sNG data. Based on the proposed CSSL framework, a high-accuracy classifier can be obtained even when the available training data are very limited. Ablation experiments verify that the proposed method can effectively improve the ability of the classifier to learn normal solder joint (OK) features. Through comparative experiments, the classifier trained with the help of the proposed method can achieve an accuracy of 99.14% on the test set, which is better than other competitive methods. In addition, its reasoning time is less than 6 ms per chip image, which is in favor of the real-time defect detection of chip solder joints.<\/jats:p>","DOI":"10.3390\/e25020268","type":"journal-article","created":{"date-parts":[[2023,2,1]],"date-time":"2023-02-01T02:29:03Z","timestamp":1675218543000},"page":"268","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A Novel Contrastive Self-Supervised Learning Framework for Solving Data Imbalance in Solder Joint Defect Detection"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5177-5581","authenticated-orcid":false,"given":"Jing","family":"Zhou","sequence":"first","affiliation":[{"name":"College of Biological Sciences and Medical Engineering, Southeast University, Nanjing 210096, China"}]},{"given":"Guang","family":"Li","sequence":"additional","affiliation":[{"name":"College of Biological Sciences and Medical Engineering, Southeast University, Nanjing 210096, China"}]},{"given":"Ruifeng","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Biological Sciences and Medical Engineering, Southeast University, Nanjing 210096, China"}]},{"given":"Ruiyang","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Biological Sciences and Medical Engineering, Southeast University, Nanjing 210096, China"}]},{"given":"Shouhua","family":"Luo","sequence":"additional","affiliation":[{"name":"College of Biological Sciences and Medical Engineering, Southeast University, Nanjing 210096, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,31]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"PCBNet: A Lightweight Convolutional Neural Network for Defect Inspection in Surface Mount Technology","volume":"71","author":"Wu","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kuttiyil Thomas, O.T., and Gopalan, P.P. (2022). Electronics Production Defects and Analysis, Springer.","DOI":"10.1007\/978-981-16-9824-8"},{"key":"ref_3","unstructured":"Schubeck, J., Koblah, D., Botero, U.J., and Forte, D. (2023, January 22). A Comprehensive Taxonomy of PCB Defects. Available online: https:\/\/dforte.ece.ufl.edu\/wp-content\/uploads\/sites\/65\/2022\/02\/A_Comprehensive_Taxonomy_of_PCB_Defects.pdf."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIM.2022.3154814","article-title":"Deep Siamese Semantic Segmentation Network for PCB Welding Defect Detection","volume":"71","author":"Ling","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dorj, E., Chen, C., and Pecht, M. (2013, January 2\u20139). A bayesian hidden markov model-based approach for anomaly detection in electronic systems. Proceedings of the 2013 IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2013.6497204"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"100379","DOI":"10.1016\/j.cosrev.2021.100379","article-title":"A survey on deep learning and its applications","volume":"40","author":"Dong","year":"2021","journal-title":"Comput. Sci. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-020-00392-9","article-title":"Deep Learning applications for COVID-19","volume":"8","author":"Shorten","year":"2021","journal-title":"J. Big Data"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-020-00376-2","article-title":"Deep learning-enabled medical computer vision","volume":"4","author":"Esteva","year":"2021","journal-title":"NPJ Digit. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"6323","DOI":"10.32604\/cmc.2022.021716","article-title":"Deep learning based intelligent industrial fault diagnosis model","volume":"70","author":"Surendran","year":"2022","journal-title":"CMC-Comput. Mater. Contin."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1109\/TII.2021.3084139","article-title":"Structural scheduling of transient control under energy storage systems by sparse-promoting reinforcement learning","volume":"18","author":"Sun","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3439950","article-title":"Deep learning for anomaly detection: A review","volume":"54","author":"Pang","year":"2021","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_12","first-page":"3523","article-title":"Image segmentation using deep learning: A survey","volume":"44","author":"Minaee","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yang, L., Ghosh, R.P., Franklin, J.M., Chen, S., You, C., Narayan, R.R., Melcher, M.L., and Liphardt, J.T. (2020). NuSeT: A deep learning tool for reliably separating and analyzing crowded cells. PLoS Comput. Biol., 16.","DOI":"10.1371\/journal.pcbi.1008193"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"You, C., Zhao, R., Staib, L., and Duncan, J.S. (2021). Momentum contrastive voxel-wise representation learning for semi-supervised volumetric medical image segmentation. arXiv.","DOI":"10.1007\/978-3-031-16440-8_61"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"102469","DOI":"10.1016\/j.simpat.2021.102469","article-title":"Deep residual networks-based intelligent fault diagnosis method of planetary gearboxes in cloud environments","volume":"116","author":"Huang","year":"2022","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"8005","DOI":"10.1109\/TIE.2019.2942548","article-title":"Multitask convolutional neural network with information fusion for bearing fault diagnosis and localization","volume":"67","author":"Guo","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1109\/TCPMT.2018.2789453","article-title":"SMT solder joint inspection via a novel cascaded convolutional neural network","volume":"8","author":"Cai","year":"2018","journal-title":"IEEE Trans. Compon. Packag. Manuf. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1109\/TCPMT.2019.2952393","article-title":"Solder joint recognition using mask R-CNN method","volume":"10","author":"Wu","year":"2019","journal-title":"IEEE Trans. Compon. Packag. Manuf. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Fan, F., Wang, B., Zhu, G., and Wu, J. (2021, January 13\u201315). Efficient Faster R-CNN: Used in PCB Solder Joint Defects and Components Detection. Proceedings of the 2021 IEEE 4th International Conference on Computer and Communication Engineering Technology (CCET), Beijing, China.","DOI":"10.1109\/CCET52649.2021.9544356"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Park, S., and Ko, J.H. (2021, January 13\u201315). Robust Inspection of Micro-LED Chip Defects Using Unsupervised Anomaly Detection. Proceedings of the 2021 International Conference on Information and Communication Technology Convergence (ICTC), Beijing, China.","DOI":"10.1109\/ICTC52510.2021.9620801"},{"key":"ref_21","first-page":"114","article-title":"An Al-based AOl automatic reassessment method for Chip components","volume":"44","author":"Wang","year":"2021","journal-title":"Electron. Meas. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Akcay, S., Atapour-Abarghouei, A., and Breckon, T.P. (2018, January 2\u20136). Ganomaly: Semi-supervised anomaly detection via adversarial training. Proceedings of the Asian Conference on Computer Vision, Perth, Australia.","DOI":"10.1007\/978-3-030-20893-6_39"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2214","DOI":"10.1109\/TCPMT.2021.3121265","article-title":"Anomaly Detection for Solder Joints Using \u03b2-VAE","volume":"11","author":"Ulger","year":"2021","journal-title":"IEEE Trans. Compon. Packag. Manuf. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2228","DOI":"10.1109\/TMI.2022.3161829","article-title":"Simcvd: Simple contrastive voxel-wise representation distillation for semi-supervised medical image segmentation","volume":"41","author":"You","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jaiswal, A., Babu, A.R., Zadeh, M.Z., Banerjee, D., and Makedon, F. (2020). A survey on contrastive self-supervised learning. Technologies, 9.","DOI":"10.3390\/technologies9010002"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., and Tang, J. (2021). Self-supervised learning: Generative or contrastive. IEEE Trans. Knowl. Data Eng.","DOI":"10.1109\/TKDE.2021.3090866"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wu, Z., Xiong, Y., Yu, S.X., and Lin, D. (2018, January 18\u201322). Unsupervised feature learning via non-parametric instance discrimination. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00393"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Albelwi, S. (2022). Survey on Self-Supervised Learning: Auxiliary Pretext Tasks and Contrastive Learning Methods in Imaging. Entropy, 24.","DOI":"10.3390\/e24040551"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Noroozi, M., and Favaro, P. (2016, January 11\u201314). Unsupervised learning of visual representations by solving jigsaw puzzles. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46466-4_5"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., and Efros, A.A. (2016, January 27\u201330). Context encoders: Feature learning by inpainting. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.278"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Larsson, G., Maire, M., and Shakhnarovich, G. (2017, January 21\u201326). Colorization as a proxy task for visual understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.96"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., and Efros, A.A. (2016, January 11\u201314). Colorful image colorization. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_40"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R. (2020, January 13\u201319). Momentum contrast for unsupervised visual representation learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"ref_34","unstructured":"Chen, T., Kornblith, S., Norouzi, M., and Hinton, G. (2020, January 13\u201318). A simple framework for contrastive learning of visual representations. Proceedings of the International Conference on Machine Learning, PMLR, Virtual."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, X., and Qi, G.J. (2021). Contrastive learning with stronger augmentations. arXiv.","DOI":"10.1109\/TPAMI.2022.3203630"},{"key":"ref_36","first-page":"22243","article-title":"Big self-supervised models are strong semi-supervised learners","volume":"33","author":"Chen","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201322). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_39","first-page":"4931","article-title":"An Efficient Method for Solder Joint Inspection Based on Statistical Learning","volume":"Volume 121","author":"Kuang","year":"2012","journal-title":"Applied Mechanics and Materials"},{"key":"ref_40","first-page":"300","article-title":"IC solder joint inspection via robust principle component analysis","volume":"7","author":"Cai","year":"2017","journal-title":"IEEE Trans. Compon. Packag. Manuf. Technol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Baek, Y., Lee, B., Han, D., Yun, S., and Lee, H. (2019, January 15\u201320). Character region awareness for text detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00959"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/10867651.2004.10487596","article-title":"An image inpainting technique based on the fast marching method","volume":"9","author":"Telea","year":"2004","journal-title":"J. Graph. Tools"},{"key":"ref_43","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_44","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_45","unstructured":"Hjelm, R.D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., and Bengio, Y. (2018). Learning deep representations by mutual information estimation and maximization. arXiv."},{"key":"ref_46","first-page":"15535","article-title":"Learning representations by maximizing mutual information across views","volume":"32","author":"Bachman","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_47","unstructured":"Henaff, O. (2020, January 13\u201318). Data-efficient image recognition with contrastive predictive coding. Proceedings of the International Conference on Machine Learning, PMLR, Virtual."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ye, S.Q., Xue, C.S., Jian, C.Y., Chen, Y.Z., Gung, J.J., and Lin, C.Y. (2022, January 6\u20138). A Deep Learning-based Generic Solder Defect Detection System. Proceedings of the 2022 IEEE International Conference on Consumer Electronics, Taipei, Taiwan.","DOI":"10.1109\/ICCE-Taiwan55306.2022.9869217"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/2\/268\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:20:21Z","timestamp":1760120421000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/2\/268"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,31]]},"references-count":48,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["e25020268"],"URL":"https:\/\/doi.org\/10.3390\/e25020268","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,31]]}}}