{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T15:38:17Z","timestamp":1774021097147,"version":"3.50.1"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,14]],"date-time":"2024-02-14T00:00:00Z","timestamp":1707868800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,14]],"date-time":"2024-02-14T00:00:00Z","timestamp":1707868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Dongguan Polytechnic Special funding for the electronic information engineering technology specialty group of the National Double High Program","award":["No. ZXF015"],"award-info":[{"award-number":["No. ZXF015"]}]},{"name":"Dongguan Sci-tech Commissioner Program","award":["20221800500492\/20221800500552"],"award-info":[{"award-number":["20221800500492\/20221800500552"]}]},{"name":"Dongguan's Rural Revitalization Strategy","award":["No. 20211800400102"],"award-info":[{"award-number":["No. 20211800400102"]}]},{"name":"Dongguan Special Commissioner Project","award":["No. 20211800500182"],"award-info":[{"award-number":["No. 20211800500182"]}]},{"name":"Guangdong-Dongguan Joint Fund for Basic and Applied Research of Guangdong Province","award":["No. 2020A1515110162"],"award-info":[{"award-number":["No. 2020A1515110162"]}]},{"name":"University Special Fund of Guangdong Provincial Department of Education","award":["No. 2022ZDZX1073"],"award-info":[{"award-number":["No. 2022ZDZX1073"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this study, we aimed to address the primary challenges encountered in industrial integrated circuit (IC) surface defect detection, particularly focusing on the imbalance in information density arising from difficulties in data sample collection. To this end, we have developed a new hybrid architecture model for IC surface defect detection (SDDM), based on ResNet and Vision Transformer (ViT). The core innovation of SDDM lies in the integration of the concepts of image information density and dataset information density, effectively identifying and processing areas of high information density through multi-channel image segmentation techniques. The convolution operations performed within each patch of the model help to precisely capture positional information, thereby meticulously differentiating the complex details on the surface defect detection of ICs. We optimized the model to make it more suitable for industrial applications, significantly reducing computational and operational costs. The experimental results confirmed that the improved SDDM model achieved an accuracy rate of 98.6% on datasets with uneven information density, effectively enhancing the productivity of IC packaging and testing companies, particularly in handling datasets with imbalanced information density.<\/jats:p>","DOI":"10.1007\/s44196-024-00423-w","type":"journal-article","created":{"date-parts":[[2024,2,14]],"date-time":"2024-02-14T09:03:02Z","timestamp":1707901382000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Deep Learning-Based Integrated Circuit Surface Defect Detection: Addressing Information Density Imbalance for Industrial Application"],"prefix":"10.1007","volume":"17","author":[{"given":"Xiaobin","family":"Wang","sequence":"first","affiliation":[]},{"given":"Shuang","family":"Gao","sequence":"additional","affiliation":[]},{"given":"Jianlan","family":"Guo","sequence":"additional","affiliation":[]},{"given":"Chu","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Liping","family":"Xiong","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8492-7684","authenticated-orcid":false,"given":"Yuntao","family":"Zou","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,2,14]]},"reference":[{"issue":"12","key":"423_CR1","doi-asserted-by":"publisher","first-page":"2911","DOI":"10.1049\/iet-ipr.2019.1506","volume":"14","author":"GA De Vitis","year":"2020","unstructured":"De Vitis, G.A., Foglia, P., Prete, C.A.: Row-level algorithm to improve real-time performance of glass tube defect detection in the production phase. IET Image Proc. 14(12), 2911\u20132921 (2020)","journal-title":"IET Image Proc."},{"issue":"14","key":"423_CR2","doi-asserted-by":"publisher","first-page":"1644","DOI":"10.1016\/j.patrec.2006.03.009","volume":"27","author":"H-F Ng","year":"2006","unstructured":"Ng, H.-F.: Automatic thresholding for defect detection. Pattern Recogn. Lett. 27(14), 1644\u20131649 (2006)","journal-title":"Pattern Recogn. Lett."},{"issue":"2","key":"423_CR3","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1007\/s40684-021-00343-6","volume":"9","author":"Z Ren","year":"2022","unstructured":"Ren, Z., Fang, F., Yan, N., Wu, Y.: State of the art in defect detection based on machine vision. Int. J. Precis. Eng. Manuf.-Green Technol 9(2), 661\u2013691 (2022)","journal-title":"Int. J. Precis. Eng. Manuf.-Green Technol"},{"key":"423_CR4","doi-asserted-by":"crossref","unstructured":"Ciregan, D., Meier, U., Schmidhuber, J.: Multi-column deep neural networks for image classification. In: 2012 IEEE conference on computer vision and pattern recognition. pp. 3642\u20133649. IEEE (2012)","DOI":"10.1109\/CVPR.2012.6248110"},{"key":"423_CR5","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., Polosukhin, I.: Attention is all you need. In: Advances in neural information processing systems, vol. 30 (2017)"},{"issue":"2","key":"423_CR6","doi-asserted-by":"publisher","first-page":"734","DOI":"10.3390\/s23020734","volume":"23","author":"O Moutik","year":"2023","unstructured":"Moutik, O., Sekkat, H., Tigani, S., Chehri, A., Saadane, R., Tchakoucht, T.A., Paul, A.: Convolutional neural networks or vision transformers: Who will win the race for action recognitions in visual data? Sensors 23(2), 734 (2023)","journal-title":"Sensors"},{"issue":"10s","key":"423_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3505244","volume":"54","author":"S Khan","year":"2022","unstructured":"Khan, S., Naseer, M., Hayat, M., Zamir, S.W., Khan, F.S., Shah, M.: Transformers in vision: a survey. ACM Comput Surv (CSUR) 54(10s), 1\u201341 (2022)","journal-title":"ACM Comput Surv (CSUR)"},{"key":"423_CR8","doi-asserted-by":"crossref","unstructured":"Luan, C., Cui, R., Sun, L., Lin, Z.: A Siamese network utilizing image structural differences for cross-category defect detection. In: 2020 IEEE International Conference on Image Processing (ICIP). pp. 778\u2013782. IEEE (2020)","DOI":"10.1109\/ICIP40778.2020.9191128"},{"key":"423_CR9","doi-asserted-by":"crossref","unstructured":"Bennett, M.H., Tobin Jr, K.W., Gleason, S.S.: Automatic defect classification: status and industry trends. In: Integrated Circuit Metrology, Inspection, and Process Control IX, vol. 2439. pp. 210\u2013220. SPIE (1995)","DOI":"10.1117\/12.209203"},{"issue":"2\u20133","key":"423_CR10","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.mejo.2010.01.015","volume":"41","author":"H Liu","year":"2010","unstructured":"Liu, H., Zhou, W., Kuang, Q., Cao, L., Gao, B.: Defect detection of ic wafer based on two-dimension wavelet transform. Microelectron. J. 41(2\u20133), 171\u2013177 (2010)","journal-title":"Microelectron. J."},{"issue":"6","key":"423_CR11","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1016\/j.ndteint.2011.05.003","volume":"44","author":"X Lu","year":"2011","unstructured":"Lu, X., Liao, G., Zha, Z., Xia, Q., Shi, T.: A novel approach for flip chip solder joint inspection based on pulsed phase thermography. NDT E Int. 44(6), 484\u2013489 (2011)","journal-title":"NDT E Int."},{"issue":"9","key":"423_CR12","first-page":"1326","volume":"7","author":"S Kaitwanidvilai","year":"2012","unstructured":"Kaitwanidvilai, S., Saenthon, A., Kunakorn, A.: Pattern recognition technique for integrated circuit (ic) pins inspection using wavelet transform with chain-code-discrete Fourier transform and signal correlation. Int. J. Phys. Sci. 7(9), 1326\u20131332 (2012)","journal-title":"Int. J. Phys. Sci."},{"issue":"9\u201310","key":"423_CR13","doi-asserted-by":"publisher","first-page":"1887","DOI":"10.1016\/j.microrel.2014.07.022","volume":"54","author":"C Berg\u00e8s","year":"2014","unstructured":"Berg\u00e8s, C., Soufflet, P., Jadrani, A.: Risk and reliability assessment about a manufacturing issue in a power mosfet for automotive applications. Microelectron. Reliab. 54(9\u201310), 1887\u20131890 (2014)","journal-title":"Microelectron. Reliab."},{"issue":"13","key":"423_CR14","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1049\/joe.2019.1188","volume":"2020","author":"R Ding","year":"2020","unstructured":"Ding, R., Zhang, C., Zhu, Q., Liu, H.: Unknown defect detection for printed circuit board based on multi-scale deep similarity measure method. J. Eng. 2020(13), 388\u2013393 (2020)","journal-title":"J. Eng."},{"issue":"3","key":"423_CR15","first-page":"19","volume":"25","author":"A Anvar","year":"2020","unstructured":"Anvar, A., Cho, Y.I.: Automatic metallic surface defect detection using shuffledefectnet. J. Korea Soc. Comput. Inf. 25(3), 19\u201326 (2020)","journal-title":"J. Korea Soc. Comput. Inf."},{"key":"423_CR16","doi-asserted-by":"publisher","first-page":"108335","DOI":"10.1109\/ACCESS.2020.3001349","volume":"8","author":"B Hu","year":"2020","unstructured":"Hu, B., Wang, J.: Detection of PCB surface defects with improved faster-RCNN and feature pyramid network. IEEE Access 8, 108335\u2013108345 (2020)","journal-title":"IEEE Access"},{"issue":"1","key":"423_CR17","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1113\/jphysiol.1962.sp006837","volume":"160","author":"DH Hubel","year":"1962","unstructured":"Hubel, D.H., Wiesel, T.N.: Receptive fields, binocular interaction and functional architecture in the cat\u2019s visual cortex. J. Physiol. 160(1), 106 (1962)","journal-title":"J. Physiol."},{"issue":"4","key":"423_CR18","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/BF00344251","volume":"36","author":"K Fukushima","year":"1980","unstructured":"Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36(4), 193\u2013202 (1980)","journal-title":"Biol. Cybern."},{"issue":"4","key":"423_CR19","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","volume":"1","author":"Y LeCun","year":"1989","unstructured":"LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541\u2013551 (1989)","journal-title":"Neural Comput."},{"issue":"11","key":"423_CR20","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradientbased learning applied to document recognition. Proc. IEEE 86(11), 2278\u20132324 (1998)","journal-title":"Proc. IEEE"},{"issue":"13","key":"423_CR21","doi-asserted-by":"publisher","first-page":"2907","DOI":"10.1177\/1369433219849829","volume":"22","author":"X Gao","year":"2019","unstructured":"Gao, X., Jian, M., Hu, M., Tanniru, M., Li, S.: Faster multidefect detection system in shield tunnel using combination of FCN and faster rcnn. Adv. Struct. Eng. 22(13), 2907\u20132921 (2019)","journal-title":"Adv. Struct. Eng."},{"issue":"13","key":"423_CR22","doi-asserted-by":"publisher","first-page":"7181","DOI":"10.1109\/JSEN.2020.2977366","volume":"20","author":"L Xiao","year":"2020","unstructured":"Xiao, L., Wu, B., Hu, Y.: Surface defect detection using image pyramid. IEEE Sens. J. 20(13), 7181\u20137188 (2020)","journal-title":"IEEE Sens. J."},{"issue":"11","key":"423_CR23","doi-asserted-by":"publisher","first-page":"2971","DOI":"10.3390\/biomedicines10112971","volume":"10","author":"RM Al-Tam","year":"2022","unstructured":"Al-Tam, R.M., Al-Hejri, A.M., Narangale, S.M., Samee, N.A., Mahmoud, N.F., Al-Masni, M.A., Al-Antari, M.A.: A hybrid workflow of residual convolutional transformer encoder for breast cancer classification using digital x-ray mammograms. Biomedicines 10(11), 2971 (2022)","journal-title":"Biomedicines"},{"key":"423_CR24","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1016\/j.inffus.2022.10.030","volume":"91","author":"J Chen","year":"2023","unstructured":"Chen, J., Chen, X., Chen, S., Liu, Y., Rao, Y., Yang, Y., Wang, H., Wu, D.: Shape-former: bridging CNN and transformer via shapeconv for multimodal image matching. Inf. Fusion 91, 445\u2013457 (2023)","journal-title":"Inf. Fusion"},{"key":"423_CR25","doi-asserted-by":"publisher","first-page":"1978","DOI":"10.1109\/TIP.2023.3261747","volume":"32","author":"G Gao","year":"2023","unstructured":"Gao, G., Xu, Z., Li, J., Yang, J., Zeng, T., Qi, G.-J.: Ctcnet: a CNN-transformer cooperation network for face image superresolution. IEEE Trans. Image Process. 32, 1978\u20131991 (2023)","journal-title":"IEEE Trans. Image Process."},{"key":"423_CR26","unstructured":"Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: Bert:Pre-training of deep bidirectional transformers for language understanding, arXiv preprint arXiv:1810.04805 (2018)"},{"key":"423_CR27","first-page":"1877","volume":"33","author":"T Brown","year":"2020","unstructured":"Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few-shot learners. Adv. Neural. Inf. Process. Syst. 33, 1877\u20131901 (2020)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"423_CR28","doi-asserted-by":"crossref","unstructured":"Huang, L., Tan, J., Meng, J., Liu, J., Yuan, J.: Hotnet: Non-autoregressive transformer for 3D hand-object pose estimation. In: Proceedings of the 28th ACM International Conference on Multimedia, pp. 3136\u20133145 (2020)","DOI":"10.1145\/3394171.3413775"},{"key":"423_CR29","doi-asserted-by":"crossref","unstructured":"Lin, K., Wang, L., Liu, Z.: End-to-end human pose and mesh reconstruction with transformers. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. pp. 1954\u20131963 (2021)","DOI":"10.1109\/CVPR46437.2021.00199"},{"key":"423_CR30","doi-asserted-by":"crossref","unstructured":"Esser, P., Rombach, R., Ommer, B.: Taming transformers for high-resolution image synthesis. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. pp. 12873\u201312883 (2021)","DOI":"10.1109\/CVPR46437.2021.01268"},{"key":"423_CR31","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)"},{"key":"423_CR32","first-page":"15908","volume":"34","author":"K Han","year":"2021","unstructured":"Han, K., Xiao, A., Wu, E., Guo, J., Xu, C., Wang, Y.: Transformer in transformer. Adv. Neural. Inf. Process. Syst. 34, 15908\u201315919 (2021)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"423_CR33","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., Guo, B.: Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE\/CVF international conference on computer vision. pp. 10012\u201310022 (2021)","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"423_CR34","unstructured":"Chen, C.-F., Panda, R., Fan, Q.: Regionvit: Regionalto-local attention for vision transformers. arXiv preprint arXiv:2106.02689 (2021)"},{"issue":"23","key":"423_CR35","doi-asserted-by":"publisher","first-page":"11981","DOI":"10.3390\/app122311981","volume":"12","author":"N H\u00fctten","year":"2022","unstructured":"H\u00fctten, N., Meyes, R., Meisen, T.: Vision transformer in industrial visual inspection. Appl. Sci. 12(23), 11981 (2022)","journal-title":"Appl. Sci."},{"key":"423_CR36","doi-asserted-by":"publisher","DOI":"10.1016\/j.aei.2023.101882","volume":"55","author":"H Shang","year":"2023","unstructured":"Shang, H., Sun, C., Liu, J., Chen, X., Yan, R.: Defectaware transformer network for intelligent visual surface defect detection. Adv. Eng. Inform. 55, 101882 (2023)","journal-title":"Adv. Eng. Inform."}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00423-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-024-00423-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00423-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T11:09:30Z","timestamp":1708168170000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-024-00423-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,14]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["423"],"URL":"https:\/\/doi.org\/10.1007\/s44196-024-00423-w","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,14]]},"assertion":[{"value":"3 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}],"article-number":"29"}}