{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,7]],"date-time":"2026-06-07T04:23:49Z","timestamp":1780806229426,"version":"3.54.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"34","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["202008610227"],"award-info":[{"award-number":["202008610227"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["434946896"],"award-info":[{"award-number":["434946896"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["465316565"],"award-info":[{"award-number":["465316565"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007537","name":"Freie Universit\u00e4t Berlin","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100007537","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Laser beam welding has become widely applied in many industrial fields in recent years. Solidification cracks remain one of the most common welding faults that can prevent a safe welded joint. In civil engineering, convolutional neural networks (CNNs) have been successfully used to detect cracks in roads and buildings by analysing images of the constructed objects. These cracks are found in static objects, whereas the generation of a welding crack is a dynamic process. Detecting the formation of cracks as early as possible is greatly important to ensure high welding quality. In this study, two end-to-end models based on long short-term memory and three-dimensional convolutional networks (3D-CNN) are proposed for automatic crack formation detection. To achieve maximum accuracy with minimal computational complexity, we progressively modify the model to find the optimal structure. The controlled tensile weldability test is conducted to generate long videos used for training and testing. The performance of the proposed models is compared with the classical neural network ResNet-18, which has been proven to be a good transfer learning model for crack detection. The results show that our models can detect the start time of crack formation earlier, while ResNet-18 only detects cracks during the propagation stage.<\/jats:p>","DOI":"10.1007\/s00521-023-09004-y","type":"journal-article","created":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T11:03:55Z","timestamp":1695899035000},"page":"24315-24332","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Detection of solidification crack formation in laser beam welding videos of sheet metal using neural networks"],"prefix":"10.1007","volume":"35","author":[{"given":"Wenjie","family":"Huo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nasim","family":"Bakir","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrey","family":"Gumenyuk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Rethmeier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8630-0869","authenticated-orcid":false,"given":"Katinka","family":"Wolter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,9,28]]},"reference":[{"key":"9004_CR1","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1016\/j.procir.2020.09.104","volume":"94","author":"N Bakir","year":"2020","unstructured":"Bakir N, Gumenyuk A, Pavlov V, Volvenko S, Rethmeier M (2020) In situ determination of the critical straining condition for solidification cracking during laser beam welding. Procedia CIRP 94:666\u2013670","journal-title":"Procedia CIRP"},{"issue":"3","key":"9004_CR2","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1080\/13621718.2017.1367550","volume":"23","author":"N Bakir","year":"2018","unstructured":"Bakir N, Gumenyuk A, Rethmeier M (2018) Investigation of solidification cracking susceptibility during laser beam welding using an in-situ observation technique. Sci Technol Weld Join 23(3):234\u2013240","journal-title":"Sci Technol Weld Join"},{"issue":"11","key":"9004_CR3","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278\u20132324","journal-title":"Proc IEEE"},{"issue":"6","key":"9004_CR4","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84\u201390","journal-title":"Commun ACM"},{"key":"9004_CR5","unstructured":"Simonyan K, Zisserman A (2014) Two-stream convolutional networks for action recognition in videos. Adv Neural Inf Process Syst 27"},{"issue":"8","key":"9004_CR6","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"9004_CR7","doi-asserted-by":"crossref","unstructured":"Donahue J, Anne\u00a0Hendricks L, Guadarrama S, Rohrbach M, Venugopalan S, Saenko K, Darrell T (2015) Long-term recurrent convolutional networks for visual recognition and description. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2625\u20132634","DOI":"10.1109\/CVPR.2015.7298878"},{"issue":"1","key":"9004_CR8","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1109\/TPAMI.2012.59","volume":"35","author":"S Ji","year":"2012","unstructured":"Ji S, Xu W, Yang M, Yu K (2012) 3D convolutional neural networks for human action recognition. IEEE Trans Pattern Anal Mach Intell 35(1):221\u2013231","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"9004_CR9","doi-asserted-by":"crossref","unstructured":"Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3D convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 4489\u20134497","DOI":"10.1109\/ICCV.2015.510"},{"key":"9004_CR10","doi-asserted-by":"crossref","unstructured":"Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3D convolutional networks. In: Proceedings of the IEEE International conference on computer vision, pp 4489\u20134497","DOI":"10.1109\/ICCV.2015.510"},{"issue":"11","key":"9004_CR11","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6501\/ac8368","volume":"33","author":"H Tao","year":"2022","unstructured":"Tao H, Cheng L, Qiu J, Stojanovic V (2022) Few shot cross equipment fault diagnosis method based on parameter optimization and feature mertic. Meas Sci Technol 33(11):115005","journal-title":"Meas Sci Technol"},{"issue":"2","key":"9004_CR12","doi-asserted-by":"publisher","first-page":"1454","DOI":"10.1016\/j.jfranklin.2022.11.004","volume":"360","author":"H Tao","year":"2023","unstructured":"Tao H, Qiu J, Chen Y, Stojanovic V, Cheng L (2023) Unsupervised cross-domain rolling bearing fault diagnosis based on time-frequency information fusion. J Franklin Inst 360(2):1454\u20131477","journal-title":"J Franklin Inst"},{"issue":"5","key":"9004_CR13","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1111\/mice.12263","volume":"32","author":"Y-J Cha","year":"2017","unstructured":"Cha Y-J, Choi W, B\u00fcy\u00fck\u00f6zt\u00fcrk O (2017) Deep learning-based crack damage detection using convolutional neural networks. Comput Aided Civ Infrastruct Eng 32(5):361\u2013378","journal-title":"Comput Aided Civ Infrastruct Eng"},{"issue":"5","key":"9004_CR14","doi-asserted-by":"publisher","first-page":"4392","DOI":"10.1109\/TIE.2017.2764844","volume":"65","author":"F-C Chen","year":"2017","unstructured":"Chen F-C, Jahanshahi MR (2017) NB-CNN: deep learning-based crack detection using convolutional neural network and Na\u00efve Bayes data fusion. IEEE Trans Ind Electron 65(5):4392\u20134400","journal-title":"IEEE Trans Ind Electron"},{"key":"9004_CR15","doi-asserted-by":"publisher","first-page":"9289","DOI":"10.1007\/s00521-021-05690-8","volume":"33","author":"B Kim","year":"2021","unstructured":"Kim B, Yuvaraj N, Sri Preethaa K, Arun Pandian R (2021) Surface crack detection using deep learning with shallow CNN architecture for enhanced computation. Neural Comput Appl 33:9289\u20139305","journal-title":"Neural Comput Appl"},{"key":"9004_CR16","doi-asserted-by":"crossref","unstructured":"Quan J, Ge B, Wang M (2023) CrackViT: a unified CNN-transformer model for pixel-level crack extraction. Neural Comput Appl PP 1\u201317","DOI":"10.1007\/s00521-023-08277-7"},{"issue":"4","key":"9004_CR17","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1080\/10298436.2018.1485917","volume":"21","author":"B Li","year":"2020","unstructured":"Li B, Wang KC, Zhang A, Yang E, Wang G (2020) Automatic classification of pavement crack using deep convolutional neural network. Int J Pavement Eng 21(4):457\u2013463","journal-title":"Int J Pavement Eng"},{"key":"9004_CR18","doi-asserted-by":"crossref","unstructured":"Silva WRLd, Lucena DSd (2018) Concrete cracks detection based on deep learning image classification. In: Proceedings, vol. 2. MDPI, p 489","DOI":"10.3390\/ICEM18-05387"},{"key":"9004_CR19","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556"},{"key":"9004_CR20","doi-asserted-by":"publisher","first-page":"1031","DOI":"10.1016\/j.conbuildmat.2018.08.011","volume":"186","author":"S Dorafshan","year":"2018","unstructured":"Dorafshan S, Thomas RJ, Maguire M (2018) Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete. Constr Build Mater 186:1031\u20131045","journal-title":"Constr Build Mater"},{"issue":"9","key":"9004_CR21","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1111\/mice.12449","volume":"34","author":"R-T Wu","year":"2019","unstructured":"Wu R-T, Singla A, Jahanshahi MR, Bertino E, Ko BJ, Verma D (2019) Pruning deep convolutional neural networks for efficient edge computing in condition assessment of infrastructures. Comput Aided Civ Infrastruct Eng 34(9):774\u2013789","journal-title":"Comput Aided Civ Infrastruct Eng"},{"issue":"4","key":"9004_CR22","doi-asserted-by":"publisher","first-page":"2124","DOI":"10.1177\/1475921720965445","volume":"20","author":"AS Rao","year":"2021","unstructured":"Rao AS, Nguyen T, Palaniswami M, Ngo T (2021) Vision-based automated crack detection using convolutional neural networks for condition assessment of infrastructure. Struct Health Monit 20(4):2124\u20132142","journal-title":"Struct Health Monit"},{"issue":"3","key":"9004_CR23","doi-asserted-by":"publisher","first-page":"933","DOI":"10.3390\/app10030933","volume":"10","author":"Y Yang","year":"2020","unstructured":"Yang Y, Pan L, Ma J, Yang R, Zhu Y, Yang Y, Zhang L (2020) A high-performance deep learning algorithm for the automated optical inspection of laser welding. Appl Sci 10(3):933","journal-title":"Appl Sci"},{"key":"9004_CR24","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.jmsy.2019.02.004","volume":"51","author":"Y Zhang","year":"2019","unstructured":"Zhang Y, You D, Gao X, Zhang N, Gao PP (2019) Welding defects detection based on deep learning with multiple optical sensors during disk laser welding of thick plates. J Manuf Syst 51:87\u201394","journal-title":"J Manuf Syst"},{"key":"9004_CR25","doi-asserted-by":"publisher","first-page":"800","DOI":"10.1016\/j.jmsy.2021.01.012","volume":"62","author":"R Miao","year":"2022","unstructured":"Miao R, Shan Z, Zhou Q, Wu Y, Ge L, Zhang J, Hu H (2022) Real-time defect identification of narrow overlap welds and application based on convolutional neural networks. J Manuf Syst 62:800\u2013810","journal-title":"J Manuf Syst"},{"issue":"1","key":"9004_CR26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-56847-4","volume":"10","author":"S Shevchik","year":"2020","unstructured":"Shevchik S, Le-Quang T, Meylan B, Farahani FV, Olbinado MP, Rack A, Masinelli G, Leinenbach C, Wasmer K (2020) Supervised deep learning for real-time quality monitoring of laser welding with x-ray radiographic guidance. Sci Rep 10(1):1\u201312","journal-title":"Sci Rep"},{"issue":"12","key":"9004_CR27","doi-asserted-by":"publisher","first-page":"4205","DOI":"10.3390\/s21124205","volume":"21","author":"C Knaak","year":"2021","unstructured":"Knaak C, E\u00dfen J, Kr\u00f6ger M, Schulze F, Abels P, Gillner A (2021) A spatio-temporal ensemble deep learning architecture for real-time defect detection during laser welding on low power embedded computing boards. Sensors 21(12):4205","journal-title":"Sensors"},{"key":"9004_CR28","doi-asserted-by":"publisher","first-page":"5506","DOI":"10.1109\/TII.2022.3199258","volume":"19","author":"Y Hong","year":"2022","unstructured":"Hong Y, Yang M, Jiang Y, Du D, Chang B (2022) Real-time quality monitoring of ultra-thin sheets edge welding based on micro-vision sensing and SOCIFS-SYM. IEEE Trans Ind Inform 19:5506\u20135516","journal-title":"IEEE Trans Ind Inform"},{"key":"9004_CR29","doi-asserted-by":"crossref","unstructured":"Hasan M, Choi J, Neumann J, Roy-Chowdhury AK, Davis LS (2016) Learning temporal regularity in video sequences. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 733\u2013742","DOI":"10.1109\/CVPR.2016.86"},{"key":"9004_CR30","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1\u20139","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"9004_CR31","doi-asserted-by":"crossref","unstructured":"He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5353\u20135360","DOI":"10.1109\/CVPR.2015.7299173"},{"key":"9004_CR32","doi-asserted-by":"publisher","first-page":"745","DOI":"10.3389\/fnins.2018.00745","volume":"12","author":"T Gokmen","year":"2018","unstructured":"Gokmen T, Rasch MJ, Haensch W (2018) Training LSTM networks with resistive cross-point devices. Front Neurosci 12:745","journal-title":"Front Neurosci"},{"key":"9004_CR33","unstructured":"Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L et al (2019) Pytorch: an imperative style, high-performance deep learning library. Adv Neural Inf Process Syst 32"},{"key":"9004_CR34","unstructured":"Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. arXiv preprint arXiv:1412.6806"},{"key":"9004_CR35","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision, pp 618\u2013626","DOI":"10.1109\/ICCV.2017.74"},{"key":"9004_CR36","unstructured":"Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861"},{"key":"9004_CR37","doi-asserted-by":"crossref","unstructured":"Zhang X, Zhou X, Lin M, Sun J (2018) Shufflenet: an extremely efficient convolutional neural network for mobile devices. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 6848\u20136856","DOI":"10.1109\/CVPR.2018.00716"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-09004-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-023-09004-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-09004-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T13:09:13Z","timestamp":1699016953000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-023-09004-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":37,"journal-issue":{"issue":"34","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["9004"],"URL":"https:\/\/doi.org\/10.1007\/s00521-023-09004-y","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}