{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T05:43:34Z","timestamp":1771479814924,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2021,11,2]],"date-time":"2021-11-02T00:00:00Z","timestamp":1635811200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61775050"],"award-info":[{"award-number":["61775050"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["PA2019GDZC0098"],"award-info":[{"award-number":["PA2019GDZC0098"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Most of the existing laser welding process monitoring technologies focus on the detection of post-engineering defects, but in the mass production of electronic equipment, such as laser welding metal plates, the real-time identification of defect detection has more important practical significance. The data set of laser welding process is often difficult to build and there is not enough experimental data, which hinder the applications of the data-driven laser welding defect detection method. In this paper, an intelligent welding defect diagnosis method based on auxiliary classifier generative adversarial networks (ACGAN) has been proposed. Firstly, a ten-class dataset consisting of 6467 samples, was constructed, which originate from the optical and thermal sensory parameters in the welding process. A new structured ACGAN network model is proposed to generate fake data similar to the true defect feature distributions. In addition, in order to make the difference between different defects categories more obvious after data expansion, a data filtering and data purification scheme was proposed based on ensemble learning and an SVM (support vector machine), which is used to filter the bad generated data. In the experiments, the classification accuracy can reach 96.83% and 85.13%, for the CNN (convolutional neural network) algorithm model and ACGAN model, respectively. However, the accuracy can further improve to 97.86% and 98.37% for the fusion models of ACGAN-CNN and ACGAN-SVM-CNN models, respectively. The results show that ACGAN can not only be used as an algorithm model for classification, but also be used to achieve superior real-time classification and recognition through data enhancement and multi-model fusion.<\/jats:p>","DOI":"10.3390\/s21217304","type":"journal-article","created":{"date-parts":[[2021,11,2]],"date-time":"2021-11-02T22:17:23Z","timestamp":1635891443000},"page":"7304","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Real-Time High-Performance Laser Welding Defect Detection by Combining ACGAN-Based Data Enhancement and Multi-Model Fusion"],"prefix":"10.3390","volume":"21","author":[{"given":"Kui","family":"Fan","sequence":"first","affiliation":[{"name":"School of Computer and Information, Hefei University of Technology, Hefei 230009, China"}]},{"given":"Peng","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Computer and Information, Hefei University of Technology, Hefei 230009, China"}]},{"given":"Hongping","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer and Information, Hefei University of Technology, Hefei 230009, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7466-9522","authenticated-orcid":false,"given":"Lulu","family":"Wang","sequence":"additional","affiliation":[{"name":"Biomedical Device Innovation Center, Shenzhen Technology University, Shenzhen 518118, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7282-2503","authenticated-orcid":false,"given":"Zhongyi","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Computer and Information, Hefei University of Technology, Hefei 230009, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1179\/1362171815Y.0000000031","article-title":"Analysis of weld defects in similar and dissimilar resistance seam welding of aluminium, zinc and galvanised steel","volume":"20","author":"Galvo","year":"2015","journal-title":"Sci. Technol. Weld. Join."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pa\u0144cikiewicz, K., \u015awierczy\u0144ska, A., Hu\u0107ko, P., and Tumidajewicz, M. (2020). Laser Dissimilar Welding of AISI 430F and AISI 304 Stainless Steels. Materials, 13.","DOI":"10.3390\/ma13204540"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sahul, M., Tom\u010d\u00edkov\u00e1, E., Sahul, M., Pa\u0161\u00e1k, M., Ludrovcov\u00e1, B., and Hodulova, E. (2020). Effect of Disk Laser Beam Offset on the Microstructure and Mechanical Properties of Copper\u2014AISI 304 Stainless Steel Dissimilar Metals Joints. Metals, 10.","DOI":"10.3390\/met10101294"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Landowski, M., \u015awierczy\u0144ska, A., Rogalski, G., and Fydrych, D. (2020). Autogenous Fiber Laser Welding of 316L Austenitic and 2304 Lean Duplex Stainless Steels. Materials, 13.","DOI":"10.3390\/ma13132930"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1179\/1362171813Y.0000000180","article-title":"Review of laser welding monitoring","volume":"19","author":"You","year":"2014","journal-title":"Sci. Technol. Weld. Join."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2851","DOI":"10.3390\/s90402851","article-title":"A Weld Defects Detection System Based on a Spectrometer","volume":"9","author":"Bebiano","year":"2009","journal-title":"Sensors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"506","DOI":"10.3390\/s110100506","article-title":"A Laser-Based Vision System for Weld Quality Inspection","volume":"11","author":"Huang","year":"2011","journal-title":"Sensors"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hong, Y., Chang, B., Peng, G., Yuan, Z., Hou, X., Xue, B., and Du, D. (2018). In-Process Monitoring of Lack of Fusion in Ultra-Thin Sheets Edge Welding Using Machine Vision. Sensors, 18.","DOI":"10.3390\/s18082411"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"6080","DOI":"10.1109\/TIM.2020.2969057","article-title":"Detection Method Based on Automatic Visual Shape Clustering for Pin-Missing Defect in Transmission Lines","volume":"69","author":"Zhao","year":"2020","journal-title":"IEEE Trans. Inst. Meas."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2189","DOI":"10.1109\/TII.2019.2935153","article-title":"A Surface Defect Detection Framework for Glass Bottle Bottom Using Visual Attention Model and Wavelet Transform","volume":"16","author":"Zhou","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, T.H., Pang, X.H., Jia, B.Y., Xia, Y.W., Zeng, S.M., Liu, H.L., Tian, H., Lin, F., and Wang, D. (2020). Detection and Diagnosis of Defect in GIS Based on X-ray Digital Imaging Technology. Energies, 13.","DOI":"10.3390\/en13030661"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Moon, J.S., and Yoo, M. (2020). Development of a Seismic Detection Technology for High-Speed Trains Using Signal Analysis Techniques. Sensors, 20.","DOI":"10.3390\/s20133708"},{"key":"ref_13","unstructured":"Gao, X.D., Huan, Y.J., and Liu, G.Q. (2017). A kind of Laser Welding Defocus Amount Determining Device and Assay Method. (201710768378), C.N. Patent."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1364\/AO.44.000013","article-title":"Closed-loop power and focus control of laser welding for full-penetration monitoring","volume":"44","author":"Bardin","year":"2005","journal-title":"Appl. Optics."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.optlastec.2018.07.023","article-title":"Visual-assisted laser microwelding of carbon microfiber on metal plates","volume":"108","author":"Huang","year":"2018","journal-title":"Opt. Laser Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1016\/j.eng.2019.01.016","article-title":"Online monitoring of welding status based on a DBN model during laser welding","volume":"5","author":"Zhang","year":"2019","journal-title":"Engineering"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1016\/j.phpro.2014.08.038","article-title":"Monitoring and adaptive control of laser processes","volume":"56","author":"Purtonen","year":"2014","journal-title":"Phys. Procedia"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"93108","DOI":"10.1109\/ACCESS.2019.2927661","article-title":"Laser Welding Quality Monitoring via Graph Support Vector Machine With Data Adaptive Kernel","volume":"7","author":"Shevchik","year":"2019","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Krajewski, A., Klekot, G., Cybulak, M., and Kolodziejczak, P. (2020). A Novel Method of Supporting the Laser Welding Process with Mechanical Acoustic Vibrations. Materials, 13.","DOI":"10.3390\/ma13184179"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/S0030-3992(01)00103-7","article-title":"Real time estimation of CO2 laser weld quality for automotive industry","volume":"34","author":"Park","year":"2002","journal-title":"Opt. Laser Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.jmsy.2019.02.004","article-title":"Welding defects detection based on deep learning with multiple optical sensors during disk laser welding of thick plates","volume":"51","author":"Zhang","year":"2019","journal-title":"J. Manuf. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2177","DOI":"10.1109\/TIE.2008.918637","article-title":"Sputter tracking for the automatic monitoring of industrial laser-welding processes","volume":"55","author":"Jager","year":"2008","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hipp, D., Mahrle, A., Beyer, E., J\u00e4ckel, S., Hertel, M., and F\u00fcssel, U. (2019). Thermal Efficiency Analysis for Laser-Assisted Plasma Arc Welding of AISI 304 Stainless Steel. Materials, 12.","DOI":"10.3390\/ma12091460"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1696","DOI":"10.1109\/JLT.2008.922337","article-title":"High-power and widely tunable all-fiber Raman laser","volume":"26","author":"Bernier","year":"2008","journal-title":"J. Lightwave Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"9364","DOI":"10.1109\/JSEN.2019.2927268","article-title":"Data-driven detection of laser welding defects based on real-time spectrometer signals","volume":"19","author":"Zhang","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"147349","DOI":"10.1109\/ACCESS.2020.3015529","article-title":"A Multi-Sensor Data Fusion System for Laser Welding Process Monitoring","volume":"8","author":"Deng","year":"2020","journal-title":"IEEE Access."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.jmapro.2020.03.047","article-title":"Automatic weld seam tracking of tube-to-tubesheet TIG welding robot with multiple Sensors","volume":"63","author":"Lei","year":"2021","journal-title":"J. Manuf. Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1080\/174329313X13789830157500","article-title":"Intelligent pattern recognition and diagnosis of ultrasonic inspection of welding defects based on neural network and information fusion","volume":"7","author":"Gang","year":"2002","journal-title":"Sci. Technol. Weld. Join."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ma, S.J., Cai, W., Liu, W.K., Shang, Z.W., and Liu, G. (2019). A Lighted Deep Convolutional Neural Network Based Fault Diagnosis of Rotating Machinery. Sensors, 19.","DOI":"10.3390\/s19102381"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"26241","DOI":"10.1109\/ACCESS.2018.2837621","article-title":"Preprocessing-free gear fault diagnosis using small datasets with deep convolutional neural network-based transfer learning","volume":"6","author":"Cao","year":"2018","journal-title":"IEEE Access."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1585","DOI":"10.1109\/TIM.2019.2913057","article-title":"An improved fault diagnosis method of rotating machinery using sensitive features and RLS-BP neural network","volume":"69","author":"Lu","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1109\/TPEL.2018.2814615","article-title":"PWM-VSI Fault Diagnosis for a PMSM Drive Based on the Fuzzy Logic Approach","volume":"34","author":"Yan","year":"2019","journal-title":"IEEE Trans. Power Electr."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.solener.2019.01.083","article-title":"Study of joint temporal-spatial distribution of array output for large-scale photovoltaic plant and its fault diagnosis application","volume":"181","author":"Zhu","year":"2019","journal-title":"Sol. Energy."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1109\/TII.2020.2979467","article-title":"Multidimensional Feature Fusion and Ensemble Learning-Based Fault Diagnosis for the Braking System of Heavy-Haul Train","volume":"17","author":"Liu","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"108654","DOI":"10.1016\/j.measurement.2020.108654","article-title":"Fault diagnosis of planetary gearbox using multi-criteria feature selection and heterogeneous ensemble learning classification","volume":"173","author":"Wang","year":"2021","journal-title":"Measurement"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"18061","DOI":"10.1021\/acs.iecr.0c03082","article-title":"Fault Diagnostic Method Based on Deep Learning and Multimodel Feature Fusion for Complex Industrial Processes","volume":"59","author":"Li","year":"2020","journal-title":"Ind. Eng. Chem. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1355","DOI":"10.1109\/TR.2020.2996261","article-title":"WR-ELM: Weighted Regularization Extreme Learning Machine for Imbalance Learning in Software Fault Prediction","volume":"69","author":"Bal","year":"2020","journal-title":"IEEE Trans. Reliab."},{"key":"ref_38","first-page":"2672","article-title":"Generative adversarial networks","volume":"3","author":"Goodfellow","year":"2014","journal-title":"NIPS"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"91916","DOI":"10.1109\/ACCESS.2020.2994762","article-title":"CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection","volume":"8","author":"Waheed","year":"2020","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"4039","DOI":"10.1109\/TNNLS.2020.3016666","article-title":"Generative Adversarial Networks-Based Data Augmentation for Brain-Computer Interface","volume":"32","author":"Fahimi","year":"2020","journal-title":"IEEE Trans. Neur. Net. Lear."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"10844","DOI":"10.1109\/JSEN.2021.3059860","article-title":"Weld Defect Detection From Imbalanced Radiographic Images Based on Contrast Enhancement Conditional Generative Adversarial Network and Transfer Learning","volume":"21","author":"Guo","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1206","DOI":"10.1109\/TASE.2020.2998467","article-title":"Data Augmentation Classifier for Imbalanced Fault Classification","volume":"18","author":"Jiang","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_43","unstructured":"Odena, A., Olah, C., and Shlens, J. (2017, January 6\u201311). Conditional Image Synthesis with Auxiliary Classifier GANs. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Wu, Z., Chen, H., and Lei, Y. (2020). Unidimensional ACGAN Applied to Link Establishment Behaviors Recognition of a Short-Wave Radio Station. Sensors, 20.","DOI":"10.3390\/s20154270"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"161317","DOI":"10.1109\/ACCESS.2020.3021189","article-title":"Pixel-Wise Fabric Defect Detection by CNNs Without Labeled Training Data","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"e2741","DOI":"10.1002\/stc.2741","article-title":"Near real-time bolt-loosening detection using mask and region-based convolutional neural network","volume":"28","author":"Yuan","year":"2021","journal-title":"Struct. Control Health Monit."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Li, X., Ling, S.H., and Su, S. (2020). A Hybrid Feature Selection and Extraction Methods for Sleep Apnea Detection Using Bio-Signals. Sensors, 20.","DOI":"10.3390\/s20154323"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"104218","DOI":"10.1016\/j.compbiomed.2021.104218","article-title":"Cardiotocography Signal Abnormality Classification Using Time-frequency Features and Ensemble Cost-sensitive SVM Classifier","volume":"130","author":"Zeng","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"980","DOI":"10.1109\/TKDE.2004.29","article-title":"Multistrategy ensemble learning: Reducing error by combining ensemble learning techniques","volume":"16","author":"Webb","year":"2004","journal-title":"IEEE Trans. Knowl. Data En."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1638","DOI":"10.1109\/TFUZZ.2014.2371479","article-title":"A Study on Relationship Between Generalization Abilities and Fuzziness of Base Classifiers in Ensemble Learning","volume":"23","author":"Wang","year":"2015","journal-title":"IEEE Trans. Fuzzy Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/21\/7304\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:24:51Z","timestamp":1760167491000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/21\/7304"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,2]]},"references-count":50,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21217304"],"URL":"https:\/\/doi.org\/10.3390\/s21217304","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,2]]}}}