{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T19:24:48Z","timestamp":1794079488418,"version":"4.8.0"},"reference-count":36,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,1,13]],"date-time":"2022-01-13T00:00:00Z","timestamp":1642032000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51805434 and 12172290"],"award-info":[{"award-number":["51805434 and 12172290"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key Laboratory of Equipment Research Foundation","award":["6142003190208"],"award-info":[{"award-number":["6142003190208"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The vibration signal of gearboxes contains abundant fault information, which can be used for condition monitoring. However, vibration signal is ineffective for some non-structural failures. In order to resolve this dilemma, infrared thermal images are introduced to combine with vibration signals via fusion domain-adaptation convolutional neural network (FDACNN), which can diagnose both structural and non-structural failures under various working conditions. First, the measured raw signals are converted into frequency and squared envelope spectrum to characterize the health states of the gearbox. Second, the sequences of the frequency and squared envelope spectrum are arranged into two-dimensional format, which are combined with infrared thermal images to form fusion data. Finally, the adversarial network is introduced to realize the state recognition of structural and non-structural faults in the unlabeled target domain. An experiment of gearbox test rigs was used for effectiveness validation by measuring both vibration and infrared thermal images. The results suggest that the proposed FDACNN method performs best in cross-domain fault diagnosis of gearboxes via multi-source heterogeneous data compared with the other four methods.<\/jats:p>","DOI":"10.3390\/e24010119","type":"journal-article","created":{"date-parts":[[2022,1,13]],"date-time":"2022-01-13T10:57:37Z","timestamp":1642071457000},"page":"119","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Fusion Domain-Adaptation CNN Driven by Images and Vibration Signals for Fault Diagnosis of Gearbox Cross-Working Conditions"],"prefix":"10.3390","volume":"24","author":[{"given":"Gang","family":"Mao","sequence":"first","affiliation":[{"name":"MIIT Key Laboratory of Dynamics and Control of Complex System, School of Aeronautics, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongzheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"MIIT Key Laboratory of Dynamics and Control of Complex System, School of Aeronautics, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Qiao","sequence":"additional","affiliation":[{"name":"MIIT Key Laboratory of Dynamics and Control of Complex System, School of Aeronautics, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2699-9951","authenticated-orcid":false,"given":"Yongbo","family":"Li","sequence":"additional","affiliation":[{"name":"MIIT Key Laboratory of Dynamics and Control of Complex System, School of Aeronautics, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"107132","DOI":"10.1016\/j.measurement.2019.107132","article-title":"A multi-ensemble method based on deep auto-encoders for fault diagnosis of rolling bearings","volume":"151","author":"Kong","year":"2020","journal-title":"Measurement"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"108463","DOI":"10.1016\/j.apacoust.2021.108463","article-title":"Intelligent worm gearbox fault diagnosis under various working conditions using vibration, sound and thermal features","volume":"186","author":"Karabacak","year":"2022","journal-title":"Appl. Acoust."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"108202","DOI":"10.1016\/j.ymssp.2021.108202","article-title":"A review on the application of blind deconvolution in machinery fault diagnosis","volume":"163","author":"Miao","year":"2022","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"107996","DOI":"10.1016\/j.ymssp.2021.107996","article-title":"Planetary gearbox fault diagnosis using bidirectional-convolutional LSTM networks","volume":"162","author":"Shi","year":"2022","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.isatra.2018.04.005","article-title":"Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders","volume":"77","author":"Liu","year":"2018","journal-title":"ISA Trans."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/j.ymssp.2017.06.022","article-title":"A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load","volume":"100","author":"Zhang","year":"2018","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_7","first-page":"1","article-title":"One-dimensional residual convolutional auto-encoder for fault detection in complex industrial processes","volume":"196","author":"Yu","year":"2021","journal-title":"Int. J. Prod. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"110258","DOI":"10.1016\/j.measurement.2021.110258","article-title":"Fault diagnosis of rotating machinery based on dual convolutional-capsule network (DC-CN)","volume":"187","author":"Li","year":"2022","journal-title":"Measurement"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3208","DOI":"10.1109\/TIE.2018.2844856","article-title":"Estimation of bearing remaining useful life based on multiscale convolutional neural network","volume":"66","author":"Zhu","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"107756","DOI":"10.1016\/j.measurement.2020.107756","article-title":"A lightweight neural network with strong robustness for bearing fault diagnosis","volume":"159","author":"Yao","year":"2020","journal-title":"Measurement"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.ymssp.2017.09.026","article-title":"A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders","volume":"102","author":"Shao","year":"2018","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7316","DOI":"10.1109\/TIE.2018.2877090","article-title":"Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines with Unlabeled Data","volume":"66","author":"Guo","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/j.knosys.2018.12.019","article-title":"A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults","volume":"165","author":"Han","year":"2019","journal-title":"Knowl. Based Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Qian, W., Li, S., Wang, J., Xin, Y., and Ma, H. (2018, January 26\u201328). A New Deep Transfer Learning Network for Fault Diagnosis of Rotating Machine Under Variable Working Conditions. Proceedings of the 2018 Prognostics and System Health Management Conference (PHM-Chongqing), Chongqing, China.","DOI":"10.1109\/PHM-Chongqing.2018.00180"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1109\/TII.2019.2917233","article-title":"Intelligent Fault Diagnosis for Rotary Machinery Using Transferable Convolutional Neural Network","volume":"16","author":"Chen","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1016\/j.ymssp.2018.12.051","article-title":"An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings","volume":"122","author":"Yang","year":"2019","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"105107","DOI":"10.1088\/1361-6501\/ab230b","article-title":"A novel convolutional transfer feature discrimination network for imbalanced fault diagnosis under variable rotational speed","volume":"30","author":"Xu","year":"2019","journal-title":"Meas. Sci. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1109\/TSMC.2017.2754287","article-title":"A new deep transfer learning based on sparse auto-encoder for fault diagnosis","volume":"49","author":"Wen","year":"2017","journal-title":"IEEE Trans. Syst. Man Cybern.-Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"65303","DOI":"10.1109\/ACCESS.2019.2916935","article-title":"A Deep Transfer Model With Wasserstein Distance Guided Multi-Adversarial Networks for Bearing Fault Diagnosis under Different Working Conditions","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Li, X., Wen, L., Gao, L., and Gao, Y. (2019, January 22\u201326). Fault Diagnosis Using Unsupervised Transfer Learning Based on Adversarial Network. Proceedings of the 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), Vancouver, BC, Canada.","DOI":"10.1109\/COASE.2019.8842881"},{"key":"ref_21","unstructured":"Zhang, B., Li, W., Hao, J., Li, X.-L., and Zhang, M. (2018). Adversarial adaptive 1-D convolutional neural networks for bearing fault diagnosis under varying working condition. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, B., Shen, C., Yu, C., and Yang, Y. (2019, January 3\u20136). Data Fused Motor Fault Identification Based on Adversarial Auto-Encoder. Proceedings of the 2019 IEEE 10th International Symposium on Power Electronics for Distributed Generation Systems (PEDG), Xi\u2019an, China.","DOI":"10.1109\/PEDG.2019.8807538"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"110213","DOI":"10.1016\/j.measurement.2021.110213","article-title":"A multi-source ensemble domain adaptation method for rotary machine fault diagnosis","volume":"186","author":"Yang","year":"2021","journal-title":"Measurement"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"106396","DOI":"10.1016\/j.knosys.2020.106396","article-title":"Ensemble transfer CNNs driven by multi-channel signals for fault diagnosis of rotating machinery cross working conditions","volume":"207","author":"He","year":"2020","journal-title":"Knowl. Based Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"108219","DOI":"10.1016\/j.ymssp.2021.108219","article-title":"Multisource domain factorization network for cross-domain fault diagnosis of rotating machinery: An unsupervised multisource domain adaptation method","volume":"164","author":"Shi","year":"2022","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_26","first-page":"8957","article-title":"Modified Gaussian convolutional deep belief network and infrared thermal imaging for intelligent fault diagnosis of rotor-bearing system under time-varying speeds","volume":"99","author":"Xin","year":"2021","journal-title":"Struct. Health Monit."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"109196","DOI":"10.1016\/j.measurement.2021.109196","article-title":"Convolutional neural network based bearing fault diagnosis of rotating machine using thermal images","volume":"176","author":"Choudhary","year":"2021","journal-title":"Measurement"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"12348","DOI":"10.1109\/ACCESS.2019.2893331","article-title":"A rotating machinery fault diagnosis method based on feature learning of thermal images","volume":"7","author":"Jia","year":"2019","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"6622041","DOI":"10.1155\/2021\/6622041","article-title":"Information Fusion of Infrared Images and Vibration Signals for Coupling Fault Diagnosis of Rotating Machinery","volume":"2021","author":"Bai","year":"2021","journal-title":"Shock. Vib."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/s11431-020-1679-x","article-title":"Ensemble deep transfer learning driven by multisensor signals for the fault diagnosis of bevel-gear cross-operation conditions","volume":"64","author":"Di","year":"2021","journal-title":"Sci. China Technol. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107174","DOI":"10.1016\/j.ymssp.2020.107174","article-title":"Rolling element bearing diagnosis based on singular value decomposition and composite squared envelope spectrum","volume":"148","author":"Xu","year":"2021","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kia, S.H., Henao, H., and Capolino, G.-A. (2013, January 11\u201312). Efficient digital signal processing techniques for induction machines fault diagnosis. Proceedings of the 2013 IEEE Workshop on Electrical Machines Design, Control and Diagnosis (WEMDCD), Paris, France.","DOI":"10.1109\/WEMDCD.2013.6525183"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Li, Y., Gu, J.X., Zhen, D., Xu, M., and Ball, A. (2019). An evaluation of gearbox condition monitoring using infrared thermal images applied with convolutional neural networks. Sensors, 19.","DOI":"10.3390\/s19092205"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.cja.2019.08.014","article-title":"Rotating machinery fault diagnosis based on convolutional neural network and infrared thermal imaging","volume":"33","author":"Yongbo","year":"2020","journal-title":"Chin. J. Aeronaut."},{"key":"ref_35","first-page":"2030","article-title":"Domain-adversarial training of neural networks","volume":"17","author":"Ganin","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.1109\/TIE.2016.2627020","article-title":"Deep model based domain adaptation for fault diagnosis","volume":"64","author":"Lu","year":"2016","journal-title":"IEEE Trans. Ind. Electron."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/119\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:28:55Z","timestamp":1760365735000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,13]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010119"],"URL":"https:\/\/doi.org\/10.3390\/e24010119","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,13]]}}}