{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T03:06:00Z","timestamp":1779332760272,"version":"3.51.4"},"reference-count":32,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,3,8]],"date-time":"2024-03-08T00:00:00Z","timestamp":1709856000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation Youth Foundation of Shandong Province of China","award":["ZR2022QF126"],"award-info":[{"award-number":["ZR2022QF126"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Compared to fault diagnosis across operating conditions, the differences in data distribution between devices are more pronounced and better aligned with practical application needs. However, current research on transfer learning inadequately addresses fault diagnosis issues across devices. To better balance the relationship between computational resources and diagnostic accuracy, a knowledge distillation-based lightweight transfer learning framework for rolling bearing diagnosis is proposed in this study. Specifically, a deep teacher\u2013student model based on variable-scale residual networks is constructed to learn domain-invariant features relevant to fault classification within both the source and target domain data. Subsequently, a knowledge distillation framework incorporating a temperature factor is established to transfer fault features learned by the large teacher model in the source domain to the smaller student model, thereby reducing computational and parameter overhead. Finally, a multi-kernel domain adaptation method is employed to capture the feature probability distribution distance of fault characteristics between the source and target domains in Reproducing Kernel Hilbert Space (RKHS), and domain-invariant features are learned by minimizing the distribution distance between them. The effectiveness and applicability of the proposed method in situations of incomplete data across device types were validated through two engineering cases, spanning device models and transitioning from laboratory equipment to real-world operational devices.<\/jats:p>","DOI":"10.3390\/s24061758","type":"journal-article","created":{"date-parts":[[2024,3,8]],"date-time":"2024-03-08T10:10:52Z","timestamp":1709892652000},"page":"1758","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Lightweight Knowledge Distillation-Based Transfer Learning Framework for Rolling Bearing Fault Diagnosis"],"prefix":"10.3390","volume":"24","author":[{"given":"Ruijia","family":"Lu","sequence":"first","affiliation":[{"name":"School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4499-6722","authenticated-orcid":false,"given":"Shuzhi","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China"}]},{"given":"Zisu","family":"Gong","sequence":"additional","affiliation":[{"name":"School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China"}]},{"given":"Chengcheng","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China"}]},{"given":"Zonghe","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China"}]},{"given":"Yiqi","family":"Zhong","sequence":"additional","affiliation":[{"name":"School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China"}]},{"given":"Baojian","family":"Li","sequence":"additional","affiliation":[{"name":"School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"109966","DOI":"10.1016\/j.ress.2024.109966","article-title":"An unknown wafer surface defect detection approach based on Incremental Learning for reliability analysis","volume":"244","author":"Zhao","year":"2024","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4697","DOI":"10.1109\/TMECH.2022.3164101","article-title":"Iterative Learning Control for Robotic Path Following with Trial-Varying Motion Profiles","volume":"27","author":"Chen","year":"2022","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4492","DOI":"10.1109\/TII.2023.3316264","article-title":"Class-Aware Adversarial Multiwavelet Convolutional Neural Network for Cross-Domain Fault Diagnosis","volume":"20","author":"Zhao","year":"2023","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1016\/j.isatra.2023.03.046","article-title":"Iterative learning control for piecewise arc path tracking with validation on a gantry robot manufacturing platform","volume":"139","author":"Chen","year":"2023","journal-title":"ISA Trans."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"111258","DOI":"10.1016\/j.ymssp.2024.111258","article-title":"Self-paced decentralized federated transfer framework for rotating machinery fault diagnosis with multiple domains","volume":"211","author":"Zhao","year":"2024","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"102027","DOI":"10.1016\/j.aei.2023.102027","article-title":"Adaptive variational autoencoding generative adversarial networks for rolling bearing fault diagnosis","volume":"56","author":"Wang","year":"2023","journal-title":"Adv. Eng. Inform."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"036107","DOI":"10.1088\/1361-6501\/ad156f","article-title":"An Efficient Diagnostic Strategy for Intermittent Faults in Electronic Circuit Systems by Enhancing and Locating Local Features of Faults","volume":"35","author":"Jia","year":"2024","journal-title":"Meas. Sci. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2377","DOI":"10.1109\/TIM.2019.2956332","article-title":"A New Intelligent Bearing Fault Diagnosis Method Using SDP Representation and SE-CNN","volume":"69","author":"Wang","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, H., Huang, J., and Ji, S. (2019). Bearing Fault Diagnosis with a Feature Fusion Method Based on an Ensemble Convolutional Neural Network and Deep Neural Network. Sensors, 19.","DOI":"10.3390\/s19092034"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Shenfield, A., and Howarth, M. (2020). A Novel Deep Learning Model for the Detection and Identification of Rolling Element-Bearing Faults. Sensors, 20.","DOI":"10.3390\/s20185112"},{"key":"ref_11","unstructured":"Mikic, D., Desnica, E., Asonja, A., Stojanovic, B., and Epifanic-Pajic, V. (2016). Reliability analysis of ball bearing on the crankshaft of piston compressors. J. Balk. Tribol. Assoc., Available online: https:\/\/scidar.kg.ac.rs\/handle\/123456789\/16523."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"106974","DOI":"10.1016\/j.knosys.2021.106974","article-title":"Joint distribution adaptation network with adversarial learning for rolling bearing fault diagnosis","volume":"222","author":"Zhao","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"45","DOI":"10.18485\/aeletters.2023.8.2.1","article-title":"Temperature Conditions and Diagnostics of Bearings","volume":"8","author":"Pastukhov","year":"2023","journal-title":"Appl. Eng. Lett. J. Eng. Appl. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2761","DOI":"10.3233\/BME-141094","article-title":"An adaptive ultrasonic backscattered signal processing technique for instantaneous characteristic frequency detection","volume":"24","author":"Jin","year":"2014","journal-title":"Bio-Med. Mater. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"123649","DOI":"10.1109\/ACCESS.2020.3005687","article-title":"Deep Facial Diagnosis: Deep Transfer Learning from Face Recognition to Facial Diagnosis","volume":"8","author":"Jin","year":"2020","journal-title":"IEEE Access"},{"key":"ref_16","unstructured":"Shen, F., Chen, C., Yan, R., and Gao, R.X. (2015, January 21\u201323). Bearing fault diagnosis based on SVD feature extraction and transfer learning classification. Proceedings of the 2015 Prognostics and System Health Management Conference (PHM), Beijing, China."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1186\/s10033-021-00566-3","article-title":"Dynamic distribution adaptation based transfer network for cross domain bearing fault diagnosis","volume":"34","author":"Liao","year":"2021","journal-title":"Chin. J. Mech. Eng."},{"key":"ref_18","first-page":"8850976","article-title":"A new deep convolutional domain adaptation network for bearing fault diagnosis under different working conditions","volume":"2020","author":"Zhang","year":"2020","journal-title":"Shock Vib."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"095105","DOI":"10.1088\/1361-6501\/abeddd","article-title":"Domain adaptation-based deep feature learning method with a mixture of distance measures for bearing fault diagnosis","volume":"32","author":"Zhou","year":"2021","journal-title":"Meas. Sci. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.neucom.2020.04.073","article-title":"Deep multi-scale convolutional transfer learning network: A novel method for intelligent fault diagnosis of rolling bearings under variable working conditions and domains","volume":"407","author":"Zhao","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"76187","DOI":"10.1109\/ACCESS.2018.2883078","article-title":"Bearing Fault Diagnosis Under Variable Working Conditions Based on Domain Adaptation Using Feature Transfer Learning","volume":"6","author":"Tong","year":"2018","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1016\/j.ymssp.2018.12.051","article-title":"An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings","volume":"122","author":"Yang","year":"2019","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"109918","DOI":"10.1016\/j.ymssp.2022.109918","article-title":"Fast nonlinear blind deconvolution for rotating machinery fault diagnosis","volume":"187","author":"Zhang","year":"2023","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"111285","DOI":"10.1016\/j.knosys.2023.111285","article-title":"Attention Guided Multi-Wavelet Adversarial Network for Cross Domain Fault Diagnosis","volume":"284","author":"Wang","year":"2023","journal-title":"Knowl.-Based Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"015005","DOI":"10.1088\/1361-6501\/ab3a59","article-title":"An optimal deep sparse autoencoder with gated recurrent unit for rolling bearing fault diagnosis","volume":"31","author":"Zhao","year":"2019","journal-title":"Meas. Sci. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"121585","DOI":"10.1016\/j.eswa.2023.121585","article-title":"Multi-source weighted source-free domain transfer method for rotating machinery fault diagnosis","volume":"237","author":"Gao","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_27","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"109331","DOI":"10.1016\/j.asoc.2022.109331","article-title":"A neural network compression method based on knowledge-distillation and parameter quantization for the bearing fault diagnosis","volume":"127","author":"Ji","year":"2022","journal-title":"Appl. Soft Comput."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xu, Y., Yan, X., Sun, B., Feng, K., Kou, L., Chen, Y., Li, Y., Chen, H., Tian, E., and Ni, Q. (2023). Online knowledge distillation based multiscale threshold denoising networks for fault diag-nosis of transmission systems. IEEE Trans. Transp. Electrif.","DOI":"10.1109\/TTE.2023.3313986"},{"key":"ref_30","unstructured":"Targ, S., Almeida, D., and Lyman, K. (2016). Resnet in resnet: Generalizing residual architectures. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shao, H., Zhou, X., Lin, J., and Liu, B. (2024). Few-Shot Cross-Domain Fault Diagnosis of Bearing Driven by Task-Supervised ANIL. IEEE Internet Things J.","DOI":"10.1109\/JIOT.2024.3360432"},{"key":"ref_32","unstructured":"(2024, February 18). Available online: https:\/\/csegroups.case.edu\/bearingdatacenter."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/6\/1758\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:11:07Z","timestamp":1760105467000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/6\/1758"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,8]]},"references-count":32,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["s24061758"],"URL":"https:\/\/doi.org\/10.3390\/s24061758","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,8]]}}}