{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T00:24:07Z","timestamp":1775694247759,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,11,4]],"date-time":"2024-11-04T00:00:00Z","timestamp":1730678400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["B230205019"],"award-info":[{"award-number":["B230205019"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["2019YFE0105200"],"award-info":[{"award-number":["2019YFE0105200"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["B230205019"],"award-info":[{"award-number":["B230205019"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFE0105200"],"award-info":[{"award-number":["2019YFE0105200"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Rolling bearings are often exposed to high speeds and pressures, leading to the symmetry in their rotating structure being disrupted, which can lead to serious failures. Intelligent rolling bearing fault diagnosis is a critical part of ensuring operation of machinery, and it has been facilitated by the growing popularity of convolutional neural networks (CNNs). The outstanding performance of fault diagnosis CNNs results from complex and redundant network structures and parameters, resulting in huge storage and computational requirements, which makes it challenging to implement these models in resource-limited industrial devices. This study aims to address this problem by proposing a comprehensive compression method for CNNs that is applied to intelligent fault diagnosis. It involves several different compression methods, including tensor train decomposition, parameter quantization, and knowledge distillation for deep network compression. This results in a significant decrease in redundancy and speeding up the training of CNN models. Firstly, tensor train decomposition is applied to reduce redundant connections in both convolutional and fully connected layers. The next step is to perform parameter quantization to minimize the bits needed for parameter representation and storage. Finally, knowledge distillation is used to restore accuracy to the compressed model. The effectiveness of the proposed approach is confirmed by an experiment and ablation study with different models on several datasets. The results show that it can significantly reduce redundant information and floating-point operations with little degradation in accuracy. Notably, on the CWRU dataset, with about 60% parameter reduction, there is no degradation in our model\u2019s accuracy. The proposed approach is a new attempt at the intelligent fault diagnosis of rolling bearings in industrial equipment.<\/jats:p>","DOI":"10.3390\/sym16111461","type":"journal-article","created":{"date-parts":[[2024,11,4]],"date-time":"2024-11-04T03:57:34Z","timestamp":1730692654000},"page":"1461","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Intelligent Fault Diagnosis Method Based on Neural Network Compression for Rolling Bearings"],"prefix":"10.3390","volume":"16","author":[{"given":"Xinren","family":"Wang","sequence":"first","affiliation":[{"name":"Jiangsu Special Equipment Safety Supervision and Inspection Institute, Wuxi 214174, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dongming","family":"Hu","sequence":"additional","affiliation":[{"name":"Jiangsu Special Equipment Safety Supervision and Inspection Institute, Wuxi 214174, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xueqi","family":"Fan","sequence":"additional","affiliation":[{"name":"Jiangsu Special Equipment Safety Supervision and Inspection Institute, Wuxi 214174, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huiyi","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Computer and Soft, Hohai University, Nanjing 211100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8178-2179","authenticated-orcid":false,"given":"Chenbin","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Computer and Soft, Hohai University, Nanjing 211100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"He, Y., Lin, J., Liu, Z., Wang, H., Li, L.-J., and Han, S. (2018, January 8\u201314). AMC: AutoML for Model Compression and Acceleration on Mobile Devices. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_48"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"He, Y., Kang, G., Dong, X., Fu, Y., and Yang, Y. (2018, January 13\u201319). Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks. Proceedings of the 27th International Joint Conference on Artificial Intelligence, Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/309"},{"key":"ref_3","unstructured":"Gong, R., Liu, X., Jiang, S., Li, T., Hu, P., Lin, J., Yu, F., and Yan, J. (November, January 27). Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea."},{"key":"ref_4","first-page":"18518","article-title":"HAWQ-V2: Hessian Aware Trace-Weighted Quantization of Neural Networks","volume":"Volume 33","author":"Larochelle","year":"2020","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kossaifi, J., Toisoul, A., Bulat, A., Panagakis, Y., Hospedales, T.M., and Pantic, M. (2020, January 13\u201319). Factorized Higher-Order CNNs with an Application to Spatio-Temporal Emotion Estimation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00610"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kim, Y.-D., Park, E., Yoo, S., Choi, T., Yang, L., and Shin, D. (2016). Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile Applications. arXiv.","DOI":"10.14257\/astl.2016.140.36"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4735","DOI":"10.1109\/TIP.2021.3066051","article-title":"ResKD: Residual-Guided Knowledge Distillation","volume":"30","author":"Li","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"109331","DOI":"10.1016\/j.asoc.2022.109331","article-title":"A Neural Network Compression Method Based on Knowledge-Distillation and Parameter Quantization for the Bearing Fault Diagnosis","volume":"127","author":"Ji","year":"2022","journal-title":"Appl. Soft Comput."},{"key":"ref_9","first-page":"3891","article-title":"Tensor-Train Recurrent Neural Networks for Video Classification","volume":"Volume 70","author":"Precup","year":"2017","journal-title":"Proceedings of the 34th International Conference on Machine Learning"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/s40799-017-0174-5","article-title":"Feature Extraction for Rolling Element Bearing Faults Using Resonance Sparse Signal Decomposition","volume":"41","author":"Huang","year":"2017","journal-title":"Exp. Tech."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"86510","DOI":"10.1109\/ACCESS.2020.2992692","article-title":"Convolutional Neural Network in Intelligent Fault Diagnosis Toward Rotatory Machinery","volume":"8","author":"Tang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"93155","DOI":"10.1109\/ACCESS.2020.2990528","article-title":"Bearing Fault Detection and Diagnosis Using Case Western Reserve University Dataset With Deep Learning Approaches: A Review","volume":"8","author":"Neupane","year":"2020","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0165-1684(90)90158-U","article-title":"Fast Fourier Transforms: A Tutorial Review and a State of the Art","volume":"19","author":"Duhamel","year":"1990","journal-title":"Signal Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1049\/ecej:19940401","article-title":"Wavelet Transforms: An Introduction","volume":"6","author":"McDonnell","year":"1994","journal-title":"Electron. Commun. Eng. J."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zeiler, A., Faltermeier, R., Keck, I.R., Tom\u00e9, A.M., Puntonet, C.G., and Lang, E.W. (2010, January 18\u201323). Empirical Mode Decomposition\u2014An Introduction. Proceedings of the 2010 International Joint Conference on Neural Networks (IJCNN), Barcelona, Spain.","DOI":"10.1109\/IJCNN.2010.5596829"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xu, L., Chatterton, S., Pennacchi, P., and Liu, C. (2020). A Tacholess Order Tracking Method Based on Inverse Short Time Fourier Transform and Singular Value Decomposition for Bearing Fault Diagnosis. Sensors, 20.","DOI":"10.3390\/s20236924"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1016\/S0301-679X(02)00063-4","article-title":"Application of Discrete Wavelet Transform for Detection of Ball Bearing Race Faults","volume":"35","author":"Prabhakar","year":"2002","journal-title":"Tribol. Int."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"145194","DOI":"10.1109\/ACCESS.2020.3012559","article-title":"Intelligent Fault Diagnosis of Rolling Bearing Using FCM Clustering of EMD-PWVD Vibration Images","volume":"8","author":"Fan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103050","DOI":"10.1016\/j.dsp.2021.103050","article-title":"An Improved Complementary Ensemble Empirical Mode Decomposition Method and Its Application in Rolling Bearing Fault Diagnosis","volume":"113","author":"Gu","year":"2021","journal-title":"Digit. Signal Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2607","DOI":"10.1016\/j.ymssp.2006.12.004","article-title":"Bearing Fault Diagnosis Using FFT of Intrinsic Mode Functions in Hilbert\u2013Huang Transform","volume":"21","author":"Rai","year":"2007","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2177","DOI":"10.1007\/s11071-021-07078-8","article-title":"Unknown Bearing Fault Diagnosis under Time-Varying Speed Conditions and Strong Noise Background","volume":"107","author":"Yang","year":"2022","journal-title":"Nonlinear Dyn."},{"key":"ref_22","first-page":"8843759","article-title":"A Review of Artificial Intelligence Methods for Condition Monitoring and Fault Diagnosis of Rolling Element Bearings for Induction Motor","volume":"2020","author":"AlShorman","year":"2020","journal-title":"Shock Vib."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"63584","DOI":"10.1109\/ACCESS.2018.2877447","article-title":"An End-to-End Model Based on Improved Adaptive Deep Belief Network and Its Application to Bearing Fault Diagnosis","volume":"6","author":"Xie","year":"2018","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.ymssp.2015.10.025","article-title":"Deep Neural Networks: A Promising Tool for Fault Characteristic Mining and Intelligent Diagnosis of Rotating Machinery with Massive Data","volume":"72\u201373","author":"Jia","year":"2016","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"31078","DOI":"10.1109\/ACCESS.2021.3059761","article-title":"Rolling Bearing Fault Diagnosis Based on One-Dimensional Dilated Convolution Network With Residual Connection","volume":"9","author":"Liang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/j.ymssp.2017.06.022","article-title":"A Deep Convolutional Neural Network with New Training Methods for Bearing Fault Diagnosis under Noisy Environment and Different Working Load","volume":"100","author":"Zhang","year":"2018","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"106427","DOI":"10.1016\/j.cie.2020.106427","article-title":"Domain Adaptive Deep Belief Network for Rolling Bearing Fault Diagnosis","volume":"143","author":"Che","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"12990","DOI":"10.1007\/s10489-021-03107-6","article-title":"Timed Failure Propagation Graph Construction with Supremal Language Guided Tree-LSTM and Its Application to Interpretable Fault Diagnosis","volume":"52","author":"Chen","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"107417","DOI":"10.1016\/j.measurement.2019.107417","article-title":"A Reinforcement Neural Architecture Search Method for Rolling Bearing Fault Diagnosis","volume":"154","author":"Wang","year":"2020","journal-title":"Measurement"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"29857","DOI":"10.1109\/ACCESS.2020.2972859","article-title":"Deep Learning Algorithms for Bearing Fault Diagnostics\u2014A Comprehensive Review","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"106060","DOI":"10.1016\/j.asoc.2019.106060","article-title":"Stacked Pruning Sparse Denoising Autoencoder Based Intelligent Fault Diagnosis of Rolling Bearings","volume":"88","author":"Zhu","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3502813","DOI":"10.1109\/TIM.2022.3231325","article-title":"Lightweight Multiscale Convolutional Networks With Adaptive Pruning for Intelligent Fault Diagnosis of Train Bogie Bearings in Edge Computing Scenarios","volume":"72","author":"Ding","year":"2023","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"107756","DOI":"10.1016\/j.measurement.2020.107756","article-title":"A Lightweight Neural Network with Strong Robustness for Bearing Fault Diagnosis","volume":"159","author":"Yao","year":"2020","journal-title":"Measurement"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3521109","DOI":"10.1109\/TIM.2021.3091498","article-title":"HS-KDNet: A Lightweight Network Based on Hierarchical-Split Block and Knowledge Distillation for Fault Diagnosis With Extremely Imbalanced Data","volume":"70","author":"Deng","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2521711","DOI":"10.1109\/TIM.2023.3298403","article-title":"EdgeCog: A Real-Time Bearing Fault Diagnosis System Based on Lightweight Edge Computing","volume":"72","author":"Fu","year":"2023","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_36","unstructured":"Li, X., Hu, Y., Zheng, J., and Li, M. (2020). Neural Architecture Search For Fault Diagnosis. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"107773","DOI":"10.1016\/j.ymssp.2021.107773","article-title":"Differentiable Neural Architecture Search Augmented with Pruning and Multi-Objective Optimization for Time-Efficient Intelligent Fault Diagnosis of Machinery","volume":"158","author":"Zhang","year":"2021","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_38","unstructured":"Garipov, T., Podoprikhin, D., Novikov, A., and Vetrov, D. (2016). Ultimate Tensorization: Compressing Convolutional and Fc Layers Alike. arXiv."},{"key":"ref_39","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the Knowledge in a Neural Network. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1109\/TR.2018.2882682","article-title":"A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings","volume":"69","author":"Wang","year":"2020","journal-title":"IEEE Trans. Reliab."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.ymssp.2015.04.021","article-title":"Rolling Element Bearing Diagnostics Using the Case Western Reserve University Data: A Benchmark Study","volume":"64\u201365","author":"Smith","year":"2015","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5990","DOI":"10.1109\/TIE.2017.2774777","article-title":"A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method","volume":"65","author":"Wen","year":"2018","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"109088","DOI":"10.1016\/j.measurement.2021.109088","article-title":"A New Bearing Fault Diagnosis Method Based on Signal-to-Image Mapping and Convolutional Neural Network","volume":"176","author":"Zhao","year":"2021","journal-title":"Measurement"},{"key":"ref_44","unstructured":"Li, H., Kadav, A., Durdanovic, I., Samet, H., and Graf, H.P. (2017, January 24\u201326). Pruning Filters for Efficient ConvNets. Proceedings of the International Conference on Learning Representations (ICLR), Toulon, France."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lin, M., Ji, R., Wang, Y., Zhang, Y., Zhang, B., Tian, Y., and Shao, L. (2020, January 13\u201319). HRank: Filter Pruning Using High-Rank Feature Map. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00160"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., Bischof, H., Brox, T., and Frahm, J.-M. (2020, January 23\u201328). Stable Low-Rank Tensor Decomposition for Compression of Convolutional Neural Network. Proceedings of the Computer Vision\u2014ECCV 2020, Glasgow, UK.","DOI":"10.1007\/978-3-030-58598-3"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"4730","DOI":"10.1109\/TNNLS.2017.2774288","article-title":"Quantized CNN: A Unified Approach to Accelerate and Compress Convolutional Networks","volume":"29","author":"Cheng","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.compind.2019.05.005","article-title":"A Novel Deep Stacking Least Squares Support Vector Machine for Rolling Bearing Fault Diagnosis","volume":"110","author":"Li","year":"2019","journal-title":"Comput. Ind."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"104749","DOI":"10.1016\/j.engappai.2022.104749","article-title":"Adaptive Nearest Neighbor Reconstruction with Deep Contractive Sparse Filtering for Fault Diagnosis of Roller Bearings","volume":"111","author":"Qian","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.psep.2021.07.002","article-title":"A New Deep Model Based on the Stacked Autoencoder with Intensified Iterative Learning Style for Industrial Fault Detection","volume":"153","author":"Yu","year":"2021","journal-title":"Process Saf. Environ. Prot."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/11\/1461\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:28:02Z","timestamp":1760113682000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/11\/1461"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,4]]},"references-count":50,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["sym16111461"],"URL":"https:\/\/doi.org\/10.3390\/sym16111461","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,4]]}}}