{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T15:10:40Z","timestamp":1782486640631,"version":"3.54.5"},"reference-count":42,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T00:00:00Z","timestamp":1678838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The Key Research and Development Project of Zhejiang Province","award":["2020C01088"],"award-info":[{"award-number":["2020C01088"]}]},{"name":"The Key Research and Development Project of Zhejiang Province","award":["2019YFC1509503"],"award-info":[{"award-number":["2019YFC1509503"]}]},{"name":"The National Key R&amp;D Program of China","award":["2020C01088"],"award-info":[{"award-number":["2020C01088"]}]},{"name":"The National Key R&amp;D Program of China","award":["2019YFC1509503"],"award-info":[{"award-number":["2019YFC1509503"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The fault diagnosis of rolling bearings is critical for the reliability assurance of mechanical systems. The operating speeds of the rolling bearings in industrial applications are usually time-varying, and the monitoring data available are difficult to cover all the speeds. Though deep learning techniques have been well developed, the generalization capacity under different working speeds is still challenging. In this paper, a sound and vibration fusion method, named the fusion multiscale convolutional neural network (F-MSCNN), was developed with strong adaptation performance under speed-varying conditions. The F-MSCNN works directly on raw sound and vibration signals. A fusion layer and a multiscale convolutional layer were added at the beginning of the model. With comprehensive information, such as the input, multiscale features are learned for subsequent classification. An experiment on the rolling bearing test bed was carried out, and six datasets under various working speeds were constructed. The results show that the proposed F-MSCNN can achieve high accuracy with stable performance when the speeds of the testing set are the same as or different from the training set. A comparison with other methods on the same datasets also proves the superiority of F-MSCNN in speed generalization. The diagnosis accuracy improves by sound and vibration fusion and multiscale feature learning.<\/jats:p>","DOI":"10.3390\/s23063130","type":"journal-article","created":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T05:22:59Z","timestamp":1678857779000},"page":"3130","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["A Sound and Vibration Fusion Method for Fault Diagnosis of Rolling Bearings under Speed-Varying Conditions"],"prefix":"10.3390","volume":"23","author":[{"given":"Haibo","family":"Wan","sequence":"first","affiliation":[{"name":"School of Mechanical and Automobile Engineering, Zhejiang University of Water Resources and Electric Power, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiwen","family":"Gu","sequence":"additional","affiliation":[{"name":"The State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China"},{"name":"The Key Laboratory of Advanced Manufacturing Technology of Zhejiang Province, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1993-0123","authenticated-orcid":false,"given":"Shixi","family":"Yang","sequence":"additional","affiliation":[{"name":"The State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China"},{"name":"The Key Laboratory of Advanced Manufacturing Technology of Zhejiang Province, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanni","family":"Fu","sequence":"additional","affiliation":[{"name":"Hangzhou Steam Turbine Co., Ltd., Hangzhou 310022, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wu, G., Yan, T., Yang, G., Chai, H., and Cao, C. (2022). A Review on Rolling Bearing Fault Signal Detection Methods Based on Different Sensors. Sensors, 22.","DOI":"10.3390\/s22218330"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1016\/j.triboint.2015.12.037","article-title":"A review on signal processing techniques utilized in the fault diagnosis of rolling element bearings","volume":"96","author":"Rai","year":"2016","journal-title":"Tribol. Int."},{"key":"ref_3","first-page":"252","article-title":"A summary of fault modelling and predictive health monitoring of rolling element bearings","volume":"60\u201361","author":"Jantunen","year":"2015","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5644","DOI":"10.1016\/j.jsv.2012.07.026","article-title":"Envelope order tracking for fault detection in rolling element bearings","volume":"331","author":"Guo","year":"2012","journal-title":"J. Sound Vib."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tayyab, S.M., Chatterton, S., and Pennacchi, P. (2022). Intelligent Defect Diagnosis of Rolling Element Bearings under Variable Operating Conditions Using Convolutional Neural Network and Order Maps. Sensors, 22.","DOI":"10.3390\/s22052026"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.jsv.2015.12.041","article-title":"An online tacholess order tracking technique based on generalized demodulation for rolling bearing fault detection","volume":"367","author":"Wang","year":"2016","journal-title":"J. Sound Vib."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5556","DOI":"10.1109\/TIM.2019.2963582","article-title":"Rotating Angle Estimation for Hybrid Stepper Motors with Application to Bearing Fault Diagnosis","volume":"69","author":"Wang","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5091","DOI":"10.1109\/JSEN.2020.3035623","article-title":"Multiple Time-Frequency Curve Classification for Tacho-Less and Resampling-Less Compound Bearing Fault Detection Under Time-Varying Speed Conditions","volume":"21","author":"Tang","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.isatra.2021.01.010","article-title":"Instantaneous frequency estimation for wheelset bearings weak fault signals using second-order synchrosqueezing S-transform with optimally weighted sliding window","volume":"115","author":"Lin","year":"2021","journal-title":"ISA Trans."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"106297","DOI":"10.1016\/j.ymssp.2019.106297","article-title":"Signal optimization based generalized demodulation transform for rolling bearing nonstationary fault characteristic extraction","volume":"134","author":"Zhao","year":"2019","journal-title":"Mech. Syst. Signal Proc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"570","DOI":"10.23940\/ijpe.22.08.p5.570579","article-title":"Multi-point face milling tool condition monitoring through vibration spectrogram and LSTM-Autoencoder","volume":"18","author":"Keshav","year":"2022","journal-title":"Int. J. Perform. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"106587","DOI":"10.1016\/j.ymssp.2019.106587","article-title":"Applications of machine learning to machine fault diagnosis: A review and roadmap","volume":"138","author":"Lei","year":"2020","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_13","first-page":"177","article-title":"Health Monitoring of Milling Tool Inserts Using CNN Architectures Trained by Vibration Spectrograms","volume":"136","author":"Patil","year":"2023","journal-title":"Comput. Model. Eng. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hakim, M., Omran, A.A.B., Inayat-Hussain, J.I., Ahmed, A.N., Abdellatef, H., Abdellatif, A., and Gheni, H.M. (2022). Bearing Fault Diagnosis Using Lightweight and Robust One-Dimensional Convolution Neural Network in the Frequency Domain. Sensors, 22.","DOI":"10.3390\/s22155793"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIM.2021.3127641","article-title":"A New Interpretable Learning Method for Fault Diagnosis of Rolling Bearings","volume":"70","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.isatra.2019.01.018","article-title":"A fault diagnosis scheme for rotating machinery using hierarchical symbolic analysis and convolutional neural network","volume":"91","author":"Yang","year":"2019","journal-title":"ISA Trans."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.neucom.2019.05.052","article-title":"An improved deep convolutional neural network with multi-scale information for bearing fault diagnosis","volume":"359","author":"Huang","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"025003","DOI":"10.1088\/1361-6501\/ab4488","article-title":"K-SVD-based WVD enhancement algorithm for planetary gearbox fault diagnosis under a CNN framework","volume":"31","author":"Li","year":"2019","journal-title":"Meas. Sci. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"9341","DOI":"10.1007\/s00500-018-3644-5","article-title":"A bearing vibration data analysis based on spectral kurtosis and ConvNet","volume":"23","author":"Udmale","year":"2018","journal-title":"Soft Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"8005","DOI":"10.1109\/TIE.2019.2942548","article-title":"Multitask Convolutional Neural Network with Information Fusion for Bearing Fault Diagnosis and Localization","volume":"67","author":"Guo","year":"2020","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1310","DOI":"10.1109\/TII.2016.2645238","article-title":"Dislocated Time Series Convolutional Neural Architecture: An Intelligent Fault Diagnosis Approach for Electric Machine","volume":"13","author":"Liu","year":"2017","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.promfg.2020.07.001","article-title":"Multi-scale CNN for Multi-sensor Feature Fusion in Helical Gear Fault Detection","volume":"49","author":"Li","year":"2020","journal-title":"Procedia Manuf."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Di Maggio, L.G. (2023). Intelligent Fault Diagnosis of Industrial Bearings Using Transfer Learning and CNNs Pre-Trained for Audio Classification. Sensors, 23.","DOI":"10.3390\/s23010211"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhao, X., Shao, F., and Zhang, Y. (2022). A Novel Joint Adversarial Domain Adaptation Method for Rotary Machine Fault Diagnosis under Different Working Conditions. Sensors, 22.","DOI":"10.3390\/s22229007"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2511","DOI":"10.1109\/TII.2020.3003353","article-title":"Cascade Convolutional Neural Network with Progressive Optimization for Motor Fault Diagnosis under Nonstationary Conditions","volume":"17","author":"Wang","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2377","DOI":"10.1109\/TIM.2019.2956332","article-title":"A New Intelligent Bearing Fault Diagnosis Method Using SDP Representation and SE-CNN","volume":"69","author":"Wang","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.measurement.2019.04.093","article-title":"A deep convolutional neural network based fusion method of two-direction vibration signal data for health state identification of planetary gearboxes","volume":"146","author":"Chen","year":"2019","journal-title":"Measurement"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"108122","DOI":"10.1016\/j.measurement.2020.108122","article-title":"An adaptive data fusion strategy for fault diagnosis based on the convolutional neural network","volume":"165","author":"Li","year":"2020","journal-title":"Measurement"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2658","DOI":"10.1109\/TIM.2019.2925247","article-title":"DCNN-Based Multi-Signal Induction Motor Fault Diagnosis","volume":"69","author":"Shao","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.apacoust.2018.09.017","article-title":"A novel Doppler Effect reduction method for wayside acoustic train bearing fault detection systems","volume":"145","author":"Zhang","year":"2019","journal-title":"Appl. Acoust."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"108151","DOI":"10.1016\/j.apacoust.2021.108151","article-title":"Fault diagnosis of planetary gearbox based on acoustic signals","volume":"181","author":"Yao","year":"2021","journal-title":"Appl. Acoust."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.ymssp.2013.12.002","article-title":"Sound based induction motor fault diagnosis using Kohonen self-organizing map","volume":"46","author":"Germen","year":"2014","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A., and Liu, W. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.neucom.2018.02.111","article-title":"MCFF-CNN: Multiscale comprehensive feature fusion convolutional neural network for vehicle color recognition based on residual learning","volume":"395","author":"Fu","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7496","DOI":"10.1109\/TIE.2020.3003649","article-title":"Multiscale Convolutional Attention Network for Predicting Remaining Useful Life of Machinery","volume":"68","author":"Wang","year":"2021","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.isatra.2020.10.054","article-title":"Fault diagnosis of rolling bearings using an Improved Multi-Scale Convolutional Neural Network with Feature Attention mechanism","volume":"110","author":"Xu","year":"2021","journal-title":"ISA Trans."},{"key":"ref_37","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.jsv.2016.09.012","article-title":"Fault diagnosis of motor bearing with speed fluctuation via angular resampling of transient sound signals","volume":"385","author":"Lu","year":"2016","journal-title":"J. Sound Vib."},{"key":"ref_39","first-page":"448","article-title":"Batch normalization: Accelerating deep network training by reducing internal covariate shift","volume":"Volume 1","author":"Ioffe","year":"2015","journal-title":"Proceedings of the 32nd International Conference on Machine Learning, ICML 2015"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Wang, Q., Yu, Y., Ahmed, H.O.A., Darwish, M., and Nandi, A.K. (2021). Open-Circuit Fault Detection and Classification of Modular Mul-tilevel Converters in High Voltage Direct Current Systems (MMC-HVDC) with Long Short-Term Memory (LSTM) Method. Sensors, 21.","DOI":"10.3390\/s21124159"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yang, J., Sun, Z., and Chen, Y. (2016). Fault detection using the clustering-knn rule for gas sensor arrays. Sensors, 16.","DOI":"10.3390\/s16122069"},{"key":"ref_42","first-page":"200196","article-title":"Application of metaheuristic optimization based support vector machine for milling cutter health monitoring","volume":"18","author":"Bajaj","year":"2023","journal-title":"Intell. Syst. Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/3130\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:55:23Z","timestamp":1760122523000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/3130"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,15]]},"references-count":42,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23063130"],"URL":"https:\/\/doi.org\/10.3390\/s23063130","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,15]]}}}