{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:27:31Z","timestamp":1770917251139,"version":"3.50.1"},"reference-count":37,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2021,8,11]]},"abstract":"<jats:p>With the innovation and development of detection technology, various types of sensors are installed to monitor the operating status of equipment in modern industry. Compared with the same type of sensors for monitoring, heterogeneous sensors can collect more comprehensive complementary fault information. Due to the large distribution differences and serious noise pollution of heterogeneous sensor data collected in industrial sites, this brings certain challenges to the development of heterogeneous data fusion strategies. In view of the large distribution difference in the feature spatial of heterogeneous data and the difficulty of effective fusion of fault information, this paper presents a multi-scale deep coupling convolutional neural network (MDCN), which is used to map the heterogeneous fault information from different feature spaces to the common spaces for full fusion. Specifically, a multi-scale convolution module (MSC) with multiple filters of different sizes is adopted to extract multi-scale fault features of heterogeneous sensor data. Then, the maximum mean discrepancy (MMD) is applied to measure the distance between different spatial features in the coupling layer, and the common failure information in the heterogeneous data is mined by minimizing MMD to fuse effectively in order to identify the failure state of the device. The validity of this method is verified by the data collected on a first-level parallel gearbox mixed fault experiment platform.<\/jats:p>","DOI":"10.3233\/jifs-210932","type":"journal-article","created":{"date-parts":[[2021,7,16]],"date-time":"2021-07-16T10:19:02Z","timestamp":1626430742000},"page":"2225-2238","source":"Crossref","is-referenced-by-count":8,"title":["Multi-scale deep coupling convolutional neural network with heterogeneous sensor data for intelligent fault diagnosis"],"prefix":"10.1177","volume":"41","author":[{"given":"Jinghui","family":"Tian","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Yanshan University, Qinhuangdao, Hebei, P. R. China"}]},{"given":"Dongying","family":"Han","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Yanshan University, Qinhuangdao, Hebei, P. R. China"},{"name":"School of Vehicles and Energy, Yanshan University, Qinhuangdao, Hebei, P. R. China"}]},{"given":"Lifeng","family":"Xiao","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, Yanshan University, Qinhuangdao, Hebei, P. R. China"}]},{"given":"Peiming","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, Yanshan University, Qinhuangdao, Hebei, P. R. China"}]}],"member":"179","reference":[{"issue":"5","key":"10.3233\/JIFS-210932_ref1","doi-asserted-by":"crossref","first-page":"3137","DOI":"10.1109\/TIE.2016.2519325","article-title":"An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data","volume":"63","author":"Lei","year":"2016","journal-title":"IEEE Trans Ind Electron"},{"key":"10.3233\/JIFS-210932_ref2","doi-asserted-by":"crossref","first-page":"47374","DOI":"10.1109\/ACCESS.2018.2866403","article-title":"Data-driven monitoring and safety control of industrial cyber-physical systems: Basics and beyond","volume":"6","author":"Jiang","year":"2018","journal-title":"IEEE Access"},{"key":"10.3233\/JIFS-210932_ref3","doi-asserted-by":"crossref","first-page":"59","DOI":"10.3901\/JME.2011.19.059","article-title":"Research advances of fault diagnosis technique for planetary gearboxes","volume":"47","author":"Lei","year":"2011","journal-title":"Jixie Gongcheng Xuebao (Chin. J. Mech. Eng.)"},{"key":"10.3233\/JIFS-210932_ref4","first-page":"1","article-title":"A novel rotating machinery fault diagnosis method based on adaptive deep belief network structure and dynamic learning rate under variable working conditions","volume":"99","author":"Shi","year":"2021","journal-title":"IEEE Access"},{"key":"10.3233\/JIFS-210932_ref5","first-page":"314","article-title":"Prognostics and health management design for rotary machinery systems-Reviews, methodology and applications","volume":"44","author":"Wu","year":"2014","journal-title":"Mech Syst Signal Process"},{"key":"10.3233\/JIFS-210932_ref6","doi-asserted-by":"crossref","first-page":"1445","DOI":"10.1007\/s12206-020-0306-1","article-title":"A sparse auto-encoder method based on compressed sensing and wavelet packet energy entropy for rolling bearing intelligent fault diagnosis","volume":"34","author":"Shi","year":"2020","journal-title":"Journal of Mechanical Science and Technology"},{"key":"10.3233\/JIFS-210932_ref7","doi-asserted-by":"crossref","first-page":"107660","DOI":"10.1016\/j.measurement.2020.107660","article-title":"Optimal IMF selection and unknown fault feature extraction for rolling bearings with different defect modes","volume":"157","author":"Yang","year":"2020","journal-title":"Measurement"},{"key":"10.3233\/JIFS-210932_ref8","first-page":"1","article-title":"A Review on Soft Sensors for Monitoring, Control and Optimization of Industrial Processes","volume":"2020","author":"Jiang","journal-title":"IEEE Sensors Journal"},{"issue":"4","key":"10.3233\/JIFS-210932_ref9","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MIE.2019.2938025","article-title":"Real-Time Monitoring and Control of Industrial Cyberphysical Systems: With Integrated Plant-Wide Monitoring and Control Framework","volume":"13","author":"Yin","year":"2019","journal-title":"IEEE Industrial Electronics Magazine"},{"issue":"1","key":"10.3233\/JIFS-210932_ref10","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1080\/08982112.2014.846119","article-title":"Reliability meets big data: Opportunities and challenges","volume":"26","author":"Meeker","year":"2014","journal-title":"Qual Eng"},{"issue":"4","key":"10.3233\/JIFS-210932_ref11","doi-asserted-by":"crossref","first-page":"2233","DOI":"10.1109\/TII.2014.2300753","article-title":"Internet of things in industries: A survey","volume":"10","author":"Xu","year":"2014","journal-title":"IEEE Trans Ind Informat"},{"key":"10.3233\/JIFS-210932_ref12","doi-asserted-by":"crossref","first-page":"1483","DOI":"10.1016\/j.ymssp.2005.09.012","article-title":"A review on machinery diagnostics and prognostics implementing condition-based maintenance","volume":"20","author":"Jardine","year":"2006","journal-title":"Mech Syst Sig Process"},{"issue":"3","key":"10.3233\/JIFS-210932_ref13","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/TASE.2013.2250282","article-title":"A data-level fusion model for developing composite health indices for degradation modeling and prognostic analysis","volume":"10","author":"Liu","year":"2013","journal-title":"IEEE Trans Autom Sci Eng"},{"issue":"1","key":"10.3233\/JIFS-210932_ref14","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1109\/TPAMI.2014.2343973","article-title":"Data fusion by matrix factorization","volume":"37","author":"Zitnik","year":"2015","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10.3233\/JIFS-210932_ref16","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1177\/1461348419849279","article-title":"Intelligent fault diagnosis of rotating machinery based on deep learning with feature selection","volume":"39","author":"Han","year":"2020","journal-title":"Journal of Low Frequency Noise, Vibration and Active Control"},{"key":"10.3233\/JIFS-210932_ref18","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.ins.2012.06.016","article-title":"Multi-sensor data fusion using support vector machine for motor fault detection","volume":"217","author":"Banerjee","year":"2012","journal-title":"Inf Sci"},{"issue":"1\u20132","key":"10.3233\/JIFS-210932_ref19","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1016\/j.ymssp.2013.08.032","article-title":"Full-life dynamic identification of wear state based on on-line wear debris image features","volume":"42","author":"Wu","year":"2014","journal-title":"Mech Syst Sig Process"},{"issue":"2","key":"10.3233\/JIFS-210932_ref20","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1109\/JSYST.2014.2307632","article-title":"Simultaneous sensor and process fault detection and isolation in multiple-input-multiple-output systems","volume":"9","author":"Krishnamoorthy","year":"2017","journal-title":"IEEE Syst J"},{"key":"10.3233\/JIFS-210932_ref21","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.measurement.2014.08.017","article-title":"An improved data fusion technique for faults diagnosis in rotating machines","volume":"58","author":"Yunusa-Kaltungo","year":"2014","journal-title":"Measurement"},{"key":"10.3233\/JIFS-210932_ref22","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.ymssp.2015.10.025","article-title":"Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data","volume":"72\/73","author":"Jia","year":"2016","journal-title":"Mech Syst Signal Process"},{"key":"10.3233\/JIFS-210932_ref23","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1016\/j.ymssp.2017.08.002","article-title":"Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing","volume":"100","author":"Shao","year":"2018","journal-title":"Mech Syst Signal Process"},{"key":"10.3233\/JIFS-210932_ref24","doi-asserted-by":"crossref","first-page":"131299","DOI":"10.1109\/ACCESS.2020.3008208","article-title":"An Intelligent Fault Diagnosis Method of Variable Condition Gearbox Based on Improved DBN Combined With WPEE and MPE","volume":"8","author":"Han","year":"2020","journal-title":"IEEE Access"},{"key":"10.3233\/JIFS-210932_ref25","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/s12206-019-0101-z","article-title":"Gear fault feature extraction and diagnosis method under different load excitation based on EMD, PSO-SVM and fractal box dimension","volume":"33","author":"Han","year":"2019","journal-title":"Journal of Mechanical Science and Technology"},{"issue":"1","key":"10.3233\/JIFS-210932_ref26","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s40747-015-0004-2","article-title":"Fault detection and classification byunsupervised feature extraction and dimensionality reduction","volume":"1","author":"Chopra","year":"2015","journal-title":"Complex Intell Syst"},{"key":"10.3233\/JIFS-210932_ref27","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.measurement.2019.04.093","article-title":"A deep convolutional neural network based fusion method of twodirection vibration signal data for health state identification of planetary gearboxes","volume":"146","author":"Chen","year":"2019","journal-title":"Measurement"},{"key":"10.3233\/JIFS-210932_ref28","doi-asserted-by":"crossref","unstructured":"Zhang L. and Gao H. , A deep learning-based multi-sensor data fusion method for degradation monitoring of ball screws, in: 2016 Prognostics and System Health Management Conference. IEEE (2016), 2166\u20135656.","DOI":"10.1109\/PHM.2016.7819792"},{"issue":"7","key":"10.3233\/JIFS-210932_ref29","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1109\/TIM.2017.2669947","article-title":"Multisensor feature fusion for bearing fault diagnosis using sparse autoencoder and deep belief network","volume":"66","author":"Chen","year":"2017","journal-title":"IEEE Trans Instrum Meas"},{"key":"10.3233\/JIFS-210932_ref30","doi-asserted-by":"crossref","unstructured":"Jiao J. , Zhao M. , Lin J. and Ding C. , Deep Coupled Dense Convolutional Network With Complementary Data for Intelligent Fault Diagnosis, IEEE Transactions on Industrial Electronics 66(12) (2019).","DOI":"10.1109\/TIE.2019.2902817"},{"key":"10.3233\/JIFS-210932_ref31","unstructured":"Sermanet P. , Chintala S. and LeCun Y. , Convolutional neural networks applied to house numbers digit classification, in Proc. 21st Int. Conf. Pattern Recognit. (2012), 3288\u20133291."},{"key":"10.3233\/JIFS-210932_ref32","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","article-title":"Recent advances in convolutional neural networks","volume":"77","author":"Gu","year":"2018","journal-title":"Pattern Recognit"},{"issue":"4","key":"10.3233\/JIFS-210932_ref33","doi-asserted-by":"crossref","first-page":"e0118309","DOI":"10.1371\/journal.pone.0118309","article-title":"Multi-scale compositionality: Identifying the compositional structures of social dynamics using deep learning","volume":"10","author":"Peng","year":"2015","journal-title":"Plos One"},{"key":"10.3233\/JIFS-210932_ref34","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","article-title":"Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups","volume":"29","author":"Hinton","year":"2012","journal-title":"IEEE Signal Process Mag"},{"key":"10.3233\/JIFS-210932_ref35","doi-asserted-by":"crossref","unstructured":"He K. , Zhang X. and Ren S. , Delving deep into rectifiers: surpassing humanlevel performance on ImageNet classification, in: 2015 IEEE International Conference on Computer Vision of the Proceeding (2015).","DOI":"10.1109\/ICCV.2015.123"},{"issue":"5","key":"10.3233\/JIFS-210932_ref36","first-page":"3137","article-title":"Deep Coupling Autoencoder for fault diagnosis with multimodal sensory data","volume":"63","author":"Ma","year":"2016","journal-title":"IEEE Trans Ind Infor"},{"key":"10.3233\/JIFS-210932_ref37","first-page":"723","article-title":"A kernel two-sample test","volume":"13","author":"Gretton","year":"2012","journal-title":"J Mach Learn Res"},{"issue":"12","key":"10.3233\/JIFS-210932_ref38","doi-asserted-by":"crossref","first-page":"425","DOI":"10.3390\/s17020425","article-title":"A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals","volume":"17","author":"Zhang","year":"2017","journal-title":"Sensors"},{"key":"10.3233\/JIFS-210932_ref39","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Laurens","year":"2008","journal-title":"J Mach Learn Res"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-210932","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T01:27:43Z","timestamp":1769995663000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-210932"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,11]]},"references-count":37,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/jifs-210932","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,11]]}}}