{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T00:07:28Z","timestamp":1771459648683,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2018,4,5]],"date-time":"2018-04-05T00:00:00Z","timestamp":1522886400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Predictive maintenance plays an important role in modern Cyber-Physical Systems (CPSs) and data-driven methods have been a worthwhile direction for Prognostics Health Management (PHM). However, two main challenges have significant influences on the traditional fault diagnostic models: one is that extracting hand-crafted features from multi-dimensional sensors with internal dependencies depends too much on expertise knowledge; the other is that imbalance pervasively exists among faulty and normal samples. As deep learning models have proved to be good methods for automatic feature extraction, the objective of this paper is to study an optimized deep learning model for imbalanced fault diagnosis for CPSs. Thus, this paper proposes a weighted Long Recurrent Convolutional LSTM model with sampling policy (wLRCL-D) to deal with these challenges. The model consists of 2-layer CNNs, 2-layer inner LSTMs and 2-Layer outer LSTMs, with under-sampling policy and weighted cost-sensitive loss function. Experiments are conducted on PHM 2015 challenge datasets, and the results show that wLRCL-D outperforms other baseline methods.<\/jats:p>","DOI":"10.3390\/s18041096","type":"journal-article","created":{"date-parts":[[2018,4,5]],"date-time":"2018-04-05T16:50:58Z","timestamp":1522947058000},"page":"1096","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":72,"title":["A Weighted Deep Representation Learning Model for Imbalanced Fault Diagnosis in Cyber-Physical Systems"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9617-7094","authenticated-orcid":false,"given":"Zhenyu","family":"Wu","sequence":"first","affiliation":[{"name":"Engineering Research Center of Information Network, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"}]},{"given":"Yang","family":"Guo","sequence":"additional","affiliation":[{"name":"Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"}]},{"given":"Wenfang","family":"Lin","sequence":"additional","affiliation":[{"name":"Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"}]},{"given":"Shuyang","family":"Yu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"}]},{"given":"Yang","family":"Ji","sequence":"additional","affiliation":[{"name":"Engineering Research Center of Information Network, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"},{"name":"Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"}]}],"member":"1968","published-online":{"date-parts":[[2018,4,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.ress.2012.03.008","article-title":"Ensemble of data-driven prognostic algorithms for robust prediction of remaining useful life","volume":"103","author":"Hu","year":"2012","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1007730.1007733","article-title":"Editorial: Special issue on learning from imbalanced data sets","volume":"6","author":"Chawla","year":"2004","journal-title":"ACM SIGKDD Explor. Newslett."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wu, Y., Jiang, B., Lu, N.Y., and Zhou, Y. (2015). Bayesian network based fault prognosis via Bond graph modeling of high-speed railway traction device. Math. Probl. Eng.","DOI":"10.1155\/2015\/321872"},{"key":"ref_4","unstructured":"Korbicz, J., Koscielny, J.M., Kowalczuk, Z., and Cholewa, W. (2012). Fault Diagnosis: Models, Artificial Intelligence, Applications, Springer Science and Business Media."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1016\/j.jprocont.2012.06.009","article-title":"A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark tennessee eastman process","volume":"22","author":"Yin","year":"2012","journal-title":"J. Process Control"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, L., and Yu, J. (2005). Fault feature selection based on modified binary pso with mutation and its application in chemical process fault diagnosis. Advances in Natural Computation, Springer.","DOI":"10.1007\/11539902_102"},{"key":"ref_7","first-page":"727359","article-title":"Fault detection of aircraft system with random forest algorithm and similarity measure","volume":"2014","author":"Lee","year":"2014","journal-title":"Sci. World J."},{"key":"ref_8","unstructured":"LeCun, Y., and Bengio, Y. (1998). Chapter Convolutional Networks for Images, Speech, and Time Series. The Handbook of Brain Theory and Neural Networks, MIT Press."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lee, H., Grosse, R., Ranganath, R., and Ng, A.Y. (2009, January 14\u201318). Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations. Proceedings of the 26th Annual International Conference on Machine Learning (ICML), Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553453"},{"key":"ref_10","first-page":"30","article-title":"Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition","volume":"20","author":"Dahl","year":"2012","journal-title":"IEEE TASLP"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Abdel-Hamid, O., Mohamed, A., Jiang, H., and Penn, G. (2012, January 25\u201330). Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition [C]\/\/Acoustics. Proceedings of the 2012 IEEE International Conference on Speech and Signal Processing (ICASSP), Kyoto, Japan.","DOI":"10.1109\/ICASSP.2012.6288864"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Graves, A., Mohamed, A.R., and Hinton, G. (2013, January 26\u201331). Speech recognition with deep recurrent neural networks. Proceedings of the 38th International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, USA.","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"ref_13","unstructured":"Malhotra, P., Vig, L., Shroff, G., and Agarwal, P. (2015, January 22\u201324). Long short term memory networks for anomaly detection in time series. Proceedings of the 23rd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sainath, T., Vinyals, O., Senior, A., and Sak, H. (2015, January 19\u201324). Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks. Proceedings of the 40th International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia.","DOI":"10.1109\/ICASSP.2015.7178838"},{"key":"ref_15","unstructured":"Drummond, C., and Holte, R.C. (2003, January 21). C4.5, class imbalance, and cost sensitivity: Why under-sampling beats over-sampling. Proceedings of the Working Notes ICML Workshop Learning Imbalanced Data Sets, Washington, DC, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1145\/1007730.1007734","article-title":"Mining with rarity: A unifying framework","volume":"6","author":"Weiss","year":"2004","journal-title":"ACM SIGKDD Explor. Newslett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/TKDE.2006.17","article-title":"Training cost-sensitive neural networks with methods addressing the class imbalance problem","volume":"18","author":"Zhou","year":"2006","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Demidova, L., and Klyueva, I. (2017, January 11\u201315). SVM classification: Optimization with the SMOTE algorithm for the class imbalance problem. Proceedings of the 2017 6th Mediterranean Conference on Embedded Computing (MECO), Bar, Montenegro.","DOI":"10.1109\/MECO.2017.7977136"},{"key":"ref_19","unstructured":"Chan, P.K., and Stolfo, S.J. (1998, January 27\u201331). Toward scalable learning with non-uniform class and cost distributions: A case study in credit card fraud detection. Proceedings of the 4th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1109\/TSMCB.2008.2007853","article-title":"Exploratory Undersampling for Class-Imbalance Learning","volume":"39","author":"Liu","year":"2009","journal-title":"IEEE Syst. Man Cybern. Soc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1263","DOI":"10.1109\/TKDE.2008.239","article-title":"Learning from imbalanced data","volume":"21","author":"He","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pigou, L., Oord, A.V.D., Dieleman, S., van Herreweghe, M., and Dambre, J. (arXiv, 2015). Beyond Temporal Pooling: Recurrence and Temporal Convolutions for Gesture Recognition in Video, arXiv.","DOI":"10.1007\/s11263-016-0957-7"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zeng, M., Nguyen, L.T., Yu, B., Mengshoel, O.J., Zhu, J., Wu, P., and Zhang, J. (2014, January 6\u20137). Convolutional Neural Networks for human activity recognition using mobile sensors. Proceedings of the 6th IEEE International Conference on Mobile Computing, Applications and Services (MobiCASE), Austin, TX, USA.","DOI":"10.4108\/icst.mobicase.2014.257786"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ordonez, F.J., and Roggen, D. (2016). Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition. Sensors, 16.","DOI":"10.3390\/s16010115"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1109\/TSMCC.2011.2161285","article-title":"A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches","volume":"42","author":"Galar","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_27","unstructured":"Japkowicz, N. (, January June). The class imbalance problem: Significance and strategies. Proceedings of the 2000 International Conference on Artificial Intelligence, Halifax, NS, Canada."},{"key":"ref_28","unstructured":"Mani, I., and Zhang, I. (2003, January 21). KNN approach to unbalanced data distributions: A case study involving information extraction. Proceedings of the ICML 2003 Workshop on Learning from Imbalanced Datasets II, Washington, DC, USA."},{"key":"ref_29","first-page":"878","article-title":"Borderline-smote: A new over-sampling method in imbalanced data sets learning","volume":"3644","author":"Han","year":"2005","journal-title":"Adv. Intell. Comput."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1016\/j.patcog.2006.01.009","article-title":"The effect of imbalanced data sets on lda: A theoretical and empirical analysis","volume":"40","author":"Xie","year":"2007","journal-title":"Pattern Recognit."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1111\/j.0824-7935.2004.t01-1-00228.x","article-title":"A multiple resampling method for learning from imbalanced data sets","volume":"20","author":"Estabrooks","year":"2004","journal-title":"Comput. Intell."},{"key":"ref_32","first-page":"806","article-title":"The imbalanced training sample problem: under or over sampling. Struct. Syntactic Stat","volume":"3138","author":"Barandela","year":"2004","journal-title":"Pattern Recognit."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.1109\/TSMCA.2009.2027131","article-title":"Improving software-quality predictions with data sampling and boosting","volume":"39","author":"Seiffert","year":"2009","journal-title":"IEEE Trans. Syst. Man Cybern. Syst. Hum."},{"key":"ref_34","first-page":"107","article-title":"Smoteboost: Improving prediction of the minority class in boosting","volume":"2838","author":"Chawla","year":"2003","journal-title":"Know. Discov. Databases PKDD"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/TSMCA.2009.2029559","article-title":"Rusboost: A hybrid approach to alleviating class imbalance","volume":"40","author":"Seiffert","year":"2010","journal-title":"IEEE Trans. Syst. Man Cybern. A Syst. Hum."},{"key":"ref_36","unstructured":"Schapire, R.E. (August, January 31). A brief introduction to boosting. Proceedings of the 16th international joint conference on Artificial intelligence, Stockholm, Sweden."},{"key":"ref_37","unstructured":"Kukar, M., and Kononenko, I. (2013, January 24\u201326). Cost-sensitive learning with neural networks. Proceedings of the 13th European Conference on Artificial Intelligence, Bruges, Belgium."},{"key":"ref_38","unstructured":"Chung, Y.-A., Lin, H.-T., and Yang, S.-W. (2015, November 27). Cost-Aware Pre-Training for Multiclass Cost-Sensitive Deep Learning. Available online: https:\/\/arxiv.org\/abs\/1511.09337."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, S., Liu, W., Wu, J., Cao, L., Meng, Q., and Kennedy, P.J. (2016, January 24\u201329). Training deep neural networks on imbalanced data sets. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.","DOI":"10.1109\/IJCNN.2016.7727770"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Raj, V., Magg, S., and Wermter, S. (2016). Towards effective classification of imbalanced data with convolutional neural networks. IAPR Workshop on Artificial Neural Networks in Pattern Recognition (IAPR), Springer International Publishing.","DOI":"10.1007\/978-3-319-46182-3_13"},{"key":"ref_41","unstructured":"Rosca, J. (2017, October 10). PHM15 Challenge Competition and Data Set: Fault Prognostics, Available online: http:\/\/ti.arc.nasa.gov\/project\/prognostic-data-repository."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/4\/1096\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:59:41Z","timestamp":1760194781000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/4\/1096"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,5]]},"references-count":41,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,4]]}},"alternative-id":["s18041096"],"URL":"https:\/\/doi.org\/10.3390\/s18041096","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,5]]}}}