{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T19:45:27Z","timestamp":1779911127472,"version":"3.53.1"},"reference-count":53,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2019,10,23]],"date-time":"2019-10-23T00:00:00Z","timestamp":1571788800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002462","name":"Chungnam National University","doi-asserted-by":"publisher","award":["2019-0691-01"],"award-info":[{"award-number":["2019-0691-01"]}],"id":[{"id":"10.13039\/501100002462","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Fault detection and diagnosis is one of the most critical components of preventing accidents and ensuring the system safety of industrial processes. In this paper, we propose an integrated learning approach for jointly achieving fault detection and fault diagnosis of rare events in multivariate time series data. The proposed approach combines an autoencoder to detect a rare fault event and a long short-term memory (LSTM) network to classify different types of faults. The autoencoder is trained with offline normal data, which is then used as the anomaly detection. The predicted faulty data, captured by autoencoder, are put into the LSTM network to identify the types of faults. It basically combines the strong low-dimensional nonlinear representations of the autoencoder for the rare event detection and the strong time series learning ability of LSTM for the fault diagnosis. The proposed approach is compared with a deep convolutional neural network approach for fault detection and identification on the Tennessee Eastman process. Experimental results show that the combined approach accurately detects deviations from normal behaviour and identifies the types of faults within the useful time.<\/jats:p>","DOI":"10.3390\/s19214612","type":"journal-article","created":{"date-parts":[[2019,10,25]],"date-time":"2019-10-25T03:20:36Z","timestamp":1571973636000},"page":"4612","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":169,"title":["Fault Detection and Diagnosis Using Combined Autoencoder and Long Short-Term Memory Network"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3744-4476","authenticated-orcid":false,"given":"Pangun","family":"Park","sequence":"first","affiliation":[{"name":"Department of Radio and Information Communications Engineering, Chungnam National University, Daejeon 34134, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Piergiuseppe Di","family":"Marco","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, Computer Science and Mathematics, University of L\u2019Aquila, 67100 L\u2019Aquila, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyejeon","family":"Shin","sequence":"additional","affiliation":[{"name":"Dental Clinic Center, Kyungpook National University, Daegu 41940, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junseong","family":"Bang","sequence":"additional","affiliation":[{"name":"Defense &amp; Safety ICT Research Department, Electronics and Telecommunications Research Institute, Daejeon 34129, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3757","DOI":"10.1109\/TIE.2015.2417501","article-title":"A Survey of Fault Diagnosis and Fault-Tolerant Techniques\u2014Part I: Fault Diagnosis With Model-Based and Signal-Based Approaches","volume":"62","author":"Gao","year":"2015","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3146389","article-title":"On Fault Detection and Diagnosis in Robotic Systems","volume":"51","author":"Khalastchi","year":"2018","journal-title":"ACM Comput. Surv."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1109\/MIS.2018.043741325","article-title":"From Raw Data to Smart Manufacturing: AI and Semantic Web of Things for Industry 4.0","volume":"33","author":"Patel","year":"2018","journal-title":"IEEE Intell. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1109\/COMST.2017.2780114","article-title":"Wireless network design for control systems: A survey","volume":"20","author":"Park","year":"2018","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2226","DOI":"10.1109\/TII.2013.2243743","article-title":"From Model, Signal to Knowledge: A Data-Driven Perspective of Fault Detection and Diagnosis","volume":"9","author":"Dai","year":"2013","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"122644","DOI":"10.1109\/ACCESS.2019.2938227","article-title":"Challenges and Opportunities of Deep Learning Models for Machinery Fault Detection and Diagnosis: A Review","volume":"7","author":"Saufi","year":"2019","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"20590","DOI":"10.1109\/ACCESS.2017.2756872","article-title":"Data Mining and Analytics in the Process Industry: The Role of Machine Learning","volume":"5","author":"Ge","year":"2017","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4098","DOI":"10.1109\/JIOT.2018.2875594","article-title":"IoT Platforms for the Internet of Production","volume":"6","author":"Hoffmann","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3250","DOI":"10.1109\/TIE.2016.2631530","article-title":"Cross-Layer Optimization for Industrial Control Applications Using Wireless Sensor and Actuator Mesh Networks","volume":"64","author":"Park","year":"2017","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_10","unstructured":"Ranjan, C., Reddy, M., Mustonen, M., Paynabar, K., and Pourak, K. (2019). Dataset: Rare Event Classification in Multivariate Time Series, ProcessMiner Inc.. Tech. Rep."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3768","DOI":"10.1109\/TIE.2015.2417501","article-title":"A Survey of Fault Diagnosis and Fault-Tolerant Techniques\u2014Part II: Fault Diagnosis With Knowledge-Based and Hybrid\/Active Approaches","volume":"62","author":"Gao","year":"2015","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","article-title":"Representation learning: A review and new perspectives","volume":"35","author":"Bengio","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1016\/j.jprocont.2012.06.009","article-title":"A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process","volume":"22","author":"Yin","year":"2012","journal-title":"J. Process Control"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.chemolab.2013.07.001","article-title":"Modified kernel principal component analysis based on local structure analysis and its application to nonlinear process fault diagnosis","volume":"127","author":"Deng","year":"2013","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1016\/j.neucom.2015.10.018","article-title":"An improved SVM integrated GS-PCA fault diagnosis approach of Tennessee Eastman process","volume":"174","author":"Gao","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.chemolab.2015.05.013","article-title":"Designing supervised local neural network classifiers based on EM clustering for fault diagnosis of Tennessee Eastman process","volume":"146","author":"Rad","year":"2015","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1651","DOI":"10.1109\/TIE.2014.2345331","article-title":"Improved PLS focused on key- performance-indicator-related fault diagnosis","volume":"62","author":"Yin","year":"2015","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1016\/S0893-6080(00)00026-5","article-title":"Independent component analysis: Algorithms and applications","volume":"13","author":"Hyvarinen","year":"2000","journal-title":"Neural Netw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1016\/j.ins.2013.06.021","article-title":"Fault detection and diagnosis of non-linear non-Gaussian dynamic processes using kernel dynamic independent component analysis","volume":"259","author":"Fan","year":"2014","journal-title":"Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/j.jprocont.2003.09.004","article-title":"Statistical process monitoring with independent component analysis","volume":"14","author":"Lee","year":"2004","journal-title":"J. Process Control"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1162\/089976698300017467","article-title":"Nonlinear component analysis as a kernel eigenvalue problem","volume":"10","author":"Scholkopf","year":"1998","journal-title":"Neural Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1002\/cjce.5450850414","article-title":"Fault detection of non-linear processes using kernel independent component analysis","volume":"85","author":"Lee","year":"2007","journal-title":"Can. J. Chem. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1389","DOI":"10.1016\/j.compchemeng.2003.10.002","article-title":"Fault diagnosis based on Fisher discriminant analysis and support vector machines","volume":"28","author":"Chiang","year":"2004","journal-title":"Comput. Chem. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"8682","DOI":"10.1109\/ACCESS.2017.2705644","article-title":"Sensor fault classification based on support vector machine and statistical time-domain features","volume":"5","author":"Jan","year":"2017","journal-title":"IEEE Access"},{"key":"ref_25","first-page":"577","article-title":"Fault detection of batch process using dynamic multi-way orthogonal locality preserving projections","volume":"11","author":"Guo","year":"2015","journal-title":"J. Comput. Inf. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1407","DOI":"10.1016\/j.asoc.2010.04.012","article-title":"Designing a hierarchical neural network based on fuzzy clustering for fault diagnosis of the Tennessee Eastman process","volume":"11","author":"Eslamloueyan","year":"2011","journal-title":"Appl. Soft Comput."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.chemolab.2012.10.005","article-title":"Fault diagnosis of Tennessee Eastman process with multi-scale PCA and ANFIS","volume":"120","author":"Lau","year":"2013","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000006","article-title":"Learning deep architectures for AI","volume":"2","author":"Bengio","year":"2009","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Xie, D., and Bai, L. (2015, January 9\u201311). A hierarchical deep neural network for fault diagnosis on Tennessee-Eastman process. Proceedings of the IEEE 14th International Conference on Machine Learning and Applications (ICMLA), Miami, FL, USA.","DOI":"10.1109\/ICMLA.2015.208"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1016\/S0893-6080(05)80125-X","article-title":"Approximation of dynamical systems by continuous time recurrent neural networks","volume":"6","author":"Funahashi","year":"1993","journal-title":"Neural Netw."},{"key":"ref_32","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2222","DOI":"10.1109\/TNNLS.2016.2582924","article-title":"LSTM: A search space odyssey","volume":"28","author":"Greff","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yuan, M., Wu, Y., and Lin, L. (2016, January 10\u201312). Fault diagnosis and remaining useful life estimation of aero engine using LSTM neural network. Proceedings of the IEEE International Conference on Aircraft Utility Systems (AUS), Beijing, China.","DOI":"10.1109\/AUS.2016.7748035"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1109\/TNNLS.2016.2551940","article-title":"Railway track circuit fault diagnosis using recurrent neural networks","volume":"28","author":"Verbert","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_36","unstructured":"Le, Q.V., Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G.S., Dean, J., and Ng, A.Y. (July, January 26). Building high-level features using large scale unsupervised learning. Proceedings of the International Conference on International Conference on Machine Learning, Edinburgh, Scotland, UK."},{"key":"ref_37","unstructured":"Rifai, S., Vincent, P., Muller, X., Glorot, X., and Bengio, Y. (July, January 28). Contractive auto-encoders: Explicit invariance during feature extraction. Proceedings of the International Conference on International Conference on Machine Learning, Washington, DC, USA."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"12929","DOI":"10.1109\/ACCESS.2018.2794765","article-title":"Sequential fault diagnosis based on LSTM neural network","volume":"6","author":"Zhao","year":"2018","journal-title":"IEEE Access"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"7675","DOI":"10.1109\/ACCESS.2017.2785763","article-title":"Data-based line trip fault prediction in power systems using LSTM networks and SVM","volume":"6","author":"Zhang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_40","first-page":"3371","article-title":"Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion","volume":"11","author":"Vincent","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_42","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1109\/TPAMI.2005.127","article-title":"Sparse multinomial logistic regression: Fast algorithms and generalization bounds","volume":"27","author":"Krishnapuram","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bengio, Y. (2012). Practical Recommendations for Gradient-Based Training of Deep Architectures, Springer.","DOI":"10.1007\/978-3-642-35289-8_26"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/0098-1354(93)80018-I","article-title":"A plant-wide industrial process control problem","volume":"17","author":"Downs","year":"1993","journal-title":"Comput. Chem. Eng."},{"key":"ref_46","unstructured":"Lawrence Ricker, N. (2019, October 20). Tennessee Eastman Challenge Archive. University of Washington. Available online: https:\/\/depts.washington.edu\/control\/LARRY\/TE\/download.html."},{"key":"ref_47","unstructured":"Rieth, C.A., Amsel, B.D., Tran, R., and Cook, M.B. (2019, October 20). Additional Tennessee Eastman Process Simulation Data for Anomaly Detection Evaluation. Harvard Dataverse. Available online: https:\/\/dataverse.harvard.edu\/dataset.xhtml?persistentId=doi:10.7910\/DVN\/6C3JR1."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Park, B., Nah, J., Choi, J.Y., Yoon, I.J., and Park, P. (2018). Transmission Scheduling Schemes of Industrial Wireless Sensors for Heterogeneous Multiple Control Systems. Sensors, 18.","DOI":"10.3390\/s18124284"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Park, B., Nah, J., Choi, J.Y., Yoon, I.J., and Park, P. (2019). Robust Wireless Sensor and Actuator Networks for Networked Control Systems. Sensors, 19.","DOI":"10.3390\/s19071535"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1016\/j.compchemeng.2017.02.041","article-title":"A deep belief network based fault diagnosis model for complex chemical processes","volume":"107","author":"Zhang","year":"2017","journal-title":"Comput. Chem. Eng."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Russell, E.L., Chiang, L.H., and Braatz, R.D. (2000). Data-Driven Methods for Fault Detection and Diagnosis in Chemical Processes, Springer.","DOI":"10.1007\/978-1-4471-0409-4"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.compchemeng.2018.04.009","article-title":"Deep convolutional neural network model based chemical process fault diagnosis","volume":"115","author":"Wu","year":"2018","journal-title":"Comput. Chem. Eng."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/S0169-7439(00)00058-7","article-title":"Fault detection in industrial processes using canonical variate analysis and dynamic principal component analysis","volume":"51","author":"Russell","year":"2000","journal-title":"Chemom. Intell. Lab. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4612\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:28:45Z","timestamp":1760189325000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4612"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,23]]},"references-count":53,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["s19214612"],"URL":"https:\/\/doi.org\/10.3390\/s19214612","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,23]]}}}