{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T18:30:49Z","timestamp":1783449049305,"version":"3.55.0"},"reference-count":98,"publisher":"Springer Science and Business Media LLC","issue":"17","license":[{"start":{"date-parts":[[2024,12,11]],"date-time":"2024-12-11T00:00:00Z","timestamp":1733875200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,11]],"date-time":"2024-12-11T00:00:00Z","timestamp":1733875200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Machine learning approaches play a crucial role in nonlinear system modeling across diverse domains, finding applications in system monitoring, anomaly\/fault detection, control, and various other areas. With technological advancements, today such systems might include hundreds or thousands of sensors that generate large amounts of multivariate data streams. This inevitably results in increased model complexity. In response, feature selection techniques are widely employed as a means to reduce complexity, avoid the curse of high dimensionality, decrease training and inference times, and eliminate redundant features. This paper introduces a sensitivity-inspired feature analysis technique for regression tasks. Leveraging the energy distance on the model prediction errors, this approach performs both feature ranking and selection. Additionally, this paper introduces an ensemble-based unsupervised fault detection methodology that incorporates homogeneous units, specifically long short-term memory (LSTM) predictors and cumulative sum-based detectors. The proposed predictors utilize a variant of the teacher forcing (TF) algorithm during both the training and inference phases. Additionally, predictors are used to model the normal behavior of the system, whereas detectors are used to identify deviations from normality. The detector decisions are aggregated using a majority voting scheme. The validity of the proposed approach is illustrated on the two representative datasets, where numerous experiments are performed for feature selection and fault detection evaluation. Experimental assessment reveals promising results, even compared to well-established techniques. Nevertheless, the results also demonstrate the need to perform additional experiments with datasets originating from both simulators and real systems. Further possible refinements of the detection ensemble include the addition of heterogeneous units and other decision fusion techniques.<\/jats:p>","DOI":"10.1007\/s00521-024-10551-1","type":"journal-article","created":{"date-parts":[[2024,12,11]],"date-time":"2024-12-11T16:21:59Z","timestamp":1733934119000},"page":"10465-10489","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Feature analysis and ensemble-based fault detection techniques for nonlinear systems"],"prefix":"10.1007","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4825-8786","authenticated-orcid":false,"given":"Roland","family":"Bolboac\u0103","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5611-2429","authenticated-orcid":false,"given":"Piroska","family":"Haller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1390-479X","authenticated-orcid":false,"given":"Bela","family":"Genge","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,12,11]]},"reference":[{"issue":"1","key":"10551_CR1","doi-asserted-by":"crossref","first-page":"011001","DOI":"10.1115\/1.4054039","volume":"23","author":"Y Zhao","year":"2023","unstructured":"Zhao Y, Jiang C, Vega MA, Todd MD, Hu Z (2023) Surrogate modeling of nonlinear dynamic systems: a comparative study. J Comput Inf Sci Eng 23(1):011001","journal-title":"J Comput Inf Sci Eng"},{"key":"10551_CR2","doi-asserted-by":"crossref","first-page":"2321","DOI":"10.1007\/s00170-019-03306-z","volume":"102","author":"H Lahdhiri","year":"2019","unstructured":"Lahdhiri H, Said M, Abdellafou KB, Taouali O, Harkat MF (2019) Supervised process monitoring and fault diagnosis based on machine learning methods. Int J Adv Manuf Technol 102:2321\u20132337","journal-title":"Int J Adv Manuf Technol"},{"issue":"3","key":"10551_CR3","doi-asserted-by":"crossref","first-page":"1310","DOI":"10.3390\/s23031310","volume":"23","author":"B Kim","year":"2023","unstructured":"Kim B, Alawami MA, Kim E, Oh S, Park J, Kim H (2023) A comparative study of time series anomaly detection models for industrial control systems. Sensors 23(3):1310","journal-title":"Sensors"},{"key":"10551_CR4","doi-asserted-by":"crossref","first-page":"119660","DOI":"10.1016\/j.eswa.2023.119660","volume":"219","author":"A Yeganeh","year":"2023","unstructured":"Yeganeh A, Chukhrova N, Johannssen A, Fotuhi H (2023) A network surveillance approach using machine learning based control charts. Expert Syst Appl 219:119660","journal-title":"Expert Syst Appl"},{"key":"10551_CR5","doi-asserted-by":"crossref","first-page":"100123","DOI":"10.1016\/j.adapen.2023.100123","volume":"9","author":"Z Chen","year":"2023","unstructured":"Chen Z, Xiao F, Guo F, Yan J (2023) Interpretable machine learning for building energy management: a state-of-the-art review. Adv Appl Energy 9:100123","journal-title":"Adv Appl Energy"},{"key":"10551_CR6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/eds.2022.30","volume":"2","author":"A Chattopadhyay","year":"2023","unstructured":"Chattopadhyay A, Pathak J, Nabizadeh E, Bhimji W, Hassanzadeh P (2023) Long-term stability and generalization of observationally-constrained stochastic data-driven models for geophysical turbulence. Environ Data Sci 2:1","journal-title":"Environ Data Sci"},{"key":"10551_CR7","doi-asserted-by":"crossref","first-page":"181","DOI":"10.3934\/mmc.2023016","volume":"3","author":"V Stojanovi\u0107","year":"2023","unstructured":"Stojanovi\u0107 V (2023) Fault-tolerant control of a hydraulic servo actuator via adaptive dynamic programming. Math Model Control 3:181\u2013191","journal-title":"Math Model Control"},{"key":"10551_CR8","doi-asserted-by":"crossref","first-page":"112797","DOI":"10.1016\/j.measurement.2023.112797","volume":"214","author":"J Xin","year":"2023","unstructured":"Xin J, Zhou C, Jiang Y, Tang Q, Yang X, Zhou J (2023) A signal recovery method for bridge monitoring system using tvfemd and encoder-decoder aided lstm. Measurement 214:112797","journal-title":"Measurement"},{"key":"10551_CR9","doi-asserted-by":"crossref","first-page":"107549","DOI":"10.1016\/j.jobe.2023.107549","volume":"78","author":"H Zhang","year":"2023","unstructured":"Zhang H, Wang L, Shi W (2023) Seismic control of adaptive variable stiffness intelligent structures using fuzzy control strategy combined with lstm. J Build Eng 78:107549","journal-title":"J Build Eng"},{"key":"10551_CR10","doi-asserted-by":"crossref","first-page":"128669","DOI":"10.1016\/j.energy.2023.128669","volume":"283","author":"Y Cao","year":"2023","unstructured":"Cao Y, Liu G, Luo D, Bavirisetti DP, Xiao G (2023) Multi-timescale photovoltaic power forecasting using an improved stacking ensemble algorithm based lstm-informer model. Energy 283:128669","journal-title":"Energy"},{"key":"10551_CR11","first-page":"100320","volume":"9","author":"HN Bhandari","year":"2022","unstructured":"Bhandari HN, Rimal B, Pokhrel NR, Rimal R, Dahal KR, Khatri RK (2022) Predicting stock market index using lstm. Mach Learning Appl 9:100320","journal-title":"Mach Learning Appl"},{"key":"10551_CR12","unstructured":"Goodfellow I. Bengio Y, Courville A (2016) Deep Learning. MIT Press, Cambridge, Massachusetts . http:\/\/www.deeplearningbook.org"},{"key":"10551_CR13","doi-asserted-by":"crossref","first-page":"105733","DOI":"10.1016\/j.conengprac.2023.105733","volume":"141","author":"J Yang","year":"2023","unstructured":"Yang J, Wang J, Ye Q, Xiong Z, Zhang F, Liu H (2023) A novel fault detection framework integrated with variable importance analysis for quality-related nonlinear process monitoring. Control Eng Pract 141:105733","journal-title":"Control Eng Pract"},{"issue":"2","key":"10551_CR14","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.arcontrol.2009.09.001","volume":"33","author":"J Bokor","year":"2009","unstructured":"Bokor J, Szab\u00f3 Z (2009) Fault detection and isolation in nonlinear systems. Annu Rev Control 33(2):113\u2013123","journal-title":"Annu Rev Control"},{"key":"10551_CR15","volume-title":"Novel Computational and Analytic Techniques for Nonlinear Systems Applied to Structural and Celestial Mechanics","author":"TAA Elgohary","year":"2015","unstructured":"Elgohary TAA (2015) Novel Computational and Analytic Techniques for Nonlinear Systems Applied to Structural and Celestial Mechanics. Texas A &M University, Texas, United States"},{"key":"10551_CR16","doi-asserted-by":"publisher","DOI":"10.1063\/5.0119516","author":"C-D Cheng","year":"2022","unstructured":"Cheng C-D, Tian B, Ma Y-X, Zhou T-Y, Shen Y (2022) Pfaffian, breather, and hybrid solutions for a (2+ 1)-dimensional generalized nonlinear system in fluid mechanics and plasma physics. Phys Fluids. https:\/\/doi.org\/10.1063\/5.0119516","journal-title":"Phys Fluids"},{"issue":"5\u20136","key":"10551_CR17","first-page":"247","volume":"75","author":"JP Higgins","year":"2002","unstructured":"Higgins JP (2002) Nonlinear systems in medicine. Yale J Biol Med 75(5\u20136):247","journal-title":"Yale J Biol Med"},{"key":"10551_CR18","doi-asserted-by":"crossref","first-page":"8497093","DOI":"10.1155\/2019\/8497093","volume":"2019","author":"AF Villaverde","year":"2019","unstructured":"Villaverde AF et al (2019) Observability and structural identifiability of nonlinear biological systems. Complexity 2019:8497093","journal-title":"Complexity"},{"issue":"4","key":"10551_CR19","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1016\/0959-1524(95)00014-H","volume":"5","author":"RK Pearson","year":"1995","unstructured":"Pearson RK (1995) Nonlinear input\/output modelling. J Process Control 5(4):197\u2013211","journal-title":"J Process Control"},{"key":"10551_CR20","first-page":"687","volume-title":"Forecasting with recurrent neural networks: 12 tricks","author":"H-G Zimmermann","year":"2012","unstructured":"Zimmermann H-G, Tietz C, Grothmann R (2012) Forecasting with recurrent neural networks: 12 tricks. Tricks of the Trade, Neural Networks, pp 687\u2013707"},{"key":"10551_CR21","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.knosys.2017.10.009","volume":"139","author":"L Zhang","year":"2018","unstructured":"Zhang L, Lin J, Karim R (2018) Adaptive kernel density-based anomaly detection for nonlinear systems. Knowl-Based Syst 139:50\u201363","journal-title":"Knowl-Based Syst"},{"issue":"3\u20135","key":"10551_CR22","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/S0378-4754(02)00023-X","volume":"60","author":"M Lazar","year":"2002","unstructured":"Lazar M, Pastravanu O (2002) A neural predictive controller for non-linear systems. Math Comput Simul 60(3\u20135):315\u2013324","journal-title":"Math Comput Simul"},{"issue":"1","key":"10551_CR23","doi-asserted-by":"crossref","first-page":"24","DOI":"10.3390\/pr8010024","volume":"8","author":"KE Pilario","year":"2019","unstructured":"Pilario KE, Shafiee M, Cao Y, Lao L, Yang S-H (2019) A review of kernel methods for feature extraction in nonlinear process monitoring. Processes 8(1):24","journal-title":"Processes"},{"issue":"2","key":"10551_CR24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TAC.1959.1104847","volume":"4","author":"R Bellman","year":"1959","unstructured":"Bellman R, Kalaba R (1959) On adaptive control processes. IRE Trans Autom Control 4(2):1\u20139","journal-title":"IRE Trans Autom Control"},{"key":"10551_CR25","first-page":"1157","volume":"3","author":"I Guyon","year":"2003","unstructured":"Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learning Res 3:1157\u20131182","journal-title":"J Mach Learning Res"},{"key":"10551_CR26","doi-asserted-by":"crossref","unstructured":"Kira K, Rendell LA ( 1992) A practical approach to feature selection. In: Machine Learning Proceedings 1992, pp. 249\u2013 256 . Elsevier","DOI":"10.1016\/B978-1-55860-247-2.50037-1"},{"key":"10551_CR27","doi-asserted-by":"crossref","unstructured":"Jovi\u0107, A., Brki\u0107, K., Bogunovi\u0107, N ( 2015) A review of feature selection methods with applications. In: 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 1200\u2013 1205 . IEEE","DOI":"10.1109\/MIPRO.2015.7160458"},{"issue":"4","key":"10551_CR28","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/S0959-1524(00)00008-1","volume":"11","author":"S Yoon","year":"2001","unstructured":"Yoon S, MacGregor JF (2001) Fault diagnosis with multivariate statistical models part i: using steady state fault signatures. J Process Control 11(4):387\u2013400","journal-title":"J Process Control"},{"key":"10551_CR29","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1016\/j.neucom.2021.11.067","volume":"488","author":"N Amini","year":"2022","unstructured":"Amini N, Zhu Q (2022) Fault detection and diagnosis with a novel source-aware autoencoder and deep residual neural network. Neurocomputing 488:618\u2013633","journal-title":"Neurocomputing"},{"key":"10551_CR30","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-02532-7","volume-title":"Sensitivity Analysis for Neural Networks","author":"DS Yeung","year":"2010","unstructured":"Yeung DS, Cloete I, Shi D, Ng W (2010) Sensitivity Analysis for Neural Networks. Springer, Berlin, Heidelberg"},{"issue":"2","key":"10551_CR31","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1162\/neco.1989.1.2.270","volume":"1","author":"RJ Williams","year":"1989","unstructured":"Williams RJ, Zipser D (1989) A learning algorithm for continually running fully recurrent neural networks. Neural Comput 1(2):270\u2013280","journal-title":"Neural Comput"},{"issue":"1","key":"10551_CR32","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1002\/wics.1375","volume":"8","author":"ML Rizzo","year":"2016","unstructured":"Rizzo ML, Sz\u00e9kely GJ (2016) Energy distance. WIREs Comput Stat 8(1):27\u201338. https:\/\/doi.org\/10.1002\/wics.1375","journal-title":"WIREs Comput Stat"},{"issue":"3","key":"10551_CR33","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/0098-1354(93)80018-I","volume":"17","author":"JJ Downs","year":"1993","unstructured":"Downs JJ, Vogel EF (1993) A plant-wide industrial process control problem. Comput Chem Eng 17(3):245\u2013255","journal-title":"Comput Chem Eng"},{"key":"10551_CR34","doi-asserted-by":"publisher","unstructured":"Granderson J, Lin G, Chen Y, Casillas A, Im P, Jung S, Benne K, Ling J, Gorthala R, Wen J, Chen Z, Huang S, Vrabie D (2022) Lbnl fault detection and diagnostics datasets https:\/\/doi.org\/10.25984\/1881324","DOI":"10.25984\/1881324"},{"issue":"4","key":"10551_CR35","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1016\/j.jksuci.2019.06.012","volume":"34","author":"UM Khaire","year":"2022","unstructured":"Khaire UM, Dhanalakshmi R (2022) Stability of feature selection algorithm: a review. J King Saud Univ-Comput Inf Sci 34(4):1060\u20131073","journal-title":"J King Saud Univ-Comput Inf Sci"},{"key":"10551_CR36","unstructured":"Robnik-\u0160ikonja M, Kononenko I, et al ( 1997) An adaptation of relief for attribute estimation in regression. In: Machine Learning: Proceedings of the Fourteenth International Conference (ICML\u201997), vol. 5, pp. 296\u2013 304 . Citeseer"},{"issue":"1","key":"10551_CR37","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1186\/s40854-022-00441-7","volume":"9","author":"HH Htun","year":"2023","unstructured":"Htun HH, Biehl M, Petkov N (2023) Survey of feature selection and extraction techniques for stock market prediction. Financ Innov 9(1):26","journal-title":"Financ Innov"},{"issue":"3","key":"10551_CR38","doi-asserted-by":"crossref","first-page":"1863","DOI":"10.1007\/s11831-022-09853-1","volume":"30","author":"S Kaur","year":"2023","unstructured":"Kaur S, Kumar Y, Koul A, Kumar Kamboj S (2023) A systematic review on metaheuristic optimization techniques for feature selections in disease diagnosis: open issues and challenges. Archiv Comput Methods Eng 30(3):1863\u20131895","journal-title":"Archiv Comput Methods Eng"},{"key":"10551_CR39","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.inffus.2022.09.026","volume":"90","author":"A Thakkar","year":"2023","unstructured":"Thakkar A, Lohiya R (2023) Fusion of statistical importance for feature selection in deep neural network-based intrusion detection system. Inf Fusion 90:353\u2013363","journal-title":"Inf Fusion"},{"issue":"63","key":"10551_CR40","doi-asserted-by":"crossref","first-page":"3323","DOI":"10.21105\/joss.03323","volume":"6","author":"A Jenul","year":"2021","unstructured":"Jenul A, Schrunner S, Huynh BN, Tomic O (2021) Rent: a python package for repeated elastic net feature selection. J Open Sour Softw 6(63):3323","journal-title":"J Open Sour Softw"},{"key":"10551_CR41","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Mach Learning 45:5\u201332","journal-title":"Mach Learning"},{"key":"10551_CR42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-2105-10-213","volume":"10","author":"BH Menze","year":"2009","unstructured":"Menze BH, Kelm BM, Masuch R, Himmelreich U, Bachert P, Petrich W, Hamprecht FA (2009) A comparison of random forest and its gini importance with standard chemometric methods for the feature selection and classification of spectral data. BMC Bioinf 10:1\u201316","journal-title":"BMC Bioinf"},{"issue":"02","key":"10551_CR43","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1142\/S0219720005001004","volume":"3","author":"C Ding","year":"2005","unstructured":"Ding C, Peng H (2005) Minimum redundancy feature selection from microarray gene expression data. J Bioinform Comput Biol 3(02):185\u2013205","journal-title":"J Bioinform Comput Biol"},{"key":"10551_CR44","doi-asserted-by":"crossref","unstructured":"Zhao Z, Anand R, Wang M ( 2019) Maximum relevance and minimum redundancy feature selection methods for a marketing machine learning platform. In: 2019 IEEE International Conference on Data Science and Advanced Analytics (DSAA), pp. 442\u2013 452 . IEEE","DOI":"10.1109\/DSAA.2019.00059"},{"issue":"1","key":"10551_CR45","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B Stat Methodol 58(1):267\u2013288","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"issue":"4","key":"10551_CR46","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1109\/TKDE.2019.2893266","volume":"32","author":"H Zhang","year":"2019","unstructured":"Zhang H, Wang J, Sun Z, Zurada JM, Pal NR (2019) Feature selection for neural networks using group lasso regularization. IEEE Trans Knowl Data Eng 32(4):659\u2013673","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"10551_CR47","doi-asserted-by":"crossref","first-page":"1123493","DOI":"10.3389\/fonc.2023.1123493","volume":"13","author":"L Lei","year":"2023","unstructured":"Lei L, Du L-X, He Y-L, Yuan J-P, Wang P, Ye B-L, Wang C, Hou Z (2023) Dictionary learning lasso for feature selection with application to hepatocellular carcinoma grading using contrast enhanced magnetic resonance imaging. Front Oncol 13:1123493","journal-title":"Front Oncol"},{"issue":"17","key":"10551_CR48","doi-asserted-by":"crossref","first-page":"5888","DOI":"10.3390\/s21175888","volume":"21","author":"J Figueroa Barraza","year":"2021","unstructured":"Figueroa Barraza J, L\u00f3pez Droguett E, Martins MR (2021) Towards interpretable deep learning: a feature selection framework for prognostics and health management using deep neural networks. Sensors 21(17):5888","journal-title":"Sensors"},{"key":"10551_CR49","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1016\/j.matpr.2022.04.803","volume":"64","author":"RA Kumar","year":"2022","unstructured":"Kumar RA, Franklin JV, Koppula N (2022) A comprehensive survey on metaheuristic algorithm for feature selection techniques. Mater Today Proc 64:435\u2013441","journal-title":"Mater Today Proc"},{"key":"10551_CR50","doi-asserted-by":"crossref","first-page":"110211","DOI":"10.1016\/j.asoc.2023.110211","volume":"138","author":"L Sun","year":"2023","unstructured":"Sun L, Chen Y, Ding W, Xu J, Ma Y (2023) Amfsa: adaptive fuzzy neighborhood-based multilabel feature selection with ant colony optimization. Appl Soft Comput 138:110211","journal-title":"Appl Soft Comput"},{"issue":"2","key":"10551_CR51","doi-asserted-by":"crossref","first-page":"906","DOI":"10.3390\/app13020906","volume":"13","author":"J Priyadarshini","year":"2023","unstructured":"Priyadarshini J, Premalatha M, \u010cep R, Jayasudha M, Kalita K (2023) Analyzing physics-inspired metaheuristic algorithms in feature selection with k-nearest-neighbor. Appl Sci 13(2):906","journal-title":"Appl Sci"},{"key":"10551_CR52","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C ( 2016) why should i trust you? explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135\u2013 1144","DOI":"10.1145\/2939672.2939778"},{"key":"10551_CR53","first-page":"4765","volume":"30","author":"SM Lundberg","year":"2017","unstructured":"Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. Adv Neural Inf Proc Syst 30:4765\u20134774","journal-title":"Adv Neural Inf Proc Syst"},{"issue":"1","key":"10551_CR54","doi-asserted-by":"crossref","first-page":"127","DOI":"10.3905\/jfds.2020.1.047","volume":"3","author":"X Man","year":"2021","unstructured":"Man X, Chan E (2021) The best way to select features? Comparing mda, lime, and shap. J Financ Data Sci Winter 3(1):127\u2013139","journal-title":"J Financ Data Sci Winter"},{"key":"10551_CR55","doi-asserted-by":"crossref","unstructured":"Marc\u00edlio WE, Eler DM ( 2020) From explanations to feature selection: assessing shap values as feature selection mechanism. In: 2020 33rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 340\u2013 347 . IEEE","DOI":"10.1109\/SIBGRAPI51738.2020.00053"},{"issue":"8","key":"10551_CR56","doi-asserted-by":"crossref","first-page":"3066","DOI":"10.3390\/s22083066","volume":"22","author":"SE S\u00e1nchez-Hern\u00e1ndez","year":"2022","unstructured":"S\u00e1nchez-Hern\u00e1ndez SE, Salido-Ruiz RA, Torres-Ramos S, Rom\u00e1n-God\u00ednez I (2022) Evaluation of feature selection methods for classification of epileptic seizure eeg signals. Sensors 22(8):3066","journal-title":"Sensors"},{"key":"10551_CR57","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1016\/j.psep.2022.12.055","volume":"170","author":"K Zhou","year":"2023","unstructured":"Zhou K, Tong Y, Li X, Wei X, Huang H, Song K, Chen X (2023) Exploring global attention mechanism on fault detection and diagnosis for complex engineering processes. Process Saf Environ Prot 170:660\u2013669","journal-title":"Process Saf Environ Prot"},{"key":"10551_CR58","first-page":"1","volume":"55","author":"T Huang","year":"2022","unstructured":"Huang T, Zhang Q, Tang X, Zhao S, Lu X (2022) A novel fault diagnosis method based on cnn and lstm and its application in fault diagnosis for complex systems. Artif Intell Rev 55:1\u201327","journal-title":"Artif Intell Rev"},{"key":"10551_CR59","first-page":"100216","volume":"23","author":"I Lomov","year":"2021","unstructured":"Lomov I, Lyubimov M, Makarov I, Zhukov LE (2021) Fault detection in tennessee eastman process with temporal deep learning models. J Ind Inf Integr 23:100216","journal-title":"J Ind Inf Integr"},{"key":"10551_CR60","doi-asserted-by":"crossref","unstructured":"Chadha GS, Schwung A (2017) Comparison of deep neural network architectures for fault detection in tennessee eastman process. In: 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), pp. 1\u2013 8 . IEEE","DOI":"10.1109\/ETFA.2017.8247619"},{"key":"10551_CR61","doi-asserted-by":"crossref","first-page":"105098","DOI":"10.1016\/j.jtice.2023.105098","volume":"151","author":"Y Yang","year":"2023","unstructured":"Yang Y, Shi H, Tao Y, Ma Y, Song B, Tan S (2023) A semi-supervised feature contrast convolutional neural network for processes fault diagnosis. J Taiwan Inst Chem Eng 151:105098","journal-title":"J Taiwan Inst Chem Eng"},{"key":"10551_CR62","first-page":"42","volume":"27","author":"IA Okaro","year":"2019","unstructured":"Okaro IA, Jayasinghe S, Sutcliffe C, Black K, Paoletti P, Green PL (2019) Automatic fault detection for laser powder-bed fusion using semi-supervised machine learning. Addit Manuf 27:42\u201353","journal-title":"Addit Manuf"},{"issue":"2","key":"10551_CR63","doi-asserted-by":"crossref","first-page":"025036","DOI":"10.1088\/1361-6501\/ad0f6d","volume":"35","author":"H Tao","year":"2023","unstructured":"Tao H, Shi H, Qiu J, Jin G, Stojanovic V (2023) Planetary gearbox fault diagnosis based on fdknn-dgat with few labeled data. Meas Sci Technol 35(2):025036","journal-title":"Meas Sci Technol"},{"key":"10551_CR64","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/j.inffus.2019.02.006","volume":"51","author":"B Wang","year":"2019","unstructured":"Wang B, Mao Z (2019) Outlier detection based on a dynamic ensemble model: applied to process monitoring. Inf Fusion 51:244\u2013258","journal-title":"Inf Fusion"},{"key":"10551_CR65","doi-asserted-by":"crossref","first-page":"128746","DOI":"10.1109\/ACCESS.2019.2939163","volume":"7","author":"C Hu","year":"2019","unstructured":"Hu C, Xu Z, Kong X, Luo J (2019) Recursive-cpls-based quality-relevant and process-relevant fault monitoring with application to the tennessee eastman process. IEEE Access 7:128746\u2013128757","journal-title":"IEEE Access"},{"issue":"1","key":"10551_CR66","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1080\/21642583.2016.1198940","volume":"4","author":"RT Samuel","year":"2016","unstructured":"Samuel RT, Cao Y (2016) Nonlinear process fault detection and identification using kernel pca and kernel density estimation. Syst Sci Control Eng 4(1):165\u2013174","journal-title":"Syst Sci Control Eng"},{"issue":"13","key":"10551_CR67","doi-asserted-by":"crossref","first-page":"12181","DOI":"10.1007\/s11071-023-08456-0","volume":"111","author":"X Song","year":"2023","unstructured":"Song X, Sun P, Song S, Stojanovic V (2023) Finite-time adaptive neural resilient dsc for fractional-order nonlinear large-scale systems against sensor-actuator faults. Nonlinear Dyn 111(13):12181\u201312196","journal-title":"Nonlinear Dyn"},{"key":"10551_CR68","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2018\/5910696","volume":"2018","author":"S Yin","year":"2018","unstructured":"Yin S, Wang Y, Wang G, Khan A-Q, Haghani A (2018) Key performance indicators relevant fault diagnosis and process control approaches for industrial applications. J Control Sci Eng 2018:1\u20132","journal-title":"J Control Sci Eng"},{"issue":"1","key":"10551_CR69","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.chemolab.2004.05.001","volume":"75","author":"SW Choi","year":"2005","unstructured":"Choi SW, Lee C, Lee J-M, Park JH, Lee I-B (2005) Fault detection and identification of nonlinear processes based on kernel pca. Chemom Intell Lab Syst 75(1):55\u201367","journal-title":"Chemom Intell Lab Syst"},{"key":"10551_CR70","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.isatra.2023.06.004","volume":"140","author":"M Ren","year":"2023","unstructured":"Ren M, Liang Y, Chen J, Xu X, Cheng L (2023) Fault detection for nox emission process in thermal power plants using sip-pca. ISA Trans 140:46\u201354","journal-title":"ISA Trans"},{"key":"10551_CR71","doi-asserted-by":"crossref","first-page":"6369","DOI":"10.1007\/s13369-020-05052-x","volume":"46","author":"A Maran Beena","year":"2021","unstructured":"Maran Beena A, Pani AK (2021) Fault detection of complex processes using nonlinear mean function based gaussian process regression: application to the tennessee eastman process. Arab J Sci Eng 46:6369\u20136390","journal-title":"Arab J Sci Eng"},{"key":"10551_CR72","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.isatra.2023.07.043","volume":"142","author":"R Wang","year":"2023","unstructured":"Wang R, Zhuang Z, Tao H, Paszke W, Stojanovic V (2023) Q-learning based fault estimation and fault tolerant iterative learning control for mimo systems. ISA Trans 142:123\u2013135","journal-title":"ISA Trans"},{"key":"10551_CR73","doi-asserted-by":"crossref","first-page":"103301","DOI":"10.1109\/ACCESS.2020.2999065","volume":"8","author":"Y Tan","year":"2020","unstructured":"Tan Y, Hu C, Zhang K, Zheng K, Davis EA, Park JS (2020) Lstm-based anomaly detection for non-linear dynamical system. IEEE access 8:103301\u2013103308","journal-title":"IEEE access"},{"issue":"8","key":"10551_CR74","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"10551_CR75","doi-asserted-by":"crossref","first-page":"105497","DOI":"10.1109\/ACCESS.2022.3211387","volume":"10","author":"R Bolboac\u0103","year":"2022","unstructured":"Bolboac\u0103 R (2022) Adaptive ensemble methods for tampering detection in automotive aftertreatment systems. IEEE Access 10:105497\u2013105517","journal-title":"IEEE Access"},{"issue":"6","key":"10551_CR76","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.3390\/math11061432","volume":"11","author":"R Bolboac\u0103","year":"2023","unstructured":"Bolboac\u0103 R, Haller P (2023) Performance analysis of long short-term memory predictive neural networks on time series data. Mathematics 11(6):1432","journal-title":"Mathematics"},{"issue":"3","key":"10551_CR77","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1080\/00207540600792267","volume":"45","author":"Z Wu","year":"2007","unstructured":"Wu Z, Wang Q (2007) A single cusum chart using a single observation to monitor a variable. Int J Prod Res 45(3):719\u2013741","journal-title":"Int J Prod Res"},{"issue":"2","key":"10551_CR78","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/S0304-4076(96)01818-0","volume":"77","author":"AC Cameron","year":"1997","unstructured":"Cameron AC, Windmeijer FA (1997) An r-squared measure of goodness of fit for some common nonlinear regression models. J Econ 77(2):329\u2013342","journal-title":"J Econ"},{"issue":"11","key":"10551_CR79","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1016\/S0098-1354(03)00113-3","volume":"27","author":"T Jockenh\u00f6vel","year":"2003","unstructured":"Jockenh\u00f6vel T, Biegler LT, W\u00e4chter A (2003) Dynamic optimization of the tennessee eastman process using the optcontrolcentre. Comput Chem Eng 27(11):1513\u20131531","journal-title":"Comput Chem Eng"},{"issue":"9","key":"10551_CR80","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1016\/0098-1354(94)00113-3","volume":"19","author":"N Ricker","year":"1995","unstructured":"Ricker N, Lee J (1995) Nonlinear modeling and state estimation for the tennessee eastman challenge process. Comput Chem Eng 19(9):983\u20131005","journal-title":"Comput Chem Eng"},{"key":"10551_CR81","first-page":"2017","volume":"1","author":"C Rieth","year":"2017","unstructured":"Rieth C, Amsel B, Tran R, Cook M (2017) Additional tennessee eastman process simulation data for anomaly detection evaluation. Harv Dataverse 1:2017","journal-title":"Harv Dataverse"},{"key":"10551_CR82","unstructured":"Krotofil M, Larsen J ( 2015) Rocking the pocket book: Hacking chemical plants. In: DefCon Conference, DEFCON"},{"key":"10551_CR83","doi-asserted-by":"crossref","first-page":"106786","DOI":"10.1016\/j.compchemeng.2020.106786","volume":"136","author":"N Basha","year":"2020","unstructured":"Basha N, Sheriff MZ, Kravaris C, Nounou H, Nounou M (2020) Multiclass data classification using fault detection-based techniques. Comp Chem Eng 136:106786","journal-title":"Comp Chem Eng"},{"key":"10551_CR84","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1016\/j.automatica.2017.02.028","volume":"80","author":"J Shang","year":"2017","unstructured":"Shang J, Chen M, Ji H, Zhou D (2017) Recursive transformed component statistical analysis for incipient fault detection. Automatica 80:313\u2013327","journal-title":"Automatica"},{"issue":"18","key":"10551_CR85","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1016\/j.ifacol.2018.09.380","volume":"51","author":"S Heo","year":"2018","unstructured":"Heo S, Lee JH (2018) Fault detection and classification using artificial neural networks. IFAC-PapersOnLine 51(18):470\u2013475","journal-title":"IFAC-PapersOnLine"},{"key":"10551_CR86","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-63913-0","volume-title":"An Introduction to Machine Learning","author":"M Kubat","year":"2017","unstructured":"Kubat M, Kubat J (2017) An Introduction to Machine Learning, vol 2. Springer, Berlin, Heidelberg"},{"issue":"11","key":"10551_CR87","doi-asserted-by":"crossref","first-page":"1480","DOI":"10.3390\/pr8111480","volume":"8","author":"X Li","year":"2020","unstructured":"Li X, Zhou K, Xue F, Chen Z, Ge Z, Chen X, Song K (2020) A wavelet transform-assisted convolutional neural network multi-model framework for monitoring large-scale fluorochemical engineering processes. Processes 8(11):1480","journal-title":"Processes"},{"issue":"3","key":"10551_CR88","doi-asserted-by":"crossref","first-page":"992","DOI":"10.1002\/aic.16497","volume":"65","author":"M Onel","year":"2019","unstructured":"Onel M, Kieslich CA, Pistikopoulos EN (2019) aA nonlinear support vector machine-based feature selection approach for fault detection and diagnosis: application to the tennessee eastman process. AIChE J 65(3):992\u20131005","journal-title":"AIChE J"},{"issue":"9","key":"10551_CR89","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1016\/j.jprocont.2012.06.009","volume":"22","author":"S Yin","year":"2012","unstructured":"Yin S, Ding SX, Haghani A, Hao H, Zhang P (2012) A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark tennessee eastman process. J Process Control 22(9):1567\u20131581","journal-title":"J Process Control"},{"key":"10551_CR90","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.compchemeng.2018.04.009","volume":"115","author":"H Wu","year":"2018","unstructured":"Wu H, Zhao J (2018) Deep convolutional neural network model based chemical process fault diagnosis. Comput Chem Eng 115:185\u2013197","journal-title":"Comput Chem Eng"},{"key":"10551_CR91","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1016\/j.asoc.2016.08.040","volume":"49","author":"MF D\u2019Angelo","year":"2016","unstructured":"D\u2019Angelo MF, Palhares RM, Camargos Filho MC, Maia RD, Mendes JB, Ekel PY (2016) A new fault classification approach applied to tennessee eastman benchmark process. Appl Soft Comput 49:676\u2013686","journal-title":"Appl Soft Comput"},{"key":"10551_CR92","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. Advances Neural Inf Process Syst 30"},{"key":"10551_CR93","doi-asserted-by":"crossref","unstructured":"Karita S, Chen N, Hayashi T, Hori T, Inaguma H, Jiang Z, Someki M, Soplin NEY, Yamamoto R, Wang X, Watanabe S, Yoshimura T, Zhang W ( 2019) A comparative study on transformer vs rnn in speech applications. In: 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), pp. 449\u2013 456","DOI":"10.1109\/ASRU46091.2019.9003750"},{"key":"10551_CR94","volume-title":"Natural Language Processing with Transformers","author":"L Tunstall","year":"2022","unstructured":"Tunstall L, Von Werra L, Wolf T (2022) Natural Language Processing with Transformers. O\u2019Reilly Media Inc, Sebastopol, California"},{"key":"10551_CR95","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1162\/tacl_a_00574","volume":"11","author":"A Murtadha","year":"2023","unstructured":"Murtadha A, Pan S, Bo W, Su J, Cao X, Zhang W, Liu Y (2023) Rank-aware negative training for semi-supervised text classification. Trans Assoc Comput Linguist 11:771\u2013786","journal-title":"Trans Assoc Comput Linguist"},{"key":"10551_CR96","doi-asserted-by":"crossref","unstructured":"Buest\u00e1n-Andrade P-A, Santos M, Sierra-Garc\u00eda J-E, Pazmi\u00f1o-Piedra J-P ( 2023) Comparison of lstm, gru and transformer neural network architecture for prediction of wind turbine variables. In: International Conference on Soft Computing Models in Industrial and Environmental Applications, pp. 334\u2013 343 . Springer","DOI":"10.1007\/978-3-031-42536-3_32"},{"key":"10551_CR97","doi-asserted-by":"publisher","unstructured":"Ezen-Can, A ( 2020) A comparison of lstm and bert for small corpus. arXiv preprint arXiv: 2009.05451https:\/\/doi.org\/10.48550\/arXiv.2009.05451","DOI":"10.48550\/arXiv.2009.05451"},{"key":"10551_CR98","first-page":"11121","volume":"37","author":"A Zeng","year":"2023","unstructured":"Zeng A, Chen M, Zhang L, Xu Q (2023) Are transformers effective for time series forecasting? Proc AAAI Conf Artif Intell 37:11121\u201311128","journal-title":"Proc AAAI Conf Artif Intell"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-024-10551-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-024-10551-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-024-10551-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,31]],"date-time":"2025-05-31T09:18:37Z","timestamp":1748683117000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-024-10551-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,11]]},"references-count":98,"journal-issue":{"issue":"17","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["10551"],"URL":"https:\/\/doi.org\/10.1007\/s00521-024-10551-1","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,11]]},"assertion":[{"value":"16 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 October 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 December 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}