{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T02:50:45Z","timestamp":1781751045561,"version":"3.54.5"},"reference-count":141,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2024,10,2]],"date-time":"2024-10-02T00:00:00Z","timestamp":1727827200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Culture and Innovation of Hungary","award":["TKP2021-NVA-10"],"award-info":[{"award-number":["TKP2021-NVA-10"]}]},{"name":"Ministry of Culture and Innovation of Hungary","award":["2020-1.1.2-PIACI-KFI-2020-00144"],"award-info":[{"award-number":["2020-1.1.2-PIACI-KFI-2020-00144"]}]},{"DOI":"10.13039\/501100003827","name":"National Research, Development, and Innovation Office of Hungary","doi-asserted-by":"publisher","award":["TKP2021-NVA-10"],"award-info":[{"award-number":["TKP2021-NVA-10"]}],"id":[{"id":"10.13039\/501100003827","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003827","name":"National Research, Development, and Innovation Office of Hungary","doi-asserted-by":"publisher","award":["2020-1.1.2-PIACI-KFI-2020-00144"],"award-info":[{"award-number":["2020-1.1.2-PIACI-KFI-2020-00144"]}],"id":[{"id":"10.13039\/501100003827","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Machine learning (ML) revolutionized traditional machine fault detection and identification (FDI), as complex-structured models with well-designed unsupervised learning strategies can detect abnormal patterns from abundant data, which significantly reduces the total cost of ownership. However, their opaqueness raised human concern and intrigued the eXplainable artificial intelligence (XAI) concept. Furthermore, the development of ML-based FDI models can be improved fundamentally with machine learning operations (MLOps) guidelines, enhancing reproducibility and operational quality. This study proposes a framework for the continuous development of ML-based FDI solutions, which contains a general structure to simultaneously visualize and check the performance of the ML model while directing the resource-efficient development process. A use case is conducted on sensor data of a hydraulic system with a simple long short-term memory (LSTM) network. Proposed XAI principles and tools supported the model engineering and monitoring, while additional system optimization can be made regarding input data preparation, feature selection, and model usage. Suggested MLOps principles help developers create a minimum viable solution and involve it in a continuous improvement loop. The promising result motivates further adoption of XAI and MLOps while endorsing the generalization of modern ML-based FDI applications with the HITL concept.<\/jats:p>","DOI":"10.3390\/computers13100252","type":"journal-article","created":{"date-parts":[[2024,10,2]],"date-time":"2024-10-02T06:27:31Z","timestamp":1727850451000},"page":"252","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["The Use of eXplainable Artificial Intelligence and Machine Learning Operation Principles to Support the Continuous Development of Machine Learning-Based Solutions in Fault Detection and Identification"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3098-7075","authenticated-orcid":false,"given":"Tuan-Anh","family":"Tran","sequence":"first","affiliation":[{"name":"HUN-REN-PE Complex Systems Monitoring Research Group, University of Pannonia, Egyetem u. 10, P.O. Box 158, 8200 Veszprem, Hungary"},{"name":"Department of System Engineering, University of Pannonia, Egyetem u. 10, P.O. Box 158, 8200 Veszprem, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9441-843X","authenticated-orcid":false,"given":"Tam\u00e1s","family":"Ruppert","sequence":"additional","affiliation":[{"name":"HUN-REN-PE Complex Systems Monitoring Research Group, University of Pannonia, Egyetem u. 10, P.O. Box 158, 8200 Veszprem, Hungary"},{"name":"Department of System Engineering, University of Pannonia, Egyetem u. 10, P.O. Box 158, 8200 Veszprem, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8593-1493","authenticated-orcid":false,"given":"J\u00e1nos","family":"Abonyi","sequence":"additional","affiliation":[{"name":"HUN-REN-PE Complex Systems Monitoring Research Group, University of Pannonia, Egyetem u. 10, P.O. Box 158, 8200 Veszprem, Hungary"},{"name":"Department of Process Engineering, University of Pannonia, Egyetem u. 10, P.O. Box 158, 8200 Veszprem, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Haddad, D., Wang, L., Kallel, A.Y., Amara, N.E.B., and Kanoun, O. (2022, January 15\u201317). Multi-sensor-based method for multiple hard faults identification in complex wired networks. Proceedings of the 2022 IEEE 9th International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), Chemnitz, Germany.","DOI":"10.1109\/CIVEMSA53371.2022.9853641"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"110468","DOI":"10.1016\/j.automatica.2022.110468","article-title":"A generalized probabilistic monitoring model with both random and sequential data","volume":"144","author":"Yu","year":"2022","journal-title":"Automatica"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1016\/j.neucom.2017.07.032","article-title":"A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines","volume":"272","author":"Jia","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"107386","DOI":"10.1016\/j.knosys.2021.107386","article-title":"Hierarchical diagnosis of bearing faults using branch convolutional neural network considering noise interference and variable working conditions","volume":"230","author":"Su","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"110070","DOI":"10.1016\/j.knosys.2022.110070","article-title":"A real-time adaptive model for bearing fault classification and remaining useful life estimation using deep neural network","volume":"259","author":"Gupta","year":"2023","journal-title":"Knowl.-Based Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.ymssp.2017.11.024","article-title":"A review on the application of deep learning in system health management","volume":"107","author":"Khan","year":"2018","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1109\/TCST.2023.3330443","article-title":"An unsupervised fault detection and diagnosis with distribution dissimilarity and lasso penalty","volume":"32","author":"Yu","year":"2023","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.arcontrol.2012.09.004","article-title":"Survey on data-driven industrial process monitoring and diagnosis","volume":"36","author":"Qin","year":"2012","journal-title":"Annu. Rev. Control"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"106587","DOI":"10.1016\/j.ymssp.2019.106587","article-title":"Applications of machine learning to machine fault diagnosis: A review and roadmap","volume":"138","author":"Lei","year":"2020","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1038\/538020a","article-title":"Can we open the black box of AI?","volume":"538","author":"Castelvecchi","year":"2016","journal-title":"Nat. News"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/3236386.3241340","article-title":"The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery","volume":"16","author":"Lipton","year":"2018","journal-title":"Queue"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.inffus.2021.11.005","article-title":"A comprehensive survey on regularization strategies in machine learning","volume":"80","author":"Tian","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_13","unstructured":"Sevillano-Garc\u00eda, I., Luengo, J., and Herrera, F. (2024). SHIELD: A regularization technique for eXplainable Artificial Intelligence. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Arrieta","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_15","unstructured":"Das, A., and Rad, P. (2020). Opportunities and challenges in explainable artificial intelligence (xai): A survey. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5031","DOI":"10.1109\/TII.2022.3146552","article-title":"From artificial intelligence to explainable artificial intelligence in industry 4.0: A survey on what, how, and where","volume":"18","author":"Ahmed","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Jang, K., Pilario, K.E.S., Lee, N., Moon, I., and Na, J. (IEEE Trans. Ind. Inform., 2023). Explainable Artificial Intelligence for Fault Diagnosis of Industrial Processes, IEEE Trans. Ind. Inform., in press.","DOI":"10.1109\/TII.2023.3240601"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/MC.2021.3071551","article-title":"Explainable AI for chiller fault-detection systems: Gaining human trust","volume":"54","author":"Srinivasan","year":"2021","journal-title":"Computer"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Brusa, E., Cibrario, L., Delprete, C., and Di Maggio, L.G. (2023). Explainable AI for Machine Fault Diagnosis: Understanding Features\u2019 Contribution in Machine Learning Models for Industrial Condition Monitoring. Appl. Sci., 13.","DOI":"10.3390\/app13042038"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mey, O., and Neufeld, D. (2022). Explainable AI Algorithms for Vibration Data-Based Fault Detection: Use Case-Adadpted Methods and Critical Evaluation. Sensors, 22.","DOI":"10.3390\/s22239037"},{"key":"ref_21","first-page":"95","article-title":"kNN vs. SVM: A Comparison of Algorithms","volume":"78","author":"Hamilton","year":"2018","journal-title":"Fire-Contin.-Prep. Future Wildland Fire Missoula USA"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hasan, M.J., Sohaib, M., and Kim, J.M. (2021). An explainable ai-based fault diagnosis model for bearings. Sensors, 21.","DOI":"10.3390\/s21124070"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sanakkayala, D.C., Varadarajan, V., Kumar, N., Soni, G., Kamat, P., Kumar, S., Patil, S., and Kotecha, K. (2022). Explainable AI for Bearing Fault Prognosis Using Deep Learning Techniques. Micromachines, 13.","DOI":"10.3390\/mi13091471"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3494","DOI":"10.17762\/turcomat.v12i3.1624","article-title":"Failure Prognostic of Turbofan Engines with Uncertainty Quantification and Explainable AI (XIA)","volume":"12","author":"Nor","year":"2021","journal-title":"Turk. J. Comput. Math. Educ. (TURCOMAT)"},{"key":"ref_25","unstructured":"Nor, A.K.B.M., Pedapait, S.R., and Muhammad, M. (2021). Explainable ai (xai) for phm of industrial asset: A state-of-the-art, prisma-compliant systematic review. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"110273","DOI":"10.1016\/j.knosys.2023.110273","article-title":"Explainable AI (XAI): A systematic meta-survey of current challenges and future opportunities","volume":"263","author":"Saeed","year":"2023","journal-title":"Knowl.-Based Syst."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ruf, P., Madan, M., Reich, C., and Ould-Abdeslam, D. (2021). Demystifying mlops and presenting a recipe for the selection of open-source tools. Appl. Sci., 11.","DOI":"10.3390\/app11198861"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Alla, S., Adari, S.K., Alla, S., and Adari, S.K. (2021). What is mlops?. Beginning MLOps with MLFlow: Deploy Models in AWS SageMaker, Google Cloud, and Microsoft Azure, Apress.","DOI":"10.1007\/978-1-4842-6549-9"},{"key":"ref_29","unstructured":"Lwakatare, L.E., Kuvaja, P., and Oivo, M. (2016, January 22\u201324). Relationship of devops to agile, lean and continuous deployment: A multivocal literature review study. Proceedings of the Product-Focused Software Process Improvement: 17th International Conference, PROFES 2016, Trondheim, Norway. Proceedings 17."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Karamitsos, I., Albarhami, S., and Apostolopoulos, C. (2020). Applying DevOps practices of continuous automation for machine learning. Information, 11.","DOI":"10.3390\/info11070363"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tamburri, D.A. (2020, January 1\u20134). Sustainable mlops: Trends and challenges. Proceedings of the 2020 22nd International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), Timisoara, Romania.","DOI":"10.1109\/SYNASC51798.2020.00015"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"108907","DOI":"10.1016\/j.ymssp.2022.108907","article-title":"Physics-Informed LSTM hyperparameters selection for gearbox fault detection","volume":"171","author":"Chen","year":"2022","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Leite, D., Martins, A., Rativa, D., De Oliveira, J.F., and Maciel, A.M. (2022). An Automated Machine Learning Approach for Real-Time Fault Detection and Diagnosis. Sensors, 22.","DOI":"10.3390\/s22166138"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Z\u00f6ller, M.A., Titov, W., Schlegel, T., and Huber, M.F. (2022). XAutoML: A Visual Analytics Tool for Establishing Trust in Automated Machine Learning. arXiv.","DOI":"10.1145\/3625240"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Helwig, N., Pignanelli, E., and Sch\u00fctze, A. (2015, January 11\u201314). Condition monitoring of a complex hydraulic system using multivariate statistics. Proceedings of the 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings, Pisa, Italy.","DOI":"10.1109\/I2MTC.2015.7151267"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1515\/teme-2016-0072","article-title":"Automatic feature extraction and selection for classification of cyclical time series data","volume":"84","author":"Schneider","year":"2017","journal-title":"tm-Tech. Mess."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"6789","DOI":"10.1109\/TNNLS.2021.3083401","article-title":"Fault diagnosis of hydraulic systems based on deep learning model with multirate data samples","volume":"33","author":"Huang","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"103339","DOI":"10.1016\/j.advengsoft.2022.103339","article-title":"Health condition monitoring of a complex hydraulic system using Deep Neural Network and DeepSHAP explainable XAI","volume":"175","author":"Keleko","year":"2023","journal-title":"Adv. Eng. Softw."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Goelles, T., Schlager, B., and Muckenhuber, S. (2020). Fault detection, isolation, identification and recovery (fdiir) methods for automotive perception sensors including a detailed literature survey for lidar. Sensors, 20.","DOI":"10.3390\/s20133662"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Keipour, A., Mousaei, M., and Scherer, S. (2019, January 20\u201324). Automatic real-time anomaly detection for autonomous aerial vehicles. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794286"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"113844","DOI":"10.1016\/j.oceaneng.2023.113844","article-title":"GASEL: Genetic algorithm-supported ensemble learning for fault detection in autonomous underwater vehicles","volume":"272","author":"Das","year":"2023","journal-title":"Ocean. Eng."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13\u201317). \u201cWhy should i trust you?\u201d Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA.","DOI":"10.1145\/2939672.2939778"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"102024","DOI":"10.1016\/j.aei.2023.102024","article-title":"Explainable artificial intelligence (XAI): Precepts, models, and opportunities for research in construction","volume":"57","author":"Love","year":"2023","journal-title":"Adv. Eng. Inform."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Shahbazi, Z., and Byun, Y.C. (2021). Integration of blockchain, IoT and machine learning for multistage quality control and enhancing security in smart manufacturing. Sensors, 21.","DOI":"10.3390\/s21041467"},{"key":"ref_45","unstructured":"Molnar, C. (2022). Interpretable Machine Learning, Lulu.com. [2nd ed.]."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Kravchenko, T., Bogdanova, T., and Shevgunov, T. (2022, January 26\u201330). Ranking requirements using MoSCoW methodology in practice. Proceedings of the Computer Science On-Line Conference, Virtual.","DOI":"10.1007\/978-3-031-09073-8_18"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3533378","article-title":"Challenges in deploying machine learning: A survey of case studies","volume":"55","author":"Paleyes","year":"2022","journal-title":"Acm Comput. Surv."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/MS.2010.85","article-title":"Agile model-driven development in practice","volume":"28","author":"Zhang","year":"2010","journal-title":"IEEE Softw."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"012016","DOI":"10.1088\/1742-6596\/2511\/1\/012016","article-title":"PythonDAQ\u2013A Python based measurement data acquisition and processing software","volume":"2511","year":"2023","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"045104","DOI":"10.1063\/5.0032116","article-title":"PyMoDAQ: An open-source Python-based software for modular data acquisition","volume":"92","author":"Weber","year":"2021","journal-title":"Rev. Sci. Instrum."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"5662","DOI":"10.21105\/joss.05662","article-title":"PYDAQ: Data Acquisition and Experimental Analysis with Python","volume":"8","author":"Martins","year":"2023","journal-title":"J. Open Source Softw."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"125","DOI":"10.14778\/2735471.2735474","article-title":"Scaling up crowd-sourcing to very large datasets: A case for active learning","volume":"8","author":"Mozafari","year":"2014","journal-title":"Proc. Vldb Endow."},{"key":"ref_53","unstructured":"Ehrenberg, H.R., Shin, J., Ratner, A.J., Fries, J.A., and R\u00e9, C. (July, January 26). Data programming with ddlite: Putting humans in a different part of the loop. Proceedings of the Workshop on Human-In-the-Loop Data Analytics, New York, NY, USA."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Meas, M., Machlev, R., Kose, A., Tepljakov, A., Loo, L., Levron, Y., Petlenkov, E., and Belikov, J. (2022). Explainability and Transparency of Classifiers for Air-Handling Unit Faults Using Explainable Artificial Intelligence (XAI). Sensors, 22.","DOI":"10.3390\/s22176338"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"105304","DOI":"10.1016\/j.conengprac.2022.105304","article-title":"An interpretable unsupervised Bayesian network model for fault detection and diagnosis","volume":"127","author":"Yang","year":"2022","journal-title":"Control Eng. Pract."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"63606","DOI":"10.1109\/ACCESS.2022.3181730","article-title":"MLOps: A Taxonomy and a Methodology","volume":"10","author":"Testi","year":"2022","journal-title":"IEEE Access"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"S118","DOI":"10.1134\/S1064562422060230","article-title":"Eco2ai: Carbon emissions tracking of machine learning models as the first step towards sustainable ai","volume":"106","author":"Budennyy","year":"2022","journal-title":"Dokl. Math."},{"key":"ref_58","unstructured":"Anthony, L.F.W., Kanding, B., and Selvan, R. (2020). Carbontracker: Tracking and predicting the carbon footprint of training deep learning models. arXiv."},{"key":"ref_59","unstructured":"G\u00e9ron, A. (2022). Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow, O\u2019Reilly Media, Inc."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1016\/j.renene.2021.10.063","article-title":"Edge-based Explainable Fault Detection Systems for photovoltaic panels on edge nodes","volume":"185","author":"Sairam","year":"2022","journal-title":"Renew. Energy"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"115014","DOI":"10.1088\/2515-7620\/acf81b","article-title":"How to estimate carbon footprint when training deep learning models? A guide and review","volume":"5","author":"Bouza","year":"2023","journal-title":"Environ. Res. Commun."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Al-Aomar, R. (2002). A methodology for determining Process and system-level manufacturing performance metrics. Sae Trans., 1043\u20131056.","DOI":"10.4271\/2002-01-2900"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Frank, S.M., Lin, G., Jin, X., Singla, R., Farthing, A., Zhang, L., and Granderson, J. (2019). Metrics and Methods to Assess Building Fault Detection and Diagnosis Tools, National Renewable Energy Lab. (NREL). Technical Report.","DOI":"10.2172\/1503166"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/j.patcog.2017.07.024","article-title":"Synthetic minority oversampling technique for multiclass imbalance problems","volume":"72","author":"Zhu","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Belikov, J., Meas, M., Machlev, R., Kose, A., Tepljakov, A., Loo, L., Petlenkov, E., and Levron, Y. (2022, January 14\u201316). Explainable AI based fault detection and diagnosis system for air handling units. Proceedings of the International Conference on Informatics in Control, Automation and Robotics, Lisbon, Portugal.","DOI":"10.5220\/0011350000003271"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.solener.2022.11.018","article-title":"Explainable artificial intelligence for photovoltaic fault detection: A comparison of instruments","volume":"249","author":"Utama","year":"2023","journal-title":"Sol. Energy"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"He, M., Li, B., and Sun, S. (2023). A Survey of Class Activation Mapping for the Interpretability of Convolution Neural Networks. Signal and Information Processing, Networking and Computers: Proceedings of the 10th International Conference on Signal and Information Processing, Networking and Computers (ICSINC), Xi\u2019Ning, China, July 2022, Springer.","DOI":"10.1007\/978-981-19-9968-0_48"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Montavon, G., Binder, A., Lapuschkin, S., Samek, W., and M\u00fcller, K.R. (2019). Layer-wise relevance propagation: An overview. Explainable AI: Interpreting, Explaining and Visualizing Deep Learning, Springer.","DOI":"10.1007\/978-3-030-28954-6_10"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1613\/jair.1.13283","article-title":"On the tractability of SHAP explanations","volume":"74","author":"Lykov","year":"2022","journal-title":"J. Artif. Intell. Res."},{"key":"ref_70","unstructured":"Laves, M.H., Ihler, S., and Ortmaier, T. (2019). Uncertainty Quantification in Computer-Aided Diagnosis: Make Your Model say \u201cI don\u2019t know\u201d for Ambiguous Cases. arXiv."},{"key":"ref_71","unstructured":"Shafaei, S., Kugele, S., Osman, M.H., and Knoll, A. (2018, January 18). Uncertainty in machine learning: A safety perspective on autonomous driving. Proceedings of the Computer Safety, Reliability, and Security: SAFECOMP 2018 Workshops, ASSURE, DECSoS, SASSUR, STRIVE, and WAISE, V\u00e4ster\u00e5s, Sweden. Proceedings 37."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3185515","article-title":"Using machine learning to support qualitative coding in social science: Shifting the focus to ambiguity","volume":"8","author":"Chen","year":"2018","journal-title":"Acm Trans. Interact. Intell. Syst. (TiiS)"},{"key":"ref_73","unstructured":"Munro, R., and Monarch, R. (2021). Human-in-the-Loop Machine Learning: Active Learning and Annotation for Human-Centered AI, Simon and Schuster."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"108105","DOI":"10.1016\/j.ymssp.2021.108105","article-title":"An explainable artificial intelligence approach for unsupervised fault detection and diagnosis in rotating machinery","volume":"163","author":"Brito","year":"2022","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1016\/j.psep.2022.07.019","article-title":"XFDDC: EXplainable Fault Detection Diagnosis and Correction framework for chemical process systems","volume":"165","author":"Harinarayan","year":"2022","journal-title":"Process. Saf. Environ. Prot."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"056026","DOI":"10.1103\/PhysRevD.104.056026","article-title":"Uncertainty-aware machine learning for high energy physics","volume":"104","author":"Ghosh","year":"2021","journal-title":"Phys. Rev. D"},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"104637","DOI":"10.1016\/j.conengprac.2020.104637","article-title":"Process fault diagnosis with model-and knowledge-based approaches: Advances and opportunities","volume":"105","author":"Li","year":"2020","journal-title":"Control Eng. Pract."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.1007\/s12206-021-0342-5","article-title":"Knowledge Integration into deep learning in dynamical systems: An overview and taxonomy","volume":"35","author":"Kim","year":"2021","journal-title":"J. Mech. Sci. Technol."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"110866","DOI":"10.1016\/j.knosys.2023.110866","article-title":"An objective metric for explainable AI: How and why to estimate the degree of explainability","volume":"278","author":"Sovrano","year":"2023","journal-title":"Knowl.-Based Syst."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Breck, E., Cai, S., Nielsen, E., Salib, M., and Sculley, D. (2017, January 11\u201314). The ML test score: A rubric for ML production readiness and technical debt reduction. Proceedings of the 2017 IEEE International Conference on Big Data (Big Data), Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258038"},{"key":"ref_81","unstructured":"Larysa, V., Anja, K., Isabel, B., Alexander, K., and Michael, P. (2024, September 11). MLOps Principles. Available online: https:\/\/ml-ops.org\/content\/mlops-principles."},{"key":"ref_82","unstructured":"Treveil, M., Omont, N., Stenac, C., Lefevre, K., Phan, D., Zentici, J., Lavoillotte, A., Miyazaki, M., and Heidmann, L. (2020). Introducing MLOps, O\u2019Reilly Media."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"31866","DOI":"10.1109\/ACCESS.2023.3262138","article-title":"Machine learning operations (mlops): Overview, definition, and architecture","volume":"11","author":"Kreuzberger","year":"2023","journal-title":"IEEE Access"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S1474-6670(17)36841-6","article-title":"Fuzzy expert system for supervision in adaptive control","volume":"33","author":"Abonyi","year":"2000","journal-title":"Ifac Proc. Vol."},{"key":"ref_85","first-page":"13","article-title":"The CRISP-DM model: The new blueprint for data mining","volume":"5","author":"Shearer","year":"2000","journal-title":"J. Data Warehous."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1108\/IJQRM-09-2014-0139","article-title":"Utilizing Kaizen process and DFSS methodology for new product development","volume":"34","author":"Awad","year":"2017","journal-title":"Int. J. Qual. Reliab. Manag."},{"key":"ref_87","unstructured":"Karpatne, A., Watkins, W., Read, J., and Kumar, V. (2017, January 4\u20139). How can physics inform deep learning methods in scientific problems?: Recent progress and future prospects. Proceedings of the 31st Conference on Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1007\/s10915-022-01939-z","article-title":"Scientific machine learning through physics\u2013informed neural networks: Where we are and what\u2019s next","volume":"92","author":"Cuomo","year":"2022","journal-title":"J. Sci. Comput."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Arachchi, S., and Perera, I. (June, January 30). Continuous integration and continuous delivery pipeline automation for agile software project management. Proceedings of the 2018 Moratuwa Engineering Research Conference (MERCon), Moratuwa, Sri Lanka.","DOI":"10.1109\/MERCon.2018.8421965"},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Neely, S., and Stolt, S. (2013, January 5\u20139). Continuous delivery? easy! just change everything (well, maybe it is not that easy). Proceedings of the 2013 Agile Conference, Nashville, TN, USA.","DOI":"10.1109\/AGILE.2013.17"},{"key":"ref_91","unstructured":"Humble, J., and Farley, D. (2010). Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation, Pearson Education."},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Yu, Y., and Ding, B. (2020, January 23\u201325). Towards mlops: A case study of ml pipeline platform. Proceedings of the 2020 International Conference on Artificial Intelligence and Computer Engineering (ICAICE), Beijing, China.","DOI":"10.1109\/ICAICE51518.2020.00102"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Pathania, N. (2017). Learning Continuous Integration with Jenkins: A Beginner\u2019s Guide to Implementing Continuous Integration and Continuous Delivery Using Jenkins 2, Packt Publishing Ltd.","DOI":"10.1007\/978-1-4842-2913-2_8"},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Ding, K., Li, J., and Liu, H. (2019, January 11\u201315). Interactive anomaly detection on attributed networks. Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, New York, NY, USA.","DOI":"10.1145\/3289600.3290964"},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Baier, L., K\u00fchl, N., and Satzger, G. (2019, January 8\u201311). How to Cope with Change? Preserving Validity of Predictive Services over Time. Proceedings of the Hawaii International Conference on System Sciences (HICSS-52), Wailea, HI, USA. University of Hawai\u2019i at Manoa\/AIS.","DOI":"10.24251\/HICSS.2019.133"},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Symeonidis, G., Nerantzis, E., Kazakis, A., and Papakostas, G.A. (2022, January 26\u201329). MLOps-definitions, tools and challenges. Proceedings of the 2022 IEEE 12th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA.","DOI":"10.1109\/CCWC54503.2022.9720902"},{"key":"ref_97","first-page":"19","article-title":"Demystifying mlops for continuous delivery of the product","volume":"5","author":"Gujjar","year":"2022","journal-title":"Asian J. Adv. Res."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/MCS.2020.3019151","article-title":"Human trust-based feedback control: Dynamically varying automation transparency to optimize human-machine interactions","volume":"40","author":"Akash","year":"2020","journal-title":"IEEE Control Syst. Mag."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"1082","DOI":"10.1080\/23744731.2020.1757327","article-title":"Chiller fault detection and diagnosis by knowledge transfer based on adaptive imbalanced processing","volume":"26","author":"Fan","year":"2020","journal-title":"Sci. Technol. Built Environ."},{"key":"ref_100","unstructured":"Liao, Q.V., and Varshney, K.R. (2021). Human-centered explainable ai (xai): From algorithms to user experiences. arXiv."},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Drozdal, J., Weisz, J., Wang, D., Dass, G., Yao, B., Zhao, C., Muller, M., Ju, L., and Su, H. (2020, January 18\u201321). Trust in AutoML: Exploring information needs for establishing trust in automated machine learning systems. Proceedings of the 25th International Conference on Intelligent User Interfaces, Greenville, SC, USA.","DOI":"10.1145\/3377325.3377501"},{"key":"ref_102","doi-asserted-by":"crossref","unstructured":"Ozsoy, M.G., and Polat, F. (2013, January 25\u201328). Trust based recommendation systems. Proceedings of the 2013 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining, New York, NY, USA.","DOI":"10.1145\/2492517.2500276"},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.1016\/j.promfg.2017.07.227","article-title":"Legend and future horizon of lean concept and technology","volume":"11","author":"Katayama","year":"2017","journal-title":"Procedia Manuf."},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Lima, A., Rossi, L., and Musolesi, M. (2014, January 1\u20134). Coding together at scale: GitHub as a collaborative social network. Proceedings of the International AAAI Conference on Web and Social Media, Ann Arbor, MI, USA.","DOI":"10.1609\/icwsm.v8i1.14552"},{"key":"ref_105","unstructured":"(2024, September 11). Directorate-General for Communications Networks, Content and Technology, European Commission. European Approach to Artificial Intelligence. Available online: https:\/\/digital-strategy.ec.europa.eu\/en\/policies\/european-approach-artificial-intelligence."},{"key":"ref_106","unstructured":"Burns, B., Beda, J., Hightower, K., and Evenson, L. (2022). Kubernetes: Up and Running, O\u2019Reilly Media, Inc."},{"key":"ref_107","unstructured":"Butcher, M., Farina, M., and Dolitsky, J. (2021). Learning Helm, O\u2019Reilly Media."},{"key":"ref_108","first-page":"66121","article-title":"Condition monitoring of hydraulic systems Data Set","volume":"46","author":"Helwig","year":"2018","journal-title":"Uci Mach. Learn. Repos."},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Helwig, N. (2015, January 19\u201321). Detecting and Compensating Sensor Faults in a Hydraulic Condition Monitoring System. Proceedings of the SENSOR 2015\u201417th International Conference on Sensors and Measurement Technology, Nuremberg, Germany. oral presentation D8.1.","DOI":"10.5162\/sensor2015\/D8.1"},{"key":"ref_110","unstructured":"Malhotra, P., Vig, L., Shroff, G., and Agarwal, P. (2015, January 22\u201324). Long Short Term Memory Networks for Anomaly Detection in Time Series. Proceedings of the ESANN, Bruges, Belgium."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"1679","DOI":"10.1109\/TIM.2018.2800978","article-title":"Early fault detection approach with deep architectures","volume":"67","author":"Lu","year":"2018","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"e3006","DOI":"10.1002\/cem.3006","article-title":"Understanding the importance of process alarms based on the analysis of deep recurrent neural networks trained for fault isolation","volume":"32","author":"Dorgo","year":"2018","journal-title":"J. Chemom."},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"107299","DOI":"10.1016\/j.sigpro.2019.107299","article-title":"Selective review of offline change point detection methods","volume":"167","author":"Truong","year":"2020","journal-title":"Signal Process."},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"1504","DOI":"10.21105\/joss.01504","article-title":"STUMPY: A Powerful and Scalable Python Library for Time Series Data Mining","volume":"4","author":"Law","year":"2019","journal-title":"J. Open Source Softw."},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"111181","DOI":"10.1016\/j.rse.2019.04.034","article-title":"Detecting change-point, trend, and seasonality in satellite time series data to track abrupt changes and nonlinear dynamics: A Bayesian ensemble algorithm","volume":"232","author":"Zhao","year":"2019","journal-title":"Remote. Sens. Environ."},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"2404","DOI":"10.21105\/joss.02404","article-title":"seg1d: A Python package for Automated segmentation of one-dimensional (1D) data","volume":"5","author":"Schwartz","year":"2020","journal-title":"J. Open Source Softw."},{"key":"ref_117","unstructured":"Truong, C., Oudre, L., and Vayatis, N. (2018). ruptures: Change point detection in Python. arXiv."},{"key":"ref_118","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1111\/ecog.02881","article-title":"Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure","volume":"40","author":"Roberts","year":"2017","journal-title":"Ecography"},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"100378","DOI":"10.1016\/j.cosrev.2021.100378","article-title":"Conceptual and empirical comparison of dimensionality reduction algorithms (pca, kpca, lda, mds, svd, lle, isomap, le, ica, t-sne)","volume":"40","author":"Anowar","year":"2021","journal-title":"Comput. Sci. Rev."},{"key":"ref_121","unstructured":"Chollet, F. (2024, September 11). Keras. Available online: https:\/\/github.com\/fchollet\/keras."},{"key":"ref_122","doi-asserted-by":"crossref","unstructured":"Holzinger, A. (2021, January 13\u201317). The next frontier: AI we can really trust. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Virtual.","DOI":"10.1007\/978-3-030-93736-2_33"},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.inffus.2021.10.007","article-title":"Information fusion as an integrative cross-cutting enabler to achieve robust, explainable, and trustworthy medical artificial intelligence","volume":"79","author":"Holzinger","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_124","doi-asserted-by":"crossref","unstructured":"Saxena, D., Lamest, M., and Bansal, V. (2021). Responsible machine learning for ethical artificial intelligence in business and industry. Handbook of Research on Applied Data Science and Artificial Intelligence in Business and Industry, IGI Global.","DOI":"10.4018\/978-1-7998-6985-6.ch030"},{"key":"ref_125","first-page":"97","article-title":"A Systematic Analysis of MLOps Features and Platforms","volume":"10","author":"Faubel","year":"2024","journal-title":"WiPiEC J.-Work. Prog. Embed. Comput. J."},{"key":"ref_126","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s40708-016-0042-6","article-title":"Interactive machine learning for health informatics: When do we need the human-in-the-loop?","volume":"3","author":"Holzinger","year":"2016","journal-title":"Brain Inform."},{"key":"ref_127","unstructured":"Holzinger, A., Plass, M., Holzinger, K., Cri\u015fan, G.C., Pintea, C.M., and Palade, V. (September, January 31). Towards interactive Machine Learning (iML): Applying ant colony algorithms to solve the traveling salesman problem with the human-in-the-loop approach. Proceedings of the Availability, Reliability, and Security in Information Systems: IFIP WG 8.4, 8.9, TC 5 International Cross-Domain Conference, CD-ARES 2016, and Workshop on Privacy Aware Machine Learning for Health Data Science, PAML 2016, Salzburg, Austria. Proceedings."},{"key":"ref_128","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.4103\/ijo.IJO_2583_21","article-title":"Utilizing human intelligence in artificial intelligence for detecting glaucomatous fundus images using human-in-the-loop machine learning","volume":"70","author":"Ramesh","year":"2022","journal-title":"Indian J. Ophthalmol."},{"key":"ref_129","unstructured":"Yang, Y., Kandogan, E., Li, Y., Sen, P., and Lasecki, W.S. (2019, January 19\u201320). A Study on Interaction in Human-in-the-Loop Machine Learning for Text Analytics. Proceedings of the IUI Workshops, Los Angeles, CA, USA."},{"key":"ref_130","first-page":"37","article-title":"Human-in-the-loop Techniques in Machine Learning","volume":"43","author":"Chai","year":"2020","journal-title":"IEEE Data Eng. Bull."},{"key":"ref_131","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/j.future.2022.05.014","article-title":"A survey of human-in-the-loop for machine learning","volume":"135","author":"Wu","year":"2022","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_132","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1080\/14702436.2022.2102486","article-title":"Automating the OODA loop in the age of intelligent machines: Reaffirming the role of humans in command-and-control decision-making in the digital age","volume":"23","author":"Johnson","year":"2022","journal-title":"Def. Stud."},{"key":"ref_133","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.futures.2015.07.009","article-title":"Taking superintelligence seriously: Superintelligence: Paths, dangers, strategies by Nick Bostrom (Oxford University Press, 2014)","volume":"72","author":"Brundage","year":"2015","journal-title":"Futures"},{"key":"ref_134","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1145\/1656274.1656280","article-title":"KNIME-the Konstanz information miner: Version 2.0 and beyond","volume":"11","author":"Berthold","year":"2009","journal-title":"ACM SIGKDD Explor. Newsl."},{"key":"ref_135","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1007\/s10822-012-9577-7","article-title":"Scientific workflow systems: Pipeline Pilot and KNIME","volume":"26","author":"Warr","year":"2012","journal-title":"J. Comput.-Aided Mol. Des."},{"key":"ref_136","doi-asserted-by":"crossref","unstructured":"Raouf, I., Kumar, P., Lee, H., and Kim, H.S. (2023). Transfer Learning-Based Intelligent Fault Detection Approach for the Industrial Robotic System. Mathematics, 11.","DOI":"10.3390\/math11040945"},{"key":"ref_137","doi-asserted-by":"crossref","first-page":"107467","DOI":"10.1016\/j.compchemeng.2021.107467","article-title":"Explainability: Relevance based dynamic deep learning algorithm for fault detection and diagnosis in chemical processes","volume":"154","author":"Agarwal","year":"2021","journal-title":"Comput. Chem. Eng."},{"key":"ref_138","doi-asserted-by":"crossref","unstructured":"Madhikermi, M., Malhi, A.K., and Fr\u00e4mling, K. (2019, January 13\u201314). Explainable artificial intelligence based heat recycler fault detection in air handling unit. Proceedings of the Explainable, Transparent Autonomous Agents and Multi-Agent Systems: First International Workshop, EXTRAAMAS 2019, Montreal, QC, Canada. Revised Selected Papers 1.","DOI":"10.1007\/978-3-030-30391-4_7"},{"key":"ref_139","unstructured":"Ali, M. (2024, September 11). PyCaret: An Open Source, Low-Code Machine Learning Library in Python. PyCaret Version 1.0. Available online: https:\/\/github.com\/pycaret\/pycaret."},{"key":"ref_140","doi-asserted-by":"crossref","first-page":"117373","DOI":"10.1016\/j.ces.2021.117373","article-title":"An explainable artificial intelligence based approach for interpretation of fault classification results from deep neural networks","volume":"250","author":"Bhakte","year":"2022","journal-title":"Chem. Eng. Sci."},{"key":"ref_141","unstructured":"Baier, L., Schl\u00f6r, T., Sch\u00f6ffer, J., and K\u00fchl, N. (2021). Detecting concept drift with neural network model uncertainty. arXiv."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/13\/10\/252\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:09:12Z","timestamp":1760112552000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/13\/10\/252"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,2]]},"references-count":141,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["computers13100252"],"URL":"https:\/\/doi.org\/10.3390\/computers13100252","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,2]]}}}