{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:52:45Z","timestamp":1760237565736,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,6,7]],"date-time":"2022-06-07T00:00:00Z","timestamp":1654560000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Queen\u2019s University Belfast, United Kingdom"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>As the world moves into the exciting age of Healthcare 4.0, it is essential that patients and clinicians have confidence and reassurance that the real-time clinical decision support systems being used throughout their care guarantee robustness and optimal quality of care. However, current systems involving autonomic behaviour and those with no prior clinical feedback, have generally to date had little focus on demonstrating robustness in the use of data and final output, thus generating a lack of confidence. This paper wishes to address this challenge by introducing a new process mining approach based on a statistically robust methodology that relies on the utilisation of conditional survival models for the purpose of evaluating the performance of Healthcare 4.0 systems and the quality of the care provided. Its effectiveness is demonstrated by analysing the performance of a clinical decision support system operating in an intensive care setting with the goal to monitor ventilated patients in real-time and to notify clinicians if the patient is predicted at risk of receiving injurious mechanical ventilation. Additionally, we will also demonstrate how the same metrics can be used for evaluating the patient quality of care. The proposed methodology can be used to analyse the performance of any Healthcare 4.0 system and the quality of care provided to the patient.<\/jats:p>","DOI":"10.3390\/a15060196","type":"journal-article","created":{"date-parts":[[2022,6,9]],"date-time":"2022-06-09T09:59:38Z","timestamp":1654768778000},"page":"196","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Process Mining the Performance of a Real-Time Healthcare 4.0 Systems Using Conditional Survival Models"],"prefix":"10.3390","volume":"15","author":[{"given":"Adele H.","family":"Marshall","sequence":"first","affiliation":[{"name":"School of Mathematics and Physics, Queen\u2019s University Belfast, University Road, Belfast BT7 1NN, Northern Ireland, UK"},{"name":"Joint Research Centre in AI for Health and Wellness, Faculty of Business and IT, Ontario Tech University, 2000 Simcoe Street North, Oshawa, ON L1G 0C5, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aleksandar","family":"Novakovic","sequence":"additional","affiliation":[{"name":"School of Mathematics and Physics, Queen\u2019s University Belfast, University Road, Belfast BT7 1NN, Northern Ireland, UK"},{"name":"Joint Research Centre in AI for Health and Wellness, Faculty of Business and IT, Ontario Tech University, 2000 Simcoe Street North, Oshawa, ON L1G 0C5, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1016\/j.jbi.2016.04.007","article-title":"Process mining in healthcare: A literature review","volume":"61","author":"Rojas","year":"2016","journal-title":"J. Biomed. Inform."},{"key":"ref_2","unstructured":"Plathong, K., and Surakratanasakul, B. (September, January 31). A study of integration Internet of Things with health level 7 protocol for real-time healthcare monitoring by using cloud computing. Proceedings of the 10th Biomedical Engineering International Conference (BMEiCON), Hokkaido, Japan."},{"key":"ref_3","unstructured":"Health Level Seven International (2019, February 05). About HL7. Available online: https:\/\/bit.ly\/2tkavDk."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.knosys.2017.03.029","article-title":"A temporal model in electronic health record search","volume":"126","author":"Zhang","year":"2017","journal-title":"Knowl.-Based Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.knosys.2015.02.004","article-title":"An integrated framework for securing semi-structural health records","volume":"79","author":"Amato","year":"2015","journal-title":"Knowl.-Based Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"105877","DOI":"10.1016\/j.knosys.2020.105877","article-title":"Introducing the DM-P approach for analysing the performances of real-time clinical decision support systems","volume":"198","author":"Novakovic","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1186\/s13054-015-0801-4","article-title":"State of the art review: The data revolution in critical care","volume":"19","author":"Ghassemi","year":"2015","journal-title":"Crit. Care"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2126","DOI":"10.1056\/NEJMra1208707","article-title":"Ventilator-Induced Lung Injury","volume":"369","author":"Slutsky","year":"2013","journal-title":"N. Engl. J. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"R1","DOI":"10.1186\/cc8230","article-title":"Ventilation with lower tidal volumes as compared with conventional tidal volumes for patients without acute lung injury: A preventive randomized controlled trial","volume":"14","author":"Determann","year":"2010","journal-title":"Crit. Care"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1056\/NEJM199802053380602","article-title":"Effect of a protective-ventilation strategy on mortality in the acute respiratory distress syndrome","volume":"338","author":"Amato","year":"1998","journal-title":"N. Engl. J. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"566","DOI":"10.7326\/0003-4819-151-8-200910200-00011","article-title":"Meta-analysis: Ventilation strategies and outcomes of the acute respiratory distress syndrome and acute lung injury","volume":"151","author":"Putensen","year":"2009","journal-title":"Ann. Intern. Med."},{"key":"ref_12","unstructured":"Neto, A.S. (2017). Lung-Protective Ventilation in Intensive Care Unit and Operation Room: Tidal Volume Size, Level of Positive End-Expiratory Pressure and Driving Pressure, Faculty of Medicine, University of Amsterdam. Available online: https:\/\/dare.uva.nl\/search?identifier=35660734-9d32-4127-8608-68207d9d5d28."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"323.e1","DOI":"10.1016\/j.jcrc.2011.06.015","article-title":"Risk Factors for Underuse of Lung Protective Ventilation in Acute Lung Injury","volume":"27","author":"Walkey","year":"2012","journal-title":"Crit. Care"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1215","DOI":"10.1164\/rccm.200709-1424OC","article-title":"Effects of a clinical trial on mechanical ventilation practices in patients with acute lung injury","volume":"177","author":"Checkley","year":"2008","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1097\/01.CCM.0000198328.83571.4A","article-title":"Underuse of lung protective ventilation: Analysis of potential factors to explain physician behavior","volume":"34","author":"Kalhan","year":"2006","journal-title":"Crit. Care Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.compbiomed.2018.05.028","article-title":"Expediting assessments of database performance for streams of respiratory parameters","volume":"100","author":"Gillan","year":"2018","journal-title":"Comput. Biol. Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1097\/CCM.0b013e3181fa4184","article-title":"Limiting ventilator-induced lung injury through individual electronic medical record surveillance","volume":"39","author":"Herasevich","year":"2011","journal-title":"Crit. Care Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e010129","DOI":"10.1136\/bmjopen-2015-010129","article-title":"Increasing compliance with low tidal volume ventilation in the ICU with two nudge-based interventions: Evaluation through intervention time-series analysis","volume":"6","author":"Bourdeaux","year":"2016","journal-title":"BMJ Open"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Marshall, A.H., and Novakovic, A. (2019, January 5\u20137). Analysing the performance of a real-time Healthcare 4.0 system using shared frailty time to event models. Proceedings of the 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS), Cordoba, Spain.","DOI":"10.1109\/CBMS.2019.00129"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1111\/insr.12214","article-title":"A Tutorial on Multilevel Survival Analysis: Methods, Models, Applications","volume":"85","author":"Austin","year":"2017","journal-title":"Int. Stat. Rev."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1080\/01621459.1958.10501452","article-title":"Nonparametric estimation from incomplete observations","volume":"53","author":"Kaplan","year":"1958","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bustamante, A.F., Wood, C.L., Tran, Z.V., and Moine, P. (2011). Intraoperative ventilation: Incidence and risk factors for receiving large tidal volumes during general anesthesia. BMC Anesthesiol., 11.","DOI":"10.1186\/1471-2253-11-22"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1530","DOI":"10.1158\/1078-0432.CCR-14-2154","article-title":"Conditional Survival: A Useful Concept to Provide Information on How Prognosis Evolves over Time","volume":"21","author":"Hieke","year":"2015","journal-title":"Clin. Cancer Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1080\/10543406.2017.1405012","article-title":"Statistical Methods for Conditional Survival Analysis","volume":"28","author":"Jung","year":"2018","journal-title":"J. Biopharm. Stat."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3589","DOI":"10.1002\/cncr.28273","article-title":"Dynamic Prognostication Using Conditional Survival Estimates","volume":"119","author":"Zabor","year":"2013","journal-title":"Cancer"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1002\/(SICI)1097-0142(19990115)85:2<485::AID-CNCR29>3.0.CO;2-L","article-title":"The conditional probability of survival of patients with primary malignant brain tumors","volume":"85","author":"Davis","year":"1999","journal-title":"Cancer"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1080\/03610918.2011.560732","article-title":"Confidence Intervals for Survival Probabilities: A Comparison Study","volume":"40","author":"Yuan","year":"2011","journal-title":"Commun. Stat. Simul. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4397","DOI":"10.1158\/1078-0432.CCR-11-2663","article-title":"Conditional Survival after Hepatic Resection for Hepatocellular Carcinoma in Cirrhotic Patients","volume":"18","author":"Cucchetti","year":"2012","journal-title":"Clin. Cancer Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1016\/0895-4356(90)90093-5","article-title":"Indexes and boundaries for \u201cquantitative significance\u201d in statistical decisions","volume":"43","author":"Burnard","year":"1990","journal-title":"J. Clin. Epidimiol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1097\/SLA.0000000000001527","article-title":"Curative Surgical Resection of Adrenocortical Carcinoma: Determining Long-term Outcome Based on Conditional Disease-free Probability","volume":"265","author":"Kim","year":"2017","journal-title":"Ann. Surg."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"591","DOI":"10.3389\/fonc.2019.00591","article-title":"Causes of Death and Conditional Survival of Renal Cell Carcinoma","volume":"9","author":"Shao","year":"2019","journal-title":"Front. Oncol."},{"key":"ref_32","unstructured":"R Core Team (2018). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_33","unstructured":"Therneau, T.M. (2022, April 01). A Package for Survival Analysis in S. Available online: https:\/\/CRAN.R-project.org\/package=survival."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Thernau, T.M., and Grambsch, P.M. (2000). Modeling Survival Data: Extending the Cox Model, Springer.","DOI":"10.1007\/978-1-4757-3294-8"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"12171","DOI":"10.1038\/srep12171","article-title":"Prognostic factors for conditional survival in patients with muscle-invasive urothelial carcinoma of the bladder treated with radical cystectomy","volume":"5","author":"Kang","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1001\/jamasurg.2014.2881","article-title":"Conditional Disease-Free Survival After Surgical Resection of Gastrointestinal Stromal Tumors: A Multi-institutional Analysis of 502 Patients","volume":"150","author":"Bischof","year":"2015","journal-title":"JAMA Surg."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Multidisciplinary Larynx Cancer Working Group, Sheu, T., Vock, D.M., Mohamed, A.S.R., Gross, N., Mulcahy, C., Zafereo, M., Gunn, G.B., Garden, A., and Sevak, P. (2017). Conditional Survival Analysis of Patients with Locally Advanced Laryngeal Cancer: Construction of a Dynamic Risk Model and Clinical Nomogram. Sci. Rep., 7, 43928.","DOI":"10.1038\/srep43928"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1016\/j.juro.2018.06.030","article-title":"Changeable Conditional Survival Rates and Associated Prognosticators in Patients with Metastatic Renal Cell Carcinoma Receiving First Line Targeted Therapy","volume":"200","author":"Kang","year":"2018","journal-title":"J. Urol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"e190194","DOI":"10.1001\/jamanetworkopen.2019.0194","article-title":"Risk-Dependent Conditional Survival and Failure Hazard After Radiotherapy for Early-Stage Extranodal Natural Killer\/T-Cell Lymphoma","volume":"2","author":"Liu","year":"2019","journal-title":"JAMA Netw. Open"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"6566","DOI":"10.1002\/cam4.2502","article-title":"Changes in conditional net survival and dynamic prognostic factors in patients with newly diagnosed metastatic prostate cancer initially treated with androgen deprivation therapy","volume":"8","author":"Narita","year":"2019","journal-title":"Cancer Med."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"131608","DOI":"10.1016\/j.snb.2022.131608","article-title":"Ultra-sensitive DNAzyme-based optofluidic biosensor with liquid crystal-Au nanoparticle hybrid amplification for molecular detection","volume":"359","author":"Luo","year":"2022","journal-title":"Sens. Actuators B Chem."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zahed, M.A., Yoon, H., Sharifuzzaman, M., Yoon, S.H., Kim, D.K., Do Shin, Y., Asaduzzaman, M., and Park, J.Y. (2022, January 9\u201313). Nanoporous Carbon-Based Wearable Hybrid Biosensing Patch for Real-Time and in Vitro Healthcare Monitoring. Proceedings of the 2022 IEEE 35th International Conference on Micro Electro Mechanical Systems Conference (MEMS), Tokyo, Japan.","DOI":"10.1109\/MEMS51670.2022.9699439"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/6\/196\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:25:23Z","timestamp":1760138723000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/6\/196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,7]]},"references-count":42,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["a15060196"],"URL":"https:\/\/doi.org\/10.3390\/a15060196","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2022,6,7]]}}}