{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T15:29:53Z","timestamp":1780500593975,"version":"3.54.1"},"reference-count":43,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2023,9,16]],"date-time":"2023-09-16T00:00:00Z","timestamp":1694822400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100020718","name":"Universidad Aut\u00f3noma de Tamaulipas (M\u00e9xico)","doi-asserted-by":"publisher","award":["PEI2018-UAT-2022"],"award-info":[{"award-number":["PEI2018-UAT-2022"]}],"id":[{"id":"10.13039\/501100020718","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020718","name":"Universidad Aut\u00f3noma de Tamaulipas (M\u00e9xico)","doi-asserted-by":"publisher","award":["UAT\/SIP\/INV\/2023\/043"],"award-info":[{"award-number":["UAT\/SIP\/INV\/2023\/043"]}],"id":[{"id":"10.13039\/501100020718","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020718","name":"Universidad Aut\u00f3noma de Tamaulipas (M\u00e9xico)","doi-asserted-by":"publisher","award":["748457"],"award-info":[{"award-number":["748457"]}],"id":[{"id":"10.13039\/501100020718","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Consejo Nacional de Ciencia y Tecnolog\u00eda (CONACYT) of M\u00e9xico","award":["PEI2018-UAT-2022"],"award-info":[{"award-number":["PEI2018-UAT-2022"]}]},{"name":"Consejo Nacional de Ciencia y Tecnolog\u00eda (CONACYT) of M\u00e9xico","award":["UAT\/SIP\/INV\/2023\/043"],"award-info":[{"award-number":["UAT\/SIP\/INV\/2023\/043"]}]},{"name":"Consejo Nacional de Ciencia y Tecnolog\u00eda (CONACYT) of M\u00e9xico","award":["748457"],"award-info":[{"award-number":["748457"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>In this paper, we propose a deep learning-based approach to predict the next event in hospital organizational process models following the guidance of predictive process mining. This method provides value for the planning and allocating of resources since each trace linked to a case shows the consecutive execution of events in a healthcare process. The predictive model is based on a long short-term memory (LSTM) neural network that achieves high accuracy in the training and testing stages. In addition, a framework to implement the LSTM neural network is proposed, comprising stages from the preprocessing of the raw data to selecting the best LSTM model. The effectiveness of the prediction method is evaluated through four real-life event logs that contain historical information on the execution of the processes of patient transfer orders between hospitals, sepsis care cases, billing of medical services, and patient care management. In the test stage, the LSTM model reached values of 0.98, 0.91, 0.85, and 0.81 in the accuracy metric, and in the evaluation of the prediction of the next event using the 10-fold cross-validation technique, values of 0.94, 0.88, 0.84, and 0.81 were obtained for the four previously mentioned event logs. In addition, the performance of the LSTM prediction model was evaluated with the precision, recall, F1-score, and area under the receiver operating characteristic (ROC) curve (AUC) metrics, obtaining high scores very close to 1. The experimental results suggest that the proposed method achieves acceptable measures in predicting the next event regardless of whether an input event or a set of input events is used.<\/jats:p>","DOI":"10.3390\/info14090508","type":"journal-article","created":{"date-parts":[[2023,9,17]],"date-time":"2023-09-17T23:32:27Z","timestamp":1694993547000},"page":"508","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A Deep Learning Approach for Predictive Healthcare Process Monitoring"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4868-3210","authenticated-orcid":false,"given":"Ulises Manuel","family":"Ramirez-Alcocer","sequence":"first","affiliation":[{"name":"Multidisciplinary Academic Unit Reynosa-Rodhe, Autonomous University of Tamaulipas, Reynosa 88779, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0303-6303","authenticated-orcid":false,"given":"Edgar","family":"Tello-Leal","sequence":"additional","affiliation":[{"name":"Faculty of Engineering and Science, Autonomous University of Tamaulipas, Victoria 87000, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3007-9365","authenticated-orcid":false,"given":"Gerardo","family":"Romero","sequence":"additional","affiliation":[{"name":"Multidisciplinary Academic Unit Reynosa-Rodhe, Autonomous University of Tamaulipas, Reynosa 88779, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8196-6496","authenticated-orcid":false,"given":"B\u00e1rbara A.","family":"Mac\u00edas-Hern\u00e1ndez","sequence":"additional","affiliation":[{"name":"Faculty of Engineering and Science, Autonomous University of Tamaulipas, Victoria 87000, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Consoli, S., Reforgiato Recupero, D., and Petkovi\u0107, M. (2019). Data Science for Healthcare: Methodologies and Applications, Springer International Publishing.","DOI":"10.1007\/978-3-030-05249-2"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"103244","DOI":"10.1016\/j.jnca.2021.103244","article-title":"Towards development of IoT-ML driven healthcare systems: A survey","volume":"196","author":"Sworna","year":"2021","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/s40537-018-0167-y","article-title":"Knowledge discovery from a more than a decade studies on healthcare Big Data systems: A scientometrics study","volume":"6","author":"Radfar","year":"2019","journal-title":"J. Big Data"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.jbi.2016.09.011","article-title":"Health Information Exchange (HIE): A literature review, assimilation pattern and a proposed classification for a new policy approach","volume":"64","author":"Esmaeilzadeh","year":"2016","journal-title":"J. Biomed. Inform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1259","DOI":"10.1093\/jamia\/ocy035","article-title":"The benefits of health information exchange: An updated systematic review","volume":"25","author":"Menachemi","year":"2018","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_6","unstructured":"Health Level Seven International (2023, August 01). HL7 version 2.x (V2) Messaging Standard. Available online: https:\/\/www.hl7.org\/implement\/standards\/product_brief.cfm?product_id=185."},{"key":"ref_7","unstructured":"Health Level Seven International CDA (2023, August 01). Clinical Document Architecture (CDA) Standard. Available online: https:\/\/www.hl7.org\/implement\/standards\/product_brief.cfm?product_id=7."},{"key":"ref_8","unstructured":"Health Level Seven International FHIR (2023, August 01). Introducing HL7 Fast Healthcare Interoperability Resources (FHIR) Specification 4.00. Available online: http:\/\/www.hl7.org\/implement\/standards\/fhir\/summary.html."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"103979","DOI":"10.1016\/j.jbi.2021.103979","article-title":"Multi-level process mining methodology for exploring disease-specific care processes","volume":"125","year":"2022","journal-title":"J. Biomed. Inform."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1016\/j.jbi.2016.04.007","article-title":"Process mining in healthcare: A literature review","volume":"61","author":"Rojas","year":"2016","journal-title":"J. Biomed. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.eswa.2019.05.003","article-title":"Process mining techniques and applications\u2014A systematic mapping study","volume":"133","author":"Meincheim","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Dumas, M., Rosa, M.L., Mendling, J., and Reijers, H.A. (2018). Fundamentals of Business Process Management, Springer.","DOI":"10.1007\/978-3-662-56509-4"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.is.2011.01.003","article-title":"Business process analysis in healthcare environments: A methodology based on process mining","volume":"37","author":"Rebuge","year":"2012","journal-title":"Inf. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"101962","DOI":"10.1016\/j.artmed.2020.101962","article-title":"Recommendations for enhancing the usability and understandability of process mining in healthcare","volume":"109","author":"Martin","year":"2020","journal-title":"Artif. Intell. Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"186012","DOI":"10.1109\/ACCESS.2020.3030318","article-title":"Supporting Governance in Healthcare Through Process Mining: A Case Study","volume":"8","author":"Agostinelli","year":"2020","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"24543","DOI":"10.1109\/ACCESS.2018.2831244","article-title":"Systematic Mapping of Process Mining Studies in Healthcare","volume":"6","author":"Erdogan","year":"2018","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Fahland, D., Ghidini, C., Becker, J., and Dumas, M. (2020). Business Process Management: 18th International Conference (BPM 2020), Seville, Spain, 13\u201318 September 2020, Springer International Publishing.","DOI":"10.1007\/978-3-030-58666-9"},{"key":"ref_18","unstructured":"van Andel, V., Beerepoot, I., Lu, X., van de Weerd, I., and Reijers, H.A. (2021, January 14\u201316). DEUCE: A Methodology for Detecting Unauthorized Access of Electronic Health Records Using Process Mining. Proceedings of the 29th European Conference on Information Systems (ECIS 2021), Marrakech, Morocco."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Van der Aalst, W. (2016). Process Mining: Data Science in Action, Springer. [2nd ed.].","DOI":"10.1007\/978-3-662-49851-4"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"9236","DOI":"10.1016\/j.eswa.2015.07.040","article-title":"Declarative process mining in healthcare","volume":"42","author":"Rovani","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.dss.2017.04.003","article-title":"Predicting process behaviour using deep learning","volume":"100","author":"Evermann","year":"2017","journal-title":"Decis. Support Syst."},{"key":"ref_22","first-page":"1009","article-title":"Comprehensible Predictive Models for Business Processes","volume":"40","author":"Breuker","year":"2016","journal-title":"MIS Q. Support Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Weske, M., Montali, M., Weber, I., and vom Brocke, J. (2018). Business Process Management: 16th International Conference (BPM 2018), Sydney, NSW, Australia, 9\u201314 September 2018, Springer International Publishing.","DOI":"10.1007\/978-3-319-98648-7"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hassanien, A.E., Azar, A.T., Gaber, T., Bhatnagar, R., and Tolba, F.M. (2019, January 28\u201330). Deep Learning for Predictive Analytics in Healthcare. Proceedings of the International Conference on Advanced Machine Learning Technologies and Applications (AMLTA2019), Cairo, Egypt.","DOI":"10.1007\/978-3-030-14118-9"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jarke, M., Mylopoulos, J., Quix, C., Rolland, C., Manolopoulos, Y., Mouratidis, H., and Horkoff, J. (2014, January 16\u201320). Predictive Monitoring of Business Processes. Proceedings of the Advanced Information Systems Engineering Conference, Thessaloniki, Greece.","DOI":"10.1007\/978-3-319-07881-6"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1109\/JSTARS.2022.3225150","article-title":"Improved Swin Transformer-Based Semantic Segmentation of Postearthquake Dense Buildings in Urban Areas Using Remote Sensing Images","volume":"16","author":"Cui","year":"2023","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e2667","DOI":"10.1002\/stc.2667","article-title":"Relationship modeling between vehicle-induced girder vertical deflection and cable tension by BiLSTM using field monitoring data of a cable-stayed bridge","volume":"28","author":"Tian","year":"2021","journal-title":"Struct. Control Health Monit."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.neucom.2018.03.020","article-title":"Novel architecture for long short-term memory used in question classification","volume":"299","author":"Xia","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_29","unstructured":"eXtensible Event Stream (XES) (2023, August 01). 1849\u20132016\u2014IEEE Standard for eXtensible Event Stream (XES) for Achieving Interoperability in Event Logs and Event Streams. Available online: http:\/\/www.xes-standard.org\/."},{"key":"ref_30","unstructured":"Keras (2023, August 01). Keras: The Python Deep Learning API. Available online: https:\/\/keras.io\/."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.1109\/TII.2016.2587765","article-title":"A Technological Solution to Provide Integrated and Process-Oriented Care Services in Healthcare Organizations","volume":"12","author":"Villarreal","year":"2016","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_32","unstructured":"Mannhardt, F. (2016). Sepsis Cases\u2014Event Log. Res. Data."},{"key":"ref_33","unstructured":"Mannhardt, F. (2017). Hospital Billing\u2014Event Log. Res. Data."},{"key":"ref_34","unstructured":"Augusto, A., Gill, A., Bork, D., Nurcan, S., Reinhartz-Berger, I., and Schmidt, R. (2022, January 6\u20137). A Technique for Collaboration Discovery. Proceedings of the 23rd International Conference (BPMDS 2022) and 27th International Conference (EMMSAD 2022), Leuven, Belgium."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.jbi.2017.04.001","article-title":"Predicting healthcare trajectories from medical records: A deep learning approach","volume":"69","author":"Pham","year":"2017","journal-title":"J. Biomed. Inform."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Baytas, I.M., Xiao, C., Zhang, X., Wang, F., Jain, A.K., and Zhou, J. (2017, January 13\u201317). Patient Subtyping via Time-Aware LSTM Networks. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD \u201917), Halifax, NS, Canada.","DOI":"10.1145\/3097983.3097997"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kaushik, S., Choudhury, A., Dasgupta, N., Natarajan, S., Pickett, L.A., and Dutt, V. (2017, January 14\u201315). Using LSTMs for Predicting Patient\u2019s Expenditure on Medications. Proceedings of the 2017 International Conference on Machine Learning and Data Science (MLDS), Noida, India.","DOI":"10.1109\/MLDS.2017.9"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/s10916-019-1243-3","article-title":"LSTM Model for Prediction of Heart Failure in Big Data","volume":"43","author":"Maragatham","year":"2019","journal-title":"J. Med. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s10844-022-00775-9","article-title":"Performance-preserving event log sampling for predictive monitoring","volume":"61","author":"Vazifehdoostirani","year":"2023","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Del R\u00edo Ortega, A., Leopold, H., and Santoro, F.M. (2020, January 13\u201318). Process Outcome Prediction: CNN vs. LSTM (with Attention). Proceedings of the Business Process Management (BPM 2020) International Workshops, Seville, Spain.","DOI":"10.1007\/978-3-030-66498-5"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.eswa.2019.04.016","article-title":"An empirical comparison of classification techniques for next event prediction using business process event logs","volume":"129","author":"Tama","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ni, W., Zhao, G., Liu, T., Zeng, Q., and Xu, X. (2023). Predictive Business Process Monitoring Approach Based on Hierarchical Transformer. Electronics, 12.","DOI":"10.3390\/electronics12061273"},{"key":"ref_43","unstructured":"Bukhsh, Z.A., Saeed, A., and Dijkman, R.M. (2021). ProcessTransformer: Predictive Business Process Monitoring with Transformer Network. arXiv."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/9\/508\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:52:10Z","timestamp":1760129530000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/9\/508"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,16]]},"references-count":43,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["info14090508"],"URL":"https:\/\/doi.org\/10.3390\/info14090508","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,16]]}}}