{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T21:25:02Z","timestamp":1772745902227,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T00:00:00Z","timestamp":1651190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>An acknowledgment of feedback is extremely helpful in medical training, as it may improve student skill development and provide accurate, unbiased feedback. Data are generated by hundreds of complicated and variable processes within healthcare including treatments, lab results, and internal logistics. Additionally, it is crucial to analyze medical training data to improve operational processes and eliminate bottlenecks. Therefore, the use of process mining (PM) along with conformance checking allows healthcare trainees to gain knowledge about instructor training. Researchers find it challenging to analyze the conformance between observations from event logs and predictions from models with artifacts from the training process. To address this conformance check, we modeled student activities and performance patterns in the training of Central Venous Catheter (CVC) installation. This work aims to provide medical trainees with activities with easy and interpretable outcomes. The two independent techniques for mining process models were fuzzy (i.e., for visualizing major activities) and inductive (i.e., for conformance checking at low threshold noise levels). A set of 20 discrete activity traces was used to validate conformance checks. Results show that 97.8% of the fitness of the model and the movement of the model occurred among the nine activities.<\/jats:p>","DOI":"10.3390\/a15050153","type":"journal-article","created":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T16:49:57Z","timestamp":1651250997000},"page":"153","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Process Mining in Clinical Practice: Model Evaluations in the Central Venous Catheter Installation Training"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0603-2356","authenticated-orcid":false,"given":"Gopi","family":"Battineni","sequence":"first","affiliation":[{"name":"Clinical Research Center, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0818-306X","authenticated-orcid":false,"given":"Nalini","family":"Chintalapudi","sequence":"additional","affiliation":[{"name":"Informatics Center, School of Science and Technology, University of Camerino, 62032 Camerino, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7726-1725","authenticated-orcid":false,"given":"Gregory","family":"Zacharewicz","sequence":"additional","affiliation":[{"name":"Laboratoire des Sciences des Risques (LSR), Institut Mines-Telecom (IMT) Mines Ales, CEDEX, 30319 Al\u00e8s, France"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"244","DOI":"10.5858\/arpa.2018-0058-RA","article-title":"Giving and Receiving Effective Feedback: A Review Article and How-To Guide","volume":"143","author":"Jug","year":"2019","journal-title":"Arch. Pathol. Lab. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"754","DOI":"10.3109\/0142159X.2012.704438","article-title":"Developing research skills in medical students: AMEE Guide No. 69","volume":"34","author":"Laidlaw","year":"2012","journal-title":"Med. Teach."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"104296","DOI":"10.1016\/j.ijmedinf.2020.104296","article-title":"A meta-synthesis of competency standards suggest allied health are not preparing for a digital health future","volume":"144","author":"Dalton","year":"2020","journal-title":"Int. J. Med. Inform."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1016\/j.techfore.2016.09.006","article-title":"Strategy deployment in healthcare services: A case study approach","volume":"113","author":"Landry","year":"2016","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1097\/CCM.0b013e3182a667f0","article-title":"Central venous catheter placement by advanced practice nurses demonstrates low procedural complication and infection rates\u2013A report from 13 years of service*","volume":"42","author":"Alexandrou","year":"2014","journal-title":"Crit. Care Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1111\/j.1365-2923.2007.02821.x","article-title":"A systematic review of medical skills laboratory training: Where to from here?","volume":"41","author":"Lynagh","year":"2007","journal-title":"Med. Educ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/s10459-013-9462-8","article-title":"Feedback for simulation-based procedural skills training: A meta-analysis and critical narrative synthesis","volume":"19","author":"Hatala","year":"2014","journal-title":"Adv. Health Sci. Educ. Theory Pract."},{"key":"ref_8","first-page":"18","article-title":"Students Learning in a Skills Laboratory","volume":"29","author":"Strand","year":"2009","journal-title":"V\u00e5rd Nord."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"e765","DOI":"10.1136\/bmj.e765","article-title":"Effective teaching skills\u2014How to become a better medical educator","volume":"344","author":"Ralhan","year":"2012","journal-title":"BMJ"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"237","DOI":"10.2147\/AMEP.S295728","article-title":"Online Medical Education in India-Different Challenges and Probable Solutions in the Age of COVID-19","volume":"12","author":"Nimavat","year":"2021","journal-title":"Adv. Med. Educ. Pract."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.artmed.2010.12.003","article-title":"Modeling surgical processes: A four-level translational approach","volume":"51","author":"Neumuth","year":"2011","journal-title":"Artif. Intell. Med."},{"key":"ref_12","first-page":"23","article-title":"Modeling of processes with use of process mining techniques","volume":"2018","author":"Brzychczy","year":"2018","journal-title":"Sci. Pap. Silesian Univ. Technol. Organ. Manag. Ser."},{"key":"ref_13","first-page":"163","article-title":"Tailored Process Feedback Through Process Mining for Surgical Procedures in Medical Training: The Central Venous Catheter Case","volume":"342","author":"Lira","year":"2019","journal-title":"Lect. Notes Bus. Inf. Process."},{"key":"ref_14","unstructured":"Meyer, J., Reimold, J., and Wehmschulte, C. (2022, February 28). Conformance Checking Challenge 2019: Analysis of Central Venous Catheter Installation with MEHRWERK ProcessMining. Available online: https:\/\/icpmconference.org\/2019\/wp-content\/uploads\/sites\/6\/2019\/09\/ICPM2019_paper_84.pdf."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lira, R., Salas-Morales, J., Leiva, L., de la Fuente, R., Fuentes, R., Delfino, A., Nazal, C.H., Sep\u00falveda, M., Arias, M., and Herskovic, V. (2019). Process-Oriented Feedback through Process Mining for Surgical Procedures in Medical Training: The Ultrasound-Guided Central Venous Catheter Placement Case. Int. J. Environ. Res. Public Health, 16.","DOI":"10.3390\/ijerph16111877"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"28","DOI":"10.4081\/jphr.2013.e28","article-title":"Technology and the Future of Healthcare","volume":"2","author":"Thimbleby","year":"2013","journal-title":"J. Public Health Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"i41","DOI":"10.1136\/bmjqs.2010.046409","article-title":"Five main processes in healthcare: A citizen perspective","volume":"20","author":"Bergman","year":"2011","journal-title":"BMJ Qual. Saf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"103994","DOI":"10.1016\/j.jbi.2022.103994","article-title":"Process mining for healthcare: Characteristics and challenges","volume":"127","author":"Martin","year":"2022","journal-title":"J. Biomed. Inform."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ali, O., Ishak, M.K., Bhatti, M.K.L., Khan, I., and Kim, K.I. (2022). A Comprehensive Review of Internet of Things: Technology Stack, Middlewares, and Fog\/Edge Computing Interface. Sensors, 22.","DOI":"10.3390\/s22030995"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1016\/j.future.2017.04.036","article-title":"Towards fog-driven IoT eHealth: Promises and challenges of IoT in medicine and healthcare","volume":"78","author":"Farahani","year":"2018","journal-title":"Futur. Gener. Comput. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ibarra-Esquer, J.E., Gonz\u00e1lez-Navarro, F.F., Flores-Rios, B.L., Burtseva, L., and Astorga-Vargas, M.A. (2017). Tracking the evolution of the internet of things concept across different application domains. Sensors, 17.","DOI":"10.3390\/s17061379"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pal, S., Hitchens, M., Rabehaja, T., and Mukhopadhyay, S. (2020). Security requirements for the internet of things: A systematic approach. Sensors, 20.","DOI":"10.3390\/s20205897"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1016\/j.jbi.2016.04.007","article-title":"Process mining in healthcare: A literature review","volume":"61","author":"Rojas","year":"2016","journal-title":"J. Biomed. Inform."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gatta, R., Vallati, M., Fernandez-Llatas, C., Martinez-Millana, A., Orini, S., Sacchi, L., and Castellano, M. (2020). What Role Can Process Mining Play in Recurrent Clinical Guidelines Issues? A Position Paper. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17186616"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Munoz-Gama, J., Galvez, V., de la Fuente, R., Sep\u00falveda, M., and Fuentes, R. (2021). Interactive Process Mining in Healthcare, Springer.","DOI":"10.1007\/978-3-030-53993-1_14"},{"key":"ref_26","first-page":"317","article-title":"The Delphi Method: Techniques and Applications","volume":"13","author":"Mahajan","year":"1976","journal-title":"J. Mark. Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1504\/IJBPIM.2017.088819","article-title":"The state-of-the-art of business process mining challenges","volume":"8","author":"Cho","year":"2017","journal-title":"Int. J. Bus. Process. Integr. Manag."},{"key":"ref_28","unstructured":"(2022, April 26). Prom611|ProM Tools. Available online: https:\/\/www.promtools.org\/doku.php?id=prom611."},{"key":"ref_29","first-page":"322","article-title":"Discovering learning processes using Inductive Miner: A case study with Learning Management Systems (LMSs)","volume":"30","author":"Cerezo","year":"2018","journal-title":"Psicothema"},{"key":"ref_30","first-page":"109","article-title":"Trace Clustering in Process Mining","volume":"Volume 17","author":"Song","year":"2009","journal-title":"Proceedings of the International Conference on Business Process Management"},{"key":"ref_31","first-page":"11","article-title":"Conformance checking and its challenges","volume":"270","year":"2016","journal-title":"Lect. Notes Bus. Inf. Process."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Battineni, G., Chintalapudi, N., and Amenta, F. (2020). Model discovery, and replay fitness validation using inductive mining techniques in medical training of CVC surgery. Appl. Comput. Informat, ahead-of-print.","DOI":"10.1016\/j.aci.2020.01.001"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1111\/j.1468-0009.2005.00397.x","article-title":"Evaluating the Quality of Medical Care","volume":"83","author":"Donabedian","year":"2005","journal-title":"Milbank Q."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"l4523","DOI":"10.1136\/bmj.l4523","article-title":"Medical education: Giving feedback to doctors in training","volume":"366","author":"Kelly","year":"2019","journal-title":"BMJ"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"191","DOI":"10.4103\/0971-3026.54877","article-title":"Impact of ultrasonography on central venous catheter insertion in intensive care","volume":"19","author":"Palepu","year":"2009","journal-title":"Indian J. Radiol. Imaging"},{"key":"ref_36","unstructured":"Geyer-Klingeberg, J., Nakladal, J., Badakhshan, P., and Somasundaram, I. (2022, April 26). Medical Training Analytics through Process Mining: The Case of Central Venous Catheters Surgeries Conformance Checking Challenge 2019 *. Available online: https:\/\/www.thoracic.org\/patients\/patient-resources\/resources\/central-venous-catheter.pdf."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"477","DOI":"10.3233\/JIFS-17403","article-title":"An integrative approach to simulation model discovery: Combining system theory, process mining and fuzzy logic","volume":"34","author":"Wang","year":"2018","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_38","first-page":"91","article-title":"Theory of Modeling and Simulation Handbook of Simulator-Based Training Creating Computer Simulation Systems: An introduction to the High Level Architecture","volume":"100","author":"Zeigler","year":"2000","journal-title":"Practice"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/5\/153\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:04:13Z","timestamp":1760137453000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/5\/153"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,29]]},"references-count":38,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["a15050153"],"URL":"https:\/\/doi.org\/10.3390\/a15050153","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,29]]}}}