{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T21:39:04Z","timestamp":1776980344359,"version":"3.51.4"},"reference-count":109,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T00:00:00Z","timestamp":1765152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Healthcare"],"abstract":"<jats:p>Artificial Intelligence (AI) is rapidly transforming surgical care by enabling more accurate diagnosis and risk prediction, personalized decision-making, real-time intraoperative support, and postoperative management. Ongoing trends such as multi-task learning, real-time integration, and clinician-centered design suggest AI is maturing into a safe, pragmatic asset in surgical care. Yet, significant challenges, such as the complexity and opacity of many AI models (particularly deep learning), transparency, bias, data sharing, and equitable deployment, must be surpassed to achieve clinical trust, ethical use, and regulatory approval of AI algorithms in healthcare. Explainable Artificial Intelligence (XAI) is an emerging field that plays an important role in bridging the gap between algorithmic power and clinical use as surgery becomes increasingly data-driven. The authors reviewed current applications of XAI in the context of surgery\u2014preoperative risk assessment, surgical planning, intraoperative guidance, and postoperative monitoring\u2014and highlighted the absence of these mechanisms in Generative AI (e.g., ChatGPT). XAI will allow surgeons to interpret, validate, and trust AI tools. XAI applied in surgery is not a luxury: it must be a prerequisite for responsible innovation. Model bias, overfitting, and user interface design are key challenges that need to be overcome and will be explored in this review to achieve the integration of XAI into the surgical field. Unveiling the algorithm is the first step toward a safe, accountable, transparent, and human-centered surgical AI.<\/jats:p>","DOI":"10.3390\/healthcare13243208","type":"journal-article","created":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T10:35:51Z","timestamp":1765190151000},"page":"3208","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Unveiling the Algorithm: The Role of Explainable Artificial Intelligence in Modern Surgery"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9166-9508","authenticated-orcid":false,"given":"Sara","family":"Lopes","sequence":"first","affiliation":[{"name":"Portuguese Institute of Oncology of Porto, 4200-072 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0340-0830","authenticated-orcid":false,"given":"Miguel","family":"Mascarenhas","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal"},{"name":"Precision Medicine Unit, Department of Gastroenterology, Hospital S\u00e3o Jo\u00e3o, 4200-437 Porto, Portugal"},{"name":"WGO Training Center, 4200-437 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0887-8796","authenticated-orcid":false,"given":"Jo\u00e3o","family":"Fonseca","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal"},{"name":"Precision Medicine Unit, Department of Gastroenterology, Hospital S\u00e3o Jo\u00e3o, 4200-437 Porto, Portugal"},{"name":"WGO Training Center, 4200-437 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3549-0770","authenticated-orcid":false,"given":"Maria Gabriela O.","family":"Fernandes","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal"},{"name":"Institute for Research and Innovation in Health\u2014Associate Laboratory (i3s-LA) (IPATIMUP\/I3S), 4200-135 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7808-3596","authenticated-orcid":false,"given":"Adelino F.","family":"Leite-Moreira","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal"},{"name":"Department of Cardiothoracic Surgery, Hospital S\u00e3o Jo\u00e3o, 4200-437 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Saraiva, M.M., Ribeiro, T., Agudo, B., Afonso, J., Mendes, F., Martins, M., Cardoso, P., Mota, J., Almeida, M.J., and Costa, A. (2025). Evaluating ChatGPT-4 for the Interpretation of Images from Several Diagnostic Techniques in Gastroenterology. J. Clin. Med., 14.","DOI":"10.3390\/jcm14020572"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2146","DOI":"10.14309\/ajg.0000000000002573","article-title":"Generative Artificial Intelligence for Gastroenterology: Neither Friend nor Foe","volume":"118","author":"Dang","year":"2023","journal-title":"Am. J. Gastroenterol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e488084","DOI":"10.2196\/48808","article-title":"ChatGPT-Generated Differential Diagnosis Lists for Complex Case-Derived Clinical Vignettes: Diagnostic Accuracy Evaluation","volume":"11","author":"Hirosawa","year":"2023","journal-title":"JMIR Med. Inform."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1007\/s11604-024-01619-y","article-title":"Diagnostic performances of GPT-4o, Claude 3 Opus, and Gemini 1.5 Pro in \u201cDiagnosis Please\u201d cases","volume":"42","author":"Sonoda","year":"2024","journal-title":"Jpn. J. Radiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2276","DOI":"10.14309\/ajg.0000000000002397","article-title":"Evaluation of the Potential Utility of an Artificial Intelligence Chatbot in Gastroesophageal Reflux Disease Management","volume":"118","author":"Henson","year":"2023","journal-title":"Am. J. Gastroenterol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"E600","DOI":"10.1055\/a-2289-9334","article-title":"Using a customized GPT to provide guideline-based recommendations for management of pancreatic cystic lesions","volume":"12","author":"Gorelik","year":"2024","journal-title":"Endosc. Int. Open"},{"key":"ref_7","first-page":"e68298","article-title":"GPT-4 Vision: Multi-Modal Evolution of ChatGPT and Potential Role in Radiology","volume":"16","author":"Javan","year":"2024","journal-title":"Cureus"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1007\/s11604-024-01606-3","article-title":"Evaluating ChatGPT-4V in chest CT diagnostics: A critical image interpretation assessment","volume":"42","author":"Dehdab","year":"2024","journal-title":"Jpn. J. Radiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1016\/j.jaad.2023.12.062","article-title":"Can ChatGPT vision diagnose melanoma? An exploratory diagnostic accuracy study","volume":"90","author":"Shifai","year":"2024","journal-title":"J. Am. Acad. Dermatol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kokkinakis, S., Kritsotakis, E.I., and Lasithiotakis, K. (2023). Artificial Intelligence in Surgical Risk Prediction. J. Clin. Med., 12.","DOI":"10.3390\/jcm12124016"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1007\/s00424-025-03076-6","article-title":"Comprehensive overview of artificial intelligence in surgery: A systematic review and perspectives","volume":"477","author":"Chevalier","year":"2025","journal-title":"Pflugers Arch."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, Y.Y., Wang, J.J., Huang, S.H., Kuo, C.-L., Chen, J.-Y., Liu, C.-F., and Chu, C.-C. (2022). Implementation of a machine learning application in preoperative risk assessment for hip repair surgery. BMC Anesthesiol., 22.","DOI":"10.1186\/s12871-022-01648-y"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kinoshita, M., Ueda, D., Matsumoto, T., Shinkawa, H., Yamamoto, A., Shiba, M., Okada, T., Tani, N., Tanaka, S., and Kimura, K. (2023). Deep Learning Model Based on Contrast-Enhanced Computed Tomography Imaging to Predict Postoperative Early Recurrence after the Curative Resection of a Solitary Hepatocellular Carcinoma. Cancers, 15.","DOI":"10.3390\/cancers15072140"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, C.-Y., Cheng, C.-Y., Yang, S.-Y., Chai, J.-W., Chen, W.-H., and Chang, P.-Y. (2023). Mortality Evaluation and Life Expectancy Prediction of Patients with Hepatocellular Carcinoma with Data Mining. Healthcare, 11.","DOI":"10.3390\/healthcare11060925"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Kenig, N., Monton Echeverria, J., and Muntaner Vives, A. (2024). Artificial Intelligence in Surgery: A Systematic Review of Use and Validation. J. Clin. Med., 13.","DOI":"10.3390\/jcm13237108"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.bjps.2025.10.026","article-title":"Structural barriers and pathways to artificial intelligence integration in plastic surgery","volume":"111","author":"Karamitros","year":"2025","journal-title":"J. Plast. Reconstr. Aesthet. Surg."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"101587","DOI":"10.1016\/j.imu.2024.101587","article-title":"A Survey of Explainable Artificial Intelligence in Healthcare: Concepts, Applications, and Challenges","volume":"51","author":"Mienye","year":"2024","journal-title":"Inform. Med. Unlocked"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Weng, Y., and Lund, J. (2022). Applications of Explainable Artificial Intelligence in Diagnosis and Surgery. Diagnostics, 12.","DOI":"10.3390\/diagnostics12020237"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Metta, C., Beretta, A., Pellungrini, R., Rinzivillo, S., and Giannotti, F. (2024). Towards Transparent Healthcare: Advancing Local Explanation Methods in Explainable Artificial Intelligence. Bioengineering, 11.","DOI":"10.3390\/bioengineering11040369"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s00423-025-03626-7","article-title":"Can surgeons trust AI? Perspectives on machine learning in surgery and the importance of eXplainable Artificial Intelligence (XAI)","volume":"410","author":"Brandenburg","year":"2025","journal-title":"Langenbecks Arch. Surg."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Amann, J., Blasimme, A., Vayena, E., Frey, D., and Madai, V.I. (2020). Explainability for artificial intelligence in healthcare: A multidisciplinary perspective. BMC Med. Inform. Decis. Mak., 20.","DOI":"10.1186\/s12911-020-01332-6"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"107829","DOI":"10.1016\/j.engappai.2023.107829","article-title":"Global and local interpretability techniques of supervised machine learning black box models for numerical medical data","volume":"131","author":"Hakkoum","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2571","DOI":"10.1007\/s10618-024-01041-y","article-title":"Explainable and interpretable machine learning and data mining","volume":"38","author":"Atzmueller","year":"2024","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"105689","DOI":"10.1016\/j.ijmedinf.2024.105689","article-title":"Decoding the black box: Explainable AI (XAI) for cancer diagnosis, prognosis, and treatment planning-A state-of-the art systematic review","volume":"193","author":"Mohamed","year":"2025","journal-title":"Int. J. Med. Inform."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Torda, T., Ciardiello, A., Gargiulo, S., Grillo, G., Scardapane, S., Voena, C., and Giagu, S. (2025). Influence based explainability of brain tumors segmentation in magnetic resonance imaging. Prog. Artif. Intell.","DOI":"10.1007\/s13748-025-00367-y"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Haupt, M., Maurer, M.H., and Thomas, R.P. (2025). Explainable Artificial Intelligence in Radiological Cardiovascular Imaging\u2014A Systematic Review. Diagnostics, 15.","DOI":"10.3390\/diagnostics15111399"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Song, D., Yao, J., Jiang, Y., Shi, S., Cui, C., Wang, L., Wang, L., Wu, H., Tian, H., and Ye, X. (2023). A new xAI framework with feature explainability for tumors decision-making in Ultrasound data: Comparing with Grad-CAM. Comput. Methods Programs Biomed., 235.","DOI":"10.1016\/j.cmpb.2023.107527"},{"key":"ref_28","unstructured":"Topol, E. (2019). Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again, Basic Books."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mascarenhas, M., Mendes, F., Martins, M., Ribeiro, T., Afonso, J., Cardoso, P., Ferreira, J., Fonseca, J., and Macedo, G. (2025). Explainable AI in Digestive Healthcare and Gastrointestinal Endoscopy. J. Clin. Med., 14.","DOI":"10.3390\/jcm14020549"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1002\/cjp2.322","article-title":"Explainability and causability in digital pathology","volume":"9","author":"Plass","year":"2023","journal-title":"J. Pathol. Clin. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"e014519","DOI":"10.1161\/CIRCIMAGING.122.014519","article-title":"Explainable artificial intelligence and cardiac imaging","volume":"16","author":"Salih","year":"2023","journal-title":"Circ. Cardiovasc. Imaging"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4739","DOI":"10.1038\/s41467-025-59532-5","article-title":"Dermatologist-like explainable AI enhances melanoma diagnosis accuracy: Eye-tracking study","volume":"16","author":"Chanda","year":"2025","journal-title":"Nat. Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1038\/s41551-018-0304-0","article-title":"Explainable machine-learning predictions for the prevention of hypoxaemia during surgery","volume":"2","author":"Lundberg","year":"2018","journal-title":"Nat. Biomed. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","article-title":"A guide to deep learning in healthcare","volume":"25","author":"Esteva","year":"2019","journal-title":"Nat. Med."},{"key":"ref_35","unstructured":"Holzinger, A., Biemann, C., Pattichis, C.S., and Kell, D.B. (2017). What do we need to build explainable AI systems for the medical domain?. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4793","DOI":"10.1109\/TNNLS.2020.3027314","article-title":"A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI","volume":"32","author":"Tjoa","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Gerke, S., Minssen, T., and Cohen, G. (2020). Ethical and legal challenges of artificial intelligence-driven healthcare. Artificial Intelligence in Healthcare, Academic Press.","DOI":"10.2139\/ssrn.3570129"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1765","DOI":"10.1001\/jama.2019.15064","article-title":"Potential liability for physicians using artificial intelligence","volume":"322","author":"Price","year":"2019","journal-title":"JAMA"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1136\/bmjqs-2018-008551","article-title":"Framing the challenges of artificial intelligence in medicine","volume":"28","author":"Yu","year":"2019","journal-title":"BMJ Qual. Saf."},{"key":"ref_40","first-page":"1","article-title":"IBM\u2019s Watson supercomputer recommended \u201cunsafe and incorrect\u201d cancer treatments, internal documents show","volume":"25","author":"Ross","year":"2018","journal-title":"Stat News."},{"key":"ref_41","unstructured":"European Commission (2025, July 24). Proposal for a Regulation Laying Down Harmonised Rules on Artificial Intelligence (AI Act). Available online: https:\/\/digital-strategy.ec.europa.eu\/en\/library\/proposal-regulation-laying-down-harmonised-rules-artificial-intelligence."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1136\/bmjqs-2018-008370","article-title":"Artificial intelligence, bias and clinical safety","volume":"28","author":"Challen","year":"2019","journal-title":"BMJ Qual. Saf."},{"key":"ref_43","first-page":"254","article-title":"An ethically mindful approach to AI for health care","volume":"395","author":"Morley","year":"2020","journal-title":"Lancet Digit Health"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"e1312","DOI":"10.1002\/widm.1312","article-title":"Causability and explainability of AI in medicine","volume":"9","author":"Holzinger","year":"2019","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_45","first-page":"4765","article-title":"A unified approach to interpreting model predictions","volume":"30","author":"Lundberg","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_46","first-page":"841","article-title":"Counterfactual explanations without opening the black box: Automated decisions and the GDPR","volume":"31","author":"Wachter","year":"2018","journal-title":"Harv. J. Law Technol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"e10023","DOI":"10.1002\/lrh2.10023","article-title":"The forgetting health system","volume":"1","author":"Coiera","year":"2017","journal-title":"Learn Health Syst."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1038\/s41551-018-0305-z","article-title":"Artificial intelligence in healthcare","volume":"2","author":"Yu","year":"2018","journal-title":"Nat. Biomed. Eng."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1002\/hast.973","article-title":"Artificial intelligence and black-box medical decisions: Accuracy versus explainability","volume":"49","author":"London","year":"2019","journal-title":"Hastings Cent. Rep."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"e745","DOI":"10.1016\/S2589-7500(21)00208-9","article-title":"The false hope of current approaches to explainable artificial intelligence in health care","volume":"3","author":"Ghassemi","year":"2021","journal-title":"Lancet Digit Health"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2199","DOI":"10.1001\/jama.2018.17163","article-title":"Clinical decision support in the era of artificial intelligence","volume":"320","author":"Shortliffe","year":"2018","journal-title":"JAMA"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1093\/jcr\/ucz013","article-title":"Resistance to medical artificial intelligence","volume":"46","author":"Longoni","year":"2019","journal-title":"J. Consum. Res."},{"key":"ref_53","unstructured":"Tonekaboni, S., Joshi, S., McCradden, M.D., and Goldenberg, A. (2019). What clinicians want: Contextualizing explainable machine learning for clinical end use. arXiv."},{"key":"ref_54","unstructured":"Lundberg, S.M., Erion, G., and Lee, S.I. (2018). Consistent individualized feature attribution for tree ensembles. arXiv."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Vayena, E., Blasimme, A., and Cohen, I.G. (2018). Machine learning in medicine: Addressing ethical challenges. PLoS Med., 15.","DOI":"10.1371\/journal.pmed.1002689"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1016\/j.jamcollsurg.2012.11.014","article-title":"Racial disparities in surgical care and outcomes in the United States: A comprehensive review","volume":"216","author":"Haider","year":"2013","journal-title":"J. Am. Coll. Surg."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"866","DOI":"10.7326\/M18-1990","article-title":"Ensuring fairness in machine learning to advance health equity","volume":"169","author":"Rajkomar","year":"2018","journal-title":"Ann. Intern. Med."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1038\/s41591-019-0649-2","article-title":"Treating health disparities with artificial intelligence","volume":"26","author":"Chen","year":"2020","journal-title":"Nat. Med."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"2176","DOI":"10.1038\/s41591-021-01595-0","article-title":"Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations","volume":"27","author":"Zhang","year":"2021","journal-title":"Nat. Med."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1038\/s41591-019-0548-6","article-title":"Do no harm: A roadmap for responsible machine learning for health care","volume":"25","author":"Wiens","year":"2019","journal-title":"Nat. Med."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I.D., and Gebru, T. (2019, January 29\u201331). Model cards for model reporting. Proceedings of the Conference on Fairness, Accountability, and Transparency (FAT), Atlanta, GA, USA.","DOI":"10.1145\/3287560.3287596"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"105567","DOI":"10.1016\/j.clsr.2021.105567","article-title":"Why fairness cannot be automated: Bridging the gap between EU non-discrimination law and AI","volume":"41","author":"Wachter","year":"2021","journal-title":"Comput. Law Secur. Rev."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1002\/wjs.12220","article-title":"How to harness the power of web scraping for medical and surgical research: An application in estimating international collaboration","volume":"48","author":"Goulas","year":"2024","journal-title":"World J. Surg."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1016\/S1071-5819(03)00038-7","article-title":"The role of trust in automation reliance","volume":"58","author":"Dzindolet","year":"2003","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_66","first-page":"40","article-title":"Moral crumple zones: Cautionary tales in human-robot interaction","volume":"5","author":"Elish","year":"2019","journal-title":"Engag. Sci. Technol. Soc."},{"key":"ref_67","first-page":"19-00172","article-title":"A path for translation of machine learning products into healthcare delivery","volume":"10","author":"Sendak","year":"2020","journal-title":"EMJ Innov."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Amann, J., Vetter, D., Blomberg, S.N., Christensen, H.C., Coffee, M., Gerke, S., Gilbert, T.K., Hagendorff, T., Holm, S., and Livne, M. (2022). To explain or not to ex-plain?\u2014Artificial Intelligence Explainability in clinical decision support systems. PLoS Digit. Health, 1.","DOI":"10.1371\/journal.pdig.0000016"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"e2322285","DOI":"10.1001\/jamanetworkopen.2023.22285","article-title":"Development and Validation of a Machine Learning Model to Identify Patients Before Surgery at High Risk for Postoperative Adverse Events","volume":"6","author":"Mahajan","year":"2023","journal-title":"JAMA Netw. Open"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"29","DOI":"10.21037\/jmai-24-111","article-title":"Artificial intelligence in surgery\u2014A narrative review","volume":"7","author":"Tignanelli","year":"2024","journal-title":"J. Med. Artif. Intell."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"1716","DOI":"10.1038\/s41591-018-0213-5","article-title":"The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care","volume":"24","author":"Komorowski","year":"2018","journal-title":"Nat. Med."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13\u201317). \u201cWhy should I trust you?\u201d: Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939778"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"1361","DOI":"10.1007\/s11606-012-2077-6","article-title":"Shared decision making: A model for clinical practice","volume":"27","author":"Elwyn","year":"2012","journal-title":"J. Gen. Intern. Med."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-CAM: Visual explanations from deep networks via gradient-based localization. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"2774","DOI":"10.1007\/s00464-025-11685-6","article-title":"Artificial intelligence for intraoperative video analysis in robotic-assisted esophagectomy","volume":"39","author":"Cizmic","year":"2025","journal-title":"Surg. Endosc."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1097\/SLA.0000000000002693","article-title":"Artificial intelligence in surgery: Promises and perils","volume":"268","author":"Hashimoto","year":"2018","journal-title":"Ann. Surg."},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Leszczy\u0144ska, A., Obuchowicz, R., Strzelecki, M., and Seweryn, M. (2025). The Integration of Artificial Intelligence into Robotic Cancer Surgery: A Systematic Review. J. Clin. Med., 14.","DOI":"10.3390\/jcm14176181"},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"896","DOI":"10.1097\/SLA.0000000000005700","article-title":"Intraoperative Applications of Artificial Intelligence in Robotic Surgery: A Scoping Review of Current Development Stages and Levels of Autonomy","volume":"278","author":"Vasey","year":"2023","journal-title":"Ann. Surg."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1038\/s41746-025-01769-x","article-title":"Liquid white box model as an explainable AI for surgery","volume":"8","author":"Singh","year":"2025","journal-title":"Npj Digit. Med."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"e2300247","DOI":"10.1200\/CCI.23.00247","article-title":"Explainable Machine Learning Model to Preoperatively Predict Postoperative Complications in Inpatients With Cancer Undergoing Major Operations","volume":"8","author":"Hernandez","year":"2024","journal-title":"JCO Clin. Cancer Inform."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"2411","DOI":"10.1007\/s00464-024-10681-6","article-title":"Explainable artificial intelligence prediction-based model in laparoscopic liver surgery for segments 7 and 8","volume":"38","author":"Gavara","year":"2024","journal-title":"Surg. Endosc."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"3603","DOI":"10.21037\/jtd-24-1853","article-title":"Prediction model for postoperative pulmonary complications after thoracoscopic surgery with machine learning algorithms and SHapley Additive exPlanations (SHAP)","volume":"17","author":"Wang","year":"2025","journal-title":"J. Thorac. Dis."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"106954","DOI":"10.1016\/j.ijsu.2022.106954","article-title":"Study and validation of an explainable machine learning\u2013based mortality prediction following emergency surgery in the elderly: A prospective observational study (FRAILESEL)","volume":"107","author":"Fransvea","year":"2022","journal-title":"Int. J. Surg."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"e2212930","DOI":"10.1001\/jamanetworkopen.2022.12930","article-title":"Development and Validation of an Explainable Machine Learning Model for Major Complications After Cytoreductive Surgery","volume":"5","author":"Deng","year":"2022","journal-title":"JAMA Netw. Open"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Zeng, X., Hu, Y., Shu, L., Li, J., Duan, H., Shu, Q., and Li, H. (2021). Explainable machine-learning predictions for complications after pediatric congenital heart surgery. Sci. Rep., 11.","DOI":"10.1038\/s41598-021-96721-w"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Arabian, H., Alshirbaji, T.A., Jalal, N.A., Krueger-Ziolek, S., and Moeller, K. (2023). P-CSEM: An Attention Module for Improved Laparoscopic Surgical Tool Detection. Sensors, 23.","DOI":"10.3390\/s23167257"},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"7444","DOI":"10.1007\/s00464-022-09160-7","article-title":"Artificial intelligence software available for medical devices: Surgical phase recognition in laparoscopic cholecystectomy","volume":"46","author":"Shinozuka","year":"2022","journal-title":"Surg. Endosc."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1097\/SLA.0000000000003460","article-title":"Computer Vision Analysis of Intraoperative Video: Automated Recognition of Operative Steps in Laparoscopic Sleeve Gastrectomy","volume":"270","author":"Hashimoto","year":"2019","journal-title":"Ann. Surg."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1097\/SLA.0000000000004594","article-title":"Artificial Intelligence for Intraoperative Guidance: Using Semantic Segmentation to identify surgical anatomy during Laparoscopic Cholecystectomy","volume":"276","author":"Madani","year":"2022","journal-title":"Ann. Surg."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1007\/s11548-018-1735-5","article-title":"Automated surgical skill assessment in RMIS training","volume":"13","author":"Zia","year":"2018","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1007\/s11548-019-01995-1","article-title":"Video-based surgical skill assessment using 3D convolutional neural networks","volume":"14","author":"Funke","year":"2019","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/s41746-022-00566-0","article-title":"MAchine Learning for technical skill assessment in surgery: A systematic review","volume":"5","author":"Lam","year":"2022","journal-title":"npj Digit. Med."},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1038\/s41746-022-00707-5","article-title":"Computer vision in surgery: From potential to clinical value","volume":"5","author":"Mascagni","year":"2022","journal-title":"npj Digi. Med."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.amjsurg.2005.07.031","article-title":"Development of assessing generic and specific technical skills in laparoscopic surgery","volume":"191","author":"Sarker","year":"2006","journal-title":"Am. J. Surg."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"Rudin","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Slack, D., Hilgard, S., Jia, E., Singh, S., and Lakkaraju, H. (2020, January 7\u20139). Fooling LIME and SHAP: Adversarial attacks on post hoc explanation methods. Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, New York, NY, USA.","DOI":"10.1145\/3375627.3375830"},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"e15182","DOI":"10.2196\/15182","article-title":"Real-world Integration of a sepsis Deep Learning Technology Into Routine Clinical Care: Implementation Study","volume":"8","author":"Sendak","year":"2020","journal-title":"JMIR MED Inform."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: The convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nat. Med."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1001\/jama.2019.0161","article-title":"A decade of health information technology usability challenges and the path forward","volume":"321","author":"Ratwani","year":"2019","journal-title":"JAMA"},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-319-99740-7_1","article-title":"Current advances, trends and challenges of machine learning and knowledge extraction: From machine learning to explainable AI","volume":"Volume 11015","author":"Holzinger","year":"2018","journal-title":"Machine Learning and Knowledge Extraction"},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1080\/13645706.2019.1584116","article-title":"Machine and deep learning for workflow recognition during surgery","volume":"28","author":"Padoy","year":"2019","journal-title":"Minim. Invasive Ther. Allied Technol."},{"key":"ref_102","unstructured":"U.S. Food & Drug Administration (2025, August 15). Artificial Intelligence\/Machine Learning (AI\/ML)-Based Software as a Medical Device (SaMD): Action Plan, Available online: https:\/\/www.fda.gov\/media\/145022\/download."},{"key":"ref_103","unstructured":"(2025, August 15). FDA Discussion Paper: Proposed Regulatory Framework for Modifications to AI\/ML-Based Software as a Medical Device, Available online: https:\/\/www.fda.gov\/files\/medical%20devices\/published\/US-FDA-Artificial-Intelligence-and-Machine-Learning-Discussion-Paper.pdf."},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/rego.12512","article-title":"Trustworthy artificial intelligence and the European Union AI Act: On the conflation of trustworthiness and the acceptability of risk","volume":"18","author":"Laux","year":"2024","journal-title":"Regul. Gov."},{"key":"ref_105","first-page":"ivae192","article-title":"The Ethical Considerations of integrating artificial intelligence into surgery: A review","volume":"40","author":"Rad","year":"2025","journal-title":"Interdiscip. Cardiovasc. Thorac. Surg."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.jss.2025.03.043","article-title":"Associations in Medical Research Can Be Misleading: A Clinician\u2019s Guide to Causal Inference","volume":"310","author":"Karamitros","year":"2025","journal-title":"J. Surg. Res."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"Shen, J., Xue, B., Kannampallil, T., Lu, C., and Abraham, J. (2024). A Novel Generative Multi-Task Representation Learning Approach for Predicting Postoperative Complications in Cardiac Surgery Patients. arXiv.","DOI":"10.1093\/jamia\/ocae316"},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1093\/jamia\/ocae316","article-title":"A novel generative multi-task representation learning approach for predicting postoperative complications in cardiac surgery patients","volume":"32","author":"Shen","year":"2025","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"e070904","DOI":"10.1136\/bmj-2022-070904","article-title":"Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI","volume":"377","author":"Vasey","year":"2022","journal-title":"BMJ"}],"container-title":["Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9032\/13\/24\/3208\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T10:58:33Z","timestamp":1765191513000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9032\/13\/24\/3208"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,8]]},"references-count":109,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["healthcare13243208"],"URL":"https:\/\/doi.org\/10.3390\/healthcare13243208","relation":{},"ISSN":["2227-9032"],"issn-type":[{"value":"2227-9032","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,8]]}}}