{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T05:45:52Z","timestamp":1792820752544,"version":"4.5.0"},"reference-count":32,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T00:00:00Z","timestamp":1787270400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100011576","name":"Inonu University Scientific Research Projects Coordination Unit","doi-asserted-by":"publisher","award":["TSA-2026-5141"],"award-info":[{"award-number":["TSA-2026-5141"]}],"id":[{"id":"10.13039\/501100011576","id-type":"DOI","asserted-by":"publisher"}]},{"award":["TSA-2026-5141"],"award-info":[{"award-number":["TSA-2026-5141"]}],"id":[{"id":"https:\/\/ror.org\/04asck240","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Bioengineering"],"abstract":"<jats:p>Background: Predicting recurrence after liver transplantation (LT) for hepatocellular carcinoma (HCC) remains important for post-transplant risk stratification and surveillance planning. The Milan criteria discriminate only moderately and some machine-learning re-analyses report overly optimistic results because of information leakage. Aim: The current study aimed to re-evaluate a previously published transplant cohort under a leakage-free survival-analysis framework and to benchmark post-transplant, explant-informed survival learners against the Milan criteria as a fixed pre-transplant reference. We hypothesised moderate rather than near-perfect discrimination, similar performance across learners of differing complexity, and better discrimination than the Milan criteria. Methods: This secondary analysis included 356 patients with HCC who underwent LT. The primary endpoint was recurrence-free survival, analysed from the observed event indicator and follow-up time rather than from a derived risk label. Seven survival learners were benchmarked with repeated nested cross-validation, using three repeats of a five-fold outer loop with a three-fold inner tuning loop. All data-dependent preprocessing, including robust multivariable outlier handling and imputation, was fitted within training folds only. Performance was assessed by the concordance indices of Harrell and Uno, the time-dependent area under the curve, the integrated Brier score, calibration, decision-curve analysis and descriptive competing-risk assessment. Results: Recurrence developed in 183 of the 356 patients over a median follow-up of 52 months. Discrimination was moderate rather than near-perfect and similar across learners; the random survival forest ranked highest and the Elastic-Net Cox model performed comparably. All learners showed higher descriptive concordance than the Milan criteria, and dependency-corrected comparisons supported higher concordance for the full-feature Cox model than for the Milan criteria, whereas the random survival forest and Cox did not differ materially. Out-of-fold calibration of the Elastic-Net Cox model at 36 months was acceptable, decision-curve analysis indicated positive net benefit across clinically relevant thresholds, and tumour size and alpha-fetoprotein were the leading contributors to prediction. Findings were stable in ablation and threshold-sensitivity analyses. Conclusions: Leakage-free survival modelling gave moderate but internally validated prediction of post-transplant recurrence and higher concordance than the Milan criteria in this cohort, supporting the stated hypotheses. Careful study design may matter more than architectural complexity in this setting, and leakage-free survival analysis is a practical standard for prognostic modelling in transplant oncology.<\/jats:p>","DOI":"10.3390\/bioengineering13080951","type":"journal-article","created":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T14:20:36Z","timestamp":1787322036000},"page":"951","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Leakage-Free Survival-Modelling Benchmark for Hepatocellular Carcinoma Recurrence After Liver Transplantation: Nested Cross-Validation Against the Milan Criteria"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6864-7711","authenticated-orcid":false,"given":"Sami","family":"Akbulut","sequence":"first","affiliation":[{"name":"Department of Surgery and Liver Transplantation, Faculty of Medicine, Inonu University, 44280 Malatya, T\u00fcrkiye"},{"name":"Department of Biostatistics and Medical Informatics, Faculty of Medicine, Inonu University, 44280 Malatya, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5406-098X","authenticated-orcid":false,"given":"Cemil","family":"Colak","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Medical Informatics, Faculty of Medicine, Inonu University, 44280 Malatya, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5436-8164","authenticated-orcid":false,"given":"Emek","family":"Guldogan","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Medical Informatics, Faculty of Medicine, Inonu University, 44280 Malatya, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,21]]},"reference":[{"key":"ref_1","first-page":"229","article-title":"Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"74","author":"Bray","year":"2024","journal-title":"CA Cancer J. Clin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"10413","DOI":"10.12998\/wjcc.v10.i29.10413","article-title":"Liver transplantation for hepatocellular carcinoma: Historical evolution of transplantation criteria","volume":"10","author":"Ince","year":"2022","journal-title":"World J. Clin. Cases"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Shimamura, T., Goto, R., Watanabe, M., Kawamura, N., and Takada, Y. (2022). Liver Transplantation for Hepatocellular Carcinoma: How Should We Improve the Thresholds?. Cancers, 14.","DOI":"10.3390\/cancers14020419"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1056\/NEJM199603143341104","article-title":"Liver transplantation for the treatment of small hepatocellular carcinomas in patients with cirrhosis","volume":"334","author":"Mazzaferro","year":"1996","journal-title":"N. Engl. J. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1381","DOI":"10.1002\/cac2.12468","article-title":"Development and validation of an artificial intelligence model for predicting post-transplant hepatocellular cancer recurrence","volume":"43","author":"Lai","year":"2023","journal-title":"Cancer Commun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1002\/lt.26397","article-title":"Leveraging a Machine-Learning Approach to Predict Recurrent Hepatocellular Carcinoma Following Liver Transplantation: A Step in the Right Direction?","volume":"28","author":"Tran","year":"2022","journal-title":"Liver Transpl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1500","DOI":"10.1016\/j.surg.2024.07.039","article-title":"Artificial intelligence-based model for the recurrence of hepatocellular carcinoma after liver transplantation","volume":"176","author":"Altaf","year":"2024","journal-title":"Surgery"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"7730","DOI":"10.1038\/s41598-025-91728-z","article-title":"Deep learning for hepatocellular carcinoma recurrence before and after liver transplantation: A multicenter cohort study","volume":"15","author":"Cao","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1097\/LVT.0000000000000685","article-title":"Machine learning improves post-transplantation HCC recurrence prediction","volume":"31","author":"Li","year":"2025","journal-title":"Liver Transpl."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ge, W., Bishara, A., Braun, H., Simonetto, D., and Ge, J. (2026). Emerging applications of traditional and generative artificial intelligence in liver transplantation. Liver Transpl.","DOI":"10.1097\/LVT.0000000000000914"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"101894","DOI":"10.1016\/j.compmedimag.2021.101894","article-title":"An imageomics and multi-network based deep learning model for risk assessment of liver transplantation for hepatocellular cancer","volume":"89","author":"He","year":"2021","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2277","DOI":"10.2147\/JHC.S431503","article-title":"Imaging-Derived Biomarkers Integrated with Clinical and Laboratory Values Predict Recurrence of Hepatocellular Carcinoma After Liver Transplantation","volume":"10","author":"Hoang","year":"2023","journal-title":"J. Hepatocell. Carcinoma"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ko, S.H., Cao, J., Yang, Y.K., Xi, Z.F., Han, H.W., Sha, M., and Xia, Q. (2024). Development of a deep learning model for predicting recurrence of hepatocellular carcinoma after liver transplantation. Front. Med., 11.","DOI":"10.3389\/fmed.2024.1373005"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1007\/s12072-022-10321-y","article-title":"Deep learning for prediction of hepatocellular carcinoma recurrence after resection or liver transplantation: A discovery and validation study","volume":"16","author":"Liu","year":"2022","journal-title":"Hepatol. Int."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1097\/LVT.0000000000000603","article-title":"Combining radiomics and imaging biomarkers with clinical variables for the prediction of HCC recurrence after liver transplantation","volume":"31","author":"Schindler","year":"2025","journal-title":"Liver Transpl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, Z., Li, X.R., Huang, Z.Y., Chu, J.H., Liu, K., and Ji, Q. (2026). Multiphasic CT-based multimodal deep learning model for predicting early hepatocellular carcinoma recurrence following liver transplantation. Front. Oncol., 16.","DOI":"10.3389\/fonc.2026.1767885"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1186\/s13244-025-02082-7","article-title":"Augmenting conventional criteria: A CT-based deep learning radiomics nomogram for early recurrence risk stratification in hepatocellular carcinoma after liver transplantation","volume":"16","author":"Wu","year":"2025","journal-title":"Insights Imaging"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1016\/j.hbpd.2022.05.013","article-title":"Prediction of early recurrence of hepatocellular carcinoma after liver transplantation based on computed tomography radiomics nomogram","volume":"21","author":"Zhao","year":"2022","journal-title":"Hepatobiliary Pancreat. Dis. Int."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1038\/s43856-025-00994-5","article-title":"Validation of the Toronto recurrence inference using machine-learning for post-transplant hepatocellular carcinoma model","volume":"5","author":"Li","year":"2025","journal-title":"Commun. Med."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1186\/s40537-025-01193-8","article-title":"Overview of leakage scenarios in supervised machine learning","volume":"12","author":"Sasse","year":"2025","journal-title":"J. Big Data"},{"key":"ref_21","first-page":"1","article-title":"Scikit-survival: A Library for Time-to-Event Analysis Built on Top of scikit-learn","volume":"21","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1214\/08-AOAS169","article-title":"Random survival forests","volume":"2","author":"Ishwaran","year":"2008","journal-title":"Ann. Appl. Stat."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.2517-6161.1972.tb00899.x","article-title":"Regression Models and Life-Tables","volume":"34","author":"Cox","year":"1972","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Varma, S., and Simon, R. (2006). Bias in error estimation when using cross-validation for model selection. BMC Bioinform., 7.","DOI":"10.1186\/1471-2105-7-91"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4","article-title":"Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors","volume":"15","author":"Harrell","year":"1996","journal-title":"Stat. Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1002\/sim.4154","article-title":"On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data","volume":"30","author":"Uno","year":"2011","journal-title":"Stat. Med."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2529","DOI":"10.1002\/(SICI)1097-0258(19990915\/30)18:17\/18<2529::AID-SIM274>3.0.CO;2-5","article-title":"Assessment and comparison of prognostic classification schemes for survival data","volume":"18","author":"Graf","year":"1999","journal-title":"Stat. Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1080\/01621459.1958.10501452","article-title":"Nonparametric estimation from incomplete observations","volume":"53","author":"Kaplan","year":"1958","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1177\/0272989X06295361","article-title":"Decision curve analysis: A novel method for evaluating prediction models","volume":"26","author":"Vickers","year":"2006","journal-title":"Med. Decis. Mak."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"110234","DOI":"10.1016\/j.knosys.2022.110234","article-title":"SurvSHAP(t): Time-dependent explanations of machine learning survival models","volume":"262","author":"Spytek","year":"2023","journal-title":"Knowl.-Based Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e078378","DOI":"10.1136\/bmj-2023-078378","article-title":"TRIPOD+AI statement: Updated guidance for reporting clinical prediction models that use regression or machine learning methods","volume":"385","author":"Collins","year":"2024","journal-title":"BMJ"}],"container-title":["Bioengineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5354\/13\/8\/951\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T14:37:30Z","timestamp":1787323050000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5354\/13\/8\/951"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,21]]},"references-count":32,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["bioengineering13080951"],"URL":"https:\/\/doi.org\/10.3390\/bioengineering13080951","relation":{},"ISSN":["2306-5354"],"issn-type":[{"value":"2306-5354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,21]]}}}