{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T11:00:52Z","timestamp":1788001252305,"version":"build-2784847793"},"reference-count":23,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,10,25]],"date-time":"2022-10-25T00:00:00Z","timestamp":1666656000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:p>Patient care after kidney transplantation requires integration of complex information to make informed decisions on risk constellations. Many machine learning models have been developed for detecting patient outcomes in the past years. However, performance metrics alone do not determine practical utility. We present a newly developed clinical decision support system (CDSS) for detection of patients at risk for rejection and death-censored graft failure. The CDSS is based on clinical routine data including 1,516 kidney transplant recipients and more than 100,000 data points. In a reader study we compare the performance of physicians at a nephrology department with and without the CDSS. Internal validation shows AUC-ROC scores of 0.83 for rejection, and 0.95 for graft failure. The reader study shows that predictions by physicians converge toward the CDSS. However, performance does not improve (AUC\u2013ROC; 0.6413 vs. 0.6314 for rejection; 0.8072 vs. 0.7778 for graft failure). Finally, the study shows that the CDSS detects partially different patients at risk compared to physicians. This indicates that the combination of both, medical professionals and a CDSS might help detect more patients at risk for graft failure. However, the question of how to integrate such a system efficiently into clinical practice remains open.<\/jats:p>","DOI":"10.3389\/fpubh.2022.979448","type":"journal-article","created":{"date-parts":[[2022,10,25]],"date-time":"2022-10-25T03:12:07Z","timestamp":1666667527000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Evaluation of a clinical decision support system for detection of patients at risk after kidney transplantation"],"prefix":"10.3389","volume":"10","author":[{"given":"Roland","family":"Roller","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manuel","family":"Mayrdorfer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wiebke","family":"Duettmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcel G.","family":"Naik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danilo","family":"Schmidt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabian","family":"Halleck","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrik","family":"Hummel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aljoscha","family":"Burchardt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"M\u00f6ller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Dabrock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bilgin","family":"Osmanodja","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Klemens","family":"Budde","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,10,25]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1725","DOI":"10.1056\/NEJM199912023412303","article-title":"Comparison of mortality in all patients on dialysis, patients on dialysis awaiting transplantation, and recipients of a first cadaveric transplant","volume":"341","author":"Wolfe","year":"1999","journal-title":"N Engl J Med."},{"key":"B2","doi-asserted-by":"publisher","first-page":"1859","DOI":"10.1681\/ASN.2004121092","article-title":"Impact of cadaveric renal transplantation on survival in patients listed for transplantation","volume":"16","author":"Oniscu","year":"2005","journal-title":"J Am Soc Nephrol."},{"key":"B3","doi-asserted-by":"publisher","first-page":"1513","DOI":"10.1681\/ASN.2020081215","article-title":"Exploring the complexity of death-censored kidney allograft failure","volume":"32","author":"Mayrdorfer","year":"2021","journal-title":"J Am Soc Nephrol."},{"key":"B4","doi-asserted-by":"publisher","first-page":"2557","DOI":"10.1097\/TP.0000000000003192","article-title":"Assessing the complex causes of kidney allograft loss","volume":"104","author":"Van Loon","year":"2020","journal-title":"Transplantation."},{"key":"B5","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1111\/j.1600-6143.2011.03840.x","article-title":"Understanding the causes of kidney transplant failure: the dominant role of antibody-mediated rejection and nonadherence","volume":"12","author":"Sellar\u00e9s","year":"2012","journal-title":"Am J Transpl."},{"key":"B6","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1038\/s41746-020-00346-8","article-title":"Deep-learning-based real-time prediction of acute kidney injury outperforms human predictive performance","volume":"3","author":"Rank","year":"2020","journal-title":"NPJ Digit Med."},{"key":"B7","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1038\/s41597-019-0103-9","article-title":"Multitask learning and benchmarking with clinical time series data","volume":"6","author":"Harutyunyan","year":"2019","journal-title":"Sci Data."},{"key":"B8","doi-asserted-by":"publisher","first-page":"1060","DOI":"10.1101\/2020.07.21.20157610","article-title":"EffiCare: better prognostic models via resource-efficient health embeddings","volume":"2020","author":"Rethmeier","year":"2020","journal-title":"AMIA Ann Sympos Proc."},{"key":"B9","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1109\/TVCG.2018.2865027","article-title":"Retainvis: Visual analytics with interpretable and interactive recurrent neural networks on electronic medical records","volume":"25","author":"Kwon","year":"2019","journal-title":"IEEE Trans Vis Comp Graph."},{"key":"B10","doi-asserted-by":"publisher","first-page":"e61971","DOI":"10.3791\/61971","article-title":"TBase-an integrated electronic health record and research database for kidney transplant recipients","volume":"170","author":"Schmidt","year":"2021","journal-title":"JoVE."},{"key":"B11","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1111\/ajt.14625","article-title":"The banff 2017 kidney meeting report: revised diagnostic criteria for chronic active T cell-mediated rejection, antibody-mediated rejection, and prospects for integrative endpoints for next-generation clinical trials","volume":"18","author":"Haas","year":"2018","journal-title":"Am J Transpl."},{"key":"B12","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J Art Intell Res."},{"key":"B13","first-page":"513","article-title":"Neighbourhood components analysis","volume":"17","author":"Goldberger","year":"2004","journal-title":"Adv Neural Inform Process Syst"},{"key":"B14","doi-asserted-by":"publisher","first-page":"837","DOI":"10.2307\/2531595","article-title":"Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach","volume":"44","author":"DeLong","year":"1988","journal-title":"Biometrics."},{"key":"B15","article-title":"Some unintended consequences of clinical decision support systems","volume-title":"Amia Annual Symposium Proceedings.","author":"Ash","year":"2007"},{"key":"B16","doi-asserted-by":"publisher","first-page":"l4923","DOI":"10.1136\/bmj.l4923","article-title":"Prediction system for risk of allograft loss in patients receiving kidney transplants: international derivation and validation study","volume":"366","author":"Loupy","year":"2019","journal-title":"BMJ."},{"key":"B17","doi-asserted-by":"publisher","first-page":"ii68","DOI":"10.1093\/ndt\/gfw405","article-title":"Risk prediction models for graft failure in kidney transplantation: a systematic review","volume":"32","author":"Kabor\u00e9","year":"2017","journal-title":"Nephrol Dial Transpl."},{"key":"B18","doi-asserted-by":"publisher","first-page":"e3","DOI":"10.1136\/medethics-2019-105860","article-title":"Primer on an ethics of AI-based decision support systems in the clinic","volume":"47","author":"Braun","year":"2020","journal-title":"J Med Ethics."},{"key":"B19","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1002\/hast.1207","article-title":"A leap of faith: is there a formula for \u201ctrustworthy\u201d AI?","volume":"51","author":"Braun","year":"2021","journal-title":"Hast Center Rep."},{"key":"B20","doi-asserted-by":"publisher","first-page":"1765","DOI":"10.1001\/jama.2019.15064","article-title":"Potential liability for physicians using artificial intelligence","volume":"322","author":"Price","year":"2019","journal-title":"JAMA."},{"key":"B21","doi-asserted-by":"publisher","first-page":"e000798","DOI":"10.1136\/bmjgh-2018-000798","article-title":"Artificial intelligence (AI) and global health: how can AI contribute to health in resource-poor settings?","volume":"3","author":"Wahl","year":"2018","journal-title":"BMJ Glob Health."},{"key":"B22","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1136\/medethics-2019-105586","article-title":"On the ethics of algorithmic decision-making in healthcare","volume":"46","author":"Grote","year":"2019","journal-title":"J Med Ethics."},{"key":"B23","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: the convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nat Med."}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2022.979448\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,25]],"date-time":"2022-10-25T03:12:11Z","timestamp":1666667531000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2022.979448\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,25]]},"references-count":23,"alternative-id":["10.3389\/fpubh.2022.979448"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2022.979448","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.05.12.22275019","asserted-by":"object"}]},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,25]]},"article-number":"979448"}}