{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T23:52:48Z","timestamp":1791417168414,"version":"4.3.3"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T00:00:00Z","timestamp":1782518400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T00:00:00Z","timestamp":1791417600000},"content-version":"vor","delay-in-days":103,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"PRAIRIE 3IA Institute","award":["ANR-19-P3IA-0001"],"award-info":[{"award-number":["ANR-19-P3IA-0001"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Cardiovasc Disord"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>We present a natural language processing pipeline to extract and re-compute a pre-existing score, the IMPACT-score, in a children\u2019s hospital belonging to the APHP hospitals.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and methods<\/jats:title>\n                    <jats:p>Predictive variables and adverse events occurrences were extracted from the EHR of each patient. Data extraction involved rule-based and machine learning approaches depending on the format of the data. The machine learning text-classifiers were trained on active learning annotated dataset. Once the registry was automatically populated, we computed the IMPACT-score model in our patients and we performed a logistic regression analysis to find the specific odd ratio fitting our cohort and obtain the IMPACT-score-Necker.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We extracted clinical data from 2,980 patients. When applied to our hospital cohort, the IMPACT-score-Necker achieved an AUC of 0.719 whereas the original IMPACT-score achieved an AUC of 0.642. As a reminder, the IMPACT-score achieved an AUC of 0.752 in the NCDR-IMPACT validation cohort.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Local calibration of the IMPACT-score on our cohort enhanced predictive accuracy, improving the AUC from 0.642 to 0.719, and addressing differences between our population and the original NCDR-IMPACT cohort. This reinforces the need for model adaptation to local data, as patient demographic and clinical variations can significantly impact performance. Local EHR data warehouses could be leveraged for recalibration and continuous monitoring, ensuring that AI tools remain accurate, ethical, and practical for clinicians in their clinical practice.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Our results underscore the need for real-world model validation, and EHRs offer a reliable source for training and validating AI models.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12872-026-06065-4","type":"journal-article","created":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T06:17:44Z","timestamp":1782541064000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Validating predictive models on EHRs data : lessons learnt from the NCDR-IMPACT-score applied on a French cardiac catheterization cohort"],"prefix":"10.1186","volume":"26","author":[{"given":"S","family":"Quennelle","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S","family":"Malekzadeh-Milani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"N","family":"Garcelon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A","family":"Burgun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"D","family":"Bonnet","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A","family":"Neuraz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,6,27]]},"reference":[{"key":"6065_CR1","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1111\/j.1747-0803.2010.00385.x","volume":"5","author":"BL Phillips","year":"2010","unstructured":"Phillips BL, Cabalka AK, Hagler DJ, et al. Procedural complications during congenital cardiac catheterization. Congenit Heart Dis. 2010;5:118\u201323. https:\/\/doi.org\/10.1111\/j.1747-0803.2010.00385.x.","journal-title":"Congenit Heart Dis"},{"key":"6065_CR2","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1002\/ccd.21580","volume":"72","author":"R Mehta","year":"2008","unstructured":"Mehta R, Lee K, Chaturvedi R, et al. Complications of pediatric cardiac catheterization: a review in the current era. Cathet Cardio Intervent. 2008;72:278\u201385. https:\/\/doi.org\/10.1002\/ccd.21580.","journal-title":"Cathet Cardio Intervent"},{"key":"6065_CR3","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1017\/S1047951105000843","volume":"15","author":"G Agnoletti","year":"2005","unstructured":"Agnoletti G, Bonnet C, Boudjemline Y, et al. Complications of paediatric interventional catheterisation: an analysis of risk factors. Cardiol Young. 2005;15:402\u20138. https:\/\/doi.org\/10.1017\/S1047951105000843.","journal-title":"Cardiol Young"},{"key":"6065_CR4","doi-asserted-by":"publisher","first-page":"2077","DOI":"10.1093\/eurheartj\/ehx299","volume":"38","author":"A Uebing","year":"2017","unstructured":"Uebing A, Gatzoulis MA, Rigby ML. Therapeutic catheterization in congenital heart disease: reflections on the value of risk scores. Eur Heart J. 2017;38:2077\u20138. https:\/\/doi.org\/10.1093\/eurheartj\/ehx299.","journal-title":"Eur Heart J"},{"key":"6065_CR5","doi-asserted-by":"publisher","unstructured":"Heidenreich PA, Bozkurt B, Aguilar D, et al. 2022 AHA\/ACC\/HFSA guideline for the management of heart failure: a report of the American college of cardiology\/American heart association joint committee on clinical practice guidelines. Circulation. 2022;145. https:\/\/doi.org\/10.1161\/CIR.0000000000001063.","DOI":"10.1161\/CIR.0000000000001063"},{"key":"6065_CR6","doi-asserted-by":"publisher","first-page":"2009","DOI":"10.1161\/CIRCULATIONAHA.117.027714","volume":"136","author":"N Jayaram","year":"2017","unstructured":"Jayaram N, Spertus JA, Kennedy KF, et al. Modeling major adverse outcomes of pediatric and adult patients with congenital heart disease undergoing cardiac catheterization: observations from the NCDR IMPACT registry. Circulation. 2017;136:2009\u201319. https:\/\/doi.org\/10.1161\/CIRCULATIONAHA.117.027714.","journal-title":"Circulation"},{"key":"6065_CR7","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1053\/j.pcsu.2010.02.004","volume":"13","author":"GR Martin","year":"2010","unstructured":"Martin GR, Beekman RH, Ing FF, et al. The IMPACT Registry\u2122: IMproving pediatric and adult congenital treatments. seminars thorac cardiovasc surgery: Pediatr Cardiac Surg Annual. 2010;13:20\u20135. https:\/\/doi.org\/10.1053\/j.pcsu.2010.02.004.","journal-title":"Seminars Thorac Cardiovasc Surgery: Pediatr Cardiac Surg Annual"},{"key":"6065_CR8","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.1016\/j.jacc.2009.07.020","volume":"54","author":"MT Cooney","year":"2009","unstructured":"Cooney MT, Dudina AL, Graham IM. Value and limitations of existing scores for the assessment of cardiovascular risk: a review for clinicians. J Am Coll Cardiol. 2009;54:1209\u201327. https:\/\/doi.org\/10.1016\/j.jacc.2009.07.020.","journal-title":"J Am Coll Cardiol"},{"key":"6065_CR9","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1056\/NEJMp1714229","volume":"378","author":"DS Char","year":"2018","unstructured":"Char DS, Shah NH, Magnus D. Implementing machine learning in health care \u2014 addressing ethical challenges. N Engl J Med. 2018;378:981\u20133. https:\/\/doi.org\/10.1056\/NEJMp1714229.","journal-title":"N Engl J Med"},{"key":"6065_CR10","doi-asserted-by":"publisher","unstructured":"Gijsberts CM, Groenewegen KA, Hoefer IE, et al. Race\/ethnic differences in the associations of the framingham risk factors with carotid IMT and cardiovascular Events. PLoS ONE. 2015;10. https:\/\/doi.org\/10.1371\/journal.pone.0132321.","DOI":"10.1371\/journal.pone.0132321"},{"key":"6065_CR11","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1158\/1055-9965.EPI-22-0873","volume":"32","author":"U Chandran","year":"2023","unstructured":"Chandran U, Reps J, Yang R, et al. Machine learning and real-world data to predict lung cancer risk in routine care. Cancer Epidemiol Biomarkers Prev. 2023;32:337\u201343. https:\/\/doi.org\/10.1158\/1055-9965.EPI-22-0873.","journal-title":"Cancer Epidemiol Biomarkers Prev"},{"key":"6065_CR12","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1186\/s12916-019-1340-7","volume":"17","author":"JA Damen","year":"2019","unstructured":"Damen JA, Pajouheshnia R, Heus P, et al. Performance of the framingham risk models and pooled cohort equations for predicting 10-year risk of cardiovascular disease: a systematic review and meta-analysis. BMC Med. 2019;17:109. https:\/\/doi.org\/10.1186\/s12916-019-1340-7.","journal-title":"BMC Med"},{"key":"6065_CR13","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1016\/j.ihj.2017.01.015","volume":"69","author":"N Garg","year":"2017","unstructured":"Garg N, Muduli SK, Kapoor A, et al. Comparison of different cardiovascular risk score calculators for cardiovascular risk prediction and guideline recommended statin uses. Indian Heart J. 2017;69:458\u201363. https:\/\/doi.org\/10.1016\/j.ihj.2017.01.015.","journal-title":"Indian Heart J"},{"key":"6065_CR14","doi-asserted-by":"publisher","unstructured":"QuennelleS, Douillet M, Friedlander L, et al. The smart data extractor, a clinician friendly solution to accelerate and improve the data collection during clinical trials. caring is sharing \u2013 exploiting the value in data for health and innovation. IOS; 2023. p. 247\u201351. https:\/\/doi.org\/10.3233\/SHTI230112.","DOI":"10.3233\/SHTI230112"},{"key":"6065_CR15","doi-asserted-by":"publisher","first-page":"105761","DOI":"10.1016\/j.ijmedinf.2024.105761","volume":"195","author":"S Quennelle","year":"2025","unstructured":"Quennelle S, Malekzadeh-Milani S, Garcelon N, et al. Active learning for extracting rare adverse events from electronic health records: a study in pediatric cardiology. Int J Med Informatics. 2025;195:105761. https:\/\/doi.org\/10.1016\/j.ijmedinf.2024.105761.","journal-title":"Int J Med Informatics"},{"key":"6065_CR16","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1097\/MLR.0b013e31827da594","volume":"51","author":"EH Kennedy","year":"2013","unstructured":"Kennedy EH, Wiitala WL, Hayward RA, et al. Improved cardiovascular risk prediction using nonparametric regression and electronic health record data. Med Care. 2013;51:251\u20138. https:\/\/doi.org\/10.1097\/MLR.0b013e31827da594.","journal-title":"Med Care"},{"key":"6065_CR17","doi-asserted-by":"publisher","first-page":"e2433009","DOI":"10.1001\/jamanetworkopen.2024.33009","volume":"7","author":"NH Shah","year":"2024","unstructured":"Shah NH, Pfeffer MA, Ghassemi M. The need for continuous evaluation of artificial intelligence prediction algorithms. JAMA Netw Open. 2024;7:e2433009. https:\/\/doi.org\/10.1001\/jamanetworkopen.2024.33009.","journal-title":"JAMA Netw Open"},{"key":"6065_CR18","doi-asserted-by":"publisher","unstructured":"Adams L. Artificial intelligence in health, health care, and biomedical science: an AI code of conduct principles and commitments discussion draft. Health Care. 2024. https:\/\/doi.org\/10.31478\/202403a.","DOI":"10.31478\/202403a"},{"key":"6065_CR19","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1016\/j.patcog.2011.06.019","volume":"45","author":"JG Moreno-Torres","year":"2012","unstructured":"Moreno-Torres JG, Raeder T, Alaiz-Rodr\u00edguez R, et al. A unifying view on dataset shift in classification. Pattern Recogn. 2012;45:521\u201330. https:\/\/doi.org\/10.1016\/j.patcog.2011.06.019.","journal-title":"Pattern Recogn"},{"key":"6065_CR20","doi-asserted-by":"publisher","first-page":"1173","DOI":"10.1109\/TBME.2021.3117407","volume":"69","author":"H Guan","year":"2022","unstructured":"Guan H, Liu M. Domain adaptation for medical image analysis: a survey. IEEE Trans Biomed Eng. 2022;69:1173\u201385. https:\/\/doi.org\/10.1109\/TBME.2021.3117407.","journal-title":"IEEE Trans Biomed Eng"},{"key":"6065_CR21","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1056\/NEJMc2104626","volume":"385","author":"G Finlayson Samuel","year":"2021","unstructured":"Finlayson Samuel G, Adarsh S, Karandeep S, et al. The clinician and dataset shift in artificial intelligence. N Engl J Med. 2021;385:283\u20136. https:\/\/doi.org\/10.1056\/NEJMc2104626.","journal-title":"N Engl J Med"},{"key":"6065_CR22","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1093\/biostatistics\/kxz041","volume":"21","author":"A Subbaswamy","year":"2020","unstructured":"Subbaswamy A, Saria S. From development to deployment: dataset shift, causality, and shift-stable models in health AI. Biostatistics. 2020;21:345\u201352. https:\/\/doi.org\/10.1093\/biostatistics\/kxz041.","journal-title":"Biostatistics"},{"key":"6065_CR23","unstructured":"The Clinician and Dataset Shift in Artificial Intelligence | New England Journal of Medicine. https:\/\/www.nejm.org\/doi\/10.1056\/NEJMc2104626?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub%20%200pubmed. Accessed 21 June 2024."},{"key":"6065_CR24","doi-asserted-by":"publisher","first-page":"2409","DOI":"10.1038\/s41591-024-03181-6","volume":"30","author":"S Bedi","year":"2024","unstructured":"Bedi S, Jain SS, Shah NH. Evaluating the clinical benefits of LLMs. Nat Med. 2024;30:2409\u201310. https:\/\/doi.org\/10.1038\/s41591-024-03181-6.","journal-title":"Nat Med"},{"key":"6065_CR25","doi-asserted-by":"publisher","first-page":"2613","DOI":"10.1038\/s41591-024-03097-1","volume":"30","author":"P Hager","year":"2024","unstructured":"Hager P, Jungmann F, Holland R, et al. Evaluation and mitigation of the limitations of large language models in clinical decision-making. Nat Med. 2024;30:2613\u201322. https:\/\/doi.org\/10.1038\/s41591-024-03097-1.","journal-title":"Nat Med"},{"key":"6065_CR26","doi-asserted-by":"publisher","first-page":"e210064","DOI":"10.1148\/ryai.210064","volume":"4","author":"AC Yu","year":"2022","unstructured":"Yu AC, Mohajer B, Eng J. External validation of deep learning algorithms for radiologic diagnosis: a systematic review. Radiol Artif Intell. 2022;4:e210064. https:\/\/doi.org\/10.1148\/ryai.210064.","journal-title":"Radiol Artif Intell"},{"key":"6065_CR27","doi-asserted-by":"publisher","first-page":"405","DOI":"10.3348\/kjr.2019.0025","volume":"20","author":"DW Kim","year":"2019","unstructured":"Kim DW, Jang HY, Kim KW, et al. Design characteristics of studies reporting the performance of artificial intelligence algorithms for diagnostic analysis of medical images: results from recently published papers. Korean J Radiol. 2019;20:405. https:\/\/doi.org\/10.3348\/kjr.2019.0025.","journal-title":"Korean J Radiol"},{"key":"6065_CR28","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-023-02540-z","author":"A Youssef","year":"2023","unstructured":"Youssef A, Pencina M, Thakur A, et al. External validation of AI models in health should be replaced with recurring local validation. Nat Med Published Online First: 18 Oct. 2023. https:\/\/doi.org\/10.1038\/s41591-023-02540-z.","journal-title":"Nat Med Published Online First: 18 Oct"},{"key":"6065_CR29","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1038\/s41591-022-01894-0","volume":"28","author":"R Adams","year":"2022","unstructured":"Adams R, Henry KE, Sridharan A, et al. Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis. Nat Med. 2022;28:1455\u201360. https:\/\/doi.org\/10.1038\/s41591-022-01894-0.","journal-title":"Nat Med"},{"key":"6065_CR30","unstructured":"Ethics guidelines for trustworthy AI | Shaping Europe\u2019s digital future. 2019. https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai. Accessed 24 Sep 2024."}],"container-title":["BMC Cardiovascular Disorders"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12872-026-06065-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12872-026-06065-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12872-026-06065-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T23:25:35Z","timestamp":1791415535000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s12872-026-06065-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,27]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["6065"],"URL":"https:\/\/doi.org\/10.1186\/s12872-026-06065-4","relation":{},"ISSN":["1471-2261"],"issn-type":[{"value":"1471-2261","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,27]]},"assertion":[{"value":"15 November 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 June 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 June 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The study, recorded under registration number N\u00b02022 0503160104, was approved by the APHP ethical committee. Clinical trial number: not applicable.","order":1,"name":"Ethics","label":"Ethics approval and consent to participate","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"887"}}