{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T12:47:27Z","timestamp":1774529247312,"version":"3.50.1"},"reference-count":63,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,2,6]],"date-time":"2025-02-06T00:00:00Z","timestamp":1738800000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"},{"start":{"date-parts":[[2025,2,6]],"date-time":"2025-02-06T00:00:00Z","timestamp":1738800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"funder":[{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"EC | Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945260"],"award-info":[{"award-number":["945260"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"DOI":"10.1038\/s41746-025-01459-8","type":"journal-article","created":{"date-parts":[[2025,2,6]],"date-time":"2025-02-06T07:53:46Z","timestamp":1738828426000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["CORE-MD clinical risk score for regulatory evaluation of artificial intelligence-based medical device software"],"prefix":"10.1038","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7786-4179","authenticated-orcid":false,"given":"Frank E.","family":"Rademakers","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9090-3315","authenticated-orcid":false,"given":"Elisabetta","family":"Biasin","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0272-5617","authenticated-orcid":false,"given":"Nico","family":"Bruining","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1770-6486","authenticated-orcid":false,"given":"Enrico G.","family":"Caiani","sequence":"additional","affiliation":[]},{"given":"Rhodri H.","family":"Davies","sequence":"additional","affiliation":[]},{"given":"Stephen H.","family":"Gilbert","sequence":"additional","affiliation":[]},{"given":"Eric","family":"Kamenjasevic","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0005-3615-1876","authenticated-orcid":false,"given":"Gear\u00f3id","family":"McGauran","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4839-8412","authenticated-orcid":false,"given":"Gear\u00f3id","family":"O\u2019Connor","sequence":"additional","affiliation":[]},{"given":"Jean-Baptiste","family":"Rouffet","sequence":"additional","affiliation":[]},{"given":"Baptiste","family":"Vasey","sequence":"additional","affiliation":[]},{"given":"Alan G.","family":"Fraser","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,2,6]]},"reference":[{"key":"1459_CR1","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","volume":"28","author":"P Rajpurkar","year":"2022","unstructured":"Rajpurkar, P., Chen, E., Banerjee, O. & Topol, E. J. AI in health and medicine. Nat. Med. 28, 31\u201338 (2022).","journal-title":"Nat. Med."},{"key":"1459_CR2","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.1056\/NEJMra2212850","volume":"389","author":"DJ Hunter","year":"2023","unstructured":"Hunter, D. J. & Holmes, C. Where medical statistics meets artificial intelligence. N. Engl. J. Med. 389, 1211\u20131219 (2023).","journal-title":"N. Engl. J. Med."},{"key":"1459_CR3","unstructured":"World Health Organization. Regulatory considerations on artificial intelligence for health. https:\/\/www.who.int\/publications\/i\/item\/9789240078871 (2023)."},{"key":"1459_CR4","doi-asserted-by":"publisher","first-page":"205520762311893","DOI":"10.1177\/20552076231189331","volume":"9","author":"OV Bitkina","year":"2023","unstructured":"Bitkina, O. V., Park, J. & Kim, H. K. Application of artificial intelligence in medical technologies: a systematic review of main trends. Digit. Health 9, 20552076231189331 (2023).","journal-title":"Digit. Health"},{"key":"1459_CR5","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1177\/1062860619878515","volume":"35","author":"S Ellahham","year":"2020","unstructured":"Ellahham, S., Ellahham, N. & Simsekler, M. C. E. Application of artificial intelligence in the health care safety context: opportunities and challenges. Am. J. Med. Qual. 35, 341\u2013348 (2020).","journal-title":"Am. J. Med. Qual."},{"key":"1459_CR6","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1080\/17434440.2023.2184685","volume":"20","author":"AG Fraser","year":"2023","unstructured":"Fraser, A. G. et al. Artificial intelligence in medical device software and high-risk medical devices \u2013 a review of definitions, expert recommendations and regulatory initiatives. Expert Rev. Med. Devices 20, 467\u2013491 (2023).","journal-title":"Expert Rev. Med. Devices"},{"key":"1459_CR7","unstructured":"European Commission. Medical Devices Coordination Group Document MDCG 2020-1. Guidance on Clinical Evaluation (MDR) \/ Performance Evaluation (IVDR) of Medical Device Software. https:\/\/health.ec.europa.eu\/system\/files\/2020-09\/md_mdcg_2020_1_guidance_clinic_eva_md_software_en_0.pdf (2020)."},{"key":"1459_CR8","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1093\/ehjqcco\/qcab059","volume":"8","author":"AG Fraser","year":"2022","unstructured":"Fraser, A. G. et al. Improved clinical investigation and evaluation of high-risk medical devices: the rationale and objectives of CORE-MD (Coordinating Research and Evidence for Medical Devices). Eur. Heart J. Qual. Care Clin. Outcomes 8, 249\u2013258 (2022).","journal-title":"Eur. Heart J. Qual. Care Clin. Outcomes"},{"key":"1459_CR9","doi-asserted-by":"publisher","unstructured":"Balahur-Dobrescu, A. et al. Data quality requirements for inclusive, non-biased and trustworthy AI. https:\/\/doi.org\/10.2760\/365479, JRC131097 (Publications Office of the European Union, Luxembourg, 2022).","DOI":"10.2760\/365479"},{"key":"1459_CR10","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1136\/bmj.312.7023.71","volume":"312","author":"DL Sackett","year":"1996","unstructured":"Sackett, D. L., Rosenberg, W. M., Gray, J. A., Haynes, R. B. & Richardson, W. S. Evidence based medicine: what it is and what it isn\u2019t. BMJ 312, 71\u201372 (1996).","journal-title":"BMJ"},{"key":"1459_CR11","first-page":"5","volume":"30","author":"JD Rozich","year":"2004","unstructured":"Rozich, J. D. et al. Standardization as a mechanism to improve safety in health care. Jt. Comm. J. Qual. Saf. 30, 5\u201314 (2004).","journal-title":"Jt. Comm. J. Qual. Saf."},{"key":"1459_CR12","unstructured":"Kahneman, D., Sibony, O. & Sunstein, C. R. Noise: a Flaw in Human Judgment (Little, Brown Spark, New York, 2021)."},{"key":"1459_CR13","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1177\/0018720817743223","volume":"60","author":"NJ McNeese","year":"2018","unstructured":"McNeese, N. J., Demir, M., Cooke, N. J. & Myers, C. Teaming with a synthetic teammate: insights into human-autonomy teaming. Hum. Factors 60, 262\u2013273 (2018).","journal-title":"Hum. Factors"},{"key":"1459_CR14","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1093\/ajcl\/avab012","volume":"69","author":"S Chesterman","year":"2021","unstructured":"Chesterman, S. Through a glass, darkly: artificial intelligence and the problem of opacity. Am. J. Comp. Law 69, 271\u2013294 (2021).","journal-title":"Am. J. Comp. Law"},{"key":"1459_CR15","unstructured":"Doshi-Velez, F. & Kim, B. Towards a rigorous science of interpretable machine learning. Preprint at http:\/\/arxiv.org\/abs\/1702.08608 (2017)."},{"key":"1459_CR16","doi-asserted-by":"publisher","first-page":"e745","DOI":"10.1016\/S2589-7500(21)00208-9","volume":"3","author":"M Ghassemi","year":"2021","unstructured":"Ghassemi, M., Oakden-Rayner, L. & Beam, A. L. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit. Health 3, e745\u2013e750 (2021).","journal-title":"Lancet Digit. Health"},{"key":"1459_CR17","doi-asserted-by":"publisher","DOI":"10.1126\/scitranslmed.aao5333","volume":"10","author":"W Nicholson Price","year":"2018","unstructured":"Nicholson Price, W. Big data and black-box medical algorithms. Sci. Transl. Med. 10, eaao5333 (2018).","journal-title":"Sci. Transl. Med."},{"key":"1459_CR18","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1001\/jamadermatol.2018.4378","volume":"155","author":"P Tschandl","year":"2019","unstructured":"Tschandl, P. et al. Expert-level diagnosis of nonpigmented skin cancer by combined convolutional neural networks. JAMA Dermatol. 155, 58\u201365 (2019).","journal-title":"JAMA Dermatol."},{"key":"1459_CR19","doi-asserted-by":"publisher","first-page":"1271","DOI":"10.1001\/jamadermatol.2021.3128","volume":"157","author":"P Tschandl","year":"2021","unstructured":"Tschandl, P. Risk of bias and error from data sets used for dermatologic artificial intelligence. JAMA Dermatol. 157, 1271\u20131273 (2021).","journal-title":"JAMA Dermatol."},{"key":"1459_CR20","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41746-021-00385-9","volume":"4","author":"S Gaube","year":"2021","unstructured":"Gaube, S. et al. Do as AI say: susceptibility in deployment of clinical decision-aids. NPJ Digit. Med. 4, 31 (2021).","journal-title":"NPJ Digit. Med."},{"key":"1459_CR21","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1038\/s41591-020-0942-0","volume":"26","author":"P Tschandl","year":"2020","unstructured":"Tschandl, P. et al. Human\u2013computer collaboration for skin cancer recognition. Nat. Med. 26, 1229\u20131234 (2020).","journal-title":"Nat. Med."},{"key":"1459_CR22","doi-asserted-by":"publisher","unstructured":"Agarwal, N., Moehring, A., Rajpurkar, P. & Salz, T. Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology. Working paper 31422 https:\/\/doi.org\/10.3386\/w31422 (National Bureau of Economic Research, 2023).","DOI":"10.3386\/w31422"},{"key":"1459_CR23","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1038\/s41591-024-02850-w","volume":"30","author":"F Yu","year":"2024","unstructured":"Yu, F. et al. Heterogeneity and predictors of the effects of AI assistance on radiologists. Nat. Med. 30, 837\u2013849 (2024).","journal-title":"Nat. Med."},{"key":"1459_CR24","doi-asserted-by":"publisher","first-page":"e211276","DOI":"10.1001\/jamanetworkopen.2021.1276","volume":"4","author":"B Vasey","year":"2021","unstructured":"Vasey, B. et al. Association of clinician diagnostic performance with machine learning-based decision support systems: A systematic review. JAMA Netw. Open 4, e211276 (2021).","journal-title":"JAMA Netw. Open"},{"key":"1459_CR25","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1080\/10447318.2020.1741118","volume":"36","author":"B Shneiderman","year":"2020","unstructured":"Shneiderman, B. Human-centered artificial intelligence: reliable, safe & trustworthy. Int. J. Hum. Comput. Interact. 36, 495\u2013504 (2020).","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"1459_CR26","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.1016\/j.jcmg.2023.05.012","volume":"16","author":"D Dey","year":"2023","unstructured":"Dey, D. et al. Proceedings of the NHLBI workshop on artificial intelligence in cardiovascular imaging: translation patient care. JACC Cardiovasc. Imaging 16, 1209\u20131223 (2023).","journal-title":"JACC Cardiovasc. Imaging"},{"key":"1459_CR27","doi-asserted-by":"publisher","first-page":"e30545","DOI":"10.2196\/30545","volume":"23","author":"S Gilbert","year":"2021","unstructured":"Gilbert, S. et al. Algorithm change protocols in the regulation of adaptive machine learning-based medical devices. J. Med. Internet Res. 23, e30545 (2021).","journal-title":"J. Med. Internet Res."},{"key":"1459_CR28","doi-asserted-by":"publisher","first-page":"e16323","DOI":"10.2196\/16323","volume":"21","author":"E Coiera","year":"2019","unstructured":"Coiera, E. The last mile: where artificial intelligence meets reality. J. Med. Internet Res. 21, e16323 (2019).","journal-title":"J. Med. Internet Res."},{"key":"1459_CR29","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2020-100301","volume":"28","author":"D Lyell","year":"2021","unstructured":"Lyell, D., Coier, A. E., Chen, J., Shah, P. & Magrabi, F. How machine learning is embedded to support clinician decision making: an analysis of FDA-approved medical devices. BMJ Health Care Inform. 28, e100301 (2021).","journal-title":"BMJ Health Care Inform."},{"key":"1459_CR30","unstructured":"Health Sciences Authority (Singapore). Regulatory guidelines for software medical devices - A lifecycle approach. Revision 2.0 https:\/\/www.hsa.gov.sg\/docs\/default-source\/hprg-mdb\/guidance-documents-for-medical-devices\/regulatory-guidelines-for-software-medical-devices---a-life-cycle-approach_r2-(2022-apr)-pub.pdf (2022)."},{"key":"1459_CR31","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1038\/s41746-022-00690-x","volume":"5","author":"J Zhang","year":"2022","unstructured":"Zhang, J. et al. Moving towards vertically integrated artificial intelligence development. NPJ Digit. Med. 5, 143 (2022).","journal-title":"NPJ Digit. Med."},{"key":"1459_CR32","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1038\/s41746-020-0262-2","volume":"3","author":"S Gerke","year":"2020","unstructured":"Gerke, S., Babic, B., Evgeniou, T. & Cohen, I. G. The need for a system view to regulate artificial intelligence\/machine learning-based software as medical device. NPJ Digit. Med. 3, 53 (2020).","journal-title":"NPJ Digit. Med."},{"key":"1459_CR33","doi-asserted-by":"publisher","unstructured":"Daly, A. et al. Artificial Intelligence, Governance and Ethics: Global Perspectives. Paper No. 2019\/033. https:\/\/doi.org\/10.2139\/ssrn.3414805 (Chinese University of Hong Kong Faculty of Law Research, 2019).","DOI":"10.2139\/ssrn.3414805"},{"key":"1459_CR34","unstructured":"Biasin, E., Bre\u0161i\u0107, D., Kamenja\u0161evi\u0107, E. & Notermans, P. Analysis of ethics, privacy, and confidentiality constraints. SAFECARE project deliverable 3.9. Lead Author: KUL. https:\/\/www.safecare-project.eu\/wp-content\/uploads\/2020\/02\/Analysis-of-Ethics-Privacy-and-Confidentiality-Restraints.pdf (2018)."},{"key":"1459_CR35","doi-asserted-by":"publisher","first-page":"Spec No:S16\u201327","DOI":"10.1002\/hast.134","volume":"43","author":"RR Faden","year":"2013","unstructured":"Faden, R. R. et al. An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics. Hastings Cent. Rep. 43, Spec No:S16\u201327 (2013).","journal-title":"Hastings Cent. Rep."},{"key":"1459_CR36","unstructured":"High-Level Expert Group on Artificial Intelligence set up by the European Commission. Ethics guidelines for trustworthy AI. https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai (2019)."},{"key":"1459_CR37","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1001\/jama.2024.0549","volume":"331","author":"JW Ayers","year":"2024","unstructured":"Ayers, J. W., Desai, N. & Smith, D. M. Regulate artificial intelligence in health care by prioritizing patient outcomes. JAMA 331, 639\u2013640 (2024).","journal-title":"JAMA"},{"key":"1459_CR38","unstructured":"NIST. AI Risk Management Framework Playbook-MAP https:\/\/www.nist.gov\/itl\/ai-risk-management-framework\/nist-ai-rmf-playbook (2023)."},{"key":"1459_CR39","unstructured":"NIST. AI Risk Management Framework Playbook-MEASURE https:\/\/www.nist.gov\/itl\/ai-risk-management-framework\/nist-ai-rmf-playbook (2023)."},{"key":"1459_CR40","unstructured":"NIST. AI Risk Management Framework Playbook-MANAGE https:\/\/www.nist.gov\/itl\/ai-risk-management-framework\/nist-ai-rmf-playbook (2023)."},{"key":"1459_CR41","unstructured":"NIST. AI Risk Management Framework Playbook-GOVERN https:\/\/www.nist.gov\/itl\/ai-risk-management-framework\/nist-ai-rmf-playbook (2023)."},{"key":"1459_CR42","unstructured":"NIST. Risk Management Framework Quick Start Guide. Roles and Responsibilities Crosswalk https:\/\/nist.gov\/rmf (2021)."},{"key":"1459_CR43","unstructured":"NIST. Privacy Framework Core https:\/\/www.nist.gov\/privacy-framework (2020)."},{"key":"1459_CR44","unstructured":"Bernal-Delgado, E. et al. Report on architecture and infrastructure options to support EHDS services for secondary use of data. https:\/\/tehdas.eu\/app\/uploads\/2023\/03\/tehdas-report-on-architecture-and-infrastructure-options-to-support-ehds-services.pdf (2023)."},{"key":"1459_CR45","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1515\/lehr-2019-0004","volume":"13","author":"G Newlands","year":"2019","unstructured":"Newlands, G., Lutz, C. & Fieseler, C. Trading on the unknown: scenarios for the future value of data. Law Ethics Hum. Rights 13, 97\u2013114 (2019).","journal-title":"Law Ethics Hum. Rights"},{"key":"1459_CR46","first-page":"1052","volume":"50","author":"P Andanda","year":"2019","unstructured":"Andanda, P. Towards a paradigm shift in governing data access and related intellectual property rights in big data and health-related research. IIC Int. Rev. Intellect. Prop. Compet. Law 50, 1052\u20131081 (2019).","journal-title":"IIC Int. Rev. Intellect. Prop. Compet. Law"},{"key":"1459_CR47","doi-asserted-by":"publisher","unstructured":"Starkbaum, J. & Felt, U. Negotiating the reuse of health-data: Research, Big Data, and the European General Data Protection Regulation. Big Data Soc. https:\/\/doi.org\/10.1177\/2053951719862594 (2019).","DOI":"10.1177\/2053951719862594"},{"key":"1459_CR48","doi-asserted-by":"publisher","first-page":"2021","DOI":"10.1056\/NEJMp2308736","volume":"389","author":"KT Kadakia","year":"2023","unstructured":"Kadakia, K. T., Kramer, D. B. & Yeh, R. W. Coverage for emerging technologies \u2014 bridging regulatory approval and patient access. N. Engl. J. Med. 389, 2021\u20132024 (2023).","journal-title":"N. Engl. J. Med."},{"key":"1459_CR49","doi-asserted-by":"publisher","first-page":"e50158","DOI":"10.2196\/50158","volume":"25","author":"C Welzel","year":"2023","unstructured":"Welzel, C. et al. Holistic human-serving digitization of health care needs integrated automated system-level assessment tools. J. Med. Internet Res. 25, e50158 (2023).","journal-title":"J. Med. Internet Res."},{"key":"1459_CR50","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1038\/s41746-024-01237-y","volume":"7","author":"A Balendran","year":"2024","unstructured":"Balendran, A., Benchoufi, M., Evgeniou, T. & Ravaud, P. Algorithmovigilance, lessons from pharmacovigilance. NPJ Digit. Med. 7, 270 (2024).","journal-title":"NPJ Digit. Med."},{"key":"1459_CR51","unstructured":"European Commission. Guidelines on the qualification and classification of stand alone software used in healthcare within the regulatory framework of medical devices. Medical Devices Guidance Document MEDDEV 2.1\/6 (2016)European Commission. Guidelines on the qualification and classification of stand alone software used in healthcare within the regulatory framework of medical devices. Medical Devices Guidance Document MEDDEV 2.1\/6 (2016)."},{"key":"1459_CR52","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-019-0192-5","volume":"6","author":"JM Johnson","year":"2019","unstructured":"Johnson, J. M. & Khoshgoftaar, T. M. Survey on deep learning with class imbalance. J. Big Data 6, 27 (2019).","journal-title":"J. Big Data"},{"key":"1459_CR53","doi-asserted-by":"publisher","unstructured":"Mosquera, C., Ferrer, L., Milone, D. H., Luna, D. & Ferrante, E. Class imbalance on medical image classification: towards better evaluation practices for discrimination and calibration performance. Eur. Radiol. https:\/\/doi.org\/10.1007\/s00330-024-10834-0 (2024).","DOI":"10.1007\/s00330-024-10834-0"},{"key":"1459_CR54","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1038\/s42256-020-00257-z","volume":"2","author":"R Geirhos","year":"2020","unstructured":"Geirhos, R. et al. Shortcut learning in deep neural networks. Nat. Mach. Intell. 2, 665\u2013673 (2020).","journal-title":"Nat. Mach. Intell."},{"key":"1459_CR55","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-019-1426-2","volume":"17","author":"CJ Kelly","year":"2019","unstructured":"Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G. & King, D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 17, 195 (2019).","journal-title":"BMC Med."},{"key":"1459_CR56","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","volume":"366","author":"Z Obermeyer","year":"2019","unstructured":"Obermeyer, Z., Powers, B., Vogeli, C. & Mullainathan, S. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 447\u2013453 (2019).","journal-title":"Science"},{"key":"1459_CR57","unstructured":"International Medical Device Regulators Forum. Software as a Medical Device Working Group. Software as a Medical Device (SaMD): Clinical Evaluation. IMDRF\/SaMD WG\/N41FINAL:2017. https:\/\/www.imdrf.org\/sites\/default\/files\/docs\/imdrf\/final\/technical\/imdrf-tech-170921-samd-n41-clinical-evaluation_1.pdf (2017)."},{"key":"1459_CR58","unstructured":"International Medical Device Regulators Forum. IMDRF\/SaMD WG\/N23 FINAL: 2015 - Software as a Medical Device (SaMD): Application of Quality Management System. (2015)."},{"key":"1459_CR59","unstructured":"International Medical Device Regulators Forum. Machine Learning-enabled medical devices-a subset of artificial intelligence-enabled medical devices: key terms and definitions. IMDRF AIMD Working Group. (2021)."},{"key":"1459_CR60","unstructured":"US Food and Drug Adminstration, Health Canada, and the Medicines & Healthcare Products Regulatory Authority. Good machine learning practice for medical device development: guiding principles. https:\/\/www.fda.gov\/media\/153486\/download (2021)."},{"key":"1459_CR61","doi-asserted-by":"publisher","first-page":"e000066","DOI":"10.1136\/bmjsit-2020-000066","volume":"3","author":"C Fleetcroft","year":"2021","unstructured":"Fleetcroft, C., McCulloch, P. & Campbell, B. IDEAL as a guide to designing clinical device studies consistent with the new European medical device regulation. BMJ Surg. Interv. Health Technol. 3, e000066 (2021).","journal-title":"BMJ Surg. Interv. Health Technol."},{"key":"1459_CR62","doi-asserted-by":"publisher","unstructured":"Warraich, H. J., Tazbaz, T. & Califf, R. M. FDA perspective on the regulation of artificial intelligence in health care and biomedicine. JAMA https:\/\/doi.org\/10.1001\/jama.2024.21451 (2024).","DOI":"10.1001\/jama.2024.21451"},{"key":"1459_CR63","unstructured":"FDA. Proposed regulatory framework for modifications to artificial intelligence\/machine learning (AI\/ML)-based software as a medical device (SaMD)\u2014discussion paper and request for feedback https:\/\/www.fda.gov\/files\/medical%20devices\/published\/USFDA-Artificial-Intelligence-and-Machine-Learning-Discussion-Paper.pdf (2024)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-01459-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-01459-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-01459-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,6]],"date-time":"2025-02-06T07:53:57Z","timestamp":1738828437000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-01459-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,6]]},"references-count":63,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["1459"],"URL":"https:\/\/doi.org\/10.1038\/s41746-025-01459-8","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,6]]},"assertion":[{"value":"12 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 February 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"F.R.: Occasional travel and accommodation costs to CORE\u2013MD meetings were supported within the EU Horizon 2020 grant budget (2022-204); senior associate editor European Heart Journal, Cardiovascular Imaging. E.B.: external collaborative expert at the European Medicine Agency between 2023 and 2024 (unpaid collaboration); Occasional travel and accommodation costs to CORE\u2013MD meetings were supported within the EU Horizon 2020 grant budget (2022-204). N.B.: Honorarium for presentation at Great Wall Cardiac Congress; ESC paid Article Processing Costs for one article in the European Heart Journal \u2013 Digital Health; Heart Rhythm Society paid travel costs for presentation at HRX; ESC Vice-chair Digital Health Committee; Editor-in-Chief of European Heart Journal \u2013 Digital Health. E.C.: Research contract with Luxottica S.p.A, Payment to my institution; Research contract with Croce Rossa Italiana, Payment to my institution; Project evaluator for the Autonomous Province of Trento, Italy; Honoraria for presentations from Dynamicom Education Srl, Summeet Srl, AIM Italy S.r.l.; Member of the Regulatory Affairs committee of the European Society of Cardiology. R.D.: minority shareholder in myocardium.AI; Consulting fees were paid directly to him. The company develops AI products for cardiac MR image analysis and is in the process of applying for regulatory approval. S.G.: German Federal Ministry of Education and Research (Bundesministerium f\u00fcr Bildung und Forschung, BMBF) through the European Union-financed NextGenerationEU programme under grant number 16KISA100K, project PATH\u2014\u2018Personal Mastery of Health and Wellness Data\u2019. The European Commission under the Horizon Europe Programme, as part of the projects CYMEDSEC (101094218) and ASSESS-DHT (101137347). S.G. has or has had consulting relationships with Una Health GmbH, Lindus Health Ltd.; Flo Ltd, Thymia Ltd., FORUM Institut f\u00fcr Management GmbH, High-Tech Gr\u00fcnderfonds Management GmbH, Ada Health GmbH, and he holds share options in Ada Health GmbH. Support and honoraria for TK Health Economics Forum at MEDICA. Advisory Group member of the EY-coordinated \u2018Study on Regulatory Governance and Innovation in the Field of Medical Devices\u2019 conducted on behalf of the DG SANTE of the European Commission. Share options in Ada Health GmbH. S.G. is a News and Views Editor for npj Digital Medicine. S.G. played no role in the internal review or decision to publish this article. G.M.: Occasional travel and accommodation costs to CORE\u2013MD meetings were supported within the EU Horizon 2020 grant budget (2022-204). Health Products Regulatory Authority, Source of employment. G.O.: Health Products Regulatory Authority, Source of employment. J.B.R.: none. B.V.: Berrow Foundation Lord Florey scholarship. A.G.: Chair, Regulatory Affairs Committee, Biomedical Alliance in Europe.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"90"}}