{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T20:33:26Z","timestamp":1777667606851,"version":"3.51.4"},"reference-count":27,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T00:00:00Z","timestamp":1701216000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["UL1TR002553"],"award-info":[{"award-number":["UL1TR002553"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,2,16]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The complexity and rapid pace of development of algorithmic technologies pose challenges for their regulation and oversight in healthcare settings. We sought to improve our institution\u2019s approach to evaluation and governance of algorithmic technologies used in clinical care and operations by creating an Implementation Guide that standardizes evaluation criteria so that local oversight is performed in an objective fashion.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Building on a framework that applies key ethical and quality principles (clinical value and safety, fairness and equity, usability and adoption, transparency and accountability, and regulatory compliance), we created concrete guidelines for evaluating algorithmic technologies at our institution.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>An Implementation Guide articulates evaluation criteria used during review of algorithmic technologies and details what evidence supports the implementation of ethical and quality principles for trustworthy health AI. Application of the processes described in the Implementation Guide can lead to algorithms that are safer as well as more effective, fair, and equitable upon implementation, as illustrated through 4 examples of technologies at different phases of the algorithmic lifecycle that underwent evaluation at our academic medical center.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>By providing clear descriptions\/definitions of evaluation criteria and embedding them within standardized processes, we streamlined oversight processes and educated communities using and developing algorithmic technologies within our institution.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>We developed a scalable, adaptable framework for translating principles into evaluation criteria and specific requirements that support trustworthy implementation of algorithmic technologies in patient care and healthcare operations.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad221","type":"journal-article","created":{"date-parts":[[2023,11,30]],"date-time":"2023-11-30T07:59:52Z","timestamp":1701331192000},"page":"705-713","source":"Crossref","is-referenced-by-count":44,"title":["Translating ethical and quality principles for the effective, safe and fair development, deployment and use of artificial intelligence technologies in healthcare"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-4078-9809","authenticated-orcid":false,"given":"Nicoleta J","family":"Economou-Zavlanos","sequence":"first","affiliation":[{"name":"Duke AI Health, Duke University School of Medicine , Durham, NC 27705, United States"}]},{"given":"Sophia","family":"Bessias","sequence":"additional","affiliation":[{"name":"Duke AI Health, Duke University School of Medicine , Durham, NC 27705, United States"}]},{"suffix":"Jr","given":"Michael P","family":"Cary","sequence":"additional","affiliation":[{"name":"Duke AI Health, Duke University School of Medicine , Durham, NC 27705, United States"},{"name":"Duke University School of Nursing , Durham, NC 27710, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6496-7024","authenticated-orcid":false,"given":"Armando D","family":"Bedoya","sequence":"additional","affiliation":[{"name":"Duke Health Technology Solutions, Duke University Health System , Durham, NC 27705, United States"},{"name":"Department of Medicine, Duke University School of Medicine , Durham, NC 27710, United States"}]},{"given":"Benjamin A","family":"Goldstein","sequence":"additional","affiliation":[{"name":"Duke AI Health, Duke University School of Medicine , Durham, NC 27705, United States"},{"name":"Department of Biostatistics and Bioinformatics, Duke University School of Medicine , Durham, NC 27705, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7196-817X","authenticated-orcid":false,"given":"John E","family":"Jelovsek","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, Duke University School of Medicine , Durham, NC 27710, United States"}]},{"given":"Cara L","family":"O\u2019Brien","sequence":"additional","affiliation":[{"name":"Duke Health Technology Solutions, Duke University Health System , Durham, NC 27705, United States"},{"name":"Department of Medicine, Duke University School of Medicine , Durham, NC 27710, United States"}]},{"given":"Nancy","family":"Walden","sequence":"additional","affiliation":[{"name":"Duke AI Health, Duke University School of Medicine , Durham, NC 27705, United States"}]},{"given":"Matthew","family":"Elmore","sequence":"additional","affiliation":[{"name":"Duke AI Health, Duke University School of Medicine , Durham, NC 27705, United States"}]},{"given":"Amanda B","family":"Parrish","sequence":"additional","affiliation":[{"name":"Office of Regulatory Affairs and Quality, Duke University School of Medicine , Durham, NC 27705, United States"}]},{"given":"Scott","family":"Elengold","sequence":"additional","affiliation":[{"name":"Office of Counsel, Duke University , Durham, NC 27701, United States"}]},{"given":"Kay S","family":"Lytle","sequence":"additional","affiliation":[{"name":"Duke University School of Nursing , Durham, NC 27710, United States"},{"name":"Duke Health Technology Solutions, Duke University Health System , Durham, NC 27705, United States"}]},{"given":"Suresh","family":"Balu","sequence":"additional","affiliation":[{"name":"Duke Institute for Health Innovation, Duke University , Durham, NC 27701, United States"}]},{"given":"Michael E","family":"Lipkin","sequence":"additional","affiliation":[{"name":"Department of Urology, Duke University School of Medicine , Durham, NC 27710, United States"}]},{"given":"Afreen Idris","family":"Shariff","sequence":"additional","affiliation":[{"name":"Department of Medicine, Duke University School of Medicine , Durham, NC 27710, United States"},{"name":"Duke Endocrine-Oncology Program, Duke University Health System , Durham, NC 27710, United States"}]},{"given":"Michael","family":"Gao","sequence":"additional","affiliation":[{"name":"Duke Institute for Health Innovation, Duke University , Durham, NC 27701, United States"}]},{"given":"David","family":"Leverenz","sequence":"additional","affiliation":[{"name":"Department of Medicine, Duke University School of Medicine , Durham, NC 27710, United States"}]},{"given":"Ricardo","family":"Henao","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Bioinformatics, Duke University School of Medicine , Durham, NC 27705, United States"},{"name":"Department of Bioengineering, King Abdullah University of Science and Technology , Thuwal 23955, Saudi Arabia"}]},{"given":"David Y","family":"Ming","sequence":"additional","affiliation":[{"name":"Department of Medicine, Duke University School of Medicine , Durham, NC 27710, United States"},{"name":"Duke Department of Pediatrics, Duke University Health System , Durham, NC 27705, United States"},{"name":"Department of Population Health Sciences, Duke University School of Medicine , Durham, NC 27701, United States"}]},{"given":"David M","family":"Gallagher","sequence":"additional","affiliation":[{"name":"Department of Medicine, Duke University School of Medicine , Durham, NC 27710, United States"}]},{"given":"Michael J","family":"Pencina","sequence":"additional","affiliation":[{"name":"Duke AI Health, Duke University School of Medicine , Durham, NC 27705, United States"},{"name":"Department of Biostatistics and Bioinformatics, Duke University School of Medicine , Durham, NC 27705, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7251-5842","authenticated-orcid":false,"given":"Eric G","family":"Poon","sequence":"additional","affiliation":[{"name":"Duke Health Technology Solutions, Duke University Health System , Durham, NC 27705, United States"},{"name":"Department of Medicine, Duke University School of Medicine , Durham, NC 27710, United States"},{"name":"Department of Biostatistics and Bioinformatics, Duke University School of Medicine , Durham, NC 27705, United States"}]}],"member":"286","published-online":{"date-parts":[[2023,11,29]]},"reference":[{"issue":"6464","key":"2024021710214477100_ocad221-B1","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"2024021710214477100_ocad221-B2","volume-title":"Blueprint for an AI Bill of Rights: Making Automated Systems Work for the American People","author":"White House","year":"2022"},{"key":"2024021710214477100_ocad221-B3","author":"Bonta"},{"key":"2024021710214477100_ocad221-B4","volume-title":"Artificial Intelligence and Machine Learning in Software as a Medical Device","author":"US Food and Drug Administration Website. Center for Devices and Radiological Health"},{"issue":"5","key":"2024021710214477100_ocad221-B5","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1038\/s41591-022-01772-9","article-title":"Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI","volume":"28","author":"Vasey","year":"2022","journal-title":"Nat Med"},{"issue":"7","key":"2024021710214477100_ocad221-B6","doi-asserted-by":"crossref","first-page":"e048008","DOI":"10.1136\/bmjopen-2020-048008","article-title":"Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence","volume":"11","author":"Collins","year":"2021","journal-title":"BMJ Open"},{"key":"2024021710214477100_ocad221-B7","volume-title":"Ethics and Governance of Artificial Intelligence for Health","author":"World Health Organization","year":"2021"},{"key":"2024021710214477100_ocad221-B8","author":"Sanderson","year":"2022"},{"key":"2024021710214477100_ocad221-B9","author":"Microsoft Responsible AI Standard, V2","year":"2022"},{"key":"2024021710214477100_ocad221-B10","author":"Google Responsible AI Practices"},{"key":"2024021710214477100_ocad221-B11","volume-title":"NIST AI Risk Management Framework (AI RMF 1.0) Playbook","author":"National Institute of Standards and Technology"},{"issue":"9","key":"2024021710214477100_ocad221-B12","doi-asserted-by":"crossref","first-page":"1631","DOI":"10.1093\/jamia\/ocac078","article-title":"A framework for the oversight and local deployment of safe and high-quality prediction models","volume":"29","author":"Bedoya","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2024021710214477100_ocad221-B13","volume-title":"Ethics by Design and Ethics of Use Approaches for Artificial Intelligence (version 1.0)","author":"European Commission","year":"2021"},{"issue":"1","key":"2024021710214477100_ocad221-B14","doi-asserted-by":"crossref","first-page":"W1","DOI":"10.7326\/M14-0698","article-title":"Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration","volume":"162","author":"Moons","year":"2015","journal-title":"Ann Intern Med"},{"key":"2024021710214477100_ocad221-B15","volume-title":"Clinical Decision Support Software. Final Guidance for Industry and FDA Staff","author":"U.S. Food and Drug Administration","year":"2022"},{"issue":"1","key":"2024021710214477100_ocad221-B16","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1038\/s41746-020-0253-3","article-title":"Presenting machine learning model information to clinical end users with model facts labels","volume":"3","author":"Sendak","year":"2020","journal-title":"NPJ Digit Med"},{"issue":"10","key":"2024021710214477100_ocad221-B17","doi-asserted-by":"crossref","first-page":"1359","DOI":"10.1377\/hlthaff.2023.00553","article-title":"Mitigating racial and ethnic bias and advancing health equity in clinical algorithms: a scoping review","volume":"42","author":"Cary","year":"2023","journal-title":"Health Aff (Millwood)"},{"key":"2024021710214477100_ocad221-B18","volume-title":"Creating a Culture of Continuous Improvement","author":"Chandrasekaran"},{"issue":"17","key":"2024021710214477100_ocad221-B19","doi-asserted-by":"crossref","first-page":"1583","DOI":"10.1056\/NEJMp2000589","article-title":"Prediction models\u2014development, evaluation, and clinical application","volume":"382","author":"Pencina","year":"2020","journal-title":"N Engl J Med"},{"key":"2024021710214477100_ocad221-B20","article-title":"EASY model: development and pilot implementation of a predictive model to identify visits appropriate for telehealth in rheumatology","author":"Solomon","year":"2023","journal-title":"Arthritis Care Res"},{"issue":"10","key":"2024021710214477100_ocad221-B21","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1002\/acr2.11470","article-title":"Telehealth Made EASY: understanding provider perceptions of telehealth appropriateness in outpatient rheumatology encounters","volume":"4","author":"Smith","year":"2022","journal-title":"ACR Open Rheumatol"},{"issue":"1","key":"2024021710214477100_ocad221-B22","doi-asserted-by":"crossref","first-page":"e100423","DOI":"10.1136\/bmjhci-2021-100423","article-title":"A proposal for developing a platform that evaluates algorithmic equity and accuracy","volume":"29","author":"Cerrato","year":"2022","journal-title":"BMJ Health Care Inform"},{"key":"2024021710214477100_ocad221-B23","first-page":"1","author":"Suresh","year":"2021"},{"issue":"8","key":"2024021710214477100_ocad221-B24","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1093\/jamia\/ocac065","article-title":"A bias evaluation checklist for predictive models and its pilot application for 30-day hospital readmission models","volume":"29","author":"Wang","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2024021710214477100_ocad221-B25","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1542\/hpeds.2022-006861","article-title":"Predictive modeling to identify children with complex health needs at risk for hospitalization","volume":"13","author":"Ming","year":"2023","journal-title":"Hosp Pediatr"},{"issue":"3","key":"2024021710214477100_ocad221-B26","doi-asserted-by":"crossref","first-page":"103","DOI":"10.3390\/jpm10030103","article-title":"Implementation and continuous monitoring of an electronic health record embedded readmissions clinical decision support tool","volume":"10","author":"Gallagher","year":"2020","journal-title":"J Pers Med"},{"key":"2024021710214477100_ocad221-B27","article-title":"Blueprint for Trustworthy AI Implementation Guidance and Assurance for Healthcare","author":"Coalition for Health AI","year":"2023"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/3\/705\/56691575\/ocad221.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/3\/705\/56691575\/ocad221.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T10:22:53Z","timestamp":1708165373000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/3\/705\/7455696"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,29]]},"references-count":27,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,11,29]]},"published-print":{"date-parts":[[2024,2,16]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad221","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,3,1]]},"published":{"date-parts":[[2023,11,29]]}}}