{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T01:47:30Z","timestamp":1779328050875,"version":"3.51.4"},"reference-count":35,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T00:00:00Z","timestamp":1694649600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>The rapid expansion of artificial intelligence (AI) has produced many opportunities, but also new risks that must be actively managed, particularly in the health care sector with clinical practice to avoid unintended health, economic, and social consequences.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Given that much of the research and development (R&amp;amp;D) involving human subjects is reviewed and rigorously monitored by institutional review boards (IRBs), we argue that supplemental questions added to the IRB process is an efficient risk mitigation technique available for immediate use. To facilitate this, we introduce AI supplemental questions that provide a feasible, low-disruption mechanism for IRBs to elicit information necessary to inform the review of AI proposals. These questions will also be relevant to review of research using AI that is exempt from the requirement of IRB review. We pilot the questions within the Department of Veterans Affairs\u2013the nation's largest integrated healthcare system\u2013and demonstrate its efficacy in risk mitigation through providing vital information in a way accessible to non-AI subject matter experts responsible for reviewing IRB proposals. We provide these questions for other organizations to adapt to fit their needs and are further developing these questions into an AI IRB module with an extended application, review checklist, informed consent, and other informational materials.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We find that the supplemental AI IRB module further streamlines and expedites the review of IRB projects. We also find that the module has a positive effect on reviewers' attitudes and ease of assessing the potential alignment and risks associated with proposed projects.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>As projects increasingly contain an AI component, streamlining their review and assessment is important to avoid posing too large of a burden on IRBs in their review of submissions. In addition, establishing a minimum standard that submissions must adhere to will help ensure that all projects are at least aware of potential risks unique to AI and dialogue with their local IRBs over them. Further work is needed to apply these concepts to other non-IRB pathways, like quality improvement projects.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fcomp.2023.1235226","type":"journal-article","created":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T03:41:45Z","timestamp":1694749305000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Informing the ethical review of human subjects research utilizing artificial intelligence"],"prefix":"10.3389","volume":"5","author":[{"given":"Christos Andreas","family":"Makridis","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony","family":"Boese","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rafael","family":"Fricks","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Don","family":"Workman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Molly","family":"Klote","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joshua","family":"Mueller","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isabel J.","family":"Hildebrandt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Kim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gil","family":"Alterovitz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,9,14]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.3386\/w31422","article-title":"\u201cCombining human expertise with artificial intelligence: Experimental evidence from radiology,\u201d","author":"Agarwal","year":"2023","journal-title":"NBER Working Paper"},{"key":"B2","doi-asserted-by":"publisher","first-page":"323","DOI":"10.2307\/2951599","article-title":"A model of growth through creative destruction","volume":"60","author":"Aghion","year":"1992","journal-title":"Econometrica"},{"key":"B3","unstructured":"2021"},{"key":"B4","doi-asserted-by":"publisher","first-page":"E125","DOI":"10.1001\/amajethics.2019.125","article-title":"How should ai be developed, validated, and implemented in patient care?","volume":"21","author":"Anderson","year":"2019","journal-title":"AMA J. Ethics"},{"key":"B5","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1146\/annurev-biodatasci-122220-110053","article-title":"Developing and implementing predictive models in a healthcare system: traditional and artificial intelligence approaches in the Veterans Health Administration","volume":"5","author":"Atkins","year":"2022","journal-title":"Annu. Rev. Biomed. Data Sci."},{"key":"B6","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s11019-020-09948-1","article-title":"A critical perspective on guidelines for responsible and trustworthy artificial intelligence","volume":"23","author":"Buruk","year":"2020","journal-title":"Med. Health Care Philos"},{"key":"B7","year":"2016","journal-title":"International Ethical Guideline for Health Related Research Involving Humans."},{"key":"B8","doi-asserted-by":"crossref","first-page":"1754","DOI":"10.1093\/rfs\/hhz007","article-title":"Blockchain disruption and smart contracts","volume":"32","author":"Cong","year":"2019","journal-title":"Rev. Financ. Stud."},{"key":"B9","doi-asserted-by":"publisher","first-page":"1519","DOI":"10.1038\/s41591-019-0583-3","article-title":"Deep learning-based classification of mesothelioma improves prediction of patient outcome","volume":"25","author":"Courtiol","year":"2019","journal-title":"Nat. Med."},{"key":"B10","doi-asserted-by":"publisher","first-page":"8","DOI":"10.2196\/36823","article-title":"Guidelines for artificial intelligence in medicine: literature review and content analysis of frameworks","volume":"24","author":"Crossnohere","year":"2022","journal-title":"J. Med. Internet Res."},{"key":"B11","doi-asserted-by":"publisher","first-page":"282","DOI":"10.7326\/0003-4819-141-4-200408170-00008","article-title":"Oversight of human participants research: identifying problems to evaluate reform proposals","volume":"141","author":"Emanuel","year":"2004","journal-title":"Ann. Intern. Med"},{"key":"B12","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41746-021-00385-9","article-title":"Do as AI say: susceptibility in deployment of clinical decision-aids","volume":"4","author":"Gaube","year":"2021","journal-title":"NPJ Digi. Med."},{"key":"B13","doi-asserted-by":"publisher","first-page":"816823","DOI":"10.1056\/nejmsb0803929","article-title":"Ethical and scientific implications of the globalization of clinical research","volume":"360","author":"Glickman","year":"2009","journal-title":"N. Engl. J. Med."},{"key":"B14","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1038\/s41467-021-20910-4","article-title":"Artificial intelligence in sepsis early prediction and diagnosis using unstructured data in healthcare","volume":"12","author":"Goh","year":"2021","journal-title":"Nat. Commun."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1447","DOI":"10.1038\/s41591-022-01895-z","article-title":"Factors driving provider adoption of the TREWS machine learning-based early warning system and its effects on sepsis treatment timing","volume":"28","author":"Henry","year":"2022","journal-title":"Nat. Med."},{"key":"B16","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/S2589-7500(19)30159-1","article-title":"Prediction of lung cancer risk at follow-up screening with low-dose CT: a training and validation study of a deep learning method","volume":"1","author":"Huang","year":"2019","journal-title":"Lancet Digit. Health"},{"key":"B17","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1257\/000282802760015685","article-title":"Sources of U.S. economic growth in a world of ideas","volume":"92","author":"Jones","year":"2002","journal-title":"Am. Econ. Rev."},{"key":"B18","unstructured":"Khin-Maung-GyiF.\n          The history and role of institutional review boards: local and central IRBs, a single mission. 2009"},{"key":"B19","doi-asserted-by":"publisher","first-page":"6","DOI":"10.2196\/28921","article-title":"Ethical applications of artificial intelligence: evidence for health research on veterans","volume":"9","author":"Makridis","year":"","journal-title":"J. Med. Inter. Res. Med. Informat."},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2020-100312","article-title":"Designing COVID-19 mortality predictions to advance clinical outcomes: evidence from the department of Veterans Affairs","author":"Makridis","year":"","journal-title":"BMJ Health Care Inform"},{"key":"B21","doi-asserted-by":"crossref","DOI":"10.17226\/27111","volume-title":"Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril.","author":"Matheny","year":"2019"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1224","DOI":"10.1038\/s41591-020-0931-3","article-title":"Artificial intelligence\u2013enabled rapid diagnosis of patients with COVID-19","volume":"26","author":"Mei","year":"2020","journal-title":"Nat. Med."},{"key":"B23","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1038\/s42256-019-0114-4","article-title":"Principles alone cannot guarantee ethical AI perspectives","volume":"1","author":"Mittelstadt","year":"2019","journal-title":"Nat. Mach. Intellig"},{"key":"B24","unstructured":"\u201cThe National Commission for the protection of human subjects of biomedical and behavioral research,\u201dThe Belmont Report: Ethical Principles and Guidelines for the Protection of Human Subjects of Research1979"},{"key":"B25","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"25","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"B26","article-title":"\u201cState of implementation of the OECD AI principles: insights from national AI policies,\u201d","year":"2021","journal-title":"OECD Digital Economy Papers"},{"key":"B27","author":"O'Shaughnessy","year":"2023"},{"key":"B28","doi-asserted-by":"publisher","first-page":"17651766","DOI":"10.1001\/jama.2019.15064","article-title":"Potential liability for physicians using artificial intelligence","volume":"322","author":"Price","year":"2019","journal-title":"J. Am. Med. Assoc."},{"key":"B29","doi-asserted-by":"publisher","first-page":"1351","DOI":"10.1136\/bmj.m3210","article-title":"Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension","volume":"26","author":"Rivera","year":"2020","journal-title":"Nat. Med."},{"key":"B30","doi-asserted-by":"publisher","first-page":"100495","DOI":"10.1136\/bmjhci-2021-100495","article-title":"Developing, implementing and governing artificial intelligence in medicine: a step-by-step approach to prevent an artificial intelligence winter","volume":"29","author":"van de Sande","year":"2022","journal-title":"BMJ Health Care Inform."},{"key":"B31","article-title":"\u201cExecutive order on promoting the use of trustworthy artificial intelligence in the Federal Government,\u201d","year":"2020","journal-title":"Federal Register: Promoting the Use of Trustworthy Artificial Intelligence in the Federal Government."},{"key":"B32","unstructured":"\u201cA prospective randomized clinical trial for measuring radiology study reporting time on Artificial Intelligence-based detection of intracranial hemorrhage in emergent care head CT,\u201d\n            Wism\u00fcllerA.\n            StockmasterL.\n          Proc. SPIE 11317, Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging 113170M.2020"},{"key":"B33","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1038\/s41551-018-0305-z","article-title":"Artificial intelligence in healthcare","volume":"2","author":"Yu Kun-Hsing","year":"2018","journal-title":"Nat. Biomed. Eng."},{"key":"B34","doi-asserted-by":"publisher","first-page":"2961","DOI":"10.1038\/s41467-020-16777-6","article-title":"Diagnostic evaluation of a deep learning model for optical diagnosis of colorectal cancer","volume":"11","author":"Zhou","year":"2020","journal-title":"Nat Communic."},{"key":"B35","doi-asserted-by":"publisher","first-page":"693","DOI":"10.7205\/MILMED-D-11-00434","article-title":"Cancer incidence among patients of the U.S. Veterans Affairs Health Care System","volume":"177","author":"Zullig","year":"2012","journal-title":"Military Med."}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1235226\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T03:41:48Z","timestamp":1694749308000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1235226\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,14]]},"references-count":35,"alternative-id":["10.3389\/fcomp.2023.1235226"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2023.1235226","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,14]]},"article-number":"1235226"}}