{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T20:48:08Z","timestamp":1788468488867,"version":"build-2803163510"},"reference-count":46,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,12,8]],"date-time":"2023-12-08T00:00:00Z","timestamp":1701993600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["NCATS R01-TR-003505"],"award-info":[{"award-number":["NCATS R01-TR-003505"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,2,16]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>We set out to describe academic machine learning (ML) researchers\u2019 ethical considerations regarding the development of ML tools intended for use in clinical care.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We conducted in-depth, semistructured interviews with a sample of ML researchers in medicine (N\u2009=\u200910) as part of a larger study investigating stakeholders\u2019 ethical considerations in the translation of ML tools in medicine. We used a qualitative descriptive design, applying conventional qualitative content analysis in order to allow participant perspectives to emerge directly from the data.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Every participant viewed their algorithm development work as holding ethical significance. While participants shared positive attitudes toward continued ML innovation, they described concerns related to data sampling and labeling (eg, limitations to mitigating bias; ensuring the validity and integrity of data), and algorithm training and testing (eg, selecting quantitative targets; assessing reproducibility). Participants perceived a need to increase interdisciplinary training across stakeholders and to envision more coordinated and embedded approaches to addressing ethics issues.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion and Conclusion<\/jats:title>\n                  <jats:p>Participants described key areas where increased support for ethics may be needed; technical challenges affecting clinical acceptability; and standards related to scientific integrity, beneficence, and justice that may be higher in medicine compared to other industries engaged in ML innovation. Our results help shed light on the perspectives of ML researchers in medicine regarding the range of ethical issues they encounter or anticipate in their work, including areas where more attention may be needed to support the successful development and integration of medical ML tools.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad238","type":"journal-article","created":{"date-parts":[[2023,12,9]],"date-time":"2023-12-09T05:57:50Z","timestamp":1702101470000},"page":"563-573","source":"Crossref","is-referenced-by-count":19,"title":["Academic machine learning researchers\u2019 ethical perspectives on algorithm development for health care: a qualitative study"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6364-6234","authenticated-orcid":false,"given":"Max","family":"Kasun","sequence":"first","affiliation":[{"name":"Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine , Stanford, CA 94305, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katie","family":"Ryan","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine , Stanford, CA 94305, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jodi","family":"Paik","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine , Stanford, CA 94305, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyle","family":"Lane-McKinley","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine , Stanford, CA 94305, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura Bodin","family":"Dunn","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, University of Arkansas for Medical Sciences , Little Rock, AK 72205, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura Weiss","family":"Roberts","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine , Stanford, CA 94305, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1475-9822","authenticated-orcid":false,"given":"Jane Paik","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine , Stanford, CA 94305, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,12,8]]},"reference":[{"key":"2024021710213514400_ocad238-B1","author":"U.S. Food and Drug Administration. Artificial intelligence and machine learning (AI\/ML)-enabled medical devices","year":"2023"},{"issue":"1","key":"2024021710213514400_ocad238-B2","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1038\/s41746-022-00634-5","article-title":"Medical domain knowledge in domain-agnostic generative AI","volume":"5","author":"Kather","year":"2022","journal-title":"NPJ Digit Med"},{"issue":"7","key":"2024021710213514400_ocad238-B3","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.1038\/s41591-022-01894-0","article-title":"Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis","volume":"28","author":"Adams","year":"2022","journal-title":"Nat Med"},{"issue":"1","key":"2024021710213514400_ocad238-B4","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1111\/1559-8918.2018.01213","article-title":"The stakes of uncertainty: developing and integrating machine learning in clinical care","volume":"2018","author":"Elish","year":"2018","journal-title":"Ethnographic Praxis"},{"issue":"2","key":"2024021710213514400_ocad238-B5","doi-asserted-by":"crossref","first-page":"ooac022","DOI":"10.1093\/jamiaopen\/ooac022","article-title":"Implementation approaches and barriers for rule-based and machine learning-based sepsis risk prediction tools: a qualitative study","volume":"5","author":"Joshi","year":"2022","journal-title":"JAMIA Open"},{"issue":"11","key":"2024021710213514400_ocad238-B6","doi-asserted-by":"crossref","first-page":"e22421","DOI":"10.2196\/22421","article-title":"Integrating a machine learning system into clinical workflows: qualitative study","volume":"22","author":"Sandhu","year":"2020","journal-title":"J Med Internet Res"},{"key":"2024021710213514400_ocad238-B7","article-title":"Physicians\u2019 and machine learning researchers\u2019 perspectives on ethical issues in the early development of machine learning for medicine: a qualitative interview study","author":"Kim"},{"key":"2024021710213514400_ocad238-B8","doi-asserted-by":"crossref","first-page":"104679","DOI":"10.1016\/j.ijmedinf.2021.104679","article-title":"Potential applications and performance of machine learning techniques and algorithms in clinical practice: a systematic review","volume":"159","author":"Nwanosike","year":"2022","journal-title":"Int J Med Inform"},{"key":"2024021710213514400_ocad238-B9","author":"National Commission for the Protection of Human Subjects of Biomedical, and Behavioral Research","year":"1978"},{"key":"2024021710213514400_ocad238-B10","volume-title":"Protecting the Integrity of Government Science","author":"Scientific Integrity Fast-Track Action Committee","year":"2022"},{"issue":"11","key":"2024021710213514400_ocad238-B11","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1080\/15265161.2020.1819469","article-title":"Identifying ethical considerations for machine learning healthcare applications","volume":"20","author":"Char","year":"2020","journal-title":"Am J Bioeth"},{"issue":"4","key":"2024021710213514400_ocad238-B12","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1093\/jamia\/ocac006","article-title":"Defining AMIA\u2019s artificial intelligence principles","volume":"29","author":"Solomonides","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2024021710213514400_ocad238-B13","doi-asserted-by":"crossref","first-page":"l6927","DOI":"10.1136\/bmj.l6927","article-title":"Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness","volume":"368","author":"Vollmer","year":"2020","journal-title":"BMJ"},{"issue":"5","key":"2024021710213514400_ocad238-B14","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1080\/15265161.2021.2013977","article-title":"A research ethics framework for the clinical translation of healthcare machine learning","volume":"22","author":"McCradden","year":"2022","journal-title":"Am J Bioeth"},{"issue":"11","key":"2024021710213514400_ocad238-B15","doi-asserted-by":"crossref","first-page":"W6","DOI":"10.1080\/15265161.2020.1827695","article-title":"A framework to evaluate ethical considerations with ML-HCA applications-valuable, even necessary, but never comprehensive","volume":"20","author":"Char","year":"2020","journal-title":"Am J Bioeth"},{"issue":"12","key":"2024021710213514400_ocad238-B16","doi-asserted-by":"crossref","first-page":"2024","DOI":"10.1093\/jamia\/ocaa085","article-title":"Patient safety and quality improvement: Ethical principles for a regulatory approach to bias in healthcare machine learning","volume":"27","author":"McCradden","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2024021710213514400_ocad238-B17","first-page":"5787","author":"Zhang","year":"2022"},{"key":"2024021710213514400_ocad238-B18","doi-asserted-by":"crossref","DOI":"10.1007\/s43681-022-00256-3","article-title":"The ethical agency of AI developers","author":"Griffin","year":"2023","journal-title":"AI Ethics"},{"key":"2024021710213514400_ocad238-B19","doi-asserted-by":"crossref","first-page":"20552076231186064","DOI":"10.1177\/20552076231186064","article-title":"Medical artificial intelligence ethics: a systematic review of empirical studies","volume":"9","author":"Tang","year":"2023","journal-title":"Digit Health"},{"issue":"11","key":"2024021710213514400_ocad238-B20","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1038\/s42256-019-0114-4","article-title":"Principles alone cannot guarantee ethical AI","volume":"1","author":"Mittelstadt","year":"2019","journal-title":"Nat Mach Intell"},{"key":"2024021710213514400_ocad238-B21","doi-asserted-by":"crossref","first-page":"776837","DOI":"10.3389\/fcomp.2022.776837","article-title":"AI ethics as applied ethics","volume":"4","author":"Hallamaa","year":"2022","journal-title":"Front Comput Sci"},{"key":"2024021710213514400_ocad238-B22","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/j.jpsychires.2021.02.021","article-title":"Letter to the editor: machine learning and artificial intelligence in psychiatry: balancing promise and reality","volume":"136","author":"Kim","year":"2021","journal-title":"J Psychiatr Res"},{"issue":"5","key":"2024021710213514400_ocad238-B23","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1080\/03605310500253030","article-title":"Empirical ethics, context-sensitivity, and contextualism","volume":"30","author":"Musschenga","year":"2005","journal-title":"J Med Philos"},{"issue":"4","key":"2024021710213514400_ocad238-B24","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1002\/1098-240X(200008)23:4<334::AID-NUR9>3.0.CO;2-G","article-title":"Whatever happened to qualitative description?","volume":"23","author":"Sandelowski","year":"2000","journal-title":"Res Nurs Health"},{"issue":"1","key":"2024021710213514400_ocad238-B25","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1186\/1471-2288-9-52","article-title":"Qualitative description\u2014the poor cousin of health research?","volume":"9","author":"Neergaard","year":"2009","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"2024021710213514400_ocad238-B26","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1002\/nur.21768","article-title":"Characteristics of qualitative descriptive studies: a systematic review","volume":"40","author":"Kim","year":"2017","journal-title":"Res Nurs Health"},{"issue":"12","key":"2024021710213514400_ocad238-B27","doi-asserted-by":"crossref","first-page":"2743","DOI":"10.1093\/jamia\/ocab195","article-title":"Guidance for publishing qualitative research in informatics","volume":"28","author":"Ancker","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2024021710213514400_ocad238-B28","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1093\/intqhc\/mzm042","article-title":"Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups","volume":"19","author":"Tong","year":"2007","journal-title":"Int J Qual Health Care"},{"issue":"5","key":"2024021710213514400_ocad238-B29","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1007\/s10488-013-0528-y","article-title":"Purposeful sampling for qualitative data collection and analysis in mixed method implementation research","volume":"42","author":"Palinkas","year":"2015","journal-title":"Adm Policy Ment Health"},{"key":"2024021710213514400_ocad238-B30","first-page":"220","volume-title":"Handbook of Qualitative Research","author":"Morse","year":"1994"},{"key":"2024021710213514400_ocad238-B31","volume-title":"Qualitative Data Analysis","author":"Miles","year":"1994","edition":"2nd ed"},{"key":"2024021710213514400_ocad238-B32","author":"Zoom Video Communications, Inc","year":"2022"},{"issue":"9","key":"2024021710213514400_ocad238-B33","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1177\/1049732305276687","article-title":"Three approaches to qualitative content analysis","volume":"15","author":"Hsieh","year":"2005","journal-title":"Qual Health Res"},{"issue":"3","key":"2024021710213514400_ocad238-B34","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1080\/07399339209516006","article-title":"Content analysis: method, applications, and issues","volume":"13","author":"Downe-Wamboldt","year":"1992","journal-title":"Health Care Women Int"},{"key":"2024021710213514400_ocad238-B35","author":"QSR International Pty Ltd","year":"2020"},{"key":"2024021710213514400_ocad238-B36","author":"Executive Office of the President, Office of Management and Budget (OMB), Office of Information and Regulatory Affairs","year":"1997"},{"key":"2024021710213514400_ocad238-B37","author":"Lewis","year":"2020"},{"key":"2024021710213514400_ocad238-B38","first-page":"23","volume-title":"Machine Bias Risk Assessments in Criminal Sentencing","author":"Angwin","year":"2016"},{"issue":"8","key":"2024021710213514400_ocad238-B39","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1145\/3464903","article-title":"Biases in AI systems","volume":"64","author":"Srinivasan","year":"2021","journal-title":"Commun ACM"},{"issue":"11","key":"2024021710213514400_ocad238-B40","doi-asserted-by":"crossref","first-page":"1247","DOI":"10.1001\/jamadermatol.2018.2348","article-title":"Machine learning and health care disparities in dermatology","volume":"154","author":"Adamson","year":"2018","journal-title":"JAMA Dermatol"},{"key":"2024021710213514400_ocad238-B41","first-page":"2612","author":"Hee","year":"2017"},{"issue":"6464","key":"2024021710213514400_ocad238-B42","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"2024021710213514400_ocad238-B43","volume-title":"Repairing Innovation: A Study of Integrating AI in Clinical Care","author":"Elish","year":"2020"},{"issue":"1","key":"2024021710213514400_ocad238-B44","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1038\/s41746-022-00597-7","article-title":"Human\u2013machine teaming is key to AI adoption: clinicians\u2019 experiences with a deployed machine learning system","volume":"5","author":"Henry","year":"2022","journal-title":"NPJ Dig Med"},{"issue":"1","key":"2024021710213514400_ocad238-B45","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s10730-013-9218-0","article-title":"The changing composition of a hospital ethics committee: a tertiary care center\u2019s experience","volume":"26","author":"Courtwright","year":"2014","journal-title":"HEC Forum"},{"issue":"6","key":"2024021710213514400_ocad238-B46","first-page":"51","article-title":"Ethical decision-making: group diversity holds the key","volume":"9","author":"DeGrassi","year":"2012","journal-title":"J Leadership Accountability Ethics"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/3\/563\/56691565\/ocad238.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/3\/563\/56691565\/ocad238.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T10:22:24Z","timestamp":1708165344000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/3\/563\/7464003"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,8]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,12,8]]},"published-print":{"date-parts":[[2024,2,16]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad238","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,3,1]]},"published":{"date-parts":[[2023,12,8]]}}}