{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T00:54:20Z","timestamp":1775868860645,"version":"3.50.1"},"reference-count":119,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,12,2]],"date-time":"2023-12-02T00:00:00Z","timestamp":1701475200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,2]],"date-time":"2023-12-02T00:00:00Z","timestamp":1701475200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100011359","name":"Pitt | School of Health and Rehabilitation Sciences, University of Pittsburgh","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100011359","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"U.S. Department of Health & Human Services | National Institutes of Health","doi-asserted-by":"publisher","award":["R01LM014306"],"award-info":[{"award-number":["R01LM014306"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"U.S. Department of Health & Human Services | NIH | National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["U24TR004111"],"award-info":[{"award-number":["U24TR004111"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"U.S. Department of Health & Human Services | National Institutes of Health","doi-asserted-by":"publisher","award":["R01LM014306"],"award-info":[{"award-number":["R01LM014306"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"U.S. Department of Health & Human Services | National Institutes of Health","doi-asserted-by":"publisher","award":["4R00LM013001"],"award-info":[{"award-number":["4R00LM013001"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2145640"],"award-info":[{"award-number":["2145640"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In 2020, the U.S. Department of Defense officially disclosed a set of ethical principles to guide the use of Artificial Intelligence (AI) technologies on future battlefields. Despite stark differences, there are core similarities between the military and medical service. Warriors on battlefields often face life-altering circumstances that require quick decision-making. Medical providers experience similar challenges in a rapidly changing healthcare environment, such as in the emergency department or during surgery treating a life-threatening condition. Generative AI, an emerging technology designed to efficiently generate valuable information, holds great promise. As computing power becomes more accessible and the abundance of health data, such as electronic health records, electrocardiograms, and medical images, increases, it is inevitable that healthcare will be revolutionized by this technology. Recently, generative AI has garnered a lot of attention in the medical research community, leading to debates about its application in the healthcare sector, mainly due to concerns about transparency and related issues. Meanwhile, questions around the potential exacerbation of health disparities due to modeling biases have raised notable ethical concerns regarding the use of this technology in healthcare. However, the ethical principles for generative AI in healthcare have been understudied. As a result, there are no clear solutions to address ethical concerns, and decision-makers often neglect to consider the significance of ethical principles before implementing generative AI in clinical practice. In an attempt to address these issues, we explore ethical principles from the military perspective and propose the \u201cGREAT PLEA\u201d ethical principles, namely Governability, Reliability, Equity, Accountability, Traceability, Privacy, Lawfulness, Empathy, and Autonomy for generative AI in healthcare. Furthermore, we introduce a framework for adopting and expanding these ethical principles in a practical way that has been useful in the military and can be applied to healthcare for generative AI, based on contrasting their ethical concerns and risks. Ultimately, we aim to proactively address the ethical dilemmas and challenges posed by the integration of generative AI into healthcare practice.<\/jats:p>","DOI":"10.1038\/s41746-023-00965-x","type":"journal-article","created":{"date-parts":[[2023,12,2]],"date-time":"2023-12-02T10:02:04Z","timestamp":1701511324000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":104,"title":["Adopting and expanding ethical principles for generative artificial intelligence from military to healthcare"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9221-3059","authenticated-orcid":false,"given":"David","family":"Oniani","sequence":"first","affiliation":[]},{"given":"Jordan","family":"Hilsman","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9309-8331","authenticated-orcid":false,"given":"Yifan","family":"Peng","sequence":"additional","affiliation":[]},{"given":"Ronald K.","family":"Poropatich","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3857-8417","authenticated-orcid":false,"given":"Jeremy C.","family":"Pamplin","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0878-1484","authenticated-orcid":false,"given":"Gary L.","family":"Legault","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4433-7839","authenticated-orcid":false,"given":"Yanshan","family":"Wang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,12,2]]},"reference":[{"key":"965_CR1","unstructured":"Russell, S. Ai weapons: Russia\u2019s war in Ukraine shows why the world must enact a ban. Nature https:\/\/www.nature.com\/articles\/d41586-023-00511-5 (2023)."},{"key":"965_CR2","unstructured":"U.S. Department of Defense. Dod adopts ethical principles for artificial intelligence https:\/\/www.defense.gov\/News\/Releases\/Release\/Article\/2091996\/dod-adopts-ethical-principles-for-artificial-intelligence\/ (2020)."},{"key":"965_CR3","unstructured":"The North Atlantic Treaty Organization. Summary of the NATO artificial intelligence strategy https:\/\/www.nato.int\/cps\/en\/natohq\/official_texts_187617.htm (2021)."},{"key":"965_CR4","unstructured":"Hicks, K. What the Pentagon thinks about artificial intelligence. Politico https:\/\/www.politico.com\/news\/magazine\/2023\/06\/15\/pentagon-artificial-intelligence-china-00101751."},{"key":"965_CR5","doi-asserted-by":"crossref","unstructured":"Baker, A. et al. A comparison of artificial intelligence and human doctors for the purpose of triage and diagnosis. Front Artif. Intell. 3, 543405 (2020).","DOI":"10.3389\/frai.2020.543405"},{"key":"965_CR6","doi-asserted-by":"publisher","first-page":"20180416","DOI":"10.1259\/bjr.20180416","volume":"92","author":"S Chan","year":"2019","unstructured":"Chan, S. & Siegel, E. L. Will machine learning end the viability of radiology as a thriving medical specialty? Br. J. Radiol. 92, 20180416 (2019).","journal-title":"Br. J. Radiol."},{"key":"965_CR7","doi-asserted-by":"publisher","first-page":"1688","DOI":"10.1093\/jamia\/ocac103","volume":"29","author":"J Meyer","year":"2022","unstructured":"Meyer, J. et al. Impact of artificial intelligence on pathologists\u2019 decisions: an experiment. J. Am. Med. Inform. Assoc. 29, 1688\u20131695 (2022).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"965_CR8","doi-asserted-by":"publisher","first-page":"e190058","DOI":"10.1148\/ryai.2019190058","volume":"1","author":"CP Langlotz","year":"2019","unstructured":"Langlotz, C. P. Will artificial intelligence replace radiologists? Radiol. Artif. Intell. 1, e190058 (2019).","journal-title":"Radiol. Artif. Intell."},{"key":"965_CR9","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.euros.2022.09.024","volume":"48","author":"GE Cacciamani","year":"2023","unstructured":"Cacciamani, G. E. et al. Is artificial intelligence replacing our radiology stars? not yet! Eur. Urol. Open Sci. 48, 14\u201316 (2023).","journal-title":"Eur. Urol. Open Sci."},{"key":"965_CR10","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1038\/s41746-022-00742-2","volume":"5","author":"X Yang","year":"2022","unstructured":"Yang, X. et al. A large language model for electronic health records. npj Digit. Med. 5, 194 (2022).","journal-title":"npj Digit. Med."},{"key":"965_CR11","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1167\/tvst.9.2.13","volume":"9","author":"W-C Lin","year":"2020","unstructured":"Lin, W.-C., Chen, J. S., Chiang, M. F. & Hribar, M. R. Applications of artificial intelligence to electronic health record data in ophthalmology. Transl. Vis. Sci. Technol. 9, 13\u201313 (2020).","journal-title":"Transl. Vis. Sci. Technol."},{"key":"965_CR12","doi-asserted-by":"crossref","unstructured":"Rosenthal, S., Barker, K. & Liang, Z. Leveraging medical literature for section prediction in electronic health records. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 4864\u20134873 (Association for Computational Linguistics, Hong Kong, China, 2019).","DOI":"10.18653\/v1\/D19-1492"},{"key":"965_CR13","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","volume":"620","author":"K Singhal","year":"2023","unstructured":"Singhal, K. et al. Large language models encode clinical knowledge. Nature 620, 172\u2013180 (2023).","journal-title":"Nature"},{"key":"965_CR14","unstructured":"Organization, T. W. H. Ethics and governance of artificial intelligence for health https:\/\/www.who.int\/publications\/i\/item\/9789240029200 (2021)."},{"key":"965_CR15","doi-asserted-by":"publisher","first-page":"103662","DOI":"10.1016\/j.frl.2023.103662","volume":"53","author":"M Dowling","year":"2023","unstructured":"Dowling, M. & Lucey, B. Chatgpt for (finance) research: the Bananarama conjecture. Finance Res. Lett. 53, 103662 (2023).","journal-title":"Finance Res. Lett."},{"key":"965_CR16","doi-asserted-by":"publisher","unstructured":"Lee, M., Liang, P. & Yang, Q. Coauthor: designing a human-ai collaborative writing dataset for exploring language model capabilities. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, CHI \u201922 (Association for Computing Machinery, New York, NY, USA, 2022). https:\/\/doi.org\/10.1145\/3491102.3502030.","DOI":"10.1145\/3491102.3502030"},{"key":"965_CR17","unstructured":"Thiergart, J., Huber, S. & \u00dcbellacker, T. Understanding emails and drafting responses\u2014an approach using gpt-3 (2021). Preprint at https:\/\/arxiv.org\/abs\/2102.03062."},{"key":"965_CR18","doi-asserted-by":"crossref","unstructured":"Ranade, P., Piplai, A., Mittal, S., Joshi, A. & Finin, T. Generating fake cyber threat intelligence using transformer-based models. In 2021 International Joint Conference on Neural Networks (IJCNN), 1\u20139 (2021).","DOI":"10.1109\/IJCNN52387.2021.9534192"},{"key":"965_CR19","unstructured":"Liao, W. et al. Differentiate chatgpt-generated and human-written medical texts (2023). Preprint at https:\/\/arxiv.org\/abs\/2304.11567."},{"key":"965_CR20","doi-asserted-by":"crossref","unstructured":"Chintagunta, B., Katariya, N., Amatriain, X. & Kannan, A. Medically aware GPT-3 as a data generator for medical dialogue summarization. In Proceedings of the Second Workshop on Natural Language Processing for Medical Conversations, (eds Shivade, C. et al.) 66\u201376 (Association for Computational Linguistics, Online, 2021). https:\/\/aclanthology.org\/2021.nlpmc-1.9.","DOI":"10.18653\/v1\/2021.nlpmc-1.9"},{"key":"965_CR21","doi-asserted-by":"publisher","first-page":"e231259","DOI":"10.1148\/radiol.231259","volume":"307","author":"Z Sun","year":"2023","unstructured":"Sun, Z. et al. Evaluating GPT4 on impressions generation in radiology reports. Radiology 307, e231259 (2023).","journal-title":"Radiology"},{"key":"965_CR22","doi-asserted-by":"crossref","unstructured":"Peng, Y., Rousseau, J. F., Shortliffe, E. H. & Weng, C. AI-generated text may have a role in evidence-based medicine. Nat. Med. (2023).","DOI":"10.1038\/s41591-023-02366-9"},{"key":"965_CR23","unstructured":"Gilbert, T. K., Brozek, M. W. & Brozek, A. Beyond bias and compliance: Towards individual agency and plurality of ethics in AI (2023). Preprint at https:\/\/arxiv.org\/abs\/2302.12149."},{"key":"965_CR24","doi-asserted-by":"crossref","unstructured":"Birhane, A. et al. The forgotten margins of ai ethics. In 2022 ACM Conference on Fairness, Accountability, and Transparency (ACM, 2022).","DOI":"10.1145\/3531146.3533157"},{"key":"965_CR25","unstructured":"OpenAI. Introducing chatgpt https:\/\/openai.com\/blog\/chatgpt (2022)."},{"key":"965_CR26","unstructured":"Hu, K. Chatgpt sets record for fastest-growing user base - analyst note. Reuters https:\/\/www.reuters.com\/technology\/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01\/."},{"key":"965_CR27","unstructured":"OpenAI. Model index for researchers https:\/\/platform.openai.com\/docs\/model-index-for-researchers."},{"key":"965_CR28","unstructured":"OpenAI. Gpt-4 technical report (2023). Preprint at https:\/\/arxiv.org\/abs\/2303.08774."},{"key":"965_CR29","unstructured":"Radford, A., Narasimhan, K., Salimans, T. & Sutskever, I. Improving language understanding by generative pre-training. https:\/\/openai.com\/research\/language-unsupervised (2018)."},{"key":"965_CR30","unstructured":"Radford, A. et al. Language models are unsupervised multitask learners (2019)."},{"key":"965_CR31","unstructured":"Brown, T. et al. Language models are few-shot learners. In Advances in Neural Information Processing Systems, Vol. 33 (eds Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M. & Lin, H.) 1877\u20131901 (Curran Associates, Inc., 2020). https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/file\/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf."},{"key":"965_CR32","unstructured":"Vaswani, A. et al. Attention is all you need. In Advances in Neural Information Processing Systems, Vol. 30 (eds Guyon, I. et al.) (Curran Associates, Inc., 2017). https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2017\/file\/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf."},{"key":"965_CR33","doi-asserted-by":"crossref","unstructured":"Rombach, R., Blattmann, A., Lorenz, D., Esser, P. & Ommer, B. High-resolution image synthesis with latent diffusion models. In 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 10674\u201310685 (IEEE Computer Society, Los Alamitos, CA, USA, 2022). https:\/\/doi.ieeecomputersociety.org\/10.1109\/CVPR52688.2022.01042.","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"965_CR34","unstructured":"Ramesh, A., Dhariwal, P., Nichol, A., Chu, C. & Chen, M. Hierarchical text-conditional image generation with clip latents (2022). Preprint at https:\/\/arxiv.org\/abs\/2204.06125."},{"key":"965_CR35","unstructured":"Luo, C. Understanding diffusion models: A unified perspective (2022). Preprint at https:\/\/arxiv.org\/abs\/2208.11970."},{"key":"965_CR36","unstructured":"Zhao, W. X. et al. A survey of large language models (2023). Preprint at https:\/\/arxiv.org\/abs\/2303.18223."},{"key":"965_CR37","doi-asserted-by":"publisher","unstructured":"Liu, P. et al. Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Comput. Surv. 55 https:\/\/doi.org\/10.1145\/3560815 (2023).","DOI":"10.1145\/3560815"},{"key":"965_CR38","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-022-00634-5","volume":"5","author":"JN Kather","year":"2022","unstructured":"Kather, J. N., Ghaffari Laleh, N., Foersch, S. & Truhn, D. Medical domain knowledge in domain-agnostic generative ai. npj Digit. Med. 5, 90 (2022).","journal-title":"npj Digit. Med."},{"key":"965_CR39","unstructured":"Zhang, C. et al. A complete survey on generative ai (aigc): Is chatgpt from gpt-4 to gpt-5 all you need? (2023). Preprint at https:\/\/arxiv.org\/abs\/2303.11717."},{"key":"965_CR40","unstructured":"Zhang, C., Zhang, C., Zhang, M. & Kweon, I. S. Text-to-image diffusion models in generative ai: A survey (2023). Preprint at https:\/\/arxiv.org\/abs\/2303.07909."},{"key":"965_CR41","doi-asserted-by":"crossref","unstructured":"Ferrara, E. Should chatgpt be biased? challenges and risks of bias in large language models (2023). Preprint at https:\/\/arxiv.org\/abs\/2304.03738.","DOI":"10.2139\/ssrn.4627814"},{"key":"965_CR42","unstructured":"Rutinowski, J., Franke, S., Endendyk, J., Dormuth, I. & Pauly, M. The self-perception and political biases of chatgpt (2023). Preprint at https:\/\/arxiv.org\/abs\/2304.07333."},{"key":"965_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3571730","volume":"55","author":"Z Ji","year":"2023","unstructured":"Ji, Z. et al. Survey of hallucination in natural language generation. ACM Comput. Surv. 55, 1\u201338 (2023).","journal-title":"ACM Comput. Surv."},{"key":"965_CR44","unstructured":"Bang, Y. et al. A multitask, multilingual, multimodal evaluation of chatgpt on reasoning, hallucination, and interactivity (2023). Preprint at https:\/\/arxiv.org\/abs\/2302.04023."},{"key":"965_CR45","unstructured":"Bian, N. et al. Chatgpt is a knowledgeable but inexperienced solver: An investigation of commonsense problem in large language models (2023). Preprint at https:\/\/arxiv.org\/abs\/2303.16421."},{"key":"965_CR46","unstructured":"Chen, N. et al. Metrics for deep generative models. In Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics, Vol. 84 of Proceedings of Machine Learning Research, (eds Storkey, A. & Perez-Cruz, F.) 1540\u20131550 (PMLR, 2018). https:\/\/proceedings.mlr.press\/v84\/chen18e.html."},{"key":"965_CR47","unstructured":"Thoppilan, R. et al. Lamda: Language models for dialog applications (2022). Preprint at https:\/\/arxiv.org\/abs\/2201.08239."},{"key":"965_CR48","unstructured":"Gloria, K., Rastogi, N. & DeGroff, S. Bias impact analysis of AI in consumer mobile health technologies: Legal, technical, and policy (2022). Preprint at https:\/\/arxiv.org\/abs\/2209.05440."},{"key":"965_CR49","unstructured":"Peng, C. et al. A study of generative large language model for medical research and healthcare (2023). Preprint at https:\/\/arxiv.org\/abs\/2305.13523."},{"key":"965_CR50","unstructured":"Wei, J. et al. Chain of thought prompting elicits reasoning in large language models. In Advances in Neural Information Processing Systems (eds Oh, A. H., Agarwal, A., Belgrave, D. & Cho, K.) https:\/\/openreview.net\/forum?id=_VjQlMeSB_J (2022)."},{"key":"965_CR51","unstructured":"Leiter, C. et al. Towards explainable evaluation metrics for natural language generation (2022). Preprint at https:\/\/arxiv.org\/abs\/2203.11131."},{"key":"965_CR52","unstructured":"Priyanshu, A., Vijay, S., Kumar, A., Naidu, R. & Mireshghallah, F. Are chatbots ready for privacy-sensitive applications? an investigation into input regurgitation and prompt-induced sanitization (2023). Preprint at https:\/\/arxiv.org\/abs\/2305.15008."},{"key":"965_CR53","doi-asserted-by":"crossref","unstructured":"Ayers, J. W. et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Intern. Med. (2023).","DOI":"10.1001\/jamainternmed.2023.1838"},{"key":"965_CR54","unstructured":"Donovan - AI-powered decision-making for defense. Scale https:\/\/scale.com\/donovan (2023)."},{"key":"965_CR55","unstructured":"Advanced targeting and lethality aided system (atlas). CoVar https:\/\/covar.com\/case-study\/atlas\/ (2023)."},{"key":"965_CR56","unstructured":"Doctrinaire. CoVar https:\/\/covar.com\/case-study\/doctrinaire\/ (2023)."},{"key":"965_CR57","doi-asserted-by":"publisher","first-page":"e18599","DOI":"10.2196\/18599","volume":"8","author":"A Choudhury","year":"2020","unstructured":"Choudhury, A. & Asan, O. Role of artificial intelligence in patient safety outcomes: systematic literature review. JMIR Med. Inform. 8, e18599 (2020).","journal-title":"JMIR Med. Inform."},{"key":"965_CR58","first-page":"170549","volume":"286","author":"M Bahl","year":"2017","unstructured":"Bahl, M. et al. High-risk breast lesions: a machine learning model to predict pathologic upgrade and reduce unnecessary surgical excision. Radiology 286, 170549 (2017).","journal-title":"Radiology"},{"key":"965_CR59","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1093\/jamia\/ocz002","volume":"26","author":"AK Dalal","year":"2019","unstructured":"Dalal, A. K. et al. Systems engineering and human factors support of a system of novel ehr-integrated tools to prevent harm in the hospital. J. Am. Med. Inform. Assoc. 26, 553\u2013560 (2019).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"965_CR60","unstructured":"Intercom for Healthcare https:\/\/www.intercom.com\/drlp\/industry\/healthcare."},{"key":"965_CR61","unstructured":"Prediction and Early Identification of Disease Through AI\u2014Siemens Healthineers https:\/\/www.siemens-healthineers.com\/digital-health-solutions\/artificial-intelligence-in-healthcare\/ai-to-help-predict-disease."},{"key":"965_CR62","unstructured":"Willemink, M. Ai for CT image reconstruction - a great opportunity. AI Blog https:\/\/ai.myesr.org\/articles\/ai-for-ct-image-reconstruction-a-great-opportunity\/ (2019)."},{"key":"965_CR63","doi-asserted-by":"publisher","first-page":"e068373","DOI":"10.1136\/bmjopen-2022-068373","volume":"13","author":"B Bajgain","year":"2023","unstructured":"Bajgain, B., Lorenzetti, D., Lee, J. & Sauro, K. Determinants of implementing artificial intelligence-based clinical decision support tools in healthcare: a scoping review protocol. BMJ Open 13, e068373 (2023).","journal-title":"BMJ Open"},{"key":"965_CR64","unstructured":"David Lat, E. M. Advanced targeting and lethality automated system archives. Breaking Defense https:\/\/breakingdefense.com\/tag\/advanced-targeting-and-lethality-automated-system\/."},{"key":"965_CR65","doi-asserted-by":"crossref","unstructured":"Utegen, A. et al. Development and modeling of intelligent control system of cruise missile based on fuzzy logic. In 2021 16th International Conference on Electronics Computer and Computation (ICECCO), 1\u20136 (2021).","DOI":"10.1109\/ICECCO53203.2021.9663808"},{"key":"965_CR66","doi-asserted-by":"crossref","unstructured":"Bohr, A. & Memarzadeh, K. Chapter 2 - the rise of artificial intelligence in healthcare applications. In Artificial Intelligence in Healthcare, (eds Bohr, A. & Memarzadeh, K.) 25\u201360 (Academic Press, 2020).","DOI":"10.1016\/B978-0-12-818438-7.00002-2"},{"key":"965_CR67","doi-asserted-by":"crossref","unstructured":"Morgan, F. E. et al. Military Applications of Artificial Intelligence: Ethical Concerns in an Uncertain World (RAND Corporation, Santa Monica, CA, 2020).","DOI":"10.7249\/RR3139"},{"key":"965_CR68","unstructured":"Introduction to the law of armed conflict (loac) https:\/\/www.genevacall.org\/wp-content\/uploads\/dlm_uploads\/2013\/11\/The-Law-of-Armed-Conflict.pdf."},{"key":"965_CR69","unstructured":"Rule 1. The principle of distinction between civilians and combatants. IHL https:\/\/ihl-databases.icrc.org\/en\/customary-ihl\/v1\/rule1."},{"key":"965_CR70","unstructured":"Docherty, B. Losing humanity. Human Rights Watch https:\/\/www.hrw.org\/report\/2012\/11\/19\/losing-humanity\/case-against-killer-robots (2012)."},{"key":"965_CR71","unstructured":"Generative Artificial Intelligence and data privacy: A Primer - CRS Reports https:\/\/crsreports.congress.gov\/product\/pdf\/R\/R47569."},{"key":"965_CR72","unstructured":"Journal, H. Hipaa, healthcare data, and artificial intelligence. HIPAA J. https:\/\/www.hipaajournal.com\/hipaa-healthcare-data-and-artificial-intelligence\/ (2023)."},{"key":"965_CR73","doi-asserted-by":"crossref","unstructured":"Patel, V. L., Kannampallil, T. G. & Kaufman, D. R. Cognitive informatics for biomedicine: human computer interaction in healthcare (Springer, 2015).","DOI":"10.1007\/978-3-319-17272-9"},{"key":"965_CR74","unstructured":"II, W. N. P. Risks and remedies for artificial intelligence in health care. Brookings https:\/\/www.brookings.edu\/research\/risks-and-remedies-for-artificial-intelligence-in-health-care\/ (2022)."},{"key":"965_CR75","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1177\/0018720811427034","volume":"54","author":"JB Lyons","year":"2012","unstructured":"Lyons, J. B. & Stokes, C. K. Human-human reliance in the context of automation. Hum. Factors 54, 112\u2013121 (2012).","journal-title":"Hum. Factors"},{"key":"965_CR76","doi-asserted-by":"crossref","unstructured":"Asan, O., Bayrak, E. & Choudhury, A. Artificial intelligence and human trust in healthcare: Focus on clinicians (preprint) (2019).","DOI":"10.2196\/preprints.15154"},{"key":"965_CR77","doi-asserted-by":"crossref","unstructured":"Lewis, M., Sycara, K. & Walker, P. The Role of Trust in Human\u2013Robot Interaction, 135\u2013159 (Springer International Publishing, 2018).","DOI":"10.1007\/978-3-319-64816-3_8"},{"key":"965_CR78","unstructured":"Hawley, J. K. Looking back at 20 years of manprint on patriot: Observations and lessons (2007)."},{"key":"965_CR79","doi-asserted-by":"publisher","first-page":"810","DOI":"10.1126\/science.aaw0029","volume":"363","author":"RB Parikh","year":"2019","unstructured":"Parikh, R. B., Obermeyer, Z. & Navathe, A. S. Regulation of predictive analytics in medicine. Science 363, 810\u2013812 (2019).","journal-title":"Science"},{"key":"965_CR80","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-021-00509-1","volume":"4","author":"JP Richardson","year":"2021","unstructured":"Richardson, J. P. et al. Patient apprehensions about the use of artificial intelligence in healthcare. npj Digit. Med. 4, 140 (2021).","journal-title":"npj Digit. Med."},{"key":"965_CR81","unstructured":"Christian, R. Mind the gap the lack of accountability for killer robots. Human Rights Watch https:\/\/www.hrw.org\/report\/2015\/04\/09\/mind-gap\/lack-accountability-killer-robots (2015)."},{"key":"965_CR82","doi-asserted-by":"publisher","first-page":"251","DOI":"10.2471\/BLT.19.237487","volume":"98","author":"I Habli","year":"2020","unstructured":"Habli, I., Lawton, T. & Porter, Z. Artificial intelligence in health care: accountability and safety. Bull. World Health Organ. 98, 251\u2013256 (2020).","journal-title":"Bull. World Health Organ."},{"key":"965_CR83","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","volume":"366","author":"Z Obermeyer","year":"2019","unstructured":"Obermeyer, Z., Powers, B., Vogeli, C. & Mullainathan, S. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 447\u2013453 (2019).","journal-title":"Science"},{"key":"965_CR84","unstructured":"N, O. et al. Addressing racial and ethnic inequities in data-driven health technologies 1\u201353 (2022)."},{"key":"965_CR85","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1056\/NEJMp1714229","volume":"378","author":"DS Char","year":"2018","unstructured":"Char, D. S., Shah, N. H. & Magnus, D. Implementing machine learning in health care\u2014addressing ethical challenges. N. Engl. J. Med. 378, 981\u2013983 (2018).","journal-title":"N. Engl. J. Med."},{"key":"965_CR86","unstructured":"Frisk, A. What is Project Maven? The Pentagon ai project Google employees want out of - -national. Global News (2018). https:\/\/globalnews.ca\/news\/4125382\/google-pentagon-ai-project-maven\/."},{"key":"965_CR87","unstructured":"Shane, S. & Wakabayashi, D. The business of war\u2019: Google employees protest work for the Pentagon. The New York Times https:\/\/www.nytimes.com\/2018\/04\/04\/technology\/google-letter-ceo-pentagon-project.html (2018)."},{"key":"965_CR88","unstructured":"Our principles. Google AI https:\/\/ai.google\/principles."},{"key":"965_CR89","unstructured":"Augmented intelligence in Health Care*1 - American Medical Association https:\/\/www.ama-assn.org\/system\/files\/2019-01\/augmented-intelligence-policy-report.pdf."},{"key":"965_CR90","unstructured":"Blueprint for trustworthy AI implementation guidance and assurance for healthcare https:\/\/www.coalitionforhealthai.org\/papers\/blueprint-for-trustworthy-ai_V1.0.pdf."},{"key":"965_CR91","unstructured":"Blueprint for an AI bill of rights - ostp. The White House https:\/\/www.whitehouse.gov\/ostp\/ai-bill-of-rights\/ (2023)."},{"key":"965_CR92","doi-asserted-by":"crossref","unstructured":"Naik, N. et al. Legal and ethical consideration in artificial intelligence in healthcare: Who takes responsibility?Front. Surg. 9 (2022).","DOI":"10.3389\/fsurg.2022.862322"},{"key":"965_CR93","unstructured":"Pifer, R. \"hurtling into the future\u201d: The potential and thorny ethics of generative ai in healthcare. Healthcare Dive https:\/\/www.healthcaredive.com\/news\/generative-AI-healthcare-gpt-potential\/648104\/ (2023)."},{"key":"965_CR94","doi-asserted-by":"publisher","unstructured":"Rosenberg, I., Shabtai, A., Elovici, Y. & Rokach, L. Adversarial machine learning attacks and defense methods in the cyber security domain. ACM Comput. Surv. 54 https:\/\/doi.org\/10.1145\/3453158 (2021).","DOI":"10.1145\/3453158"},{"key":"965_CR95","doi-asserted-by":"crossref","unstructured":"Sigfrids, A., Leikas, J., Salo-P\u00f6ntinen, H. & Koskimies, E. Human-centricity in AI governance: A systemic approach. Front. Artif. Intell. 6 https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.976887 (2023).","DOI":"10.3389\/frai.2023.976887"},{"key":"965_CR96","doi-asserted-by":"publisher","unstructured":"Developing cyber-resilient systems: A systems security engineering approach https:\/\/doi.org\/10.6028\/NIST.SP.800-160v2r1.","DOI":"10.6028\/NIST.SP.800-160v2r1"},{"key":"965_CR97","unstructured":"Centers for Disease Control and Prevention https:\/\/www.cdc.gov\/healthequity\/whatis\/index.html (2022)."},{"key":"965_CR98","doi-asserted-by":"crossref","unstructured":"Aquino, Y. S. J. et al. Practical, epistemic and normative implications of algorithmic bias in healthcare artificial intelligence: a qualitative study of multidisciplinary expert perspectives. J. Med. Ethics (2023).","DOI":"10.1136\/jme-2022-108850"},{"key":"965_CR99","doi-asserted-by":"publisher","first-page":"4296","DOI":"10.1073\/pnas.1516047113","volume":"113","author":"KM Hoffman","year":"2016","unstructured":"Hoffman, K. M., Trawalter, S., Axt, J. R. & Oliver, M. N. Racial bias in pain assessment and treatment recommendations, and false beliefs about biological differences between blacks and whites. Proc. Natl Acad. Sci. 113, 4296\u20134301 (2016).","journal-title":"Proc. Natl Acad. Sci."},{"key":"965_CR100","unstructured":"Oldehoeft, A. E. Foundations of a security policy for use of the national research and educational network https:\/\/nvlpubs.nist.gov\/nistpubs\/Legacy\/IR\/nistir4734.pdf."},{"key":"965_CR101","doi-asserted-by":"publisher","unstructured":"Robertson, C. et al. Diverse patients\u2019 attitudes towards artificial intelligence (AI) in diagnosis. PLOS Digital Health https:\/\/doi.org\/10.1371\/journal.pdig.0000237.","DOI":"10.1371\/journal.pdig.0000237"},{"key":"965_CR102","doi-asserted-by":"publisher","first-page":"251 \u2013 256","DOI":"10.2471\/BLT.19.237487","volume":"98","author":"I Habli","year":"2020","unstructured":"Habli, I., Lawton, T. & Porter, Z. Artificial intelligence in health care: accountability and safety. Bull. World Health Org. 98, 251 \u2013 256 (2020).","journal-title":"Bull. World Health Org."},{"key":"965_CR103","doi-asserted-by":"crossref","unstructured":"Mora-Cantallops, M., S\u00e1nchez-Alonso, S., Garc\u00eda-Barriocanal, E. & Sicilia, M.-A. Traceability for trustworthy AI: a review of models and tools. Big Data Cogn. Comput. 5 https:\/\/www.mdpi.com\/2504-2289\/5\/2\/20 (2021).","DOI":"10.3390\/bdcc5020020"},{"key":"965_CR104","doi-asserted-by":"publisher","unstructured":"Li, B. et al. Trustworthy ai: From principles to practices. ACM Comput. Surv. 55 https:\/\/doi.org\/10.1145\/3555803 (2023).","DOI":"10.1145\/3555803"},{"key":"965_CR105","unstructured":"Barker, E., Smid, M., Branstad, D. & Chokhani, S. A framework for designing cryptographic key management systems https:\/\/csrc.nist.gov\/publications\/detail\/sp\/800-130\/final."},{"key":"965_CR106","unstructured":"(OCR), O. f. C. R. Guidance on risk analysis. HHS.gov https:\/\/www.hhs.gov\/hipaa\/for-professionals\/security\/guidance\/guidance-risk-analysis\/index.html (2021)."},{"key":"965_CR107","unstructured":"Perez, F. & Ribeiro, I. Ignore previous prompt: Attack techniques for language models. In NeurIPS ML Safety Workshop https:\/\/openreview.net\/forum?id=qiaRo_7Zmug (2022)."},{"key":"965_CR108","unstructured":"Liu, Y. et al. Jailbreaking chatgpt via prompt engineering: An empirical study (2023). Preprint at https:\/\/arxiv.org\/abs\/2305.13860."},{"key":"965_CR109","unstructured":"Stanley-Lockman, Z. & Christie, E. H. An artificial intelligence strategy for nato https:\/\/www.nato.int\/docu\/review\/articles\/2021\/10\/25\/an-artificial-intelligence-strategy-for-nato\/index.html."},{"key":"965_CR110","unstructured":"Team, T. F. State of California endorses Asilomar ai principles. Future Life Inst. https:\/\/futureoflife.org\/recent-news\/state-of-california-endorses-asilomar-ai-principles\/ (2022)."},{"key":"965_CR111","doi-asserted-by":"publisher","first-page":"26","DOI":"10.3390\/healthcare8010026","volume":"8","author":"M Moudatsou","year":"2020","unstructured":"Moudatsou, M., Stavropoulou, A., Philalithis, A. & Koukouli, S. The role of empathy in health and social care professionals. Healthcare 8, 26 (2020).","journal-title":"Healthcare"},{"key":"965_CR112","doi-asserted-by":"crossref","unstructured":"Zhu, Q. & Luo, J. Toward artificial empathy for human-centered design: A framework (2023). Preprint at https:\/\/arxiv.org\/abs\/2303.10583.","DOI":"10.1115\/DETC2023-117266"},{"key":"965_CR113","unstructured":"Asch, D. A. An interview with chatgpt about health care. Catal. Non Issue Content 4 (2023)."},{"key":"965_CR114","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1136\/jme.28.5.332-a","volume":"28","author":"S Holm","year":"2002","unstructured":"Holm, S. Principles of biomedical ethics, 5th edn. J. Med. Eth. 28, 332\u2013332 (2002).","journal-title":"J. Med. Eth."},{"key":"965_CR115","doi-asserted-by":"crossref","unstructured":"AMA Journal of Ethics 18, 12\u201317 (2016).","DOI":"10.1001\/journalofethics.2017.18.1.ecas2-1601"},{"key":"965_CR116","doi-asserted-by":"crossref","unstructured":"Applin, S. & Fischer, M. New technologies and mixed-use convergence: How humans and algorithms are adapting to each other (2016).","DOI":"10.1109\/ISTAS.2015.7439436"},{"key":"965_CR117","unstructured":"Human Rights and Biomedicine https:\/\/coe.int\/en\/web\/bioethics\/report-impact-of-ai-on-the-doctor-patient-relationship."},{"key":"965_CR118","doi-asserted-by":"crossref","unstructured":"Svikhnushina, E. & Pu, P. Approximating online human evaluation of social chatbots with prompting. In Proceedings of the 24th Meeting of the Special Interest Group on Discourse and Dialogue, (eds Schlangen, D. et al.) 268\u2013281 (Association for Computational Linguistics, 2023). https:\/\/aclanthology.org\/2023.sigdial-1.25.","DOI":"10.18653\/v1\/2023.sigdial-1.25"},{"key":"965_CR119","unstructured":"Raamkumar, A. S. & Yang, Y. Empathetic conversational systems: a review of current advances, gaps, and opportunities (2022). Preprint at https:\/\/arxiv.org\/abs\/2206.05017."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00965-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00965-x","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00965-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,7]],"date-time":"2023-12-07T08:07:00Z","timestamp":1701936420000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00965-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,2]]},"references-count":119,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["965"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00965-x","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,2]]},"assertion":[{"value":"18 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 December 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Y.W. consults for Pfizer Inc. and has ownership\/equity interests in BonafideNLP, LLC. All other authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"225"}}