{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T00:47:53Z","timestamp":1775868473357,"version":"3.50.1"},"reference-count":152,"publisher":"Oxford University Press (OUP)","issue":"1","funder":[{"DOI":"10.13039\/100030692","name":"NIH Intramural Research Program","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100030692","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["1K99LM014024"],"award-info":[{"award-number":["1K99LM014024"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>ChatGPT has drawn considerable attention from both the general public and domain experts with its remarkable text generation capabilities. This has subsequently led to the emergence of diverse applications in the field of biomedicine and health. In this work, we examine the diverse applications of large language models (LLMs), such as ChatGPT, in biomedicine and health. Specifically, we explore the areas of biomedical information retrieval, question answering, medical text summarization, information extraction and medical education and investigate whether LLMs possess the transformative power to revolutionize these tasks or whether the distinct complexities of biomedical domain presents unique challenges. Following an extensive literature survey, we find that significant advances have been made in the field of text generation tasks, surpassing the previous state-of-the-art methods. For other applications, the advances have been modest. Overall, LLMs have not yet revolutionized biomedicine, but recent rapid progress indicates that such methods hold great potential to provide valuable means for accelerating discovery and improving health. We also find that the use of LLMs, like ChatGPT, in the fields of biomedicine and health entails various risks and challenges, including fabricated information in its generated responses, as well as legal and privacy concerns associated with sensitive patient data. We believe this survey can provide a comprehensive and timely overview to biomedical researchers and healthcare practitioners on the opportunities and challenges associated with using ChatGPT and other LLMs for transforming biomedicine and health.<\/jats:p>","DOI":"10.1093\/bib\/bbad493","type":"journal-article","created":{"date-parts":[[2024,1,3]],"date-time":"2024-01-03T09:20:14Z","timestamp":1704273614000},"source":"Crossref","is-referenced-by-count":278,"title":["Opportunities and challenges for ChatGPT and large language models in biomedicine and health"],"prefix":"10.1093","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6415-1439","authenticated-orcid":false,"given":"Shubo","family":"Tian","sequence":"first","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1268-7239","authenticated-orcid":false,"given":"Qiao","family":"Jin","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Lana","family":"Yeganova","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Po-Ting","family":"Lai","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Qingqing","family":"Zhu","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Xiuying","family":"Chen","sequence":"additional","affiliation":[{"name":"King Abdullah University of Science and Technology"}]},{"given":"Yifan","family":"Yang","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Qingyu","family":"Chen","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Won","family":"Kim","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Donald C","family":"Comeau","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5651-1860","authenticated-orcid":false,"given":"Rezarta","family":"Islamaj","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Aadit","family":"Kapoor","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]},{"given":"Xin","family":"Gao","sequence":"additional","affiliation":[{"name":"King Abdullah University of Science and Technology"}]},{"given":"Zhiyong","family":"Lu","sequence":"additional","affiliation":[{"name":"National Library of Medicine, National Institutes of Health"}]}],"member":"286","published-online":{"date-parts":[[2024,1,2]]},"reference":[{"key":"2024041921491165300_ref1","volume-title":"Introducing ChatGPT","author":"OpenAI","year":"2022"},{"key":"2024041921491165300_ref2","volume-title":"GPT-4 Technical Report","author":"OpenAI","year":"2023"},{"key":"2024041921491165300_ref3","volume-title":"On the Opportunities and Risks of Foundation Models","author":"Bommasani","year":"2022"},{"key":"2024041921491165300_ref4","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2020.emnlp-main.379","article-title":"BioMegatron: Larger Biomedical Domain Language Model","volume-title":"et\u00a0al","author":"Shin","year":"2020"},{"key":"2024041921491165300_ref5","volume-title":"GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records","author":"Yang","year":"2022"},{"key":"2024041921491165300_ref6","article-title":"BioMedLM: a Domain-Specific Large Language Model for Biomedical Text","volume-title":"Stanford CRFM Blog","author":"Bolton","year":"2022"},{"issue":"6","key":"2024041921491165300_ref7","doi-asserted-by":"crossref","first-page":"bbac409","DOI":"10.1093\/bib\/bbac409","article-title":"BioGPT: generative pre-trained transformer for biomedical text generation and mining","volume":"23","author":"Luo","year":"2022","journal-title":"Brief Bioinform"},{"key":"2024041921491165300_ref8","volume-title":"Large Language Models Encode Clinical Knowledge","author":"Singhal","year":"2022"},{"key":"2024041921491165300_ref9","volume-title":"PMC-LLaMA: Further Finetuning LLaMA on Medical Papers","author":"Wu","year":"2023"},{"key":"2024041921491165300_ref10","volume-title":"A Survey of Large Language Models","author":"Zhao","year":"2023"},{"key":"2024041921491165300_ref11","volume-title":"Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond","author":"Yang","year":"2023"},{"key":"2024041921491165300_ref12","doi-asserted-by":"crossref","DOI":"10.3389\/frai.2023.1169595","article-title":"ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations","volume":"6","author":"Dave","year":"2023","journal-title":"Front Artif Intell"},{"key":"2024041921491165300_ref13","doi-asserted-by":"crossref","first-page":"2647","DOI":"10.1007\/s10439-023-03284-0","article-title":"ChatGPT, bard, and large language models for biomedical research: opportunities and pitfalls","volume":"51","author":"Thapa","year":"2023","journal-title":"Ann Biomed Eng"},{"issue":"5","key":"2024041921491165300_ref14","first-page":"e38380","article-title":"A critical review of ChatGPT as a potential substitute for diabetes educators","volume":"15","author":"Sharma","year":"2023","journal-title":"Cureus"},{"key":"2024041921491165300_ref15","article-title":"A Neural Probabilistic Language Model","volume-title":"J Mach Learn Res","author":"Bengio","year":"2003"},{"key":"2024041921491165300_ref16","volume-title":"Attention Is All You Need","author":"Vaswani","year":"2017"},{"key":"2024041921491165300_ref17","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Devlin","year":"2019"},{"key":"2024041921491165300_ref18","article-title":"Improving Language Understanding by Generative Pre-Training","volume-title":"OpenAI Research Papers","author":"Radford","year":"2018"},{"key":"2024041921491165300_ref19","volume-title":"Proceedings of the 34th International Conference on Neural Information Processing Systems","author":"Brown","year":"2020"},{"key":"2024041921491165300_ref20","volume-title":"OpenAI Research Papers","author":"Radford","year":"2019"},{"issue":"140","key":"2024041921491165300_ref21","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J Mach Learn Res"},{"key":"2024041921491165300_ref22","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Lewis","year":"2020"},{"key":"2024041921491165300_ref23","volume-title":"Emergent Abilities of Large Language Models","author":"Wei","year":"2022"},{"key":"2024041921491165300_ref24","volume-title":"et\u00a0al","author":"Chowdhery","year":"2022"},{"key":"2024041921491165300_ref25","volume-title":"et\u00a0al","author":"Taylor","year":"2022"},{"key":"2024041921491165300_ref26","volume-title":"Training language models to follow instructions with human feedback","author":"Ouyang","year":"2022"},{"key":"2024041921491165300_ref27","volume-title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","author":"Wei","year":"2023"},{"key":"2024041921491165300_ref28","article-title":"OpenAI codex","author":"OpenAI","year":"2021"},{"key":"2024041921491165300_ref29","volume-title":"Capabilities of GPT-4 on Medical Challenge Problems","author":"Nori","year":"2023"},{"key":"2024041921491165300_ref30","volume-title":"Towards Expert-Level Medical Question Answering with Large Language Models","author":"Singhal","year":"2023"},{"key":"2024041921491165300_ref31","volume-title":"Can Large Language Models Reason About Medical Questions?","author":"Li\u00e9vin","year":"2023"},{"key":"2024041921491165300_ref32","volume-title":"et\u00a0al","author":"Touvron","year":"2023"},{"key":"2024041921491165300_ref33","volume-title":"Clinical Camel: An Open-Source Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding","author":"Toma","year":"2023"},{"key":"2024041921491165300_ref34","volume-title":"ChatDoctor: A Medical Chat Model Fine-tuned on LLaMA Model using Medical Domain Knowledge","author":"Li","year":"2023"},{"key":"2024041921491165300_ref35","volume-title":"MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Data","author":"Han","year":"2023"},{"key":"2024041921491165300_ref36","volume-title":"Scaling Instruction-Finetuned Language Models","author":"Chung","year":"2022"},{"issue":"4","key":"2024041921491165300_ref37","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2020","journal-title":"Bioinformatics"},{"key":"2024041921491165300_ref38","article-title":"Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing","volume-title":"ACM Trans Comput Healthcare","author":"Gu","year":"2021"},{"key":"2024041921491165300_ref39","volume-title":"ELECTRAMed: A New Pre-Trained Language Representation Model for Biomedical NLP","author":"Miolo","year":"2021"},{"key":"2024041921491165300_ref40","volume-title":"The Pile: An 800GB Dataset of Diverse Text for Language Modeling","author":"Gao","year":"2020"},{"key":"2024041921491165300_ref41","author":"Lo","year":"2020"},{"key":"2024041921491165300_ref42","volume-title":"PaLM 2 Technical Report","author":"Anil R, Dai AM, Firat O","year":"2023"},{"issue":"14","key":"2024041921491165300_ref43","doi-asserted-by":"crossref","first-page":"6421","DOI":"10.3390\/app11146421","article-title":"What disease does this patient have? A large-scale open domain question answering dataset from medical exams","volume":"11","author":"Jin","year":"2021","journal-title":"Appl Sci"},{"key":"2024041921491165300_ref44","volume-title":"Proceedings of the Conference on Health, Inference, and Learning","author":"Pal","year":"2022"},{"key":"2024041921491165300_ref45","volume-title":"Overview of the Medical Question Answering Task at TREC 2017 LiveQA","author":"Abacha","year":"2017"},{"key":"2024041921491165300_ref46","first-page":"25","volume-title":"MEDINFO 2019: Health and Wellbeing e-Networks for All","author":"Abacha","year":"2019"},{"issue":"2","key":"2024041921491165300_ref47","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1197\/jamia.M1608","article-title":"Answering Physicians' clinical questions: obstacles and potential solutions","volume":"12","author":"Ely","year":"2005","journal-title":"J Am Med Inform Assoc"},{"key":"2024041921491165300_ref48","doi-asserted-by":"crossref","DOI":"10.1016\/j.jbi.2019.103141","article-title":"A survey on literature based discovery approaches in biomedical domain","volume":"93","author":"Gopalakrishnan","year":"2019","journal-title":"J Biomed Inform"},{"key":"2024041921491165300_ref49","doi-asserted-by":"crossref","first-page":"baq036","DOI":"10.1093\/database\/baq036","article-title":"PubMed and beyond: a survey of web tools for searching biomedical literature","volume":"2011","author":"Lu","year":"2011","journal-title":"Database"},{"key":"2024041921491165300_ref50","article-title":"Biomedical Question Answering: A Survey of Approaches and Challenges","volume-title":"ACM Comput Surv","author":"Jin","year":"2022"},{"issue":"1","key":"2024041921491165300_ref51","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1186\/1471-2105-8-423","article-title":"PubMed related articles: a probabilistic topic-based model for content similarity","volume":"8","author":"Lin","year":"2007","journal-title":"BMC Bioinformatics"},{"issue":"8","key":"2024041921491165300_ref52","doi-asserted-by":"crossref","first-page":"1302","DOI":"10.1681\/ASN.0000000000000166","article-title":"Retrieve, summarize, and Verify: how will ChatGPT impact information seeking from the medical literature?","volume":"34","author":"Jin","year":"2023","journal-title":"J Am Soc Nephrol"},{"key":"2024041921491165300_ref53","volume-title":"ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports","author":"Jeblick","year":"2022"},{"key":"2024041921491165300_ref54","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2023.findings-emnlp.467","volume-title":"Evaluating Verifiability in Generative Search Engines","author":"Liu","year":"2023"},{"key":"2024041921491165300_ref55","doi-asserted-by":"crossref","DOI":"10.1145\/3539618.3591703","volume-title":"Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?","author":"Wang","year":"2023"},{"key":"2024041921491165300_ref56","first-page":"1","volume-title":"CEUR Workshop Proceedings","author":"Kanoulas","year":"2017"},{"key":"2024041921491165300_ref57","volume-title":"CEUR Workshop Proceedings","author":"Kanoulas","year":"2018"},{"key":"2024041921491165300_ref58","volume-title":"CEUR Workshop Proceedings","author":"Kanoulas","year":"2019"},{"key":"2024041921491165300_ref59","volume-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Wang","year":"2022"},{"issue":"1","key":"2024041921491165300_ref60","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1038\/s41597-023-02068-4","article-title":"BioASQ-QA: a manually curated corpus for biomedical question answering","volume":"10","author":"Krithara","year":"2023","journal-title":"Sci Data"},{"issue":"1","key":"2024041921491165300_ref61","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1186\/s12859-015-0564-6","article-title":"An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition","volume":"16","author":"Tsatsaronis","year":"2015","journal-title":"BMC Bioinformatics"},{"key":"2024041921491165300_ref62","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Jin","year":"2019"},{"key":"2024041921491165300_ref63","doi-asserted-by":"crossref","DOI":"10.1101\/2023.03.11.532238","volume-title":"GeneTuring tests GPT models in genomics","author":"Hou","year":"2023"},{"key":"2024041921491165300_ref64","volume-title":"Deep Bidirectional Language-Knowledge Graph Pretraining","author":"Yasunaga","year":"2022"},{"issue":"12","key":"2024041921491165300_ref65","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3571730","article-title":"Survey of hallucination in natural language generation","volume":"55","author":"Ji","year":"2023","journal-title":"ACM Comput Surv"},{"key":"2024041921491165300_ref66","volume-title":"Almanac: Retrieval-Augmented Language Models for Clinical Medicine","author":"Zakka","year":"2023"},{"key":"2024041921491165300_ref67","volume-title":"GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical Information","author":"Jin","year":"2023"},{"key":"2024041921491165300_ref68","volume-title":"TALM: Tool Augmented Language Models","author":"Parisi","year":"2022"},{"key":"2024041921491165300_ref69","volume-title":"Tool Learning with Foundation Models","author":"Qin","year":"2023"},{"key":"2024041921491165300_ref70","volume-title":"PAL: Program-aided Language Models","author":"Gao","year":"2023"},{"key":"2024041921491165300_ref71","volume-title":"Pew Research Center Blog Post","author":"Fox","year":"2013"},{"key":"2024041921491165300_ref72","volume-title":"DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Task","author":"Xiong","year":"2023"},{"key":"2024041921491165300_ref73","volume-title":"HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge","author":"Wang","year":"2023"},{"issue":"1","key":"2024041921491165300_ref74","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1613\/jair.3732","article-title":"Generating extractive summaries of scientific paradigms","volume":"46","author":"Qazvinian","year":"2013","journal-title":"J Artif Intell Res"},{"key":"2024041921491165300_ref75","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Cohan","year":"2018"},{"key":"2024041921491165300_ref76","volume-title":"Long Document Summarization with Top-down and Bottom-up Inference","author":"Pang","year":"2022"},{"key":"2024041921491165300_ref77","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Chen","year":"2021"},{"key":"2024041921491165300_ref78","volume-title":"Turn GPT-4 Into your Personal Literature Review Bot. The Academic\u2019s Field Guide to Writing Code Blog Post on Medium","author":"Laundry","year":"2023"},{"key":"2024041921491165300_ref79","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2023.acl-long.549","volume-title":"Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations","author":"Wang","year":"2023"},{"key":"2024041921491165300_ref80","volume-title":"Improving Radiology Summarization with Radiograph and Anatomy Prompts","author":"Hu","year":"2022"},{"key":"2024041921491165300_ref81","volume-title":"MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographs","author":"Johnson","year":"2019"},{"key":"2024041921491165300_ref82","volume-title":"et\u00a0al","author":"Smit","year":"2020"},{"key":"2024041921491165300_ref83","volume-title":"ImpressionGPT: An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT","author":"Ma","year":"2023"},{"key":"2024041921491165300_ref84","volume-title":"et\u00a0al","author":"Wang","year":"2023"},{"issue":"5","key":"2024041921491165300_ref85","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1093\/jamia\/ocv032","article-title":"Automated methods for the summarization of electronic health records","volume":"22","author":"Pivovarov","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2024041921491165300_ref86","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1016\/j.jbi.2011.03.008","article-title":"Summarization of clinical information: a conceptual model","volume":"44","author":"Feblowitz","year":"2011","journal-title":"J Biomed Inform"},{"key":"2024041921491165300_ref87","volume-title":"Query-Focused EHR Summarization to Aid Imaging Diagnosis","author":"McInerney","year":"2020"},{"key":"2024041921491165300_ref88","doi-asserted-by":"crossref","DOI":"10.1038\/s41591-023-02366-9","article-title":"AI-generated text may have a role in evidence-based medicine","volume":"29","author":"Peng","year":"2023","journal-title":"Nat Med"},{"issue":"3","key":"2024041921491165300_ref89","doi-asserted-by":"crossref","first-page":"e107","DOI":"10.1016\/S2589-7500(23)00021-3","article-title":"ChatGPT: the future of discharge summaries?","volume":"5","author":"Patel","year":"2023","journal-title":"Lancet Digit Health"},{"key":"2024041921491165300_ref90","volume-title":"npj Digit Med","author":"Tang","year":"2023"},{"key":"2024041921491165300_ref91","volume-title":"Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations","author":"Ramprasad","year":"2023"},{"key":"2024041921491165300_ref92","volume-title":"Bioinformatics","author":"Luo"},{"key":"2024041921491165300_ref93","volume-title":"Proceedings of the 20th Workshop on Biomedical Language Processing","author":"Alrowili","year":"2021"},{"key":"2024041921491165300_ref94","doi-asserted-by":"crossref","first-page":"baw032","DOI":"10.1093\/database\/baw032","article-title":"Assessing the state of the art in biomedical relation extraction: overview of the BioCreative V chemical-disease relation (CDR) task","volume":"2016","author":"Wei","year":"2016","journal-title":"Database"},{"key":"2024041921491165300_ref95","volume-title":"Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing","author":"Agrawal","year":"2022"},{"key":"2024041921491165300_ref96","volume-title":"Structured Prompt Interrogation and Recursive Extraction of Semantics (SPIRES): A Method for Populating Knowledge Bases Using Zero-Shot Learning","author":"Caufield","year":"2023"},{"key":"2024041921491165300_ref97","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2022.findings-emnlp.329","volume-title":"Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again","author":"Jimenez Gutierrez","year":"2022"},{"key":"2024041921491165300_ref98","doi-asserted-by":"crossref","DOI":"10.1093\/bioinformatics\/btad557","article-title":"A comprehensive benchmark study on biomedical text generation and mining with ChatGPT","volume":"39","author":"Chen","year":"2023","journal-title":"Bioinformatics"},{"key":"2024041921491165300_ref99","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jbi.2013.12.006","article-title":"NCBI disease corpus: a resource for disease name recognition and concept normalization","volume":"47","author":"Do\u011fan","year":"2014","journal-title":"J Biomed Inform"},{"issue":"2","key":"2024041921491165300_ref100","doi-asserted-by":"crossref","first-page":"S2","DOI":"10.1186\/gb-2008-9-s2-s2","article-title":"Overview of BioCreative II gene mention recognition","volume":"9","author":"Smith","year":"2008","journal-title":"Genome Biol"},{"key":"2024041921491165300_ref101","volume-title":"Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and its Applications (NLPBA\/BioNLP)","author":"Collier","year":"2004"},{"key":"2024041921491165300_ref102","volume-title":"Proceedings of the sixth BioCreative Challenge Evaluation Workshop","author":"Krallinger","year":"2017"},{"issue":"5","key":"2024041921491165300_ref103","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1016\/j.jbi.2013.07.011","article-title":"The DDI corpus: an annotated corpus with pharmacological substances and drug\u2013drug interactions","volume":"46","author":"Herrero-Zazo","year":"2013","journal-title":"J Biomed Inform"},{"issue":"1","key":"2024041921491165300_ref104","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1186\/s12859-015-0472-9","article-title":"Extraction of relations between genes and diseases from text and large-scale data analysis: implications for translational research","volume":"16","author":"Bravo","year":"2015","journal-title":"BMC Bioinformatics"},{"key":"2024041921491165300_ref105","volume-title":"Large Language Models in Biomedical Natural Language Processing: Benchmarks, Baselines, and Recommendations","author":"Chen","year":"2023"},{"key":"2024041921491165300_ref106","volume-title":"Educator considerations for ChatGPT","author":"OpenAI","year":"2023"},{"key":"2024041921491165300_ref107"},{"key":"2024041921491165300_ref108","article-title":"Large language models in medical education and quality concerns","volume":"6","author":"Pandey","year":"2023","journal-title":"J Qual Health Care Econ"},{"key":"2024041921491165300_ref109","volume-title":"The Role of ChatGPT, Generative Language Models, and Artificial Intelligence in Medical Education: A Conversation With ChatGPT and a Call for Papers","author":"Eysenbach","year":"2023"},{"key":"2024041921491165300_ref110","doi-asserted-by":"crossref","first-page":"605","DOI":"10.12669\/pjms.39.2.7653","article-title":"ChatGPT - reshaping medical education and clinical management","volume":"39","author":"Khan","year":"2023","journal-title":"Pak J Med Sci"},{"key":"2024041921491165300_ref111","volume-title":"Proceedings of the ACL-02 Workshop on Natural Language Processing in the Biomedical Domain","author":"Pustejovsky","year":"2002"},{"key":"2024041921491165300_ref112","volume-title":"Proceedings of DAARC","author":"Gasperin","year":"2007"},{"key":"2024041921491165300_ref113","volume-title":"Dagstuhl Seminar Proceedings","author":"Su"},{"issue":"2","key":"2024041921491165300_ref114","doi-asserted-by":"crossref","first-page":"S1","DOI":"10.1186\/1471-2105-11-S2-S1","article-title":"Resolving anaphoras for the extraction of drug-drug interactions in pharmacological documents","volume":"11","author":"Segura-Bedmar","year":"2010","journal-title":"BMC Bioinformatics"},{"key":"2024041921491165300_ref115","volume-title":"Proceedings of BioNLP Shared Task 2011 Workshop","author":"Nguyen"},{"key":"2024041921491165300_ref116","volume-title":"Proceedings of BioNLP 2011 Workshop","author":"Batista-Navarro"},{"issue":"1","key":"2024041921491165300_ref117","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1186\/s12859-017-1775-9","article-title":"Coreference annotation and resolution in the Colorado richly annotated full text (CRAFT) corpus of biomedical journal articles","volume":"18","author":"Cohen","year":"2017","journal-title":"BMC Bioinformatics"},{"key":"2024041921491165300_ref118","volume-title":"Proceedings of the Fourth Workshop on Computational Models of Reference, Anaphora and Coreference","author":"Lu"},{"issue":"3","key":"2024041921491165300_ref119","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1093\/bioinformatics\/btv585","article-title":"Automatic semantic classification of scientific literature according to the hallmarks of cancer","volume":"32","author":"Baker","year":"2016","journal-title":"Bioinformatics"},{"key":"2024041921491165300_ref120","volume-title":"Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Shaib"},{"key":"2024041921491165300_ref121","volume-title":"Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models","author":"Tamkin","year":"2021"},{"key":"2024041921491165300_ref122","volume-title":"GPT-4 System Card","author":"OpenAI","year":"2023"},{"key":"2024041921491165300_ref123","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Shah"},{"key":"2024041921491165300_ref124","volume-title":"Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society","author":"Abid"},{"issue":"6464","key":"2024041921491165300_ref125","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"issue":"16","key":"2024041921491165300_ref126","doi-asserted-by":"crossref","first-page":"3867","DOI":"10.3390\/cancers14163867","article-title":"Possible bias in supervised deep learning algorithms for CT lung nodule detection and classification","volume":"14","author":"Sourlos","year":"2022","journal-title":"Cancer"},{"issue":"9","key":"2024041921491165300_ref127","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1056\/NEJMms2004740","article-title":"Hidden in plain sight \u2014 reconsidering the use of race correction in clinical algorithms","volume":"383","author":"Vyas","year":"2020","journal-title":"N Engl J Med"},{"key":"2024041921491165300_ref128","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2022","author":"Huang"},{"key":"2024041921491165300_ref129","doi-asserted-by":"crossref","first-page":"9","DOI":"10.3389\/fsurg.2022.862322","article-title":"Legal and ethical consideration in artificial intelligence in healthcare: who takes responsibility?","volume":"9","author":"Naik","year":"2022","journal-title":"Front Surg"},{"issue":"6","key":"2024041921491165300_ref130","doi-asserted-by":"crossref","first-page":"887","DOI":"10.3390\/healthcare11060887","article-title":"ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns","volume":"11","author":"Sallam","year":"2023","journal-title":"Healthcare"},{"key":"2024041921491165300_ref131","volume-title":"ChatGPT in Healthcare: A Taxonomy and Systematic Review","author":"Li","year":"2023"},{"issue":"5","key":"2024041921491165300_ref132","article-title":"Embracing large language models for medical applications: opportunities and challenges","volume":"15","author":"Karabacak","year":"2023","journal-title":"Cureus"},{"key":"2024041921491165300_ref133","article-title":"Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models","volume":"2","author":"Kung","journal-title":"PLOS Digit Health"},{"key":"2024041921491165300_ref134","doi-asserted-by":"crossref","first-page":"103537","DOI":"10.1016\/j.nepr.2022.103537","article-title":"Open artificial intelligence platforms in nursing education: tools for academic progress or abuse?","volume":"66","author":"O'Connor","year":"2023","journal-title":"Nurse Educ Pract"},{"key":"2024041921491165300_ref135","first-page":"82","article-title":"Rapamycin in the context of Pascal's wager: generative pre-trained transformer perspective","volume":"9","author":"Zhavoronkov","year":"2022","journal-title":"Onco Targets Ther"},{"key":"2024041921491165300_ref136","volume-title":"Can GPT-3 Write an Academic Paper on Itself, With Minimal Human Input?","author":"GPT Generative Pretrained Transformer,","year":"2022"},{"issue":"7945","key":"2024041921491165300_ref137","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1038\/d41586-023-00107-z","article-title":"ChatGPT listed as author on research papers: many scientists disapprove","volume":"613","author":"Stokel-Walker","year":"2023","journal-title":"Nature"},{"issue":"67","key":"2024041921491165300_ref138","first-page":"103572","article-title":"Corrigendum to \u201copen artificial intelligence platforms in nursing education: tools for academic progress or abuse?\u201d [nurse Educ. Pract. 66 (2023) 103537]","volume":"2023","author":"O'Connor","journal-title":"Nurse Educ Pract"},{"issue":"1","key":"2024041921491165300_ref139","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1038\/s41746-023-00819-6","article-title":"Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers","volume":"6","author":"Gao","year":"2023","journal-title":"NPJ Digit Med"},{"key":"2024041921491165300_ref140","doi-asserted-by":"crossref","first-page":"6","DOI":"10.3352\/jeehp.2023.20.6","article-title":"Can an artificial intelligence chatbot be the author of a scholarly article?","volume":"20","author":"Lee","year":"2023","journal-title":"J Educ Eval Health Prof"},{"key":"2024041921491165300_ref141","doi-asserted-by":"crossref","DOI":"10.1016\/j.nepr.2023.103599","article-title":"ChatGPT as an author of academic papers is wrong and highlights the concepts of accountability and contributorship","volume":"68","author":"Siegerink","year":"2023","journal-title":"Nurse Educ Pract"},{"key":"2024041921491165300_ref142","doi-asserted-by":"crossref","first-page":"333","DOI":"10.2188\/jea.JE20230078","article-title":"Should we acknowledge ChatGPT as an author?","volume":"33","author":"Goto","year":"2023","journal-title":"J Epidemiol"},{"key":"2024041921491165300_ref143","doi-asserted-by":"crossref","first-page":"381","DOI":"10.2188\/jea.JE20230030","article-title":"Can ChatGPT be considered an author of a medical article?","volume":"33","author":"Ide","year":"2023","journal-title":"J Epidemiol"},{"issue":"6","key":"2024041921491165300_ref144","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1007\/s10439-023-03212-2","article-title":"Large language models like ChatGPT in ABME: author guidelines","volume":"51","author":"Norris","year":"2023","journal-title":"Ann Biomed Eng"},{"key":"2024041921491165300_ref145","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"2024041921491165300_ref146","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni"},{"key":"2024041921491165300_ref147","volume-title":"Text Summarization Branches Out","author":"Lin"},{"key":"2024041921491165300_ref148","volume-title":"Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization","author":"Banerjee"},{"key":"2024041921491165300_ref149","volume-title":"BERTScore: Evaluating Text Generation with BERT","author":"Zhang","year":"2020"},{"key":"2024041921491165300_ref150","volume-title":"Advances in Neural Information Processing Systems","author":"Yuan"},{"key":"2024041921491165300_ref151","volume-title":"GPTScore: Evaluate as You Desire","author":"Fu","year":"2023"},{"key":"2024041921491165300_ref152","volume-title":"Matching Patients to Clinical Trials with Large Language Models","author":"Jin"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/1\/bbad493\/57263001\/bbad493.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/1\/bbad493\/57263001\/bbad493.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,19]],"date-time":"2024-04-19T21:50:20Z","timestamp":1713563420000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbad493\/7505071"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,22]]},"references-count":152,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,11,22]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbad493","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,11,22]]},"article-number":"bbad493"}}