{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T07:49:07Z","timestamp":1782546547015,"version":"3.54.5"},"reference-count":60,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T00:00:00Z","timestamp":1708128000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T00:00:00Z","timestamp":1708128000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004770","name":"Universit\u00e0 degli Studi di Parma","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004770","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Med Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Within the domain of Natural Language Processing (NLP), Large Language Models (LLMs) represent sophisticated models engineered to comprehend, generate, and manipulate text resembling human language on an extensive scale. They are transformer-based deep learning architectures, obtained through the scaling of model size, pretraining of corpora, and computational resources. The potential healthcare applications of these models primarily involve chatbots and interaction systems for clinical documentation management, and medical literature summarization (Biomedical NLP). The challenge in this field lies in the research for applications in diagnostic and clinical decision support, as well as patient triage. Therefore, LLMs can be used for multiple tasks within patient care, research, and education. Throughout 2023, there has been an escalation in the release of LLMs, some of which are applicable in the healthcare domain. This remarkable output is largely the effect of the customization of pre-trained models for applications like chatbots, virtual assistants, or any system requiring human-like conversational engagement. As healthcare professionals, we recognize the imperative to stay at the forefront of knowledge. However, keeping abreast of the rapid evolution of this technology is practically unattainable, and, above all, understanding its potential applications and limitations remains a subject of ongoing debate. Consequently, this article aims to provide a succinct overview of the recently released LLMs, emphasizing their potential use in the field of medicine. Perspectives for a more extensive range of safe and effective applications are also discussed. The upcoming evolutionary leap involves the transition from an AI-powered model primarily designed for answering medical questions to a more versatile and practical tool for healthcare providers such as generalist biomedical AI systems for multimodal-based calibrated decision-making processes. On the other hand, the development of more accurate virtual clinical partners could enhance patient engagement, offering personalized support, and improving chronic disease management.<\/jats:p>","DOI":"10.1007\/s10916-024-02045-3","type":"journal-article","created":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T02:02:25Z","timestamp":1708135345000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":204,"title":["The Breakthrough of Large Language Models Release for Medical Applications: 1-Year Timeline and Perspectives"],"prefix":"10.1007","volume":"48","author":[{"given":"Marco","family":"Cascella","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Federico","family":"Semeraro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan","family":"Montomoli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentina","family":"Bellini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ornella","family":"Piazza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elena","family":"Bignami","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,17]]},"reference":[{"key":"2045_CR1","first-page":"730","volume":"35","author":"L Ouyang","year":"2022","unstructured":"Ouyang L, Wu J, Jiang X, Almeida, Wainwright C, Mishkin P, Zhang C, Agarwal S, Slama K. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems. 2022; 35:730\u2013744.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2045_CR2","doi-asserted-by":"publisher","first-page":"103982","DOI":"10.1016\/j.jbi.2021.103982","volume":"126","author":"KS Kalyan","year":"2022","unstructured":"Kalyan KS, Rajasekharan A, Sangeetha S. Ammu: a survey of transformer-based biomedical pretrained language models. Journal of biomedical informatics. 2022;126:103982.","journal-title":"Journal of biomedical informatics"},{"key":"2045_CR3","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I. Attention Is All You Need. 2017. arXiv:1706.03762."},{"key":"2045_CR4","unstructured":"Open AI. ChatGPT release note. Available at: https:\/\/help.openai.com\/en\/articles\/6825453-chatgpt-release-notes#h_4799933861 Last Accessed: December 22, 2023."},{"key":"2045_CR5","doi-asserted-by":"crossref","unstructured":"Tian S, Jin Q, Yeganova L, Lai P-T, Zhu Q, Chen X, Yang X, Chen, Kim W, Comeau DC, Islamaj R, Kapoor A, Gao X, Lu Z. Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health- arXiv:2306.10070. (2023).","DOI":"10.1093\/bib\/bbad493"},{"key":"2045_CR6","unstructured":"Radford A, Narasimhan K. Improving Language Understanding by Generative Pre-Training. 2018. https:\/\/api.semanticscholar.org\/CorpusID:49313245."},{"issue":"12","key":"2045_CR7","doi-asserted-by":"publisher","first-page":"5369","DOI":"10.1109\/TNNLS.2021.3084198","volume":"32","author":"Z Cao","year":"2021","unstructured":"Cao Z, Wong K, Lin CT. Weak Human Preference Supervision for Deep Reinforcement Learning. IEEE Trans Neural Netw Learn Syst. 2021;32(12):5369\u20135378. doi: https:\/\/doi.org\/10.1109\/TNNLS.2021.3084198.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"2045_CR8","unstructured":"Rafailov R, Sharma A, Mitchell E, Ermon S, Manning CD, Finn C. Direct Preference Optimization: Your Language Model is Secretly a Reward Model. arXiv:2305.18290 (2023)."},{"key":"2045_CR9","unstructured":"Gao L, Biderman S, Black S, Golding L, Hoppe T, Foster C, Phang J, He H, Thite A, Nabeshima N, Presser S, Leahy C. The Pile: An 800GB Dataset of Diverse Text for Language Modeling. arXiv:2101.00027 (2020)."},{"key":"2045_CR10","unstructured":"Meta AI Request Form. Available at: https:\/\/docs.google.com\/forms\/d\/e\/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA\/viewform Last Accessed: December 22, 2023."},{"issue":"6","key":"2045_CR11","doi-asserted-by":"publisher","first-page":"e40895","DOI":"10.7759\/cureus.40895","volume":"15","author":"Y Li","year":"2023","unstructured":"Li Y, Li Z, Zhang K, Dan R, Jiang S, Zhang Y. ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledge. Cureus. 2023;15(6):e40895. doi: https:\/\/doi.org\/10.7759\/cureus.40895.","journal-title":"Cureus"},{"key":"2045_CR12","unstructured":"Microsoft Bing Blog. Available at: https:\/\/blogs.bing.com\/search\/november-2023\/our-vision-to-bring-microsoft-copilot-to-everyone-and-more. Last Accessed: December 24, 2023."},{"key":"2045_CR13","unstructured":"ZDNET Information. Available at: https:\/\/www.zdnet.com\/article\/what-is-copilot-formerly-bing-chat-heres-everything-you-need-to-know\/. Last Accessed: December 24, 2023."},{"key":"2045_CR14","unstructured":"Avanade Insight. Available at: https:\/\/www.avanade.com\/en\/blogs\/avanade-insights\/health-care\/ai-copilot. Last Accessed: December 24, 2023."},{"key":"2045_CR15","unstructured":"OpenAI. GPT-4 Technical Report. arXiv:2303.08774 (2023)."},{"key":"2045_CR16","unstructured":"The decoder. Available at: https:\/\/the-decoder.com\/gpt-4-architecture-datasets-costs-and-more-leaked\/ Last Accessed: December 22, 2023"},{"issue":"13","key":"2045_CR17","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1056\/NEJMsr2214184","volume":"388","author":"P Lee","year":"2023","unstructured":"Lee P, Bubeck S, Petro J. Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine. N Engl J Med. 2023;388(13):1233\u20131239. doi: https:\/\/doi.org\/10.1056\/NEJMsr2214184.","journal-title":"N Engl J Med"},{"issue":"5","key":"2045_CR18","doi-asserted-by":"publisher","first-page":"e230987","DOI":"10.1148\/radiol.230987","volume":"307","author":"R Bhayana","year":"2023","unstructured":"Bhayana R, Bleakney RR, Krishna S. GPT-4 in Radiology: Improvements in Advanced Reasoning. Radiology. 2023;307(5):e230987. doi: https:\/\/doi.org\/10.1148\/radiol.230987.","journal-title":"Radiology"},{"issue":"12","key":"2045_CR19","doi-asserted-by":"publisher","first-page":"e0000416","DOI":"10.1371\/journal.pdig.0000416","volume":"2","author":"D Jang","year":"2023","unstructured":"Jang D, Yun TR, Lee CY, Kwon YK, Kim CE. GPT-4 can pass the Korean National Licensing Examination for Korean Medicine Doctors. PLOS Digit Health. 2023;2(12):e0000416. doi: https:\/\/doi.org\/10.1371\/journal.pdig.0000416.","journal-title":"PLOS Digit Health"},{"key":"2045_CR20","doi-asserted-by":"publisher","first-page":"e160-e165","DOI":"10.1016\/j.wneu.2023.08.042","volume":"179","author":"GA Guerra","year":"2023","unstructured":"Guerra GA, Hofmann H, Sobhani S, Hofmann G, Gomez D, Soroudi D, Hopkins BS, Dallas J, Pangal DJ, Cheok S, Nguyen VN, Mack WJ, Zada G. GPT-4 Artificial Intelligence Model Outperforms ChatGPT, Medical Students, and Neurosurgery Residents on Neurosurgery Written Board-Like Questions. World Neurosurg. 2023;179:e160-e165. doi: https:\/\/doi.org\/10.1016\/j.wneu.2023.08.042.","journal-title":"World Neurosurg"},{"key":"2045_CR21","doi-asserted-by":"publisher","unstructured":"Scheschenja M, Viniol S, Bastian MB, Wessendorf J, K\u00f6nig AM, Mahnken AH. Feasibility of GPT-3 and GPT-4 for in-Depth Patient Education Prior to Interventional Radiological Procedures: A Comparative Analysis. Cardiovasc Intervent Radiol. 2023 Oct 23. doi: https:\/\/doi.org\/10.1007\/s00270-023-03563-2.","DOI":"10.1007\/s00270-023-03563-2"},{"issue":"6","key":"2045_CR22","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1093\/jalm\/jfad058","volume":"8","author":"NC Spies","year":"2023","unstructured":"Spies NC, Hubler Z, Roper SM, Omosule CL, Senter-Zapata M, Roemmich BL, Brown HM, Gimple R, Farnsworth CW. GPT-4 Underperforms Experts in Detecting IV Fluid Contamination. J Appl Lab Med. 2023;8(6):1092\u20131100. doi: https:\/\/doi.org\/10.1093\/jalm\/jfad058.","journal-title":"J Appl Lab Med"},{"issue":"7972","key":"2045_CR23","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","volume":"620","author":"K Singhal","year":"2023","unstructured":"Singhal K, Azizi S, Tu T, Mahdavi SS, Wei J, Chung HW, Scales N, Tanwani A, Cole-Lewis H, Pfohl S, Payne P, Seneviratne M, Gamble P, Kelly C, Babiker A, Sch\u00e4rli N, Chowdhery A, Mansfield P, Demner-Fushman D, Ag\u00fcera Y Arcas B, Webster D, Corrado GS, Matias Y, Chou K, Gottweis J, Tomasev N, Liu Y, Rajkomar A, Barral J, Semturs C, Karthikesalingam A, Natarajan V. Large language models encode clinical knowledge. Nature. 2023;620(7972):172\u2013180. doi: https:\/\/doi.org\/10.1038\/s41586-023-06291-2.","journal-title":"Nature"},{"key":"2045_CR24","unstructured":"Madaan A, Tandon N, Gupta P, Hallinan S, Gao L, Wiegreffe S, Alon U, Dziri N, Prabhumoye S, Yang Y, et al. Self-refine: Iterative refinement with self-feedback. arXiv preprint arXiv:2303.17651 (2023)."},{"key":"2045_CR25","unstructured":"Singhal K, Tu T, Gottweis J, Sayres R, Wulczyn E, Hou L, Clark K, Pfohl S, Cole-Lewis H, Neal D, Schaekermann M, Wang A, Amin M, Lachgar S, Mansfield P, Prakash S, Green B, Dominowska E, Aguera y Arcas B, Tomasev N, Liu Y, Wong R, Semturs C, Mahdavi S. Towards Expert-Level Medical Question Answering with Large Language Models. arXiv:2305.09617v1 (2023)."},{"key":"2045_CR26","doi-asserted-by":"crossref","unstructured":"Tu T, Azizi S, Driess D, Schaekermann M, Amin M, et al. Towards Generalist Biomedical AI. arXiv:2307.14334v1 (2023).","DOI":"10.1056\/AIoa2300138"},{"key":"2045_CR27","unstructured":"Hippocratic AI. Available at https:\/\/www.hippocraticai.com\/. Last Accessed: December 24, 2023."},{"key":"2045_CR28","unstructured":"Hugging Face. MPT-B. Available at: https:\/\/huggingface.co\/mosaicml\/mpt-7b. Last Accessed: December 24, 2023."},{"issue":"11","key":"2045_CR29","doi-asserted-by":"publisher","first-page":"e13386","DOI":"10.1111\/cogs.13386","volume":"47","author":"C Kauf","year":"2023","unstructured":"Kauf C, Ivanova AA, Rambelli G, Chersoni E, She JS, Chowdhury Z, Fedorenko E, Lenci A. Event Knowledge in Large Language Models: The Gap Between the Impossible and the Unlikely. Cogn Sci. 2023;47(11):e13386. doi: https:\/\/doi.org\/10.1111\/cogs.13386.","journal-title":"Cogn Sci"},{"key":"2045_CR30","unstructured":"Touvron H, Martin L, et al. LLaMA-2: Open Foundation and Fine-Tuned Chat Models. arXiv:2307.09288 (2023)."},{"key":"2045_CR31","doi-asserted-by":"crossref","unstructured":"Ainslie J, Lee-Thorp J, de Jong M, Zemlyanskiy Y, Lebron, Sanghai S. 2023. GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 4895\u20134901, Singapore. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2023.emnlp-main.298"},{"key":"2045_CR32","unstructured":"Jiang AQ, Sablayrolles A, Mensch A, Bamford C, Singh Chaplot D, de las Casas D, Bressand F, Lengyel G, Lample G, Saulnier L, Lavaud LR, Lachaux MA, Stock P, Le Scao T, Lavril T, Wang T, Lacroix T, El Sayed W. Mistral-7B arXiv:2310.06825."},{"key":"2045_CR33","unstructured":"An END-to-END guide on how to finetune a LLM(Mistral-7B) into a Medical Chat Doctor using Huggingface. Available at: https:\/\/medium.com\/@SachinKhandewal\/finetuning-mistral-7b-into-a-medical-chat-doctor-using-huggingface-qlora-peft-5ce15d45f581 Last Accessed: December 22, 2023."},{"key":"2045_CR34","unstructured":"Mistral AI. Available at: https:\/\/mistral.ai\/news\/mixtral-of-experts\/ Last Accessed: December 24, 2023."},{"key":"2045_CR35","unstructured":"Nijkamp E, Xie T, Hayashi H, Pang B, Xia C, Xing C, Vig J, Yavuz S, Laban P, Krause B, Purushwalkam S, Niu T, Kry\u015bci\u0144ski W, Murakhovs\u2019ka L, Choubey PK, Fabbri A, Liu Y, Meng R, Tu L, Bhat M, Wu C-S, Savarese S, Zhou Y, Joty S, Xiong C. XGen-7B Technical Report. arXiv:2309.03450."},{"issue":"1","key":"2045_CR36","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1038\/s41746-023-00958-w","volume":"6","author":"C Peng","year":"2023","unstructured":"Peng C, Yang X, Chen A, Smith KE, PourNejatian N, Costa AB, Martin C, Flores MG, Zhang Y, Magoc T, Lipori G, Mitchell DA, Ospina NS, Ahmed MM, Hogan WR, Shenkman EA, Guo Y, Bian J, Wu Y. A study of generative large language model for medical research and healthcare. NPJ Digit Med. 2023;6(1):210. doi: https:\/\/doi.org\/10.1038\/s41746-023-00958-w.","journal-title":"NPJ Digit Med"},{"key":"2045_CR37","unstructured":"Cunningham H, Ewart A, Riggs L, Huben R, Sharkey R. Sparse Autoencoders Find Highly Interpretable Features in Language Models. arXiv:2309.08600 (2023)."},{"key":"2045_CR38","unstructured":"Anthropic. Available at: https:\/\/www.anthropic.com\/ Last Accessed: December 22, 2023."},{"key":"2045_CR39","unstructured":"Gemini Team, Google. Gemini: A Family of Highly Capable Multimodal Models. Available at: https:\/\/assets.bwbx.io\/documents\/users\/iqjWHBFdfxIU\/r7G7RrtT6rnM\/v0 Last Accessed: January 31, 2023."},{"key":"2045_CR40","doi-asserted-by":"crossref","unstructured":"Yasunaga M, Leskovec J, Liang P. LinkBERT: Pretraining Language Models with Document Links. arXiv:2203.15827 (2022).","DOI":"10.18653\/v1\/2022.acl-long.551"},{"issue":"2","key":"2045_CR41","doi-asserted-by":"publisher","first-page":"605","DOI":"10.12669\/pjms.39.2.7653","volume":"39","author":"RA Khan","year":"2023","unstructured":"Khan RA, Jawaid M, Khan AR, Sajjad M. ChatGPT - Reshaping medical education and clinical management. Pak J Med Sci. 2023;39(2):605\u2013607. doi: https:\/\/doi.org\/10.12669\/pjms.39.2.7653.","journal-title":"Pak J Med Sci"},{"issue":"6","key":"2045_CR42","doi-asserted-by":"publisher","first-page":"887","DOI":"10.3390\/healthcare11060887","volume":"11","author":"M Sallam","year":"2023","unstructured":"Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. doi: https:\/\/doi.org\/10.3390\/healthcare11060887.","journal-title":"Healthcare (Basel)"},{"key":"2045_CR43","doi-asserted-by":"publisher","first-page":"e46885","DOI":"10.2196\/46885","volume":"9","author":"G Eysenbach","year":"2023","unstructured":"Eysenbach G. The Role of ChatGPT, Generative Language Models, and Artificial Intelligence in Medical Education: A Conversation With ChatGPT and a Call for Papers. JMIR Med Educ. 2023;9:e46885. doi: https:\/\/doi.org\/10.2196\/46885.","journal-title":"JMIR Med Educ"},{"issue":"1","key":"2045_CR44","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1186\/s44158-023-00118-2","volume":"3","author":"M Cascella","year":"2023","unstructured":"Cascella M, Cascella A, Monaco F, Shariff MN. Envisioning gamification in anesthesia, pain management, and critical care: basic principles, integration of artificial intelligence, and simulation strategies. J Anesth Analg Crit Care. 2023;3(1):33. doi: https:\/\/doi.org\/10.1186\/s44158-023-00118-2.","journal-title":"J Anesth Analg Crit Care"},{"key":"2045_CR45","doi-asserted-by":"publisher","unstructured":"Haque A, Chowdhury N-U-R. The Future of Medicine: Large Language Models Redefining Healthcare Dynamics. TechRxiv. November 22, 2023. doi: https:\/\/doi.org\/10.36227\/techrxiv.24354451.v2.","DOI":"10.36227\/techrxiv.24354451.v2"},{"key":"2045_CR46","doi-asserted-by":"publisher","first-page":"1225093","DOI":"10.3389\/frai.2023.1225093","volume":"6","author":"S Gurrapu","year":"2023","unstructured":"Gurrapu S, Kulkarni A, Huang L, Lourentzou I, Batarseh FA. Rationalization for explainable NLP: a survey. Front Artif Intell. 2023;6:1225093. doi: https:\/\/doi.org\/10.3389\/frai.2023.1225093.","journal-title":"Front Artif Intell"},{"issue":"1","key":"2045_CR47","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/s10916-023-01925-4","volume":"47","author":"M Cascella","year":"2023","unstructured":"Cascella M, Montomoli J, Bellini V, Bignami E. Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios. J Med Syst. 2023;47(1):33. doi: https:\/\/doi.org\/10.1007\/s10916-023-01925-4.","journal-title":"J Med Syst"},{"issue":"6","key":"2045_CR48","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1017\/S1049023X23006568","volume":"38","author":"AA Birkun","year":"2023","unstructured":"Birkun AA, Gautam A. Large Language Model (LLM)-Powered Chatbots Fail to Generate Guideline-Consistent Content on Resuscitation and May Provide Potentially Harmful Advice. Prehosp Disaster Med. 2023;38(6):757\u2013763. doi: https:\/\/doi.org\/10.1017\/S1049023X23006568.","journal-title":"Prehosp Disaster Med"},{"issue":"9","key":"2045_CR49","doi-asserted-by":"publisher","first-page":"e45473","DOI":"10.7759\/cureus.45473","volume":"15","author":"G Z\u00fa\u00f1iga Salazar","year":"2023","unstructured":"Z\u00fa\u00f1iga Salazar G, Z\u00fa\u00f1iga D, Vindel CL, Yoong AM, Hincapie S, Z\u00fa\u00f1iga AB, Z\u00fa\u00f1iga P, Salazar E, Z\u00fa\u00f1iga B. Efficacy of AI Chats to Determine an Emergency: A Comparison Between OpenAI\u2019s ChatGPT, Google Bard, and Microsoft Bing AI Chat. Cureus. 2023;15(9):e45473. doi: https:\/\/doi.org\/10.7759\/cureus.45473.","journal-title":"Cureus"},{"key":"2045_CR50","unstructured":"MIT Technology Review. Why Meta\u2019s latest large language model survived only three days online. https:\/\/www.technologyreview.com\/2022\/11\/18\/1063487\/meta-large-language-model-ai-only-survived-three-days-gpt-3-science\/ Last Accessed: December 22, 2023."},{"key":"2045_CR51","doi-asserted-by":"publisher","unstructured":"Batarseh FA, Freeman L, Huang C-H. A survey on artificial intelligence assurance. J Big Data 2021;8,7. doi:https:\/\/doi.org\/10.1186\/s40537-021-00445-7.","DOI":"10.1186\/s40537-021-00445-7"},{"key":"2045_CR52","unstructured":"Manathunga S, Hettigoda I. Aligning Large Language Models for Clinical Tasks. arXiv:2309.02884 (2023)."},{"issue":"11","key":"2045_CR53","doi-asserted-by":"publisher","first-page":"e2343689","DOI":"10.1001\/jamanetworkopen.2023.43689","volume":"6","author":"M Benary","year":"2023","unstructured":"Benary M, Wang XD, Schmidt M, Soll D, Hilfenhaus G, Nassir M, Sigler C, Kn\u00f6dler M, Keller U, Beule D, Keilholz U, Leser U, Rieke DT. Leveraging Large Language Models for Decision Support in Personalized Oncology. JAMA Netw Open. 2023;6(11):e2343689. doi: https:\/\/doi.org\/10.1001\/jamanetworkopen.2023.43689.","journal-title":"JAMA Netw Open"},{"key":"2045_CR54","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell. 2019;1:206\u2013215. doi: https:\/\/doi.org\/10.1038\/s42256-019-0048-x.","journal-title":"Nat Mach Intell"},{"issue":"8","key":"2045_CR55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3546577","volume":"55","author":"A Madsen","year":"2022","unstructured":"Madsen A, Reddy S, Chandar S. Post-hoc Interpretability for Neural NLP: A Survey. ACM Computing Surveys. 2022;55(8):1\u201342. doi: https:\/\/doi.org\/10.1145\/3546577.","journal-title":"ACM Computing Surveys"},{"key":"2045_CR56","doi-asserted-by":"publisher","unstructured":"Tran D, Liu J, Dusenberry MW, Phan D, Collier M, Ren J, Han K, Wang Z, Mariet Z, Hu H, Band N, Rudner TJG, Singhal K, Nado Z, van Amersfoort J, Kirsch A, Jenatton R, Thain N, Yuan H, Buchanan K, Murphy K, Sculley D, Gal Y. Plex: towards reliability using pretrained large model extensions. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2207.07411 (2022).","DOI":"10.48550\/arXiv.2207.07411"},{"key":"2045_CR57","first-page":"1877","volume":"33","author":"T Brown","year":"2020","unstructured":"Brown T, et al. Language models are few-shot learners. Adv. Neural Inf. Process. Syst. 2020;33:1877\u20131901.","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"2045_CR58","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2104.08691","author":"B Lester","year":"2021","unstructured":"Lester B, Al-Rfou R, Constant N. The power of scale for parameter-efficient prompt tuning. Preprint at: https:\/\/doi.org\/10.48550\/arXiv.2104.08691 (2021).","journal-title":"Preprint at"},{"key":"2045_CR59","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2211.09110","author":"P Liang","year":"2022","unstructured":"Liang P. et al. Holistic evaluation of language models. Preprint at: https:\/\/doi.org\/10.48550\/arXiv.2211.09110 (2022).","journal-title":"Preprint at"},{"key":"2045_CR60","unstructured":"Hippocratic AI. Available at https:\/\/www.hippocraticai.com\/. Last Accessed: December 24, 2023"}],"container-title":["Journal of Medical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-024-02045-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10916-024-02045-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-024-02045-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T07:26:53Z","timestamp":1736839613000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10916-024-02045-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,17]]},"references-count":60,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2045"],"URL":"https:\/\/doi.org\/10.1007\/s10916-024-02045-3","relation":{},"ISSN":["1573-689X"],"issn-type":[{"value":"1573-689X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,17]]},"assertion":[{"value":"27 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Italic' removed-->Ethical Approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Availability of Supporting data"}}],"article-number":"22"}}