{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T14:08:03Z","timestamp":1788962883832,"version":"build-2803163510"},"reference-count":19,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T00:00:00Z","timestamp":1781222400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0"},{"start":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T00:00:00Z","timestamp":1781222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Drug Saf"],"published-print":{"date-parts":[[2026,10]]},"DOI":"10.1007\/s40264-026-01682-6","type":"journal-article","created":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T08:29:55Z","timestamp":1781252995000},"page":"1181-1198","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Large Language Model for Extracting Post-marketing Adverse Drug Events from Clinical Notes in the Electronic Health Record"],"prefix":"10.1007","volume":"49","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-1240-5685","authenticated-orcid":false,"given":"Dana","family":"Ludwig","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michelle","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8417-2288","authenticated-orcid":false,"given":"James","family":"Buchanan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Trang","family":"Trinh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,6,12]]},"reference":[{"key":"1682_CR1","unstructured":"Wei Q, Ji Z, Si Y, Du J, Wang J, Firat Tiryaki, et al. Relation extraction from clinical narratives using pre-trained language models. AMIA Annu Symp Proc. 2020;2019:1236. https:\/\/pmc.ncbi.nlm.nih.gov\/articles\/PMC7153059\/. Accessed 2 Jan 2025"},{"key":"1682_CR2","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1016\/j.jbi.2015.08.013","volume":"57","author":"A Henriksson","year":"2015","unstructured":"Henriksson A, Kvist M, Dalianis H, Duneld M. Identifying adverse drug event information in clinical notes with distributional semantic representations of context. J Biomed Inform. 2015;57:333\u201349. https:\/\/doi.org\/10.1016\/j.jbi.2015.08.013.","journal-title":"J Biomed Inform"},{"key":"1682_CR3","unstructured":"Guidance for Industry Postmarketing Adverse Experience Reporting for Human Drug and Licensed Biological Products: Clarification of What to Report. 1997. https:\/\/www.fda.gov\/media\/71635\/download"},{"key":"1682_CR4","unstructured":"IND Application Reporting: Safety reports. 2019; https:\/\/www.fda.gov\/drugs\/investigational-new-drug-ind-application\/ind-application-reporting-safety-reports. Accessed 1 Jan 2021"},{"key":"1682_CR5","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-024-02855-5","author":"D Van Veen","year":"2024","unstructured":"Van Veen D, Van Uden C, Blankemeier L, Delbrouck J-B, Aali A, Bluethgen C, et al. Adapted large language models can outperform medical experts in clinical text summarization. Nat Med. 2024. https:\/\/doi.org\/10.1038\/s41591-024-02855-5.","journal-title":"Nat Med"},{"key":"1682_CR6","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1111\/j.1365-2125.2011.04037.x","volume":"72","author":"J-L Montastruc","year":"2011","unstructured":"Montastruc J-L, Sommet A, Bagheri H, Lapeyre-Mestre M. Benefits and strengths of the disproportionality analysis for identification of adverse drug reactions in a pharmacovigilance database. Br J Clin Pharmacol. 2011;72:905\u20138. https:\/\/doi.org\/10.1111\/j.1365-2125.2011.04037.x.","journal-title":"Br J Clin Pharmacol"},{"key":"1682_CR7","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1093\/jamia\/ocz166","volume":"27","author":"S Henry","year":"2019","unstructured":"Henry S, Buchan K, Filannino M, Stubbs A, Uzuner O. 2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records. J Am Med Inform Assoc. 2019;27:3\u201312. https:\/\/doi.org\/10.1093\/jamia\/ocz166.","journal-title":"J Am Med Inform Assoc"},{"key":"1682_CR8","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35","author":"A Johnson","year":"2016","unstructured":"Johnson A, Pollard T, Shen L, Lehman L-W, Feng M, Ghassemi M, et al. OPEN SUBJECT CATEGORIES background & summary. MIMIC-III Free Access Crit Care Database. 2016. https:\/\/doi.org\/10.1038\/sdata.2016.35.","journal-title":"MIMIC-III Free Access Crit Care Database."},{"key":"1682_CR9","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1093\/jamia\/ocz063","volume":"27","author":"Q Wei","year":"2020","unstructured":"Wei Q, Ji Z, Li L, Du J, Wang J, Xu J, et al. A study of deep learning approaches for medication and adverse drug event extraction from clinical text. J Am Med Inform Assoc. 2020;27:13\u201321. https:\/\/doi.org\/10.1093\/jamia\/ocz063.","journal-title":"J Am Med Inform Assoc"},{"key":"1682_CR10","unstructured":"Darshini Mahendran, McInnes BT. Extracting adverse drug events from clinical notes. AMIA Summits Transl Sci Proc. 2021;2021:420. https:\/\/pmc.ncbi.nlm.nih.gov\/articles\/PMC8378605\/"},{"key":"1682_CR11","doi-asserted-by":"publisher","DOI":"10.3389\/fphar.2023.1218679","author":"MM Zitu","year":"2023","unstructured":"Zitu MM, Zhang S, Owen DH, Chiang C, Li L. Generalizability of machine learning methods in detecting adverse drug events from clinical narratives in electronic medical records. Front Pharmacol. 2023. https:\/\/doi.org\/10.3389\/fphar.2023.1218679.","journal-title":"Front Pharmacol"},{"key":"1682_CR12","doi-asserted-by":"publisher","unstructured":"Gu Y, Zhang S, Usuyama N, Woldesenbet Y, Wong C, Sanapathi P, et al. Distilling large language models for biomedical knowledge extraction: a case study on adverse drug events. arXiv.org. 2023. https:\/\/doi.org\/10.48550\/arXiv.2307.06439","DOI":"10.48550\/arXiv.2307.06439"},{"key":"1682_CR13","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1016\/j.jbi.2012.04.008","volume":"45","author":"H Gurulingappa","year":"2012","unstructured":"Gurulingappa H, Rajput AM, Roberts A, Fluck J, Hofmann-Apitius M, Toldo L. Development of a benchmark corpus to support the automatic extraction of drug-related adverse effects from medical case reports. J Biomed Inform. 2012;45:885\u201392. https:\/\/doi.org\/10.1016\/j.jbi.2012.04.008.","journal-title":"J Biomed Inform"},{"key":"1682_CR14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0300919","volume":"19","author":"Y Li","year":"2024","unstructured":"Li Y, Li J, He J, Tao C. AE-GPT: using large language models to extract adverse events from surveillance reports-a use case with Influenza vaccine adverse events. PLoS ONE. 2024;19:e0300919\u2013e0300919. https:\/\/doi.org\/10.1371\/journal.pone.0300919. (Public Library of Science).","journal-title":"PLoS ONE"},{"key":"1682_CR15","doi-asserted-by":"publisher","DOI":"10.2196\/52499","volume":"26","author":"EC Leas","year":"2024","unstructured":"Leas EC, Ayers JW, Desai N, Dredze M, Hogarth M, Smith DM. Using large language models to support content analysis: a case study of ChatGPT for adverse event detection. J Med Internet Res. 2024;26:e52499. https:\/\/doi.org\/10.2196\/52499.","journal-title":"J Med Internet Res"},{"key":"1682_CR16","doi-asserted-by":"publisher","first-page":"1391","DOI":"10.1002\/cpt.3226","volume":"115","author":"AL Silverman","year":"2024","unstructured":"Silverman AL, Sushil M, Bhasuran B, Ludwig D, Buchanan J, Racz R, et al. Algorithmic identification of treatment\u2010emergent adverse events from clinical notes using large language models: A pilot study in inflammatory bowel disease. Clin Pharmacol Ther. 2024;115:1391\u20139. https:\/\/doi.org\/10.1002\/cpt.3226.","journal-title":"Clin Pharmacol Ther"},{"key":"1682_CR17","unstructured":"Sushil M, Ludwig D, Butte AJ, Rudrapatna VA. Developing a general-purpose clinical language inference model from a large corpus of clinical notes. arXiv.org. 2022. https:\/\/arxiv.org\/abs\/2210.06566. Accessed 1 Jan 2025"},{"key":"1682_CR18","doi-asserted-by":"publisher","unstructured":"Elizaveta Kopacheva, Lincke A, Olof Bj\u00f6rneld, Hammar T. Detecting adverse drug events in clinical notes using large language models. Stud Health Technol Inform. IOS Press; 2025; https:\/\/doi.org\/10.3233\/shti250495","DOI":"10.3233\/shti250495"},{"key":"1682_CR19","volume-title":"What is a serious adverse event?","author":"FDA","year":"2019","unstructured":"FDA. What is a serious adverse event? US Food Drug Adm; 2019.\u00a0https:\/\/www.fda.gov\/safety\/reporting-serious-problems-fda\/what-serious-adverse-event."}],"container-title":["Drug Safety"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40264-026-01682-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40264-026-01682-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40264-026-01682-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T13:12:06Z","timestamp":1788959526000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40264-026-01682-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,12]]},"references-count":19,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2026,10]]}},"alternative-id":["1682"],"URL":"https:\/\/doi.org\/10.1007\/s40264-026-01682-6","relation":{},"ISSN":["0114-5916","1179-1942"],"issn-type":[{"value":"0114-5916","type":"print"},{"value":"1179-1942","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,12]]},"assertion":[{"value":"7 December 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 May 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 June 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The use of the LLMs was funded by the UCSF Versa project and by the Butte Lab at UCSF.","order":1,"name":"Ethics","label":"Funding","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No authors, Dana Ludwig, Michelle Wang, James Buchanan and Trang Trinh, have conflicts of interest to declare.","order":2,"name":"Ethics","label":"Conflicts of Interest","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No ethics approval was required for this study as it includes only HIPAA de-identified patient data.","order":3,"name":"Ethics","label":"Ethical Approval","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":4,"name":"Ethics","label":"Consent to Participate","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":5,"name":"Ethics","label":"Consent for Publication","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Access to de-identified patient data for this project is available at physionet.org under a database project named \u201cClinical Notes and LLM Output for Post-marketing Adverse Drug Event extraction with Large Language Model\u201d. Access to the project requires \u201cCredentialed\u201d level of access.","order":6,"name":"Ethics","label":"Availability of Data and Materials","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Software for the LLM model \u201co1\u201d that matches the software used in this study is available on github at\n                      github.com\/danaludwig1\/ADE-extraction-with-LLM-OpenAI-o1\n                      . In addition, updated software adapted to run the same prompts under LLM model GPT-5.2 is available on Physionet.org, under software project named \u201cSource Code for Post-marketing Adverse Drug Event extraction with Large Language Model\u201d.","order":7,"name":"Ethics","label":"Code Availability","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Dana Ludwig, Michelle Wang and James Buchanan contributed to the study conception and design. Data preparation, LLM model prompting and scripting and (Reviewer 1) validation were performed by Dana Ludwig. Implementation of the gold standard ADE annotation dataset (Reviewer 2) was performed by Michelle Wang. Validation of 70 LLM-generated ADEs not found in the gold standard (Reviewer 3) was performed by Trang Trinh. All authors read and approved of the final version.","order":8,"name":"Ethics","label":"Authors\u2019 Contributions","group":{"name":"EthicsHeading","label":"Declarations"}}]}}