{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T03:42:33Z","timestamp":1792813353912,"version":"4.5.0"},"reference-count":26,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"1","funder":[{"name":"AstraZeneca"}],"content-domain":{"domain":["www.ahajournals.org"],"crossmark-restriction":true},"short-container-title":["Circ: Heart Failure"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:sec>\n            <jats:title>BACKGROUND:<\/jats:title>\n            <jats:p>Medical record review by a physician clinical events committee is the gold standard for identifying cardiovascular outcomes in clinical trials, but is labor-intensive and poorly reproducible. Automated outcome adjudication by artificial intelligence (AI) could enable larger and less expensive clinical trials but has not been validated in global studies.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>METHODS:<\/jats:title>\n            <jats:p>We developed a novel model for automated AI-based heart failure adjudication (Heart Failure Natural Language Processing) using hospitalizations from 3 international clinical outcomes trials. This model was tested on potential heart failure hospitalizations from the DELIVER trial (Dapagliflozin Evaluation to Improve the Lives of Patients With Preserved Ejection Fraction Heart Failure), a cardiovascular outcomes trial comparing dapagliflozin with placebo in 6063 patients with heart failure with mildly reduced or preserved ejection fraction. AI-based adjudications were compared with adjudications from a clinical events committee that followed Food and Drug Administration-based criteria.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>RESULTS:<\/jats:title>\n            <jats:p>AI-based adjudication agreed with the clinical events committee in 83% of events. A strategy of human review for events that the AI model deemed uncertain (16%) would have achieved 91% agreement with the clinical events committee while reducing the adjudication workload by 84%. The estimated effect of dapagliflozin on heart failure hospitalization was nearly identical with AI-based adjudication (hazard ratio, 0.76 [95% CI, 0.66\u20130.88]) compared with clinical events committee adjudication (hazard ratio, 0.77 [95% CI, 0.67\u20130.89]). The AI model extracted symptoms, signs, and treatments of heart failure from each medical record in tabular format and quoted sentences documenting them.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>CONCLUSIONS:<\/jats:title>\n            <jats:p>AI-based adjudication of clinical outcomes has the potential to improve the efficiency of global clinical trials while preserving accuracy and interpretability.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1161\/circheartfailure.124.012514","type":"journal-article","created":{"date-parts":[[2024,11,16]],"date-time":"2024-11-16T19:30:27Z","timestamp":1731785427000},"update-policy":"https:\/\/doi.org\/10.1161\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":17,"title":["Natural Language Processing to Adjudicate Heart Failure Hospitalizations in Global Clinical Trials"],"prefix":"10.1161","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0252-5831","authenticated-orcid":true,"given":"Pablo M.","family":"Marti-Castellote","sequence":"first","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."},{"name":"Cardiovascular Disease Initiative (P.M.M.-C., C.R., P.S., E.S.L., S.K., P.B., S.A.L., M.M., P.T.E., J.E.H., J.W.C.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Reeder","sequence":"additional","affiliation":[{"name":"Cardiovascular Disease Initiative (P.M.M.-C., C.R., P.S., E.S.L., S.K., P.B., S.A.L., M.M., P.T.E., J.E.H., J.W.C.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."},{"name":"Data Sciences Platform (C.R., P.S., P.B., M.M.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4215-9218","authenticated-orcid":true,"given":"Brian","family":"Claggett","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pulkit","family":"Singh","sequence":"additional","affiliation":[{"name":"Cardiovascular Disease Initiative (P.M.M.-C., C.R., P.S., E.S.L., S.K., P.B., S.A.L., M.M., P.T.E., J.E.H., J.W.C.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."},{"name":"Data Sciences Platform (C.R., P.S., P.B., M.M.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9361-6397","authenticated-orcid":true,"given":"Emily S.","family":"Lau","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."},{"name":"Division of Cardiology (E.S.L.), Massachusetts General Hospital, Boston."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2840-4539","authenticated-orcid":true,"given":"Shaan","family":"Khurshid","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."},{"name":"Demoulas Center for Cardiac Arrhythmias (S.K., S.A.L., P.T.E.), Massachusetts General Hospital, Boston."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6822-0593","authenticated-orcid":true,"given":"Puneet","family":"Batra","sequence":"additional","affiliation":[{"name":"Cardiovascular Disease Initiative (P.M.M.-C., C.R., P.S., E.S.L., S.K., P.B., S.A.L., M.M., P.T.E., J.E.H., J.W.C.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."},{"name":"Data Sciences Platform (C.R., P.S., P.B., M.M.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9599-4866","authenticated-orcid":true,"given":"Steven A.","family":"Lubitz","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."},{"name":"Demoulas Center for Cardiac Arrhythmias (S.K., S.A.L., P.T.E.), Massachusetts General Hospital, Boston."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9837-6000","authenticated-orcid":true,"given":"Mahnaz","family":"Maddah","sequence":"additional","affiliation":[{"name":"Cardiovascular Disease Initiative (P.M.M.-C., C.R., P.S., E.S.L., S.K., P.B., S.A.L., M.M., P.T.E., J.E.H., J.W.C.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."},{"name":"Data Sciences Platform (C.R., P.S., P.B., M.M.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Orly","family":"Vardeny","sequence":"additional","affiliation":[{"name":"Center for Care Delivery and Outcomes Research, Minneapolis VA Hospital, University of Minnesota (O.V.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eldrin F.","family":"Lewis","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Stanford University School of Medicine, Palo Alto, CA (E.F.L.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3876-7568","authenticated-orcid":true,"given":"Marc","family":"Pfeffer","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4306-5317","authenticated-orcid":true,"given":"Pardeep","family":"Jhund","sequence":"additional","affiliation":[{"name":"British Heart Foundation Cardiovascular Research Centre, University of Glasgow, United Kingdom (P.J., J.J.V.M.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1443-0701","authenticated-orcid":true,"given":"Akshay S.","family":"Desai","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6317-3975","authenticated-orcid":true,"given":"John J.V.","family":"McMurray","sequence":"additional","affiliation":[{"name":"British Heart Foundation Cardiovascular Research Centre, University of Glasgow, United Kingdom (P.J., J.J.V.M.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2067-0533","authenticated-orcid":true,"given":"Patrick T.","family":"Ellinor","sequence":"additional","affiliation":[{"name":"Cardiovascular Disease Initiative (P.M.M.-C., C.R., P.S., E.S.L., S.K., P.B., S.A.L., M.M., P.T.E., J.E.H., J.W.C.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."},{"name":"Demoulas Center for Cardiac Arrhythmias (S.K., S.A.L., P.T.E.), Massachusetts General Hospital, Boston."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7987-4768","authenticated-orcid":true,"given":"Jennifer E.","family":"Ho","sequence":"additional","affiliation":[{"name":"Cardiovascular Disease Initiative (P.M.M.-C., C.R., P.S., E.S.L., S.K., P.B., S.A.L., M.M., P.T.E., J.E.H., J.W.C.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."},{"name":"CardioVascular Institute and Division of Cardiology, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA (J.E.H.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3698-9597","authenticated-orcid":true,"given":"Scott D.","family":"Solomon","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4481-7867","authenticated-orcid":true,"given":"Jonathan W.","family":"Cunningham","sequence":"additional","affiliation":[{"name":"Division of Cardiovascular Medicine, Brigham and Women\u2019s Hospital, Boston, MA (P.M.M.-C., B.C., M.P., A.S.D., S.D.S., J.W.C.)."},{"name":"Cardiovascular Disease Initiative (P.M.M.-C., C.R., P.S., E.S.L., S.K., P.B., S.A.L., M.M., P.T.E., J.E.H., J.W.C.), Broad Institute of Harvard University and the Massachusetts Institute of Technology, Cambridge."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMsb1901642"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2018.3931"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2020-038863"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCULATIONAHA.117.033502"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1002\/ejhf.2018"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCHEARTFAILURE.119.006720"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jchf.2023.02.012"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamacardio.2023.4859"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2021.35152"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1101\/2020.11.12.20230706"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamacardio.2023.4900"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2023.23822"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2020.23649"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa2104508"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1908655"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa2206286"},{"key":"e_1_3_3_18_2","first-page":"2","article-title":"Tesseract","volume":"2007","author":"Kay A","year":"2007","unstructured":"Kay A. Tesseract: an open-source optical character recognition engine. Linux J. 2007;2007:2.","journal-title":"Linux J"},{"key":"e_1_3_3_19_2","unstructured":"Artifex Software. Ghostscript. Accessed May 9 2023. www.ghostscript.com"},{"key":"e_1_3_3_20_2","unstructured":"Strauss M. ocrmac. Published online June 1 2024. https:\/\/github.com\/straussmaximilian\/ocrmac\/tree\/main"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","unstructured":"Li Y Wehbe RM Ahmad FS Wang H Luo Y. Clinical-Longformer and Clinical-BigBird: transformers for long clinical sequences. Published online 2022. doi:10.48550\/ARXIV.2201.11838","DOI":"10.48550\/ARXIV.2201.11838"},{"key":"e_1_3_3_22_2","unstructured":"Open AI Achiam J Adler S et al. GPT-4 technical report. Published online 2024. https:\/\/arxiv.org\/abs\/2303.08774"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCULATIONAHA.121.054496"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ahj.2021.12.012"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_3_3_26_2","unstructured":"Nori H Lee YT Zhang S Carignan D Edgar R Fusi N King N Larson J Li Y Liu W et al. Can generalist foundation models outcompete special-purpose tuning? Case study in medicine. Published online November 2023. https:\/\/www.microsoft.com\/en-us\/research\/publication\/can-generalist-foundation-models-outcompete-special-purpose-tuning-case-study-in-medicine\/"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1056\/AIoa2400181"}],"container-title":["Circulation: Heart Failure"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ahajournals.org\/doi\/full\/10.1161\/CIRCHEARTFAILURE.124.012514","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,21]],"date-time":"2025-01-21T19:01:29Z","timestamp":1737486089000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ahajournals.org\/doi\/10.1161\/CIRCHEARTFAILURE.124.012514"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10.1161\/CIRCHEARTFAILURE.124.012514"],"URL":"https:\/\/doi.org\/10.1161\/circheartfailure.124.012514","relation":{},"ISSN":["1941-3289","1941-3297"],"issn-type":[{"value":"1941-3289","type":"print"},{"value":"1941-3297","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]},"assertion":[{"value":"2024-10-14","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}