{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T06:48:17Z","timestamp":1767768497173,"version":"3.48.0"},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T00:00:00Z","timestamp":1767744000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T00:00:00Z","timestamp":1767744000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003086","name":"Eusko Jaurlaritza","doi-asserted-by":"publisher","award":["IT1570-22"],"award-info":[{"award-number":["IT1570-22"]}],"id":[{"id":"10.13039\/501100003086","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003086","name":"Eusko Jaurlaritza","doi-asserted-by":"publisher","award":["IT1570-22"],"award-info":[{"award-number":["IT1570-22"]}],"id":[{"id":"10.13039\/501100003086","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003086","name":"Eusko Jaurlaritza","doi-asserted-by":"publisher","award":["IT1570-22"],"award-info":[{"award-number":["IT1570-22"]}],"id":[{"id":"10.13039\/501100003086","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003086","name":"Eusko Jaurlaritza","doi-asserted-by":"publisher","award":["IT1570-22"],"award-info":[{"award-number":["IT1570-22"]}],"id":[{"id":"10.13039\/501100003086","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["MCIN\/AEI\/10.13039\/5011 00011033"],"award-info":[{"award-number":["MCIN\/AEI\/10.13039\/5011 00011033"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["MCIN\/AEI\/10.13039\/5011 00011033"],"award-info":[{"award-number":["MCIN\/AEI\/10.13039\/5011 00011033"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["MCIN\/AEI\/10.13039\/5011 00011033"],"award-info":[{"award-number":["MCIN\/AEI\/10.13039\/5011 00011033"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["MCIN\/AEI\/10.13039\/5011 00011033"],"award-info":[{"award-number":["MCIN\/AEI\/10.13039\/5011 00011033"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["MCIN\/AEI\/10.13039\/5011 00011033"],"award-info":[{"award-number":["MCIN\/AEI\/10.13039\/5011 00011033"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003086","name":"Eusko Jaurlaritza","doi-asserted-by":"publisher","award":["PRE_2024_1_0224"],"award-info":[{"award-number":["PRE_2024_1_0224"]}],"id":[{"id":"10.13039\/501100003086","id-type":"DOI","asserted-by":"publisher"}]},{"name":"BioBizkaia","award":["BB\/I\/PMIR\/24\/001"],"award-info":[{"award-number":["BB\/I\/PMIR\/24\/001"]}]},{"DOI":"10.13039\/501100003451","name":"Universidad del Pa\u00eds Vasco","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003451","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Health Inf Sci Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Cohort selection and eligibility screening are critical in clinical research, especially in trials where manual patient matching remains a major bottleneck. This study investigates the use of Natural Language Processing and Large Language Models (LLMs) in two real use cases, namely Atrial Fibrillation (AF) progression and Hearth Failure (HF) decompensation, within a non-English clinical context. We specifically address the following research questions: (1) Can discharge reports and NLP support cohort selection? (2) Can LLMs effectively model longitudinal patient trajectories and temporal reasoning? (3) Do general-purpose or domain-adapted LLMs outperform rule-based baselines for this task? (4) Compared to large foundation models, do small-scale LLMs offer similar performance?<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A dataset of 212 patients was manually annotated for AF progression using discharge reports. Two strategies were evaluated: (1) an adapted rule-based pipeline and (2) zero-shot open-source LLMs with varying prompt structures. To assess generalizability, an additional dataset of 100 patients was annotated for HF decompensation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The adapted rule-based approach achieved the highest accuracy (0.82), but LLMs with task-division prompts performed comparably (up to 0.79), requiring significantly less manual effort. The medium-sized general-domain\n                      <jats:italic>gemma-3<\/jats:italic>\n                      model outperformed others.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>(1) Discharge reports are a valuable resource for automatic cohort selection, with both the rule-based method and LLMs showing promising results. (2) While LLMs struggled with long-context inputs, they handled temporal reasoning well when explicit dates were provided. (3) Larger models did not always outperform smaller ones, (4) prompt language strongly influenced performance, and medical model variants were not consistently superior.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s13755-025-00415-w","type":"journal-article","created":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T06:46:54Z","timestamp":1767768414000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Leveraging electronic health records for atrial fibrillation cohort generation"],"prefix":"10.1007","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-8202-1099","authenticated-orcid":false,"given":"Ane G.","family":"Domingo-Aldama","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcos","family":"Merino Prado","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alain","family":"Garc\u00eda-Olea","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Josu","family":"Goikoetxea","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Koldo","family":"Gojenola","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aitziber","family":"Atutxa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,1,7]]},"reference":[{"key":"415_CR1","doi-asserted-by":"publisher","first-page":"2500071","DOI":"10.1200\/CCI-25-00071","volume":"9","author":"H Chen","year":"2025","unstructured":"Chen H, Li X, He X, Chen A, McGill J, Webber EC, et al. Enhancing patient-trial matching with large language models: a scoping review of emerging applications and approaches. JCO Clin Cancer Inform. 2025;9:2500071.","journal-title":"JCO Clin Cancer Inform"},{"issue":"1","key":"415_CR2","doi-asserted-by":"publisher","first-page":"9074","DOI":"10.1038\/s41467-024-53081-z","volume":"15","author":"Q Jin","year":"2024","unstructured":"Jin Q, Wang Z, Floudas CS, Chen F, Gong C, Bracken-Clarke D, et al. Matching patients to clinical trials with large language models. Nat Commun. 2024;15(1):9074.","journal-title":"Nat Commun"},{"issue":"3","key":"415_CR3","doi-asserted-by":"publisher","first-page":"131","DOI":"10.12793\/tcp.2023.31.e16","volume":"31","author":"J-L Ghim","year":"2023","unstructured":"Ghim J-L, Ahn S. Transforming clinical trials: the emerging roles of large language models. Transl Clin Pharmacol. 2023;31(3):131.","journal-title":"Transl Clin Pharmacol"},{"key":"415_CR4","doi-asserted-by":"publisher","first-page":"13193","DOI":"10.3390\/ijerph182413193","volume":"18","author":"B Williams","year":"2021","unstructured":"Williams B. Constructing epidemiologic cohorts from electronic health record data. Int J Environ Res Public Health. 2021;18:13193. https:\/\/doi.org\/10.3390\/ijerph182413193.","journal-title":"Int J Environ Res Public Health"},{"issue":"4","key":"415_CR5","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1158\/1055-9965.EPI-23-1200","volume":"33","author":"RJ Huang","year":"2024","unstructured":"Huang RJ, Huang ES, Mudiganti S, Chen T, Martinez MC, Ramrakhiani S, et al. Risk of gastric adenocarcinoma in a multiethnic population undergoing routine care: an electronic health records cohort study. Cancer Epidemiol Biomark Prev. 2024;33(4):547\u201356.","journal-title":"Cancer Epidemiol Biomark Prev"},{"key":"415_CR6","doi-asserted-by":"publisher","first-page":"41","DOI":"10.5888\/pcd21.230413","volume":"21","author":"O Barth","year":"2024","unstructured":"Barth O, Anderson B, Jones K, Nickles A, Dawkins K, Burnett A, et al. An innovative approach to using electronic health records through health information exchange to build a chronic disease registry in Michigan. Prev Chronic Dis. 2024;21:41.","journal-title":"Prev Chronic Dis"},{"issue":"12","key":"415_CR7","doi-asserted-by":"publisher","first-page":"1977","DOI":"10.1093\/jamia\/ocaa186","volume":"27","author":"A Aliabadi","year":"2020","unstructured":"Aliabadi A, Sheikhtaheri A, Ansari H. Electronic health record-based disease surveillance systems: a systematic literature review on challenges and solutions. J Am Med Inform Assoc. 2020;27(12):1977\u201386.","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"415_CR8","doi-asserted-by":"publisher","first-page":"12035","DOI":"10.1002\/trc2.12035","volume":"6","author":"D Tjandra","year":"2020","unstructured":"Tjandra D, Migrino RQ, Giordani B, Wiens J. Cohort discovery and risk stratification for Alzheimer\u2019s disease: an electronic health record-based approach. Alzheimer\u2019s Dement Transl Res Clin Interv. 2020;6(1):12035.","journal-title":"Alzheimer\u2019s Dement Transl Res Clin Interv"},{"key":"415_CR9","first-page":"303","volume":"23","author":"A Garcia Olea","year":"2021","unstructured":"Garcia Olea A, Ormaetxe Merodio J, Atutxa Salazar A, Diez Gonzalez I, Fernandez De La Prieta I, Maeztu Rada M, et al. The role of congestive heart failure at atrial fibrillation onset in the data entry errors of electronic health records. Eur J Heart Fail. 2021;23:303\u20134.","journal-title":"Eur J Heart Fail"},{"key":"415_CR10","first-page":"1","volume":"2010","author":"T Botsis","year":"2010","unstructured":"Botsis T, Hartvigsen G, Chen F, Weng C. Secondary use of EHR: data quality issues and informatics opportunities. Summit Transl Bioinform. 2010;2010:1.","journal-title":"Summit Transl Bioinform"},{"issue":"11","key":"415_CR11","doi-asserted-by":"publisher","first-page":"1163","DOI":"10.1093\/jamia\/ocz163","volume":"26","author":"A Stubbs","year":"2019","unstructured":"Stubbs A, Filannino M, Soysal E, Henry S, Uzuner \u00d6. Cohort selection for clinical trials: n2c2 2018 shared task track 1. J Am Med Inform Assoc. 2019;26(11):1163\u201371.","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"415_CR12","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1093\/jamia\/ocy178","volume":"26","author":"C Yuan","year":"2019","unstructured":"Yuan C, Ryan PB, Ta C, Guo Y, Li Z, Hardin J, et al. Criteria2Query: a natural language interface to clinical databases for cohort definition. J Am Med Inform Assoc. 2019;26(4):294\u2013305.","journal-title":"J Am Med Inform Assoc"},{"key":"415_CR13","unstructured":"Tai CA, Tannier X. Clinical trial cohort selection using Large Language Models on n2c2 Challenges 2025. https:\/\/arxiv.org\/abs\/2501.11114."},{"key":"415_CR14","doi-asserted-by":"publisher","first-page":"104734","DOI":"10.1016\/j.jbi.2024.104734","volume":"159","author":"M Rybinski","year":"2024","unstructured":"Rybinski M, Kusa W, Karimi S, Hanbury A. Learning to match patients to clinical trials using large language models. J Biomed Inform. 2024;159:104734. https:\/\/doi.org\/10.1016\/j.jbi.2024.104734.","journal-title":"J Biomed Inform"},{"key":"415_CR15","doi-asserted-by":"crossref","unstructured":"Devi A, Uttrani S, Singla A, Jha S, Dasgupta N, Natarajan SS, Punekar RA, Pickett L, Dutt V. Automating clinical trial eligibility screening: quantitative analysis of GPT models versus human expertise. In: Proceedings of the 17th international conference on PErvasive Technologies Related to Assistive Environments, 2024, pp. 626\u201332.","DOI":"10.1145\/3652037.3663922"},{"issue":"2, Supplement","key":"415_CR16","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1016\/j.ijrobp.2024.07.1345","volume":"120","author":"J Beattie","year":"2024","unstructured":"Beattie J, Neufeld S, Yang DX, Chukwuma C, Gul A, Desai NB, et al. Utilizing large language models for enhanced clinical trial matching. Int J Radiat Oncol Biol Phys. 2024;120(2, Supplement):611. https:\/\/doi.org\/10.1016\/j.ijrobp.2024.07.1345.","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"415_CR17","doi-asserted-by":"crossref","unstructured":"Taweel A, Lamine E, Bache R. A model for computing temporal eligibility criteria on large and diverse data repositories. In: 2021 IEEE\/ACS 18th international conference on computer systems and applications (AICCSA), 2021. IEEE; 2021, pp. 1\u20136.","DOI":"10.1109\/AICCSA53542.2021.9686822"},{"key":"415_CR18","doi-asserted-by":"crossref","unstructured":"Baader F, Borgwardt S, Forkel W. Patient selection for clinical trials using temporalized ontology-mediated query answering. In: Companion proceedings of The Web Conference 2018, 2018, pp. 1069\u201374.","DOI":"10.1145\/3184558.3191538"},{"key":"415_CR19","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.ijmedinf.2017.03.015","volume":"102","author":"MTF Abrah\u00e3o","year":"2017","unstructured":"Abrah\u00e3o MTF, Nobre MRC, Gutierrez MA. A method for cohort selection of cardiovascular disease records from an electronic health record system. Int J Med Inform. 2017;102:138\u201349.","journal-title":"Int J Med Inform"},{"issue":"3","key":"415_CR20","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1093\/jamiaopen\/ooaa026","volume":"3","author":"SR Chamberlin","year":"2020","unstructured":"Chamberlin SR, Bedrick SD, Cohen AM, Wang Y, Wen A, Liu S, et al. Evaluation of patient-level retrieval from electronic health record data for a cohort discovery task. JAMIA Open. 2020;3(3):395\u2013404.","journal-title":"JAMIA Open"},{"key":"415_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.compbiomed.2015.01.008","volume":"60","author":"AV Gundlapalli","year":"2015","unstructured":"Gundlapalli AV, Redd D, Gibson BS, Carter M, Korhonen C, Nebeker J, et al. Maximizing clinical cohort size using free text queries. Comput Biol Med. 2015;60:1\u20137. https:\/\/doi.org\/10.1016\/j.compbiomed.2015.01.008.","journal-title":"Comput Biol Med"},{"key":"415_CR22","doi-asserted-by":"crossref","unstructured":"Soboroff I. Overview of TREC 2021. In: TREC 2021, 2021.","DOI":"10.6028\/NIST.SP.500-335.overview-overview"},{"key":"415_CR23","doi-asserted-by":"crossref","unstructured":"Roberts K, Demner-Fushman D, Voorhees EM, Bedrick S, Hersh WR. Overview of the TREC 2022 Clinical Trials track. In: TREC 2022, 2022.","DOI":"10.6028\/NIST.SP.500-338.trials-overview"},{"issue":"11","key":"415_CR24","doi-asserted-by":"publisher","first-page":"1172","DOI":"10.1093\/jamia\/ocz079","volume":"26","author":"VV Vydiswaran","year":"2019","unstructured":"Vydiswaran VV, Strayhorn A, Zhao X, Robinson P, Agarwal M, Bagazinski E, et al. Hybrid bag of approaches to characterize selection criteria for cohort identification. J Am Med Inform Assoc. 2019;26(11):1172\u201380.","journal-title":"J Am Med Inform Assoc"},{"key":"415_CR25","unstructured":"Birnbaum B, Nussbaum N, Seidl-Rathkopf K, Agrawal M, Estevez M, Estola E, Haimson J, He L, Larson P, Richardson P. Model-assisted cohort selection with bias analysis for generating large-scale cohorts from the EHR for oncology research. arXiv preprint; 2020. arXiv:2001.09765."},{"key":"415_CR26","doi-asserted-by":"crossref","unstructured":"Glicksberg BS, Miotto R, Johnson KW, Shameer K, Li L, Chen R, Dudley JT. Automated disease cohort selection using word embeddings from electronic health records. In: PACIFIC SYMPOSIUM on BIOCOMPUTING 2018: proceedings of the Pacific symposium, 2018. World Scientific; 2018; pp. 145\u201356.","DOI":"10.1142\/9789813235533_0014"},{"key":"415_CR27","unstructured":"Mugambi P, Meliou A, Fiterau M. Leveraging foundation language models (FLMs) for automated cohort extraction from large EHR databases 2024. https:\/\/arxiv.org\/abs\/2412.11472."},{"issue":"1","key":"415_CR28","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1109\/JBHI.2021.3095478","volume":"26","author":"Y Xiong","year":"2021","unstructured":"Xiong Y, Peng W, Chen Q, Huang Z, Tang B. A unified machine reading comprehension framework for cohort selection. IEEE J Biomed Health Inform. 2021;26(1):379\u201387.","journal-title":"IEEE J Biomed Health Inform"},{"key":"415_CR29","unstructured":"Soni S, Roberts K. Patient cohort retrieval using transformer language models. In: AMIA annual symposium proceedings, 2021, 2020, p. 1150."},{"issue":"2","key":"415_CR30","doi-asserted-by":"publisher","first-page":"1106","DOI":"10.1109\/JBHI.2022.3224727","volume":"27","author":"Y Li","year":"2022","unstructured":"Li Y, Mamouei M, Salimi-Khorshidi G, Rao S, Hassaine A, Canoy D, et al. Hi-BEHRT: hierarchical transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records. IEEE J Biomed Health Inform. 2022;27(2):1106\u201317.","journal-title":"IEEE J Biomed Health Inform"},{"issue":"1","key":"415_CR31","doi-asserted-by":"publisher","first-page":"7857","DOI":"10.1038\/s41467-023-43715-z","volume":"14","author":"Z Yang","year":"2023","unstructured":"Yang Z, Mitra A, Liu W, Berlowitz D, Yu H. TransformEHR: transformer-based encoder-decoder generative model to enhance prediction of disease outcomes using electronic health records. Nat Commun. 2023;14(1):7857.","journal-title":"Nat Commun"},{"key":"415_CR32","unstructured":"Chen J, Yin C, Wang Y, Zhang P. Predictive modeling with temporal graphical representation on electronic health records. In: IJCAI: proceedings of the conference, 2024, 2024, p. 5763."},{"key":"415_CR33","unstructured":"Pang C, Jiang X, Kalluri KS, Spotnitz M, Chen R, Perotte A, Natarajan K. CEHR-BERT: incorporating temporal information from structured EHR data to improve prediction tasks. In: Machine learning for health, 2021. PMLR; 2021, pp. 239\u201360."},{"key":"415_CR34","unstructured":"Guan Z, Wu Z, Liu Z, Wu D, Ren H, Li Q, Li X, Liu N. CohortGPT: an enhanced GPT for participant recruitment in clinical study 2023. https:\/\/arxiv.org\/abs\/2307.11346."},{"issue":"1","key":"415_CR35","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1093\/ehjqcco\/qcad021","volume":"10","author":"C Zheng","year":"2024","unstructured":"Zheng C, Lee M-S, Bansal N, Go AS, Chen C, Harrison TN, et al. Identification of recurrent atrial fibrillation using natural language processing applied to electronic health records. Eur Heart J Qual Care Clin Outcomes. 2024;10(1):77\u201388.","journal-title":"Eur Heart J Qual Care Clin Outcomes"},{"issue":"1","key":"415_CR36","doi-asserted-by":"publisher","first-page":"013023","DOI":"10.1161\/CIRCEP.124.013023","volume":"18","author":"R Feng","year":"2025","unstructured":"Feng R, Brennan KA, Azizi Z, Goyal J, Deb B, Chang HJ, et al. Engineering of generative artificial intelligence and natural language processing models to accurately identify arrhythmia recurrence. Circ Arrhythm Electrophysiol. 2025;18(1):013023.","journal-title":"Circ Arrhythm Electrophysiol"},{"key":"415_CR37","doi-asserted-by":"publisher","unstructured":"Li J, Wang M, Zheng Z, Zhang M. LooGLE: can long-context language models understand long contexts? In: Ku L-W, Martins A, Srikumar V. (eds.) Proceedings of the 62nd annual meeting of the Association for Computational Linguistics (Volume 1: long papers), Bangkok, Thailand, 2024. Association for Computational Linguistics; 2024, pp. 16304\u201333. https:\/\/doi.org\/10.18653\/v1\/2024.acl-long.859.","DOI":"10.18653\/v1\/2024.acl-long.859"},{"key":"415_CR38","first-page":"106519","volume":"37","author":"Y Kuratov","year":"2024","unstructured":"Kuratov Y, Bulatov A, Anokhin P, Rodkin I, Sorokin D, Sorokin A, et al. BABILong: testing the limits of LLMs with long context reasoning-in-a-haystack. Adv Neural Inf Process Syst. 2024;37:106519\u201354.","journal-title":"Adv Neural Inf Process Syst"},{"key":"415_CR39","unstructured":"Zhang Y, Sun R, Chen Y, Pfister T, Zhang R, Arik SO. Chain of agents: large language models collaborating on long-context tasks, 2024. https:\/\/arxiv.org\/abs\/2406.02818."},{"key":"415_CR40","doi-asserted-by":"crossref","unstructured":"Kougia V, Sedova A, Stephan A, Zaporojets K, Roth B. Analysing zero-shot temporal relation extraction on clinical notes using temporal consistency, 2024. https:\/\/arxiv.org\/abs\/2406.11486.","DOI":"10.18653\/v1\/2024.bionlp-1.6"},{"key":"415_CR41","doi-asserted-by":"publisher","unstructured":"Tu H, Han L, Nenadic G. Extraction of medication and temporal relation from clinical text using neural language models. In: 2023 IEEE international conference on big data (BigData), 2023, pp. 2735\u201344. https:\/\/doi.org\/10.1109\/BigData59044.2023.10386489.","DOI":"10.1109\/BigData59044.2023.10386489"},{"key":"415_CR42","unstructured":"Fatemi B, Kazemi M, Tsitsulin A, Malkan K, Yim J, Palowitch J, Seo S, Halcrow J, Perozzi B. Test of time: a benchmark for evaluating LLMs on temporal reasoning, 2024. https:\/\/arxiv.org\/abs\/2406.09170."},{"issue":"1","key":"415_CR43","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159\u201374.","journal-title":"Biometrics"},{"key":"415_CR44","doi-asserted-by":"publisher","first-page":"104461","DOI":"10.1016\/j.jbi.2023.104461","volume":"145","author":"I Iglesia","year":"2023","unstructured":"Iglesia I, Viv\u00f3 M, Chocr\u00f3n P, Maeztu G, Gojenola K, Atutxa A. An open source corpus and automatic tool for section identification in Spanish health records. J Biomed Inform. 2023;145:104461.","journal-title":"J Biomed Inform"},{"key":"415_CR45","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.jbi.2017.05.009","volume":"71","author":"A Perez","year":"2017","unstructured":"Perez A, Weegar R, Casillas A, Gojenola K, Oronoz M, Dalianis H. Semi-supervised medical entity recognition: a study on Spanish and Swedish clinical corpora. J Biomed Inform. 2017;71:16\u201330.","journal-title":"J Biomed Inform"},{"key":"415_CR46","unstructured":"Akbik A, Bergmann T, Blythe D, Rasul K, Schweter S, Vollgraf R. FLAIR: an easy-to-use framework for state-of-the-art NLP. In: NAACL 2019, 2019 annual conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), 2019, pp. 54\u201359."},{"key":"415_CR47","unstructured":"GemmaTeam. Gemma 3. GemmaTeam; 2025."},{"key":"415_CR48","unstructured":"GemmaTeam. Medgemma model card. GemmaTeam; 2025."},{"key":"415_CR49","unstructured":"AI@Meta. Llama 3.1 model card. AI@Meta; 2024."},{"key":"415_CR50","unstructured":"Gururajan AK, Lopez-Cuena E, Bayarri-Planas J, Tormos A, Hinjos D, Bernabeu-Perez P, Arias-Duart A, Martin-Torres PA, Urcelay-Ganzabal L, Gonzalez-Mallo M, Alvarez-Napagao S, Ayguad\u00e9-Parra E, Garcia-Gasulla UCD. Aloe: a family of fine-tuned open healthcare LLMs, 2024."},{"key":"415_CR51","unstructured":"Jiang AQ, Sablayrolles A, Mensch A, Bamford C, Chaplot DS, Casas D, Bressand F, Lengyel G, Lample G, Saulnier L, Lavaud LR, Lachaux M-A, Stock P, Scao TL, Lavril T, Wang T, Lacroix T, Sayed WE. Mistral 7B, 2023. https:\/\/arxiv.org\/abs\/2310.06825."},{"issue":"3","key":"415_CR52","doi-asserted-by":"publisher","first-page":"380","DOI":"10.1007\/s41666-025-00198-5","volume":"9","author":"WK Ojemann","year":"2025","unstructured":"Ojemann WK, Xie K, Liu K, Chang E, Roth D, Litt B, et al. Zero-shot extraction of seizure outcomes from clinical notes using generative pretrained transformers. J Healthc Inform Res. 2025;9(3):380\u2013400.","journal-title":"J Healthc Inform Res"}],"container-title":["Health Information Science and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13755-025-00415-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13755-025-00415-w","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13755-025-00415-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T06:46:58Z","timestamp":1767768418000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s13755-025-00415-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,7]]},"references-count":52,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["415"],"URL":"https:\/\/doi.org\/10.1007\/s13755-025-00415-w","relation":{},"ISSN":["2047-2501"],"issn-type":[{"value":"2047-2501","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,7]]},"assertion":[{"value":"3 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 December 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 January 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"I warrant that this manuscript has been read by all co-authors and I have submitted it on behalf of all the authors with their full consent. This manuscript has not been published and is not under consideration for publication elsewhere. The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The Basurto University Hospital Ethical Committee supported the study under the code 99.20CEICHUB and approved the informed consent exemption under the code 106.21CEICHUB. The project adhered to good clinical practice directives and complied with the 2016\/627 European Regulation. Patient consent was waived due to retrospective data collection according to the Ethical Committee and Data Extraction Evaluation Process surveillance.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval and Informed consent"}}],"article-number":"24"}}