{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T20:24:35Z","timestamp":1787171075076,"version":"build-2736575974"},"reference-count":97,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec sec-type=\"background\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>The Registry of Stroke Care Quality (RES-Q) is a health care quality improvement platform used globally. RES-Q collects structured quality-of-care data for patients with stroke, requiring clinicians to manually extract information from electronic health records or documents such as discharge summaries. This process is essential but time-consuming, particularly given the variability, length, and semistructured nature of clinical reports.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"objective\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to develop and evaluate a multilingual Evidence-Based Question-Answering framework that identifies supporting text spans in clinical reports of patients with stroke and proposes answer suggestions for structured clinical forms, with the goal of reducing clinician workload while preserving full human oversight.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We conduct a multilingual study using more than 1500 pseudonymized stroke discharge summaries in 5 languages, annotated with question-evidence-answer triplets. Encoder-based language models are used to extract evidence spans from the reports, while generative language models are used to predict normalized form answers based on the extracted evidences. We compare multiple training strategies, such as (1) models trained on reports in a single target language, (2) models trained jointly on reports in different languages, and (3) models trained on original reports combined with cross-lingual data augmentations. We evaluate performance on Evidence Extraction, Answer Prediction, and end-to-end Evidence-Based Question Answering across the 5 languages.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The presented Evidence-Based Question-Answering system achieves 88% end-to-end accuracy in form filling across 5 languages (77% for patient-specific questions and 95% for default or unverifiable items). Evidence Extraction is the primary bottleneck, reaching 85%\n                      <jats:italic>F<\/jats:italic>\n                      <jats:sub>1<\/jats:sub>\n                      and 79% exact match, whereas Answer Prediction based on extracted evidences is more stable, achieving 95% accuracy. The performance varies by question type, and cross-lingual training generally reduces Evidence Extraction performance but has little effect on Answer Prediction. Model performance is influenced more by reporting practices and dataset characteristics than by language itself.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Evidence-Based Question Answering over multilingual stroke discharge summaries enables human-in-the-loop validation and effective answer prediction with moderate computational resources. Evidence Extraction is the main bottleneck, while Answer Prediction is robust across languages and model sizes. The approach supports structured data collection, although generalization to new languages requires target-language training data.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/96347","type":"journal-article","created":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T14:50:06Z","timestamp":1781880606000},"page":"e96347-e96347","source":"Crossref","is-referenced-by-count":0,"title":["Multilingual Evidence-Based Question-Answering for Stroke Discharge Summaries: Study of Cross-Lingual Heterogeneity in Clinical Reports"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-5742-0984","authenticated-orcid":false,"given":"Vojt\u011bch","family":"Lanz","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-7997-3942","authenticated-orcid":false,"given":"Aleksis","family":"Datseris","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5542-9168","authenticated-orcid":false,"given":"Svetla","family":"Boytcheva","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6503-3442","authenticated-orcid":false,"given":"Ji\u0159\u00ed","family":"Mayer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7805-9649","authenticated-orcid":false,"given":"\u0160\u00e1rka","family":"Zik\u00e1nov\u00e1","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7458-5166","authenticated-orcid":false,"given":"Robert","family":"Mikul\u00edk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1855-5931","authenticated-orcid":false,"given":"Pavel","family":"Pecina","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,8,19]]},"reference":[{"issue":"7","key":"R1","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD000259.pub3","article-title":"Audit and feedback: effects on professional practice and healthcare outcomes","volume":"2012","author":"Ivers","journal-title":"Cochrane Database of Syst Rev"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-019-4860-0","article-title":"Can feedback approaches reduce unwarranted clinical variation? A systematic rapid evidence synthesis","volume":"20","author":"Harrison","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"R3","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-025-01424-9","article-title":"Reporting feedback on healthcare outcomes to improve quality in care: a scoping review","volume":"20","author":"Ali","journal-title":"Implement Sci"},{"issue":"1","key":"R4","doi-asserted-by":"publisher","DOI":"10.1186\/s13023-025-04153-w","article-title":"Data accuracy in the European Cystic Fibrosis Society Patient Registry: results of an on-site data validation project","volume":"20","author":"Lutz","journal-title":"Orphanet J Rare Dis"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1108\/DTS-05-2022-0013","article-title":"Transforming unstructured digital clinical notes for improved health literacy","volume":"1","author":"Doppalapudi","journal-title":"Digital Transformation and Society"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2021.104507","article-title":"Technological progress in electronic health record system optimization: systematic review of systematic literature reviews","volume":"152","author":"Negro-Calduch","journal-title":"Int J Med Inform"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1002\/jhm.831","article-title":"Audit and feedback: an intervention to improve discharge summary completion","volume":"6","author":"Dinescu","journal-title":"J Hosp Med"},{"issue":"9","key":"R8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0183667","article-title":"Impact of clinical registries on quality of patient care and clinical outcomes: a systematic review","volume":"12","author":"Hoque","journal-title":"PLoS ONE"},{"issue":"673","key":"R9","doi-asserted-by":"publisher","first-page":"e576","DOI":"10.3399\/bjgp18X697877","article-title":"Processing of discharge summaries in general practice: a retrospective record review","volume":"68","author":"Spencer","journal-title":"Br J Gen Pract"},{"issue":"3","key":"R10","doi-asserted-by":"publisher","DOI":"10.2196\/13779","article-title":"Factors associated with electronic health record usage among primary care physicians after hours: retrospective cohort study","volume":"6","author":"Attipoe","journal-title":"JMIR Hum Factors"},{"issue":"4","key":"R11","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1093\/jamia\/ocz220","article-title":"Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians","volume":"27","author":"Adler-Milstein","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"R12","doi-asserted-by":"publisher","DOI":"10.1186\/s12960-017-0187-2","article-title":"Global health workforce labor market projections for 2030","volume":"15","author":"Liu","journal-title":"Hum Resour Health"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.3402\/gha.v7.23611","article-title":"The workforce for health in a globalized context--global shortages and international migration","volume":"7","author":"Aluttis","journal-title":"Glob Health Action"},{"issue":"4","key":"R14","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1197\/jamia.M1794","article-title":"Automated detection of adverse events using natural language processing of discharge summaries","volume":"12","author":"Melton","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"R15","doi-asserted-by":"publisher","first-page":"528","DOI":"10.1136\/jamia.2010.003855","article-title":"Integrating existing natural language processing tools for medication extraction from discharge summaries","volume":"17","author":"Doan","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"R16","doi-asserted-by":"publisher","first-page":"286","DOI":"10.4258\/hir.2023.29.4.286","article-title":"Named entity recognition in electronic health records: a methodological review","volume":"29","author":"Durango","journal-title":"Healthc Inform Res"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1055\/s-0038-1638592","article-title":"Extracting information from textual documents in the electronic health record: a review of recent research","volume":"PMID","author":"Meystre","journal-title":"Yearb Med Inform"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2025.106049","article-title":"Natural language processing in medical text processing: a scoping literature review","volume":"204","author":"Elvas","journal-title":"Int J Med Inform"},{"issue":"suppl_1","key":"R19","doi-asserted-by":"publisher","DOI":"10.1093\/eurpub\/ckt126.044","article-title":"An exploratory analysis of hospital discharge summaries across Europe","volume":"23","author":"Glonti","journal-title":"Eur J Public Health"},{"issue":"6","key":"R20","doi-asserted-by":"publisher","first-page":"1387","DOI":"10.1007\/s11606-025-09395-9","article-title":"Diagnosis documentation done right: cross-specialty standard for the diagnosis section in German discharge summaries - a mixed-methods study","volume":"40","author":"Frings","journal-title":"J GEN INTERN MED"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1097\/PTS.0000000000000809","article-title":"Optimizing discharge summaries: a multispecialty, multicenter survey of primary care clinicians","volume":"18","author":"Silver","journal-title":"J Patient Saf"},{"issue":"1-2","key":"R22","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1177\/2053435414540614","article-title":"Electronic discharge summaries in cross-border care in the European Union: how close are we to making it happen?","volume":"17","author":"D\u00f6ring","journal-title":"Int J Care Coord"},{"issue":"2","key":"R23","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1558\/japl.31818","article-title":"Cross-border healthcare for all EU residents? Linguistic access in the European Union","volume":"11","author":"Angelelli","journal-title":"Journal of Applied Linguistics and Professional Practice"},{"issue":"1","key":"R24","doi-asserted-by":"publisher","DOI":"10.1186\/s13326-018-0179-8","article-title":"Clinical natural language processing in languages other than English: opportunities and challenges","volume":"9","author":"N\u00e9v\u00e9ol","journal-title":"J Biomed Semantics"},{"key":"R25","volume":"3","author":"Bengio","journal-title":"J Mach Learn Res"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"Devlin J Chang MW Lee K Toutanova K . BERT: pre-training of deep bidirectional transformers for language understanding. In: Burstein J Doran C Solorio T , editors. Presented at: Proceedings of the 2019 Conference of the North; Jun 2-7, 2019:4171-4186; Minneapolis, Minnesota. [doi: 10.18653\/v1\/N19-1423]","DOI":"10.18653\/v1\/N19-1423"},{"key":"R27","unstructured":"Grattafiori A Dubey A Jauhri A et al. The Llama 3 herd of models. arXiv. Preprint posted online on Jul 2024. [doi: 10.48550\/arXiv.2407.21783]"},{"key":"R28","doi-asserted-by":"crossref","unstructured":"Alsentzer E Murphy J Boag W et al. Publicly available clinical BERT embeddings. In: Rumshisky A Roberts K Bethard S Naumann T , editors. Presented at: Proc ClinNLP Workshop Association for Computational Linguistics; Jun 7, 2019:72-78; Minneapolis, Minnesota, USA. [doi: 10.18653\/v1\/W19-1909]","DOI":"10.18653\/v1\/W19-1909"},{"key":"R29","unstructured":"Lee SA Wu A Chiang JN . Clinical ModernBERT: an efficient and long context encoder for biomedical text. arXiv. Preprint posted online on Apr 2025. [doi: 10.48550\/arXiv.2504.03964]"},{"key":"R30","unstructured":"Christophe C Kanithi PK Raha T Khan S Pimentel MA . Med42-v2: a suite of clinical LLMs. Arxiv. Preprint posted online on Aug 2024. [doi: 10.48550\/arXiv.2408.06142]"},{"key":"R31","doi-asserted-by":"crossref","unstructured":"Lanz V Pecina P . When multilingual models compete with monolingual domain-specific models in clinical question answering. In: Ananiadou S Demner-Fushman D Gupta D Thompson P , editors. Presented at: Proceedings of the Second Workshop on Patient-Oriented Language Processing (CL4Health); May 4, 2025:69-82; Albuquerque, New Mexico. [doi: 10.18653\/v1\/2025.cl4health-1.6]","DOI":"10.18653\/v1\/2025.cl4health-1.6"},{"key":"R32","unstructured":"Allen A . Privacy and medicine. In: Zalta EN , editor. The Stanford Encyclopedia of Philosophy. Spring; 2021. URL: https:\/\/plato.stanford.edu\/archives\/spr2021\/entries\/privacy-medicine\/ [Accessed 15-07-2026]"},{"issue":"2","key":"R33","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1111\/inr.12585","article-title":"Privacy, confidentiality, security and patient safety concerns about electronic health records","volume":"67","author":"Bani Issa","journal-title":"Int Nurs Rev"},{"key":"R34","unstructured":"ChatGPT. 2025. URL: https:\/\/chat.openai.com\/ [Accessed 15-07-2026]"},{"issue":"3","key":"R35","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1097\/MLR.0000000000002110","article-title":"Hospital artificial intelligence\/machine learning adoption by neighborhood deprivation","volume":"63","author":"Chen","journal-title":"Med Care"},{"key":"R36","unstructured":"Li H Li Y Tian A et al. A survey on large language model acceleration based on KV cache management. arXiv. Preprint posted online on Dec 2025. [doi: 10.48550\/arXiv.2412.19442]"},{"issue":"2","key":"R37","doi-asserted-by":"publisher","DOI":"10.2196\/29806","article-title":"Early prediction of functional outcomes after acute ischemic stroke using unstructured clinical text: retrospective cohort study","volume":"10","author":"Sung","journal-title":"JMIR Med Inform"},{"issue":"24","key":"R38","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.121.023486","article-title":"Natural language processing enhances prediction of functional outcome after acute ischemic stroke","volume":"10","author":"Sung","journal-title":"J Am Heart Assoc"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2021.649521","article-title":"Prediction of 30-day readmission after stroke using machine learning and natural language processing","volume":"12","author":"Lineback","journal-title":"Front Neurol"},{"issue":"1","key":"R40","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-1010-x","article-title":"Assessing stroke severity using electronic health record data: a machine learning approach","volume":"20","author":"Kogan","journal-title":"BMC Med Inform Decis Mak"},{"issue":"5","key":"R41","doi-asserted-by":"publisher","DOI":"10.2196\/24381","article-title":"Automating stroke data extraction from free-text radiology reports using natural language processing: instrument validation study","volume":"9","author":"Yu","journal-title":"JMIR Med Inform"},{"issue":"6","key":"R42","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0234908","article-title":"Machine learning and natural language processing methods to identify ischemic stroke, acuity and location from radiology reports","volume":"15","author":"Ong","journal-title":"PLoS ONE"},{"issue":"2","key":"R43","doi-asserted-by":"publisher","DOI":"10.2196\/12109","article-title":"Natural language processing for the identification of silent brain infarcts from neuroimaging reports","volume":"7","author":"Fu","journal-title":"JMIR Med Inform"},{"issue":"2","key":"R44","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1111\/imj.15678","article-title":"Automated information extraction from free-text medical documents for stroke key performance indicators: a pilot study","volume":"52","author":"Bacchi","journal-title":"Intern Med J"},{"key":"R45","doi-asserted-by":"crossref","unstructured":"Gaschi F Fontaine X Rastin P Toussaint Y . Multilingual clinical NER: translation or cross-lingual transfer? In: Naumann T Ben Abacha A Bethard S Roberts K Rumshisky A , editors. Presented at: Proceedings of the 5th Clinical Natural Language Processing Workshop; Jul 14, 2023:289-311; Toronto, Canada. [doi: 10.18653\/v1\/2023.clinicalnlp-1.34]","DOI":"10.18653\/v1\/2023.clinicalnlp-1.34"},{"issue":"2","key":"R46","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0318726","article-title":"Leveraging natural language processing for efficient information extraction from breast cancer pathology reports: single-institution study","volume":"20","author":"Park","journal-title":"PLoS ONE"},{"issue":"1","key":"R47","doi-asserted-by":"publisher","DOI":"10.2196\/29015","article-title":"Identifying information gaps in electronic health records by using natural language processing: gynecologic surgery history identification","volume":"24","author":"Moon","journal-title":"J Med Internet Res"},{"issue":"10","key":"R48","doi-asserted-by":"publisher","first-page":"2966","DOI":"10.1161\/STROKEAHA.125.051993","article-title":"Accuracy of large language models to identify stroke subtypes within unstructured electronic health record data","volume":"56","author":"Owens","journal-title":"Stroke"},{"issue":"3","key":"R49","doi-asserted-by":"publisher","DOI":"10.2196\/27210","article-title":"A question-and-answer system to extract data from free-text oncological pathology reports (CancerBERT Network): development study","volume":"24","author":"Mitchell","journal-title":"J Med Internet Res"},{"issue":"2","key":"R50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3703155","article-title":"A survey on hallucination in large language models: principles, taxonomy, challenges, and open questions","volume":"43","author":"Huang","journal-title":"ACM Trans Inf Syst"},{"issue":"4","key":"R51","doi-asserted-by":"publisher","first-page":"73","DOI":"10.21608\/ijicis.2024.336135.1365","article-title":"Hallucination mitigation techniques in large language models","volume":"24","author":"Abdelghafour","journal-title":"IJICIS"},{"key":"R52","doi-asserted-by":"crossref","unstructured":"Sohn J Park Y Yoon C et al. Rationale-guided retrieval augmented generation for medical question answering. In: Chiruzzo L Ritter A Wang L , editors. Presented at: Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics; Apr 29 to May 4, 2025:12739-12753; Albuquerque, New Mexico. [doi: 10.18653\/v1\/2025.naacl-long.635]","DOI":"10.18653\/v1\/2025.naacl-long.635"},{"key":"R53","doi-asserted-by":"crossref","unstructured":"Wang Z Khatibi E Rahmani AM . MedCoT-RAG: causal chain-of-thought RAG for medical question answering. Presented at: 2025 IEEE 21st International Conference on Body Sensor Networks (BSN); Nov 3-5, 2025; Los Angeles, CA, USA. URL: https:\/\/ieeexplore.ieee.org\/document\/11337389 [Accessed 16-07-2026]","DOI":"10.1109\/BSN66969.2025.11337389"},{"key":"R54","doi-asserted-by":"crossref","unstructured":"Jiang E Chen A Tenison I Kagal L . MediRAG: secure question answering for healthcare data. Presented at: 2024 IEEE International Conference on Big Data (BigData); Dec 15-18, 2024:6476-6485; Washington, DC, USA. [doi: 10.1109\/BigData62323.2024.10825604]","DOI":"10.1109\/BigData62323.2024.10825604"},{"key":"R55","doi-asserted-by":"crossref","unstructured":"Ning Y Sun Y Luo L Wang Y Pan Y Lin H . MedTrust-RAG: evidence verification and trust alignment for biomedical question answering. Presented at: 2025 IEEE International Conference on Bioinformatics and Biomedicine (BIBM); Dec 15-18, 2025; Wuhan, China. [doi: 10.1109\/BIBM66473.2025.11356290]","DOI":"10.1109\/BIBM66473.2025.11356290"},{"issue":"33","key":"R56","doi-asserted-by":"publisher","first-page":"28191","DOI":"10.1007\/s00521-025-11666-9","article-title":"A survey on retrieval-augmentation generation (RAG) models for healthcare applications","volume":"37","author":"Abo El-Enen","journal-title":"Neural Comput & Applic"},{"key":"R57","doi-asserted-by":"crossref","unstructured":"Rajpurkar P Zhang J Lopyrev K Liang P . SQuAD: 100,000+ questions for machine comprehension of text. In: Su J Duh K Carreras X , editors. Presented at: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing; Nov 1-5, 2016:2383-2392; Austin, Texas. [doi: 10.18653\/v1\/D16-1264]","DOI":"10.18653\/v1\/D16-1264"},{"key":"R58","doi-asserted-by":"crossref","unstructured":"Pampari A Raghavan P Liang J Peng J . EmrQA: a large corpus for question answering on electronic medical records. In: Riloff E Chiang D Hockenmaier J Tsujii J , editors. Presented at: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing; Oct 31 to Nov 4, 2018:2357-2368; Brussels, Belgium. [doi: 10.18653\/v1\/D18-1258]","DOI":"10.18653\/v1\/D18-1258"},{"key":"R59","doi-asserted-by":"crossref","unstructured":"Lanz V Pecina P . Paragraph retrieval for enhanced question answering in clinical documents. In: Demner-Fushman D Ananiadou S Miwa M Roberts K Tsujii J , editors. Presented at: Proceedings of the 23rd Workshop on Biomedical Natural Language Processing; Aug 16, 2024:580-590; Bangkok, Thailand. [doi: 10.18653\/v1\/2024.bionlp-1.48]","DOI":"10.18653\/v1\/2024.bionlp-1.48"},{"key":"R60","doi-asserted-by":"crossref","unstructured":"Yue X Jimenez Gutierrez B Sun H . Clinical reading comprehension: a thorough analysis of the emrQA dataset. In: Jurafsky D Chai J Schluter N Tetreault J , editors. Presented at: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics; 4474-4486; Online. 2020.[doi: 10.18653\/v1\/2020.acl-main.410]","DOI":"10.18653\/v1\/2020.acl-main.410"},{"key":"R61","unstructured":"Registry of Stroke Care Quality (RES-Q). URL: https:\/\/www.qualityregistry.org [Accessed 12-02-2026]"},{"key":"R62","doi-asserted-by":"crossref","unstructured":"Rajpurkar P Jia R Liang P . Know what you don\u2019t know: unanswerable questions for SQuAD. In: Gurevych I Miyao Y , editors. Presented at: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2; Jul 15-20, 2018:784-789; Melbourne, Australia. [doi: 10.18653\/v1\/P18-2124]","DOI":"10.18653\/v1\/P18-2124"},{"issue":"5","key":"R63","doi-asserted-by":"publisher","first-page":"9636","DOI":"10.1609\/aaai.v34i05.6511","article-title":"SG-Net: syntax-guided machine reading comprehension","volume":"34","author":"Zhang","journal-title":"AAAI"},{"key":"R64","unstructured":"Lan Z Chen M Goodman S Gimpel K Sharma P Soricut R . ALBERT: a lite BERT for self-supervised learning of language representations. Presented at: Proc Int Conf Learn Representations (ICLR 2020); Apr 26 to May 1, 2020; Online. 2020.URL: https:\/\/openreview.net\/forum?id=H1eA7AEtvS [Accessed 15-07-2026]"},{"issue":"16","key":"R65","doi-asserted-by":"publisher","first-page":"14506","DOI":"10.1609\/aaai.v35i16.17705","article-title":"Retrospective reader for machine reading comprehension","volume":"35","author":"Zhang","journal-title":"AAAI"},{"key":"R66","unstructured":"He P Liu X Gao J Chen W . DeBERTa: decoding-enhanced BERT with disentangled attention. Presented at: Proc Int Conf Learn Representations (ICLR); May 3-7, 2021; Online. URL: https:\/\/openreview.net\/forum?id=XPZIaotutsD [Accessed 15-07-2026]"},{"key":"R67","doi-asserted-by":"crossref","unstructured":"Glass M Gliozzo A Chakravarti R et al. Span selection pre-training for question answering. In: Jurafsky D Chai J Schluter N Tetreault J , editors. Presented at: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics; Jul 5-10, 2020:2773-2782; Online. [doi: 10.18653\/v1\/2020.acl-main.247]","DOI":"10.18653\/v1\/2020.acl-main.247"},{"key":"R68","doi-asserted-by":"crossref","unstructured":"Bogireddy SR Dasari N . Comparative analysis of ChatGPT-4 and LLaMA: performance evaluation on text summarization, data analysis, and question answering. Presented at: 2024 15th International Conference on Computing Communication and Networking Technologies (ICCCNT); Jun 24-28, 2024:1-7; Kamand, India. [doi: 10.1109\/ICCCNT61001.2024.10725662]","DOI":"10.1109\/ICCCNT61001.2024.10725662"},{"key":"R69","unstructured":"Beltagy I Peters ME Cohan A . Longformer: the long-document transformer. arXiv. Preprint posted online on Apr 2020. [doi: 10.48550\/arXiv.2004.05150]"},{"key":"R70","unstructured":"Zaheer M Guruganesh G Dubey KA et al. Big bird: transformers for longer sequences. In: Larochelle H Ranzato M Hadsell R Balcan MF Lin H , editors. Presented at: NIPS\u201920: Proceedings of the 34th International Conference on Neural Information Processing Systems; Dec 6-12, 2020:17283-17297; Online. URL: https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/file\/c8512d142a2d849725f31a9a7a361ab9-Paper.pdf [Accessed 15-07-2026]"},{"key":"R71","doi-asserted-by":"crossref","unstructured":"Conneau A Khandelwal K Goyal N et al. Unsupervised cross-lingual representation learning at scale. Presented at: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics; Jul 5-10, 2020; Online. Nov 2019.[doi: 10.18653\/v1\/2020.acl-main.747]","DOI":"10.18653\/v1\/2020.acl-main.747"},{"key":"R72","unstructured":"Marone M Weller O Fleshman W Yang E Lawrie D Durme B . mmBERT: a modern multilingual encoder with annealed language learning. Arxiv. Preprint posted online on Sep 2025. [doi: 10.48550\/arXiv.2509.06888]"},{"key":"R73","unstructured":"Jiang AQ Sablayrolles A Mensch A et al. Mistral 7B. Arxiv. Preprint posted online on Nov 2023. [doi: 10.48550\/arXiv.2310.06825]"},{"key":"R74","unstructured":"Abdin M Aneja J Awadalla H et al. Phi-3 technical report: a highly capable language model locally on your phone. Arxiv. Preprint posted online on Apr 2024. [doi: 10.48550\/arXiv.2404.14219]"},{"key":"R75","unstructured":"Kamath A Ferret J Pathak S et al. Gemma 3 technical report. Arxiv. Preprint posted online on Mar 2025. [doi: 10.48550\/arXiv.2503.19786]"},{"key":"R76","doi-asserted-by":"crossref","unstructured":"Labrak Y Bazoge A Morin E Gourraud PA Rouvier M Dufour R . BioMistral: a collection of open-source pretrained large language models for medical domains. Presented at: Findings of the Association for Computational Linguistics ACL 2024; Aug 11-16, 2024; Bangkok, Thailand. 2024.[doi: 10.18653\/v1\/2024.findings-acl.348]","DOI":"10.18653\/v1\/2024.findings-acl.348"},{"key":"R77","doi-asserted-by":"crossref","unstructured":"Corbeil JP Dada A Attendu JM et al. A modular approach for clinical slms driven by synthetic data with pre-instruction tuning, model merging, and clinical-tasks alignment. In: Che W Nabende J Shutova E Pilehvar MT , editors. Presented at: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1); Jul 27 to Aug 1, 2025:19352-19374; Vienna, Austria. [doi: 10.18653\/v1\/2025.acl-long.950]","DOI":"10.18653\/v1\/2025.acl-long.950"},{"key":"R78","unstructured":"Sellergren A Kazemzadeh S Jaroensri T et al. MedGemma technical report. Arxiv. Preprint posted online on Jul 2025. [doi: 10.48550\/arXiv.2507.05201]"},{"key":"R79","unstructured":"Hu EJ Shen Y Wallis P et al. LoRA: low-rank adaptation of large language models. Presented at: Proc Int Conf Learn Representations (ICLR); Apr 25-29, 2022; Online. URL: https:\/\/openreview.net\/forum?id=nZeVKeeFYf9 [Accessed 15-07-2026]"},{"key":"R80","doi-asserted-by":"crossref","unstructured":"Liu L Ding B Bing L Joty S Si L Miao C . MulDA: a multilingual data augmentation framework for low-resource cross-lingual NER. In: Zong C Xia F Li W Navigli R , editors. Presented at: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers); Aug 1-6, 2021:5834-5846; Online. [doi: 10.18653\/v1\/2021.acl-long.453]","DOI":"10.18653\/v1\/2021.acl-long.453"},{"issue":"14","key":"R81","doi-asserted-by":"publisher","first-page":"12583","DOI":"10.1609\/aaai.v35i14.17491","article-title":"Multilingual transfer learning for QA using translation as data augmentation","volume":"35","author":"Bornea","journal-title":"AAAI"},{"key":"R82","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2508.10925","article-title":"gpt-oss-120b & gpt-oss-20b model card","author":"Agarwal","journal-title":"arXiv"},{"issue":"1","key":"R83","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1093\/jamia\/ocz166","article-title":"2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records","volume":"27","author":"Henry","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"R84","doi-asserted-by":"publisher","DOI":"10.2196\/24678","article-title":"Extracting drug names and associated attributes from discharge summaries: text mining study","volume":"9","author":"Alfattni","journal-title":"JMIR Med Inform"},{"issue":"12","key":"R85","doi-asserted-by":"publisher","first-page":"1935","DOI":"10.1093\/jamia\/ocaa189","article-title":"Clinical concept extraction using transformers","volume":"27","author":"Yang","journal-title":"J Am Med Inform Assoc"},{"key":"R86","unstructured":"Johnson A Bulgarelli L Pollard T Horng S Celi LA . MIMIC-IV (version 2.2). 2023. [doi: 10.13026\/6mm1-ek67]"},{"key":"R87","doi-asserted-by":"crossref","unstructured":"Kweon S Kim J Kwak H et al. EHRNoteQA: an LLM benchmark for real-world clinical practice using discharge summaries. In: Globerson A Mackey L Belgrave D , editors. Presented at: Advances in Neural Information Processing Systems 37; Dec 9-14, 2024:124575-124611; Vancouver, BC, Canada. [doi: 10.52202\/079017-3958]","DOI":"10.52202\/079017-3958"},{"key":"R88","doi-asserted-by":"crossref","unstructured":"Dada A Koras O Bauer M et al. MeDiSumQA: patient-oriented question-answer generation from discharge letters. In: Ananiadou S Demner-Fushman D Gupta D Thompson P , editors. Presented at: Proceedings of the Second Workshop on Patient-Oriented Language Processing (CL4Health); May 4, 2025:124-136; Albuquerque, New Mexico. [doi: 10.18653\/v1\/2025.cl4health-1.10]","DOI":"10.18653\/v1\/2025.cl4health-1.10"},{"key":"R89","unstructured":"Kotschenreuther K . EHR-DS-QA: a synthetic QA dataset derived from medical discharge summaries for enhanced medical information retrieval systems. PhysioNet; 2024. [doi: 10.13026\/25fx-f706]"},{"key":"R90","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","journal-title":"Sci Data"},{"key":"R91","doi-asserted-by":"crossref","unstructured":"Soni S Gayen S Demner-Fushman D . Overview of the ArchEHR-QA 2025 shared task on grounded question answering from electronic health records. In: Demner-Fushman D Ananiadou S Miwa M Tsujii J , editors. Presented at: Proceedings of the 24th Workshop on Biomedical Language Processing; Aug 1, 2025:396-405; Viena, Austria. [doi: 10.18653\/v1\/2025.bionlp-1.34]","DOI":"10.18653\/v1\/2025.bionlp-1.34"},{"key":"R92","doi-asserted-by":"crossref","unstructured":"Lanz V Pecina P . CUNI-a at ArchEHR-QA 2025: do we need giant LLMs for clinical QA? In: Soni S Demner-Fushman D , editors. Presented at: Proceedings of the 24th Workshop on Biomedical Language Processing (Shared Tasks); Aug 1, 2024:27-40; Vienna, Austria. [doi: 10.18653\/v1\/2025.bionlp-share.4]","DOI":"10.18653\/v1\/2025.bionlp-share.4"},{"key":"R93","doi-asserted-by":"crossref","unstructured":"Balmus S Bogdan D Uban AS . UniBuc-SB at ArchEHR-QA 2025: a resource-constrained pipeline for relevance classification and grounded answer synthesis. In: Soni S Demner-Fushman D , editors. Presented at: Proceedings of the 24th Workshop on Biomedical Language Processing (Shared Tasks); 62-68; Vienna, Austria. [Accessed 15-07-2026] [doi: 10.18653\/v1\/2025.bionlp-share.7]","DOI":"10.18653\/v1\/2025.bionlp-share.7"},{"key":"R94","doi-asserted-by":"crossref","unstructured":"Buonocore TM Parimbelli E Tibollo V Napolitano C Priori S Bellazzi R . A rule-free approach for cardiological registry filling from italian clinical notes with question answering transformers. In: Juarez JM Marcos M Stiglic G Tucker A , editors. Artif Intell Med. Springer; 2023:153-162.","DOI":"10.1007\/978-3-031-34344-5_19"},{"key":"R95","doi-asserted-by":"crossref","unstructured":"Schneider ETR de Souza JVA Knafou J et al. BioBERTpt - a Portuguese neural language model for clinical named entity recognition. Presented at: Proceedings of the 3rd Clinical Natural Language Processing Workshop; Nov 19, 2020:65-72; Online. [doi: 10.18653\/v1\/2020.clinicalnlp-1.7]","DOI":"10.18653\/v1\/2020.clinicalnlp-1.7"},{"issue":"8","key":"R96","doi-asserted-by":"publisher","first-page":"1725","DOI":"10.1093\/jamia\/ocae159","article-title":"Annotation-preserving machine translation of English corpora to validate Dutch clinical concept extraction tools","volume":"31","author":"Seinen","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"R97","doi-asserted-by":"publisher","first-page":"183","DOI":"10.34172\/ijhpm.2020.96","article-title":"Perceived burden due to registrations for quality monitoring and improvement in hospitals: a mixed methods study","volume":"PMID","author":"Zegers","journal-title":"Int J Health Policy Manag"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T19:42:08Z","timestamp":1787168528000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e96347"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,19]]},"references-count":97,"URL":"https:\/\/doi.org\/10.2196\/96347","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,19]]},"article-number":"v28i7e96347"}}