{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T22:38:41Z","timestamp":1779403121602,"version":"3.53.1"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686615","type":"electronic"}],"license":[{"start":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T00:00:00Z","timestamp":1779321600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,5,21]]},"abstract":"<jats:p>Introduction: Large Language Models usage in the healthcare environment is more noticeable than ever, finding use cases from data extraction and clinical knowledge retrieval. However, current benchmarks are predominantly single language and biased by the country-of-origin framework. Methods: This work presents the creation of a new harmonized multilingual dataset of medical multiple-choice questions from 14 countries, with 13 languages. The questions were standardized and labelled according to the European Union of Medical Specialists classification, resorting to automated annotation, when required. To demonstrate the applicability of the dataset, exploratory benchmark experiments were conducted on a smaller set and a wide selection of models were analyzed to illustrate their performance across different languages. Results: The results show a great variability dependent on the language and model specifications. These findings highlight the uneven performance of LLMs across linguistic contexts in medical reasoning tasks. Conclusion\/Discussion: With a standardized and multilingual resource, a reliable foundation is available for future research on globally applicable medical AI.<\/jats:p>","DOI":"10.3233\/shti260188","type":"book-chapter","created":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T21:57:43Z","timestamp":1779400663000},"source":"Crossref","is-referenced-by-count":0,"title":["GlobalMedQA: A Standardized Multilingual Dataset for Assessing Medical Knowledge in LLMs"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-5309-2194","authenticated-orcid":false,"given":"M\u00e1rio","family":"Macedo","sequence":"first","affiliation":[{"name":"Institute for Medical Informatics and Statistics, Kiel University and University Hospital Schleswig-Holstein, Kiel, Germany"},{"name":"Medical Data Integration Center, University Hospital Schleswig-Holstein, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2086-5481","authenticated-orcid":false,"given":"Manuel","family":"Hecht","sequence":"additional","affiliation":[{"name":"Department of Medicine II, Hematology and Oncology, University Hospital Schleswig-Holstein, Christian-Albrechts-University, Kiel, Germany"},{"name":"University Cancer Centre Schleswig-Holstein, University Hospital Schleswig-Holstein, Kiel, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7002-7917","authenticated-orcid":false,"given":"Sylvia","family":"Saalfeld","sequence":"additional","affiliation":[{"name":"Institute for Medical Informatics and Statistics, Kiel University and University Hospital Schleswig-Holstein, Kiel, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1748-1563","authenticated-orcid":false,"given":"Bj\u00f6rn","family":"Schreiweis","sequence":"additional","affiliation":[{"name":"Institute for Medical Informatics and Statistics, Kiel University and University Hospital Schleswig-Holstein, Kiel, Germany"},{"name":"Medical Data Integration Center, University Hospital Schleswig-Holstein, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8349-6798","authenticated-orcid":false,"given":"Hannes","family":"Ulrich","sequence":"additional","affiliation":[{"name":"Institute for Medical Informatics and Statistics, Kiel University and University Hospital Schleswig-Holstein, Kiel, Germany"},{"name":"Medical Data Integration Center, University Hospital Schleswig-Holstein, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","Opening the Personal Gate between Technology and Health Care"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI260188","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T21:57:43Z","timestamp":1779400663000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI260188"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,21]]},"ISBN":["9781643686615"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti260188","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"value":"0926-9630","type":"print"},{"value":"1879-8365","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,21]]}}}