{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T22:37:44Z","timestamp":1779403064744,"version":"3.53.1"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686615","type":"electronic"}],"license":[{"start":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T00:00:00Z","timestamp":1779321600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,5,21]]},"abstract":"<jats:p>Headache disorders present diagnostic challenges due to their clinical heterogeneity and the extensive taxonomy of the ICHD-3 classification. While large language models (LLMs) have recently demonstrated impressive diagnostic reasoning capabilities, systematic evaluation for headache disorders remains elusive. This study protocol presents a retrospective, multicentre study designed to investigate whether anonymized clinical vignettes from specialized headache centres can be accurately classified according to the ICHD-3 by LLMs. Open-weight models selected for this study will operate in a GDPR-compliant environment and generate classifications that will be compared with expert diagnoses (the gold standard) using top-k accuracy, micro\/macro precision, recall, F1 score and Cohen\u2019s \u03ba. Secondary analyses will assess differences between centres and non-specialist raters. Preliminary pilot data (n = 50) already demonstrated exact accuracy of up to 62% and group-level accuracy of up to 92%. The study aims to confirm substantial agreement (\u03ba &gt; 0.6) and provide evidence of the usefulness of LLMs as diagnostic support tools in headache medicine.<\/jats:p>","DOI":"10.3233\/shti260170","type":"book-chapter","created":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T21:57:13Z","timestamp":1779400633000},"source":"Crossref","is-referenced-by-count":0,"title":["Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-0990-3570","authenticated-orcid":false,"given":"Dorian","family":"Zwanzig","sequence":"first","affiliation":[{"name":"Eberswalde University for Sustainable Development, Eberswalde, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anika","family":"Zahn","sequence":"additional","affiliation":[{"name":"Department of Neurology, University Medicine Greifswald, Greifswald, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5865-4427","authenticated-orcid":false,"given":"Sebastian","family":"Strauss","sequence":"additional","affiliation":[{"name":"Department of Neurology, University Medicine Greifswald, Greifswald, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","Opening the Personal Gate between Technology and Health Care"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI260170","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T21:57:14Z","timestamp":1779400634000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI260170"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,21]]},"ISBN":["9781643686615"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti260170","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"value":"0926-9630","type":"print"},{"value":"1879-8365","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,21]]}}}