{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T22:40:43Z","timestamp":1779403243059,"version":"3.53.1"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686615","type":"electronic"}],"license":[{"start":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T00:00:00Z","timestamp":1779321600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,5,21]]},"abstract":"<jats:p>Large language models (LLMs) are increasingly used in healthcare, yet standardised benchmarks for evaluating guideline-based clinical reasoning are missing. This study introduces a validated dataset derived from the UK\u2019s National Institute for Health and Care Excellence (NICE) guidelines covering multiple diagnoses. The dataset was initially created with the help of GPT-4o-mini and contains patient scenarios, as well as clinical questions; notably, generated contents were further assessed for clinical validity and realism by a practicing clinician to ensure alignment with NICE guidelines. We benchmark a range of recent popular LLMs to showcase the validity of our NICE guideline-based dataset. The framework supports systematic evaluation of LLMs\u2019 clinical utility and guideline adherence. The dataset and Appendix are publicly available at https:\/\/github.com\/julia-ive\/guidelines_qa.<\/jats:p>","DOI":"10.3233\/shti260313","type":"book-chapter","created":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T22:01:23Z","timestamp":1779400883000},"source":"Crossref","is-referenced-by-count":0,"title":["Building a Silver-Standard Dataset from NICE Guidelines for Clinical LLMs"],"prefix":"10.3233","author":[{"given":"Qing","family":"Ding","sequence":"first","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric Hua Qing","family":"Zhang","sequence":"additional","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felix","family":"Jozsa","sequence":"additional","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3931-3392","authenticated-orcid":false,"given":"Julia","family":"Ive","sequence":"additional","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","Opening the Personal Gate between Technology and Health Care"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI260313","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T22:01:23Z","timestamp":1779400883000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI260313"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,21]]},"ISBN":["9781643686615"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti260313","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"value":"0926-9630","type":"print"},{"value":"1879-8365","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,21]]}}}