{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T09:31:05Z","timestamp":1774690265747,"version":"3.50.1"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686080","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T00:00:00Z","timestamp":1754524800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,8,7]]},"abstract":"<jats:p>Generating differential diagnoses for rare disease patients can be time intensive and highly dependent on the background and training of the evaluating physicians. Large language models (LLMs) have the potential to complement this process by automatically generating differentials to support physicians, but their performance in real-world patient populations remains underexplored. To this end, we assessed the diagnostic accuracy of ChatGPT-4o, Llama 3.1-8B-Instruct, and Exomiser in 424 rare disease patients at the Undiagnosed Diseases Network. ChatGPT-4o had the highest differential diagnostic accuracy (22.4% [95% CI: 18.4, 26.4]), outperforming Exomiser (13.9% [10.6, 17.2]; p &lt; 0.001) and Llama 3.1-8B-Instruct (11.6% [8.5, 14.6]; p &lt; 0.001). Adjusting for other factors, age at symptom onset was a significant predictor of ChatGPT-4o\u2019s diagnostic accuracy with the model performing better in patients with later symptom onset, potentially due to more distinct phenotypic presentations in older individuals. The combined accuracy of ChatGPT-4o and Exomiser was 30% [25.6, 34.3] and higher than that of either model alone (p &lt; 0.01). This improvement highlights the potential of combining LLMs and bioinformatic models to generate differential diagnoses for rare diseases.<\/jats:p>","DOI":"10.3233\/shti251000","type":"book-chapter","created":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T11:37:48Z","timestamp":1754566668000},"source":"Crossref","is-referenced-by-count":2,"title":["Accuracy of Large Language Models in Generating Rare Disease Differential Diagnosis Using Key Clinical Features"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7466-0034","authenticated-orcid":false,"given":"Cathy","family":"Shyr","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA"}]},{"given":"Rory J.","family":"Tinker","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN, USA"}]},{"given":"Paul A.","family":"Harris","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA"}]},{"given":"Alex C.","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA"}]},{"given":"Kevin W.","family":"Byram","sequence":"additional","affiliation":[{"name":"Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA"}]},{"given":"Lisa","family":"Bastarache","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA"}]},{"given":"Josh F.","family":"Peterson","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA"}]},{"given":"Rizwan","family":"Hamid","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN, USA"}]},{"given":"Hua","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA"}]},{"given":"Thomas A.","family":"Cassini","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN, USA"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","MEDINFO 2025 \u2014 Healthcare Smart \u00d7 Medicine Deep"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI251000","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T11:37:48Z","timestamp":1754566668000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI251000"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,7]]},"ISBN":["9781643686080"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti251000","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"value":"0926-9630","type":"print"},{"value":"1879-8365","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,7]]}}}