{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T06:52:16Z","timestamp":1777877536708,"version":"3.51.4"},"reference-count":50,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2025,9,1]],"date-time":"2025-09-01T00:00:00Z","timestamp":1756684800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,9,1]],"date-time":"2025-09-01T00:00:00Z","timestamp":1756684800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Otolaryngology - Head &amp; Neck Surgery"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:sec>\n                    <jats:title>Importance<\/jats:title>\n                    <jats:p>Vertigo accounts for one of the most frequent presenting symptoms in primary care. However, complexities in differential diagnoses and reliance on clinical history contribute to frequent specialist referrals and diagnostic delays. Large language models (LLMs), like LLaMA-3.1-8B, offer new potential for assisting in clinical decision-making.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To assess the utility of a small-scale, open-source LLM in diagnosing peripheral vestibular disorders (PVDs), and evaluate the impact of synthetic data augmentation on diagnostic accuracy.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design<\/jats:title>\n                    <jats:p>Retrospective chart review.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Setting\/Participants<\/jats:title>\n                    <jats:p>A retrospective analysis included adult patients presenting with dizziness to a neuro-otologist at St. Joseph\u2019s Healthcare Hamilton between 2018 and 2023. The dataset comprised 100 clinical cases, supplemented with 40 synthetic cases generated using GPT-4. The LLaMA-3.1-8B model was evaluated on the clinical, synthetic, and combined datasets. Diagnostic reasoning approaches, including chain-of-thought reasoning and multi-shot prompting, were employed to optimize model performance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Main Outcome Measures<\/jats:title>\n                    <jats:p>Metrics for evaluation included top 1 and top 3 diagnostic accuracy, Cohen\u2019s kappa for inter-rater agreement, and accuracy in predicting symptom laterality.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The LLaMA-3.1-8B model achieved a top 1 diagnostic accuracy of 60.7% and a top 3 accuracy of 71.4% in the combined dataset. The most frequent diagnosis was Meniere\u2019s disease (55.7%), followed by vestibular migraines (9.3%) and labyrinthitis (9.3%). Diagnostic accuracy was highest for benign paroxysmal positional vertigo (90%), followed by Meniere\u2019s disease (80.8%). Less common conditions, such as superior canal dehiscence syndrome and vestibular paroxysmia, exhibited lower diagnostic accuracies. Cohen\u2019s kappa indicated substantial agreement for symptom side prediction (\u03ba = 0.96) and moderate agreement for diagnosis (\u03ba = 0.41) in the combined dataset.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions and Relevance<\/jats:title>\n                    <jats:p>The LLaMA-3.1-8B model demonstrated promising accuracy in diagnosing PVDs. The model\u2019s performance highlights its potential to serve as a high-yield screening tool for primary care physicians and general otolaryngologists.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/19160216251377349","type":"journal-article","created":{"date-parts":[[2025,10,1]],"date-time":"2025-10-01T11:09:07Z","timestamp":1759316947000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["Evaluating the Efficacy of Large Language Models for Dizzy History Taking and Peripheral Vestibular Disorder Diagnosis"],"prefix":"10.1177","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-9684-4600","authenticated-orcid":false,"given":"Bonnie","family":"Lu","sequence":"first","affiliation":[{"name":"Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ana-Maria","family":"Misariu","sequence":"additional","affiliation":[{"name":"Division of Otolaryngology\u2014Head &amp; Neck Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8641-9176","authenticated-orcid":false,"given":"Jennifer Inseon","family":"Ham","sequence":"additional","affiliation":[{"name":"Division of Otolaryngology\u2014Head &amp; Neck Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jason","family":"Archibald","sequence":"additional","affiliation":[{"name":"Division of Otolaryngology\u2014Head &amp; Neck Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4189-2733","authenticated-orcid":false,"given":"Benjamin","family":"van der Woerd","sequence":"additional","affiliation":[{"name":"Division of Otolaryngology\u2014Head &amp; Neck Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2025,10]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Burt WC Schappert MS. Ambulatory care visits to physician offices hospital outpatient departments and emergency departments: United States 1999-2000. 2004. Accessed August 10 2024. https:\/\/pubmed.ncbi.nlm.nih.gov\/15499797\/"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1177\/102490790601300302"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.168.19.2118"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1111\/acem.14728"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-018-0716-y"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2023.1254105"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.2196\/49970"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.2196\/49183"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.2196\/45312"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-43436-9"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1227\/neu.0000000000002632"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1002\/oto2.94"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1038\/s43856-023-00370-1"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbad493"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocae045"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.807"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","unstructured":"Ding B Qin C Zhao R et al. Data augmentation using large language models: data perspectives learning paradigms and challenges. Published online July 2 2024. doi:10.48550\/arXiv.2403.02990","DOI":"10.48550\/arXiv.2403.02990"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2024.100946"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","unstructured":"Keles B Gunay M Caglar SI. LLMs-in-the-loop Part-1: expert small AI models for bio-medical text translation. Published online July 26 2024. doi:10.48550\/arXiv.2407.12126","DOI":"10.48550\/arXiv.2407.12126"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","unstructured":"Dubey A Jauhri A Pandey A et al. The Llama 3 Herd of Models. Published online July 31 2024. doi:10.48550\/arXiv.2407.21783","DOI":"10.48550\/arXiv.2407.21783"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-220201"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-2012-0453"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-201644"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-200003"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-210169"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-220202"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-200004"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-190672"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-200005"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-200714"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-150553"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-190655"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-150549"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-170622"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-2009-0343"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-190658"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-160589"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.3233\/VES-170619"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","unstructured":"Wei J Wang X Schuurmans D et al. Chain-of-thought prompting elicits reasoning in large language models. Published online January 10 2023. doi:10.48550\/arXiv.2201.11903","DOI":"10.48550\/arXiv.2201.11903"},{"key":"e_1_3_3_42_2","first-page":"478","article-title":"Comparison of prompt engineering and fine-tuning strategies in large language models in the classification of clinical notes","volume":"2024","author":"Zhang X","year":"2024","unstructured":"Zhang X, Talukdar N, Vemulapalli S, et al. Comparison of prompt engineering and fine-tuning strategies in large language models in the classification of clinical notes. AMIA Summits Transl Sci Proc. 2024;2024:478-487.","journal-title":"AMIA Summits Transl Sci Proc"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","unstructured":"Agarwal R Singh A Zhang LM et al. Many-shot in-context learning. Published online May 22 2024. doi:10.48550\/arXiv.2404.11018","DOI":"10.48550\/arXiv.2404.11018"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01157-x"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1111\/acem.12168"},{"key":"e_1_3_3_46_2","unstructured":"Moir M Barua B Wannamaker H. Waiting your turn: wait times for health care in Canada 2023 report. Fraser Institute. Published online 2023. Accessed October 23 2024. https:\/\/www.fraserinstitute.org\/sites\/default\/files\/waiting-your-turn-2023.pdf"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1002\/lary.26868"},{"key":"e_1_3_3_48_2","unstructured":"The role of Large Language Models (LLMs) in providing triage for maxillofacial trauma cases: a preliminary study\u2014PMC. Accessed October 23 2024. https:\/\/pmc.ncbi.nlm.nih.gov\/articles\/PMC11048758\/"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","unstructured":"Gaber F Shaik M Franke V Akalin A. Evaluating large language model workflows in clinical decision support: referral triage and diagnosis. Published online September 28 2024. doi:10.1101\/2024.09.27.24314505","DOI":"10.1101\/2024.09.27.24314505"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1097\/MAO.0000000000002013"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1212\/wnl.56.4.436"}],"container-title":["Journal of Otolaryngology - Head &amp; Neck Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/19160216251377349","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/19160216251377349","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/19160216251377349","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T22:54:04Z","timestamp":1777589644000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/19160216251377349"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9]]},"references-count":50,"alternative-id":["10.1177\/19160216251377349"],"URL":"https:\/\/doi.org\/10.1177\/19160216251377349","relation":{},"ISSN":["1916-0216","1916-0216"],"issn-type":[{"value":"1916-0216","type":"print"},{"value":"1916-0216","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9]]},"article-number":"19160216251377349"}}