{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,5]],"date-time":"2026-09-05T04:30:46Z","timestamp":1788582646676,"version":"build-2803163510"},"reference-count":31,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR AI"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Rare diseases, which affect millions of people worldwide, pose a major challenge, as it often takes years before an accurate diagnosis can be made. This delay results in substantial burdens for patients and health care systems, as misdiagnoses lead to inadequate treatment and increased costs. Artificial intelligence (AI)\u2013powered symptom checkers (SCs) present an opportunity to flag rare diseases earlier in the diagnostic work-up. However, these tools are primarily based on published literature, which often contains incomplete data on rare diseases, resulting in compromised diagnostic accuracy. Integrating expert interview insights into SC models may enhance their performance, ensuring that rare diseases are considered sooner and diagnosed more accurately.<\/jats:p>\n <\/jats:sec>\n \n \n Objective\n \n <\/jats:title>\n The objectives of our study were to incorporate expert interview vignettes into AI-powered SCs, in addition to a traditional literature review, and to evaluate whether this novel approach improves diagnostic accuracy and user satisfaction for rare diseases, focusing on Fabry disease.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This mixed methods prospective pilot study was conducted at Hannover Medical School, Germany. In the first phase, guided interviews were conducted with medical experts specialized in Fabry disease to create clinical vignettes that enriched the AI SC\u2019s Fabry disease model. In the second phase, adult patients with a confirmed diagnosis of Fabry disease used both the original and optimized SC versions in a randomized order. The versions, containing either the original or the optimized Fabry disease model, were evaluated based on diagnostic accuracy and user satisfaction, which were assessed through questionnaires.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Three medical experts with extensive experience in lysosomal storage disorder Fabry disease contributed to the creation of 5 clinical vignettes, which were integrated into the AI-powered SC. The study compared the original and optimized SC versions in 6 patients with Fabry disease. The optimized version improved diagnostic accuracy, with Fabry disease identified as the top suggestion in 33% (2\/6) of cases, compared to 17% (1\/6) with the original model. Additionally, overall user satisfaction was higher for the optimized version, with participants rating it more favorably in terms of symptom coverage and completeness.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This study demonstrates that integrating expert-derived clinical vignettes into AI-powered SCs can improve diagnostic accuracy and user satisfaction, particularly for rare diseases. The optimized SC version, which incorporated these vignettes, showed improved performance in identifying Fabry disease as a top diagnostic suggestion and received higher user satisfaction ratings compared to the original version. To fully realize the potential of this approach, it is crucial to include vignettes representing atypical presentations and to conduct larger-scale studies to validate these findings.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/55001","type":"journal-article","created":{"date-parts":[[2025,7,17]],"date-time":"2025-07-17T14:55:07Z","timestamp":1752764107000},"page":"e55001-e55001","source":"Crossref","is-referenced-by-count":4,"title":["Medical Expert Knowledge Meets AI to Enhance Symptom Checker Performance for Rare Disease Identification in Fabry Disease: Mixed Methods Study"],"prefix":"10.2196","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-9665-5143","authenticated-orcid":false,"given":"Anne","family":"Pankow","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0540-0823","authenticated-orcid":false,"given":"Nico","family":"Mei\u00dfner-Bendzko","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7718-3464","authenticated-orcid":false,"given":"Jessica","family":"Kaufeld","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2105-2419","authenticated-orcid":false,"given":"Laura","family":"Fouquette","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2898-422X","authenticated-orcid":false,"given":"Fabienne","family":"Cotte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1997-1689","authenticated-orcid":false,"given":"Stephen","family":"Gilbert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3954-1210","authenticated-orcid":false,"given":"Ewelina","family":"T\u00fcrk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5884-0852","authenticated-orcid":false,"given":"Anibh","family":"Das","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1489-1683","authenticated-orcid":false,"given":"Christoph","family":"Terkamp","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7518-1131","authenticated-orcid":false,"given":"Gerhard-R\u00fcdiger","family":"Burmester","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0640-8309","authenticated-orcid":false,"given":"Annette Doris","family":"Wagner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,8,28]]},"reference":[{"key":"R1","unstructured":"Rare disease facts & statistics. National Organization for Rare Disorders, Inc. 2025. URL: https:\/\/rarediseases.org\/understanding-rare-disease\/rare-disease-facts-and-statistics\/ [Accessed 19-08-2025]"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","DOI":"10.1186\/s13023-019-1040-6","article-title":"Can a decision support system accelerate rare disease diagnosis? Evaluating the potential impact of Ada DX in a retrospective study","volume":"14","author":"Ronicke","journal-title":"Orphanet J Rare Dis"},{"key":"R3","unstructured":"Zeidler C Mundlos C . Defizitanalyse zur diagnoseverzo\u0308gerung [Article in German]. Hintergrundpapier. 2013. URL: https:\/\/www.namse.de\/fileadmin\/user_upload\/Defizitanalyse_zur_Diagnoseverz%C3%B6gerung_AG2.pdf [Accessed 19-08-2025]"},{"issue":"2","key":"R4","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0172532","article-title":"Diagnostic needs for rare diseases and shared prediagnostic phenomena: results of a German-wide expert Delphi survey","volume":"12","author":"Bl\u00f6\u00df","journal-title":"PLoS ONE"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1002\/jmd2.12071","article-title":"The clinical profiles of female patients with Fabry disease in Latin America: a Fabry Registry analysis of natural history data from 169 patients based on enzyme replacement therapy status","volume":"49","author":"Martins","journal-title":"JIMD Rep"},{"issue":"12","key":"R6","doi-asserted-by":"publisher","first-page":"2167","DOI":"10.1007\/s00296-022-05202-4","article-title":"Comparison of physician and artificial intelligence-based symptom checker diagnostic accuracy","volume":"42","author":"Gr\u00e4f","journal-title":"Rheumatol Int"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-021-06926-y","article-title":"Health economic benefits through the use of diagnostic support systems and expert knowledge","volume":"21","author":"Willmen","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"R8","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-023-09886-7","article-title":"Rare diseases: why is a rapid referral to an expert center so important?","volume":"23","author":"Willmen","journal-title":"BMC Health Serv Res"},{"issue":"630","key":"R9","doi-asserted-by":"publisher","first-page":"e49","DOI":"10.3399\/bjgp15X683161","article-title":"Early diagnostic suggestions improve accuracy of GPs: a randomised controlled trial using computer-simulated patients","volume":"65","author":"Kostopoulou","journal-title":"Br J Gen Pract"},{"issue":"6","key":"R10","doi-asserted-by":"publisher","DOI":"10.1098\/rsfs.2021.0017","article-title":"Miasmas, mental models and preventive public health: some philosophical reflections on science in the COVID-19 pandemic","volume":"11","author":"Greenhalgh","journal-title":"Interface Focus"},{"issue":"12","key":"R11","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2020-040269","article-title":"How accurate are digital symptom assessment apps for suggesting conditions and urgency advice? A clinical vignettes comparison to GPs","volume":"10","author":"Gilbert","journal-title":"BMJ Open"},{"issue":"1","key":"R12","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-022-00667-w","article-title":"The diagnostic and triage accuracy of digital and online symptom checker tools: a systematic review","volume":"5","author":"Wallace","journal-title":"NPJ Digit Med"},{"issue":"5","key":"R13","doi-asserted-by":"publisher","first-page":"935","DOI":"10.1097\/SLA.0000000000005614","article-title":"The diagnostic efficacy of an app-based diagnostic health care application in the emergency room: eRadaR-Trial. A prospective, double-blinded, observational study","volume":"276","author":"Faqar-Uz-Zaman","journal-title":"Ann Surg"},{"key":"R14","unstructured":"Using technology to ease the burden on primary care. Healthwatch Enfield. 2019. URL: https:\/\/www.healthwatchenfield.co.uk\/sites\/healthwatchenfield.co.uk\/files\/Report_UsingTechnologyToEaseTheBurdenOnPrimaryCare.pdf [Accessed 19-08-2025]"},{"key":"R15","unstructured":"Butcher M . Ada Health built an AI-driven startup by moving slowly and not breaking things. TechCrunch. URL: https:\/\/techcrunch.com\/2020\/03\/05\/move-slow-and-dont-break-things-how-to-build-an-ai-driven-startup\/ [Accessed 19-08-2025]"},{"issue":"3","key":"R16","doi-asserted-by":"publisher","DOI":"10.2196\/19713","article-title":"Patients\u2019 utilization and perception of an artificial intelligence-based symptom assessment and advice technology in a British primary care waiting room: exploratory pilot study","volume":"7","author":"Miller","journal-title":"JMIR Hum Factors"},{"issue":"7","key":"R17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0254088","article-title":"Accuracy of online symptom checkers and the potential impact on service utilisation","volume":"16","author":"Ceney","journal-title":"PLoS ONE"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.h3480","article-title":"Evaluation of symptom checkers for self diagnosis and triage: audit study","volume":"351","author":"Semigran","journal-title":"BMJ"},{"issue":"2","key":"R19","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/s00296-023-05464-6","article-title":"Diagnostic accuracy of a large language model in rheumatology: comparison of physician and ChatGPT-4","volume":"44","author":"Krusche","journal-title":"Rheumatol Int"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.2196\/46231","article-title":"Characteristics of users and nonusers of symptom checkers in Germany: cross-sectional survey study","volume":"25","author":"Kopka","journal-title":"J Med Internet Res"},{"key":"R21","unstructured":"EPatient survey 2020. Health & Care Management. 2020. URL: https:\/\/www.hcm-magazin.de\/epatient-survey-2020-digital-health-studie-271773\/ [Accessed 19-08-2025]"},{"issue":"3","key":"R22","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1016\/j.tcb.2023.06.005","article-title":"Lysosomal enzyme trafficking: from molecular mechanisms to human diseases","volume":"34","author":"Braulke","journal-title":"Trends Cell Biol"},{"issue":"1","key":"R23","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1038\/s41572-018-0025-4","article-title":"Lysosomal storage diseases","volume":"4","author":"Platt","journal-title":"Nat Rev Dis Primers"},{"issue":"3","key":"R24","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1111\/j.1365-2362.2004.01309.x","article-title":"Fabry disease defined: baseline clinical manifestations of 366 patients in the Fabry Outcome Survey","volume":"34","author":"Mehta","journal-title":"Eur J Clin Invest"},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.2196\/53985","article-title":"Longitudinal changes in diagnostic accuracy of a differential diagnosis list developed by an AI-based symptom checker: retrospective observational study","volume":"8","author":"Harada","journal-title":"JMIR Form Res"},{"issue":"6","key":"R26","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1517\/17530059.2013.846322","article-title":"Difficulties and barriers in diagnosing Fabry disease: what can be learnt from the literature?","volume":"7","author":"Thomas","journal-title":"Expert Opin Med Diagn"},{"issue":"5","key":"R27","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1016\/j.jval.2018.03.004","article-title":"Challenges in research and health technology assessment of rare disease technologies: report of the ISPOR Rare Disease Special Interest Group","volume":"21","author":"Nestler-Parr","journal-title":"Value Health"},{"issue":"5","key":"R28","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1071\/PY21032","article-title":"Quality of condition suggestions and urgency advice provided by the Ada symptom assessment app evaluated with vignettes optimised for Australia","volume":"27","author":"Gilbert","journal-title":"Aust J Primary Health"},{"issue":"8","key":"R29","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.16956","article-title":"Artificial intelligence-based application provides accurate medical triage advice when compared to consensus decisions of healthcare providers","volume":"13","author":"Delshad","journal-title":"Cureus"},{"issue":"10","key":"R30","doi-asserted-by":"publisher","DOI":"10.2196\/37408","article-title":"Online symptom checkers: recommendations for a vignette-based clinical evaluation standard","volume":"24","author":"Painter","journal-title":"J Med Internet Res"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.2196\/49995","article-title":"Comparison of diagnostic and triage accuracy of Ada Health and WebMD symptom checkers, ChatGPT, and physicians for patients in an emergency department: clinical data analysis study","volume":"11","author":"Fraser","journal-title":"JMIR Mhealth Uhealth"}],"container-title":["JMIR AI"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ai.jmir.org\/2025\/1\/e55001","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:42:21Z","timestamp":1782841341000},"score":1,"resource":{"primary":{"URL":"https:\/\/ai.jmir.org\/2025\/1\/e55001"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,28]]},"references-count":31,"URL":"https:\/\/doi.org\/10.2196\/55001","relation":{},"ISSN":["2817-1705"],"issn-type":[{"value":"2817-1705","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,28]]},"article-number":"v4i1e55001"}}