{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T10:40:45Z","timestamp":1789123245633,"version":"build-2803163510"},"reference-count":25,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T00:00:00Z","timestamp":1741564800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: Rare diseases often present challenges in obtaining reliable and accurate information than common diseases owing to their low prevalence. Patients and families often rely on self-directed learning, but understanding complex medical information can be difficult, increasing the risk of misinformation. This study aimed to evaluate whether generative artificial intelligence (AI) provides accurate and non-harmful answers to rare disease-related questions and assesses its utility in supporting patients and families requiring genetic counseling. Methods: We evaluated four generative AI models available between 22 September and 4 October 2024: ChatGPT o1-Preview, Gemini advanced, Claude 3.5 sonnet, and Perplexity sonar huge. A total of 102 questions targeting four rare diseases, covering general information, diagnosis, treatment, prognosis, and counseling, were prepared. Four evaluators scored the responses for professionalism and accuracy using the Likert scale (1: poor, 5: excellent). Results: The average scores ranked the AI models as: ChatGPT (4.24 \u00b1 0.73), Gemini (4.15 \u00b1 0.74), Claude (4.13 \u00b1 0.82), and Perplexity (3.35 \u00b1 0.80; p &lt; 0.001). Perplexity had the highest proportion of scores of 1 (very poor) and 2 (poor) (7.6%, 31\/408), followed by Gemini (2.0%, 8\/408), Claude (1.5%, 6\/408), and ChatGPT (1.5%, 6\/408). The accuracy of responses in the counseling part across all four diseases was significantly different (p &lt; 0.001). Conclusions: The four generative AI models generally provided reliable information. However, occasional inaccuracies and ambiguous references may lead to confusion and anxiety among patients and their families. To ensure its effective use, recognizing the limitations of generative AI and providing guidance from experts regarding its proper utilization is essential.<\/jats:p>","DOI":"10.3390\/diagnostics15060672","type":"journal-article","created":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T09:36:24Z","timestamp":1741599384000},"page":"672","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Evaluating the Use of Generative Artificial Intelligence to Support Genetic Counseling for Rare Diseases"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-0139-6928","authenticated-orcid":false,"given":"Suok","family":"Jeon","sequence":"first","affiliation":[{"name":"Department of Genetic Counseling, Graduate School, College of Medicine, Ewha Womans University, Seoul 03760, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Su-A","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Genetic Counseling, Graduate School, College of Medicine, Ewha Womans University, Seoul 03760, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6382-4099","authenticated-orcid":false,"given":"Hae-Sun","family":"Chung","sequence":"additional","affiliation":[{"name":"Department of Laboratory Medicine, College of Medicine, Ewha Womans University, Seoul 03760, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji Young","family":"Yun","sequence":"additional","affiliation":[{"name":"Department of Neurology, College of Medicine, Ewha Womans University, Seoul 03760, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eun Ae","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, College of Medicine, Ewha Womans University, Seoul 03760, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min-Kyung","family":"So","sequence":"additional","affiliation":[{"name":"Department of Laboratory Medicine, College of Medicine, Ewha Womans University, Seoul 03760, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jungwon","family":"Huh","sequence":"additional","affiliation":[{"name":"Department of Genetic Counseling, Graduate School, College of Medicine, Ewha Womans University, Seoul 03760, Republic of Korea"},{"name":"Department of Laboratory Medicine, College of Medicine, Ewha Womans University, Seoul 03760, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,3,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"153","DOI":"10.5723\/kjcs.2022.43.2.153","article-title":"Sharenting and parenting support needs of mothers raising children with rare diseases","volume":"43","author":"Lee","year":"2022","journal-title":"Korean J. Child. Stud."},{"key":"ref_2","first-page":"167","article-title":"National survey for genetic counseling and demands for professional genetic counselor","volume":"4","author":"Chung","year":"2007","journal-title":"J. Genet. Med."},{"key":"ref_3","first-page":"141","article-title":"An exploratory analysis of unmet healthcare needs among patients with rare diseases and their caregivers","volume":"42","author":"Choi","year":"2022","journal-title":"Health Soc. Welf. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1186\/s13012-024-01357-9","article-title":"Generative AI in healthcare: An implementation science informed translational path on application, integration and governance","volume":"19","author":"Reddy","year":"2024","journal-title":"Implement. Sci."},{"key":"ref_5","unstructured":"(2024, December 01). Intelligent Information Society User Panel Survey. Available online: https:\/\/eiec.kdi.re.kr\/policy\/domesticView.do?ac=0000188276."},{"key":"ref_6","unstructured":"Maslej, N., Fattorini, L., Brynjolfsson, E., Etchemendy, J., Ligett, K., Lyons, T., Manyika, J., Ngo, H., Niebles, J., and Parli, V. (2023). Artificial intelligence index report 2023. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"85","DOI":"10.46251\/INNOS.2022.2.17.1.85","article-title":"Study on qualitative changes in labour demand by industry according to the diffusion of AI service","volume":"17","author":"Shim","year":"2022","journal-title":"Innos"},{"key":"ref_8","unstructured":"Ai, W.I. (2018). Artificial Intelligence (AI) in Healthcare and Research, Nuffield Council on Bioethics."},{"key":"ref_9","unstructured":"Korean Statistical Information Service Agency (2020). Stat. Regist. Rare Dis., Available online: https:\/\/kosis.kr\/statHtml\/statHtml.do?orgId=177&tblId=DT_117106_2021_001&conn_path=I3."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1038\/s41431-023-01396-8","article-title":"Analysis of large-language model versus human performance for genetics questions","volume":"32","author":"Duong","year":"2024","journal-title":"Eur. J. Hum. Genet."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e32062","DOI":"10.1002\/ajmg.c.32062","article-title":"Is artificial intelligence getting too much credit in medical genetics?","volume":"193","author":"Alkuraya","year":"2023","journal-title":"Am. J. Med. Genet. C Semin. Med. Genet."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.mcpdig.2023.05.004","article-title":"Learning to fake it: Limited responses and fabricated references provided by ChatGPT for medical questions","volume":"1","author":"Gravel","year":"2023","journal-title":"Mayo Clin. Proc. Digit. Health"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e63493","DOI":"10.1002\/ajmg.a.63493","article-title":"Genetic counselors\u2019 utilization of ChatGPT in professional practice: A cross-sectional study","volume":"194","author":"Ahimaz","year":"2024","journal-title":"Am. J. Med. Genet. A"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1016\/j.dld.2024.02.019","article-title":"Charting new AI education in gastroenterology: Cross-sectional evaluation of ChatGPT and perplexity AI in medical residency exam","volume":"56","author":"Gravina","year":"2024","journal-title":"Dig. Liver Dis."},{"key":"ref_15","first-page":"e52485","article-title":"A comparative analysis of AI models in complex medical decision-making scenarios: Evaluating ChatGPT, Claude AI, Bard, and Perplexity","volume":"16","author":"Uppalapati","year":"2024","journal-title":"Cureus"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e39305","DOI":"10.1097\/MD.0000000000039305","article-title":"Assessment of readability, reliability, and quality of ChatGPT\u00ae, Bard\u00ae, Gemini\u00ae, Copilot\u00ae, Perplexity\u00ae responses on palliative care","volume":"103","author":"Uzun","year":"2024","journal-title":"Medicine"},{"key":"ref_17","unstructured":"Moore, O. (2024). The Top 100 Gen AI Consumer Apps, [3rd ed.]. Available online: https:\/\/a16z.com\/100-gen-ai-apps-3\/Updated2024.08.21."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Durmaz Engin, C.D., Karatas, E., and Ozturk, T. (2024). Exploring the role of ChatGPT-4, BingAI, and Gemini as virtual consultants to educate families about retinopathy of prematurity. Children, 11.","DOI":"10.3390\/children11060750"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zampatti, S., Peconi, C., Megalizzi, D., Calvino, G., Trastulli, G., Cascella, R., Strafella, C., Caltagirone, C., and Giardina, E. (2024). Innovations in medicine: Exploring ChatGPT\u2019s impact on rare disorder management. Genes, 15.","DOI":"10.20944\/preprints202403.0876.v1"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/jgc4.1359","article-title":"Chatbots & artificial intelligence to scale genetic information delivery","volume":"30","author":"Nazareth","year":"2021","journal-title":"J. Genet. Couns."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e46571","DOI":"10.2196\/46571","article-title":"Evaluation of the Rosa chatbot providing genetic information to patients at risk of hereditary breast and ovarian cancer: Qualitative interview study","volume":"25","author":"Siglen","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e2300123","DOI":"10.1200\/CCI.23.00123","article-title":"Chatbot artificial intelligence for genetic Cancer risk assessment and counseling: A systematic review and meta-analysis","volume":"7","author":"Webster","year":"2023","journal-title":"JCO Clin. Cancer Inform."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1760","DOI":"10.1016\/j.jvir.2023.05.037","article-title":"Evaluation of an artificial intelligence chatbot for delivery of IR patient education material: A comparison with societal website content","volume":"34","author":"McCarthy","year":"2023","journal-title":"J. Vasc. Interv. Radiol."},{"key":"ref_24","unstructured":"Petrosyan, A. (2024). Common Languages Used for Web Content 2024, by Share of Websites, Available online: https:\/\/www.statista.com\/statistics\/262946\/most-common-languages-on-the-internet\/."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e12432","DOI":"10.1111\/lnc3.12432","article-title":"Five sources of bias in natural language processing","volume":"15","author":"Hovy","year":"2021","journal-title":"Lang. Linguist. Compass"}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/6\/672\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:49:54Z","timestamp":1760028594000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/6\/672"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,10]]},"references-count":25,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["diagnostics15060672"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics15060672","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,10]]}}}