{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,1]],"date-time":"2025-10-01T15:23:12Z","timestamp":1759332192501,"version":"3.43.0"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686080","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T00:00:00Z","timestamp":1754524800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,8,7]]},"abstract":"<jats:p>Whether ChatGPT\u2019s answers to medical questions are accurate, reliable, and trustworthy, and whether the public, not having a health background, knows how to evaluate ChatGPT\u2019s answers remains unclear. This study assessed ChatGPT\u2019s performance in answering medical questions posed by the public. An existing clinical question dataset of consumer questions from the NIH Genetic and Rare Diseases Information Center (GARD) was used for this study. API calls produced 1467 question-answer pairs for GPT-4-0613 (ChatGPT-4.0). 100 question-answer pairs were randomly selected as the sample of this study. They were evaluated on two criteria, Scientific Accuracy, and Comprehensiveness, with scales from 0 to 5. The results showed that ChatGPT-4.0 provided about 90% above average performance on scale points 4 and 5 on Scientific Accuracy, 84% on Comprehensiveness, and approximately 7% and 14% on average on scale point 3 on these two quality criteria. No statistical differences were found in the quality of answers to the questions following a question framework and those without. These study results indicate that healthcare consumers must consult healthcare providers and\/or other reliable information resources to verify the answers and gauge the applicability to individual situations. Further studies can include investigating the impact of how the medical questions were asked on the quality of ChatGPT answers, comparing healthcare consumers\u2019 evaluations with healthcare and information professionals\u2019 evaluations, and so on.<\/jats:p>","DOI":"10.3233\/shti251114","type":"book-chapter","created":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T11:41:27Z","timestamp":1754566887000},"source":"Crossref","is-referenced-by-count":1,"title":["\u201cCan ChatGPT Answer Patient\u2019s Questions?\u201d: A Preliminary Analysis"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7801-8919","authenticated-orcid":false,"given":"Donghua","family":"Tao","sequence":"first","affiliation":[{"name":"Library of the Health Sciences, University of Illinois Chicago, Chicago IL, US"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6030-5357","authenticated-orcid":false,"given":"Karl M.","family":"Kochendorfer","sequence":"additional","affiliation":[{"name":"Department of Family &Community Medicine, University of Illinois Chicago, Chicago IL, US"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0560-2364","authenticated-orcid":false,"given":"Tina","family":"Griffin","sequence":"additional","affiliation":[{"name":"Library of the Health Sciences, University of Illinois Chicago, Chicago IL, US"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5522-8729","authenticated-orcid":false,"given":"Quincy","family":"McCrary","sequence":"additional","affiliation":[{"name":"Library of the Health Sciences, University of Illinois Chicago, Chicago IL, US"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-9503-558X","authenticated-orcid":false,"given":"Anuj","family":"Gautam","sequence":"additional","affiliation":[{"name":"Discovery Partners Institute, Chicago IL, US"}]},{"given":"Bichoy S.R.","family":"Labib","sequence":"additional","affiliation":[{"name":"College of Medicine, University of Illinois Chicago, Chicago IL, US"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9155-4559","authenticated-orcid":false,"given":"Mohammad","family":"Arvan","sequence":"additional","affiliation":[{"name":"Department of Family &Community Medicine, University of Illinois Chicago, Chicago IL, US"}]},{"given":"Jason","family":"Flynn","sequence":"additional","affiliation":[{"name":"Library of the Health Sciences, University of Illinois Chicago, Chicago IL, US"}]},{"given":"Kaitlyn","family":"Jiang","sequence":"additional","affiliation":[{"name":"Glenbrook South High School, Glenview IL, US"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","MEDINFO 2025 \u2014 Healthcare Smart \u00d7 Medicine Deep"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI251114","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T11:41:27Z","timestamp":1754566887000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI251114"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,7]]},"ISBN":["9781643686080"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti251114","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"value":"0926-9630","type":"print"},{"value":"1879-8365","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,7]]}}}