{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,14]],"date-time":"2026-10-14T16:40:22Z","timestamp":1791996022249,"version":"4.4.0"},"reference-count":45,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T00:00:00Z","timestamp":1788998400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Myocardial infarction (MI) is an acute, life-threatening cardiovascular disease, and high-quality, accessible public health education is vital for emergency management. This study systematically evaluates the quality, transparency, clinical accuracy, patient safety, and readability of information generated by different large language models (LLMs) in responding to MI-related public inquiries.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Twenty-five representative MI patient education questions were submitted to Gemini 3.5 Flash, Claude Opus 4.8, and ChatGPT 5.5. The generated information was independently evaluated by two cardiologists using four validated tools (DISCERN, EQIP, GQS, and JAMA) alongside a strict clinical safety assessment. Text readability was concurrently assessed utilizing six established metrics (FRES, ARI, GFI, CLI, FKGL, and SMOG).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Significant variations were observed in the quality, transparency and readability of information generated by the evaluated LLMs. Regarding quality and transparency, significant overall differences were noted among models in DISCERN (\n                      <jats:italic>p<\/jats:italic>\n                      &amp;lt;\u202f0.001) and EQIP (\n                      <jats:italic>p<\/jats:italic>\n                      &amp;lt;\u202f0.001) scores, whereas no significant differences were found in GQS and JAMA benchmarks. For DISCERN, Claude achieved significantly higher scores than both Gemini and ChatGPT. In the EQIP assessment of completeness and clarity, Claude and Gemini scored significantly higher than ChatGPT, though all models attained a \u201cgood\u201d rating. Additionally, all models exhibited poor performance on the JAMA benchmark, indicating critical deficits in information transparency. Notably, LLMs sometimes generated incomplete, incorrect, or even potentially harmful information. Regarding readability, although Claude generated relatively more comprehensible text, all models failed to meet the recommended sixth-grade reading benchmark, indicating high reading difficulty.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>While LLMs can generate structurally clear and logically coherent foundational content for MI-related queries, they occasionally produce clinically inappropriate directives. Furthermore, the texts generated by these models are overly complex, creating substantial reading barriers for the general public. Consequently, under zero-shot and English-language testing conditions, the current LLMs are not yet capable as standalone health education tools for MI.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1914167","type":"journal-article","created":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T05:31:05Z","timestamp":1789018265000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Evaluating large language models for myocardial infarction public health education: a comparative study on information quality, transparency and readability"],"prefix":"10.3389","volume":"14","author":[{"given":"Tailong","family":"Lv","sequence":"first","affiliation":[{"name":"Shandong University of Traditional Chinese Medicine","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenkai","family":"Bao","sequence":"additional","affiliation":[{"name":"Yunnan University of Traditional Chinese Medicine","place":["Kunming, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shudi","family":"Li","sequence":"additional","affiliation":[{"name":"Shandong University of Traditional Chinese Medicine","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cong","family":"Sun","sequence":"additional","affiliation":[{"name":"Second Affiliated Hospital of Shandong University of Traditional Chinese Medicine","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shouqiang","family":"Chen","sequence":"additional","affiliation":[{"name":"Shandong University of Traditional Chinese Medicine","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Menghe","family":"Zhang","sequence":"additional","affiliation":[{"name":"Second Affiliated Hospital of Shandong University of Traditional Chinese Medicine","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,10]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"2361","DOI":"10.1016\/j.jacc.2022.11.005","article-title":"The global burden of cardiovascular diseases and risk: a compass for future health","volume":"80","author":"Vaduganathan","year":"2022","journal-title":"J Am Coll Cardiol"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"1163","DOI":"10.1093\/eurheartj\/ehu505","article-title":"Cardiovascular risk in post-myocardial infarction patients: nationwide real world data demonstrate the importance of a long-term perspective","volume":"36","author":"Jernberg","year":"2015","journal-title":"Eur Heart J"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"2982","DOI":"10.1016\/j.jacc.2020.11.010","article-title":"Global burden of cardiovascular diseases and risk factors, 1990\u20132019","volume":"76","author":"Roth","year":"2020","journal-title":"J Am Coll Cardiol"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"e202","DOI":"10.1016\/S2468-2667(22)00027-5","article-title":"Reducing the incidence and mortality from myocardial infarction","volume":"7","author":"Reed","year":"2022","journal-title":"Lancet Public Health"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"1486","DOI":"10.1001\/jamaneurol.2020.3362","article-title":"Trends in reperfusion therapy for in-hospital ischemic stroke in the endovascular therapy era","volume":"77","author":"Akbik","year":"2020","journal-title":"JAMA Neurol"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"156","DOI":"10.22159\/ajpcr.2016.v9s3.13735","article-title":"Prospective observational study on myocardial infarction in relationship with various risk factors","volume":"9","author":"Baby","year":"2016","journal-title":"Asian J Pharm Clin Res"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"e035936","DOI":"10.1161\/JAHA.124.035936","article-title":"Systematic evaluation of the impact of a wide range of dietary habits on myocardial infarction: a two-sample Mendelian randomization analysis","volume":"14","author":"Yang","year":"2025","journal-title":"J Am Heart Assoc"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"2618","DOI":"10.1001\/archinte.165.22.2618","article-title":"Trust and sources of health information: the impact of the internet and its implications for health care providers: findings from the first health information National Trends Survey","volume":"165","author":"Hesse","year":"2005","journal-title":"Arch Intern Med"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1016\/j.pec.2020.11.016","article-title":"The influence of online health information on health decisions: a systematic review","volume":"104","author":"Thapa","year":"2021","journal-title":"Patient Educ Couns"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"e2336483","DOI":"10.1001\/jamanetworkopen.2023.36483","article-title":"Accuracy and reliability of chatbot responses to physician questions","volume":"6","author":"Goodman","year":"2023","journal-title":"JAMA Netw Open"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"e69955","DOI":"10.2196\/69955","article-title":"Enhancing the readability of online patient education materials using large language models: cross-sectional study","volume":"27","author":"Will","year":"2025","journal-title":"J Med Internet Res"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1001\/jama.2023.25057","article-title":"Three epochs of artificial intelligence in health care","volume":"331","author":"Howell","year":"2024","journal-title":"JAMA"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"e237334","DOI":"10.6004\/jnccn.2023.7334","article-title":"Enhancing readability of online patient-facing content: the role of AI Chatbots in improving Cancer information accessibility","volume":"22","author":"Abreu","year":"2024","journal-title":"J Natl Compr Cancer Netw"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"e17267","DOI":"10.1111\/codi.17267","article-title":"ChatGPT as a patient education tool in colorectal cancer-an in-depth assessment of efficacy, quality and readability","volume":"27","author":"Siu","year":"2025","journal-title":"Color Dis"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"e60291","DOI":"10.2196\/60291","article-title":"Accuracy of prospective assessments of 4 large language model Chatbot responses to patient questions about emergency care: experimental comparative study","volume":"26","author":"Yau","year":"2024","journal-title":"J Med Internet Res"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"e81422","DOI":"10.2196\/81422","article-title":"Large language models in patient health communication for atherosclerotic cardiovascular disease: pilot cross-sectional comparative analysis","volume":"14","author":"Li","year":"2026","journal-title":"JMIR Med Inform"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"1801829","DOI":"10.3389\/fpubh.2026.1801829","article-title":"Challenges of using generative AI for patient education in chronic heart failure: an evaluation of content quality, readability, and actionability in cross-platform LLM-generated texts","volume":"14","author":"Wang","year":"2026","journal-title":"Front Public Health"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/s40119-023-00347-0","article-title":"Can artificial intelligence improve the readability of patient education materials on aortic stenosis? A pilot study","volume":"13","author":"Rouhi","year":"2024","journal-title":"Cardiol Ther"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"20552076251393385","DOI":"10.1177\/20552076251393385","article-title":"A comparative study on the application of large language models: Deepseek-R1, GPT-4o, and Claude-Sonnet-4 in post-cardiac surgery rehabilitation-a cross-sectional study","volume":"11","author":"Li","year":"2025","journal-title":"Digit Health"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"e63865","DOI":"10.7759\/cureus.63865","article-title":"Assessing the readability of patient education materials on cardiac catheterization from artificial intelligence Chatbots: an observational cross-sectional study","volume":"16","author":"Behers","year":"2024","journal-title":"Cureus"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"e13439","DOI":"10.2196\/13439","article-title":"Google trends in Infodemiology and Infoveillance: methodology framework","volume":"5","author":"Mavragani","year":"2019","journal-title":"JMIR Public Health Surveill"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"e618","DOI":"10.1161\/CIR.0000000000000617","article-title":"Fourth universal definition of myocardial infarction (2018)","volume":"138","author":"Thygesen","year":"2018","journal-title":"Circulation"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"e771","DOI":"10.1161\/CIR.0000000000001309","article-title":"2025 ACC\/AHA\/ACEP\/NAEMSP\/SCAI guideline for the Management of Patients with Acute Coronary Syndromes: a report of the American College of Cardiology\/American Heart Association joint committee on clinical practice guidelines","volume":"151","author":"Rao","year":"2025","journal-title":"Circulation"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"3720","DOI":"10.1093\/eurheartj\/ehad191","article-title":"2023 ESC guidelines for the management of acute coronary syndromes","volume":"44","author":"Byrne","year":"2023","journal-title":"Eur Heart J"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"DISCERN: an instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"Charnock","year":"1999","journal-title":"J Epidemiol Community Health"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/s0738-3991(01)00225-7","article-title":"Evaluating the reliability of DISCERN: a tool for assessing the quality of written patient information on treatment choices","volume":"47","author":"Rees","year":"2002","journal-title":"Patient Educ Couns"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"e22618","DOI":"10.2196\/22618","article-title":"Using the ensuring quality information for patients tool to assess patient information on appendicitis websites: systematic search and evaluation","volume":"23","author":"Ghani","year":"2021","journal-title":"J Med Internet Res"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1111\/j.1369-7625.2004.00273.x","article-title":"Ensuring quality information for patients: development and preliminary validation of a new instrument to improve the quality of written health care information","volume":"7","author":"Moult","year":"2004","journal-title":"Health Expect"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"2070","DOI":"10.1111\/j.1572-0241.2007.01325.x","article-title":"A systematic review of patient inflammatory bowel disease information resources on the world wide web","volume":"102","author":"Bernard","year":"2007","journal-title":"Am J Gastroenterol"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"1244","DOI":"10.1001\/jama.1997.03540390074039","article-title":"Assessing, controlling, and assuring the quality of medical information on the internet: Caveant lector et viewor--let the reader and viewer beware","volume":"277","author":"Silberg","year":"1997","journal-title":"JAMA"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"100594","DOI":"10.1016\/j.ajpc.2023.100594","article-title":"Readability and reliability of online patient education materials about statins","volume":"16","author":"Ngo","year":"2023","journal-title":"Am J Prev Cardiol"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"1776697","DOI":"10.3389\/fpubh.2026.1776697","article-title":"The information challenge in public health crises: a study on the reliability and readability of information provided by large language model for thunderstorm asthma","volume":"14","author":"Zhu","year":"2026","journal-title":"Front Public Health"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.jdsr.2026.01.002","article-title":"The role of large language models in dental diagnosis, decision-making, and communication: a systematic review","volume":"62","author":"Kaplan","year":"2026","journal-title":"Jpn Dent Sci Rev"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"1760871","DOI":"10.3389\/fpubh.2026.1760871","article-title":"Evaluation of validity, reliability, and readability of AI chatbots for gestational diabetes mellitus: a multi-model comparative study","volume":"14","author":"Wang","year":"2026","journal-title":"Front Public Health"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"299","DOI":"10.3390\/info17030299","article-title":"Fluency illusion: a review on influence of ChatGPT in classroom settings","volume":"17","author":"Kumar","year":"2026","journal-title":"Information"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1186\/s13104-017-2524-x","article-title":"Designing persuasive health materials using processing fluency: a literature review","volume":"10","author":"Okuhara","year":"2017","journal-title":"BMC Res Notes"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"e48","DOI":"10.1161\/CIR.0000000000000579","article-title":"Health literacy and cardiovascular disease: fundamental relevance to primary and secondary prevention: a scientific statement from the American Heart Association","volume":"138","author":"Magnani","year":"2018","journal-title":"Circulation"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"457","DOI":"10.2147\/vhrm.2006.2.4.457","article-title":"The impact of health literacy on cardiovascular disease","volume":"2","author":"Safeer","year":"2006","journal-title":"Vasc Health Risk Manag"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"518","DOI":"10.1186\/s12913-023-09364-0","article-title":"Estimation of health literacy levels in patients with cardiovascular diseases in a gulf country","volume":"23","author":"Nair","year":"2023","journal-title":"BMC Health Serv Res"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"e74","DOI":"10.3928\/24748307-20190306-03","article-title":"A readability analysis of online cardiovascular disease-related health education materials","volume":"3","author":"Ayyaswami","year":"2019","journal-title":"Health Lit Res Pract"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"100308","DOI":"10.1016\/j.ahjo.2023.100308","article-title":"Assessing readability and comprehension of web-based patient education materials by American Heart Association (AHA) and CardioSmart online platform by American College of Cardiology (ACC): how useful are these websites for patient understanding?","volume":"32","author":"Wasir","year":"2023","journal-title":"Am Heart J Plus"},{"key":"ref42","doi-asserted-by":"publisher","first-page":"15589447251415391","DOI":"10.1177\/15589447251415391","article-title":"Readability, accuracy, and lexical diversity of new ChatGPT models for common carpal tunnel syndrome questions","author":"Parmar","year":"2026","journal-title":"Hand"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"e70047","DOI":"10.2196\/70047","article-title":"Evaluating large language models for preoperative patient education in superior capsular reconstruction: comparative study of Claude, GPT, and Gemini","volume":"8","author":"Liu","year":"2025","journal-title":"JMIR Perioper Med"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"1768843","DOI":"10.3389\/fdgth.2026.1768843","article-title":"ChatGPT for diabetes education: potential, accuracy, and accessibility in patient support","volume":"8","author":"Abuzar","year":"2026","journal-title":"Front Digit Health"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"1698596","DOI":"10.3389\/fpubh.2025.1698596","article-title":"Evaluation of accuracy, quality, and readability of information on hypothyroidism provided by different artificial intelligence chatbot models","volume":"13","author":"Ruan","year":"2025","journal-title":"Front Public Health"}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1914167\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T05:31:06Z","timestamp":1789018266000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1914167\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,10]]},"references-count":45,"alternative-id":["10.3389\/fpubh.2026.1914167"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1914167","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,10]]},"article-number":"1914167"}}