{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T03:47:55Z","timestamp":1791258475968,"version":"4.1.0"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T00:00:00Z","timestamp":1771804800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Large language models (LLMs), a core technology of generative artificial intelligence (AI), are increasingly used in health education and promotion. Although they may expand access to medical information, concerns remain regarding the reliability and readability of AI generated content for the public. This study evaluated the reliability and readability of answers generated by five LLMs to common questions about perinatal depression. The primary aims were to determine (1) the reliability of LLM responses to frequently asked questions about perinatal depression and (2) whether the readability of the generated content aligns with public health literacy levels.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Twenty-seven frequently asked questions were derived from Google Trends and patient facing resources from the American College of Obstetricians and Gynecologists (ACOG). Each question was submitted to ChatGPT-5, Gemini-2.5, Microsoft Copilot, Grok4, and DeepSeek. Two obstetricians independently rated responses using five validated instruments (DISCERN, EQIP, JAMA, GQS, and HONCODE) and inter-rater agreement was quantified using the interclass correlation coefficient (ICC). Readability was assessed using six indices: ARI, GFI, CLI, OLWF, LWGLF, and FRF. Differences among models were analyzed using the Friedman test.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Inter rater agreement was high across 27 perinatal depression questions. ICC values ranged from 0.729 to 0.847. Significant between model differences emerged for DISCERN, EQIP, and HONCODE. All had\n                      <jats:italic>p<\/jats:italic>\n                      less than 0.001. No overall differences were found for JAMA and GQS. Grok4 scored highest on DISCERN at 60.33\u202f\u00b1\u202f5.48. DeepSeek scored highest on EQIP at 53.04\u202f\u00b1\u202f4.91. Copilot scored highest on HONCODE at 9.26\u202f\u00b1\u202f1.85. These results highlight distinct strengths in quality constructs across instruments. Readability posed a common limitation. All models exceeded the NIH recommended sixth grade level on grade-based indices (for example, ARI ranged from 13.49\u202f\u00b1\u202f2.92 to 15.81\u202f\u00b1\u202f3.25). Similarly, OLWF scores fell well below the sixth-grade benchmark of 94 (ranging from 61.44\u202f\u00b1\u202f6.80 to 72.96\u202f\u00b1\u202f10.39, where higher scores denote easier reading). Most models produced empathetic and informative content. However, they fell short in fully addressing clinical safety standards.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Most LLMs demonstrated moderate to high reliability when responding to perinatal depression questions, supporting their potential as supplementary sources of health information. However, readability levels above recommended benchmarks suggest that current outputs may remain challenging for individuals with lower health literacy. While LLMs improve information accessibility, further improvements in readability, source attribution, and ethical transparency are needed to maximize public benefit and support equitable health communication. Future work should focus on defining and standardizing safety behaviors in high-risk mental health contexts to enable reliable clinical deployment.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1760872","type":"journal-article","created":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T06:37:16Z","timestamp":1771828636000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Can large language models be trusted? Reliability and readability of responses to perinatal depression FAQs"],"prefix":"10.3389","volume":"14","author":[{"given":"Jingyu","family":"Huang","sequence":"first","affiliation":[{"name":"Faculty of Health Sciences, University of Macau","place":["Taipa, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hua","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Obstetrics, Ruikang Hospital, Guangxi University of Chinese Medicine","place":["Nanning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junjian","family":"Chen","sequence":"additional","affiliation":[{"name":"Second Affiliated Hospital of Guangxi Medical University","place":["Nanning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyue","family":"Wang","sequence":"additional","affiliation":[{"name":"GuangXi University of Chinese Medicine","place":["Nanning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lizhi","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Medical Informatics, Harbin Medical University","place":["Harbin, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junjie","family":"Wen","sequence":"additional","affiliation":[{"name":"Southwest Jiaotong University Hope College","place":["Chengdu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Nursing, Ruikang Hospital Affiliated to Guangxi University of Chinese Medicine","place":["Nanning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,2,23]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"667","DOI":"10.1016\/S0140-6736(23)01786-5","article-title":"Perinatal depression: a neglected aspect of maternal health","volume":"402","year":"2023","journal-title":"Lancet"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.bpobgyn.2013.09.002","article-title":"Perinatal mental illness: definition, description and aetiology","volume":"28","author":"O'Hara","year":"2014","journal-title":"Best Pract Res Clin Obstet Gynaecol"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"e2523978","DOI":"10.1001\/jamanetworkopen.2025.23978","article-title":"Perinatal maternal depressive symptoms and brain connectivity among 9-to 15-year-old offspring","volume":"8","author":"Koc","year":"2025","journal-title":"JAMA Netw Open"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"2777","DOI":"10.1136\/bmj.p2777","article-title":"Perinatal depression and its health impact","volume":"384","author":"Br\u00e4nn","year":"2024","journal-title":"BMJ"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1001\/jamapsychiatry.2023.0069","article-title":"Prevalence of perinatal depression in low-and middle-income countries: a systematic review and meta-analysis","volume":"80","author":"Mitchell","year":"2023","journal-title":"JAMA Psychiatr"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"2334","DOI":"10.3390\/jcm14072334","article-title":"Adolescent pregnancies and perinatal mental health: needs and complex support options: a literature review","volume":"14","author":"Lesinskien\u0117","year":"2025","journal-title":"J Clin Med"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"1714","DOI":"10.1001\/jama.2022.19097","article-title":"Associations of unintended pregnancy with maternal and infant health outcomes: a systematic review and meta-analysis","volume":"328","author":"Nelson","year":"2022","journal-title":"JAMA"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"1581","DOI":"10.1007\/s00127-022-02386-9","article-title":"Prevalence and correlates of perinatal depression","volume":"58","author":"Al-Abri","year":"2023","journal-title":"Soc Psychiatry Psychiatr Epidemiol"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1001\/jama.2022.24654","article-title":"Unintended pregnancy and maternal and infant health outcomes","volume":"329","author":"Luo","year":"2023","journal-title":"JAMA"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"1094","DOI":"10.1186\/s12889-024-18517-7","article-title":"Racial and ethnic disparities in access to community-based perinatal mental health programs: results from a cross-sectional survey","volume":"24","author":"Rokicki","year":"2024","journal-title":"BMC Public Health"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"e2533111","DOI":"10.1001\/jamanetworkopen.2025.33111","article-title":"Prevalence and trajectories of perinatal anxiety and depression in a large urban medical center","volume":"8","author":"Solomonov","year":"2025","journal-title":"JAMA Netw Open"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1007\/s40265-024-02038-z","article-title":"Postpartum depression: a clinical review of impact and current treatment solutions","volume":"84","author":"Dennis","year":"2024","journal-title":"Drugs"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1186\/s12884-022-04865-y","article-title":"Perinatal mental health literacy: knowledge, attitudes, and help-seeking among perinatal women and the public: a systematic review","volume":"22","author":"Daehn","year":"2022","journal-title":"BMC Pregnancy Childbirth"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"103389","DOI":"10.1016\/j.midw.2022.103389","article-title":"Women\u2019s experiences of perinatal depression: symptoms, barriers and enablers to disclosure, and effects on daily life and interaction within the family","volume":"112","author":"Pinar","year":"2022","journal-title":"Midwifery"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"1335437","DOI":"10.3389\/fgwh.2024.1335437","article-title":"Barriers to help-seeking for postpartum depression mapped onto the socio-ecological model and recommendations to address barriers","volume":"5","author":"Place","year":"2024","journal-title":"Front Glob Womens Health"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"e2426802","DOI":"10.1001\/jamanetworkopen.2024.26802","article-title":"Perinatal psychotherapy use and costs before and after federally mandated health insurance coverage","volume":"7","author":"Zivin","year":"2024","journal-title":"JAMA Netw Open"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.jad.2024.04.061","article-title":"Economic costs of perinatal depression and anxiety in a lower middle income country: Pakistan","volume":"357","author":"Bauer","year":"2024","journal-title":"J Affect Disord"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"1493300","DOI":"10.3389\/fpubh.2024.1493300","article-title":"Factors influencing spousal support for women with perinatal depression in seeking formal assistance: a qualitative study","volume":"12","author":"Zou","year":"2024","journal-title":"Front Public Health"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1002\/wps.20769","article-title":"Perinatal mental health: a review of progress and challenges","volume":"19","author":"Howard","year":"2020","journal-title":"World Psychiatry"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1093\/oodh\/oqae026","article-title":"Effectiveness of digital psychological interventions in reducing perinatal depression: a systematic review of meta-analyses","volume":"2","author":"Chen","year":"2023","journal-title":"Arch Womens Ment Health"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1001\/jama.2023.25057","article-title":"Three epochs of artificial intelligence in health care","volume":"331","author":"Howell","year":"2024","journal-title":"JAMA"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"20552076251362070","DOI":"10.1177\/20552076251362070","article-title":"Generative artificial intelligence in public health research and scientific communication: a narrative review of real applications and future directions","volume":"11","author":"Yoga Ratnam","year":"2025","journal-title":"Digit Health"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"e64486","DOI":"10.2196\/64486","article-title":"Accuracy of large language models when answering clinical research questions: systematic review and network meta-analysis","volume":"27","author":"Wang","year":"2025","journal-title":"J Med Internet Res"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"210","DOI":"10.7326\/M23-2772","article-title":"Large language models in medicine: the potentials and pitfalls: a narrative review","volume":"177","author":"Omiye","year":"2024","journal-title":"Ann Intern Med"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","article-title":"Large language models in medicine","volume":"29","author":"Thirunavukarasu","year":"2023","journal-title":"Nat Med"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1038\/s41746-020-00333-z","article-title":"A short guide for medical professionals in the era of artificial intelligence","volume":"3","author":"Mesk\u00f3","year":"2020","journal-title":"NPJ Digit Med"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"971044","DOI":"10.3389\/fpsyg.2022.971044","article-title":"Artificial intelligence technologies and compassion in healthcare: a systematic scoping review","volume":"13","author":"Morrow","year":"2023","journal-title":"Front Psychol"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"887","DOI":"10.3390\/healthcare11060887","article-title":"ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns","volume":"11","author":"Sallam","year":"2023","journal-title":"Healthcare"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"e49240","DOI":"10.2196\/49240","article-title":"Clinical accuracy of large language models and Google search responses to postpartum depression questions: cross-sectional study","volume":"25","author":"Sezgin","year":"2023","journal-title":"J Med Internet Res"},{"key":"ref30","volume-title":"Postpartum depression: FAQs","year":"2025"},{"key":"ref31","volume-title":"Depression during pregnancy: FAQsAmerican College of Obstetricians and Gynecologists","year":"2025"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/S0738-3991(01)00225-7","article-title":"Evaluating the reliability of DISCERN: a tool for assessing the quality of written patient information on treatment choices","volume":"47","author":"Rees","year":"2002","journal-title":"Patient Educ Couns"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1111\/j.1369-7625.2004.00273.x","article-title":"Ensuring quality information for patients: development and preliminary validation of a new instrument to improve the quality of written health care information","volume":"7","author":"Moult","year":"2004","journal-title":"Health Expect"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"e040487","DOI":"10.1136\/bmjopen-2020-040487","article-title":"COVID-19 prevention and treatment information on the internet: a systematic analysis and quality assessment","volume":"10","author":"Fan","year":"2020","journal-title":"BMJ Open"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"e22618","DOI":"10.2196\/22618","article-title":"Using the ensuring quality information for patients tool to assess patient information on appendicitis websites: systematic search and evaluation","volume":"23","author":"Ghani","year":"2021","journal-title":"J Med Internet Res"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1001\/jama.1997.03540390074039","article-title":"Assessing, controlling, and assuring the quality of medical information on the internet: caveant lector et viewor: let the reader and viewer beware","volume":"21","author":"Silberg","year":"1997","journal-title":"Generations"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1007\/BF03404969","article-title":"L'utilisation des technologies de l'information et des communications (TIC) en sant\u00e9 publique","volume":"92","author":"Benigeri","year":"2001","journal-title":"Can J Public Health"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"1023","DOI":"10.1097\/ICO.0000000000003034","article-title":"Assessing the quality, reliability, and readability of online information on dry eye disease","volume":"41","author":"Oydanich","year":"2022","journal-title":"Cornea"},{"key":"ref39","volume-title":"Clear and simple: developing effective print materials for low-literate readers","year":"2019"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/s10916-025-02178-z","article-title":"AI chatbots as sources of STD information: a study on reliability and readability","volume":"49","author":"Y\u0131ld\u0131z","year":"2025","journal-title":"J Med Syst"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"101043","DOI":"10.1016\/j.asmr.2024.101043","article-title":"Microsoft copilot provides more accurate and reliable information about anterior cruciate ligament injury and repair than ChatGPT and Google Gemini; however, no resource was overall the best","volume":"7","author":"Gupta","year":"2025","journal-title":"Arthrosc Sports Med Rehabil"},{"key":"ref42","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1007\/s11126-011-9179-x","article-title":"HON label and DISCERN as content quality indicators of health-related websites","volume":"83","author":"Khazaal","year":"2012","journal-title":"Psychiatry Q"},{"key":"ref43","year":"2011"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"e773","DOI":"10.1016\/S2589-7500(24)00197-3","article-title":"Combating medical misinformation and rebuilding trust in the USA","volume":"6","author":"Tandar","year":"2024","journal-title":"Lancet Digit Health"}],"updated-by":[{"DOI":"10.3389\/fpubh.2026.1822049","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T00:00:00Z","timestamp":1774310400000}}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1760872\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T14:23:38Z","timestamp":1774362218000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1760872\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,23]]},"references-count":44,"alternative-id":["10.3389\/fpubh.2026.1760872"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1760872","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,23]]},"article-number":"1760872"}}