{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T06:31:21Z","timestamp":1787725881029,"version":"build-2784847793"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T00:00:00Z","timestamp":1787702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"\n Background<\/jats:title>\n The global burden of sexually transmitted infections (STIs) continues to rise, yet stigma drives many to seek sensitive health information from artificial intelligence chatbots. The quality, safety, readability, and destigmatization of large language model (LLM) responses on sexual health remain under-evaluated, particularly for non-Western models.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This cross-sectional study constructed 30 standardized English queries (5 themes \u00d7 6 questions) informed by Google Trends, Centers for Disease Control and Prevention (CDC) guidelines, and patient education platforms, and submitted them to three LLMs\u2014GPT-5.4, DeepSeek-V4-Pro, and Kimi K2.6\u2014via official APIs, in duplicate (180 responses). Two dermatovenereologists (&gt;10 years' experience) rated the responses while blinded to platform identity, across six dimensions (accuracy, completeness, safety, understandability, actionability, and destigmatization) using a five-point scale, supplemented by four readability metrics (FKGL, FRE, GFI, and SMOG). Primary analysis used linear mixed-effects models retaining all individual ratings; the original aggregated non-parametric pipeline was retained as a sensitivity analysis. Reliability used ICC and quadratic-weighted Cohen's \u03ba with 95% CIs; correlations used query-level cluster bootstrap with false-discovery-rate control.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Inter-platform differences were significant for accuracy (\u03c7\n 2<\/jats:sup>\n (2) = 19.12, Holm-adjusted\n P<\/jats:italic>\n &lt; 0.001), understandability (\u03c7\n 2<\/jats:sup>\n (2) = 13.54,\n P<\/jats:italic>\n = 0.006), and destigmatization (\u03c7\n 2<\/jats:sup>\n (2) = 9.16,\n P<\/jats:italic>\n = 0.041). GPT-5.4 and Kimi K2.6 achieved the highest accuracy (both median 5.00), both significantly above DeepSeek-V4-Pro and not significantly different from each other. DeepSeek-V4-Pro and Kimi K2.6 both used significantly more destigmatizing language than GPT-5.4, with no significant difference between them. GPT-5.4 produced the least readable text on all four metrics (all adjusted\n P<\/jats:italic>\n &lt; 0.01). Inter-rater reliability was good to excellent (ICC(2, 1) = 0.79\u20130.95; quadratic-weighted \u03ba = 0.79\u20130.95).\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The three LLMs showed distinct profiles: GPT-5.4 and Kimi K2.6 achieved the highest accuracy, whereas GPT-5.4 produced the least readable outputs; DeepSeek-V4-Pro and Kimi K2.6 used more destigmatizing language. To our knowledge, this is the first study to quantify destigmatizing language as an explicit evaluation dimension for LLM-generated STI content, albeit as an exploratory measure pending formal content validation. Findings are specific to these models and queries and can inform quality standards and monitoring for safer AI-powered sexual health communication.<\/jats:p>\n <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1940111","type":"journal-article","created":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T06:03:33Z","timestamp":1787724213000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Toward safer digital sexual health communication: evaluating the public health reliability of large language model responses on sexually transmitted infections"],"prefix":"10.3389","volume":"14","author":[{"given":"Shucheng","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Dermatology, The First Affiliated Hospital of Shandong First Medical University","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuo","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Urology, The First Affiliated Hospital of Shandong First Medical University","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoyue","family":"Sun","sequence":"additional","affiliation":[{"name":"Department of Dermatology, The First Affiliated Hospital of Shandong First Medical University","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhuqing","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Dermatology, The First Affiliated Hospital of Shandong First Medical University","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Dermatology, The First Affiliated Hospital of Shandong First Medical University","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiale","family":"Geng","sequence":"additional","affiliation":[{"name":"Department of Dermatology, The First Affiliated Hospital of Shandong First Medical University","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoqing","family":"Si","sequence":"additional","affiliation":[{"name":"Department of Dermatology, The First Affiliated Hospital of Shandong First Medical University","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1016\/S1473-3099(21)00448-5","article-title":"Global burden and trends of sexually transmitted infections from 1990 to 2019: an observational trend study","volume":"22","author":"Zheng","year":"2022","journal-title":"Lancet Infect Dis."},{"key":"B2","doi-asserted-by":"publisher","first-page":"e1544","DOI":"10.1016\/S2214-109X(24)00266-3","article-title":"WHO global research priorities for sexually transmitted infections","volume":"12","author":"Gottlieb","year":"2024","journal-title":"Lancet Glob Health."},{"key":"B3","doi-asserted-by":"publisher","first-page":"e46761","DOI":"10.2196\/46761","article-title":"Chatbots to improve sexual and reproductive health: realist synthesis","volume":"25","author":"Mills","year":"2023","journal-title":"J Med Internet Res."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1788","DOI":"10.1186\/s12889-025-22933-8","article-title":"Evaluation of artificial intelligence (AI) chatbots for providing sexual health information: a consensus study using real-world clinical queries","volume":"25","author":"Latt","year":"2025","journal-title":"BMC Public Health."},{"key":"B5","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1071\/SH22016","article-title":"Effectiveness and acceptability of conversational agents for sexual health promotion: a systematic review and meta-analysis","volume":"19","author":"Balaji","year":"2022","journal-title":"Sex Health."},{"key":"B6","doi-asserted-by":"publisher","first-page":"2269008","DOI":"10.1080\/26410397.2023.2269008","article-title":"Assessing acceptability and effectiveness of a pleasure-oriented sexual and reproductive health chatbot in Kenya: an exploratory mixed-methods study","volume":"31","author":"Njogu","year":"2023","journal-title":"Sex Reprod Health Matters."},{"key":"B7","doi-asserted-by":"publisher","first-page":"20552076241308994","DOI":"10.1177\/20552076241308994","article-title":"Feasibility of using an artificially intelligent chatbot to increase access to information and sexual and reproductive health services","volume":"10","author":"Bull","year":"2024","journal-title":"Digit Health."},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1080\/09540121.2026.2675454","article-title":"From stigma to comfort: examining stress and disclosure pathways in gay men's interactions with AI chatbots","author":"Mazhar","year":"2026","journal-title":"AIDS Care"},{"key":"B9","doi-asserted-by":"publisher","first-page":"5","DOI":"10.5817\/CP2026-1-5","article-title":"Decoding user disclosure intentions in generative AI: exploring the influence of system attributes on trust and privacy concerns within the extended technology acceptance model","volume":"20","author":"Niu","year":"2026","journal-title":"Cyberpsychol J Psychosoc Res Cyberspace"},{"key":"B10","doi-asserted-by":"publisher","first-page":"e47479","DOI":"10.2196\/47479","article-title":"Reliability of medical information provided by ChatGPT: assessment against clinical guidelines and patient information quality instrument","volume":"25","author":"Walker","year":"2023","journal-title":"J Med Internet Res."},{"key":"B11","doi-asserted-by":"publisher","first-page":"106164","DOI":"10.1016\/j.ijmedinf.2025.106164","article-title":"Comparative evaluation of ChatGPT and Gemini in brain-computer interfaces patient education: a multi-dimensional analysis of reliability, accuracy, comprehensibility, and readability","volume":"206","author":"Liu","year":"2026","journal-title":"Int J Med Inf."},{"key":"B12","doi-asserted-by":"publisher","first-page":"e70130","DOI":"10.1002\/clt2.70130","article-title":"Evaluation of the quality and reliability of ChatGPT4\u2032s responses on allergen immunotherapy using validated instruments for health information quality assessment","volume":"15","author":"Cherrez-Ojeda","year":"2025","journal-title":"Clin Transl Allergy."},{"key":"B13","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1177\/1062860617751639","article-title":"Readability of online health information: a meta-narrative systematic review","volume":"33","author":"Daraz","year":"2018","journal-title":"Am J Med Qual."},{"key":"B14","doi-asserted-by":"publisher","first-page":"469","DOI":"10.4103\/ijd.IJD_145_18","article-title":"Stigma associated with sexually transmitted infections among patients attending Suraksha clinic at a tertiary care hospital in Northern India","volume":"63","author":"Suvirya","year":"2018","journal-title":"Indian J Dermatol."},{"key":"B15","doi-asserted-by":"publisher","first-page":"104606","DOI":"10.1016\/j.ijnurstu.2023.104606","article-title":"The effectiveness of e-health on reducing stigma, improving social support and quality of life among people living with HIV: a systematic review and meta-analysis of randomized controlled trials","volume":"148","author":"Zhang","year":"2023","journal-title":"Int J Nurs Stud."},{"key":"B16","doi-asserted-by":"publisher","first-page":"1453","DOI":"10.1016\/S0140-6736(07)61602-X","article-title":"The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies","volume":"370","author":"von Elm","year":"2007","journal-title":"Lancet"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.15585\/mmwr.rr7004a1","article-title":"Sexually transmitted infections treatment guidelines, 2021","volume":"70","author":"Workowski","year":"2021","journal-title":"MMWR Recomm Rep"},{"key":"B18","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1016\/j.pec.2014.05.027","article-title":"Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information","volume":"96","author":"Shoemaker","year":"2014","journal-title":"Patient Educ Couns."},{"key":"B19","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"DISCERN: an instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"Charnock","year":"1999","journal-title":"J Epidemiol Community Health."},{"key":"B20","doi-asserted-by":"publisher","first-page":"1698596","DOI":"10.3389\/fpubh.2025.1698596","article-title":"Evaluation of accuracy, quality, and readability of information on hypothyroidism provided by different artificial intelligence chatbot models","volume":"13","author":"Ruan","year":"2025","journal-title":"Front Public Health."},{"key":"B21","doi-asserted-by":"publisher","first-page":"1776697","DOI":"10.3389\/fpubh.2026.1776697","article-title":"The information challenge in public health crises: a study on the reliability and readability of information provided by large language model for thunderstorm asthma","volume":"14","author":"Zhu","year":"2026","journal-title":"Front Public Health."},{"key":"B22","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1037\/\/0033-2909.86.2.420","article-title":"Intraclass correlations: uses in assessing rater reliability","volume":"86","author":"Shrout","year":"1979","journal-title":"Psychol Bull."},{"key":"B23","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"J Chiropr Med."},{"key":"B24","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ Psychol Meas."},{"key":"B25","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics."},{"key":"B26","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J R Stat Soc Series B Stat Methodol."},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1075\/is.25116.maz","article-title":"Anthropomorphism, dependency, and trust in Generative Artificial Intelligence: exploring the trust-privacy paradox through dual-theory integration","author":"Mazhar","year":"2026","journal-title":"Interact Stud Soc Behav Commun Biol Artif Syst"},{"key":"B28","doi-asserted-by":"publisher","first-page":"103072","DOI":"10.1016\/j.ijinfomgt.2026.103072","article-title":"Generative artificial intelligence as social actors: the mediating roles of empathy and autonomy in anthropomorphism-driven dependency","volume":"89","author":"Mazhar","year":"2026","journal-title":"Int J Inf Manag."},{"key":"B29","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1038\/s41443-023-00682-9","article-title":"Evaluating the readability of online testosterone search results","volume":"36","author":"Pominville","year":"2024","journal-title":"Int J Impot Res."}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1940111\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T06:03:34Z","timestamp":1787724214000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1940111\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,26]]},"references-count":29,"alternative-id":["10.3389\/fpubh.2026.1940111"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1940111","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,26]]},"article-number":"1940111"}}