{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,30]],"date-time":"2026-10-30T17:56:30Z","timestamp":1793382990974,"version":"4.5.0"},"reference-count":33,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T00:00:00Z","timestamp":1785456000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Online video platforms such as YouTube and Bilibili have become important sources of health information for the public. However, the quality and reliability of online health education videos vary substantially. Artificial intelligence (AI), particularly large language models (LLMs), has recently shown potential for automated evaluation of health information, yet evidence regarding the agreement between AI-based and expert evaluations remains limited.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A cross-sectional study was conducted to analyze asthma-related health education videos retrieved from YouTube and Bilibili. Two medical experts independently evaluated video quality using the Global Quality Scale (GQS) and modified DISCERN (mDISCERN). AI-assisted evaluation was performed using the GPT-4 large language model based on video transcripts under standardized prompts. Interrater agreement between experts was assessed using intraclass correlation coefficients (ICCs) and Spearman correlations. Agreement between AI and expert ratings was evaluated using Spearman correlation and Bland\u2013Altman analysis. Multivariable linear regression was performed to identify factors associated with differences between AI and expert scores.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      A total of 200 asthma-related health education videos were included, with 100 videos from each platform. AI ratings showed moderate correlations with expert ratings for both GQS (\n                      <jats:italic>\u03c1<\/jats:italic>\n                      \u202f=\u202f0.55,\n                      <jats:italic>p<\/jats:italic>\n                      \u202f&amp;lt;\u202f0.001) and mDISCERN (\n                      <jats:italic>\u03c1<\/jats:italic>\n                      \u202f=\u202f0.49,\n                      <jats:italic>p<\/jats:italic>\n                      \u202f&amp;lt;\u202f0.001). AI scores were slightly higher than expert scores, with mean differences of 0.24 for GQS and 0.60 for mDISCERN. Multivariable regression analysis identified platform (YouTube), source type (organizational source), and PEMAT actionability as significant factors associated with differences in mDISCERN scores, whereas no significant predictors were identified for GQS score differences.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>AI-generated evaluations demonstrated moderate positive correlations with expert assessments in evaluating the quality of asthma-related health education videos. AI may serve as a scalable tool for preliminary screening of online health information, although systematic differences remain across platforms and content characteristics. Expert evaluation remains essential to ensure the accuracy and reliability of medical information assessment.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1853895","type":"journal-article","created":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T05:39:02Z","timestamp":1785476342000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Agreement between artificial intelligence and expert evaluation in assessing the quality of asthma health education videos on YouTube and Bilibili: cross-sectional study"],"prefix":"10.3389","volume":"14","author":[{"given":"Kejun","family":"Li","sequence":"first","affiliation":[{"name":"Department of Pulmonary and Critical Care Medicine, The Second Affiliated Hospital and Yuying Children\u2019s Hospital of Wenzhou Medical University","place":["Wenzhou, Zhejiang, China"]},{"name":"The Second Clinical Medical College, Wenzhou Medical University","place":["Wenzhou, Zhejiang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Beilin","family":"Fu","sequence":"additional","affiliation":[{"name":"Department of Pulmonary and Critical Care Medicine, The Second Affiliated Hospital and Yuying Children\u2019s Hospital of Wenzhou Medical University","place":["Wenzhou, Zhejiang, China"]},{"name":"The Second Clinical Medical College, Wenzhou Medical University","place":["Wenzhou, Zhejiang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yinuo","family":"Chen","sequence":"additional","affiliation":[{"name":"The Second Clinical Medical College, Wenzhou Medical University","place":["Wenzhou, Zhejiang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziteng","family":"Zhu","sequence":"additional","affiliation":[{"name":"The Second Clinical Medical College, Wenzhou Medical University","place":["Wenzhou, Zhejiang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daohui","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Pulmonary and Critical Care Medicine, The Second Affiliated Hospital and Yuying Children\u2019s Hospital of Wenzhou Medical University","place":["Wenzhou, Zhejiang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangting","family":"Ge","sequence":"additional","affiliation":[{"name":"Department of Pulmonary and Critical Care Medicine, The Second Affiliated Hospital and Yuying Children\u2019s Hospital of Wenzhou Medical University","place":["Wenzhou, Zhejiang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,7,31]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"S2","DOI":"10.1002\/ALR.21609","article-title":"Asthma: definitions and pathophysiology","volume":"5","author":"Mims","year":"2015","journal-title":"Int Forum Allergy Rhinol"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/J.PRRV.2019.08.002","article-title":"Understanding the immunology of asthma: pathophysiology, biomarkers, and treatments for asthma endotypes","volume":"36","author":"Gans","year":"2020","journal-title":"Paediatr Respir Rev"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"15025","DOI":"10.1038\/NRDP.2015.25","article-title":"Asthma","volume":"1","author":"Holgate","year":"2015","journal-title":"Nat Rev Dis Primers"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"Itc81","DOI":"10.7326\/ANNALS-25-01034","article-title":"Care of the patient with asthma","volume":"178","author":"Althoff","year":"2025","journal-title":"Ann Intern Med"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1183\/09031936.00138707","article-title":"Global strategy for asthma management and prevention: GINA executive summary","volume":"31","author":"Bateman","year":"2008","journal-title":"Eur Respir J"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1016\/0091-6749(91)90374-W","article-title":"Rehabilitation of a patient with asthma in the outpatient setting","volume":"87","author":"Strunk","year":"1991","journal-title":"J Allergy Clin Immunol"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"1483","DOI":"10.1111\/IMJ.70135","article-title":"Effect of adherence on asthma control: more patient knowledge, more adherence, more control","volume":"55","author":"Celebi Sozener","year":"2025","journal-title":"Intern Med J"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1186\/S40359-023-01097-3","article-title":"Effect of illness perceptions on asthma control and quality of life amongst adult outpatients with asthma in China","volume":"11","author":"Cai","year":"2023","journal-title":"BMC Psychol"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"1516062","DOI":"10.3389\/FPHAR.2025.1516062","article-title":"Assessing medication adherence in adults with asthma and its effect on rescue therapy for exacerbations","volume":"16","author":"Koh","year":"2025","journal-title":"Front Pharmacol"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"14856","DOI":"10.1038\/S41598-025-98364-7","article-title":"Assessing the content and quality of GI bleeding information on Bilibili, TikTok, and YouTube: a cross-sectional study","volume":"15","author":"Wang","year":"2025","journal-title":"Sci Rep"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"21671","DOI":"10.1038\/S41598-025-02898-9","article-title":"YouTube and Bilibili as sources of information on oral cancer: cross-sectional content analysis study","volume":"15","author":"Zhang","year":"2025","journal-title":"Sci Rep"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"e48508","DOI":"10.2196\/48508","article-title":"Examining the persuasive effects of health communication in short videos: systematic review","volume":"25","author":"Zhu","year":"2023","journal-title":"J Med Internet Res"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"1468","DOI":"10.6004\/JNCCN.2020.7591","article-title":"General and health-related internet use among Cancer survivors in the United States: a 2013-2018 cross-sectional analysis","volume":"18","author":"Dee","year":"2020","journal-title":"J Natl Compr Cancer Netw"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"e56080","DOI":"10.2196\/56080","article-title":"Promoting health literacy with human-in-the-loop video understandability classification of YouTube videos: development and evaluation study","volume":"27","author":"Liu","year":"2025","journal-title":"J Med Internet Res"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"e55403","DOI":"10.2196\/55403","article-title":"Quality assessment of TikTok as a source of information about mitral valve regurgitation in China: cross-sectional study","volume":"26","author":"Cui","year":"2024","journal-title":"J Med Internet Res"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"e51513","DOI":"10.2196\/51513","article-title":"The quality of short videos as a source of coronary heart disease information on TikTok: cross-sectional study","volume":"8","author":"Gong","year":"2024","journal-title":"JMIR Form Res"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"101677","DOI":"10.1016\/J.SSMPH.2024.101677","article-title":"AI-enhanced evaluation of YouTube content on post-surgical incontinence following pelvic cancer treatment","volume":"26","author":"Rodriguez-Rodriguez","year":"2024","journal-title":"SSM Popul Health"},{"key":"ref18","first-page":"7793","author":"Kou","year":"2024"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"e70164","DOI":"10.1111\/NMO.70164","article-title":"Evaluating the quality of health information: comparison of human and artificial intelligence","volume":"38","author":"Arcot","year":"2025","journal-title":"Neurogastroenterol Motil"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"145","DOI":"10.3969\/j.issn.1672-9455.2025.02.001","article-title":"Chinese expert consensus on the framework of life-cycle active health popular science","volume":"22","author":"Luo","year":"2025","journal-title":"Lab Med Clin"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"e121","DOI":"10.2500\/AAP.2015.36.3890","article-title":"Popular on YouTube: a critical appraisal of the educational quality of information regarding asthma","volume":"36","author":"Gonzalez-Estrada","year":"2015","journal-title":"Allergy Asthma Proc"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/J.JCM.2016.02.012","article-title":"A guideline of selecting and reporting Intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"J Chiropr Med"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"1783552","DOI":"10.3389\/FPUBH.2026.1783552","article-title":"A cross-cultural comparison of educational video quality on college students' anxiety and depression: a cross-sectional content analysis of YouTube and Bilibili","volume":"14","author":"Xu","year":"2026","journal-title":"Front Public Health"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"4070","DOI":"10.1038\/S41598-025-34182-1","article-title":"A cross-sectional analysis of the quality and characteristics of sleep apnea hypopnea syndrome videos on YouTube, Bilibili, and TikTok","volume":"16","author":"Qiu","year":"2026","journal-title":"Sci Rep"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"e66416","DOI":"10.2196\/66416","article-title":"Assessing the reliability and validity of principles for health-related information on social media (PRHISM) for evaluating breast Cancer treatment videos on YouTube: instrument validation study","volume":"5","author":"Kusama","year":"2025","journal-title":"JMIR Infodemiol"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"9906","DOI":"10.1038\/S41598-025-94208-6","article-title":"Evaluating the quality of medical content on YouTube using large language models","volume":"15","author":"Khalil","year":"2025","journal-title":"Sci Rep"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1186\/S12889-026-28015-7","article-title":"Public health implications of allergic rhinitis information on YouTube and Bilibili: a cross-cultural analysis of content quality, engagement, and seasonal trends","author":"Lian","year":"2026","journal-title":"BMC Public Health"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1056\/NEJMP2602837","article-title":"Supporting access to reliable health information with public\u2013private collaboration","volume":"395","author":"Dzau","year":"2026","journal-title":"N Engl J Med"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.31478\/202305B","article-title":"Identifying credible sources of health information in social media: phase 2-considerations for non-accredited nonprofit organizations, for-profit entities, and individual sources","volume":"2023","author":"Burstin","year":"2023","journal-title":"NAM Perspect"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"1640105","DOI":"10.3389\/FPUBH.2025.1640105","article-title":"Quality assessment of short videos on health science popularization in China: scale development and validation","volume":"13","author":"Xuan","year":"2025","journal-title":"Front Public Health"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"14444","DOI":"10.1038\/S41598-025-99371-4","article-title":"Evaluation of the quality and reliability of Turkish and English YouTube video contents on gingival recession treatment","volume":"15","author":"Yelbay","year":"2025","journal-title":"Sci Rep"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"20552076251346579","DOI":"10.1177\/20552076251346579","article-title":"Assessment of health information in Chinese atopic dermatitis-related videos: a cross-sectional study","volume":"11","author":"Yang","year":"2025","journal-title":"Digit Health"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-026-39444-0","article-title":"Benchmark evaluation of video large language models in quality assessment of science popularization videos for dry eye","author":"Zhou","year":"2026","journal-title":"Sci Rep"}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1853895\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T05:39:03Z","timestamp":1785476343000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1853895\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,31]]},"references-count":33,"alternative-id":["10.3389\/fpubh.2026.1853895"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1853895","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,31]]},"article-number":"1853895"}}