{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T06:04:18Z","timestamp":1789452258651,"version":"build-2803163510"},"reference-count":21,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T00:00:00Z","timestamp":1789430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Immunol."],"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To determine whether observed mechanistic performance of web-enabled large language model (LLM) responses differs across response languages under deployed web conditions and to distinguish such language-associated shifts in relative model performance from stable between-model differences.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Twenty-four standardized questions spanning intestinal, airway, and urogenital mucosa and four levels of mechanistic complexity were posed to five web-enabled LLMs in English, Simplified Chinese, Traditional Chinese, and Japanese, yielding 480 responses. Twenty senior clinician-experts, assigned to language-specific panels and blinded to model identity, independently evaluated each response using a six-domain Mechanistic Fidelity Score (MFS; 0\u201324), with two ratings per response. Overall model effects were tested using block-adjusted regression with question-clustered inference. Because expert panels were nested within language, raw cross-language means were treated descriptively, whereas language-dependent relative performance was assessed after within-reviewer standardization. Each standardized value represents performance relative to an individual reviewer\u2019s own scoring distribution rather than an absolute cross-language MFS difference.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>All 480 responses received two ratings (960 evaluations). Inter-rater agreement was moderate-to-good (Krippendorff \u03b1=0.709; Lin CCC\u00a0=\u00a00.709). Overall model performance differed substantially (F(4,23)=95.80, P&amp;lt;.001). Kimi K3 (mean MFS 20.65) and ChatGPT 5.6 Sol (20.43) outperformed DeepSeek V4 Flash 0731, ChatGPT 5.6 Luna, and Xiaomi V2.5 Pro Ultra after Holm correction (all P&amp;lt;.001), while differing nonsignificantly from each other (P\u00a0= .182). Reviewer-standardized scores showed a strong model-by-language interaction in observed relative performance (F(12,191)=44.21, P&amp;lt;.001), whereas no statistically significant model-by-complexity interaction was detected in the present question set (P\u00a0= .328).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Mechanistic fidelity in the evaluated web-enabled systems was strongly model dependent, while observed relative performance varied across language panels. Because response language was not separable from panel composition and could also influence translation and web retrieval, these findings do not establish an intrinsic causal effect of language on underlying model reasoning. Multilingual biomedical evaluation should therefore test long-form mechanistic explanations directly in the language and deployment setting of intended use rather than infer equivalence from English performance alone.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fimmu.2026.1965554","type":"journal-article","created":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T05:33:32Z","timestamp":1789450412000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Language-dependent variation in observed mechanistic performance of web-enabled large language models across myeloid\u2013mucosal immune contexts: a blinded expert evaluation"],"prefix":"10.3389","volume":"17","author":[{"given":"Jinxi","family":"Hu","sequence":"first","affiliation":[{"name":"Department of Orthopedics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology","place":["Wuhan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tong","family":"Mei","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, The First Hospital of Hebei Medical University","place":["Shijiazhuang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, The First Hospital of Hebei Medical University","place":["Shijiazhuang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengyan","family":"Xia","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology","place":["Wuhan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tian","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology","place":["Wuhan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Penghui","family":"Xiang","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology","place":["Wuhan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenzhuo","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology","place":["Wuhan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Siqing","family":"Kong","sequence":"additional","affiliation":[{"name":"Department of Pharmacy, Shandong First Medical University","place":["Taian, Shandong, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Buorui","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Chinese Medicine, Hong Kong Baptist University","place":["Hong Kong, Hong Kong SAR, China"]},{"name":"Faculty of Applied Sciences, Macao Polytechnic University","place":["Macao, Macao SAR, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sen","family":"Cao","sequence":"additional","affiliation":[{"name":"Faculty of Applied Sciences, Macao Polytechnic University","place":["Macao, Macao SAR, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yutong","family":"Ge","sequence":"additional","affiliation":[{"name":"Faculty of Applied Sciences, Macao Polytechnic University","place":["Macao, Macao SAR, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaochen","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Minimally Invasive Oncology, The Third Affiliated Hospital of Shandong First Medical University","place":["Jinan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lujie","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Pharmacy, Panzhihua Central Hospital","place":["Panzhihua, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liangjing","family":"Xia","sequence":"additional","affiliation":[{"name":"College of Chinese Medicine, Hong Kong Baptist University","place":["Hong Kong, Hong Kong SAR, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongliang","family":"Duan","sequence":"additional","affiliation":[{"name":"Faculty of Applied Sciences, Macao Polytechnic University","place":["Macao, Macao SAR, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengla","family":"Yi","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology","place":["Wuhan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,15]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcmgh.2022.01.002","article-title":"Macrophage COX2 mediates efferocytosis, resolution reprogramming, and intestinal epithelial repair","volume":"13","author":"Meriwether","year":"2022","journal-title":"Cell Mol Gastroenterol Hepatol"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1016\/j.immuni.2022.05.014","article-title":"Small intestinal resident eosinophils maintain gut homeostasis following microbial colonization","volume":"55","author":"Ignacio","year":"2022","journal-title":"Immunity"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1084\/jem.20131800","article-title":"Indigenous enteric eosinophils control DCs to initiate a primary Th2 immune response in vivo","volume":"211","author":"Chu","year":"2014","journal-title":"J Exp Med"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1164\/rccm.201810-1869oc","article-title":"Extracellular DNA, neutrophil extracellular traps, and inflammasome activation in severe asthma","volume":"199","author":"Lachowicz-Scroggins","year":"2019","journal-title":"Am J Respir Crit Care Med"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1038\/s41564-023-01346-6","article-title":"Uropathogenic Escherichia coli infection-induced epithelial trained immunity impacts urinary tract disease outcome","volume":"8","author":"Russell","year":"2023","journal-title":"Nat Microbiol"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2312855121","article-title":"Tumor\u2013neutrophil cross talk orchestrates the tumor microenvironment to determine the bladder cancer progression","volume":"121","author":"Jing","year":"2024","journal-title":"Proc Natl Acad Sci"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1038\/s41416-023-02552-z","article-title":"Tumor-associated neutrophils suppress CD8+ T cell immunity in urothelial bladder carcinoma through the COX-2\/PGE2\/IDO1 Axis: Translational Therapeutics","volume":"130","author":"Ouyang","year":"2024","journal-title":"Br J Cancer"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1172\/jci34610","article-title":"Unique CD14+ intestinal macrophages contribute to the pathogenesis of Crohn disease via IL-23\/IFN-\u03b3 axis","volume":"118","author":"Kamada","year":"2008","journal-title":"J Clin Invest"},{"key":"B9","doi-asserted-by":"publisher","first-page":"8384","DOI":"10.1038\/s41467-024-52417-z","article-title":"Towards building multilingual language model for medicine","volume":"15","author":"Qiu","year":"2024","journal-title":"Nat Commun"},{"key":"B10","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2024.findings-acl.348","article-title":"Biomistral: A collection of open-source pretrained large language models for medical domains","author":"Labrak","year":"2024"},{"key":"B11","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2024.emnlp-main.480","article-title":"CliMedBench: A large-scale Chinese benchmark for evaluating medical large language models in clinical scenarios","author":"Ouyang","year":"2024"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.2196\/69485","article-title":"Performance of large language models in the non-English context: qualitative study of models trained on different languages in Chinese medical examinations","volume":"13","author":"Yao","year":"2025","journal-title":"JMIR Med Inf"},{"key":"B13","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2025.emnlp-main.79","article-title":"Mmlu-prox: A multilingual benchmark for advanced large language model evaluation","author":"Xuan","year":"2025"},{"key":"B14","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2025.findings-emnlp.263","article-title":"Llmeval-med: A real-world clinical benchmark for medical llms with physician validation","volume-title":"Arxiv Preprint Arxiv:2506.04078","author":"Zhang","year":"2025"},{"key":"B15","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2026.findings-acl.573","article-title":"MedErrBench: a fine-grained multilingual benchmark for medical error detection and correction with clinical expert annotations","author":"Ma","year":"2026"},{"key":"B16","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2026.acl-long.1140","article-title":"MED-COREASONER: reducing language disparities in medical reasoning via language-informed co-reasoning","author":"Gao","year":"2026"},{"key":"B17","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2026.findings-acl.767","article-title":"Benchmarking LLMs on authentic cases from medical journals","author":"Liu","year":"2026"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/02770903.2018.1543435","article-title":"Expression of TSLP and IL-33 receptors on sputum macrophages of asthma patients and healthy subjects","volume":"57","author":"Papli\u0144ska-Goryca","year":"2020","journal-title":"J Asthma"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1158\/0008-5472.can-19-2254","article-title":"Blockade of DC-SIGN+ tumor-associated macrophages reactivates antitumor immunity and improves immunotherapy in muscle-invasive bladder cancer","volume":"80","author":"Hu","year":"2020","journal-title":"Cancer Res"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1126\/sciimmunol.abn4332","article-title":"Tissue-resident memory T cells mediate mucosal immunity to recurrent urinary tract infection","volume":"8","author":"Rousseau","year":"2023","journal-title":"Sci Immunol"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1007\/s11695-025-08418-y","article-title":"Performance of large language models in metabolic bariatric surgery: a comparative study","volume":"36","author":"El-Masry","year":"2026","journal-title":"Obes Surg"}],"container-title":["Frontiers in Immunology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fimmu.2026.1965554\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T05:33:33Z","timestamp":1789450413000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fimmu.2026.1965554\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,15]]},"references-count":21,"alternative-id":["10.3389\/fimmu.2026.1965554"],"URL":"https:\/\/doi.org\/10.3389\/fimmu.2026.1965554","relation":{},"ISSN":["1664-3224"],"issn-type":[{"value":"1664-3224","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,15]]},"article-number":"1965554"}}