{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T07:03:35Z","timestamp":1784099015633,"version":"3.55.0"},"reference-count":45,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T00:00:00Z","timestamp":1784073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Sepsis poses a serious threat to the health and lives of older adults and is difficult to identify accurately in its early stages. To address this issue, our team previously developed an early warning model for sepsis in older adults based on machine learning algorithms and conducted preliminary validation. To further validate the model\u2019s performance for clinical use, we collected additional clinical data. In the process, we gained some insights.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We collected clinical data from patients aged 60\u202fyears or older admitted to the Emergency Department and Intensive Care Unit of the General Hospital of Ningxia Medical University. We conducted a secondary evaluation of the predictive and generalization capabilities of the geriatric sepsis sepsis early warning model using multiple metrics (including AUC, accuracy, sensitivity, specificity, precision, and F1 score), and analyzed the validation results.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Eight hundred fourteen patients were included in the study, comprising 106 positive patients (sepsis patients) and 708 negative patients (non-sepsis patients). After validation, the model\u2019s accuracy was 0.801, sensitivity was 0.764, and AUROC was 0.865.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>In the study, although the AUROC of the further validation showed a slight decrease, the early warning model still performed well. The warning model is indeed helpful in identifying geriatric patients patients with sepsis earlier. The performance deviation observed during the validation phase may stem from multiple factors. Overall, machine learning models remain in a stage requiring continuous refinement and development. They are better suited as auxiliary tools in the medical field, necessitating long-term validation and adjustment rather than operating entirely independently.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1833804","type":"journal-article","created":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T06:03:50Z","timestamp":1784095430000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Analysis and implications of validation results for a clinical data-based early warning model for geriatric sepsis"],"prefix":"10.3389","volume":"14","author":[{"given":"Xuejie","family":"Ma","sequence":"first","affiliation":[{"name":"Intensive Care Unit, Cardiocerebral Vascular Disease Hospital, General Hospital of Ningxia Medical University","place":["Yinchuan, Ningxia, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyi","family":"Li","sequence":"additional","affiliation":[{"name":"Intensive Care Unit, Cardiocerebral Vascular Disease Hospital, General Hospital of Ningxia Medical University","place":["Yinchuan, Ningxia, China"]},{"name":"First Clinical College of Ningxia Medical University","place":["Yinchuan, Ningxia, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoqiang","family":"He","sequence":"additional","affiliation":[{"name":"Intensive Care Unit, Cardiocerebral Vascular Disease Hospital, General Hospital of Ningxia Medical University","place":["Yinchuan, Ningxia, China"]},{"name":"First Clinical College of Ningxia Medical University","place":["Yinchuan, Ningxia, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Zou","sequence":"additional","affiliation":[{"name":"Intensive Care Unit, Cardiocerebral Vascular Disease Hospital, General Hospital of Ningxia Medical University","place":["Yinchuan, Ningxia, China"]},{"name":"First Clinical College of Ningxia Medical University","place":["Yinchuan, Ningxia, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaowei","family":"Ma","sequence":"additional","affiliation":[{"name":"Intensive Care Unit, Cardiocerebral Vascular Disease Hospital, General Hospital of Ningxia Medical University","place":["Yinchuan, Ningxia, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,7,15]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"2176","DOI":"10.1038\/s43587-025-00999-8","article-title":"Adapting health, economic and social policies to address population aging in China","volume":"5","author":"Fang","year":"2025","journal-title":"Nat Aging"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"2370","DOI":"10.1038\/s41562-025-02285-4","article-title":"Visitation patterns reveal service access disparities for ageing populations in the USA","volume":"9","author":"Han","year":"2025","journal-title":"Nat Hum Behav"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1038\/s41586-023-05738-w","article-title":"Ageing threatens sustainability of smallholder farming in China","volume":"616","author":"Ren","year":"2023","journal-title":"Nature"},{"key":"ref4","year":""},{"key":"ref5","doi-asserted-by":"publisher","first-page":"e1003138","DOI":"10.1371\/journal.pmed.1003138","article-title":"Population ageing and mortality during 1990\u20132017: a global decomposition analysis","volume":"17","author":"Cheng","year":"2020","journal-title":"PLoS Med"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"1328","DOI":"10.2105\/AJPH.2020.305782","article-title":"Rural population health and aging: toward a multilevel and multidimensional research agenda for the 2020s","volume":"110","author":"Jensen","year":"2020","journal-title":"Am J Public Health"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1093\/cid\/ciy530","article-title":"Sepsis and risk of Cancer among elderly adults in the United States","volume":"68","author":"Liu","year":"2019","journal-title":"Clin Infect Dis Off Publ Infect Dis Soc Am"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1186\/s12873-022-00582-z","article-title":"Prediction of prognosis in elderly patients with sepsis based on machine learning (random survival forest)","volume":"22","author":"Zhang","year":"2022","journal-title":"BMC Emerg Med"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"136578","DOI":"10.1016\/j.ijbiomac.2024.136578","article-title":"Potential mechanism of CARD16 protein action and susceptibility to sepsis in the elderly infected population: through transcriptome analysis of blood","volume":"281","author":"Sun","year":"2024","journal-title":"Int J Biol Macromol"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"1719","DOI":"10.1093\/ageing\/afab036","article-title":"Frailty is associated with long-term outcome in patients with sepsis who are over 80 years old: results from an observational study in 241 european ICUs","volume":"50","author":"Haas","year":"2021","journal-title":"Age Ageing"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1016\/j.idc.2017.07.010","article-title":"Sepsis in older adults","volume":"31","author":"Rowe","year":"2017","journal-title":"Infect Dis Clin N Am"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"10580","DOI":"10.1038\/s41598-025-95604-8","article-title":"Constructing an early warning model for elderly sepsis patients based on machine learning","volume":"15","author":"Ma","year":"2025","journal-title":"Sci Rep"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"16154","DOI":"10.1038\/s41598-024-66608-7","article-title":"Establishment of a corneal ulcer prognostic model based on machine learning","volume":"14","author":"Wang","year":"2024","journal-title":"Sci Rep"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1186\/s13054-025-05336-4","article-title":"Machine learning models compared with current clinical indices to predict the outcome of high flow nasal cannula therapy in acute hypoxemic respiratory failure","volume":"29","author":"Yu","year":"2025","journal-title":"Crit Care Lond Engl"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.jclinepi.2015.04.005","article-title":"Prediction models need appropriate internal, internal-external, and external validation","volume":"69","author":"Steyerberg","year":"2016","journal-title":"J Clin Epidemiol"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"i3140","DOI":"10.1136\/bmj.i3140","article-title":"External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges","volume":"353","author":"Riley","year":"2016","journal-title":"BMJ"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1186\/s13054-024-05245-y","article-title":"Interpretable machine learning model for outcome prediction in patients with aneurysmatic subarachnoid hemorrhage","volume":"29","author":"Moriya","year":"2025","journal-title":"Crit Care"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1038\/s41392-023-01451-2","article-title":"Immunosenescence: molecular mechanisms and diseases","volume":"8","author":"Liu","year":"2023","journal-title":"Signal Transduct Target Ther"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"1514602","DOI":"10.3389\/fphar.2024.1514602","article-title":"Protective effect and mechanism of sufentanil on acute lung injury in septic mice","volume":"15","author":"Hou","year":"2025","journal-title":"Front Pharmacol"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"5078","DOI":"10.1038\/s41598-025-89442-x","article-title":"Construction and verification of a nomogram model for the risk of death in sepsis patients","volume":"15","author":"Yang","year":"2025","journal-title":"Sci Rep"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1186\/s12967-023-04002-z","article-title":"Whole transcriptome analysis to explore the impaired immunological features in critically ill elderly patients with sepsis","volume":"21","author":"Chen","year":"2023","journal-title":"J Transl Med"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"146","DOI":"10.7861\/clinmedicine.18-2-146","article-title":"Diagnosis and management of sepsis","volume":"18","author":"Evans","year":"2018","journal-title":"Clin Med"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1007\/s00134-019-05872-y","article-title":"Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy","volume":"46","author":"Fleuren","year":"2020","journal-title":"Intensive Care Med"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1016\/j.chest.2017.12.015","article-title":"A comparison of the quick-SOFA and systemic inflammatory response syndrome criteria for the diagnosis of sepsis and prediction of mortality: a systematic review and meta-analysis","volume":"153","author":"Serafim","year":"2018","journal-title":"Chest"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"2005","DOI":"10.1111\/jocn.17061","article-title":"Early warning scores for sepsis identification and prediction of in-hospital mortality in adults with sepsis: a systematic review and meta-analysis","volume":"33","author":"Chua","year":"2024","journal-title":"J Clin Nurs"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1016\/j.jinf.2023.07.006","article-title":"Artificial intelligence, machine learning and deep learning: potential resources for the infection clinician","volume":"87","author":"Theodosiou","year":"2023","journal-title":"J Infect"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"8426","DOI":"10.3390\/ijms25158426","article-title":"AI-driven deep learning techniques in protein structure prediction","volume":"25","author":"Chen","year":"2024","journal-title":"Int J Mol Sci"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1002\/cac2.12012","article-title":"Emerging role of deep learning-based artificial intelligence in tumor pathology","volume":"40","author":"Jiang","year":"2020","journal-title":"Cancer Commun Lond Engl"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1016\/j.jcmg.2023.07.001","article-title":"From conventional deep learning to GPT: AI\u2019S emergent power for cardiac imaging","volume":"16","author":"Sengupta","year":"2023","journal-title":"JACC Cardiovasc Imaging"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"1038","DOI":"10.1038\/s41587-019-0224-x","article-title":"Deep learning enables rapid identification of potent DDR1 kinase inhibitors","volume":"37","author":"Zhavoronkov","year":"2019","journal-title":"Nat Biotechnol"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"20230141","DOI":"10.1259\/dmfr.20230141","article-title":"Assessing the reliability of CBCT-based AI-generated STL files in diagnosing osseous changes of the mandibular condyle: a comparative study with ground truth diagnosis","volume":"52","author":"Orhan","year":"2023","journal-title":"Dentomaxillofac Radiol"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"104068","DOI":"10.1016\/j.drudis.2024.104068","article-title":"Machine learning for antidepressant treatment selection in depression","volume":"29","author":"Arnold","year":"2024","journal-title":"Drug Discov Today"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"e872","DOI":"10.1016\/S2589-7500(23)00177-2","article-title":"Machine learning and deep learning predictive models for long-term prognosis in patients with chronic obstructive pulmonary disease: a systematic review and meta-analysis","volume":"5","author":"Smith","year":"2023","journal-title":"Lancet Digit Health"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"1633635","DOI":"10.3389\/fonc.2025.1633635","article-title":"Machine learning-driven prognostic prediction model for composite small cell lung cancer: identifying risk factors with network tools and validation using SEER data and external cohorts","volume":"15","author":"Li","year":"2025","journal-title":"Front Oncol"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"103703","DOI":"10.1016\/j.iccn.2024.103703","article-title":"Development and external validation of a prediction model for the premature circuit clotting of continuous renal replacement therapy in critically ill patients","volume":"84","author":"Yang","year":"2024","journal-title":"Intensive Crit Care Nurs"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"27174","DOI":"10.1038\/s41598-024-77798-5","article-title":"Development and external validation of an interpretable machine learning model for the prediction of intubation in the intensive care unit","volume":"14","author":"Liu","year":"2024","journal-title":"Sci Rep"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1186\/s12874-022-01793-5","article-title":"External validation of existing dementia prediction models on observational health data","volume":"22","author":"John","year":"2022","journal-title":"BMC Med Res Methodol"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"1552","DOI":"10.1007\/s00134-020-06151-x","article-title":"Incidence and mortality of hospital- and ICU-treated sepsis: results from an updated and expanded systematic review and meta-analysis","volume":"46","author":"Fleischmann-Struzek","year":"2020","journal-title":"Intensive Care Med"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"1546","DOI":"10.1056\/NEJMoa022139","article-title":"The epidemiology of sepsis in the United States from 1979 through 2000","volume":"348","author":"Martin","year":"2003","journal-title":"N Engl J Med"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1164\/rccm.201504-0781OC","article-title":"Assessment of global incidence and mortality of hospital-treated sepsis. Current estimates and limitations","volume":"193","author":"Fleischmann","year":"2016","journal-title":"Am J Respir Crit Care Med"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"1461","DOI":"10.1177\/09622802231165001","article-title":"Imputation and missing indicators for handling missing data in the development and deployment of clinical prediction models: a simulation study","volume":"32","author":"Sisk","year":"2023","journal-title":"Stat Methods Med Res"},{"key":"ref42","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1186\/s12874-025-02496-3","article-title":"Conceptual framework as a guide to choose appropriate imputation method for missing values in a clinical structured dataset","volume":"25","author":"Afkanpour","year":"2025","journal-title":"BMC Med Res Methodol"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1016\/j.jclinepi.2020.03.028","article-title":"Missing data should be handled differently for prediction than for description or causal explanation","volume":"125","author":"Sperrin","year":"2020","journal-title":"J Clin Epidemiol"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1093\/bmb\/ldab016","article-title":"The promise of artificial intelligence: a review of the opportunities and challenges of artificial intelligence in healthcare","volume":"139","author":"Aung","year":"2021","journal-title":"Br Med Bull"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"105216","DOI":"10.1016\/j.ijnurstu.2025.105216","article-title":"Nursing judgment in the age of generative artificial intelligence: a cross-national study on clinical decision-making performance among emergency nurses","volume":"172","author":"Levin","year":"2025","journal-title":"Int J Nurs Stud"}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1833804\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T06:03:50Z","timestamp":1784095430000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1833804\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,15]]},"references-count":45,"alternative-id":["10.3389\/fpubh.2026.1833804"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1833804","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,15]]},"article-number":"1833804"}}