{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T17:43:51Z","timestamp":1792691031113,"version":"4.5.0"},"reference-count":19,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T00:00:00Z","timestamp":1792627200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:sec id=\"sec001\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Postoperative delirium (POD) is a fluctuating confusional state occurring early after surgery. Given its fluctuating nature, POD detection is influenced by the frequency and timing of screening. Sparse assessments potentially underestimate the true incidence reported in individual studies, subsequently influencing the weight of studies in meta-analyses, and the results and precision of these meta-analyses.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec002\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To develop a method to evaluate the robustness of meta-analyses to the variation in the frequency and timing of POD assessment across included studies.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec003\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We developed an expert-based scoring system to rate studies according to the confidence that a patient reported not to have POD in the study truly did not, based on the reported timing and frequency of POD assessments. We describe how to use the system to generate hypothetical event rates for studies if the frequency and timing of POD assessment were optimal and how to use these rates in a sensitivity analysis of meta-analyses including these studies. We illustrate the method applying it to two meta-analyses as work examples, one of observational studies and one of randomized controlled trials (RCTs).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec004\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In our work examples, the expert-based score for the individual studies ranged from 33\u201377% for the observational and 22\u201370% for RCTs meta-analysis. Sensitivity analyses showed a change in the pooled effect size, heterogeneity, and precision compared to the original estimates.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec005\">\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>We present a method to evaluate the robustness of a meta-analysis of studies having POD as an outcome, when there is variation across individual studies in the frequency and timing of POD assessment. The confidence score acts as a preliminary index of the robustness of meta-analyses. Through work examples, we showed that the robustness depends on the characteristics of individual studies included.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1371\/journal.pone.0361124","type":"journal-article","created":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T17:29:11Z","timestamp":1792690151000},"page":"e0361124","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Assessing the robustness of meta-analyses to variability in the frequency and timing of postoperative delirium assessment \u2013 a novel methodological approach"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1200-1388","authenticated-orcid":true,"given":"Maram","family":"Khaled","sequence":"first","affiliation":[{"name":"Evidence and Impact, McMaster University","place":["Hamilton, Canada"],"department":["Department of Health Research Methods"]},{"name":"Perioperative and Surgery Research Program, Population Health Research Institute, David Braley Research Institute","place":["Hamilton, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harsha","family":"Shanthanna","sequence":"additional","affiliation":[{"name":"McMaster University","place":["Hamilton, Canada"],"department":["Department of Anesthesia"]},{"name":"Evidence and Impact, McMaster University","place":["Hamilton, Canada"],"department":["Department of Health Research Methods"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lehana","family":"Thabane","sequence":"additional","affiliation":[{"name":"McMaster University","place":["Hamilton, Canada"],"department":["Department of Anesthesia"]},{"name":"Evidence and Impact, McMaster University","place":["Hamilton, Canada"],"department":["Department of Health Research Methods"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Paul","sequence":"additional","affiliation":[{"name":"McMaster University","place":["Hamilton, Canada"],"department":["Department of Anesthesia"]},{"name":"Evidence and Impact, McMaster University","place":["Hamilton, Canada"],"department":["Department of Health Research Methods"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7563-9157","authenticated-orcid":true,"given":"Anthony","family":"Absalom","sequence":"additional","affiliation":[{"name":"University Medical Center Groningen, University of Groningen","place":["Groningen, The Netherlands"],"department":["Department of Anesthesiology"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sergio","family":"Bergese","sequence":"additional","affiliation":[{"name":"Neurological Surgery, and Outcomes and Clinical Research in Perioperative Medicine, Stony Brook University","place":["New York, United States of America"],"department":["Department of Anesthesiology"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Federico","family":"Bilotta","sequence":"additional","affiliation":[{"name":"Critical Care, and Pain Medicine, Sapienza University of Rome","place":["Rome, Italy"],"department":["Departments of Anesthesiology"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Douglas","family":"Campbell","sequence":"additional","affiliation":[{"name":"Auckland City Hospital","place":["Auckland, New Zealand"],"department":["Department of Anesthesia and Perioperative Medicine"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3574-7855","authenticated-orcid":true,"given":"Matthew","family":"Chan","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Hong Kong Special Administration","place":["Hong Kong, China"],"department":["Department of Anaesthesia and Intensive Care"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Coburn","sequence":"additional","affiliation":[{"name":"University Hospital Bonn","place":["Bonn, Germany"],"department":["Department of Anesthesiology and Intensive Care Medicine"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Cowan","sequence":"additional","affiliation":[{"name":"McMaster University","place":["Hamilton, Canada"],"department":["Department of Medicine"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kamal","family":"Maheshwari","sequence":"additional","affiliation":[{"name":"Kaiser South Sacramento","place":["California, United States of America"],"department":["Department of Anesthesiology"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edward","family":"Mascha","sequence":"additional","affiliation":[{"name":"Cleveland Clinic","place":["Ohio, United States of America"],"department":["Department of Quantitative Health Sciences"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert D.","family":"Sanders","sequence":"additional","affiliation":[{"name":"University of Sydney","place":["Sydney, Australia"],"department":["Faculty of Medicine and Health"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9932-3077","authenticated-orcid":true,"given":"Daniel I.","family":"Sessler","sequence":"additional","affiliation":[{"name":"U T Health","place":["Texas, United States of America"],"department":["Center for Outcomes Research and Departments of Anesthesiology and Biostatistics"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tim","family":"Short","sequence":"additional","affiliation":[{"name":"Auckland City Hospital","place":["Auckland, New Zealand"],"department":["Department of Anesthesia and Perioperative Medicine"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica","family":"Spence","sequence":"additional","affiliation":[{"name":"McMaster University","place":["Hamilton, Canada"],"department":["Department of Anesthesia"]},{"name":"Evidence and Impact, McMaster University","place":["Hamilton, Canada"],"department":["Department of Health Research Methods"]},{"name":"Population Health Research Institute, David Braley Research Institute","place":["Hamilton, Canada"],"department":["Perioperative and Surgery Research Program"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alparslan","family":"Turan","sequence":"additional","affiliation":[{"name":"Critical Care and Pain Medicine, U T Health","place":["Texas, United States of America"],"department":["Center for Outcomes Research and Department of Anesthesiology"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3205-1836","authenticated-orcid":true,"given":"Dong-Xin","family":"Wang","sequence":"additional","affiliation":[{"name":"Peking University First Hospital","place":["Beijing, China"],"department":["Department of Anesthesiology"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Wittmann","sequence":"additional","affiliation":[{"name":"University of Bonn","place":["Germany"],"department":["Clinic and Polyclinic for Anesthesiology and Operative Intensive Care Medicine"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8468-7991","authenticated-orcid":true,"given":"Maura","family":"Marcucci","sequence":"additional","affiliation":[{"name":"Humanitas University and IRCCS Humanitas Research Hospital","place":["Milan, Italy"],"department":["Clinical Epidemiology and Research Centre (CERC), Department of Biomedical Sciences"]},{"name":"Evidence and Impact, McMaster University","place":["Hamilton, Canada"],"department":["Department of Health Research Methods"]},{"name":"Perioperative and Surgery Research Program, Population Health Research Institute, David Braley Research Institute","place":["Hamilton, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,10,22]]},"reference":[{"issue":"10","key":"pone.0361124.ref001","doi-asserted-by":"crossref","first-page":"1578","DOI":"10.1111\/j.1532-5415.2006.00893.x","article-title":"Preoperative risk assessment for delirium after noncardiac surgery: A systematic review","volume":"54","author":"M Dasgupta","year":"2006","journal-title":"J Am Geriatr Soc"},{"key":"pone.0361124.ref002","article-title":"Risk factors for postoperative delirium in patients undergoing lower extremity joint arthroplasty: A retrospective population-based cohort study","author":"S Memtsoudis","year":"2019","journal-title":"Reg Anesth Pain Med"},{"issue":"4","key":"pone.0361124.ref003","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1001\/jama.2010.1013","article-title":"Delirium in elderly patients and the risk of postdischarge mortality, institutionalization, and dementia: A meta-analysis","volume":"304","author":"J Witlox","year":"2010","journal-title":"JAMA"},{"issue":"3","key":"pone.0361124.ref004","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1097\/ALN.0000000000002253","article-title":"Cognitive Decline after Delirium in Patients Undergoing Cardiac Surgery","volume":"129","author":"CH Brown","year":"2018","journal-title":"Anesthesiology"},{"issue":"9920","key":"pone.0361124.ref005","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1016\/S0140-6736(13)60688-1","article-title":"Delirium in elderly people","volume":"383","author":"SK Inouye","year":"2014","journal-title":"Lancet"},{"issue":"1","key":"pone.0361124.ref006","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1186\/s12913-018-3345-x","article-title":"A hospital-wide evaluation of delirium prevalence and outcomes in acute care patients - a cohort study","volume":"18","author":"M Schubert","year":"2018","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"pone.0361124.ref007","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.bja.2024.08.032","article-title":"Postoperative pain and neurocognitive outcomes after noncardiac surgery: A systematic review and dose-response meta-analysis","volume":"134","author":"M Khaled","year":"2025","journal-title":"Br J Anaesth"},{"issue":"2","key":"pone.0361124.ref008","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1016\/j.bja.2022.12.001","article-title":"Effect of perioperative benzodiazepine use on intraoperative awareness and postoperative delirium: A systematic review and meta-analysis of randomised controlled trials and observational studies","volume":"131","author":"E Wang","year":"2023","journal-title":"Br J Anaesth"},{"issue":"2","key":"pone.0361124.ref009","doi-asserted-by":"crossref","DOI":"10.1186\/cc12566","article-title":"Strategies for prevention of postoperative delirium: A systematic review and meta-analysis of randomized trials","volume":"17","author":"H Zhang","year":"2013","journal-title":"Crit Care"},{"issue":"10","key":"pone.0361124.ref010","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1007\/s12630-010-9355-8","article-title":"Hospital administrative database underestimates delirium rate after cardiac surgery","volume":"57","author":"R Katznelson","year":"2010","journal-title":"Can J Anaesth"},{"issue":"5","key":"pone.0361124.ref011","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.1016\/j.bja.2017.11.087","article-title":"Recommendations for the nomenclature of cognitive change associated with anaesthesia and surgery-2018","volume":"121","author":"L Evered","year":"2018","journal-title":"Br J Anaesth"},{"key":"pone.0361124.ref012","first-page":"154","volume-title":"Does timing of delirium assessment affect CAM-ICU results? National association of clinical nurse specialists conference.","author":"V Holly","year":"2006"},{"key":"pone.0361124.ref013","doi-asserted-by":"crossref","first-page":"110233","DOI":"10.1016\/j.jclinane.2021.110233","article-title":"Optimal interval and duration of CAM-ICU assessments for delirium detection after cardiac surgery","volume":"71","author":"H Hamadnalla","year":"2021","journal-title":"J Clin Anesth"},{"issue":"3","key":"pone.0361124.ref014","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1007\/s00540-022-03049-4","article-title":"Postoperative delirium is an independent factor influencing the length of stay of elderly patients in the intensive care unit and in hospital","volume":"36","author":"A Kirfel","year":"2022","journal-title":"J Anesth"},{"issue":"1","key":"pone.0361124.ref015","article-title":"Incidence and risk factors of delirium in surgical intensive care unit","volume":"6","author":"MA Ali","year":"2021","journal-title":"Trauma Surg Acute Care Open"},{"issue":"3","key":"pone.0361124.ref016","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1136\/rapm-2018-100120","article-title":"Comparison of dexmedetomidine and benzodiazepine for intraoperative sedation in elderly patients: A randomized clinical trial","volume":"44","author":"JM Silva-Jr","year":"2019","journal-title":"Reg Anesth Pain Med"},{"issue":"6","key":"pone.0361124.ref017","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1016\/j.survophthal.2025.05.008","article-title":"Effectiveness and safety of anti-vascular endothelial growth factor therapies for macular edema in retinal vein occlusion: A systematic review and network meta-analysis of randomized controlled trials","volume":"70","author":"K-Y Chen","year":"2025","journal-title":"Surv Ophthalmol"},{"issue":"2","key":"pone.0361124.ref018","doi-asserted-by":"crossref","first-page":"202","DOI":"10.3390\/medicina61020202","article-title":"Update on the efficacy and safety of sodium-glucose co-transporter 2 inhibitors in patients with chronic diseases: A systematic review and meta-analysis","volume":"61","author":"I-C Liang","year":"2025","journal-title":"Medicina (Kaunas)"},{"key":"pone.0361124.ref019","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1186\/1471-2288-13-92","article-title":"A tutorial on sensitivity analyses in clinical trials: the what, why, when and how","volume":"13","author":"L Thabane","year":"2013","journal-title":"BMC Med Res Methodol"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0361124","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T17:29:16Z","timestamp":1792690156000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0361124"}},"subtitle":[],"editor":[{"given":"Oyelola A.","family":"Adegboye","sequence":"first","affiliation":[{"name":"Menzies School of Health Research: Charles Darwin University","place":["AUSTRALIA"]}],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,10,22]]},"references-count":19,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2026,10,22]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0361124","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,22]]}}}