{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T00:38:09Z","timestamp":1792802289816,"version":"4.5.0"},"reference-count":31,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T00:00:00Z","timestamp":1656633600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000274","name":"British Heart Foundation","doi-asserted-by":"crossref","award":["PG\/15\/51\/31596"],"award-info":[{"award-number":["PG\/15\/51\/31596"]}],"id":[{"id":"10.13039\/501100000274","id-type":"DOI","asserted-by":"crossref"}]},{"name":"British Heart Foundation Research Excellence Awards","award":["RE\/18\/5\/34216 and RE\/18\/6134217"],"award-info":[{"award-number":["RE\/18\/5\/34216 and RE\/18\/6134217"]}],"id":[{"id":"https:\/\/ror.org\/02wdwnk04","id-type":"ROR","asserted-by":"crossref"}]},{"name":"Butler Senior Clinical Research Fellowship","award":["FS\/16\/14\/32023"],"award-info":[{"award-number":["FS\/16\/14\/32023"]}]},{"name":"Butler Program Grant","award":["RG\/20\/10\/34966"],"award-info":[{"award-number":["RG\/20\/10\/34966"]}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:sec id=\"sec001\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>The high-sensitivity cardiac troponin on presentation to rule out myocardial infarction (HiSTORIC) study was a stepped-wedge cluster randomised trial with long before-and-after periods, involving seven hospitals across Scotland. Results were divergent for the binary safety endpoint (type 1 or type 4b myocardial infarction or cardiac death) across certain pre-specified analyses, which warranted further investigation. In particular, the calendar-matched analysis produced an odds ratio in the opposite direction to the primary logistic mixed-effects model analysis.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec002\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Several post-hoc statistical models were fitted to each of the co-primary outcomes of length of hospital stay and safety events, which included adjusting for exposure time, incorporating splines, and fitting a random time effect. We improved control of patient characteristics over time by adjusting for multiple additional covariates using different methods: direct inclusion, regression adjustment for propensity score, and weighting. A data augmentation approach was also conducted aiming to reduce the effect of sparse data bias. Finally, the raw data was examined.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec003\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The new statistical models confirmed the results of the pre-specified trial analysis. In particular, the observed divergence between the calendar-matched and other analyses remained, even after performing the covariate adjustment methods, and after using data augmentation. Divergence was particularly acute for the safety endpoint, which had an event rate of 0.36% overall. Examining the raw data was particularly helpful to assess the sensitivity of the results to small changes in event rates and identify patterns in the data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec004\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Our experience reveals the importance of conducting multiple pre-specified sensitivity analyses and examining the raw data, particularly for stepped wedge trials with low event rates or with a small number of sites. Before-and-after analytical approaches that adjust for differences in patient populations but avoid direct modelling of the time trend should be considered in future stepped wedge trials with similar designs.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1371\/journal.pone.0271027","type":"journal-article","created":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T13:40:46Z","timestamp":1656682846000},"page":"e0271027","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":4,"title":["Divergent confidence intervals among pre-specified analyses in the HiSTORIC stepped wedge trial: An exploratory post-hoc investigation"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2658-5022","authenticated-orcid":true,"given":"Richard A.","family":"Parker","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catriona","family":"Keerie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher J.","family":"Weir","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atul","family":"Anand","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas L.","family":"Mills","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2022,7,1]]},"reference":[{"issue":"1","key":"pone.0271027.ref001","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13063-015-0839-2","article-title":"Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014","volume":"16","author":"E Beard","year":"2015","journal-title":"Trials"},{"key":"pone.0271027.ref002","doi-asserted-by":"crossref","first-page":"h391","DOI":"10.1136\/bmj.h391","article-title":"The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting","volume":"350","author":"K Hemming","year":"2015","journal-title":"Bmj"},{"issue":"23","key":"pone.0271027.ref003","doi-asserted-by":"crossref","first-page":"2214","DOI":"10.1161\/CIRCULATIONAHA.120.052380","article-title":"High-sensitivity cardiac troponin on presentation to rule out myocardial infarction: a stepped-wedge cluster randomized controlled trial","volume":"143","author":"A Anand","year":"2021","journal-title":"Circulation"},{"issue":"17","key":"pone.0271027.ref004","doi-asserted-by":"crossref","first-page":"1586","DOI":"10.1161\/CIRCULATIONAHA.116.025021","article-title":"Comparison of the efficacy and safety of early rule-out pathways for acute myocardial infarction","volume":"135","author":"AR Chapman","year":"2017","journal-title":"Circulation"},{"issue":"1","key":"pone.0271027.ref005","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1186\/s13063-015-0842-7","article-title":"Designing a stepped wedge trial: three main designs, carry-over effects and randomisation approaches","volume":"16","author":"AJ Copas","year":"2015","journal-title":"Trials"},{"key":"pone.0271027.ref006","unstructured":"Parker RA, Mills N, Shah A, Strachan F, Keerie C, Weir CJ. The HiSTORIC trial: a hybrid before-and-after and stepped wedge design. In: Proceedings of the First International Conference on Stepped Wedge Trial Design. O1. Trials 17, no. 1 (2016): 311. (Conference Proceedings)."},{"key":"pone.0271027.ref007","unstructured":"Public Health Scotland 2020. Use of the National Safe Haven. https:\/\/www.isdscotland.org\/products-and-services\/edris\/use-of-the-national-safe-haven\/"},{"key":"pone.0271027.ref008","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1016\/S0735-1097(98)81989-X","article-title":"Seasonal distribution of acute myocardial infarction in the second National Registry of Myocardial Infarction","volume":"31","author":"FA Spencer","year":"1998","journal-title":"J Am Coll Cardiol"},{"issue":"1","key":"pone.0271027.ref009","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting Linear Mixed-Effects Models Using lme4","volume":"67","author":"D Bates","year":"2015","journal-title":"Journal of Statistical Software"},{"issue":"23","key":"pone.0271027.ref010","doi-asserted-by":"crossref","first-page":"3670","DOI":"10.1002\/sim.7348","article-title":"Bias and inference from misspecified mixed-effect models in stepped wedge trial analysis","volume":"36","author":"JA Thompson","year":"2017","journal-title":"Statistics in medicine"},{"issue":"1","key":"pone.0271027.ref011","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13063-015-0838-3","article-title":"Analysis and reporting of stepped wedge randomised controlled trials: synthesis and critical appraisal of published studies, 2010 to 2014","volume":"16","author":"C Davey","year":"2015","journal-title":"Trials"},{"issue":"2","key":"pone.0271027.ref012","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1177\/0962280220932962","article-title":"Mixed-effects models for the design and analysis of stepped wedge cluster randomized trials: An overview","volume":"30","author":"F Li","year":"2021","journal-title":"Statistical Methods in Medical Research"},{"issue":"12","key":"pone.0271027.ref013","doi-asserted-by":"crossref","first-page":"e0208876","DOI":"10.1371\/journal.pone.0208876","article-title":"Mixed effects approach to the analysis of the stepped wedge cluster randomised trial\u2014Investigating the confounding effect of time through simulation","volume":"13","author":"A Nickless","year":"2018","journal-title":"PloS one"},{"issue":"2","key":"pone.0271027.ref014","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.cct.2006.05.007","article-title":"Design and analysis of stepped wedge cluster randomized trials","volume":"28","author":"MA Hussey","year":"2007","journal-title":"Contemporary clinical trials"},{"issue":"1","key":"pone.0271027.ref015","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13063-017-1833-7","article-title":"Analysis of cluster randomised stepped wedge trials with repeated cross-sectional samples","volume":"18","author":"K Hemming","year":"2017","journal-title":"Trials"},{"issue":"1","key":"pone.0271027.ref016","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12874-021-01219-8","article-title":"Examining the effectiveness of telemonitoring with routinely acquired blood pressure data in primary care: challenges in the statistical analysis","volume":"21","author":"RA Parker","year":"2021","journal-title":"BMC medical research methodology"},{"issue":"23","key":"pone.0271027.ref017","doi-asserted-by":"crossref","first-page":"4053","DOI":"10.1002\/sim.6207","article-title":"On regression adjustment for the propensity score","volume":"33","author":"S Vansteelandt","year":"2014","journal-title":"Stat Med"},{"issue":"1","key":"pone.0271027.ref018","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1002\/sim.5884","article-title":"Bias associated with using the estimated propensity score as a regression covariate","volume":"33","author":"EM Hade","year":"2014","journal-title":"Statistics in medicine"},{"issue":"5","key":"pone.0271027.ref019","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1002\/pds.4756","article-title":"Propensity score methods and regression adjustment for analysis of nonrandomized studies with health-related quality of life outcomes","volume":"28","author":"F Cottone","year":"2019","journal-title":"Pharmacoepidemiology and drug safety"},{"issue":"28","key":"pone.0271027.ref020","doi-asserted-by":"crossref","first-page":"3661","DOI":"10.1002\/sim.6607","article-title":"Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies","volume":"34","author":"PC Austin","year":"2015","journal-title":"Statistics in medicine"},{"key":"pone.0271027.ref021","doi-asserted-by":"crossref","first-page":"i1981","DOI":"10.1136\/bmj.i1981","article-title":"Sparse data bias: a problem hiding in plain sight","volume":"352","author":"S Greenland","year":"2016","journal-title":"bmj"},{"issue":"1","key":"pone.0271027.ref022","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1111\/biom.12959","article-title":"Information content of cluster\u2013period cells in stepped wedge trials","volume":"75","author":"J Kasza","year":"2019","journal-title":"Biometrics"},{"key":"pone.0271027.ref023","doi-asserted-by":"crossref","first-page":"4686","DOI":"10.1002\/sim.8327","article-title":"Information content of stepped-wedge designs when treatment effect heterogeneity and\/or implementation periods are present","volume":"38","author":"J Kasza","year":"2019","journal-title":"Statistics in Medicine"},{"key":"pone.0271027.ref024","unstructured":"R Core Team (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https:\/\/www.R-project.org\/."},{"issue":"3","key":"pone.0271027.ref025","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v036.i03","article-title":"Conducting meta-analyses in R with the metafor package","volume":"36","author":"W. Viechtbauer","year":"2010","journal-title":"Journal of Statistical Software"},{"issue":"4","key":"pone.0271027.ref026","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1177\/1740774516634316","article-title":"Substantial risks associated with few clusters in cluster randomized and stepped wedge designs","volume":"13","author":"M Taljaard","year":"2016","journal-title":"Clinical Trials"},{"issue":"1","key":"pone.0271027.ref027","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13063-017-1862-2","article-title":"Minimum number of clusters and comparison of analysis methods for cross sectional stepped wedge cluster randomised trials with binary outcomes: A simulation study","volume":"18","author":"D Barker","year":"2017","journal-title":"Trials"},{"issue":"21","key":"pone.0271027.ref028","doi-asserted-by":"crossref","first-page":"2779","DOI":"10.1002\/sim.8575","article-title":"Maintaining the validity of inference in small-sample stepped wedge cluster randomized trials with binary outcomes when using generalized estimating equations","volume":"39","author":"WP Ford","year":"2020","journal-title":"Statistics in Medicine"},{"issue":"2","key":"pone.0271027.ref029","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1177\/0962280220958735","article-title":"Comparison of small-sample standard-error corrections for generalised estimating equations in stepped wedge cluster randomised trials with a binary outcome: A simulation study","volume":"30","author":"JA Thompson","year":"2021","journal-title":"Statistical methods in medical research"},{"issue":"3","key":"pone.0271027.ref030","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1093\/ije\/dyaa077","article-title":"Reflection on modern methods: when is a stepped-wedge cluster randomized trial a good study design choice?","volume":"49","author":"K Hemming","year":"2020","journal-title":"International journal of epidemiology"},{"key":"pone.0271027.ref031","unstructured":"Pinheiro J, Bates D, DebRoy S, Sarkar D, R Core Team (2021). _nlme:Linear and Nonlinear Mixed Effects Models. R package version 3.1\u2013152,<URL: https:\/\/CRAN.R-project.org\/package=nlme>."}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0271027","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T13:41:28Z","timestamp":1656682888000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0271027"}},"subtitle":[],"editor":[{"given":"Salvatore","family":"De Rosa","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2022,7,1]]},"references-count":31,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7,1]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0271027","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,1]]}}}