{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T06:23:57Z","timestamp":1774938237901,"version":"3.50.1"},"reference-count":26,"publisher":"BMJ","issue":"3","license":[{"start":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T00:00:00Z","timestamp":1774828800000},"content-version":"unspecified","delay-in-days":29,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100022224","name":"Health and Social Care Delivery Research Programme","doi-asserted-by":"crossref","award":["NIHR130547"],"award-info":[{"award-number":["NIHR130547"]}],"id":[{"id":"10.13039\/501100022224","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100022244","name":"National Institute for Health Research Applied Research Collaboration West","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100022244","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100015250","name":"NIHR Bristol Biomedical Research Centre","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100015250","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open"],"accepted":{"date-parts":[[2026,3,3]]},"published-print":{"date-parts":[[2026,3]]},"abstract":"<jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>We explored the effectiveness of the Evidence-Based Interventions (EBI) programme which aimed to reduce the number of inappropriate procedures or diagnostic tests (\u2018interventions\u2019) in the English National Health Service (NHS). For 12 interventions, we evaluated whether expected intervention counts fell or geographical variation was reduced across England following the publication of EBI Wave 2 guidance in November 2020.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design<\/jats:title>\n                    <jats:p>We conducted a retrospective observational study utilising routine hospital data. We applied a controlled interrupted time series analysis to examine both step and trend changes in the use of EBI interventions following the publication of the EBI Wave 2. We compared geographical variation in intervention rates pre-EBI and post-EBI.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Setting<\/jats:title>\n                    <jats:p>English hospitals where NHS funded elective healthcare interventions are performed.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Participants<\/jats:title>\n                    <jats:p>Patients who had NHS-funded elective interventions in England from March 2018 to February 2022 inclusive.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Half of the 12 interventions evaluated had significantly lower counts compared with their controls by February 2022. For five of these interventions, counts were between 20% and 57% lower than expected. This was the result of either (1) a larger fall in procedure counts by the end of the pandemic period (n=4 interventions); (2) declining counts post-pandemic (n=1); or (3) a combination of both (n=1). The remaining six interventions had similar or greater than expected counts by February 2022. There was limited evidence of reductions in geographical variation in procedure rates after publication of EBI guidance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Wave 2 of the EBI programme had a mixed impact on the use of the interventions targeted. There were some successes, however, following significant reduction in the use of elective care during the pandemic, half of the interventions evaluated returned to utilisation at or above predicted levels.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/bmjopen-2024-088256","type":"journal-article","created":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T04:55:13Z","timestamp":1774932913000},"page":"e088256","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":0,"title":["De-implementation of healthcare interventions post-COVID-19: evidence from the Evidence-Based Interventions (EBI) programme in England"],"prefix":"10.1136","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3790-9205","authenticated-orcid":false,"given":"Joel","family":"Glynn","sequence":"first","affiliation":[{"name":"Health Economics and Health Policy at Bristol (HEHP), University of Bristol Medical School, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1199-8668","authenticated-orcid":false,"given":"Tim","family":"Jones","sequence":"additional","affiliation":[{"name":"University of Bristol Musculoskeletal Research Unit, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mike","family":"Bell","sequence":"additional","affiliation":[{"name":"NIHR ARC West, Bristol, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jane M","family":"Blazeby","sequence":"additional","affiliation":[{"name":"NIHR Bristol Biomedical Research Centre, Bristol, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christopher","family":"Burton","sequence":"additional","affiliation":[{"name":"School of Allied Health Professions, Canterbury Christ Church University, Canterbury, Kent, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carmel","family":"Conefrey","sequence":"additional","affiliation":[{"name":"University of Bristol Medical School, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jenny","family":"Donovan","sequence":"additional","affiliation":[{"name":"University of Bristol Medical School, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicola","family":"Farrar","sequence":"additional","affiliation":[{"name":"University of Bristol Medical School, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Josie","family":"Morley","sequence":"additional","affiliation":[{"name":"University of Bristol Medical School, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2601-9258","authenticated-orcid":false,"given":"Angus GK","family":"McNair","sequence":"additional","affiliation":[{"name":"Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol Medical School, Bristol, UK"},{"name":"GI Surgery, North Bristol NHS Trust, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amanda","family":"Owen-Smith","sequence":"additional","affiliation":[{"name":"Health Economics and Health Policy at Bristol (HEHP), University of Bristol Medical School, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ellen","family":"Rule","sequence":"additional","affiliation":[{"name":"Gloucestershire Integrated Care Board, Gloucester, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gail","family":"Thornton","sequence":"additional","affiliation":[{"name":"University of Bristol Medical School, Bristol, UK"},{"name":"Public Contributor, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Victoria","family":"Tucker","sequence":"additional","affiliation":[{"name":"Bristol, North Somerset and South Gloucestershire ICB, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9462-9488","authenticated-orcid":false,"given":"Iestyn","family":"Williams","sequence":"additional","affiliation":[{"name":"University of Birmingham Health Services Management Centre, Birmingham, Birmingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6166-6055","authenticated-orcid":false,"given":"Leila","family":"Rooshenas","sequence":"additional","affiliation":[{"name":"University of Bristol Medical School, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William","family":"Hollingworth","sequence":"additional","affiliation":[{"name":"Health Economics and Health Policy at Bristol (HEHP), University of Bristol Medical School, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"239","published-online":{"date-parts":[[2026,3,30]]},"reference":[{"key":"2026033021550613000_16.3.e088256.1","unstructured":"NHS England and Improvement . In: Referral to Treatment (RRT) Waiting Times - Monthly RRT waiting times for incomplete pathways. 2019."},{"key":"2026033021550613000_16.3.e088256.2","unstructured":"NHS England . Referral to treatment (RTT) waiting times - monthly referral to treatment (RTT) waiting times for incomplete pathways. NHS England, 2023."},{"key":"2026033021550613000_16.3.e088256.3","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-015-0488-z"},{"key":"2026033021550613000_16.3.e088256.4","doi-asserted-by":"publisher","DOI":"10.1111\/1468-0009.12531"},{"key":"2026033021550613000_16.3.e088256.5","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1186\/s12913-018-3172-0","article-title":"Sustainability in Health care by Allocating Resources Effectively (SHARE) 11: reporting outcomes of an evidence-driven approach to disinvestment in a local healthcare setting","volume":"18","author":"Harris","year":"2018","journal-title":"BMC Health Serv Res"},{"key":"2026033021550613000_16.3.e088256.6","doi-asserted-by":"crossref","DOI":"10.1136\/bmjoq-2021-001710","article-title":"Reducing low-value care: what can we learn from eight de-implementation studies in the Netherlands?","volume":"11","author":"Verkerk","year":"2022","journal-title":"BMJ Open Qual"},{"key":"2026033021550613000_16.3.e088256.7","unstructured":"Academy of Medical Royal Colleges, 2024. Available: https:\/\/ebi.aomrc.org.uk\/about-us\/ [Accessed 15 Jan 2024]."},{"key":"2026033021550613000_16.3.e088256.8","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2021-014478"},{"key":"2026033021550613000_16.3.e088256.9","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0290996","article-title":"Did the evidence-based intervention (EBI) programme reduce inappropriate procedures, lessen unwarranted variation or lead to spill-over effects in the National Health Service?","volume":"18","author":"Glynn","year":"2023","journal-title":"PLoS One"},{"key":"2026033021550613000_16.3.e088256.10","doi-asserted-by":"crossref","DOI":"10.1186\/s12913-025-12700-1","article-title":"Relevance and flexibility are key: exploring healthcare managers\u2019 views and experiences of a de-adoption programme in the English National Health Service","volume":"25","author":"Farrar","year":"2025","journal-title":"BMC Health Serv Res"},{"key":"2026033021550613000_16.3.e088256.11","doi-asserted-by":"crossref","DOI":"10.1186\/s12913-025-13012-0","article-title":"Delivering a national de-adoption programme: a documentary analysis of local commissioning policy compliance with England\u2019s Evidence-based Interventions programme (EBI)","volume":"25","author":"Conefrey","year":"2025","journal-title":"BMC Health Serv Res"},{"key":"2026033021550613000_16.3.e088256.12","unstructured":"Academy of Medical Royal Colleges . Evidence-based interventions list 2 guidance. 2020."},{"key":"2026033021550613000_16.3.e088256.13","unstructured":"NIHR . NIHR Funding and Awards: NIHR 130547, 2023. Available: https:\/\/fundingawards.nihr.ac.uk\/award\/NIHR130547"},{"key":"2026033021550613000_16.3.e088256.14","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/dyx015"},{"key":"2026033021550613000_16.3.e088256.15","unstructured":"World Health Organization . International Statistical Classification of Diseases and Related Health Problems: Tenth Revision. 2nd edn.2004. Available: https:\/\/apps.who.int\/iris\/handle\/10665\/42980"},{"key":"2026033021550613000_16.3.e088256.16","unstructured":"NHS Digital . National Clinical Coding Standards OPCS-4, 2021. Available: https:\/\/classbrowser.nhs.uk\/ref_books\/OPCS-4.9_NCCS-2021.pdf"},{"key":"2026033021550613000_16.3.e088256.17","unstructured":"Office for National Statistics . Office for national statistics. In: LSOA (2011) to Sub ICB Locations to Integrated Care Boards to Local Authority Districts (july 2022) Lookup in England. Open Geographic Portal, 2022."},{"key":"2026033021550613000_16.3.e088256.18","doi-asserted-by":"crossref","unstructured":"Abadie A , Diamond A , Hainmueller J . SYNTH: stata module to implement synthetic control methods for comparative case studies. In: Statistical Software Componants S457334. Boston College Department of Economics, 2011.","DOI":"10.18637\/jss.v042.i13"},{"key":"2026033021550613000_16.3.e088256.19","doi-asserted-by":"publisher","DOI":"10.1111\/jep.12882"},{"key":"2026033021550613000_16.3.e088256.20","unstructured":"StataCorp LLC CS . TX.stata statistical software: release 17."},{"key":"2026033021550613000_16.3.e088256.21","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/dyy135"},{"key":"2026033021550613000_16.3.e088256.22","unstructured":"Analysis Group of PAHO\u2019s Special Program for Health Analysis (SHA) . Standardization: A Classic Epidemiological Method for the Comparison of Rates. Epidemiol Bull 2002;23."},{"key":"2026033021550613000_16.3.e088256.23","doi-asserted-by":"crossref","DOI":"10.1186\/1472-6963-9-60","article-title":"Is there much variation in variation? Revisiting statistics of small area variation in health services research","volume":"9","author":"Ib\u00e1\u00f1ez","year":"2009","journal-title":"BMC Health Serv Res"},{"key":"2026033021550613000_16.3.e088256.24","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2017-020325","article-title":"National trends in emergency readmission rates: a longitudinal analysis of administrative data for England between 2006 and 2016","volume":"8","author":"Friebel","year":"2018","journal-title":"BMJ Open"},{"key":"2026033021550613000_16.3.e088256.25","unstructured":"Federation of Surgical Speciality Association (FSSA) . Clinical guide to surgical prioritisation during the coronavirus pandemic. 2020."},{"key":"2026033021550613000_16.3.e088256.26","doi-asserted-by":"crossref","DOI":"10.1136\/bmj-2024-083868","article-title":"Global, regional, and national characteristics of the main causes of increased disease burden due to the covid-19 pandemic: time-series modelling analysis of global burden of disease study 2021","volume":"390","author":"Chen","year":"2025","journal-title":"BMJ"}],"container-title":["BMJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjopen-2024-088256","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T04:55:26Z","timestamp":1774932926000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopen.bmj.com\/lookup\/doi\/10.1136\/bmjopen-2024-088256"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3]]},"references-count":26,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3,30]]},"published-print":{"date-parts":[[2026,3]]}},"alternative-id":["10.1136\/bmjopen-2024-088256"],"URL":"https:\/\/doi.org\/10.1136\/bmjopen-2024-088256","relation":{},"ISSN":["2044-6055","2044-6055"],"issn-type":[{"value":"2044-6055","type":"print"},{"value":"2044-6055","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3]]}}}