{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T21:25:17Z","timestamp":1749849917923,"version":"3.37.3"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,9,11]],"date-time":"2020-09-11T00:00:00Z","timestamp":1599782400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,11]],"date-time":"2020-09-11T00:00:00Z","timestamp":1599782400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002001","name":"Health Services and Delivery Research Programme","doi-asserted-by":"publisher","award":["project number 16\/04\/06"],"award-info":[{"award-number":["project number 16\/04\/06"]}],"id":[{"id":"10.13039\/501100002001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Health Serv Res"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>National Clinical Audits (NCAs) are a well-established quality improvement strategy used in healthcare settings. Significant resources, including clinicians\u2019 time, are invested in participating in NCAs, yet there is variation in the extent to which the resulting feedback stimulates quality improvement. The aim of this study was to explore the reasons behind this variation.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Methods<\/jats:title>\n<jats:p>We used realist evaluation to interrogate how context shapes the mechanisms through which NCAs work (or not) to stimulate quality improvement. Fifty-four interviews were conducted with doctors, nurses, audit clerks and other staff working with NCAs across five healthcare providers in England. In line with realist principles we scrutinised the data to identify how and why providers responded to NCA feedback (mechanisms), the circumstances that supported or constrained provider responses (context), and what happened as a result of the interactions between mechanisms and context (outcomes). We summarised our findings as Context+Mechanism\u2009=\u2009Outcome configurations.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>We identified five mechanisms that explained provider interactions with NCA feedback: reputation, professionalism, competition, incentives, and professional development. Professionalism and incentives underpinned most frequent interaction with feedback, providing opportunities to stimulate quality improvement. Feedback was used routinely in these ways where it was generated from data stored in local databases before upload to NCA suppliers. Local databases enabled staff to access data easily, customise feedback and, importantly, the data were trusted as accurate, due to the skills and experience of staff supporting audit participation. Feedback produced by NCA suppliers, which included national comparator data, was used in a more limited capacity across providers. Challenges accessing supplier data in a timely way and concerns about the quality of data submitted across providers were reported to constrain use of this mode of feedback.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusion<\/jats:title>\n<jats:p>The findings suggest that there are a number of mechanisms that underpin healthcare providers\u2019 interactions with NCA feedback. However, there is variation in the mode, frequency and impact of these interactions. Feedback was used most routinely, providing opportunities to stimulate quality improvement, within clinical services resourced to collect accurate data and to maintain local databases from which feedback could be customised for the needs of the service.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12913-020-05661-0","type":"journal-article","created":{"date-parts":[[2020,9,11]],"date-time":"2020-09-11T12:02:41Z","timestamp":1599825761000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Exploring variation in the use of feedback from national clinical audits: a realist investigation"],"prefix":"10.1186","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9422-4483","authenticated-orcid":false,"given":"Natasha","family":"Alvarado","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lynn","family":"McVey","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joanne","family":"Greenhalgh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dawn","family":"Dowding","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mamas","family":"Mamas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"Gale","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick","family":"Doherty","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebecca","family":"Randell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,9,11]]},"reference":[{"issue":"3","key":"5661_CR1","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1093\/intqhc\/mzp012","volume":"21","author":"K Walshe","year":"2009","unstructured":"Walshe K. Pseudoinnovation: the development and spread of healthcare quality improvement methodologies. Int J Qual Health Care. 2009;21(3):153\u20139.","journal-title":"Int J Qual Health Care"},{"issue":"3","key":"5661_CR2","doi-asserted-by":"publisher","first-page":"203","DOI":"10.7861\/futurehosp.3-3-203","volume":"3","author":"K Stewart","year":"2016","unstructured":"Stewart K, Bray B, Buckingham R. Improving quality of care through national clinical audit. Future Hosp J. 2016;3(3):203\u20136.","journal-title":"Future Hosp J"},{"issue":"2","key":"5661_CR3","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1177\/1355819615612826","volume":"21","author":"A Taylor","year":"2016","unstructured":"Taylor A, Neuburger J, Walker K, Cromwell D, Groene O. How is feedback from national clinical audits used? Views from English National Health Service trust audit leads. J Health Serv Res Policy. 2016;21(2):91\u2013100.","journal-title":"J Health Serv Res Policy"},{"key":"5661_CR4","unstructured":"Allwood D. Engaging clinicians in quality improvement through national clinical audit. Rep to Health Qual Improv Partnersh. 2014;2014."},{"issue":"9","key":"5661_CR5","doi-asserted-by":"publisher","first-page":"1004","DOI":"10.1136\/hrt.2004.034470","volume":"90","author":"JS Birkhead","year":"2004","unstructured":"Birkhead JS, Walker L, Pearson M, Weston C, Cunningham AD, Rickards AF. Improving care for patients with acute coronary syndromes: initial results from the National Audit of myocardial infarction project (MINAP). Heart. 2004;90(9):1004\u20139.","journal-title":"Heart."},{"issue":"8","key":"5661_CR6","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1097\/MLR.0000000000000383","volume":"53","author":"J Neuburger","year":"2015","unstructured":"Neuburger J, Currie C, Wakeman R, Tsang C, Plant F, De Stavola B, et al. The impact of a national clinician-led audit initiative on care and mortality after hip fracture in England: an external evaluation using time trends in non-audit data. Med Care. 2015;53(8):686.","journal-title":"Med Care"},{"issue":"5","key":"5661_CR7","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1016\/j.ijmedinf.2010.01.011","volume":"79","author":"SN van der Veer","year":"2010","unstructured":"van der Veer SN, de Keizer NF, Ravelli AC, Tenkink S, Jager KJ. Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. Int J Med Inform. 2010;79(5):305\u201323.","journal-title":"Int J Med Inform"},{"key":"5661_CR8","volume-title":"Best practice tariffs and their impact: November 2012: Audit Commission","author":"Authorities ACfL, England tNHSi, Wales","year":"2012","unstructured":"Authorities ACfL, England tNHSi, Wales. Best practice tariffs and their impact: November 2012: Audit Commission; 2012."},{"key":"5661_CR9","first-page":"253","volume":"253","author":"J Begun","year":"2003","unstructured":"Begun J, Zimmerman B, Dooley K. Health care organizations as complex adaptive systems. Adv Health Care Org Theory. 2003;253:253\u201388.","journal-title":"Adv Health Care Org Theory"},{"issue":"1","key":"5661_CR10","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1186\/s13012-017-0646-0","volume":"12","author":"HL Colquhoun","year":"2017","unstructured":"Colquhoun HL, Carroll K, Eva KW, Grimshaw JM, Ivers N, Michie S, et al. Advancing the literature on designing audit and feedback interventions: identifying theory-informed hypotheses. Implement Sci. 2017;12(1):117.","journal-title":"Implement Sci"},{"issue":"3","key":"5661_CR11","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1136\/bmjqs-2014-003627","volume":"24","author":"F Davidoff","year":"2015","unstructured":"Davidoff F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Qual Saf. 2015;24(3):228\u201338.","journal-title":"BMJ Qual Saf"},{"key":"5661_CR12","doi-asserted-by":"crossref","unstructured":"Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6.","DOI":"10.1002\/14651858.CD000259.pub3"},{"issue":"2","key":"5661_CR13","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1177\/109821409902000205","volume":"20","author":"S Sidani","year":"1999","unstructured":"Sidani S, Sechrest L. Putting program theory into operation. Am J Eval. 1999;20(2):227\u201338.","journal-title":"Am J Eval"},{"key":"5661_CR14","unstructured":"Pawson R, Tilley N, Tilley N. Realistic evaluation. London: Sage; 1997."},{"issue":"8","key":"5661_CR15","doi-asserted-by":"publisher","first-page":"e008567","DOI":"10.1136\/bmjopen-2015-008567","volume":"5","author":"T Greenhalgh","year":"2015","unstructured":"Greenhalgh T, Wong G, Jagosh J, Greenhalgh J, Manzano A, Westhorp G, et al. Protocol\u2014the RAMESES II study: developing guidance and reporting standards for realist evaluation. BMJ Open. 2015;5(8):e008567.","journal-title":"BMJ Open"},{"issue":"1","key":"5661_CR16","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1186\/s13012-015-0237-x","volume":"10","author":"SM Dalkin","year":"2015","unstructured":"Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What\u2019s in a mechanism? Development of a key concept in realist evaluation. Implement Sci. 2015;10(1):49.","journal-title":"Implement Sci"},{"key":"5661_CR17","first-page":"141","volume-title":"Elaborating the Context-Mechanism-Outcome configuration (CMOc) in realist evaluation: A critical realist perspective","author":"DE de Souza","year":"2013","unstructured":"de Souza DE. Elaborating the Context-Mechanism-Outcome configuration (CMOc) in realist evaluation: A critical realist perspective. 2013;19(2):141\u2013154."},{"issue":"3","key":"5661_CR18","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1177\/1356389016638615","volume":"22","author":"A Manzano","year":"2016","unstructured":"Manzano A. The craft of interviewing in realist evaluation. Evaluation. 2016;22(3):342\u201360.","journal-title":"Evaluation."},{"key":"5661_CR19","doi-asserted-by":"crossref","unstructured":"Ritchie J, Lewis J, Elam RG. Selecting samples. Qual Res Pract. 2013;111.","DOI":"10.1386\/cost.4.1.111_5"},{"issue":"1","key":"5661_CR20","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/1748-5908-1-4","volume":"1","author":"Improved C, Effectiveness, through, Behavioural, Research, Group","year":"2006","unstructured":"Improved C, Effectiveness, through, Behavioural, Research, Group. Designing theoretically-informed implementation interventions. Implement Sci. 2006;1(1):4.","journal-title":"Implement Sci"},{"key":"5661_CR21","doi-asserted-by":"publisher","unstructured":"Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In: Huberman AM & Miles MB. The qualitative researcher's companion. Thousand Oaks: SAGE Publications, Inc. 2002. pp. 305-29. https:\/\/doi.org\/10.4135\/9781412986274.","DOI":"10.4135\/9781412986274"},{"key":"5661_CR22","unstructured":"Marchal BVB, S; Westhorp, G; Peersman, G. Realist evaluation online: online. Available from: https:\/\/www.betterevaluation.org\/en\/approach\/realist_evaluation; [cited 2020]."},{"issue":"3\u20134","key":"5661_CR23","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1017\/S1744133117000494","volume":"13","author":"C Propper","year":"2018","unstructured":"Propper C. Competition in health care: lessons from the English experience. Health Econ Policy Law. 2018;13(3\u20134):492\u2013508.","journal-title":"Health Econ Policy Law"},{"issue":"4","key":"5661_CR24","doi-asserted-by":"publisher","first-page":"1150","DOI":"10.1377\/hlthaff.24.4.1150","volume":"24","author":"JH Hibbard","year":"2005","unstructured":"Hibbard JH, Stockard J, Tusler M. Hospital performance reports: impact on quality, market share, and reputation. Health Aff. 2005;24(4):1150\u201360.","journal-title":"Health Aff"},{"issue":"6","key":"5661_CR25","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1111\/1467-9566.12111","volume":"36","author":"D Allen","year":"2014","unstructured":"Allen D. Lost in translation?\u2018Evidence\u2019and the articulation of institutional logics in integrated care pathways: from positive to negative boundary object? Sociol Health Illn. 2014;36(6):807\u201322.","journal-title":"Sociol Health Illn"},{"issue":"5","key":"5661_CR26","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1111\/1467-9566.12096","volume":"36","author":"B Hunter","year":"2014","unstructured":"Hunter B, Segrott J. Renegotiating inter-professional boundaries in maternity care: implementing a clinical pathway for normal labour. Sociol Health Illn. 2014;36(5):719\u201337.","journal-title":"Sociol Health Illn"},{"issue":"2","key":"5661_CR27","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1016\/S0741-5214(98)70180-6","volume":"28","author":"J Goldstone","year":"1998","unstructured":"Goldstone J. The role of quality assurance versus continuous quality improvement. J Vasc Surg. 1998;28(2):378\u201380.","journal-title":"J Vasc Surg"},{"key":"5661_CR28","doi-asserted-by":"publisher","unstructured":"Batalden PB, Davidoff F. What is \"quality improvement\" and how can it transform healthcare?. Qual Saf Health Care. 2007;16(1):2\u20133. https:\/\/doi.org\/10.1136\/qshc.2006.022046.","DOI":"10.1136\/qshc.2006.022046"},{"issue":"1","key":"5661_CR29","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1186\/s12913-019-3940-5","volume":"19","author":"CL Egholm","year":"2019","unstructured":"Egholm CL, Helmark C, Doherty P, Nilsen P, Zwisler A-D, Bunkenborg G. \u201cStruggling with practices\u201d \u2013 a qualitative study of factors influencing the implementation of clinical quality registries for cardiac rehabilitation in England and Denmark. BMC Health Serv Res. 2019;19(1):102.","journal-title":"BMC Health Serv Res"}],"container-title":["BMC Health Services Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-020-05661-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12913-020-05661-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-020-05661-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,11]],"date-time":"2021-09-11T00:07:46Z","timestamp":1631318866000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmchealthservres.biomedcentral.com\/articles\/10.1186\/s12913-020-05661-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,11]]},"references-count":29,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["5661"],"URL":"https:\/\/doi.org\/10.1186\/s12913-020-05661-0","relation":{},"ISSN":["1472-6963"],"issn-type":[{"type":"electronic","value":"1472-6963"}],"subject":[],"published":{"date-parts":[[2020,9,11]]},"assertion":[{"value":"6 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 August 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 September 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Ethics approval was received from the University of Leeds, School of Healthcare Research Ethics Committee (Approval no. HREC16\u2013044). Interview participants gave written informed consent to participate in the study.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Chris Gale is a member of the Myocardial Infarction National Audit Programme (MINAP) Academic and Steering Groups, and Patrick Doherty is Chair of Cardiovascular Health in the Department of Health Sciences and Director of the British Heart Foundation National Audit of Cardiac Rehabilitation (NACR).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"859"}}