{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T01:40:09Z","timestamp":1784943609340,"version":"3.55.0"},"reference-count":34,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T00:00:00Z","timestamp":1773532800000},"content-version":"vor","delay-in-days":73,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"name":"Belgian National Institute for Health and Disability Insurance"},{"DOI":"10.13039\/501100011878","name":"Flemish Government","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100011878","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,1,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Electronic health records (EHRs) can potentially revolutionize primary care by enhancing data storage, \u00adcommunication, and quality measure reporting. The COVID-19 pandemic accelerated the adoption of digital tools in Belgium, highlighting the potential of EHR data in audit and feedback (A&amp;F) strategies. This study aims to outline the design and national implementation process of automated A&amp;F monitoring instruments (locally known as barometers), in Belgian \u00adprimary care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Using Clinical Performance Feedback Intervention Theory, we developed three monitoring instruments for primary care: COVID-19 vaccination coverage, type 2 diabetes management, and appropriate antibiotic use. Quality indicators were selected at the national level using a Rand-modified Delphi method and validated by the Flemish Institute for Quality of Health Care (VIKZ). Data were collected from general practitioners\u2019 EHR systems, aggregated at the practice level, and analyzed using the Healthdata.be platform. Feedback was provided through the Healthstat.be interface, incorporating local and regional benchmarks and evidence-based recommendations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The COVID-19 vaccination monitoring instrument included 5223 GPs from 2269 practices, the type 2 diabetes monitoring instrument involved 9373 GPs from 3596 practices, and the antibiotics monitoring instrument covered 10 486 GPs from 3724 practices. These monitoring instruments collectively covered approximately eight million patients. Feedback reports were designed to be low in cognitive load, frequent, and benchmarked against the best-performing decile of practices. Integration of active, in-EHR delivery and formal evaluation of use are planned for future phases.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The implementation of automated A&amp;F instruments in Belgian primary care demonstrated the feasibility and scalability of such systems. These monitoring instruments can provide valuable insights for quality improvement and support the transition toward a Learning Health System. Future work will focus on expanding the range of monitoring instruments and integrating active feedback mechanisms within EHR systems.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/intqhc\/mzag037","type":"journal-article","created":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T12:46:56Z","timestamp":1773233216000},"source":"Crossref","is-referenced-by-count":1,"title":["Development and early implementation of automated audit and feedback monitoring instruments in Belgian primary care: lessons for scalable systems"],"prefix":"10.1093","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9591-3974","authenticated-orcid":false,"given":"Willem","family":"Raat","sequence":"first","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0744-3923","authenticated-orcid":false,"given":"Steve","family":"Van den Bulck","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven,","place":["Belgium"]},{"name":"Research Group Healthcare and Ethics, Faculty of Medicine and Life Sciences, UHasselt , Diepenbeek,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justine","family":"Soetaert","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marie","family":"Van de Putte","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gijs","family":"Van Pottelbergh","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robrecht","family":"De Schreye","sequence":"additional","affiliation":[{"name":"Health Services Research, Sciensano , Brussels,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bert","family":"Aertgeerts","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5244-1930","authenticated-orcid":false,"given":"Bert","family":"Vaes","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,3,15]]},"reference":[{"key":"2026032309172636400_mzag037-B1","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1007\/978-3-319-93003-9_7","volume-title":"Behavioral Medicine and Integrated Care: Efficient Delivery of Effective Treatments","author":"Edberg","year":"2018"},{"key":"2026032309172636400_mzag037-B2","doi-asserted-by":"publisher","author":"European Commission: Directorate-General for Communications Networks, Content and Technology, Open Evidence, RAND Europe, BDI Research, Benchmarking deployment of eHealth among general practitioners (2018) : final report. Publications Office;","year":"2018","DOI":"10.2759\/511610"},{"key":"2026032309172636400_mzag037-B3","doi-asserted-by":"publisher","first-page":"CD000259","DOI":"10.1002\/14651858.CD000259.pub4","article-title":"Audit and feedback: effects on professional practice","volume":"3","author":"Ivers","year":"2025","journal-title":"Cochrane Database Syst Rev"},{"key":"2026032309172636400_mzag037-B4","author":"NHS England Digital [Internet]"},{"key":"2026032309172636400_mzag037-B5","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1093\/jamia\/ocaa287","article-title":"Use of electronic health records to support a public health response to the COVID-19 pandemic in the United States: a perspective from 15 academic medical centers","volume":"28","author":"Madhavan","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2026032309172636400_mzag037-B6","doi-asserted-by":"publisher","first-page":"1592","DOI":"10.1016\/j.mayocp.2021.04.008","article-title":"Leveraging the electronic health record to address the COVID-19 pandemic","volume":"96","author":"Satterfield","year":"2021","journal-title":"Mayo Clin Proc"},{"key":"2026032309172636400_mzag037-B7","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1186\/s13690-022-01003-0","article-title":"Burden of COVID-19 on primary care in Belgium: a prospective nationwide observational study from March to August 2020","volume":"80","author":"Vaes","year":"2022","journal-title":"Arch Public Health"},{"key":"2026032309172636400_mzag037-B8","author":"Vos","year":"2024"},{"key":"2026032309172636400_mzag037-B9","author":"De COVID-19-vaccinatiebarometer: optimaliseer de vaccinatiegraad in uw praktijk!"},{"key":"2026032309172636400_mzag037-B10","author":"Intego"},{"key":"2026032309172636400_mzag037-B11","author":"Intego"},{"key":"2026032309172636400_mzag037-B12","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1038\/s41572-022-00376-4","article-title":"Multimorbidity","volume":"8","author":"Skou","year":"2022","journal-title":"Nat Rev Dis Primers"},{"key":"2026032309172636400_mzag037-B13","doi-asserted-by":"publisher","first-page":"e0279291","DOI":"10.1371\/journal.pone.0279291","article-title":"An exploration of under-registration of chronic kidney disease stages 3\u20135 in Belgian general practices using logistic regression","volume":"17","author":"Wyngaert","year":"2022","journal-title":"PLoS One"},{"key":"2026032309172636400_mzag037-B14","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1002\/ehf2.13724","article-title":"Machine learning optimization of an electronic health record audit for heart failure in primary care","volume":"9","author":"Raat","year":"2022","journal-title":"ESC Heart Fail"},{"key":"2026032309172636400_mzag037-B15","doi-asserted-by":"publisher","first-page":"3627","DOI":"10.1093\/eurheartj\/ehad195","article-title":"2023 Focused update of the 2021 ESC guidelines for the diagnosis and treatment of acute and chronic heart failure: developed by the task force for the diagnosis and treatment of acute and chronic heart failure of the european society of cardiology (ESC) with the special contribution of the heart failure association (HFA) of the ESC","volume":"44","author":"McDonagh","year":"2023","journal-title":"Eur Heart J"},{"key":"2026032309172636400_mzag037-B16","doi-asserted-by":"publisher","first-page":"S117","DOI":"10.1016\/j.kint.2023.10.018","article-title":"KDIGO 2024 clinical practice guideline for the evaluation and management of chronic kidney disease","volume":"105","author":"Stevens","year":"2024","journal-title":"Kidney Int"},{"key":"2026032309172636400_mzag037-B17","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1186\/s13012-019-0883-5","article-title":"Clinical performance feedback intervention theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research","volume":"14","author":"Brown","year":"2019","journal-title":"Implement Sci"},{"key":"2026032309172636400_mzag037-B18","doi-asserted-by":"publisher","first-page":"e11428","DOI":"10.2196\/11428","article-title":"Health data for research through a nationwide privacy-proof system in Belgium: design and implementation","volume":"6","author":"Delvaux","year":"2018","journal-title":"JMIR Med Inform"},{"key":"2026032309172636400_mzag037-B19","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1186\/1472-6947-14-48","article-title":"The Intego database: background, methods and basic results of a Flemish general practice-based continuous morbidity registration project","volume":"14","author":"Truyers","year":"2014","journal-title":"BMC Med Inform Decis Mak"},{"key":"2026032309172636400_mzag037-B20","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/1748-5908-7-21","article-title":"Methods for the guideline-based development of quality indicators\u2014a systematic review","volume":"7","author":"K\u00f6tter","year":"2012","journal-title":"Implement Sci IS"},{"key":"2026032309172636400_mzag037-B21","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.pcd.2019.05.002","article-title":"Development of quality indicators for type 2 diabetes, extractable from the electronic health record of the general physician. A rand-modified Delphi method","volume":"14","author":"Van den Bulck","year":"2020","journal-title":"Prim Care Diabetes"},{"key":"2026032309172636400_mzag037-B22","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1136\/bmjqs.2010.049049","article-title":"European surveillance of antimicrobial consumption (ESAC): disease-specific quality indicators for outpatient antibiotic prescribing","volume":"20","author":"Adriaenssens","year":"2011","journal-title":"BMJ Qual Saf"},{"key":"2026032309172636400_mzag037-B23","author":"Home | Agoria [Internet]"},{"key":"2026032309172636400_mzag037-B24","doi-asserted-by":"publisher","first-page":"CD000259","DOI":"10.1002\/14651858.CD000259.pub3","article-title":"Audit and feedback: effects on professional practice and healthcare outcomes","volume":"2012","author":"Ivers","year":"2012","journal-title":"Cochrane Database Syst Rev"},{"key":"2026032309172636400_mzag037-B25","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1093\/intqhc\/mzaa128","article-title":"The effect of electronic audits and feedback in primary care and factors that contribute to their effectiveness: a systematic review","volume":"32","author":"Van Den Bulck","year":"2020","journal-title":"Int J Qual Health Care"},{"key":"2026032309172636400_mzag037-B26","doi-asserted-by":"publisher","first-page":"2871","DOI":"10.1001\/jama.285.22.2871","article-title":"Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial","volume":"285","author":"Kiefe","year":"2001","journal-title":"JAMA"},{"key":"2026032309172636400_mzag037-B27","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1046\/j.1365-2753.1999.00203.x","article-title":"Achievable benchmarks of care: the ABCs of benchmarking","volume":"5","author":"Weissman","year":"1999","journal-title":"J Eval Clin Pract"},{"key":"2026032309172636400_mzag037-B28","author":"Over het VIKZ | Zorgkwaliteit.be [Internet]"},{"key":"2026032309172636400_mzag037-B29","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1186\/s12913-024-10915-2","article-title":"Developing a questionnaire to evaluate an automated audit & feedback intervention: a Rand-modified Delphi method","volume":"24","author":"Van den Wyngaert","year":"2024","journal-title":"BMC Health Serv Res"},{"key":"2026032309172636400_mzag037-B30","author":"GDPR.eu [Internet]","year":"2018"},{"key":"2026032309172636400_mzag037-B31","doi-asserted-by":"publisher","first-page":"e12","DOI":"10.1016\/j.ijmedinf.2010.10.005","article-title":"eHealth in Belgium, a new \u201csecure\u201d federal network: role of patients, health professions and social security services","volume":"80","author":"France","year":"2011","journal-title":"Int J Med Inform"},{"key":"2026032309172636400_mzag037-B32","author":"Roadmap 4.0 | eGezondheid [Internet]"},{"key":"2026032309172636400_mzag037-B33","author":"About Learning Health Systems [Internet]"},{"key":"2026032309172636400_mzag037-B34","doi-asserted-by":"publisher","first-page":"105148","DOI":"10.1016\/j.healthpol.2024.105148","article-title":"Lessons learned from a pay-for-performance scheme for appropriate prescribing using electronic health records from general practices in The Netherlands","volume":"149","author":"Arslan","year":"2024","journal-title":"Health Policy (New York)"}],"container-title":["International Journal for Quality in Health Care"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/intqhc\/advance-article-pdf\/doi\/10.1093\/intqhc\/mzag037\/67360286\/mzag037.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/intqhc\/article-pdf\/38\/1\/mzag037\/67360286\/mzag037.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/intqhc\/article-pdf\/38\/1\/mzag037\/67360286\/mzag037.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T13:17:34Z","timestamp":1774271854000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/intqhc\/article\/doi\/10.1093\/intqhc\/mzag037\/8524330"}},"subtitle":[],"editor":[{"given":"Siobh\u00e1n","family":"McCarthy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,10]]}},"URL":"https:\/\/doi.org\/10.1093\/intqhc\/mzag037","relation":{},"ISSN":["1353-4505","1464-3677"],"issn-type":[{"value":"1353-4505","type":"print"},{"value":"1464-3677","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,1]]},"published":{"date-parts":[[2026,1]]},"article-number":"mzag037"}}