{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T18:05:51Z","timestamp":1787162751223,"version":"build-2736575974"},"reference-count":29,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T00:00:00Z","timestamp":1764892800000},"content-version":"vor","delay-in-days":1473,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"},{"start":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T00:00:00Z","timestamp":1637625600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Aims<\/jats:title>\n                    <jats:p>The diagnosis of heart failure (HF) is an important problem in primary care. We previously demonstrated a 74% increase in registered HF diagnoses in primary care electronic health records (EHRs) following an extended audit procedure. What remains unclear is the accuracy of registered HF pre-audit and which EHR variables are most important in the extended audit strategy. This study aims to describe the diagnostic HF classification sequence at different stages, assess general practitioner (GP) HF misclassification, and test the predictive performance of an optimized audit.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods and results<\/jats:title>\n                    <jats:p>This is a secondary analysis of the OSCAR-HF study, a prospective observational trial including 51 participating GPs. OSCAR used an extended audit based on typical HF risk factors, signs, symptoms, and medications in GPs' EHR. This resulted in a list of possible HF patients, which participating GPs had to classify as HF or non-HF. We compared registered HF diagnoses before and after GPs' assessment. For our analysis of audit performance, we used GPs' assessment of HF as primary outcome and audit queries as dichotomous predictor variables for a gradient boosted machine (GBM) decision tree algorithm and logistic regression model. Of the 18 011 patients eligible for the audit intervention, 4678 (26.0%) were identified as possible HF patients and submitted for GPs' assessment in the audit stage. There were 310 patients with registered HF before GP assessment, of whom 146 (47.1%) were judged not to have HF by their GP (over-registration). There were 538 patients with registered HF after GP assessment, of whom 374 (69.5%) did not have registered HF before GP assessment (under-registration). The GBM and logistic regression model had a comparable predictive performance (area under the curve of 0.70 [95% confidence interval 0.65\u20130.77] and 0.69 [95% confidence interval 0.64\u20130.75], respectively). This was not significantly impacted by reducing the set of predictor variables to the 10 most important variables identified in the GBM model (free-text and coded cardiomyopathy, ischaemic heart disease and atrial fibrillation, digoxin, mineralocorticoid receptor antagonists, and combinations of renin-angiotensin system inhibitors and beta-blockers with diuretics). This optimized query set was enough to identify 86% (n = 461\/538) of GPs' self-assessed HF population with a 33% reduction (n = 1537\/4678) in screening caseload.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Diagnostic coding of HF in primary care health records is inaccurate with a high degree of under-registration and over-registration. An optimized query set enabled identification of more than 80% of GPs' self-assessed HF population.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/ehf2.13724","type":"journal-article","created":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T20:13:30Z","timestamp":1637698410000},"page":"39-47","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Machine Learning Optimization of an Electronic Health Record Audit for Heart Failure in Primary Care"],"prefix":"10.1093","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9591-3974","authenticated-orcid":false,"given":"Willem","family":"Raat","sequence":"first","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miek","family":"Smeets","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Severine","family":"Henrard","sequence":"additional","affiliation":[{"name":"Louvain Drug Research Institute, Clinical Pharmacy Research Group (CLIP) and Institute of Health and Society (IRSS), Universit\u00e9 catholique de Louvain (UCLouvain) , Brussels ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bert","family":"Aertgeerts","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joris","family":"Penders","sequence":"additional","affiliation":[{"name":"Ziekenhuis Oost-Limburg , Genk ,","place":["Belgium"]},{"name":"University of Hasselt , Hasselt ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Walter","family":"Droogne","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Diseases, University Hospitals Leuven, KU Leuven , Leuven ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wilfried","family":"Mullens","sequence":"additional","affiliation":[{"name":"Ziekenhuis Oost-Limburg , Genk ,","place":["Belgium"]},{"name":"University of Hasselt , Hasselt ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Janssens","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Diseases, University Hospitals Leuven, KU Leuven , Leuven ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bert","family":"Vaes","sequence":"additional","affiliation":[{"name":"Department of Public Health and Primary Care, KU Leuven , Leuven ,","place":["Belgium"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,11,23]]},"reference":[{"key":"2026012114185380100_ehf213724-bib-0001","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1016\/S0140-6736(17)32520-5","article-title":"Temporal trends and patterns in heart failure incidence: a population-based study of 4 million individuals","volume":"391","author":"Conrad","year":"2018","journal-title":"Lancet (London, England)"},{"key":"2026012114185380100_ehf213724-bib-0002","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1002\/ejhf.1345","article-title":"Near-home heart failure care","volume":"21","author":"Groenewegen","year":"2019","journal-title":"Eur J Heart Fail"},{"key":"2026012114185380100_ehf213724-bib-0003","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1002\/ejhf.110","article-title":"Prevalence of unrecognized heart failure in older persons with shortness of breath on exertion","volume":"16","author":"van Riet","year":"2014","journal-title":"Eur J Heart Fail"},{"key":"2026012114185380100_ehf213724-bib-0004","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1093\/eurjhf\/hfn006","article-title":"Adequacy of diagnosis and treatment of chronic heart failure in primary health care in Sweden","volume":"11","author":"Dahlstrom","year":"2009","journal-title":"Eur J Heart Fail"},{"key":"2026012114185380100_ehf213724-bib-0005","doi-asserted-by":"crossref","first-page":"e587","DOI":"10.3399\/bjgp16X685705","article-title":"Overdiagnosis of heart failure in primary care: a cross-sectional study","volume":"66","author":"Valk","year":"2016","journal-title":"Br J Gen Pract"},{"key":"2026012114185380100_ehf213724-bib-0006","doi-asserted-by":"crossref","first-page":"e454","DOI":"10.3399\/bjgp19X704105","article-title":"Improving coding and primary care management for patients with chronic kidney disease: an observational controlled study in East London","volume":"69","author":"Hull","year":"2019","journal-title":"Br J Gen Pract"},{"key":"2026012114185380100_ehf213724-bib-0007","volume-title":"National chronic kidney disease audit: national report (Part 1)","author":"Nitsch","year":"2017"},{"key":"2026012114185380100_ehf213724-bib-0008","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1111\/j.1525-1497.2005.40206.x","article-title":"Clinical implications of an accurate problem list on heart failure treatment","volume":"20","author":"Hartung","year":"2005","journal-title":"J Gen Intern Med"},{"key":"2026012114185380100_ehf213724-bib-0009","doi-asserted-by":"crossref","DOI":"10.1002\/14651858.CD000259.pub3","article-title":"Audit and feedback: effects on professional practice and healthcare outcomes","author":"Ivers","year":"2012","journal-title":"Cochrane Database Syst Rev"},{"key":"2026012114185380100_ehf213724-bib-0010","doi-asserted-by":"crossref","first-page":"3950","DOI":"10.1002\/ehf2.12990","article-title":"Impact of an extended audit on identifying heart failure patients in general practice: baseline results of the OSCAR-HF pilot study","volume":"7","author":"Smeets","year":"2020","journal-title":"ESC Heart Fail"},{"key":"2026012114185380100_ehf213724-bib-0011","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1080\/00015385.2018.1507426","article-title":"Optimising standards of care of heart failure in general practice the OSCAR-HF pilot study protocol","volume":"74","author":"Smeets","year":"2018","journal-title":"Acta Cardiol"},{"key":"2026012114185380100_ehf213724-bib-0012","volume-title":"Registration of Electronic Health Records for Use in General Practice","author":"RAMIT","year":"2019"},{"key":"2026012114185380100_ehf213724-bib-0013"},{"key":"2026012114185380100_ehf213724-bib-0014","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-6849-3","volume-title":"Applied Predictive Modeling","author":"Kuhn","year":"2013"},{"key":"2026012114185380100_ehf213724-bib-0015","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: a gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann Statist"},{"key":"2026012114185380100_ehf213724-bib-0016","doi-asserted-by":"crossref","DOI":"10.18637\/jss.v028.i05","article-title":"Building predictive models in R using the caret package","volume":"28","author":"Kuhn","year":"2008","journal-title":"J Stat Softw"},{"key":"2026012114185380100_ehf213724-bib-0017","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1186\/1471-2105-12-77","article-title":"pROC: an open-source package for R and S+ to analyze and compare ROC curves","volume":"12","author":"Robin","year":"2011","journal-title":"BMC Bioinform"},{"key":"2026012114185380100_ehf213724-bib-0018","volume-title":"Aalter, Belgium: Corilus","author":"Medidoc"},{"key":"2026012114185380100_ehf213724-bib-0019","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1080\/13814788.2017.1305104","article-title":"Validation of heart failure diagnosis registered in primary care records in two primary care centres in Barcelona (Spain) and factors related. A cross-sectional study","volume":"23","author":"Verdu-Rotellar","year":"2017","journal-title":"Eur J Gen Pract"},{"key":"2026012114185380100_ehf213724-bib-0020","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0218919","article-title":"A diagnostic accuracy study validating cardiovascular ICD-9-CM codes in healthcare administrative databases. The Umbria Data-Value Project","volume":"14","author":"Cozzolino","year":"2019","journal-title":"PLoS ONE"},{"key":"2026012114185380100_ehf213724-bib-0021","first-page":"36","article-title":"Validity of heart failure diagnoses made in 2000\u20132012 in western Sweden","volume":"7","author":"Schaufelberger","year":"2020","journal-title":"ESC Heart Fail"},{"key":"2026012114185380100_ehf213724-bib-0022","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1016\/j.ejheart.2004.12.007","article-title":"The validity of a diagnosis of heart failure in a hospital discharge register","volume":"7","author":"Ingelsson","year":"2005","journal-title":"Eur J Heart Fail"},{"key":"2026012114185380100_ehf213724-bib-0023","article-title":"Quality improvement into practice","volume":"368","author":"Backhouse","year":"2020","journal-title":"BMJ"},{"key":"2026012114185380100_ehf213724-bib-0024","first-page":"211","article-title":"Prescription in patients with chronic heart failure and multimorbidity attended in primary care","volume":"21","author":"Frigola-Capell","year":"2013","journal-title":"Qual Prim Care"},{"key":"2026012114185380100_ehf213724-bib-0025","doi-asserted-by":"crossref","first-page":"3","DOI":"10.3109\/13814788.2012.717925","article-title":"The care for chronic heart failure by general practitioners. Results from a clinical audit in Italy","volume":"19","author":"Cancian","journal-title":"Eur J Gen Pract"},{"key":"2026012114185380100_ehf213724-bib-0026","doi-asserted-by":"crossref","first-page":"160","DOI":"10.24095\/hpcdp.33.3.06","article-title":"Identifying cases of congestive heart failure from administrative data: a validation study using primary care patient records","volume":"33","author":"Schultz","year":"2013","journal-title":"Chronic Dis Inj Can"},{"key":"2026012114185380100_ehf213724-bib-0027","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2016-012413","article-title":"Automatic identification of type 2 diabetes, hypertension, ischaemic heart disease, heart failure and their levels of severity from Italian general practitioners' electronic medical records: a validation study","volume":"6","author":"Gini","year":"2016","journal-title":"BMJ Open"},{"key":"2026012114185380100_ehf213724-bib-0028","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1002\/pds.2313","article-title":"A systematic review of validated methods for identifying heart failure using administrative data","volume":"21","author":"Saczynski","year":"2012","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"2026012114185380100_ehf213724-bib-0029","article-title":"Validity of heart failure diagnoses in administrative databases: a systematic review and meta-analysis","volume":"9","author":"McCormick","year":"2014","journal-title":"PLoS ONE"}],"container-title":["ESC Heart Failure"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ehf2.13724","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/ehf2.13724","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/eschf\/article-pdf\/9\/1\/39\/65375017\/eschf_9_1_39.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/eschf\/article-pdf\/9\/1\/39\/65375017\/eschf_9_1_39.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T19:22:24Z","timestamp":1769023344000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/eschf\/article\/9\/1\/39\/8326403"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,23]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,11,23]]},"published-print":{"date-parts":[[2022,2,1]]}},"URL":"https:\/\/doi.org\/10.1002\/ehf2.13724","relation":{},"ISSN":["2055-5822"],"issn-type":[{"value":"2055-5822","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,2]]},"published":{"date-parts":[[2021,11,23]]},"assertion":[{"value":"2021-07-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-06","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}