{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T04:55:18Z","timestamp":1781067318635,"version":"3.54.1"},"reference-count":80,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MC-UU_00017\/3"],"award-info":[{"award-number":["MC-UU_00017\/3"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MC-UU_00017\/5"],"award-info":[{"award-number":["MC-UU_00017\/5"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000274","name":"British Heart Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000274","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000289","name":"Cancer Research UK","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000289","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100023699","name":"Health Data Research UK","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100023699","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Syst Rev"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Ascertainment of heart failure (HF) hospitalizations in cardiovascular trials is costly and complex, involving processes that could be streamlined by using routinely collected healthcare data (RCD). The utility of coded RCD for HF outcome ascertainment in randomized trials requires assessment. We systematically reviewed studies assessing RCD-based HF outcome ascertainment against \u201cgold standard\u201d (GS) methods to study the feasibility of using such methods in clinical trials.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Studies assessing International Classification of Disease (ICD) coded RCD-based HF outcome ascertainment against GS methods and reporting at least one agreement statistic were identified by searching MEDLINE and Embase from inception to May 2021. Data on study characteristics, details of RCD and GS data sources and definitions, and test statistics were reviewed. Summary sensitivities and specificities for studies ascertaining acute and prevalent HF were estimated using a bivariate random effects meta-analysis. Heterogeneity was evaluated using <jats:italic>I<\/jats:italic><jats:sup>2<\/jats:sup> statistics and hierarchical summary receiver operating characteristic (HSROC) curves.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>A total of 58 studies of 48,643 GS-adjudicated HF events were included in this review. Strategies used to improve case identification included the use of broader coding definitions, combining multiple data sources, and using machine learning algorithms to search free text data, but these methods were not always successful and at times reduced specificity in individual studies. Meta-analysis of 17 acute HF studies showed that RCD algorithms have high specificity (96.2%, 95% confidence interval [CI] 91.5\u201398.3), but lacked sensitivity (63.5%, 95% CI 51.3\u201374.1) with similar results for 21 prevalent HF studies. There was considerable heterogeneity between studies.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>RCD can correctly identify HF outcomes but may miss approximately one-third of events. Methods used to improve case identification should also focus on minimizing false positives.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s13643-024-02477-5","type":"journal-article","created":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T10:02:24Z","timestamp":1709287344000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Accuracy of heart failure ascertainment using routinely collected healthcare data: a systematic review and meta-analysis"],"prefix":"10.1186","volume":"13","author":[{"given":"Michelle. A.","family":"Goonasekera","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alison","family":"Offer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Waseem","family":"Karsan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muram","family":"El-Nayir","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy E.","family":"Mallorie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Parish","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard J.","family":"Haynes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0562-3963","authenticated-orcid":false,"given":"Marion M.","family":"Mafham","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,1]]},"reference":[{"issue":"9474","key":"2477_CR1","doi-asserted-by":"publisher","first-page":"1877","DOI":"10.1016\/S0140-6736(05)66621-4","volume":"365","author":"JJ McMurray","year":"2005","unstructured":"McMurray JJ, Pfeffer MA. Heart failure. Lancet. 2005;365(9474):1877\u201389.","journal-title":"Lancet"},{"issue":"10159","key":"2477_CR2","doi-asserted-by":"publisher","first-page":"1789","DOI":"10.1016\/S0140-6736(18)32279-7","volume":"392","author":"SL James","year":"2018","unstructured":"James SL, Abate D, Abate KH, Abay SM, Abbafati C, Abbasi N, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990\u20132017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392(10159):1789\u2013858.","journal-title":"Lancet"},{"issue":"15","key":"2477_CR3","doi-asserted-by":"publisher","first-page":"1682","DOI":"10.1093\/eurjpc\/zwaa147","volume":"28","author":"NL Bragazzi","year":"2021","unstructured":"Bragazzi NL, Zhong W, Shu J, Abu Much A, Lotan D, Grupper A, et al. Burden of heart failure and underlying causes in 195 countries and territories from 1990 to 2017. Eur J Prev Cardiol. 2021;28(15):1682\u201390.","journal-title":"Eur J Prev Cardiol"},{"issue":"2","key":"2477_CR4","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1177\/1740774515625964","volume":"13","author":"A Sertkaya","year":"2016","unstructured":"Sertkaya A, Wong HH, Jessup A, Beleche T. Key cost drivers of pharmaceutical clinical trials in the United States. Clin Trials. 2016;13(2):117\u201326.","journal-title":"Clin Trials"},{"key":"2477_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jclinepi.2017.12.018","volume":"96","author":"B Speich","year":"2018","unstructured":"Speich B, von Niederh\u00e4usern B, Schur N, Hemkens LG, F\u00fcrst T, Bhatnagar N, et al. Systematic review on costs and resource use of randomized clinical trials shows a lack of transparent and comprehensive data. J Clin Epidemiol. 2018;96:1\u201311.","journal-title":"J Clin Epidemiol"},{"issue":"15","key":"2477_CR6","doi-asserted-by":"publisher","first-page":"1156","DOI":"10.1136\/heartjnl-2017-311191","volume":"103","author":"F Zannad","year":"2017","unstructured":"Zannad F, Pfeffer MA, Bhatt DL, Bonds DE, Borer JS, Calvo-Rojas G, et al. Streamlining cardiovascular clinical trials to improve efficiency and generalisability. Heart. 2017;103(15):1156.","journal-title":"Heart"},{"issue":"9","key":"2477_CR7","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1093\/eurheartj\/eht535","volume":"35","author":"G Calvo","year":"2014","unstructured":"Calvo G, McMurray JJV, Granger CB, Alonso-Garc\u00eda \u00c1, Armstrong P, Flather M, et al. Large streamlined trials in cardiovascular disease. Eur Heart J. 2014;35(9):544\u20138.","journal-title":"Eur Heart J"},{"issue":"suppl C","key":"2477_CR8","doi-asserted-by":"publisher","first-page":"C14","DOI":"10.1093\/eurheartj\/suy001","volume":"20","author":"R Collins","year":"2018","unstructured":"Collins R. Back to the future: the urgent need to re-introduce streamlined trials. Eur Heart J Suppl. 2018;20(suppl C):C14\u20137.","journal-title":"Eur Heart J Suppl"},{"key":"2477_CR9","doi-asserted-by":"publisher","first-page":"e55","DOI":"10.1136\/bmj.e55","volume":"344","author":"T-P Van Staa","year":"2012","unstructured":"Van Staa T-P, Goldacre B, Gulliford M, Cassell J, Pirmohamed M, Taweel A, et al. Pragmatic randomized trials using routine electronic health records: putting them to the test. BMJ. 2012;344:e55.","journal-title":"BMJ"},{"issue":"10","key":"2477_CR10","doi-asserted-by":"publisher","first-page":"e1001885","DOI":"10.1371\/journal.pmed.1001885","volume":"12","author":"EI Benchimol","year":"2015","unstructured":"Benchimol EI, Smeeth L, Guttmann A, Harron K, Moher D, Petersen I, et al. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS Med. 2015;12(10):e1001885.","journal-title":"PLoS Med"},{"issue":"3","key":"2477_CR11","first-page":"232","volume":"68","author":"SM Cadarette","year":"2015","unstructured":"Cadarette SM, Wong L. An introduction to health care administrative data. Can J Hosp Pharm. 2015;68(3):232\u20137.","journal-title":"Can J Hosp Pharm"},{"issue":"6","key":"2477_CR12","doi-asserted-by":"publisher","first-page":"1006","DOI":"10.1097\/SLA.0000000000003247","volume":"272","author":"DA Etzioni","year":"2020","unstructured":"Etzioni DA, Lessow C, Bordeianou LG, Kunitake H, Deery SE, Carchman E, et al. Concordance between registry and administrative data in the determination of comorbidity: a multi-institutional study. Ann Surg. 2020;272(6):1006\u201311.","journal-title":"Ann Surg"},{"issue":"8","key":"2477_CR13","doi-asserted-by":"publisher","first-page":"e104519","DOI":"10.1371\/journal.pone.0104519","volume":"9","author":"N McCormick","year":"2014","unstructured":"McCormick N, Lacaille D, Bhole V, Avina-Zubieta JA. Validity of heart failure diagnoses in administrative databases: a systematic review and meta-analysis. Plos One. 2014;9(8):e104519.","journal-title":"Plos One"},{"issue":"8","key":"2477_CR14","doi-asserted-by":"publisher","first-page":"e306","DOI":"10.1016\/S0828-282X(10)70438-4","volume":"26","author":"S Quach","year":"2010","unstructured":"Quach S, Blais C, Quan H. Administrative data have high variation in validity for recording heart failure. Can J Cardiol. 2010;26(8):e306\u201312.","journal-title":"Can J Cardiol"},{"issue":"SUPPL. 1","key":"2477_CR15","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1002\/pds.2313","volume":"21","author":"JS Saczynski","year":"2012","unstructured":"Saczynski JS, Andrade SE, Harrold LR, Tjia J, Cutrona SL, Dodd KS, et al. A systematic review of validated methods for identifying heart failure using administrative data. Pharmacoepidemiol Drug Saf. 2012;21(SUPPL. 1):129\u201340.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"2477_CR16","doi-asserted-by":"publisher","first-page":"1095","DOI":"10.2147\/CLEP.S265619","volume":"12","author":"J Davidson","year":"2020","unstructured":"Davidson J, Banerjee A, Muzambi R, Smeeth L, Warren-Gash C. Validity of acute cardiovascular outcome diagnoses recorded in European electronic health records: a systematic review. Clin Epidemiol. 2020;12:1095\u2013111.","journal-title":"Clin Epidemiol"},{"key":"2477_CR17","doi-asserted-by":"publisher","first-page":"n71","DOI":"10.1136\/bmj.n71","volume":"372","author":"MJ Page","year":"2021","unstructured":"Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.","journal-title":"BMJ"},{"issue":"8","key":"2477_CR18","doi-asserted-by":"publisher","first-page":"529","DOI":"10.7326\/0003-4819-155-8-201110180-00009","volume":"155","author":"PF Whiting","year":"2011","unstructured":"Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529\u201336.","journal-title":"Ann Intern Med"},{"key":"2477_CR19","unstructured":"Seed P. DIAGT: Stata module to report summary statistics for diagnostic tests compared to true disease status. Statistical Software Components. 2010."},{"issue":"2","key":"2477_CR20","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1177\/1536867X0900900203","volume":"9","author":"RM Harbord","year":"2009","unstructured":"Harbord RM, Whiting P. Metandi: Meta-analysis of diagnostic accuracy using hierarchical logistic regression. Stata J. 2009;9(2):211\u201329.","journal-title":"Stata J"},{"key":"2477_CR21","unstructured":"Dwamena B. MIDAS: Stata module for meta-analytical integration of diagnostic test accuracy studies. Statistical Software Components. 2007."},{"issue":"9","key":"2477_CR22","doi-asserted-by":"publisher","first-page":"882","DOI":"10.1016\/j.jclinepi.2005.01.016","volume":"58","author":"JJ Deeks","year":"2005","unstructured":"Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. 2005;58(9):882\u201393.","journal-title":"J Clin Epidemiol"},{"key":"2477_CR23","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1186\/1472-6963-9-237","volume":"9","author":"F Alqaisi","year":"2009","unstructured":"Alqaisi F, Williams LK, Peterson EL, Lanfear DE. Comparing methods for identifying patients with heart failure using electronic data sources. BMC Health Serv Res. 2009;9:237.","journal-title":"BMC Health Serv Res"},{"issue":"2","key":"2477_CR24","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1067\/mhj.2002.123839","volume":"144","author":"PC Austin","year":"2002","unstructured":"Austin PC, Daly PA, Tu JV. A multicenter study of the coding accuracy of hospital discharge administrative data for patients admitted to cardiac care units in Ontario. Am Heart J. 2002;144(2):290\u20136.","journal-title":"Am Heart J"},{"issue":"3","key":"2477_CR25","first-page":"e407","volume":"18","author":"DF Blackburn","year":"2011","unstructured":"Blackburn DF, Shnell G, Lamb DA, Tsuyuki RT, Stang MR, Wilson TW. Coding of heart failure diagnoses in Saskatchewan: a validation study of hospital discharge abstracts. J Popul Ther Clin Pharmacol. 2011;18(3):e407\u201315.","journal-title":"J Popul Ther Clin Pharmacol"},{"issue":"2","key":"2477_CR26","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1002\/pds.4690","volume":"28","author":"P Bosco-Levy","year":"2019","unstructured":"Bosco-Levy P, Duret S, Picard F, Dos Santos P, Puymirat E, Gilleron V, et al. Diagnostic accuracy of the international classification of diseases, tenth revision, codes of heart failure in an administrative database. Pharmacoepidemiol Drug Saf. 2019;28(2):194\u2013200.","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"7","key":"2477_CR27","doi-asserted-by":"publisher","first-page":"e0218919","DOI":"10.1371\/journal.pone.0218919","volume":"14","author":"F Cozzolino","year":"2019","unstructured":"Cozzolino F, Montedori A, Abraha I, Eusebi P, Grisci C, Heymann AJ, et al. A diagnostic accuracy study validating cardiovascular ICD-9-CM codes in healthcare administrative databases. The Umbria data-value project. PLoS ONE. 2019;14(7):e0218919.","journal-title":"PLoS ONE"},{"issue":"2","key":"2477_CR28","doi-asserted-by":"publisher","first-page":"243","DOI":"10.2105\/AJPH.82.2.243","volume":"82","author":"ES Fisher","year":"1992","unstructured":"Fisher ES, Whaley FS, Krushat WM, Malenka DJ, Fleming C, Baron JA, et al. The accuracy of Medicare\u2019s hospital claims data: progress has been made, but problems remain. Am J Public Health. 1992;82(2):243\u20138.","journal-title":"Am J Public Health"},{"issue":"4","key":"2477_CR29","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1111\/j.1751-7133.2008.07752.x","volume":"14","author":"C Fonseca","year":"2008","unstructured":"Fonseca C, Sarmento PM, Marques F, Ceia F. Validity of a discharge diagnosis of heart failure: implications of misdiagnosing. Congest Heart Fail. 2008;14(4):187\u201391.","journal-title":"Congest Heart Fail"},{"issue":"5","key":"2477_CR30","first-page":"386","volume":"3","author":"N Frolova","year":"2015","unstructured":"Frolova N, Bakal JA, McAlister FA, Rowe BH, Quan H, Kaul P, et al. Assessing the use of international classification of revision codes from the emergency department for the identification of acute heart failure. JACC: Heart Fail. 2015;3(5):386\u201391.","journal-title":"JACC: Heart Fail"},{"issue":"2","key":"2477_CR31","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1001\/archinte.160.2.197","volume":"160","author":"DC Goff Jr","year":"2000","unstructured":"Goff DC Jr, Pandey DK, Chan FA, Ortiz C, Nichaman MZ. Congestive heart failure in the United States: Is there more than meets the I(CD Code)? The Corpus Christi Heart Project. Arch Intern Med. 2000;160(2):197\u2013202.","journal-title":"Arch Intern Med"},{"issue":"12","key":"2477_CR32","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.1093\/aje\/kwh314","volume":"160","author":"SR Heckbert","year":"2004","unstructured":"Heckbert SR, Kooperberg C, Safford MM, Psaty BM, Hsia J, McTiernan A, et al. Comparison of self-report, hospital discharge codes, and adjudication of cardiovascular events in the Women\u2019s Health Initiative. Am J Epidemiol. 2004;160(12):1152\u20138.","journal-title":"Am J Epidemiol"},{"issue":"11","key":"2477_CR33","doi-asserted-by":"publisher","first-page":"1791","DOI":"10.1016\/j.amjcard.2017.03.007","volume":"119","author":"H Huang","year":"2017","unstructured":"Huang H, Turner M, Raju S, Reich J, Leatherman S, Armstrong K, et al. Identification of acute decompensated heart failure hospitalisations using administrative data. Am J Cardiol. 2017;119(11):1791\u20136.","journal-title":"Am J Cardiol"},{"issue":"5","key":"2477_CR34","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1016\/j.ejheart.2004.12.007","volume":"7","author":"E Ingelsson","year":"2005","unstructured":"Ingelsson E, \u00c4rnl\u00f6v J, Sundstr\u00f6m J, Lind L. The validity of a diagnosis of heart failure in a hospital discharge register. Eur J Heart Fail. 2005;7(5):787\u201391.","journal-title":"Eur J Heart Fail"},{"issue":"8","key":"2477_CR35","doi-asserted-by":"publisher","first-page":"844","DOI":"10.7326\/0003-4819-119-8-199310150-00011","volume":"119","author":"JG Jollis","year":"1993","unstructured":"Jollis JG, Ancukiewicz M, DeLong ER, Pryor DB, Muhlbaier LH, Mark DB. Discordance of databases designed for claims payment versus clinical information systems: Implications for outcomes research. Ann Intern Med. 1993;119(8):844\u201350.","journal-title":"Ann Intern Med"},{"issue":"5","key":"2477_CR36","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1016\/j.ejheart.2005.04.001","volume":"7","author":"AU Khand","year":"2005","unstructured":"Khand AU, Shaw M, Gemmel I, Cleland JGF. Do discharge codes underestimate hospitalisation due to heart failure? Validation study of hospital discharge coding for heart failure. Eur J Heart Fail. 2005;7(5):792\u20137.","journal-title":"Eur J Heart Fail"},{"issue":"7","key":"2477_CR37","doi-asserted-by":"publisher","first-page":"658","DOI":"10.1016\/j.ejheart.2008.05.006","volume":"10","author":"T K\u00fcmler","year":"2008","unstructured":"K\u00fcmler T, Gislason GH, Kirk V, Bay M, Nielsen OW, K\u00f8ber L, et al. Accuracy of a heart failure diagnosis in administrative registers. Eur J Heart Fail. 2008;10(7):658\u201360.","journal-title":"Eur J Heart Fail"},{"issue":"2","key":"2477_CR38","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1097\/00005650-200502000-00012","volume":"43","author":"DS Lee","year":"2005","unstructured":"Lee DS, Donovan L, Austin PC, Gong Y, Liu PP, Rouleau JL, et al. Comparison of coding of heart failure and comorbidities in administrative and clinical data for use in outcomes research. Med Care. 2005;43(2):182\u20138.","journal-title":"Med Care"},{"issue":"2","key":"2477_CR39","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1177\/2047487312438979","volume":"20","author":"M Mahonen","year":"2013","unstructured":"Mahonen M, Jula A, Harald K, Antikainen R, Tuomilehto J, Zeller T, et al. The validity of heart failure diagnoses obtained from administrative registers. Eur J Prev Cardiol. 2013;20(2):254\u20139.","journal-title":"Eur J Prev Cardiol"},{"key":"2477_CR40","first-page":"235","volume":"2","author":"S Mard","year":"2010","unstructured":"Mard S, Nielsen FE. Positive predictive value and impact of misdiagnosis of a heart failure diagnosis in administrative registers among patients admitted to a University Hospital cardiac care unit. Clin Epidemiol. 2010;2:235\u20139.","journal-title":"Clin Epidemiol"},{"issue":"1","key":"2477_CR41","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/S0735-1097(01)01700-4","volume":"39","author":"PA McCullough","year":"2002","unstructured":"McCullough PA, Philbin EF, Spertus JA, Kaatz S, Sandberg KR, Weaver WD, et al. Confirmation of a heart failure epidemic: findings from the Resource Utilization Among Congestive Heart Failure (REACH) study. J Am Coll Cardiol. 2002;39(1):60\u20139.","journal-title":"J Am Coll Cardiol"},{"issue":"5","key":"2477_CR42","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1007\/s10654-009-9335-x","volume":"24","author":"AH Merry","year":"2009","unstructured":"Merry AH, Boer JM, Schouten LJ, Feskens EJ, Verschuren WM, Gorgels AP, et al. Validity of coronary heart diseases and heart failure based on hospital discharge and mortality data in the Netherlands using the cardiovascular registry Maastricht cohort study. Eur J Epidemiol. 2009;24(5):237\u201347.","journal-title":"Eur J Epidemiol"},{"key":"2477_CR43","doi-asserted-by":"publisher","first-page":"367","DOI":"10.2147\/CLEP.S245555","volume":"12","author":"Y Ono","year":"2020","unstructured":"Ono Y, Taneda Y, Takeshima T, Iwasaki K, Yasui A. Validity of claims diagnosis codes for cardiovascular diseases in diabetes patients in Japanese administrative database. Clin Epidemiol. 2020;12:367\u201375.","journal-title":"Clin Epidemiol"},{"issue":"2","key":"2477_CR44","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1161\/CIRCULATIONAHA.115.018610","volume":"133","author":"BM Psaty","year":"2016","unstructured":"Psaty BM, Delaney JA, Arnold AM, Curtis LH, Fitzpatrick AL, Heckbert SR, et al. Study of cardiovascular health outcomes in the era of claims data. Circulation. 2016;133(2):156\u201364.","journal-title":"Circulation"},{"issue":"3","key":"2477_CR45","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1001\/jama.292.3.344","volume":"292","author":"VL Roger","year":"2004","unstructured":"Roger VL, Weston SA, Redfield MM, Hellermann-Homan JP, Killian J, Yawn BP, et al. Trends in heart failure incidence and survival in a community-based population. JAMA. 2004;292(3):344\u201350.","journal-title":"JAMA"},{"issue":"1","key":"2477_CR46","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1002\/ehf2.12519","volume":"7","author":"M Schaufelberger","year":"2020","unstructured":"Schaufelberger M, Ekestubbe S, Hultgren S, Persson H, Reimstad A, Schaufelberger M, et al. Validity of heart failure diagnoses made in 2000\u20132012 in western Sweden. ESC Heart Fail. 2020;7(1):37\u201346.","journal-title":"ESC Heart Fail"},{"issue":"2","key":"2477_CR47","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1016\/j.annepidem.2005.02.012","volume":"16","author":"GD Schellenbaum","year":"2006","unstructured":"Schellenbaum GD, Heckbert SR, Smith NL, Rea TD, Lumley T, Kitzman DW, et al. Congestive heart failure incidence and prognosis: case identification using central adjudication versus hospital discharge diagnoses. Ann Epidemiol. 2006;16(2):115\u201322.","journal-title":"Ann Epidemiol"},{"issue":"5","key":"2477_CR48","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1111\/j.1753-6405.2008.00269.x","volume":"32","author":"THK Teng","year":"2008","unstructured":"Teng THK, Finn J, Hung J, Geelhoed E, Hobbs M. A validation study: how effective is the hospital morbidity data as a surveillance tool for heart failure in Western Australia? Aust Public Health. 2008;32(5):405\u20137.","journal-title":"Aust Public Health."},{"issue":"2","key":"2477_CR49","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1016\/S0895-4356(03)00246-4","volume":"57","author":"M Wilchesky","year":"2004","unstructured":"Wilchesky M, Tamblyn RM, Huang A. Validation of diagnostic codes within medical services claims. J Clin Epidemiol. 2004;57(2):131\u201341.","journal-title":"J Clin Epidemiol"},{"issue":"6","key":"2477_CR50","doi-asserted-by":"publisher","first-page":"e00676","DOI":"10.1002\/prp2.676","volume":"8","author":"SS Cohen","year":"2020","unstructured":"Cohen SS, Roger VL, Weston SA, Jiang R, Movva N, Yusuf AA, et al. Evaluation of claims-based computable phenotypes to identify heart failure patients with preserved ejection fraction. Pharmacol Res Perspect. 2020;8(6):e00676.","journal-title":"Pharmacol Res Perspect"},{"issue":"4","key":"2477_CR51","first-page":"5470","volume":"65","author":"J Delekta","year":"2018","unstructured":"Delekta J, Hansen SM, AlZuhairi KS, Bork CS, Joensen AM. The validity of the diagnosis of heart failure (I50.0-I50.9) in the Danish National Patient Register. Dan Med J. 2018;65(4):5470.","journal-title":"Dan Med J"},{"issue":"4","key":"2477_CR52","doi-asserted-by":"publisher","first-page":"4413","DOI":"10.1016\/j.ijcard.2013.05.031","volume":"168","author":"R Pfister","year":"2013","unstructured":"Pfister R, Michels G, Wilfred J, Luben R, Wareham NJ, Khaw K-T. Does ICD-10 hospital discharge code I50 identify people with heart failure? A validation study within the EPIC-Norfolk study. Int J Cardiol. 2013;168(4):4413\u20134.","journal-title":"Int J Cardiol"},{"issue":"11","key":"2477_CR53","doi-asserted-by":"publisher","first-page":"e012832","DOI":"10.1136\/bmjopen-2016-012832","volume":"6","author":"J Sundb\u00f8ll","year":"2016","unstructured":"Sundb\u00f8ll J, Adelborg K, Munch T, Fr\u00f8slev T, S\u00f8rensen HT, B\u00f8tker HE, et al. Positive predictive value of cardiovascular diagnoses in the Danish National Patient Registry: a validation study. BMJ Open. 2016;6(11):e012832.","journal-title":"BMJ Open"},{"key":"2477_CR54","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1186\/1471-2288-11-83","volume":"11","author":"SK Thygesen","year":"2011","unstructured":"Thygesen SK, Christiansen CF, Christensen S, Lash TL, S\u00f8rensen HT. The predictive value of ICD-10 diagnostic coding used to assess Charlson comorbidity index conditions in the population-based Danish National Registry of Patients. BMC Med Res Methodol. 2011;11:83.","journal-title":"BMC Med Res Methodol"},{"issue":"3","key":"2477_CR55","doi-asserted-by":"publisher","first-page":"e020455","DOI":"10.1136\/bmjopen-2017-020455","volume":"8","author":"CA Presley","year":"2018","unstructured":"Presley CA, Min JY, Chipman J, Greevy RA, Grijalva CG, Griffin MR, et al. Validation of an algorithm to identify heart failure hospitalisations in patients with diabetes within the veterans health administration. BMJ Open. 2018;8(3):e020455.","journal-title":"BMJ Open"},{"issue":"2","key":"2477_CR56","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1161\/CIRCHEARTFAILURE.111.963199","volume":"5","author":"WD Rosamond","year":"2012","unstructured":"Rosamond WD, Chang PP, Baggett C, Johnson A, Bertoni AG, Shahar E, et al. Classification of heart failure in the atherosclerosis risk in communities (ARIC) study. Circ Heart Fail. 2012;5(2):152\u20139.","journal-title":"Circ Heart Fail"},{"issue":"7","key":"2477_CR57","doi-asserted-by":"publisher","first-page":"700","DOI":"10.1002\/pds.2146","volume":"20","author":"Q Li","year":"2011","unstructured":"Li Q, Glynn RJ, Dreyer NA, Liu J, Mogun H, Setoguchi S. Validity of claims-based definitions of left ventricular systolic dysfunction in medicare patients. Pharmacoepidemiol Drug Saf. 2011;20(7):700\u20138.","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"1","key":"2477_CR58","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1186\/1472-6963-11-105","volume":"11","author":"WF Chong","year":"2011","unstructured":"Chong WF, Ding YY, Heng BH. A comparison of comorbidities obtained from hospital administrative data and medical charts in older patients with pneumonia. BMC Health Serv Res. 2011;11(1):105.","journal-title":"BMC Health Serv Res"},{"issue":"8","key":"2477_CR59","doi-asserted-by":"publisher","first-page":"752","DOI":"10.1097\/MLR.0b013e318215d7dd","volume":"49","author":"ST Fleming","year":"2011","unstructured":"Fleming ST, Sabatino SA, Kimmick G, Cress R, Wu XC, Trentham-Dietz A, et al. Developing a claim-based version of the ACE-27 comorbidity index: a comparison with medical record review. Med Care. 2011;49(8):752\u201360.","journal-title":"Med Care"},{"issue":"4","key":"2477_CR60","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1016\/S0895-4356(99)00188-2","volume":"53","author":"KH Humphries","year":"2000","unstructured":"Humphries KH, Rankin JM, Carere RG, Buller CE, Kiely FM, Spinelli JJ. Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? J Clin Epidemiol. 2000;53(4):343\u20139.","journal-title":"J Clin Epidemiol"},{"issue":"7","key":"2477_CR61","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1016\/S0895-4356(00)00364-4","volume":"54","author":"H Powell","year":"2001","unstructured":"Powell H, Lim LLY, Heller RF. Accuracy of administrative data to assess comorbidity in patients with heart disease: an Australian perspective. J Clin Epidemiol. 2001;54(7):687\u201393.","journal-title":"J Clin Epidemiol"},{"issue":"12","key":"2477_CR62","doi-asserted-by":"publisher","first-page":"1295","DOI":"10.1016\/j.jclinepi.2004.03.016","volume":"57","author":"DB Preen","year":"2004","unstructured":"Preen DB, Holman CDAJ, Lawrence DM, Baynham NJ, Semmens JB. Hospital chart review provided more accurate comorbidity information than data from a general practitioner survey or an administrative database. J Clin Epidemiol. 2004;57(12):1295\u2013304.","journal-title":"J Clin Epidemiol"},{"issue":"8","key":"2477_CR63","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1097\/00005650-200208000-00007","volume":"40","author":"H Quan","year":"2002","unstructured":"Quan H, Parsons GA, Ghali WA. Validity of information on comorbidity derived from ICD-9-CCM administrative data. Med Care. 2002;40(8):675\u201385.","journal-title":"Med Care"},{"issue":"1310","key":"2477_CR64","first-page":"50","volume":"123","author":"D Sarfati","year":"2010","unstructured":"Sarfati D, Hill S, Purdie G, Dennett E, Blakely T. How well does routine hospitalisation data capture information on comorbidity in New Zealand? N Z Med J. 2010;123(1310):50\u201361.","journal-title":"N Z Med J"},{"key":"2477_CR65","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1186\/1472-6963-6-161","volume":"6","author":"L So","year":"2006","unstructured":"So L, Evans D, Quan H. ICD-10 coding algorithms for defining comorbidities of acute myocardial infarction. BMC Health Serv Res. 2006;6:161.","journal-title":"BMC Health Serv Res"},{"key":"2477_CR66","doi-asserted-by":"publisher","first-page":"253-","DOI":"10.1186\/1756-0500-7-253","volume":"7","author":"M Soo","year":"2014","unstructured":"Soo M, Robertson LM, Ali T, Clark LE, Fluck N, Johnston M, et al. Approaches to ascertaining comorbidity information: validation of routine hospital episode data with clinician-based case note review. BMC Res Notes. 2014;7:253-.","journal-title":"BMC Res Notes"},{"issue":"5","key":"2477_CR67","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1177\/106286060401900504","volume":"19","author":"AM Borzecki","year":"2004","unstructured":"Borzecki AM, Wong AT, Hickey EC, Ash AS, Berlowitz DR. Identifying hypertension-related comorbidities from administrative data: what\u2019s the optimal approach? Am J Med Qual. 2004;19(5):201\u20136.","journal-title":"Am J Med Qual"},{"issue":"11","key":"2477_CR68","doi-asserted-by":"publisher","first-page":"1011","DOI":"10.1097\/01.mlr.0000228018.48783.34","volume":"44","author":"T Henderson","year":"2006","unstructured":"Henderson T, Shepheard J, Sundararajan V. Quality of diagnosis and procedure coding in ICD-10 administrative data. Med Care. 2006;44(11):1011\u20139.","journal-title":"Med Care"},{"issue":"2","key":"2477_CR69","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/S0895-4356(98)00154-1","volume":"52","author":"SM Kieszak","year":"1999","unstructured":"Kieszak SM, Flanders WD, Kosinski AS, Shipp CC, Karp H. A comparison of the Charlson comorbidity Index derived from medical record data and administrative billing data. J Clin Epidemiol. 1999;52(2):137\u201342.","journal-title":"J Clin Epidemiol"},{"issue":"4","key":"2477_CR70","doi-asserted-by":"publisher","first-page":"1424","DOI":"10.1111\/j.1475-6773.2007.00822.x","volume":"43","author":"H Quan","year":"2008","unstructured":"Quan H, Li B, Duncan Saunders L, Parsons GA, Nilsson CI, Alibhai A, et al. Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. Health Serv Res. 2008;43(4):1424\u201341.","journal-title":"Health Serv Res"},{"issue":"6 Pt 1","key":"2477_CR71","doi-asserted-by":"publisher","first-page":"1839","DOI":"10.1111\/j.1475-6773.2004.00321.x","volume":"39","author":"TS Rector","year":"2004","unstructured":"Rector TS, Wickstrom SL, Shah M, Thomas Greeenlee N, Rheault P, Rogowski J, et al. Specificity and sensitivity of claims-based algorithms for identifying members of Medicare+Choice health plans that have chronic medical conditions. Health Serv Res. 2004;39(6 Pt 1):1839\u201357.","journal-title":"Health Serv Res"},{"key":"2477_CR72","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1016\/j.cardfail.2020.04.003","volume":"15","author":"Y Xu","year":"2020","unstructured":"Xu Y, Martin E, D\u2019Souza AG, Doktorchik CTA, Jiang J, Lee S, et al. Enhancing ICD-Code-based case definition for heart failure using electronic medical record data. J Card Fail. 2020;15:610\u20137.","journal-title":"J Card Fail"},{"issue":"9","key":"2477_CR73","doi-asserted-by":"publisher","first-page":"778","DOI":"10.1007\/s00392-018-1245-z","volume":"107","author":"M Kaspar","year":"2018","unstructured":"Kaspar M, Fette G, G\u00fcder G, Seidlmayer L, Ertl M, Dietrich G, et al. Underestimated prevalence of heart failure in hospital inpatients: a comparison of ICD codes and discharge letter information. Clin Res Cardiol. 2018;107(9):778\u201387.","journal-title":"Clin Res Cardiol"},{"issue":"4","key":"2477_CR74","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1093\/intqhc\/mzm017","volume":"19","author":"J-C Luthi","year":"2007","unstructured":"Luthi J-C, Troillet N, Eisenring M-C, Sax H, Burnand B, Quan H, et al. Administrative data outperformed single-day chart review for comorbidity measure. Internat J Qual Health Care. 2007;19(4):225\u201331.","journal-title":"Internat J Qual Health Care"},{"issue":"7","key":"2477_CR75","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1016\/S0895-4356(00)00367-X","volume":"54","author":"C van Doorn","year":"2001","unstructured":"van Doorn C, Bogardus ST, Williams CS, Concato J, Towle VR, Inouye SK. Risk adjustment for older hospitalized persons: a comparison of two methods of data collection for the Charlson index. J Clin Epidemiol. 2001;54(7):694\u2013701.","journal-title":"J Clin Epidemiol"},{"issue":"3","key":"2477_CR76","doi-asserted-by":"publisher","first-page":"160","DOI":"10.24095\/hpcdp.33.3.06","volume":"33","author":"SE Schultz","year":"2013","unstructured":"Schultz SE, Rothwell DM, Chen Z, Tu K. Identifying cases of congestive heart failure from administrative data: a validation study using primary care patient records. Chron Dis Inj Canada. 2013;33(3):160\u20136.","journal-title":"Chron Dis Inj Canada"},{"issue":"5","key":"2477_CR77","doi-asserted-by":"publisher","first-page":"e30","DOI":"10.1097\/MLR.0b013e31825a8c22","volume":"52","author":"LA Allen","year":"2014","unstructured":"Allen LA, Yood MU, Wagner EH, Aiello Bowles EJ, Pardee R, Wellman R, et al. Performance of claims-based algorithms for identifying heart failure and cardiomyopathy among patients diagnosed with breast cancer. Med Care. 2014;52(5):e30\u20138.","journal-title":"Med Care"},{"issue":"5","key":"2477_CR78","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1097\/01.mlr.0000160417.39497.a9","volume":"43","author":"E Birman-Deych","year":"2005","unstructured":"Birman-Deych E, Waterman AD, Yan Y, Nilasena DS, Radford MJ, Gage BF. Accuracy of ICD-9-CM codes for identifying cardiovascular and stroke risk factors. Med Care. 2005;43(5):480\u20135.","journal-title":"Med Care"},{"key":"2477_CR79","unstructured":"Juurlink D PC, Croxford R, Chong A, Austin P, Tu J, Laupacis A. . Canadian Institute for Health Information Discharge Abstract Database: a validation study. Toronto: : Institute for Clinical Evaluative Sciences; 2006."},{"key":"2477_CR80","volume-title":"Eleventh Revision (ICD-11)","author":"International Classification of Diseases","year":"2022","unstructured":"International Classification of Diseases. Eleventh Revision (ICD-11). Geneva: World Health Organisation; 2022."}],"container-title":["Systematic Reviews"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13643-024-02477-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13643-024-02477-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13643-024-02477-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T16:10:49Z","timestamp":1709309449000},"score":1,"resource":{"primary":{"URL":"https:\/\/systematicreviewsjournal.biomedcentral.com\/articles\/10.1186\/s13643-024-02477-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":80,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2477"],"URL":"https:\/\/doi.org\/10.1186\/s13643-024-02477-5","relation":{},"ISSN":["2046-4053"],"issn-type":[{"value":"2046-4053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,1]]},"assertion":[{"value":"6 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"S.P., M.M., A.O., R.H., M.G., WK, ME, and AEM work in the Clinical Trial Service Unit and Epidemiological Studies Unit of the Nuffield Department of Population Health at the University of Oxford. The Clinical Trial Service Unit and Epidemiological Studies Unit have a staff policy of not taking any personal payments directly or indirectly from industry (with reimbursement sought only for the costs of travel and accommodation to attend scientific meetings). It has received research grants from Abbott, AstraZeneca, Bayer, Boehringer Ingelheim, Eli Lilly, GlaxoSmithKline, The Medicines Company, Merck, Mylan, Novartis, Novo Nordisk, Pfizer, Roche, Schering, and Solvay, which are governed by University of Oxford contracts that protect their independence.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"79"}}