{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T03:47:29Z","timestamp":1792122449049,"version":"4.4.0"},"reference-count":37,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Cardio"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n \n Atrial fibrillation (AF) ablation is an effective treatment for reducing episodes and improving quality of life in patients with AF. However, long-term AF-free rates after AF ablation are inconsistent across the population, ranging from 50% to 75%. Patient selection relies on individual clinical assessment, highlighting a critical gap in population-level predictive analytics. While existing risk scores (eg, CHADS\n \u2082<\/jats:sub>\n [congestive heart failure, hypertension, age \u226575 years, diabetes mellitus, and stroke], CHA\n \u2082<\/jats:sub>\n DS\n \u2082<\/jats:sub>\n -VASc [congestive heart failure, hypertension, age \u226575 years, diabetes mellitus, stroke, vascular disease, age, and sex category], CAAP-AF [coronary artery disease, left atrial diameter, age, AF, antiarrhythmic drugs, and female sex category]) have been applied to predict AF ablation outcomes, their performance in administrative claims data remains unclear. Leveraging large administrative claims databases represents an opportunity to develop standardized, scalable prediction models that could inform population health management and resource allocation at a national level.\n <\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n \n This study utilizes machine learning (ML) models on claims data to explore if integrating\n International Classification of Diseases<\/jats:italic>\n (\n ICD<\/jats:italic>\n ) billing codes outperforms traditional stroke and AF risk scores in predicting 1-year AF ablation outcomes.\n <\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n We analyzed claims data from the Merative MarketScan Research Medicare database (2013\u20102020) to identify 14,521 patients who underwent AF ablation. To predict 1-year AF-free outcomes, we developed logistic regression and extreme gradient boosting (XGBoost) models using demographic characteristics, comorbidity indices, and\n ICD<\/jats:italic>\n diagnostic codes from the 2 years preceding ablation. Model predictions were compared with claims-based implementations of established risk scores\u2014CHADS\n 2<\/jats:sub>\n , CHA\n 2<\/jats:sub>\n DS\n 2<\/jats:sub>\n -VASc, and a modified CAAP-AF (without left atrial diameter and the number of failed antiarrhythmic drugs). The ML models were also assessed on subgroups of patients with paroxysmal AF, persistent AF, and both AF and atrial flutter from October 2015 onward.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Among 14,521 patients (mean age 71.5, SD 5.31 y; n=5800, 39.94% female), AF ablation success occurred in 54.01% (n=7843). XGBoost achieved areas under the receiver operating characteristic curve (AUCs) of 0.528, 0.521, and 0.529 for the whole, female, and male AF ablation groups, respectively, and better discrimination than CHADS\n 2<\/jats:sub>\n , CHA\n 2<\/jats:sub>\n DS\n 2<\/jats:sub>\n -VASc, and the modified CAAP-AF in all AF ablation groups (whole population, female, and male). While CHA\n 2<\/jats:sub>\n DS\n 2<\/jats:sub>\n -VASc and the modified CAAP-AF showed higher recall (>0.798), their precision (<0.540) was lower than XGBoost (0.552\u20100.556). In subgroup analyses of\n International Classification of Disease, Tenth Revision<\/jats:italic>\n (\n ICD-10<\/jats:italic>\n ) patients (n=7646), the models incorporating\n ICD<\/jats:italic>\n codes demonstrated better performance than those using only demographic and comorbidity data across most AF subtypes, with the highest AUC (0.544) observed in patients with paroxysmal AF.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n While the ML models achieved statistically significant improvements over claim-based implementations of established clinical risk scores (AUC 0.528\u20100.544 vs 0.498\u20100.505), the modest predictive performance highlights challenges in predicting procedural outcomes using administrative data that lack key clinical variables (eg, left atrial size and medication details). Our findings establish that while standardized outcome prediction using nationally available administrative data is technically feasible, current performance is insufficient for clinical decision-making and better suited for health system quality monitoring and comparative effectiveness research applications.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/77380","type":"journal-article","created":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T21:13:16Z","timestamp":1767215596000},"page":"e77380-e77380","source":"Crossref","is-referenced-by-count":1,"title":["Predicting Atrial Fibrillation Ablation Outcomes: Machine Learning Model Development and Validation Using a Large Administrative Claims Database"],"prefix":"10.2196","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-6601-9237","authenticated-orcid":false,"given":"Yijun","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5853-517X","authenticated-orcid":false,"given":"Mustapha","family":"Oloko-Oba","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4671-2014","authenticated-orcid":false,"given":"Kathryn A","family":"Wood","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0708-9330","authenticated-orcid":false,"given":"Michael S","family":"Lloyd","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9168-3916","authenticated-orcid":false,"given":"Joyce C","family":"Ho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8834-4363","authenticated-orcid":false,"given":"Vicki Stover","family":"Hertzberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,12,31]]},"reference":[{"issue":"4","key":"R1","doi-asserted-by":"publisher","DOI":"10.1093\/europace\/euae043","article-title":"2024 European Heart Rhythm Association\/Heart Rhythm Society\/Asia Pacific Heart Rhythm Society\/Latin American Heart Rhythm Society expert consensus statement on catheter and surgical ablation of atrial fibrillation","volume":"26","author":"Tzeis","journal-title":"Europace"},{"issue":"8","key":"R2","doi-asserted-by":"publisher","first-page":"e347","DOI":"10.1161\/CIR.0000000000001209","article-title":"2024 heart disease and stroke statistics: a report of US and global data from the American Heart Association","volume":"149","author":"Martin","journal-title":"Circulation"},{"issue":"22","key":"R3","doi-asserted-by":"publisher","first-page":"1779","DOI":"10.1161\/CIRCULATIONAHA.119.042622","article-title":"Cryoballoon or radiofrequency ablation for atrial fibrillation assessed by continuous monitoring: a randomized clinical trial","volume":"140","author":"Andrade","journal-title":"Circulation"},{"issue":"4","key":"R4","doi-asserted-by":"publisher","first-page":"1103","DOI":"10.55730\/1300-0144.5413","article-title":"CHA2DS2-VASc score as a prognostic indicator in patients with atrial fibrillation undergoing coronary stenting","volume":"52","author":"Zheng","journal-title":"Turk J Med Sci"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijcard.2021.09.029","article-title":"Comparison of the predictive value of ten risk scores for outcomes of atrial fibrillation patients undergoing radiofrequency pulmonary vein isolation","volume":"344","author":"Mulder","journal-title":"Int J Cardiol"},{"issue":"4","key":"R6","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1016\/j.hrthm.2014.12.034","article-title":"The impact of risk score (CHADS2 versus CHA2DS2-VASc) on long-term outcomes after atrial fibrillation ablation","volume":"12","author":"Jacobs","journal-title":"Heart Rhythm"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0169933","article-title":"The APPLE score\u2014a novel score for the prediction of rhythm outcomes after repeat catheter ablation of atrial fibrillation","volume":"12","author":"Kornej","journal-title":"PLoS One"},{"issue":"2","key":"R8","doi-asserted-by":"publisher","first-page":"320","DOI":"10.1002\/clc.23139","article-title":"Clinical scores used for the prediction of negative events in patients undergoing catheter ablation for atrial fibrillation","volume":"42","author":"Kosich","journal-title":"Clin Cardiol"},{"issue":"5","key":"R9","doi-asserted-by":"publisher","first-page":"2553","DOI":"10.1002\/ehf2.12831","article-title":"Value of the CHA DS -VASc score for predicting outcome in patients with heart failure","volume":"7","author":"Shuvy","journal-title":"ESC Heart Fail"},{"issue":"2","key":"R10","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1378\/chest.09-1584","article-title":"Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: the Euro Heart Survey on atrial fibrillation","volume":"137","author":"Lip","journal-title":"Chest"},{"issue":"3","key":"R11","doi-asserted-by":"publisher","first-page":"258","DOI":"10.3969\/j.issn.1671-5411.2013.03.004","article-title":"CHADS2 versus CHA2DS2-VASc score in assessing the stroke and thromboembolism risk stratification in patients with atrial fibrillation: a systematic review and meta-analysis","volume":"10","author":"Chen","journal-title":"J Geriatr Cardiol"},{"issue":"11","key":"R12","doi-asserted-by":"publisher","first-page":"2119","DOI":"10.1016\/j.hrthm.2016.07.018","article-title":"Predicting atrial fibrillation ablation outcome: the CAAP-AF score","volume":"13","author":"Winkle","journal-title":"Heart Rhythm"},{"issue":"36","key":"R13","doi-asserted-by":"publisher","first-page":"3314","DOI":"10.1093\/eurheartj\/ehae176","article-title":"2024 ESC Guidelines for the management of atrial fibrillation developed in collaboration with the European Association for Cardio-Thoracic Surgery (EACTS)","volume":"45","author":"Van Gelder","journal-title":"Eur Heart J"},{"issue":"FI_3","key":"R14","doi-asserted-by":"publisher","first-page":"f366","DOI":"10.1093\/europace\/eux297","article-title":"Outcomes of persistent and long-standing persistent atrial fibrillation ablation: a systematic review and meta-analysis","volume":"20","author":"Clarnette","journal-title":"Europace"},{"issue":"4","key":"R15","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1093\/ehjqcco\/qcab102","article-title":"Ten-year trends in mortality and complications following catheter ablation of atrial fibrillation","volume":"8","author":"Ngo","journal-title":"Eur Heart J Qual Care Clin Outcomes"},{"issue":"5","key":"R16","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1093\/ehjqcco\/qcab035","article-title":"Gender differences in complications following catheter ablation of atrial fibrillation","volume":"7","author":"Ngo","journal-title":"Eur Heart J Qual Care Clin Outcomes"},{"issue":"3","key":"R17","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1016\/j.jacep.2018.11.013","article-title":"Life-threatening complications of atrial fibrillation ablation: 16-year experience in a large prospective tertiary care cohort","volume":"5","author":"Abdur Rehman","journal-title":"JACC Clin Electrophysiol"},{"issue":"8","key":"R18","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCEP.119.007952","article-title":"Artificial intelligence and machine learning in arrhythmias and cardiac electrophysiology","volume":"13","author":"Feeny","journal-title":"Circ Arrhythm Electrophysiol"},{"issue":"2","key":"R19","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/0010-4809(79)90015-6","article-title":"An automated system for ECG monitoring","volume":"12","author":"Nyg\u00e5rds","journal-title":"Comput Biomed Res"},{"issue":"11","key":"R20","doi-asserted-by":"publisher","first-page":"1317","DOI":"10.1016\/j.jacc.2018.12.054","article-title":"Artificial intelligence in cardiovascular imaging","volume":"73","author":"Dey","journal-title":"J Am Coll Cardiol"},{"key":"R21","doi-asserted-by":"publisher","DOI":"10.2196\/57111","article-title":"Accurate modeling of ejection fraction and stroke volume with mobile phone auscultation: prospective case-control study","volume":"8","author":"Huecker","journal-title":"JMIR Cardio"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.2196\/69282","article-title":"Combining machine learning with real-world data to identify gaps in clinical practice guidelines: feasibility study using the prospective German Stroke Registry and the national acute ischemic stroke guidelines","volume":"13","author":"M\u00fcller","journal-title":"JMIR Med Inform"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.2196\/68898","article-title":"The use of machine learning for analyzing real-world data in disease prediction and management: systematic review","volume":"13","author":"Alhumaidi","journal-title":"JMIR Med Inform"},{"issue":"6","key":"R24","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0252585","article-title":"Application of machine learning approaches to administrative claims data to predict clinical outcomes in medical and surgical patient populations","volume":"16","author":"MacKay","journal-title":"PLoS One"},{"issue":"11","key":"R25","doi-asserted-by":"publisher","DOI":"10.1111\/ijcp.13247","article-title":"Using the MB-LATER score for predicting arrhythmia outcome after catheter ablation for atrial fibrillation: the Guangzhou atrial fibrillation project","volume":"72","author":"Deng","journal-title":"Int J Clin Pract"},{"issue":"12","key":"R26","doi-asserted-by":"publisher","first-page":"1131","DOI":"10.1001\/jamacardio.2023.3701","article-title":"Deep learning of electrocardiograms in sinus rhythm from US veterans to predict atrial fibrillation","volume":"8","author":"Yuan","journal-title":"JAMA Cardiol"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.3389\/fphys.2021.752317","article-title":"Prediction of atrial fibrillation using machine learning: a review","volume":"12","author":"Tseng","journal-title":"Front Physiol"},{"issue":"23","key":"R28","doi-asserted-by":"publisher","first-page":"2380","DOI":"10.1016\/j.jacc.2011.08.045","article-title":"CHADS(2) and CHA(2)DS(2)-VASc scores in the prediction of clinical outcomes in patients with atrial fibrillation after catheter ablation","volume":"58","author":"Chao","journal-title":"J Am Coll Cardiol"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.2196\/54994","article-title":"Identifying predictors of heart failure readmission in patients from a statutory health insurance database: retrospective machine learning study","volume":"8","author":"Levinson","journal-title":"JMIR Cardio"},{"key":"R30","unstructured":"ICD code lookup website. Lookup IC. 2024. URL: https:\/\/icdcodelookup.com [Accessed 16-12-2025]"},{"issue":"5","key":"R31","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1016\/0021-9681(87)90171-8","article-title":"A new method of classifying prognostic comorbidity in longitudinal studies: development and validation","volume":"40","author":"Charlson","journal-title":"J Chronic Dis"},{"issue":"1","key":"R32","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1097\/00005650-199801000-00004","article-title":"Comorbidity measures for use with administrative data","volume":"36","author":"Elixhauser","journal-title":"Med Care"},{"key":"R33","doi-asserted-by":"crossref","unstructured":"Chen T Guestrin C . XGBoost: a scalable tree boosting system. Presented at: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; Aug 13-17, 2016:785-794; San Francisco, CA, USA. [doi: 10.1145\/2939672.2939785]","DOI":"10.1145\/2939672.2939785"},{"issue":"1","key":"R34","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.18962","article-title":"Comparison of machine learning methods with traditional models for use of administrative claims with electronic medical records to predict heart failure outcomes","volume":"3","author":"Desai","journal-title":"JAMA Netw Open"},{"issue":"7","key":"R35","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1097\/MLR.0000000000001135","article-title":"Prediction accuracy with electronic medical records versus administrative claims","volume":"57","author":"Zeltzer","journal-title":"Med Care"},{"key":"R36","unstructured":"yijunliu23\/AFA-Claims-CodeRelease. GitHub. URL: https:\/\/github.com\/yijunliu23\/AFA-Claims-CodeRelease [Accessed 23-12-2025]"},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","journal-title":"J Mach Learn Res"}],"container-title":["JMIR Cardio"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/cardio.jmir.org\/2025\/1\/e77380","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:09:32Z","timestamp":1782842972000},"score":1,"resource":{"primary":{"URL":"https:\/\/cardio.jmir.org\/2025\/1\/e77380"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,31]]},"references-count":37,"URL":"https:\/\/doi.org\/10.2196\/77380","relation":{},"ISSN":["2561-1011"],"issn-type":[{"value":"2561-1011","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,31]]},"article-number":"v9i4e77380"}}