{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T19:55:48Z","timestamp":1791402948018,"version":"4.3.3"},"reference-count":26,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Cancer"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Preoperative nodal assessment in colorectal cancer (CRC) remains imperfect, and uncertainty regarding pathological lymph node metastasis (LNM) may persist despite conventional imaging. Machine learning using routinely available preoperative information may provide complementary patient-level risk estimates without requiring radiomic feature extraction or molecular testing.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to develop and externally validate machine learning models for preoperative estimation of pathologically confirmed LNM risk in patients with newly diagnosed CRC undergoing direct radical surgery without preoperative anticancer treatment, and to assess whether multivariable prediction adds information beyond clinical tumor stage (cT) alone.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This multicenter retrospective study included 2725 patients from 2 hospitals. The internal cohort (n=1074) was split into training (n=753) and internal test (n=321) sets, while 1651 patients from a second center formed the external validation cohort. Candidate predictors were routinely available preoperative clinical, laboratory, tumor-marker, imaging-based, and endoscopic biopsy variables. Predictors were selected using univariable and multivariable logistic regression (LR). Seven algorithms were evaluated: random forest (RF), support vector machine (SVM), LR, decision tree (DT), extreme gradient boosting (XGBoost), naive Bayes (NB), and light gradient boosting machine (LightGBM). Performance was assessed using discrimination, threshold-dependent classification metrics, calibration, and decision curve analysis (DCA). Shapley additive explanations (SHAP) were used for interpretation. Sensitivity analyses compared the selected predictors with all candidate predictors and cT alone.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Six predictors were retained: BMI, preoperative carcinoembryonic antigen, primary tumor site, cT, histological type, and tumor differentiation. RF was selected based on internal test performance. The area under the receiver operating characteristic curve (AUROC) was 0.803 (95% CI 0.756\u20100.849) in the internal test set and 0.776 (95% CI 0.755\u20100.797) in external validation. In external validation, accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were 0.687, 0.677, 0.693, 0.569, and 0.781, respectively. The Brier score was 0.190, and the calibration slope was 1.061. cT contributed most in SHAP analysis; however, the 6-predictor RF model showed significantly higher discrimination than cT alone in both the internal test set (AUROC 0.803 vs 0.712; \u0394AUROC=0.091;\n P<\/jats:italic>\n <.001) and external validation cohort (AUROC 0.776 vs 0.707; \u0394AUROC=0.069;\n P<\/jats:italic>\n <.001). Discrimination did not differ significantly between the 6-predictor and all-predictor RF models.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n We developed and externally validated a 6-predictor RF model for preoperative LNM risk estimation in patients with newly diagnosed CRC undergoing radical resection with regional lymph node dissection without preoperative anticancer treatment. The model showed moderate external discrimination and provided predictive information beyond cT alone. It is intended for research-stage adjunctive risk stratification and should not replace imaging, pathological evaluation, or clinical judgment. Prospective validation in broader populations and clinical settings is required before implementation.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/101162","type":"journal-article","created":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T17:55:08Z","timestamp":1788371708000},"page":"e101162-e101162","source":"Crossref","is-referenced-by-count":0,"title":["Preoperative Prediction of Lymph Node Metastasis in Colorectal Cancer Using Routinely Collected Clinical Data: Multicenter Retrospective Machine Learning Model Development and External Validation Study"],"prefix":"10.2196","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-7351-6348","authenticated-orcid":false,"given":"Gehui","family":"Xu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5595-2082","authenticated-orcid":false,"given":"Xiaohe","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2802-0989","authenticated-orcid":false,"given":"Jiaxin","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6897-3947","authenticated-orcid":false,"given":"Jin","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3369-3117","authenticated-orcid":false,"given":"Liu","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3329-2225","authenticated-orcid":false,"given":"Haibo","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1997-4097","authenticated-orcid":false,"given":"Yuekun","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7515-5942","authenticated-orcid":false,"given":"Haiyi","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,10,7]]},"reference":[{"issue":"4","key":"R1","doi-asserted-by":"publisher","DOI":"10.3322\/caac.70090","article-title":"Global cancer statistics 2024: GLOBOCAN estimates of incidence and mortality worldwide for 34 cancers in 186 countries","volume":"76","author":"Sung","journal-title":"CA Cancer J Clin"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2024.1409627","article-title":"Biomarkers of lymph node metastasis in colorectal cancer: update","volume":"14","author":"Zhu","journal-title":"Front Oncol"},{"issue":"5","key":"R3","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.1002\/ags3.70218","article-title":"Diagnostic accuracy of size-based preoperative CT assessment for predicting lymph node metastasis in colon cancer: a systematic review and meta-analysis","volume":"10","author":"Takayama","journal-title":"Ann Gastroenterol Surg"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejrad.2024.111417","article-title":"Primary staging of rectal cancer on MRI: an updated pictorial review with focus on common pitfalls and current controversies","volume":"175","author":"Salmer\u00f3n-Ruiz","journal-title":"Eur J Radiol"},{"issue":"5","key":"R5","doi-asserted-by":"publisher","first-page":"1927","DOI":"10.1007\/s00261-024-04668-z","article-title":"Machine learning and deep learning models for preoperative detection of lymph node metastasis in colorectal cancer: a systematic review and meta-analysis","volume":"50","author":"Abbaspour","journal-title":"Abdom Radiol (NY)"},{"issue":"12","key":"R6","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2024-086896","article-title":"State-of-the-art performance of deep learning methods for pre-operative radiologic staging of colorectal cancer lymph node metastasis: a scoping review","volume":"14","author":"Keel","journal-title":"BMJ Open"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-021-08773-w","article-title":"Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis","volume":"21","author":"Bedrikovetski","journal-title":"BMC Cancer"},{"issue":"4","key":"R8","doi-asserted-by":"publisher","first-page":"1301","DOI":"10.1007\/s13304-024-01884-6","article-title":"Predicting lymph node metastasis in colorectal cancer patients: development and validation of a column chart model","volume":"76","author":"Niu","journal-title":"Updates Surg"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2026.1860520","article-title":"Machine learning to develop and validate a model for predicting the risk of lymph node metastasis in colorectal cancer patients","volume":"16","author":"Xia","journal-title":"Front Oncol"},{"issue":"9","key":"R10","doi-asserted-by":"publisher","first-page":"1139","DOI":"10.1097\/DCR.0000000000002164","article-title":"Classic and novel histopathologic risk factors for lymph node metastasis in T1 colorectal cancer: a systematic review and meta-analysis","volume":"64","author":"Dykstra","journal-title":"Dis Colon Rectum"},{"issue":"2","key":"R11","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1016\/j.humpath.2013.07.046","article-title":"Histologic grading based on counting poorly differentiated clusters in preoperative biopsy predicts nodal involvement and pTNM stage in colorectal cancer patients","volume":"45","author":"Barresi","journal-title":"Hum Pathol"},{"issue":"1","key":"R12","doi-asserted-by":"publisher","DOI":"10.1007\/s12672-021-00398-6","article-title":"Clinicopathological factors and survival outcomes of signet-ring cell and mucinous carcinoma versus adenocarcinoma of the colon and rectum: a systematic review and meta-analysis","volume":"12","author":"Fadel","journal-title":"Discov Onc"},{"issue":"1","key":"R13","doi-asserted-by":"publisher","DOI":"10.1007\/s12672-021-00443-4","article-title":"Endoscopy biopsy is not efficiency enough for diagnosis of mucinous colorectal adenocarcinoma","volume":"12","author":"Xiao","journal-title":"Discov Oncol"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","DOI":"10.1007\/s00384-023-04386-w","article-title":"Lymph node metastasis in T1-2 colorectal cancer: a population-based study","volume":"38","author":"Xiong","journal-title":"Int J Colorectal Dis"},{"issue":"1","key":"R15","doi-asserted-by":"publisher","DOI":"10.1007\/s10151-024-03020-3","article-title":"Oncologic outcomes and trends in each colon cancer location and stages over the last two decades: insights from the SEER registry","volume":"28","author":"Benlice","journal-title":"Tech Coloproctol"},{"issue":"1","key":"R16","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-024-55139-w","article-title":"Tumor location matters, next generation sequencing mutation profiling of left-sided, rectal, and right-sided colorectal tumors in 552 patients","volume":"14","author":"Ciepiela","journal-title":"Sci Rep"},{"issue":"16","key":"R17","doi-asserted-by":"publisher","DOI":"10.3390\/ijms25168836","article-title":"Obesity-associated colorectal cancer","volume":"25","author":"Gonzalez-Gutierrez","journal-title":"Int J Mol Sci"},{"issue":"2","key":"R18","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1007\/s10654-022-00954-6","article-title":"Is the association of overweight and obesity with colorectal cancer underestimated? An umbrella review of systematic reviews and meta-analyses","volume":"38","author":"Mandic","journal-title":"Eur J Epidemiol"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2021.709070","article-title":"Magnetic resonance imaging evaluation of the accuracy of various lymph node staging criteria in rectal cancer: a systematic review and meta-analysis","volume":"11","author":"Zhuang","journal-title":"Front Oncol"},{"issue":"5","key":"R20","doi-asserted-by":"publisher","DOI":"10.2214\/AJR.24.31440","article-title":"Diagnostic performance of MRI and FDG PET\/CT for preoperative locoregional staging of colon cancer: systematic review and meta-analysis","volume":"223","author":"Sikkenk","journal-title":"AJR Am J Roentgenol"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-020-01618-6","article-title":"Risk factors and risk prediction models for colorectal cancer metastasis and recurrence: an umbrella review of systematic reviews and meta-analyses of observational studies","volume":"18","author":"Xu","journal-title":"BMC Med"},{"issue":"6","key":"R22","doi-asserted-by":"publisher","first-page":"3795","DOI":"10.1097\/JS9.0000000000001239","article-title":"Application of radiomics for preoperative prediction of lymph node metastasis in colorectal cancer: a systematic review and meta-analysis","volume":"110","author":"Abbaspour","journal-title":"Int J Surg"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2022.1087882","article-title":"MRI-based multiregional radiomics for predicting lymph nodes status and prognosis in patients with resectable rectal cancer","volume":"12","author":"Li","journal-title":"Front Oncol"},{"issue":"1","key":"R24","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-021-00426-3","article-title":"Machine learning for patient risk stratification: standing on, or looking over, the shoulders of clinicians?","volume":"4","author":"Beaulieu-Jones","journal-title":"NPJ Digit Med"},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2023-074819","article-title":"Evaluation of clinical prediction models (part 1): from development to external validation","volume":"384","author":"Collins","journal-title":"BMJ"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-025-02463-y","article-title":"Externally validated and clinically useful machine learning algorithms to support patient-related decision-making in oncology: a scoping review","volume":"25","author":"Santos","journal-title":"BMC Med Res Methodol"}],"container-title":["JMIR Cancer"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T19:14:21Z","timestamp":1791400461000},"score":1,"resource":{"primary":{"URL":"https:\/\/cancer.jmir.org\/2026\/1\/e101162"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,7]]},"references-count":26,"URL":"https:\/\/doi.org\/10.2196\/101162","relation":{},"ISSN":["2369-1999"],"issn-type":[{"value":"2369-1999","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,7]]},"article-number":"v12i4e101162"}}