{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T05:15:56Z","timestamp":1784783756995,"version":"3.55.0"},"reference-count":36,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2025,5,11]],"date-time":"2025-05-11T00:00:00Z","timestamp":1746921600000},"content-version":"vor","delay-in-days":10,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003995","name":"Anhui Provincial Natural Science Foundation","doi-asserted-by":"publisher","award":["2308085MH278"],"award-info":[{"award-number":["2308085MH278"]}],"id":[{"id":"10.13039\/501100003995","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Health Research Program of Anhui","award":["AHWJ2023A10017"],"award-info":[{"award-number":["AHWJ2023A10017"]}]},{"name":"Postgraduate Innovation Research"},{"name":"Practice Program of Anhui Medical University","award":["YJS20230130"],"award-info":[{"award-number":["YJS20230130"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,5,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Accurate preoperative assessment of axillary lymph node metastasis (ALNM) in breast cancer is crucial for guiding treatment decisions. This study aimed to develop a deep-learning radiomics model for assessing ALNM and to evaluate its impact on radiologists\u2019 diagnostic accuracy.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>This multicenter study included 866 breast cancer patients from 6 hospitals. The data were categorized into training, internal test, external test, and prospective test sets. Deep learning and handcrafted radiomics features were extracted from ultrasound images of primary tumors and lymph nodes. The tumor score and LN score were calculated following feature selection, and a clinical-radiomics model was constructed based on these scores along with clinical-ultrasonic risk factors. The model\u2019s performance was validated across the 3 test sets. Additionally, the diagnostic performance of radiologists, with and without model assistance, was evaluated.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The clinical-radiomics model demonstrated robust discrimination with AUCs of 0.94, 0.92, 0.91, and 0.95 in the training, internal test, external test, and prospective test sets, respectively. It surpassed the clinical model and single score in all sets (P &amp;lt; .05). Decision curve analysis and clinical impact curves validated the clinical utility of the clinical-radiomics model. Moreover, the model significantly improved radiologists\u2019 diagnostic accuracy, with AUCs increasing from 0.71 to 0.82 for the junior radiologist and from 0.75 to 0.85 for the senior radiologist.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>The clinical-radiomics model effectively predicts ALNM in breast cancer patients using noninvasive ultrasound features. Additionally, it enhances radiologists\u2019 diagnostic accuracy, potentially optimizing resource allocation in breast cancer management.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/oncolo\/oyaf090","type":"journal-article","created":{"date-parts":[[2025,5,11]],"date-time":"2025-05-11T06:09:03Z","timestamp":1746943743000},"source":"Crossref","is-referenced-by-count":9,"title":["Ultrasound-based deep learning radiomics for enhanced axillary lymph node metastasis assessment: a multicenter study"],"prefix":"10.1093","volume":"30","author":[{"given":"Di","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University , Hefei ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wang","family":"Zhou","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University , Hefei ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wen-Wu","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University , Hefei ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xia-Chuan","family":"Qin","sequence":"additional","affiliation":[{"name":"Department of Medical Ultrasound, Chengdu Second People\u2019s Hospital , Chengdu ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xian-Ya","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology , Wuhan ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan-Hong","family":"Luo","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The Third Affiliated Hospital of Anhui Medical University, Hefei First People\u2019s Hospital , Hefei ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The Second Affiliated Hospital of Anhui Medical University , Hefei ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun-Li","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, WuHu Hospital, East China Normal University (The Second People\u2019s Hospital, WuHu) , Wuhu ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun-Jie","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Medical Ultrasound, Fuyang Cancer Hospital , Fuyang ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3037-8819","authenticated-orcid":false,"given":"Chao-Xue","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University , Hefei ,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2025,5,11]]},"reference":[{"key":"2025051102085683800_CIT0001","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3322\/caac.21660","article-title":"Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"71","author":"Sung","year":"2021","journal-title":"CA Cancer J Clin."},{"key":"2025051102085683800_CIT0002","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1016\/j.suc.2018.04.001","article-title":"Management of the axilla in the patient with breast cancer","volume":"98","author":"Park","year":"2018","journal-title":"Surg Clin North Am."},{"key":"2025051102085683800_CIT0003","doi-asserted-by":"publisher","first-page":"2890","DOI":"10.1245\/s10434-018-6595-2","article-title":"Axillary nodal evaluation in elderly breast cancer patients: potential effects on treatment decisions and survival","volume":"25","author":"Tamirisa","year":"2018","journal-title":"Ann Surg Oncol."},{"key":"2025051102085683800_CIT0004","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1148\/radiol.2020192534","article-title":"Axillary nodal evaluation in breast cancer: state of the art","volume":"295","author":"Chang","year":"2020","journal-title":"Radiology."},{"key":"2025051102085683800_CIT0005","doi-asserted-by":"publisher","first-page":"103460","DOI":"10.1016\/j.ebiom.2021.103460","article-title":"Magnetic resonance imaging radiomics predicts preoperative axillary lymph node metastasis to support surgical decisions and is associated with tumor microenvironment in invasive breast cancer: a machine learning, multicenter study","volume":"69","author":"Yu","year":"2021","journal-title":"EBioMedicine"},{"key":"2025051102085683800_CIT0006","doi-asserted-by":"publisher","first-page":"1219838","DOI":"10.3389\/fonc.2023.1219838","article-title":"Prediction of axillary lymph node metastasis in early breast cancer patients with ultrasonic videos based deep learning","volume":"13","author":"Li","year":"2023","journal-title":"Front Oncol."},{"key":"2025051102085683800_CIT0007","doi-asserted-by":"publisher","first-page":"1236","DOI":"10.1038\/s41467-020-15027-z","article-title":"Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer","volume":"11","author":"Zheng","year":"2020","journal-title":"Nat Commun."},{"key":"2025051102085683800_CIT0008","doi-asserted-by":"publisher","first-page":"929","DOI":"10.1186\/s12885-022-10034-3","article-title":"Prediction model of axillary lymph node status using automated breast ultrasound (ABUS) and ki-67 status in early-stage breast cancer","volume":"22","author":"Wang","year":"2022","journal-title":"BMC Cancer"},{"key":"2025051102085683800_CIT0009","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1177\/0284185117723039","article-title":"Association between US features of primary tumor and axillary lymph node metastasis in patients with clinical T1-T2N0 breast cancer","volume":"59","author":"Bae","year":"2018","journal-title":"Acta Radiol"},{"key":"2025051102085683800_CIT0010","doi-asserted-by":"publisher","first-page":"105250","DOI":"10.1016\/j.compbiomed.2022.105250","article-title":"Deep learning prediction of axillary lymph node status using ultrasound images","volume":"143","author":"Sun","year":"2022","journal-title":"Comput Biol Med."},{"key":"2025051102085683800_CIT0011","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1186\/s12885-023-10743-3","article-title":"Automated Breast Ultrasound (ABUS)-based radiomics nomogram: an individualized tool for predicting axillary lymph node tumor burden in patients with early breast cancer","volume":"23","author":"Chen","year":"2023","journal-title":"BMC Cancer"},{"key":"2025051102085683800_CIT0012","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1007\/s12282-013-0465-3","article-title":"Interobserver variability of ultrasound elastography and the ultrasound BI-RADS lexicon of breast lesions","volume":"22","author":"Park","year":"2015","journal-title":"Breast Cancer"},{"key":"2025051102085683800_CIT0013","doi-asserted-by":"publisher","first-page":"e221843","DOI":"10.1148\/radiol.221843","article-title":"Combining deep learning and handcrafted radiomics for classification of suspicious lesions on contrast-enhanced mammograms","volume":"307","author":"Beuque","year":"2023","journal-title":"Radiology."},{"key":"2025051102085683800_CIT0014","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1002\/cncr.34540","article-title":"Deep learning radiomics of ultrasonography for comprehensively predicting tumor and axillary lymph node status after neoadjuvant chemotherapy in breast cancer patients: a multicenter study","volume":"129","author":"Gu","year":"2023","journal-title":"Cancer."},{"key":"2025051102085683800_CIT0015","doi-asserted-by":"publisher","first-page":"445","DOI":"10.11152\/mu-4080","article-title":"An overview of ultrasound-derived radiomics and deep learning in liver","volume":"25","author":"Zhang","year":"2023","journal-title":"Med Ultrason"},{"key":"2025051102085683800_CIT0016","doi-asserted-by":"publisher","first-page":"940655","DOI":"10.3389\/fonc.2022.940655","article-title":"A nomogram based on radiomics signature and deep-learning signature for preoperative prediction of axillary lymph node metastasis in breast cancer","volume":"12","author":"Wang","year":"2022","journal-title":"Front Oncol."},{"key":"2025051102085683800_CIT0017","doi-asserted-by":"publisher","first-page":"1281","DOI":"10.1016\/j.acra.2022.10.015","article-title":"Comparison of traditional radiomics, deep learning radiomics and fusion methods for axillary lymph node metastasis prediction in breast cancer","volume":"30","author":"Li","year":"2023","journal-title":"Acad Radiol."},{"key":"2025051102085683800_CIT0018","doi-asserted-by":"publisher","first-page":"4995","DOI":"10.21037\/qims-22-1257","article-title":"Deep learning radiomics for prediction of axillary lymph node metastasis in patients with clinical stage T1-2 breast cancer","volume":"13","author":"Wei","year":"2023","journal-title":"Quant Imaging Med Surg"},{"key":"2025051102085683800_CIT0019","doi-asserted-by":"publisher","first-page":"15330338231166218","DOI":"10.1177\/15330338231166218","article-title":"Prediction of axillary lymph node metastatic load of breast cancer based on ultrasound deep learning radiomics nomogram","volume":"22","author":"Zhang","year":"2023","journal-title":"Technol Cancer Res Treat"},{"key":"2025051102085683800_CIT0020","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1148\/rg.336125060","article-title":"Axillary staging of breast cancer: what the radiologist should know","volume":"33","author":"Ecanow","year":"2013","journal-title":"Radiographics."},{"key":"2025051102085683800_CIT0021","doi-asserted-by":"publisher","first-page":"108658","DOI":"10.1016\/j.ejrad.2019.108658","article-title":"Ultrasound-based radiomics nomogram: a potential biomarker to predict axillary lymph node metastasis in early-stage invasive breast cancer","volume":"119","author":"Yu","year":"2019","journal-title":"Eur J Radiol."},{"key":"2025051102085683800_CIT0022","doi-asserted-by":"publisher","first-page":"1385","DOI":"10.1016\/S1470-2045(18)30380-2","article-title":"Axillary dissection versus no axillary dissection in patients with breast cancer and sentinel-node micrometastases (IBCSG 23-01): 10-year follow-up of a randomised, controlled phase 3 trial","volume":"19","author":"Galimberti","year":"2018","journal-title":"Lancet Oncol."},{"key":"2025051102085683800_CIT0023","doi-asserted-by":"publisher","first-page":"1581","DOI":"10.1016\/j.ultrasmedbio.2017.03.016","article-title":"Pre-operative evaluation of axillary lymph node status in patients with suspected breast cancer using shear wave elastography","volume":"43","author":"Youk","year":"2017","journal-title":"Ultrasound Med Biol."},{"key":"2025051102085683800_CIT0024","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1148\/radiol.2018171987","article-title":"Preoperative axillary US in early-stage breast cancer: potential to prevent unnecessary axillary lymph node dissection","volume":"288","author":"Kim","year":"2018","journal-title":"Radiology."},{"key":"2025051102085683800_CIT0025","doi-asserted-by":"publisher","first-page":"2313","DOI":"10.1007\/s00330-021-08330-w","article-title":"Radiomics model based on shear-wave elastography in the assessment of axillary lymph node status in early-stage breast cancer","volume":"32","author":"Jiang","year":"2022","journal-title":"Eur Radiol."},{"key":"2025051102085683800_CIT0026","doi-asserted-by":"publisher","first-page":"1323","DOI":"10.1007\/s10278-023-00818-9","article-title":"Deep learning radiomics of preoperative breast MRI for prediction of axillary lymph node metastasis in breast cancer","volume":"36","author":"Chen","year":"2023","journal-title":"J Digit Imaging."},{"key":"2025051102085683800_CIT0027","doi-asserted-by":"publisher","first-page":"2684","DOI":"10.1016\/j.acra.2024.01.026","article-title":"Nomogram utilizing abvs radiomics and clinical factors for predicting \u2264 3 positive axillary lymph nodes in HR+ \/HER2- breast cancer with 1-2 positive sentinel nodes","volume":"31","author":"Hu","year":"2024","journal-title":"Acad Radiol."},{"key":"2025051102085683800_CIT0028","doi-asserted-by":"publisher","first-page":"488","DOI":"10.2967\/jnumed.118.222893","article-title":"Introduction to radiomics","volume":"61","author":"Mayerhoefer","year":"2020","journal-title":"J Nucl Med"},{"key":"2025051102085683800_CIT0029","doi-asserted-by":"publisher","first-page":"1180","DOI":"10.1016\/S1470-2045(18)30413-3","article-title":"A radiomics approach to assess tumour-infiltrating CD8 cells and response to anti-PD-1 or anti-PD-L1 immunotherapy: an imaging biomarker, retrospective multicohort study","volume":"19","author":"Sun","year":"2018","journal-title":"Lancet Oncol."},{"key":"2025051102085683800_CIT0030","doi-asserted-by":"publisher","first-page":"e192561","DOI":"10.1001\/jamanetworkopen.2019.2561","article-title":"Association of peritumoral radiomics with tumor biology and pathologic response to preoperative targeted therapy for HER2 (ERBB2)-positive breast cancer","volume":"2","author":"Braman","year":"2019","journal-title":"JAMA Netw Open"},{"key":"2025051102085683800_CIT0031","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1007\/s11604-022-01261-6","article-title":"Deep learning method with a convolutional neural network for image classification of normal and metastatic axillary lymph nodes on breast ultrasonography","volume":"40","author":"Ozaki","year":"2022","journal-title":"Jpn J Radiol"},{"key":"2025051102085683800_CIT0032","doi-asserted-by":"publisher","first-page":"S25","DOI":"10.1016\/j.acra.2023.05.025","article-title":"Prediction of axillary lymph node metastasis in early-stage triple-negative breast cancer using multiparametric and radiomic features of breast MRI","volume":"30","author":"Song","year":"2023","journal-title":"Acad Radiol."},{"key":"2025051102085683800_CIT0033","doi-asserted-by":"publisher","first-page":"1202","DOI":"10.1016\/j.ultrasmedbio.2023.01.006","article-title":"Non-invasive assessment of axillary lymph node metastasis risk in early invasive breast cancer adopting automated breast volume scanning-based radiomics nomogram: a multicenter study","volume":"49","author":"Wang","year":"2023","journal-title":"Ultrasound Med Biol."},{"key":"2025051102085683800_CIT0034","doi-asserted-by":"publisher","first-page":"3820","DOI":"10.1007\/s00330-018-5981-2","article-title":"Radiomic nomogram for prediction of axillary lymph node metastasis in breast cancer","volume":"29","author":"Han","year":"2019","journal-title":"Eur Radiol."},{"key":"2025051102085683800_CIT0035","doi-asserted-by":"publisher","first-page":"103018","DOI":"10.1016\/j.ebiom.2020.103018","article-title":"Deep learning radiomics of ultrasonography: identifying the risk of axillary non-sentinel lymph node involvement in primary breast cancer","volume":"60","author":"Guo","year":"2020","journal-title":"EBioMedicine"},{"key":"2025051102085683800_CIT0036","doi-asserted-by":"publisher","first-page":"757","DOI":"10.3390\/cancers13040757","article-title":"Dedicated axillary MRI-based radiomics analysis for the prediction of axillary lymph node metastasis in breast cancer","volume":"13","author":"Samiei","year":"2021","journal-title":"Cancers"}],"container-title":["The Oncologist"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/oncolo\/article-pdf\/30\/5\/oyaf090\/63142061\/oyaf090.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/oncolo\/article-pdf\/30\/5\/oyaf090\/63142061\/oyaf090.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,11]],"date-time":"2025-05-11T06:09:05Z","timestamp":1746943745000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/oncolo\/article\/doi\/10.1093\/oncolo\/oyaf090\/8128450"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5]]},"references-count":36,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,5,8]]}},"URL":"https:\/\/doi.org\/10.1093\/oncolo\/oyaf090","relation":{},"ISSN":["1083-7159","1549-490X"],"issn-type":[{"value":"1083-7159","type":"print"},{"value":"1549-490X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,5]]},"published":{"date-parts":[[2025,5]]},"article-number":"oyaf090"}}