{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T14:51:28Z","timestamp":1780930288672,"version":"3.54.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,27]],"date-time":"2024-04-27T00:00:00Z","timestamp":1714176000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,27]],"date-time":"2024-04-27T00:00:00Z","timestamp":1714176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"The College Students' Innovative Entrepreneurial Training Plan Program in Sichuan Province","award":["S202310634054 & S202210634068"],"award-info":[{"award-number":["S202310634054 & S202210634068"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Cancer"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Cervical lymph node metastasis (LNM) is an important prognostic factor for patients with non-small cell lung cancer (NSCLC). We aimed to develop and validate machine learning models that use ultrasound radiomic and descriptive semantic features to diagnose cervical LNM in patients with NSCLC.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>This study included NSCLC patients who underwent neck ultrasound examination followed by cervical lymph node (LN) biopsy between January 2019 and January 2022 from three institutes. Radiomic features were extracted from the ultrasound images at the maximum cross-sectional areas of cervical LNs. Logistic regression (LR) and random forest (RF) models were developed. Model performance was assessed by the area under the curve (AUC) and accuracy, validated internally and externally by fivefold cross-validation and hold-out method, respectively.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>In total, 313 patients with a median age of 64\u00a0years were included, and 276 (88.18%) had cervical LNM. Three descriptive semantic features, including long diameter, shape, and corticomedullary boundary, were selected by multivariate analysis. Out of the 474 identified radiomic features, 9 were determined to fit the LR model, while 15 fit the RF model. The average AUCs of the semantic and radiomics models were 0.876 (range: 0.781\u20130.961) and 0.883 (range: 0.798\u20130.966), respectively. However, the average AUC was higher for the semantic-radiomics combined LR model (0.901; range: 0.862\u20130.927). When the RF algorithm was applied, the\u00a0average AUCs\u00a0of the radiomics and semantic-radiomics combined models were improved to 0.908 (range: 0.837\u20130.966) and 0.922 (range: 0.872\u20130.982), respectively. The models tested by the hold-out method had similar results, with the semantic-radiomics combined RF model achieving the highest AUC value of 0.901 (95% CI, 0.886\u20130.968).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The ultrasound radiomic models showed potential for accurately diagnosing cervical LNM in patients with NSCLC when integrated with descriptive semantic features. The RF model outperformed the conventional LR model in diagnosing cervical LNM in NSCLC patients.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12885-024-12306-6","type":"journal-article","created":{"date-parts":[[2024,4,27]],"date-time":"2024-04-27T06:03:13Z","timestamp":1714197793000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Ultrasound-based radiomics machine learning models for diagnosing cervical lymph node metastasis in patients with non-small cell lung cancer: a multicentre study"],"prefix":"10.1186","volume":"24","author":[{"given":"Zhiqiang","family":"Deng","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoling","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Renmei","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haoji","family":"Yan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lingyun","family":"Gou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenlong","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiaxin","family":"Wan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenwanqiu","family":"Song","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daiyuan","family":"Ma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haining","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Tian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,4,27]]},"reference":[{"key":"12306_CR1","doi-asserted-by":"crossref","unstructured":"Ferlay J, Colombet M, Soerjomataram I, Parkin DM, Pi\u00f1eros M, Znaor A, et al. Cancer statistics for the year 2020: An overview. Int J Cancer. 2021.","DOI":"10.1002\/ijc.33588"},{"issue":"3","key":"12306_CR2","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1016\/j.mcna.2018.12.006","volume":"103","author":"F Nasim","year":"2019","unstructured":"Nasim F, Sabath BF, Eapen GA. Lung Cancer. Med Clin North Am. 2019;103(3):463\u201373.","journal-title":"Med Clin North Am"},{"issue":"8","key":"12306_CR3","doi-asserted-by":"publisher","first-page":"1623","DOI":"10.1016\/j.mayocp.2019.01.013","volume":"94","author":"N Duma","year":"2019","unstructured":"Duma N, Santana-Davila R, Molina JR. Non-small cell lung cancer: epidemiology, screening, diagnosis, and treatment. Mayo Clin Proc. 2019;94(8):1623\u201340.","journal-title":"Mayo Clin Proc"},{"issue":"5","key":"12306_CR4","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1056\/NEJMoa1102873","volume":"365","author":"DR Aberle","year":"2011","unstructured":"Aberle DR, Adams AM, Berg CD, Black WC, Clapp JD, Fagerstrom RM, et al. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med. 2011;365(5):395\u2013409.","journal-title":"N Engl J Med"},{"issue":"6","key":"12306_CR5","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1056\/NEJMoa1911793","volume":"382","author":"HJ de Koning","year":"2020","unstructured":"de Koning HJ, van der Aalst CM, de Jong PA, Scholten ET, Nackaerts K, Heuvelmans MA, et al. Reduced lung-cancer mortality with volume ct screening in a randomized trial. N Engl J Med. 2020;382(6):503\u201313.","journal-title":"N Engl J Med"},{"issue":"1","key":"12306_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ccm.2019.10.001","volume":"41","author":"BC Bade","year":"2020","unstructured":"Bade BC, Dela Cruz CS. Lung Cancer 2020: Epidemiology, Etiology, and Prevention. Clin Chest Med. 2020;41(1):1\u201324.","journal-title":"Clin Chest Med."},{"issue":"5","key":"12306_CR7","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1136\/thx.2010.153288","volume":"66","author":"MM Hoosein","year":"2011","unstructured":"Hoosein MM, Barnes D, Khan AN, Peake MD, Bennett J, Purnell D, et al. The importance of ultrasound in staging and gaining a pathological diagnosis in patients with lung cancer\u2013a two year single centre experience. Thorax. 2011;66(5):414\u20137.","journal-title":"Thorax"},{"issue":"1","key":"12306_CR8","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/j.chest.2016.10.010","volume":"151","author":"FC Detterbeck","year":"2017","unstructured":"Detterbeck FC, Boffa DJ, Kim AW, Tanoue LT. The eighth edition lung cancer stage classification. Chest. 2017;151(1):193\u2013203.","journal-title":"Chest"},{"issue":"8","key":"12306_CR9","doi-asserted-by":"publisher","first-page":"4688","DOI":"10.1245\/s10434-022-11627-9","volume":"29","author":"TM Khan","year":"2022","unstructured":"Khan TM, Verbus EA, Gandhi S, Heymach JV, Hernandez JM, Elamin YY. Osimertinib, Surgery, and radiation therapy in treating patients with stage IIIB or IV non-small cell lung cancer with EGFR mutations (NORTHSTAR). Ann Surg Oncol. 2022;29(8):4688\u20139.","journal-title":"Ann Surg Oncol"},{"issue":"11","key":"12306_CR10","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1016\/j.clon.2022.08.032","volume":"34","author":"J King","year":"2022","unstructured":"King J, Patel K, Woolf D, Hatton MQ. The Use of Palliative radiotherapy in the treatment of lung cancer. Clin Oncol (R Coll Radiol). 2022;34(11):761\u201370.","journal-title":"Clin Oncol (R Coll Radiol)."},{"issue":"5","key":"12306_CR11","doi-asserted-by":"publisher","first-page":"1809","DOI":"10.1007\/s00330-017-5116-1","volume":"28","author":"F Han","year":"2018","unstructured":"Han F, Xu M, Xie T, Wang JW, Lin QG, Guo ZX, et al. Efficacy of ultrasound-guided core needle biopsy in cervical lymphadenopathy: A retrospective study of 6,695 cases. Eur Radiol. 2018;28(5):1809\u201317.","journal-title":"Eur Radiol"},{"issue":"8","key":"12306_CR12","doi-asserted-by":"publisher","first-page":"2146","DOI":"10.21037\/jtd.2016.07.71","volume":"8","author":"XF Leng","year":"2016","unstructured":"Leng XF, Zhu Y, Wang GP, Jin J, Xian L, Zhang YH. Accuracy of ultrasound for the diagnosis of cervical lymph node metastasis in esophageal cancer: a systematic review and meta-analysis. J Thorac Dis. 2016;8(8):2146\u201357.","journal-title":"J Thorac Dis"},{"issue":"4","key":"12306_CR13","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1016\/j.ejca.2011.11.036","volume":"48","author":"P Lambin","year":"2012","unstructured":"Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. 2012;48(4):441\u20136.","journal-title":"Eur J Cancer"},{"issue":"6","key":"12306_CR14","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1111\/joim.12822","volume":"284","author":"GS Handelman","year":"2018","unstructured":"Handelman GS, Kok HK, Chandra RV, Razavi AH, Lee MJ, Asadi H. eDoctor: machine learning and the future of medicine. J Intern Med. 2018;284(6):603\u201319.","journal-title":"J Intern Med"},{"issue":"2","key":"12306_CR15","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1148\/radiology.177.2.2217772","volume":"177","author":"MW van den Brekel","year":"1990","unstructured":"van den Brekel MW, Stel HV, Castelijns JA, Nauta JJ, van der Waal I, Valk J, et al. Cervical lymph node metastasis: assessment of radiologic criteria. Radiology. 1990;177(2):379\u201384.","journal-title":"Radiology"},{"issue":"7","key":"12306_CR16","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1001\/archotol.128.7.751","volume":"128","author":"KT Robbins","year":"2002","unstructured":"Robbins KT, Clayman G, Levine PA, Medina J, Sessions R, Shaha A, et al. Neck dissection classification update: revisions proposed by the American head and neck society and the american academy of otolaryngology-head and neck surgery. Arch Otolaryngol Head Neck Surg. 2002;128(7):751\u20138.","journal-title":"Arch Otolaryngol Head Neck Surg"},{"issue":"21","key":"12306_CR17","doi-asserted-by":"publisher","first-page":"e104","DOI":"10.1158\/0008-5472.CAN-17-0339","volume":"77","author":"JJM van Griethuysen","year":"2017","unstructured":"van Griethuysen JJM, Fedorov A, Parmar C, Hosny A, Aucoin N, Narayan V, et al. Computational radiomics system to decode the radiographic phenotype. Cancer Res. 2017;77(21):e104\u20137.","journal-title":"Cancer Res"},{"issue":"4","key":"12306_CR18","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1002\/(SICI)1097-0258(19970228)16:4<385::AID-SIM380>3.0.CO;2-3","volume":"16","author":"R Tibshirani","year":"1997","unstructured":"Tibshirani R. The lasso method for variable selection in the Cox model. Stat Med. 1997;16(4):385\u201395.","journal-title":"Stat Med"},{"key":"12306_CR19","doi-asserted-by":"crossref","unstructured":"Hong H, Xiaoling G, Hua Y, editors. Variable selection using mean decrease accuracy and mean decrease gini based on random forest. 2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS); 2016 26\u201328 Aug. 2016.","DOI":"10.1109\/ICSESS.2016.7883053"},{"issue":"6","key":"12306_CR20","doi-asserted-by":"publisher","first-page":"1363","DOI":"10.1016\/j.otc.2012.08.007","volume":"45","author":"TC Bryson","year":"2012","unstructured":"Bryson TC, Shah GV, Srinivasan A, Mukherji SK. Cervical lymph node evaluation and diagnosis. Otolaryngol Clin North Am. 2012;45(6):1363\u201383.","journal-title":"Otolaryngol Clin North Am"},{"issue":"3","key":"12306_CR21","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1002\/hed.21448","volume":"33","author":"A Gupta","year":"2011","unstructured":"Gupta A, Rahman K, Shahid M, Kumar A, Qaseem SMD, Hassan SA, et al. Sonographic assessment of cervical lymphadenopathy: role of high-resolution and color Doppler imaging. Head Neck. 2011;33(3):297\u2013302.","journal-title":"Head Neck"},{"key":"12306_CR22","doi-asserted-by":"crossref","unstructured":"Lin M, Tang X, Cao L, Liao Y, Zhang Y, Zhou J. Using ultrasound radiomics analysis to diagnose cervical lymph node metastasis in patients with nasopharyngeal carcinoma. European Radiology. 2023;33(2):774\u201383.","DOI":"10.1007\/s00330-022-09122-6"},{"issue":"5","key":"12306_CR23","doi-asserted-by":"publisher","first-page":"506","DOI":"10.1053\/j.sult.2017.05.005","volume":"38","author":"R Prativadi","year":"2017","unstructured":"Prativadi R, Dahiya N, Kamaya A, Bhatt S. Chapter 5 Ultrasound characteristics of benign vs malignant cervical Lymph nodes. Semin Ultrasound CT MR. 2017;38(5):506\u201315.","journal-title":"Semin Ultrasound CT MR"},{"issue":"12","key":"12306_CR24","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1038\/nrclinonc.2017.141","volume":"14","author":"P Lambin","year":"2017","unstructured":"Lambin P, Leijenaar RTH, Deist TM, Peerlings J, de Jong EEC, van Timmeren J, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. 2017;14(12):749\u201362.","journal-title":"Nat Rev Clin Oncol"},{"key":"12306_CR25","doi-asserted-by":"crossref","unstructured":"Tian D, Yan HJ, Shiiya H, Sato M, Shinozaki-Ushiku A, Nakajima J. Machine learning-based radiomic computed tomography phenotyping of thymic epithelial tumors: Predicting pathological and survival outcomes. J Thorac Cardiovasc Surg. 2022.","DOI":"10.1016\/j.jtcvs.2022.05.046"},{"key":"12306_CR26","doi-asserted-by":"publisher","first-page":"1064434","DOI":"10.3389\/fendo.2022.1064434","volume":"13","author":"Q Wen","year":"2022","unstructured":"Wen Q, Wang Z, Traverso A, Liu Y, Xu R, Feng Y, et al. A radiomics nomogram for the ultrasound-based evaluation of central cervical lymph node metastasis in papillary thyroid carcinoma. Front Endocrinol. 2022;13:1064434.","journal-title":"Front Endocrinol"},{"issue":"1","key":"12306_CR27","doi-asserted-by":"publisher","first-page":"1236","DOI":"10.1038\/s41467-020-15027-z","volume":"11","author":"X Zheng","year":"2020","unstructured":"Zheng X, Yao Z, Huang Y, Yu Y, Wang Y, Liu Y, et al. Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer. Nat Commun. 2020;11(1):1236.","journal-title":"Nat Commun"},{"issue":"6","key":"12306_CR28","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1016\/j.healun.2022.03.010","volume":"41","author":"D Tian","year":"2022","unstructured":"Tian D, Shiiya H, Takahashi M, Terasaki Y, Urushiyama H, Shinozaki-Ushiku A, et al. Noninvasive monitoring of allograft rejection in a rat lung transplant model: Application of machine learning-based (18)F-fluorodeoxyglucose positron emission tomography radiomics. J Heart Lung Transplant. 2022;41(6):722\u201331.","journal-title":"J Heart Lung Transplant"},{"issue":"5","key":"12306_CR29","doi-asserted-by":"publisher","first-page":"e2312022","DOI":"10.1001\/jamanetworkopen.2023.12022","volume":"6","author":"D Tian","year":"2023","unstructured":"Tian D, Yan H-J, Huang H, Zuo Y-J, Liu M-Z, Zhao J, et al. Machine learning-based prognostic model for patients after lung transplantation. JAMA Netw Open. 2023;6(5):e2312022.","journal-title":"JAMA Netw Open"},{"issue":"1","key":"12306_CR30","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L. Random Forests. Mach Learn. 2001;45(1):5\u201332.","journal-title":"Mach Learn"},{"issue":"18","key":"12306_CR31","doi-asserted-by":"publisher","first-page":"5374","DOI":"10.7150\/thno.34149","volume":"9","author":"L Xu","year":"2019","unstructured":"Xu L, Yang P, Liang W, Liu W, Wang W, Luo C, et al. A radiomics approach based on support vector machine using MR images for preoperative lymph node status evaluation in intrahepatic cholangiocarcinoma. Theranostics. 2019;9(18):5374\u201385.","journal-title":"Theranostics"},{"issue":"2","key":"12306_CR32","doi-asserted-by":"publisher","first-page":"584","DOI":"10.1158\/1078-0432.CCR-18-1305","volume":"25","author":"W Liang","year":"2019","unstructured":"Liang W, Yang P, Huang R, Xu L, Wang J, Liu W, et al. A combined nomogram model to preoperatively predict histologic grade in pancreatic neuroendocrine tumors. Clin Cancer Res. 2019;25(2):584\u201394.","journal-title":"Clin Cancer Res"}],"container-title":["BMC Cancer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12885-024-12306-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12885-024-12306-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12885-024-12306-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,27]],"date-time":"2024-04-27T18:03:37Z","timestamp":1714241017000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmccancer.biomedcentral.com\/articles\/10.1186\/s12885-024-12306-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,27]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["12306"],"URL":"https:\/\/doi.org\/10.1186\/s12885-024-12306-6","relation":{},"ISSN":["1471-2407"],"issn-type":[{"value":"1471-2407","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,27]]},"assertion":[{"value":"11 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 April 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All centres complied with local ethics requirements. Research procedures were conducted in accordance with the Declaration of Helsinki (1975) and its amendments. The study was approved and the requirement for informed consent was waived by the Ethics Committees and Review Board of the Nanchong Central Hospital, Affiliated Hospital of North Sichuan Medical College, and Suining Central Hospital because of the retrospective nature of the study. All methods were carried out in accordance with relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"536"}}