{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T13:25:18Z","timestamp":1791897918917,"version":"4.3.4"},"reference-count":31,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,8,19]],"date-time":"2025-08-19T00:00:00Z","timestamp":1755561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Endocrinol."],"abstract":"<jats:sec><jats:title>Objective<\/jats:title><jats:p>This study aims to construct a multimodal radiomics model based on contrast-enhanced ultrasound (CEUS) radiomic features, combined with conventional ultrasonography (US) images and clinical data, to evaluate its diagnostic efficacy in differentiating benign and malignant thyroid nodules (TNs) classified as C-TIRADS 4, and to assess the clinical application value of the model.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>This retrospective study enrolled 135 patients with C-TIRADS 4 thyroid nodules who underwent concurrent US and CEUS before FNA\/surgery. From each case, one US image and three CEUS key frames (2s post-perfusion, peak enhancement, 2s post-peak) were selected. Patients were randomly split into training (n=108) and test (n=27) cohorts (8:2 ratio). ROIs were manually delineated (3D-Slicer), with radiomics features extracted (PyRadiomics) and selected via mRMR and LASSO. Six CEUS radiomics-based machine learning models (KNN, SVM, RF, XGBoost, LightGBM, SGD) were developed and evaluated using AUC, accuracy, sensitivity, specificity, and F1-score. The optimal classifier was used to build US-only, US+CEUS, and clinical+US+CEUS models. Statistical comparisons employed DeLong tests, calibration curves, and DCA.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The CEUS radiomics model demonstrated favorable diagnostic performance in differentiating benign and malignant C-TIRADS 4 thyroid nodules, with sensitivity, specificity, and accuracy of 0.875, 0.769, and 0.833, respectively. When CEUS radiomic features were combined with US features, the diagnostic performance of the CEUS radiomics model was comparable to that of the US+CEUS radiomics model (AUC: 0.813 vs. 0.829, P=0.005). Furthermore, the multimodal radiomics model integrating clinical data (clinical+US+CEUS radiomics model) achieved significantly improved diagnostic efficacy, with an AUC of 0.967, along with accuracy, sensitivity, specificity, and F1-score values of 0.815, 0.823, 0.792, and 0.884, respectively.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Our study developed a high-performance multimodal diagnostic model through the innovative integration of radiomic features from three critical CEUS timepoints combined with conventional ultrasound and clinical data, establishing a novel decision-support tool for accurate noninvasive classification of C-TIRADS 4 thyroid nodules. The model\u2019s superior diagnostic performance (AUC 0.967) demonstrates the transformative potential of multimodal integration in overcoming single-modality limitations and enhancing clinical decision-making, positioning this approach as a promising solution to mitigate unnecessary diagnostic procedures and overtreatment.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fendo.2025.1639017","type":"journal-article","created":{"date-parts":[[2025,8,19]],"date-time":"2025-08-19T04:10:39Z","timestamp":1755576639000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Multimodal radiomics model with triple -timepoint contrast-enhanced ultrasound for precise diagnosis of C-TIRADS 4 thyroid nodules"],"prefix":"10.3389","volume":"16","author":[{"given":"Linlin","family":"Shao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lili","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lifang","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fangfang","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongyu","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tongfeng","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feng","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lirong","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,8,19]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2019.0067","article-title":"Efficacy and safety of long-term universal salt iodization on thyroid disorders: epidemiological evidence from 31 provinces of mainland China","volume":"30","author":"Li","year":"2020","journal-title":"Thyroid"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.11110206","article-title":"Thyroid imaging reporting and data system for US features of nodules: A step in establishing better stratification of cancer risk","volume":"260","author":"Kwak","year":"2011","journal-title":"Radiology"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacr.2017.01.046","article-title":"ACR thyroid imaging, reporting and data system (TI-RADS): white paper of the ACR TI-RADS committee","volume":"14","author":"Tessler","year":"2017","journal-title":"J Am Coll Radiol"},{"key":"B4","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1007\/s12020-020-02441-y","article-title":"2020 Chinese guidelines for ultrasound Malignancy risk stratification of thyroid nodules: the C-TIRADS","volume":"70","author":"Zhou","year":"2021","journal-title":"Endocrine"},{"key":"B5","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1148\/radiol.2017171240","article-title":"Thyroid imaging reporting and data system (TI-RADS): A user\u2019s guide","volume":"287","author":"Tessler","year":"2018","journal-title":"Radiology"},{"key":"B6","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1007\/s00432-024-05847-7","article-title":"Clinical risk factors and cancer risk of thyroid imaging reporting and data system category 4 A thyroid nodules","volume":"150","author":"Cheng","year":"2024","journal-title":"J Cancer Res Clin Oncol"},{"key":"B7","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1186\/s12880-022-00805-6","article-title":"Contrast-enhanced ultrasound improves the potency of fine-needle aspiration in thyroid nodules with high inadequate risk","volume":"22","author":"Yin","year":"2022","journal-title":"BMC Med Imaging"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-006-0229-y","article-title":"Qualitative and quantitative evaluation of solitary thyroid nodules with contrast-enhanced ultrasound: initial results","volume":"16","author":"Bartolotta","year":"2006","journal-title":"Eur Radiol"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0231775","article-title":"Contrast-enhanced ultrasound for the differential diagnosis of thyroid nodules: An updated meta-analysis with comprehensive heterogeneity analysis","volume":"15","author":"Cohen","year":"2020","journal-title":"PloS One"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1097\/MD.0000000000039843","article-title":"Comparison of the value of ultrasound-guided fine needle aspiration biopsy and contrast-enhanced ultrasound in different sizes of thyroid nodules","volume":"103","author":"Liu","year":"2024","journal-title":"Medicine"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2024.3405621","article-title":"Do as sonographers think: contrast-enhanced ultrasound for thyroid nodules diagnosis via microvascular infiltrative awareness","volume":"43","author":"Chen","year":"2024","journal-title":"IEEE Trans Med Imaging"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1002\/med.21846","article-title":"A review in radiomics: Making personalized medicine a reality via routine imaging","volume":"42","author":"Guiot","year":"2022","journal-title":"Med Res Rev"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.3748\/wjg.v28.i27.3398","article-title":"Artificial intelligence in liver ultrasound","volume":"28","author":"Cao","year":"2022","journal-title":"World J Gastroenterol"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2022.963612","article-title":"Ultrasound radiomics in personalized breast management: Current status and future prospects","volume":"12","author":"Gu","year":"2022","journal-title":"Front Oncol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"108992","DOI":"10.1016\/j.ejrad.2020.108992","article-title":"Differential diagnosis of benign and Malignant thyroid nodules using deep learning radiomics of thyroid ultrasound images","volume":"127","author":"Zhou","year":"2020","journal-title":"Eur J Radiol"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.21037\/qims-23-1597","article-title":"Deep-learning radiomics based on ultrasound can objectively evaluate thyroid nodules and assist in improving the diagnostic level of ultrasound physicians","volume":"14","author":"Du","year":"2024","journal-title":"Quantit Imaging Med Surg"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2021.738909","article-title":"Exploring the value of radiomics features based on B-mode and contrast-enhanced ultrasound in discriminating the nature of thyroid nodules","volume":"11","author":"Guo","year":"2021","journal-title":"Front Oncol"},{"key":"B18","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1186\/s40644-024-00661-3","article-title":"Dual-modal radiomics nomogram based on contrast-enhanced ultrasound to improve differential diagnostic accuracy and reduce unnecessary biopsy rate in ACR TI-RADS 4\u20135 thyroid nodules","volume":"24","author":"Ren","year":"2024","journal-title":"Cancer Imaging"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.3389\/fendo.2024.1299686","article-title":"Applying machine-learning models to differentiate benign and Malignant thyroid nodules classified as C-TIRADS 4 based on 2D-ultrasound combined with five contrast-enhanced ultrasound key frames","volume":"15","author":"Chen","year":"2024","journal-title":"Front Endocrinol"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1186\/s13104-019-4235-y","article-title":"Diagnostic accuracy of ultrasound characteristics in the identification of Malignant thyroid nodules","volume":"12","author":"Wettasinghe","year":"2019","journal-title":"BMC Res Notes"},{"key":"B21","doi-asserted-by":"publisher","first-page":"717","DOI":"10.3390\/cancers14030717","article-title":"Risk stratification of thyroid nodules: from ultrasound features to TIRADS","volume":"14","author":"Rago","year":"2022","journal-title":"Cancers"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.09091284","article-title":"Can vascularity at power doppler US help predict thyroid Malignancy","volume":"255","author":"Moon","year":"2010","journal-title":"Radiology"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.21037\/gs-21-752","article-title":"The value of color Doppler ultrasound in the diagnosis of thyroid nodules: a systematic review and meta-analysis","volume":"10","author":"Zhao","year":"2021","journal-title":"Gland Surge"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.7863\/jum.2007.26.6.837","article-title":"Quantitative analysis of tumor vascularity in benign and Malignant solid thyroid nodules","volume":"26","author":"Lyshchik","year":"2007","journal-title":"J Ultrasound Med"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.21037\/gs-22-262","article-title":"Parameters of dual-energy CT for the differential diagnosis of thyroid nodules and the indirect prediction of lymph node metastasis in thyroid carcinoma: a retrospective diagnostic study","volume":"11","author":"Li","year":"2022","journal-title":"Gland Surge"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2023.1029936","article-title":"Diagnostic value of superb microvascular imaging and color doppler for thyroid nodules: A meta-analysis","volume":"13","author":"Luo","year":"2023","journal-title":"Front Oncol"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2013.0150","article-title":"Diagnostic performances of various gray-Scale, color doppler, and contrast-enhanced ultrasonography findings in predicting Malignant thyroid nodules","volume":"24","author":"Ma","year":"2014","journal-title":"Thyroid"},{"key":"B28","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/01617346241291511","article-title":"Ring-enhancement on CEUS: is it useful in the differential diagnosis of solid thyroid nodules","volume":"47","author":"Li","year":"2025","journal-title":"Ultrasonic Imaging"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.3233\/CH-242173","article-title":"Contrast-enhanced ultrasound (CEUS) characteristics of atypical-enhanced papillary thyroid carcinoma (PTC)","volume":"88","author":"Wang","year":"2024","journal-title":"Clin Hemorheol Microcirc"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1002\/jum.14347","article-title":"Diagnostic efficiency of quantitative contrast-enhanced ultrasound indicators for discriminating benign from Malignant solid thyroid nodules","volume":"37","author":"Zhou","year":"2018","journal-title":"J Ultrasound Med"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.3233\/CH-221681","article-title":"VueBox\u00ae perfusion analysis of dynamic contrast enhanced ultrasound provides added value in the diagnosis of small thyroid nodules","volume":"83","author":"Huang","year":"2023","journal-title":"Clin Hemorheol Microcirc"}],"container-title":["Frontiers in Endocrinology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2025.1639017\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,19]],"date-time":"2025-08-19T04:10:40Z","timestamp":1755576640000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2025.1639017\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,19]]},"references-count":31,"alternative-id":["10.3389\/fendo.2025.1639017"],"URL":"https:\/\/doi.org\/10.3389\/fendo.2025.1639017","relation":{},"ISSN":["1664-2392"],"issn-type":[{"value":"1664-2392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,19]]},"article-number":"1639017"}}