{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T16:19:42Z","timestamp":1777652382867,"version":"3.51.4"},"reference-count":44,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T00:00:00Z","timestamp":1727222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Minitype Science and Technology Project of the National Health and Wellness Commission","award":["20011"],"award-info":[{"award-number":["20011"]}]},{"name":"Minitype Science and Technology Project of the National Health and Wellness Commission","award":["2023s07020001"],"award-info":[{"award-number":["2023s07020001"]}]},{"name":"Minitype Science and Technology Project of the National Health and Wellness Commission","award":["82371931"],"award-info":[{"award-number":["82371931"]}]},{"name":"Anhui Provincial Key Research and Development Project","award":["20011"],"award-info":[{"award-number":["20011"]}]},{"name":"Anhui Provincial Key Research and Development Project","award":["2023s07020001"],"award-info":[{"award-number":["2023s07020001"]}]},{"name":"Anhui Provincial Key Research and Development Project","award":["82371931"],"award-info":[{"award-number":["82371931"]}]},{"name":"National Natural Science Foundation of China","award":["20011"],"award-info":[{"award-number":["20011"]}]},{"name":"National Natural Science Foundation of China","award":["2023s07020001"],"award-info":[{"award-number":["2023s07020001"]}]},{"name":"National Natural Science Foundation of China","award":["82371931"],"award-info":[{"award-number":["82371931"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This study included 468 patients and aimed to use multimodal ultrasound radiomic technology to predict the malignancy of TI-RADS 4-5 thyroid nodules. First, radiomic features are extracted from conventional two-dimensional ultrasound (transverse ultrasound and longitudinal ultrasound), strain elastography (SE), and shear-wave-imaging (SWE) images. Next, the least absolute shrinkage and selection operator (LASSO) is used to screen out features related to malignant tumors. Finally, a support vector machine (SVM) is used to predict the malignancy of thyroid nodules. The Shapley additive explanation (SHAP) method was used to intuitively analyze the specific contributions of radiomic features to the model\u2019s prediction. Our proposed model has AUCs of 0.971 and 0.856 in the training and testing sets, respectively. Our proposed model has a higher prediction accuracy compared to those of models with other modal combinations. In the external validation set, the AUC of the model is 0.779, which proves that the model has good generalization ability. Moreover, SHAP analysis was used to examine the overall impacts of various radiomic features on model predictions and local explanations for individual patient evaluations. Our proposed multimodal ultrasound radiomic model can effectively integrate different data collected using multiple ultrasound sensors and has good diagnostic performance for TI-RADS 4-5 thyroid nodules.<\/jats:p>","DOI":"10.3390\/s24196203","type":"journal-article","created":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T17:12:04Z","timestamp":1727284324000},"page":"6203","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Multimodal Ultrasound Radiomic Technology for Diagnosing Benign and Malignant Thyroid Nodules of Ti-Rads 4-5: A Multicenter Study"],"prefix":"10.3390","volume":"24","author":[{"given":"Luyao","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chengjie","family":"Wang","sequence":"additional","affiliation":[{"name":"Anhui Medical University, Hefei 230032, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuefei","family":"Deng","sequence":"additional","affiliation":[{"name":"School of Basic Medical Sciences, Anhui Medical University, Hefei 230032, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2785-974X","authenticated-orcid":false,"given":"Wang","family":"Zhou","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yilv","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuan","family":"Chu","sequence":"additional","affiliation":[{"name":"Hefei Cancer Hospital, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4077-0272","authenticated-orcid":false,"given":"Tengfei","family":"Wang","sequence":"additional","affiliation":[{"name":"Hefei Cancer Hospital, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Anhui Province Key Laboratory of Medical Physics and Technology, Institute of Health and Medical Technology, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hai","family":"Li","sequence":"additional","affiliation":[{"name":"Hefei Cancer Hospital, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Anhui Province Key Laboratory of Medical Physics and Technology, Institute of Health and Medical Technology, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongchao","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"209","DOI":"10.3322\/caac.21660","article-title":"Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries","volume":"71","author":"Sung","year":"2021","journal-title":"CA A Cancer J. Clin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"614","DOI":"10.1056\/NEJMp1604412","article-title":"Worldwide Thyroid-Cancer Epidemic? The Increasing Impact of Overdiagnosis","volume":"375","author":"Vaccarella","year":"2016","journal-title":"N. Engl. J. Med."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1531","DOI":"10.1016\/S0140-6736(23)00020-X","article-title":"Thyroid cancer","volume":"401","author":"Chen","year":"2023","journal-title":"Lancet"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.asjsur.2023.10.039","article-title":"Tracheal injury following robotic thyroidectomy: A literature review of epidemiology, etiology, diagnosis, and treatment and 3 case reports","volume":"47","author":"Ma","year":"2024","journal-title":"Asian J. Surg."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Haddou, N., Idrissi, N., and Ben Jebara, S. (2023). Analysis of Voice Quality after Thyroid Surgery. J. Voice Off. J. Voice Found.","DOI":"10.1016\/j.jvoice.2023.06.027"},{"key":"ref_6","first-page":"e52232","article-title":"Approach to Thyroid Nodules: Diagnosis and Treatment","volume":"16","author":"AlSaedi","year":"2024","journal-title":"Cureus"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Monpeyssen, H., Alamri, A., and Ben Hamou, A. (2021). Long-Term Results of Ultrasound-Guided Radiofrequency Ablation of Benign Thyroid Nodules: State of the Art and Future Perspectives\u2014A Systematic Review. Front. Endocrinol., 12.","DOI":"10.3389\/fendo.2021.622996"},{"key":"ref_8","first-page":"622","article-title":"American association of clinical endocrinologists, american college of endocrinology, and associazione medici endocrinologi medical guidelines for clinical practice for the diagnosis and management of thyroid nodules\u20142016 update","volume":"22","author":"Gharib","year":"2016","journal-title":"Endocr. Pract. Off. J. Am. Coll. Endocrinol. Am. Assoc. Clin. Endocrinol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1002\/cncy.22254","article-title":"Does a higher American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) score forecast an increased risk of malignancy? A correlation study of ACR TI-RADS with FNA cytology in the evaluation of thyroid nodules","volume":"128","author":"Modi","year":"2020","journal-title":"Cancer Cytopathol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2120","DOI":"10.1007\/s00330-021-08298-7","article-title":"An integrated AI model to improve diagnostic accuracy of ultrasound and output known risk features in suspicious thyroid nodules","volume":"32","author":"Wang","year":"2022","journal-title":"Eur. Radiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1148\/radiol.2018172572","article-title":"Reduction in Thyroid Nodule Biopsies and Improved Accuracy with American College of Radiology Thyroid Imaging Reporting and Data System","volume":"287","author":"Hoang","year":"2018","journal-title":"Radiology"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"109390","DOI":"10.1016\/j.ejrad.2020.109390","article-title":"Comparison of diagnostic accuracy of ACR-TIRADS, American Thyroid Association (ATA), and EU-TIRADS guidelines in detecting thyroid malignancy","volume":"133","author":"Koc","year":"2020","journal-title":"Eur. J. Radiol."},{"key":"ref_13","first-page":"861","article-title":"Real-time ultrasound elastography in the differential diagnosis of benign and malignant thyroid nodules","volume":"28","author":"Hong","year":"2009","journal-title":"J. Ultrasound Med. Off. J. Am. Inst. Ultrasound Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1126","DOI":"10.1016\/j.ultrasmedbio.2015.03.009","article-title":"WFUMB guidelines and recommendations for clinical use of ultrasound elastography: Part 1: Basic principles and terminology","volume":"41","author":"Shiina","year":"2015","journal-title":"Ultrasound Med. Biol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"680","DOI":"10.1007\/s00261-014-0305-8","article-title":"Elastography: History, principles, and technique comparison","volume":"40","author":"Garra","year":"2015","journal-title":"Abdom. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1383","DOI":"10.1016\/j.acra.2020.12.013","article-title":"Shear Wave Elastography Evaluation of Meniscus Degeneration with Magnetic Resonance Imaging Correlation","volume":"28","author":"Gurun","year":"2021","journal-title":"Acad. Radiol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e278","DOI":"10.1016\/j.acra.2020.08.011","article-title":"Diagnosis of Carpal Tunnel Syndrome using Shear Wave Elastography and High-frequency Ultrasound Imaging","volume":"28","author":"Nam","year":"2021","journal-title":"Acad. Radiol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1177\/0284185117692167","article-title":"Preoperative prediction of papillary thyroid microcarcinoma via multiparameter ultrasound","volume":"58","author":"Ma","year":"2017","journal-title":"Acta Radiol."},{"key":"ref_19","first-page":"1311","article-title":"Diagnostic value of two-dimensional shear wave elastography in papillary thyroid microcarcinoma","volume":"9","author":"Duan","year":"2016","journal-title":"OncoTargets Ther."},{"key":"ref_20","first-page":"257","article-title":"Combined value of Virtual Touch tissue quantification and conventional sonographic features for differentiating benign and malignant thyroid nodules smaller than 10 mm","volume":"33","author":"Zhang","year":"2014","journal-title":"J. Ultrasound Med. Off. J. Am. Inst. Ultrasound Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.ejrad.2018.10.024","article-title":"Combination of ultrasound elastography with TI-RADS in the diagnosis of small thyroid nodules (\u226410 mm): A new method to increase the diagnostic performance","volume":"109","author":"Du","year":"2018","journal-title":"Eur. J. Radiol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.ejca.2011.11.036","article-title":"Radiomics: Extracting more information from medical images using advanced feature analysis","volume":"48","author":"Lambin","year":"2012","journal-title":"Eur. J. Cancer"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1007\/s00066-020-01663-3","article-title":"Radiomics in radiation oncology-basics, methods, and limitations","volume":"196","author":"Lohmann","year":"2020","journal-title":"Strahlenther. Onkol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1016\/j.mri.2012.06.010","article-title":"Radiomics: The process and the challenges","volume":"30","author":"Kumar","year":"2012","journal-title":"Magn. Reson. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gao, X., Ran, X., and Ding, W. (2023). The progress of radiomics in thyroid nodules. Front. Oncol., 13.","DOI":"10.3389\/fonc.2023.1109319"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/s11154-023-09822-4","article-title":"Application of radiomics and machine learning to thyroid diseases in nuclear medicine: A systematic review","volume":"25","author":"Dondi","year":"2024","journal-title":"Rev. Endocr. Metab. Disord."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Xia, M., Song, F., Zhao, Y., Xie, Y., Wen, Y., and Zhou, P. (2023). Ultrasonography-based radiomics and computer-aided diagnosis in thyroid nodule management: Performance comparison and clinical strategy optimization. Front. Endocrinol., 14.","DOI":"10.3389\/fendo.2023.1140816"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chen, J.H., Zhang, Y.Q., Zhu, T.T., Zhang, Q., Zhao, A.X., and Huang, Y. (2024). Applying machine-learning models to differentiate benign and malignant thyroid nodules classified as C-TIRADS 4 based on 2D-ultrasound combined with five contrast-enhanced ultrasound key frames. Front. Endocrinol., 15.","DOI":"10.3389\/fendo.2024.1299686"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1002\/jcu.23625","article-title":"Study on diagnosing thyroid nodules of ACR TI-RADS 4-5 with multimodal ultrasound radiomics technology","volume":"52","author":"Wang","year":"2024","journal-title":"J. Clin. Ultrasound JCU"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2156","DOI":"10.1016\/j.acra.2023.02.001","article-title":"Predicting Malignancy of Thyroid Micronodules: Radiomics Analysis Based on Two Types of Ultrasound Elastography Images","volume":"30","author":"Zhang","year":"2023","journal-title":"Acad. Radiol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"e104","DOI":"10.1158\/0008-5472.CAN-17-0339","article-title":"Computational Radiomics System to Decode the Radiographic Phenotype","volume":"77","author":"Fedorov","year":"2017","journal-title":"Cancer Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/5254.708428","article-title":"Support vector machines","volume":"13","author":"Hearst","year":"1998","journal-title":"IEEE Intell. Syst. Their Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","article-title":"The meaning and use of the area under a receiver operating characteristic (ROC) curve","volume":"143","author":"Hanley","year":"1982","journal-title":"Radiology"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"8761","DOI":"10.1021\/acs.jmedchem.9b01101","article-title":"Interpretation of Compound Activity Predictions from Complex Machine Learning Models Using Local Approximations and Shapley Values","volume":"63","author":"Bajorath","year":"2020","journal-title":"J. Med. Chem."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Roth, A.E. (1988). The Shapley Value (Essays in Honor of Lloyd S. Shapley)||A Value for n-Person Games, Cambridge University Press.","DOI":"10.1017\/CBO9780511528446"},{"key":"ref_37","unstructured":"Lundberg, S.M., and Lee, S.-I. (2017). A unified approach to interpreting model predictions. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhou, J., Lu, J., Gao, C., Zeng, J., Zhou, C., Lai, X., Cai, W., and Xu, M. (2020). Predicting the response to neoadjuvant chemotherapy for breast cancer: Wavelet transforming radiomics in MRI. BMC Cancer, 20.","DOI":"10.1186\/s12885-020-6523-2"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chaddad, A., Daniel, P., and Niazi, T. (2018). Radiomics Evaluation of Histological Heterogeneity Using Multiscale Textures Derived from 3D Wavelet Transformation of Multispectral Images. Front. Oncol., 8.","DOI":"10.3389\/fonc.2018.00096"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1002\/jcu.23352","article-title":"Multimodal ultrasound imaging: A method to improve the accuracy of diagnosing thyroid TI-RADS 4 nodules","volume":"50","author":"Han","year":"2022","journal-title":"J. Clin. Ultrasound JCU"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1089\/thy.2015.0020","article-title":"2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer","volume":"26","author":"Haugen","year":"2016","journal-title":"Thyroid Off. J. Am. Thyroid Assoc."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1148\/radiol.2373050220","article-title":"Management of thyroid nodules detected at US: Society of Radiologists in Ultrasound consensus conference statement","volume":"237","author":"Frates","year":"2005","journal-title":"Radiology"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1530\/EJE-12-0936","article-title":"Prospective evaluation of thyroid imaging reporting and data system on 4550 nodules with and without elastography","volume":"168","author":"Russ","year":"2013","journal-title":"Eur. J. Endocrinol."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Zhang, J., Jin, J., Ai, Y., Zhu, K., Xiao, C., Xie, C., and Jin, X. (2020). Computer Tomography Radiomics-Based Nomogram in the Survival Prediction for Brain Metastases from Non-Small Cell Lung Cancer Underwent Whole Brain Radiotherapy. Front. Oncol., 10.","DOI":"10.3389\/fonc.2020.610691"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/19\/6203\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:02:40Z","timestamp":1760112160000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/19\/6203"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,25]]},"references-count":44,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["s24196203"],"URL":"https:\/\/doi.org\/10.3390\/s24196203","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,25]]}}}