{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,12]],"date-time":"2026-11-12T14:25:34Z","timestamp":1794493534272,"version":"4.9.1"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,11,6]],"date-time":"2024-11-06T00:00:00Z","timestamp":1730851200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Endocrinol."],"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>The accurate diagnosis of thyroid nodules with indeterminate cytology, particularly in the atypia of undetermined significance (AUS) category, remains challenging. This study aims to predict the risk of malignancy in AUS nodules by comparing two machine learning (ML) and three conventional logistic regression (LR) models.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>A retrospective study on 356 AUS nodules in 342 individuals from 6728 patients who underwent thyroid surgery in 2021. All the clinical, ultrasonographic, and molecular data were collected and randomly separated into training and validation cohorts at a ratio of 7: 3. ML (random forest and XGBoost) and LR (lasso regression, best subset selection, and backward stepwise regression) models were constructed and evaluated using area under the curve (AUC), calibration, and clinical utility metrics.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Approximately 90% (321\/356) of the AUS nodules were malignant, predominantly papillary thyroid carcinoma with 68.6% BRAF V600E mutations. The final LR prediction model based on backward stepwise regression exhibited superior discrimination with AUC values of 0.83 (95% CI: 0.73-0.92) and 0.80 (95% CI: 0.67-0.94) in training and validation, respectively. Well calibration, and clinical utility were also confirmed. The ML models showed moderate performance. A nomogram was developed on the final LR model.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The LR model developed using the backward stepwise regression, outperformed ML models in predicting malignancy in AUS thyroid nodules. The corresponding nomogram based on this model provides a valuable and practical tool for personalized risk assessment, potentially reducing unnecessary surgeries and enhancing clinical decision-making.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fendo.2024.1366687","type":"journal-article","created":{"date-parts":[[2024,11,6]],"date-time":"2024-11-06T04:33:20Z","timestamp":1730867600000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Optimizing thyroid AUS nodules malignancy prediction: a comprehensive study of logistic regression and machine learning models"],"prefix":"10.3389","volume":"15","author":[{"given":"Yuan","family":"Cao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yixian","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunchao","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mengqi","family":"Luan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lu","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weiwei","family":"Zhan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,11,6]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2023.0141","article-title":"The 2023 bethesda system for reporting thyroid cytopathology","volume":"33","author":"Ali","year":"2023","journal-title":"Thyroid"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1002\/cncy.v129.8","article-title":"(AUS\/FLUS): A study of thyroid FNA cytology based on ThinPrep slides from the National Cancer Center in China","volume":"129","author":"Zhao","year":"2021","journal-title":"Cancer Cytopathol"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2014.10.004","article-title":"Evidence for overestimation of the prevalence of Malignancy in indeterminate thyroid nodules classified as Bethesda category III","volume":"157","author":"Iskandar","year":"2015","journal-title":"Surgery"},{"key":"B4","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1002\/dc.21754","article-title":"The Bethesda system for reporting thyroid cytopathology: An experience of 1,382 cases in a community practice setting with the implication for risk of neoplasm and risk of Malignancy","volume":"40","author":"Wu","year":"2012","journal-title":"Diagn Cytopathol"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.3389\/fendo.2021.686849","article-title":"Surgical outcome and\u00a0Malignant risk factors in patients with thyroid nodule classified as bethesda category III","volume":"12","author":"Huang","year":"2021","journal-title":"Front Endocrinol (Lausanne)"},{"key":"B6","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1507\/endocrj.EJ21-0300","article-title":"Approach to Bethesda system category III thyroid nodules according to US-risk stratification","volume":"69","author":"Kim","year":"2022","journal-title":"Endocr J"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.32074\/1591-951X-887","article-title":"Molecular testing in indeterminate thyroid nodules: an additional tool for clinical decision-making","volume":"115","author":"Fumagalli","year":"2023","journal-title":"Pathologica"},{"key":"B8","doi-asserted-by":"publisher","first-page":"3008","DOI":"10.3390\/diagnostics13183008","article-title":"Indeterminate thyroid nodules: from cytology to molecular testing","volume":"13","author":"Vignali","year":"2023","journal-title":"Diagnostics (Basel)"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1159\/000333274","article-title":"BRAF mutation testing of thyroid fine-needle aspiration specimens enhances the predictability of Malignancy in thyroid follicular lesions of undetermined significance","volume":"55","author":"Adeniran","year":"2011","journal-title":"Acta Cytol"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1007\/s12020-020-02300-w","article-title":"Strategy to reduce unnecessary surgeries in thyroid nodules with cytology of Bethesda category III (AUS\/FLUS): a retrospective analysis of 667 patients diagnosed by surgery","volume":"69","author":"Suh","year":"2020","journal-title":"Endocrine"},{"key":"B11","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1007\/s12022-019-09596-z","article-title":"Testing for BRAF (V600E) mutation in thyroid nodules with fine-needle aspiration (FNA) read as suspicious for Malignancy (Bethesda V, thy4, TIR4): a systematic review and meta-analysis","volume":"31","author":"Trimboli","year":"2020","journal-title":"Endocr Pathol"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.21037\/gs-20-430","article-title":"Prevalence of BRAF(V600E) mutation in Asian series of papillary thyroid carcinoma-a contemporary systematic review","volume":"9","author":"Rashid","year":"2020","journal-title":"Gland Surg"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1002\/cam4.v11.1","article-title":"BRAF(V600E) mutation test on fine-needle aspiration specimens of thyroid nodules: Clinical correlations for 4600 patients","volume":"11","author":"Chen","year":"2022","journal-title":"Cancer Med"},{"key":"B14","doi-asserted-by":"publisher","first-page":"e221157","DOI":"10.1148\/radiol.221157","article-title":"Generalizability and diagnostic performance of AI models for thyroid US","volume":"307","author":"Xu","year":"2023","journal-title":"Radiology"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2016.0372","article-title":"A computer-aided diagnosis system using artificial intelligence for the diagnosis and characterization of thyroid nodules on ultrasound: initial clinical assessment","volume":"27","author":"Choi","year":"2017","journal-title":"Thyroid"},{"key":"B16","doi-asserted-by":"publisher","first-page":"3357","DOI":"10.3390\/cancers14143357","article-title":"Artificial intelligence for thyroid nodule characterization: where are we standing","volume":"14","author":"Sorrenti","year":"2022","journal-title":"Cancers (Basel)"},{"key":"B17","doi-asserted-by":"publisher","first-page":"e0242806","DOI":"10.1371\/journal.pone.0242806","article-title":"Artificial intelligence to predict the BRAFV600E mutation in patients with thyroid cancer","volume":"15","author":"Yoon","year":"2020","journal-title":"PloS One"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaa8415","article-title":"Machine learning: Trends, perspectives, and prospects","volume":"349","author":"Jordan","year":"2015","journal-title":"Science"},{"key":"B19","doi-asserted-by":"publisher","first-page":"g7594","DOI":"10.1161\/CIRCULATIONAHA.114.014508","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD):\u00a0the\u00a0TRIPOD statement","volume":"350","author":"Collins","year":"2015","journal-title":"Bmj"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.231481","article-title":"International expert consensus on US lexicon for thyroid nodules","volume":"309","author":"Durante","year":"2023","journal-title":"Radiology"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1007\/s12020-020-02441-y","article-title":"2020 Chinese guidelines for ultrasound Malignancy risk stratification of thyroid nodules: the C-TIRADS","volume":"70","author":"Zhou","year":"2020","journal-title":"Endocrine"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.4158\/EP161208.GL","article-title":"American association of clinical endocrinologists, american college of endocrinology, and associazione medici endocrinologi medical guidelines for clinical practice for the diagnosis and management of thyroid nodules - 2016 update appendix","volume":"22","author":"Gharib","year":"2016","journal-title":"Endocr Pract"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2017.0500","article-title":"The 2017 bethesda system for reporting thyroid cytopathology","volume":"27","author":"Cibas","year":"2017","journal-title":"Thyroid"},{"key":"B24","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1016\/j.eururo.2018.08.038","article-title":"Reporting and interpreting decision curve analysis: A guide for investigators","volume":"74","author":"Van Calster","year":"2018","journal-title":"Eur Urol"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1053\/j.seminoncol.2009.12.003","article-title":"What is a real nomogram","volume":"37","author":"Kattan","year":"2010","journal-title":"Semin Oncol"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2013.12.035","article-title":"A nomogram for predicting Malignancy in thyroid nodules diagnosed as atypia of undetermined significance\/follicular lesions of undetermined significance on fine needle aspiration","volume":"155","author":"Yoon","year":"2014","journal-title":"Surgery"},{"key":"B27","doi-asserted-by":"publisher","first-page":"8296","DOI":"10.3390\/ijms24098296","article-title":"Ultrasound parameters can accurately predict the risk of Malignancy in patients with \u201cIndeterminate TIR3b\u201d Cytology nodules: A prospective study","volume":"24","author":"Guarnotta","year":"2023","journal-title":"Int J Mol Sci"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejso.2013.11.015","article-title":"Ultrasonographic features associated with Malignancy in cytologically indeterminate thyroid nodules","volume":"40","author":"Batawil","year":"2014","journal-title":"Eur J Surg Oncol"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.3389\/fendo.2022.806028","article-title":"Predictors of Malignancy in thyroid nodules classified as bethesda category III","volume":"13","author":"Liu","year":"2022","journal-title":"Front Endocrinol (Lausanne)"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1002\/cam4.v10.8","article-title":"The gray zone of thyroid nodules: Using a nomogram to provide Malignancy risk assessment and guide patient management","volume":"10","author":"Yousefi","year":"2021","journal-title":"Cancer Med"},{"key":"B31","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.jclinepi.2019.02.004","article-title":"A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models","volume":"110","author":"Christodoulou","year":"2019","journal-title":"J Clin Epidemiol"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1007\/s00167-019-05822-7","article-title":"Machine learning methods are comparable to logistic regression techniques in predicting severe walking limitation following total knee arthroplasty","volume":"28","author":"Pua","year":"2020","journal-title":"Knee Surg Sports Traumatol Arthrosc"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0201904","article-title":"On the overestimation of random forest\u2019s out-of-bag error","volume":"13","author":"Janitza","year":"2018","journal-title":"PloS One"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1111\/cen.14824","article-title":"Nomogram to differentiate benign and Malignant thyroid nodules in the American College of Radiology Thyroid Imaging Reporting and Data System level 5","volume":"98","author":"Hu","year":"2023","journal-title":"Clin Endocrinol (Oxf)"},{"key":"B35","doi-asserted-by":"publisher","first-page":"791","DOI":"10.1210\/js.2018-00427","article-title":"The impact of hashimoto thyroiditis on thyroid nodule cytology and risk of thyroid cancer","volume":"3","author":"Silva de Morais","year":"2019","journal-title":"J Endocr Soc"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1007\/s11154-018-9474-z","article-title":"The increasing prevalence of chronic lymphocytic thyroiditis in papillary microcarcinoma","volume":"19","author":"Vita","year":"2018","journal-title":"Rev Endocr Metab Disord"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1971","DOI":"10.3390\/cancers14081971","article-title":"Hashimoto\u2019s thyroiditis does not influence the Malignancy risk in nodules of category III in the bethesda system","volume":"14","author":"S\u0142owi\u0144ska-Klencka","year":"2022","journal-title":"Cancers (Basel)"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1007\/s11154-023-09842-0","article-title":"Molecular testing for thyroid nodules: Where are we now","volume":"25","author":"Ferraz","year":"2023","journal-title":"Rev Endocr Metab Disord"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejso.2016.11.003","article-title":"BRAF(V600E) mutation as a predictor of thyroid Malignancy in indeterminate nodules: A systematic review and meta-analysis","volume":"43","author":"Jinih","year":"2017","journal-title":"Eur J Surg Oncol"},{"key":"B40","doi-asserted-by":"publisher","first-page":"4287","DOI":"10.3390\/cancers15174287","article-title":"Effective use of microRNA, BRAF and sonographic risk assessment in bethesda III thyroid nodules requires a different approach to nodules with features of nuclear atypia and other types of atypia","volume":"15","author":"S\u0142owi\u0144ska-Klencka","year":"2023","journal-title":"Cancers (Basel)"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1002\/cam4.v8.12","article-title":"BRAF(V600E) mutation analysis in fine-needle aspiration cytology specimens for diagnosis of thyroid nodules: The influence of false-positive and false-negative results","volume":"8","author":"Zhao","year":"2019","journal-title":"Cancer Med"},{"key":"B42","doi-asserted-by":"publisher","first-page":"108114","DOI":"10.1016\/j.isci.2023.108114","article-title":"AI diagnosis of Bethesda category IV thyroid nodules","volume":"26","author":"Yao","year":"2023","journal-title":"iScience"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(21)00041-8","article-title":"Deep learning-based artificial intelligence model to assist thyroid nodule diagnosis and management: a multicentre diagnostic study","volume":"3","author":"Peng","year":"2021","journal-title":"Lancet Digit Health"},{"key":"B44","doi-asserted-by":"publisher","first-page":"2200100","DOI":"10.1002\/aisy.202200100","article-title":"DeepThy-net: A multimodal deep learning method for predicting cervical lymph node metastasis in papillary thyroid cancer","volume":"4","author":"Yao","year":"2022","journal-title":"Advanced Intelligent Systems"}],"container-title":["Frontiers in Endocrinology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2024.1366687\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,6]],"date-time":"2024-11-06T04:33:24Z","timestamp":1730867604000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2024.1366687\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,6]]},"references-count":44,"alternative-id":["10.3389\/fendo.2024.1366687"],"URL":"https:\/\/doi.org\/10.3389\/fendo.2024.1366687","relation":{},"ISSN":["1664-2392"],"issn-type":[{"value":"1664-2392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,6]]},"article-number":"1366687"}}