{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T01:11:16Z","timestamp":1785546676313,"version":"3.56.0"},"reference-count":42,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005866","name":"Far Eastern Memorial Hospital","doi-asserted-by":"crossref","award":["FEMH 112-2314-B-418-004"],"award-info":[{"award-number":["FEMH 112-2314-B-418-004"]}],"id":[{"id":"10.13039\/501100005866","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100005866","name":"Far Eastern Memorial Hospital","doi-asserted-by":"crossref","award":["FEMH-2025-C-071"],"award-info":[{"award-number":["FEMH-2025-C-071"]}],"id":[{"id":"10.13039\/501100005866","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100005866","name":"Far Eastern Memorial Hospital","doi-asserted-by":"crossref","award":["PI20190002"],"award-info":[{"award-number":["PI20190002"]}],"id":[{"id":"10.13039\/501100005866","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: Thyroid nodules are a prevalent condition with a high incidence rate of malignancy. Ultrasound (US)-based risk stratification systems have become widely utilized for the evaluation of thyroid nodules, including the American Thyroid Association (ATA) guidelines, the American College of Radiology Thyroid Imaging Reporting and Data System (ACR-TIRADS), the Korean Society of Thyroid Radiology system (K-TIRADS), and the European Thyroid Association system (EU-TIRADS). Our institution has developed a real-time computerized score for evaluating thyroid nodules. This study aims to systematically compare the diagnostic performance of these systems when applied in real time by otolaryngologists, who integrate dynamic US imaging with physical examination. Methods: Patients with thyroid nodules who underwent US evaluation, US-guided fine-needle aspiration cytology (FNAC), and subsequent thyroidectomy were included. During each examination, otolaryngologists performed real-time risk categorization according to five US-based systems, with immediate scoring based on dynamic sonographic findings. Results: From April 2021 to November 2023, 130 patients were enrolled. For categories 4 and 5, the ATA guidelines had a sensitivity of 96.6% (95% CI: 87.3\u2013100%), specificity of 78.9%, (60.6\u201397.3%) PPV of 84.6% (70.7\u201398.5%), NPV of 93.7% (81.9\u2013100%), and accuracy of 88.1% (78.3\u201397.9%). The sensitivity of the ACR-TIRADS was 95.6% (87.3\u2013100%), the specificity was 78.9% (60.6\u201397.3%), the PPV was 84.6% (70.7\u201398.5%), the NPV was 93.7% (81.9\u2013100%), and the accuracy was 88.1% (78.3\u201397.9%). Both the K-TIRADS and the EU-TIRADS had sensitivities of 95.6% (87.3\u2013100%), specificities of 78.9% (60.6\u201397.3%), PPVs of 84.6% (70.7\u201398.5%), NPVs of 93.7% (81.9\u2013100%), and accuracies of 88.1% (78.3\u201397.9%). The computerized score (&gt;3.3 considered malignant) and TBSRTC (Category 5 or 6) both had sensitivities of 73.9% (56.0\u201391.9%), specificities of 100%, PPVs of 100%, NPVs of 76.0% (59.3\u201392.7%), and accuracies of 85.7% (75.1\u201396.3%). Conclusions: Otolaryngologists can achieve highly accurate diagnostic performance when applying standardized ultrasound-based risk stratification systems, and a real-time computerized scoring system provides highly specific supplemental value for immediate clinical decision-making.<\/jats:p>","DOI":"10.3390\/diagnostics16010128","type":"journal-article","created":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T09:18:56Z","timestamp":1767345536000},"page":"128","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Comparative Diagnostic Performance of Ultrasound-Based Risk Stratification Systems in Thyroid Nodule Evaluations by Otolaryngologists"],"prefix":"10.3390","volume":"16","author":[{"given":"Jiun-Yi","family":"Wu","sequence":"first","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2772-0983","authenticated-orcid":false,"given":"Ping-Chia","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming-Hsun","family":"Wen","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chih-Ming","family":"Chang","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"},{"name":"Department of Biomedical Engineering, National Yang-Ming University, Taipei 112, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3393-9001","authenticated-orcid":false,"given":"Wu-Chia","family":"Lo","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Po-Wen","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Po-Hsuan","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0837-1597","authenticated-orcid":false,"given":"Li-Jen","family":"Liao","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"},{"name":"Head and Neck Cancer Surveillance and Research Study Group, Far Eastern Memorial Hospital, New Taipei City 220, Taiwan"},{"name":"Department of Electrical Engineering, Yuan Ze University, Taoyuan 320, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1111\/j.1365-2362.2009.02162.x","article-title":"Very High Prevalence of Thyroid Nodules Detected by High Frequency (13 MHz) Ultrasound Examination","volume":"39","author":"Guth","year":"2009","journal-title":"Eur. J. Clin. Investig."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2164","DOI":"10.1001\/jama.295.18.2164","article-title":"Increasing Incidence of Thyroid Cancer in the United States, 1973\u20132002","volume":"295","author":"Davies","year":"2006","journal-title":"JAMA"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1148\/radiol.2473070944","article-title":"Benign and Malignant Thyroid Nodules: Us Differentiation\u2014Multicenter Retrospective Study","volume":"247","author":"Moon","year":"2008","journal-title":"Radiology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1765","DOI":"10.1056\/NEJMp1409841","article-title":"Korea\u2019s Thyroid-Cancer \u201cEpidemic\u201d\u2014Screening and Overdiagnosis","volume":"371","author":"Ahn","year":"2014","journal-title":"N. Engl. J. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1016\/S2213-8587(20)30115-7","article-title":"Global Trends in Thyroid Cancer Incidence and the Impact of Overdiagnosis","volume":"8","author":"Li","year":"2020","journal-title":"Lancet Diabetes Endocrinol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1089\/thy.2015.0020","article-title":"2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer","volume":"26","author":"Haugen","year":"2016","journal-title":"Thyroid"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.jacr.2017.01.046","article-title":"Acr Thyroid Imaging, Reporting and Data System (Ti-Rads): White Paper of the Acr Ti-Rads Committee","volume":"14","author":"Tessler","year":"2017","journal-title":"J. Am. Coll. Radiol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"370","DOI":"10.3348\/kjr.2016.17.3.370","article-title":"Ultrasonography Diagnosis and Imaging-Based Management of Thyroid Nodules: Revised Korean Society of Thyroid Radiology Consensus Statement and Recommendations","volume":"17","author":"Shin","year":"2016","journal-title":"Korean J. Radiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1159\/000478927","article-title":"European Thyroid Association Guidelines for Ultrasound Malignancy Risk Stratification of Thyroid Nodules in Adults: The Eu-Tirads","volume":"6","author":"Russ","year":"2017","journal-title":"Eur. Thyroid J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e3288","DOI":"10.1210\/clinem\/dgac279","article-title":"Clinician Agreement on the Classification of Thyroid Nodules Ultrasound Features: A Survey of 2 Endocrine Societies","volume":"107","author":"Burgos","year":"2022","journal-title":"J. Clin. Endocrinol. Metab."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1007\/s12020-024-03731-5","article-title":"Interobserver Variability in Thyroid Ultrasound","volume":"85","author":"Garcia","year":"2024","journal-title":"Endocrine"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Alfuraih, A.M., Alotaibi, A.M., Alshammari, A.K., Alrashied, B.F., Mashhor, Y.M., Mahmoud, M., and Alsaadi, M.J. (2024). Evaluating Diagnostic Accuracy and Agreement of Ti-Rads Scoring in Thyroid Nodules: A Comparative Analysis between Sonographers and Radiologists. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0312121"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1089\/thy.2014.0353","article-title":"Thyroid Ultrasound Features and Risk of Carcinoma: A Systematic Review and Meta-Analysis of Observational Studies","volume":"25","author":"Remonti","year":"2015","journal-title":"Thyroid"},{"key":"ref_14","unstructured":"Liao, L.J., and Far Eastern Memorial Hospital (2011). An Easy Sonographic Scoring System for Predicting Malignant Thyroid Nodules, unpublished institutional study."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3676","DOI":"10.21037\/qims-23-1650","article-title":"Diagnostic Performance of Artificial Intelligence in Interpreting Thyroid Nodules on Ultrasound Images: A Multicenter Retrospective Study","volume":"14","author":"Namsena","year":"2024","journal-title":"Quant. Imaging Med. Surg."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e1201","DOI":"10.1002\/lio2.1201","article-title":"Head and Neck Ultrasound Training Improves the Diagnostic Performance of Otolaryngology Residents","volume":"9","author":"Warm","year":"2024","journal-title":"Laryngoscope Investig. Otolaryngol."},{"key":"ref_17","first-page":"510","article-title":"Clinical Evaluation of an Artificial Intelligence-Based Decision Support System for the Diagnosis and American College of Radiology Thyroid Imaging Reporting and Data System Classification of Thyroid Nodules","volume":"34","author":"Delgado","year":"2024","journal-title":"Thyroid"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3221","DOI":"10.1007\/s00405-025-09236-9","article-title":"Human-Ai Collaboration for Ultrasound Diagnosis of Thyroid Nodules: A Clinical Trial","volume":"282","author":"Makouei","year":"2025","journal-title":"Eur. Arch. Otorhinolaryngol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"26","DOI":"10.4103\/JMU.JMU_46_18","article-title":"Comparison of Strain Elastography, Shear Wave Elastography, and Conventional Ultrasound in Diagnosing Thyroid Nodules","volume":"27","author":"Liao","year":"2019","journal-title":"J. Med. Ultrasound"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"791","DOI":"10.2214\/AJR.22.28556","article-title":"Diagnostic Performance of Six Ultrasound Risk Stratification Systems for Thyroid Nodules: A Systematic Review and Network Meta-Analysis","volume":"220","author":"Kim","year":"2023","journal-title":"AJR Am. J. Roentgenol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1089\/thy.2009.0274","article-title":"The Bethesda System for Reporting Thyroid Cytopathology","volume":"19","author":"Cibas","year":"2009","journal-title":"Thyroid"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e220039","DOI":"10.1530\/ETJ-22-0039","article-title":"Diagnostic Accuracy of Ultrasonographic Features in Detecting Thyroid Cancer in the Transition Age: A Meta-Analysis","volume":"11","author":"Cozzolino","year":"2022","journal-title":"Eur. Thyroid J."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kim, J.S., Kim, B.G., Stybayeva, G., and Hwang, S.H. (2023). Diagnostic Performance of Various Ultrasound Risk Stratification Systems for Benign and Malignant Thyroid Nodules: A Meta-Analysis. Cancers, 15.","DOI":"10.3390\/cancers15020424"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1067\/j.cpradiol.2024.07.006","article-title":"Simplifying Risk Stratification for Thyroid Nodules on Ultrasound: Validation and Performance of an Artificial Intelligence Thyroid Imaging Reporting and Data System","volume":"53","author":"Yang","year":"2024","journal-title":"Curr. Probl. Diagn. Radiol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e230242","DOI":"10.1530\/ETJ-23-0242","article-title":"Head-to-Head Comparison of American, European, and Asian Tiradss in Thyroid Nodule Assessment: Systematic Review and Meta-Analysis","volume":"13","author":"Piticchio","year":"2024","journal-title":"Eur. Thyroid J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1210\/jc.2018-01674","article-title":"Reducing the Number of Unnecessary Thyroid Biopsies While Improving Diagnostic Accuracy: Toward the \u201cRight\u201d Tirads","volume":"104","author":"Grani","year":"2019","journal-title":"J. Clin. Endocrinol. Metab."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1148\/radiol.11110206","article-title":"Thyroid Imaging Reporting and Data System for Us Features of Nodules: A Step in Establishing Better Stratification of Cancer Risk","volume":"260","author":"Kwak","year":"2011","journal-title":"Radiology"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1111\/cen.13997","article-title":"A Multicentre Validation Study for the Eu-Tirads Using Histological Diagnosis as a Gold Standard","volume":"91","author":"Trimboli","year":"2019","journal-title":"Clin. Endocrinol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"552","DOI":"10.4158\/EP-2019-0237","article-title":"Comparison of Diagnostic Performance between the American College of Radiology Thyroid Imaging Reporting and Data System and American Thyroid Association Guidelines: A Systematic Review","volume":"26","author":"Zhang","year":"2020","journal-title":"Endocr. Pract."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dobruch-Sobczak, K.S., Krauze, A., Migda, B., Mlosek, K., S\u0142apa, R.Z., Baku\u0142a-Zalewska, E., Adamczewski, Z., Lewi\u0144ski, A., Jakubowski, W., and Dedecjus, M. (2019). Integration of Sonoelastography into the Tirads Lexicon Could Influence the Classification. Front. Endocrinol., 10.","DOI":"10.3389\/fendo.2019.00127"},{"key":"ref_31","first-page":"113","article-title":"Diagnostic Performance of the American College of Radiology Thyroid Imaging Reporting and Data System","volume":"12","author":"Bhushan","year":"2020","journal-title":"World J. Endoc. Surg."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1148\/radiol.2018171074","article-title":"Us Fine-Needle Aspiration Biopsy for Thyroid Malignancy: Diagnostic Performance of Seven Society Guidelines Applied to 2000 Thyroid Nodules","volume":"287","author":"Ha","year":"2018","journal-title":"Radiology"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1764","DOI":"10.1056\/NEJMcp031436","article-title":"Clinical Practice. The Thyroid Nodule","volume":"351","year":"2004","journal-title":"N. Engl. J. Med."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"840","DOI":"10.3348\/kjr.2020.0578","article-title":"2020 Imaging Guidelines for Thyroid Nodules and Differentiated Thyroid Cancer: Korean Society of Thyroid Radiology","volume":"22","author":"Lee","year":"2021","journal-title":"Korean J. Radiol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"13s","DOI":"10.2967\/jnumed.120.246025","article-title":"Update on the Evaluation of Thyroid Nodules","volume":"62","author":"Bernet","year":"2021","journal-title":"J. Nucl. Med."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1245\/s10434-011-1807-z","article-title":"Diagnostic Accuracy of Surgeon-Performed Ultrasound-Guided Fine-Needle Aspiration of Thyroid Nodules","volume":"19","author":"Bohacek","year":"2012","journal-title":"Ann. Surg. Oncol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1016\/j.jfma.2021.02.021","article-title":"Point-of-Care Ultrasound in Otolaryngology And head and Neck Surgery: A Prospective Survey Study","volume":"120","author":"Liao","year":"2021","journal-title":"J. Formos. Med. Assoc."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2455","DOI":"10.1007\/s00405-020-06344-6","article-title":"Surgeon-Performed Ultrasound in a Head and Neck Surgical Oncology Clinic: Saving Time and Improving Patient Care","volume":"278","author":"Kwok","year":"2021","journal-title":"Eur. Arch. Otorhinolaryngol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1016\/j.jacr.2015.07.011","article-title":"Thyroid Ultrasound Reporting Lexicon: White Paper of the Acr Thyroid Imaging, Reporting and Data System (Tirads) Committee","volume":"12","author":"Grant","year":"2015","journal-title":"J. Am. Coll. Radiol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Cantisani, V., De Silvestri, A., Scotti, V., Fresilli, D., Tarsitano, M.G., Polti, G., Guiban, O., Polito, E., Pacini, P., and Durante, C. (2022). Us-Elastography with Different Techniques for Thyroid Nodule Characterization: Systematic Review and Meta-Analysis. Front. Oncol., 12.","DOI":"10.3389\/fonc.2022.845549"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1089\/ct.2022;34.169-173","article-title":"A Systematic Review on the Benefits and Harms of Active Surveillance Versus Immediate Surgery for Low-Risk Differentiated Thyroid Cancer","volume":"34","author":"Biondi","year":"2022","journal-title":"Clin. Thyroidol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Jiang, L., Zhang, D., Chen, Y.N., Yu, X.J., Pan, M.F., and Lian, L. (2023). The Value of Conventional Ultrasound Combined with Superb Microvascular Imaging and Color Doppler Flow Imaging in the Diagnosis of Thyroid Malignant Nodules: A Systematic Review and Meta-Analysis. Front. Endocrinol., 14.","DOI":"10.3389\/fendo.2023.1182259"}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/1\/128\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,3]],"date-time":"2026-01-03T05:14:53Z","timestamp":1767417293000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/1\/128"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,1]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["diagnostics16010128"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics16010128","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,1]]}}}