{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T22:21:58Z","timestamp":1787610118539,"version":"build-2736575974"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T00:00:00Z","timestamp":1634169600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T00:00:00Z","timestamp":1634169600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Research Foundation of Korea (NRF) grant funded by the Korean government","award":["2019R1A2C1002375"],"award-info":[{"award-number":["2019R1A2C1002375"]}]},{"name":"National Research Foundation of Korea (NRF) grant funded by the Korean government","award":["2021R1A2C2007492"],"award-info":[{"award-number":["2021R1A2C2007492"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Ultrasonography (US) is the primary diagnostic tool for thyroid nodules, while the accuracy is operator-dependent. It is widely used not only by radiologists but also by physicians with different levels of experience. The aim of this study was to investigate whether US with computer-aided diagnosis (CAD) has assisting roles to physicians in the diagnosis of thyroid nodules. 451 thyroid nodules evaluated by fine-needle aspiration cytology following surgery were included. 300 (66.5%) of them were diagnosed as malignancy. Physicians with US experience less than 1\u00a0year (inexperienced, n\u2009=\u200910), or more than 5\u00a0years (experienced, n\u2009=\u20093) reviewed the US images of thyroid nodules with or without CAD assistance. The diagnostic performance of CAD was comparable to that of the experienced group, and better than those of the inexperienced group. The AUC of the CAD for conventional PTC was higher than that for FTC and follicular variant PTC (0.925 vs. 0.499), independent of tumor size. CAD assistance significantly improved diagnostic performance in the inexperienced group, but not in the experienced groups. In conclusion, <jats:bold>t<\/jats:bold>he CAD system showed good performance in the diagnosis of conventional PTC. CAD assistance improved the diagnostic performance of less experienced physicians in US, especially in diagnosis of conventional PTC.<\/jats:p>","DOI":"10.1038\/s41598-021-99983-6","type":"journal-article","created":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T10:09:16Z","timestamp":1634206156000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["A beneficial role of computer-aided diagnosis system for less experienced physicians in the diagnosis of thyroid nodule on ultrasound"],"prefix":"10.1038","volume":"11","author":[{"given":"Sunyoung","family":"Kang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eunjung","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chae Won","family":"Chung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Han Na","family":"Jang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joon Ho","family":"Moon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yujin","family":"Shin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyuho","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soo Myoung","family":"Shin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoo Hyung","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seul Ki","family":"Kwon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chang Ho","family":"Ahn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyong Yeun","family":"Jung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A. Ram","family":"Hong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Young Joo","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Do Joon","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jin Young","family":"Kwak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sun Wook","family":"Cho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,10,14]]},"reference":[{"key":"99983_CR1","doi-asserted-by":"publisher","first-page":"5137904","DOI":"10.1155\/2018\/5137904","volume":"2018","author":"Q Huang","year":"2018","unstructured":"Huang, Q., Zhang, F. & Li, X. Machine learning in ultrasound computer-aided diagnostic systems: A survey. Biomed. Res. Int. 2018, 5137904. https:\/\/doi.org\/10.1155\/2018\/5137904 (2018).","journal-title":"Biomed. Res. Int."},{"key":"99983_CR2","doi-asserted-by":"publisher","first-page":"587","DOI":"10.1016\/j.jacr.2017.01.046","volume":"14","author":"FN Tessler","year":"2017","unstructured":"Tessler, F. N. et al. ACR thyroid imaging, reporting and data system (TI-RADS): White paper of the ACR TI-RADS committee. J. Am. Coll. Radiol. 14, 587\u2013595. https:\/\/doi.org\/10.1016\/j.jacr.2017.01.046 (2017).","journal-title":"J. Am. Coll. Radiol."},{"key":"99983_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1089\/thy.2015.0020","volume":"26","author":"BR Haugen","year":"2016","unstructured":"Haugen, B. R. et al. 2015 American Thyroid Association Management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: The American Thyroid Association guidelines task force on thyroid nodules and differentiated thyroid cancer. Thyroid 26, 1\u2013133. https:\/\/doi.org\/10.1089\/thy.2015.0020 (2016).","journal-title":"Thyroid"},{"key":"99983_CR4","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1159\/000478927","volume":"6","author":"G Russ","year":"2017","unstructured":"Russ, G. et al. European Thyroid Association guidelines for ultrasound malignancy risk stratification of thyroid nodules in adults: The EU-TIRADS. Eur. Thyroid J. 6, 225\u2013237. https:\/\/doi.org\/10.1159\/000478927 (2017).","journal-title":"Eur. Thyroid J."},{"key":"99983_CR5","doi-asserted-by":"publisher","first-page":"370","DOI":"10.3348\/kjr.2016.17.3.370","volume":"17","author":"JH Shin","year":"2016","unstructured":"Shin, J. H. et al. Ultrasonography diagnosis and imaging-based management of thyroid nodules: Revised Korean Society of thyroid radiology consensus statement and recommendations. Korean J. Radiol. 17, 370\u2013395. https:\/\/doi.org\/10.3348\/kjr.2016.17.3.370 (2016).","journal-title":"Korean J. Radiol."},{"key":"99983_CR6","doi-asserted-by":"publisher","first-page":"622","DOI":"10.4158\/EP161208.GL","volume":"22","author":"H Gharib","year":"2016","unstructured":"Gharib, H. et al. American Association of Clinical Endocrinologists, American College of Endocrinology, and Associazione Medici Endocrinologi Medical guidelines for clinical practice for the diagnosis and management of thyroid nodules\u20132016 update. Endocr. Pract. 22, 622\u2013639. https:\/\/doi.org\/10.4158\/EP161208.GL (2016).","journal-title":"Endocr. Pract."},{"key":"99983_CR7","doi-asserted-by":"publisher","DOI":"10.1210\/clinem\/dgz170","author":"M Castellana","year":"2020","unstructured":"Castellana, M. et al. Performance of five ultrasound risk stratification systems in selecting thyroid nodules for FNA. J. Clin. Endocrinol. Metab. https:\/\/doi.org\/10.1210\/clinem\/dgz170 (2020).","journal-title":"J. Clin. Endocrinol. Metab."},{"key":"99983_CR8","doi-asserted-by":"publisher","first-page":"1159","DOI":"10.1089\/thy.2019.0812","volume":"30","author":"PH Kim","year":"2020","unstructured":"Kim, P. H. et al. Diagnostic performance of four ultrasound risk stratification systems: A systematic review and meta-analysis. Thyroid 30, 1159\u20131168. https:\/\/doi.org\/10.1089\/thy.2019.0812 (2020).","journal-title":"Thyroid"},{"key":"99983_CR9","doi-asserted-by":"publisher","first-page":"1532","DOI":"10.1089\/thy.2018.0094","volume":"28","author":"EJ Ha","year":"2018","unstructured":"Ha, E. J., Na, D. G., Moon, W. J., Lee, Y. H. & Choi, N. Diagnostic performance of ultrasound-based risk-stratification systems for thyroid nodules: Comparison of the 2015 American Thyroid Association Guidelines with the 2016 Korean Thyroid Association\/Korean Society of Thyroid Radiology and 2017 American College of Radiology Guidelines. Thyroid 28, 1532\u20131537. https:\/\/doi.org\/10.1089\/thy.2018.0094 (2018).","journal-title":"Thyroid"},{"key":"99983_CR10","doi-asserted-by":"publisher","first-page":"162","DOI":"10.2214\/AJR.17.19192","volume":"211","author":"JK Hoang","year":"2018","unstructured":"Hoang, J. K. et al. Interobserver variability of sonographic features used in the American College of Radiology thyroid imaging reporting and data system. AJR Am. J. Roentgenol. 211, 162\u2013167. https:\/\/doi.org\/10.2214\/AJR.17.19192 (2018).","journal-title":"AJR Am. J. Roentgenol."},{"key":"99983_CR11","doi-asserted-by":"publisher","first-page":"466","DOI":"10.1007\/s11604-019-00831-5","volume":"37","author":"T Fujioka","year":"2019","unstructured":"Fujioka, T. et al. Distinction between benign and malignant breast masses at breast ultrasound using deep learning method with convolutional neural network. Jpn. J. Radiol. 37, 466\u2013472. https:\/\/doi.org\/10.1007\/s11604-019-00831-5 (2019).","journal-title":"Jpn. J. Radiol."},{"key":"99983_CR12","doi-asserted-by":"publisher","first-page":"746","DOI":"10.1002\/mp.13361","volume":"46","author":"M Byra","year":"2019","unstructured":"Byra, M. et al. Breast mass classification in sonography with transfer learning using a deep convolutional neural network and color conversion. Med. Phys. 46, 746\u2013755. https:\/\/doi.org\/10.1002\/mp.13361 (2019).","journal-title":"Med. Phys."},{"key":"99983_CR13","doi-asserted-by":"publisher","first-page":"20170576","DOI":"10.1259\/bjr.20170576","volume":"91","author":"AS Becker","year":"2018","unstructured":"Becker, A. S. et al. Classification of breast cancer in ultrasound imaging using a generic deep learning analysis software: A pilot study. Br. J. Radiol. 91, 20170576. https:\/\/doi.org\/10.1259\/bjr.20170576 (2018).","journal-title":"Br. J. Radiol."},{"key":"99983_CR14","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1148\/radiol.2019181343","volume":"292","author":"M Buda","year":"2019","unstructured":"Buda, M. et al. Management of thyroid nodules seen on US images: Deep learning may match performance of radiologists. Radiology 292, 695\u2013701. https:\/\/doi.org\/10.1148\/radiol.2019181343 (2019).","journal-title":"Radiology"},{"key":"99983_CR15","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/S1470-2045(18)30762-9","volume":"20","author":"X Li","year":"2019","unstructured":"Li, X. et al. Diagnosis of thyroid cancer using deep convolutional neural network models applied to sonographic images: A retrospective, multicohort, diagnostic study. Lancet Oncol. 20, 193\u2013201. https:\/\/doi.org\/10.1016\/S1470-2045(18)30762-9 (2019).","journal-title":"Lancet Oncol."},{"key":"99983_CR16","doi-asserted-by":"publisher","first-page":"e16379","DOI":"10.1097\/MD.0000000000016379","volume":"98","author":"WJ Zhao","year":"2019","unstructured":"Zhao, W. J., Fu, L. R., Huang, Z. M., Zhu, J. Q. & Ma, B. Y. Effectiveness evaluation of computer-aided diagnosis system for the diagnosis of thyroid nodules on ultrasound: A systematic review and meta-analysis. Medicine 98, e16379. https:\/\/doi.org\/10.1097\/MD.0000000000016379 (2019).","journal-title":"Medicine"},{"key":"99983_CR17","doi-asserted-by":"publisher","first-page":"15245","DOI":"10.1038\/s41598-020-72270-6","volume":"10","author":"J Koh","year":"2020","unstructured":"Koh, J. et al. Diagnosis of thyroid nodules on ultrasonography by a deep convolutional neural network. Sci. Rep. 10, 15245. https:\/\/doi.org\/10.1038\/s41598-020-72270-6 (2020).","journal-title":"Sci. Rep."},{"key":"99983_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.7863\/ultra.34.1.1","volume":"34","author":"JH Lee","year":"2015","unstructured":"Lee, J. H. et al. Sonographic and cytopathologic correlation of papillary thyroid carcinoma variants. J. Ultrasound Med. 34, 1\u201315. https:\/\/doi.org\/10.7863\/ultra.34.1.1 (2015).","journal-title":"J. Ultrasound Med."},{"key":"99983_CR19","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1186\/s12957-019-1558-z","volume":"17","author":"L Wang","year":"2019","unstructured":"Wang, L. et al. Automatic thyroid nodule recognition and diagnosis in ultrasound imaging with the YOLOv2 neural network. World J. Surg. Oncol. 17, 12. https:\/\/doi.org\/10.1186\/s12957-019-1558-z (2019).","journal-title":"World J. Surg. Oncol."},{"key":"99983_CR20","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1007\/s12020-018-1817-8","volume":"64","author":"T Xu","year":"2019","unstructured":"Xu, T. et al. Validation and comparison of three newly-released Thyroid Imaging Reporting and Data Systems for cancer risk determination. Endocrine 64, 299\u2013307. https:\/\/doi.org\/10.1007\/s12020-018-1817-8 (2019).","journal-title":"Endocrine"},{"key":"99983_CR21","doi-asserted-by":"publisher","first-page":"397","DOI":"10.3346\/jkms.2016.31.3.397","volume":"31","author":"EJ Jeon","year":"2016","unstructured":"Jeon, E. J. et al. Ultrasonographic characteristics of the follicular variant papillary thyroid cancer according to the tumor size. J. Korean Med. Sci. 31, 397\u2013402. https:\/\/doi.org\/10.3346\/jkms.2016.31.3.397 (2016).","journal-title":"J. Korean Med. Sci."},{"key":"99983_CR22","doi-asserted-by":"publisher","first-page":"1685","DOI":"10.7863\/jum.2009.28.12.1685","volume":"28","author":"DS Kim","year":"2009","unstructured":"Kim, D. S. et al. Sonographic features of follicular variant papillary thyroid carcinomas in comparison with conventional papillary thyroid carcinomas. J. Ultrasound Med. 28, 1685\u20131692. https:\/\/doi.org\/10.7863\/jum.2009.28.12.1685 (2009).","journal-title":"J. Ultrasound Med."},{"key":"99983_CR23","doi-asserted-by":"publisher","first-page":"1816","DOI":"10.1016\/j.ultrasmedbio.2016.03.025","volume":"42","author":"YS Song","year":"2016","unstructured":"Song, Y. S. et al. Ultrasonographic differentiation between nodular hyperplasia and neoplastic follicular-patterned lesions of the thyroid gland. Ultrasound Med. Biol. 42, 1816\u20131824. https:\/\/doi.org\/10.1016\/j.ultrasmedbio.2016.03.025 (2016).","journal-title":"Ultrasound Med. Biol."},{"key":"99983_CR24","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1111\/j.1365-2265.2006.02677.x","volume":"66","author":"T Rago","year":"2007","unstructured":"Rago, T. et al. Combined clinical, thyroid ultrasound and cytological features help to predict thyroid malignancy in follicular and Hupsilonrthle cell thyroid lesions: Results from a series of 505 consecutive patients. Clin. Endocrinol. 66, 13\u201320. https:\/\/doi.org\/10.1111\/j.1365-2265.2006.02677.x (2007).","journal-title":"Clin. Endocrinol."},{"key":"99983_CR25","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1634\/theoncologist.2010-0405","volume":"16","author":"CR McHenry","year":"2011","unstructured":"McHenry, C. R. & Phitayakorn, R. Follicular adenoma and carcinoma of the thyroid gland. Oncologist 16, 585\u2013593. https:\/\/doi.org\/10.1634\/theoncologist.2010-0405 (2011).","journal-title":"Oncologist"},{"key":"99983_CR26","doi-asserted-by":"publisher","first-page":"1341","DOI":"10.1089\/thy.2017.0500","volume":"27","author":"ES Cibas","year":"2017","unstructured":"Cibas, E. S. & Ali, S. Z. The 2017 Bethesda System for reporting thyroid cytopathology. Thyroid 27, 1341\u20131346. https:\/\/doi.org\/10.1089\/thy.2017.0500 (2017).","journal-title":"Thyroid"}],"updated-by":[{"DOI":"10.1038\/s41598-021-00821-6","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T00:00:00Z","timestamp":1634774400000}}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-99983-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-99983-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-99983-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T16:28:10Z","timestamp":1670084890000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-99983-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,14]]},"references-count":26,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["99983"],"URL":"https:\/\/doi.org\/10.1038\/s41598-021-99983-6","relation":{"correction":[{"id-type":"doi","id":"10.1038\/s41598-021-00821-6","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,14]]},"assertion":[{"value":"28 May 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 September 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2021","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1038\/s41598-021-00821-6","URL":"https:\/\/doi.org\/10.1038\/s41598-021-00821-6","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"20448"}}