{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T03:42:40Z","timestamp":1778125360842,"version":"3.51.4"},"reference-count":14,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,12]],"date-time":"2023-10-12T00:00:00Z","timestamp":1697068800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,12]],"date-time":"2023-10-12T00:00:00Z","timestamp":1697068800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Imaging"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Several machine learning (ML) classifiers for thyroid nodule diagnosis have been compared in terms of their accuracy, sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV), and area under the receiver operating curve (AUC). A total of 525 patients with thyroid nodules (malignant, <jats:italic>n<\/jats:italic>\u2009=\u2009228; benign, <jats:italic>n<\/jats:italic>\u2009=\u2009297) underwent conventional ultrasonography, strain elastography, and contrast-enhanced ultrasound. Six algorithms were compared: support vector machine (SVM), linear discriminant analysis (LDA), random forest (RF), logistic regression (LG), GlmNet, and K-nearest neighbors (K-NN). The diagnostic performances of the 13 suspicious sonographic features for discriminating benign and malignant thyroid nodules were assessed using different ML algorithms. To compare these algorithms, a 10-fold cross-validation paired t-test was applied to the algorithm performance differences.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The logistic regression algorithm had better diagnostic performance than the other ML algorithms. However, it was only slightly higher than those of GlmNet, LDA, and RF. The accuracy, sensitivity, specificity, NPV, PPV, and AUC obtained by running logistic regression were 86.48%, 83.33%, 88.89%, 87.42%, 85.20%, and 92.84%, respectively.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The experimental results indicate that GlmNet, SVM, LDA, LG, K-NN, and RF exhibit slight differences in classification performance.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12880-023-01117-z","type":"journal-article","created":{"date-parts":[[2023,10,12]],"date-time":"2023-10-12T12:02:39Z","timestamp":1697112159000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Comparison of six machine learning methods for differentiating benign and malignant thyroid nodules using ultrasonographic characteristics"],"prefix":"10.1186","volume":"23","author":[{"given":"Jianguang","family":"Liang","sequence":"first","affiliation":[]},{"given":"Tiantian","family":"Pang","sequence":"additional","affiliation":[]},{"given":"Weixiang","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Xiaogang","family":"Li","sequence":"additional","affiliation":[]},{"given":"Leidan","family":"Huang","sequence":"additional","affiliation":[]},{"given":"Xuehao","family":"Gong","sequence":"additional","affiliation":[]},{"given":"Xianfen","family":"Diao","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,12]]},"reference":[{"issue":"2","key":"1117_CR1","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1016\/j.ejso.2013.11.015","volume":"40","author":"N Batawil","year":"2014","unstructured":"Batawil N, Alkordy T. Ultrasonographic features associated with malignancy in cytologically indeterminate thyroid nodules. Eur J Surg Oncol. 2014;40(2):182\u20136.","journal-title":"Eur J Surg Oncol"},{"issue":"12","key":"1117_CR2","doi-asserted-by":"publisher","first-page":"0188987","DOI":"10.1371\/journal.pone.0188987","volume":"12","author":"T Pang","year":"2017","unstructured":"Pang T, Huang L, Deng Y, Wang T, Chen S, Gong X, Liu W. Logistic regression analysis of conventional ultrasonography, strain elastosonography, and contrast-enhanced ultrasound characteristics for the differentiation of benign and malignant thyroid nodules. PLoS One. 2017;12(12):0188987.","journal-title":"PLoS One"},{"issue":"12","key":"1117_CR3","doi-asserted-by":"publisher","first-page":"3102","DOI":"10.1016\/j.ultrasmedbio.2015.04.026","volume":"41","author":"RN Zhao","year":"2015","unstructured":"Zhao RN, Zhang B, Yang X, Jiang YX, Lai XJ, Zhang XY. Logistic regression analysis of contrast-enhanced ultrasound and conventional ultrasound characteristics of sub-centimeter thyroid nodules. Ultrasound Med Biol. 2015;41(12):3102\u20138.","journal-title":"Ultrasound Med Biol"},{"issue":"5","key":"1117_CR4","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1111\/cen.12692","volume":"83","author":"CL Chng","year":"2015","unstructured":"Chng CL, Kurzawinski TR, Beale T. Value of sonographic features in predicting malignancy in thyroid nodules diagnosed as follicular neoplasm on cytology. Clin Endocrinol. 2015;83(5):711.","journal-title":"Clin Endocrinol"},{"issue":"466","key":"1117_CR5","first-page":"567","volume":"99","author":"J Franklin","year":"2010","unstructured":"Franklin J. The elements of statistical learning: data mining, inference and prediction. Publ Am Stat Assoc. 2010;99(466):567\u2013567.","journal-title":"Publ Am Stat Assoc"},{"issue":"7","key":"1117_CR6","first-page":"779","volume":"28","author":"H Drucker","year":"1997","unstructured":"Drucker H, Burges CJC, Kaufman L, Smola AJ, Vapnik V. Support vector regression machines. Adv Neural Inf Process Syst. 1997;28(7):779\u201384.","journal-title":"Adv Neural Inf Process Syst"},{"issue":"3","key":"1117_CR7","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1007\/BF00994018","volume":"20","author":"C Cortes","year":"1995","unstructured":"Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273\u201397.","journal-title":"Mach Learn"},{"issue":"1","key":"1117_CR8","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L. Random forests. Mach Learn. 2001;45(1):5\u201332.","journal-title":"Mach Learn"},{"issue":"1","key":"1117_CR9","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","volume":"13","author":"T Cover","year":"1967","unstructured":"Cover T, Hart P. Nearest neighbor pattern classification. IEEE Trans Inf Theory. 1967;13(1):21\u20137.","journal-title":"IEEE Trans Inf Theory"},{"key":"1117_CR10","doi-asserted-by":"crossref","unstructured":"Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning.\u00a0New York: Springer;\u00a02009.","DOI":"10.1007\/978-0-387-84858-7"},{"issue":"3","key":"1117_CR11","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1198\/106186006X133933","volume":"15","author":"T Hothorn","year":"2006","unstructured":"Hothorn T, Hornik K, Zeileis A. Unbiased recursive partitioning: a conditional inference framework. J Comput Graph Stat. 2006;15(3):651\u201374.","journal-title":"J Comput Graph Stat"},{"key":"1117_CR12","doi-asserted-by":"publisher","first-page":"106300","DOI":"10.1016\/j.ultras.2020.106300","volume":"110","author":"YC Zhu","year":"2021","unstructured":"Zhu YC, AlZoubi A, Jassim S, Jiang Q, Zhang Y, Wang YB, Ye XD, Hongbo DU. A generic deep learning framework to classify thyroid and breast lesions in ultrasound images. Ultrasonics. 2021;110:106300. https:\/\/doi.org\/10.1016\/j.ultras.2020.106300. Epub 2020 Nov 12. PMID: 33232887.","journal-title":"Ultrasonics"},{"issue":"20","key":"1117_CR13","doi-asserted-by":"publisher","first-page":"1526","DOI":"10.21037\/atm-21-4328","volume":"9","author":"YC Zhu","year":"2021","unstructured":"Zhu YC, Jin PF, Bao J, Jiang Q, Wang X. Thyroid ultrasound image classification using a convolutional neural network. Ann Transl Med. 2021;9(20):1526. https:\/\/doi.org\/10.21037\/atm-21-4328. PMID: 34790732; PMCID: PMC8576712.","journal-title":"Ann Transl Med"},{"issue":"4","key":"1117_CR14","doi-asserted-by":"publisher","first-page":"585","DOI":"10.7863\/ultra.33.4.585","volume":"33","author":"YF Zhang","year":"2014","unstructured":"Zhang YF, He Y, Xu HX, Xu XH, Liu C, Guo LH, Liu LN, Xu JM. Virtual touch tissue imaging on acoustic radiation force impulse elastography. J Ultrasound Med. 2014;33(4):585\u201395.","journal-title":"J Ultrasound Med"}],"container-title":["BMC Medical Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-023-01117-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12880-023-01117-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-023-01117-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,20]],"date-time":"2023-11-20T10:11:27Z","timestamp":1700475087000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedimaging.biomedcentral.com\/articles\/10.1186\/s12880-023-01117-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,12]]},"references-count":14,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1117"],"URL":"https:\/\/doi.org\/10.1186\/s12880-023-01117-z","relation":{},"ISSN":["1471-2342"],"issn-type":[{"value":"1471-2342","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,12]]},"assertion":[{"value":"25 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All subjects gave their informed consent for inclusion before they participated in the study. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of Shenzhen Second People\u2019s Hospital.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"154"}}