{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T17:25:31Z","timestamp":1772645131551,"version":"3.50.1"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,9,3]],"date-time":"2020-09-03T00:00:00Z","timestamp":1599091200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,3]],"date-time":"2020-09-03T00:00:00Z","timestamp":1599091200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BioData Mining"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Various combinations of ultrasonographic (US) characteristics are increasingly utilized to classify thyroid nodules. But they lack theories, and heavily depend on radiologists\u2019 experience, and cannot correctly classify thyroid nodules. Hence, our main purpose of this manuscript is to select the US characteristics significantly associated with malignancy and to develop an efficient scoring system for facilitating ultrasonic clinicians to correctly identify thyroid malignancy.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>A logistic regression (LR) model is utilized to identify the potential thyroid malignancy, and the least absolute shrinkage and selection operator (LASSO) method is adopted to simultaneously select US characteristics significantly associated with malignancy and estimate parameters in LR model. Based on the selected US characteristics, we calculate the probability for each of thyroid nodules via random forest (RF) and extreme learning machine (ELM), and develop a scoring system to classify thyroid nodules. For comparison, we also consider eight state-of-the-art methods such as support vector machine (SVM), neural network (NET), etc. The area under the receiver operating characteristic curve (AUC) is employed to measure the accuracy of various classifiers.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The US characteristics: nodule size, AP\/T\u22651, solid component, micro-calcifications, hackly border, hypoechogenicity, presence of halo, unclear border, irregular margin, and central vascularity are selected as the significant predictors associated with thyroid malignancy via the LASSO LR (LLR). Using the developed scoring system, thyroid nodules are classified into the following four categories: benign, low suspicion, intermediate suspicion, and high suspicion, whose rates of malignancy correctly identified for RF (ELM) method on the testing dataset are 0.0% (4.3%), 14.3% (50.0%), 58.1% (59.1%) and 96.1% (97.7%), respectively.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>LLR together with RF performs better than other methods in identifying malignancy, especially for abnormal nodules, in terms of risk scores. The developed scoring system can well predict the risk of malignancy and guide medical doctors to make management decisions for reducing the number of unnecessary biopsies for benign nodules.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s13040-020-00223-w","type":"journal-article","created":{"date-parts":[[2020,9,3]],"date-time":"2020-09-03T07:03:04Z","timestamp":1599116584000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Diagnosis of thyroid nodules for ultrasonographic characteristics indicative of malignancy using random forest"],"prefix":"10.1186","volume":"13","author":[{"given":"Dan","family":"Chen","sequence":"first","affiliation":[]},{"given":"Jun","family":"Hu","sequence":"additional","affiliation":[]},{"given":"Mei","family":"Zhu","sequence":"additional","affiliation":[]},{"given":"Niansheng","family":"Tang","sequence":"additional","affiliation":[]},{"given":"Yang","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Yuran","family":"Feng","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,9,3]]},"reference":[{"issue":"3","key":"223_CR1","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1148\/radiol.11110206","volume":"260","author":"JY Kwak","year":"2011","unstructured":"Kwak JY, Han KH, Yoon JH, Moon HJ, Son EJ, Park SH, Jung HK, Choi JS, Kim BM, Kim E-K. Thyroid imaging reporting and data system for US features of nodules: a step in establishing better stratification of cancer risk. Radiology. 2011; 260(3):892\u20139.","journal-title":"Radiology"},{"issue":"1","key":"223_CR2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-016-0028-x","volume":"7","author":"Y Wang","year":"2017","unstructured":"Wang Y, Lei K-R, He Y-P, Li X-L, Ren W-W, Zhao C-K, Bo X-W, Wang D, Sun C-Y, Xu H-X. Malignancy risk stratification of thyroid nodules: comparisons of four ultrasound Thyroid Imaging Reporting and Data Systems in surgically resected nodules. Sci Rep. 2017; 7(1):1\u201310.","journal-title":"Sci Rep"},{"issue":"1","key":"223_CR3","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/1756-6614-6-6","volume":"6","author":"Z Adamczewski","year":"2013","unstructured":"Adamczewski Z, Lewi\u0144ski A. Proposed algorithm for management of patients with thyroid nodules\/focal lesions, based on ultrasound (US) and fine-needle aspiration biopsy (FNAB); our own experience. Thyroid Res. 2013; 6(1):6.","journal-title":"Thyroid Res"},{"issue":"7","key":"223_CR4","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1007\/s00268-008-9494-z","volume":"32","author":"LF Morris","year":"2008","unstructured":"Morris LF, Ragavendra N, Yeh MW. Evidence-based assessment of the role of ultrasonography in the management of benign thyroid nodules. World J Surg. 2008; 32(7):1253\u201363.","journal-title":"World J Surg"},{"issue":"5","key":"223_CR5","doi-asserted-by":"crossref","first-page":"1748","DOI":"10.1210\/jc.2008-1724","volume":"94","author":"E Horvath","year":"2009","unstructured":"Horvath E, Majlis S, Rossi R, Franco C, Niedmann JP, Castro A, Dominguez M. An ultrasonogram reporting system for thyroid nodules stratifying cancer risk for clinical management. J Clin Endocrinol Metab. 2009; 94(5):1748\u201351.","journal-title":"J Clin Endocrinol Metab"},{"issue":"11","key":"223_CR6","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.1089\/thy.2008.0021","volume":"19","author":"J-Y Park","year":"2009","unstructured":"Park J-Y, Lee HJ, Jang HW, Kim HK, Yi JH, Lee W, Kim SH. A proposal for a thyroid imaging reporting and data system for ultrasound features of thyroid carcinoma. Thyroid. 2009; 19(11):1257\u201364.","journal-title":"Thyroid"},{"issue":"2","key":"223_CR7","doi-asserted-by":"crossref","first-page":"389","DOI":"10.3348\/kjr.2013.14.2.389","volume":"14","author":"JY Kwak","year":"2013","unstructured":"Kwak JY, Jung I, Baek JH, Baek SM, Choi N, Choi YJ, Jung SL, Kim E-K, Kim J-A, Kim J-h, Kim KS, Lee JH, Moon HJ, Moon W-J, Park JS, Ryu JH, Shin JH, Son EJ, Sung JY, Na DG. Erratum: Image reporting and characterization system for ultrasound features of thyroid nodules: multicentric korean retrospective study. Korean J Radiol. 2013; 14(2):389.","journal-title":"Korean J Radiol"},{"issue":"3","key":"223_CR8","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1148\/radiol.11110206","volume":"260","author":"JY Kwak","year":"2011","unstructured":"Kwak JY, Han KH, Yoon JH, Moon HJ, Son EJ, Park SH, Jung HK, Choi JS, Kim BM, Kim E-K. Thyroid imaging reporting and data system for US features of nodules: a step in establishing better stratification of cancer risk. Radiology. 2011; 260(3):892\u20139.","journal-title":"Radiology"},{"issue":"5","key":"223_CR9","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1530\/EJE-12-0936","volume":"168","author":"G Russ","year":"2013","unstructured":"Russ G, Royer B, Bigorgne C, Rouxel A, Bienvenu-Perrard M, Leenhardt L. Prospective evaluation of thyroid imaging reporting and data system on 4550 nodules with and without elastography. Eur J Endocrinol. 2013; 168(5):649\u201355.","journal-title":"Eur J Endocrinol"},{"issue":"1","key":"223_CR10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1089\/thy.2015.0020","volume":"26","author":"BR Haugen","year":"2016","unstructured":"Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, Pacini F, Randolph GW, Sawka AM, Schlumberger M, Schuff KG, Sherman SI, Sosa JA, Steward DL, Tuttle RM, Wartofsky L. 2015 American Thyroid Association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association guidelines task force on thyroid nodules and differentiated thyroid cancer. Thyroid. 2016; 26(1):1\u2013133.","journal-title":"Thyroid"},{"issue":"5","key":"223_CR11","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.jacr.2017.01.046","volume":"14","author":"FN Tessler","year":"2017","unstructured":"Tessler FN, Middleton WD, Grant EG, Hoang JK, Berland LL, Teefey SA, Cronan JJ, Beland MD, Desser TS, Frates MC, Hammers LW, Hamper UM, Langer JE, Reading CC, Scoutt LM, Stavros AT. ACR thyroid imaging, reporting and data system (TI-RADS): white paper of the ACR TI-RADS committee. J Am Coll Radiol. 2017; 14(5):587\u201395.","journal-title":"J Am Coll Radiol"},{"issue":"6","key":"223_CR12","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1089\/thy.2018.0380","volume":"29","author":"B Zhang","year":"2019","unstructured":"Zhang B, Tian J, Pei S, Chen Y, He X, Dong Y, Zhang L, Mo X, Huang W, Cong S, Zhang S. Machine learning\u2013assisted system for thyroid nodule diagnosis. Thyroid. 2019; 29(6):858\u201367.","journal-title":"Thyroid"},{"issue":"5","key":"223_CR13","first-page":"326","volume":"16","author":"R Xu","year":"1994","unstructured":"Xu R, Yi D, Xia J. The principal research to assess the outliers of the logistic regression model. Acta Academlae Medicinae Militaris Tertlae. 1994; 16(5):326\u20138.","journal-title":"Acta Academlae Medicinae Militaris Tertlae"},{"key":"223_CR14","doi-asserted-by":"crossref","first-page":"35632","DOI":"10.1038\/srep35632","volume":"6","author":"M-H Wu","year":"2016","unstructured":"Wu M-H, Chen C-N, Chen K-Y, Ho M-C, Tai H-C, Wang Y-H, Chen A, Chang K-J. Quantitative analysis of echogenicity for patients with thyroid nodules. Sci Rep. 2016; 6:35632.","journal-title":"Sci Rep"},{"issue":"1","key":"223_CR15","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/s12020-013-9922-1","volume":"45","author":"Y Tutuncu","year":"2014","unstructured":"Tutuncu Y, Berker D, Isik S, Akbaba G, Ozuguz U, Kucukler FK, G\u00f6cmen E, Yalc\u0131n Y, Aydin Y, Guler S. The frequency of malignancy and the relationship between malignancy and ultrasonographic features of thyroid nodules with indeterminate cytology. Endocrine. 2014; 45(1):37\u201345.","journal-title":"Endocrine"},{"issue":"2","key":"223_CR16","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.ejrad.2012.10.017","volume":"82","author":"JY Kim","year":"2013","unstructured":"Kim JY, Kim SY, Yang KR. Ultrasonographic criteria for fine needle aspiration of nonpalpable thyroid nodules 1-2 cm in diameter. Eur J Radiol. 2013; 82(2):321\u20136.","journal-title":"Eur J Radiol"},{"key":"223_CR17","doi-asserted-by":"crossref","unstructured":"Pereira JM, Basto M, da Silva AF. The logistic lasso and ridge regression in predicting corporate failure In: Iacob AI, editor. 3rd Global Conference on Business, Economics, Management and Tourism: 2016. p. 634\u201341.","DOI":"10.1016\/S2212-5671(16)30310-0"},{"issue":"1","key":"223_CR18","doi-asserted-by":"crossref","first-page":"36","DOI":"10.14366\/usg.16045","volume":"37","author":"SM Kim","year":"2018","unstructured":"Kim SM, Kim Y, Jeong K, Jeong H, Kim J. Logistic LASSO regression for the diagnosis of breast cancer using clinical demographic data and the BI-RADS lexicon for ultrasonography. Ultrasonography. 2018; 37(1):36\u201342.","journal-title":"Ultrasonography"},{"key":"223_CR19","doi-asserted-by":"crossref","unstructured":"James G, Witten D, Hastie T, Tibshirani R. An Introduction to Statistical Learning with applications in R, 1st; 2013, pp. 221\u20137.","DOI":"10.1007\/978-1-4614-7138-7_1"},{"key":"223_CR20","doi-asserted-by":"crossref","unstructured":"Hastie T, Tibshirani R, Friedman J. The elements of statistical learning: data mining, inference, and prediction, 2nd edn; 2009;99, pp. 61\u201379.","DOI":"10.1007\/978-0-387-84858-7"},{"key":"223_CR21","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.neunet.2014.10.001","volume":"61","author":"G Huang","year":"2015","unstructured":"Huang G, Huang G-B, Song S, You K. Trends in extreme learning machines: A review. Neural Netw. 2015; 61:32\u201348.","journal-title":"Neural Netw"},{"key":"223_CR22","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.cmpb.2017.06.005","volume":"147","author":"J Xia","year":"2017","unstructured":"Xia J, Chen H, Li Q, Zhou M, Chen L, Cai Z, Fang Y, Zhou H. Ultrasound-based differentiation of malignant and benign thyroid nodules: An extreme learning machine approach. Comput Methods Programs Biomed. 2017; 147:37\u201349.","journal-title":"Comput Methods Programs Biomed"},{"issue":"6","key":"223_CR23","doi-asserted-by":"crossref","first-page":"594","DOI":"10.3348\/kjr.2010.11.6.594","volume":"11","author":"O Algin","year":"2010","unstructured":"Algin O, Algin E, Gokalp G, Ocako\u011flu G, Erdo\u011fan C, Saraydaroglu O, Tuncel E. Role of duplex power Doppler ultrasound in differentiation between malignant and benign thyroid nodules. Korean J Radiol Off J Korean Radiol Soc. 2010; 11(6):594\u2013602.","journal-title":"Korean J Radiol Off J Korean Radiol Soc"},{"issue":"6","key":"223_CR24","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1016\/S0002-9610(05)80728-7","volume":"164","author":"DAK Watters","year":"1992","unstructured":"Watters DAK, Ahuja AT, Evans RM, Chick W, King WWK, Metreweli C, Li AKC. Role of ultrasound in the management of thyroid nodules. Am J Surg. 1992; 164(6):654\u20137.","journal-title":"Am J Surg"},{"issue":"10","key":"223_CR25","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.7863\/jum.2003.22.10.1027","volume":"22","author":"JR Wienke","year":"2003","unstructured":"Wienke JR, Chong WK, Fielding JR, Zou KH, Mittelstaedt CA. Sonographic features of benign thyroid nodules: interobserver reliability and overlap with malignancy. J Ultrasound Med. 2003; 22(10):1027\u201331.","journal-title":"J Ultrasound Med"},{"issue":"5","key":"223_CR26","doi-asserted-by":"crossref","first-page":"1941","DOI":"10.1210\/jcem.87.5.8504","volume":"87","author":"E Papini","year":"2002","unstructured":"Papini E, Guglielmi R, Bianchini A, Crescenzi A, Taccogna S, Nardi F, Panunzi C, Rinaldi R, Toscano V, Pacella CM. Risk of malignancy in nonpalpable thyroid nodules: predictive value of ultrasound and color-Doppler features. J Clin Endocrinol Metab. 2002; 87(5):1941\u20136.","journal-title":"J Clin Endocrinol Metab"},{"issue":"5","key":"223_CR27","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1016\/j.clinimag.2013.04.007","volume":"37","author":"B Erol","year":"2013","unstructured":"Erol B, Kara T, G\u00fcrses C, Karakoyun R, K\u00f6ro\u011flu M, S\u00fcren D, B\u00fclb\u00fcller N. Gray scale histogram analysis of solid breast lesions with ultrasonography: can lesion echogenicity ratio be used to differentiate the malignancy?Clin Imaging. 2013; 37(5):871\u20135.","journal-title":"Clin Imaging"}],"container-title":["BioData Mining"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13040-020-00223-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13040-020-00223-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13040-020-00223-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,16]],"date-time":"2022-11-16T05:39:30Z","timestamp":1668577170000},"score":1,"resource":{"primary":{"URL":"https:\/\/biodatamining.biomedcentral.com\/articles\/10.1186\/s13040-020-00223-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,3]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["223"],"URL":"https:\/\/doi.org\/10.1186\/s13040-020-00223-w","relation":{},"ISSN":["1756-0381"],"issn-type":[{"value":"1756-0381","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,3]]},"assertion":[{"value":"29 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 August 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 September 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14"}}