{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T15:39:18Z","timestamp":1787758758640,"version":"build-2784847793"},"reference-count":42,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T00:00:00Z","timestamp":1621814400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Medicina"],"abstract":"<jats:p>Background and Objectives: Thyroid nodules are lumps of solid or liquid-filled tumors that form inside the thyroid gland, which can be malignant or benign. Our aim was to test whether the described features of the Thyroid Imaging Reporting and Data System (TI-RADS) could improve radiologists\u2019 decision making when integrated into a computer system. In this study, we developed a computer-aided diagnosis system integrated into multiple-instance learning (MIL) that would focus on benign\u2013malignant classification. Data were available from the Universidad Nacional de Colombia. Materials and Methods: There were 99 cases (33 Benign and 66 malignant). In this study, the median filter and image binarization were used for image pre-processing and segmentation. The grey level co-occurrence matrix (GLCM) was used to extract seven ultrasound image features. These data were divided into 87% training and 13% validation sets. We compared the support vector machine (SVM) and artificial neural network (ANN) classification algorithms based on their accuracy score, sensitivity, and specificity. The outcome measure was whether the thyroid nodule was benign or malignant. We also developed a graphic user interface (GUI) to display the image features that would help radiologists with decision making. Results: ANN and SVM achieved an accuracy of 75% and 96% respectively. SVM outperformed all the other models on all performance metrics, achieving higher accuracy, sensitivity, and specificity score. Conclusions: Our study suggests promising results from MIL in thyroid cancer detection. Further testing with external data is required before our classification model can be employed in practice.<\/jats:p>","DOI":"10.3390\/medicina57060527","type":"journal-article","created":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T12:38:01Z","timestamp":1621859881000},"page":"527","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":51,"title":["Ultrasound Image Classification of Thyroid Nodules Using Machine Learning Techniques"],"prefix":"10.3390","volume":"57","author":[{"given":"Vijay Vyas","family":"Vadhiraj","sequence":"first","affiliation":[{"name":"School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland"},{"name":"Health Innovation Via Engineering Laboratory, C\u00faram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Simpkin","sequence":"additional","affiliation":[{"name":"School of Mathematics, Statistics and Applied Maths, National University of Ireland, H91 TK33 Galway, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1553-4489","authenticated-orcid":false,"given":"James","family":"O\u2019Connell","sequence":"additional","affiliation":[{"name":"School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland"},{"name":"Health Innovation Via Engineering Laboratory, C\u00faram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Naykky","family":"Singh Ospina","sequence":"additional","affiliation":[{"name":"Division of Endocrinology, Department of Medicine, University of Florida, Gainesville, FL 3210, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Spyridoula","family":"Maraka","sequence":"additional","affiliation":[{"name":"Division of Endocrinology and Metabolism, University of Arkansas for Medical Sciences, Little Rock, AR 72205, USA"},{"name":"Medicine Section, Central Arkansas Veterans Healthcare System, Little Rock, AR 72205, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Derek T.","family":"O\u2019Keeffe","sequence":"additional","affiliation":[{"name":"School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland"},{"name":"Health Innovation Via Engineering Laboratory, C\u00faram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland"},{"name":"Lero, SFI Centre for Software Research, National University of Ireland Galway, H91 TK33 Galway, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,24]]},"reference":[{"key":"ref_1","unstructured":"Ospina, N.S., I\u00f1iguez-Ariza, N.M., and Castro, M.R. (2020). Thyroid nodules: Diagnostic evaluation based on thyroid cancer risk assessment. BMJ, 368."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1111\/j.1365-2362.2009.02162.x","article-title":"Very high prevalence of thyroid nodules detected by high frequency (13 MHz) ultrasound examination","volume":"39","author":"Guth","year":"2009","journal-title":"Eur. J. Clin. Investig."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bomeli, S.R., LeBeau, S.O., and Ferris, R.L. (2010). Evaluation of a Thyroid Nodule. Otolaryngologic Clinics of North America, Elsevier.","DOI":"10.1016\/j.otc.2010.01.002"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2347","DOI":"10.1056\/NEJMcp1415786","article-title":"Thyroid nodules","volume":"373","author":"Burman","year":"2015","journal-title":"N. Engl. J. Med. Mass Med. Soc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"23","DOI":"10.14366\/usg.20068","article-title":"Applications of machine learning and deep learning to thyroid imaging: Where do we stand?","volume":"40","author":"Ha","year":"2021","journal-title":"Ultrasonoraphy"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.bjoms.2016.11.321","article-title":"Complications after fine-needle aspiration cytology: A retrospective study of 7449 consecutive thyroid nodules","volume":"55","author":"Cappelli","year":"2017","journal-title":"Br. J. Oral Maxillofac. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1111\/j.1365-2265.2012.04404.x","article-title":"What are the keys to successful thyroid FNA interpretation?","volume":"77","author":"Sebo","year":"2012","journal-title":"Clin. Endocrinol."},{"key":"ref_8","first-page":"251","article-title":"Fine needle aspiration cytology of thyroid gland diseases","volume":"34","author":"Altavilla","year":"1990","journal-title":"Acta Cytol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1089\/thy.2017.0655","article-title":"Quantitative analysis of the benefits and risk of thyroid nodule evaluation in patients \u226570 years old","volume":"28","author":"Wang","year":"2018","journal-title":"Thyroid"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1089\/thy.2016.0075","article-title":"Thyroid cancer screening in South Korea increases detection of papillary cancers with no impact on other subtypes or thyroid cancer mortality","volume":"26","author":"Ahn","year":"2016","journal-title":"Thyroid"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1017","DOI":"10.1002\/cncr.29123","article-title":"Should small papillary thyroid cancer be observed? A population-based study","volume":"121","author":"Nilubol","year":"2015","journal-title":"Cancer"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2040","DOI":"10.1148\/rg.2019190026","article-title":"ACR TI-RADS: Pitfalls, solutions, and future directions","volume":"39","author":"Tappouni","year":"2019","journal-title":"Radiographics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"878","DOI":"10.1089\/thy.2019.0752","article-title":"AIBx, artificial intelligence model to risk stratify thyroid nodules","volume":"30","author":"Thomas","year":"2020","journal-title":"Thyroid"},{"key":"ref_14","unstructured":"Ko, S.Y., Lee, J.H., Yoon, J.H., Na, H., and Hong, E. (2011). Deep Convolutional Neural Network for the Diagnosis of Thyroid Nodules on Ultrasound, PubMed."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, L., Yang, S., Yang, S., Zhao, C., Tian, G., Gao, Y., Chen, Y., and Lu, Y. (2019). Automatic thyroid nodule recognition and diagnosis in ultrasound imaging with the YOLOv2 neural network. World J. Surg. Oncol., 17.","DOI":"10.1186\/s12957-019-1558-z"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Seo, J.K., Kim, Y.J., Kim, K.G., Shin, I., Shin, J.H., and Kwak, J.Y. (2017). Differentiation of the follicular neoplasm on the grayscale us by image selection subsampling along with the marginal outline using convolutional neural network. BioMed Res. Int.","DOI":"10.1155\/2017\/3098293"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1007\/s10278-017-9997-y","article-title":"Thyroid nodule classification in ultrasound images by fine-tuning deep convolutional neural network","volume":"30","author":"Chi","year":"2017","journal-title":"J. Digit. Imaging"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"778","DOI":"10.1002\/hed.25049","article-title":"Computer-aided system for diagnosing thyroid nodules on ultrasound: A comparison with radiologist-based clinical assessments","volume":"40","author":"Gao","year":"2018","journal-title":"Head Neck"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2891","DOI":"10.1007\/s00405-017-4562-3","article-title":"Computer-aided diagnosis of malignant or benign thyroid nodes based on ultrasound images","volume":"274","author":"Yu","year":"2017","journal-title":"Eur. Arch. Otorhinolaryngol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.ultras.2016.09.011","article-title":"A pre-trained convolutional neural network-based method for thyroid nodule diagnosis","volume":"73","author":"Ma","year":"2017","journal-title":"Ultrasonics"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.cmpb.2017.06.005","article-title":"Ultrasound-based differentiation of malignant and benign thyroid Nodules: An extreme learning machine approach","volume":"147","author":"Xia","year":"2017","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"859","DOI":"10.2214\/AJR.15.15813","article-title":"Classifier model based on machine learning algorithms: Application to differential diagnosis of suspicious thyroid nodules via sonography","volume":"207","author":"Wu","year":"2016","journal-title":"Am. J. Roentgenol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ardakani, A.A., Gharbali, A., and Mohammadi, A. (2015). Application of Texture Analysis Method for Classification of Benign and Malignant Thyroid Nodules in Ultrasound Images, Pubmed.","DOI":"10.7863\/ultra.14.09057"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"W598","DOI":"10.2214\/AJR.09.4037","article-title":"A bayesian network for differentiating benign from malignant thyroid nodules using sonographic and demographic features","volume":"196","author":"Liu","year":"2011","journal-title":"Am. J. Roentgenol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.compmedimag.2008.10.010","article-title":"Morphological and wavelet features towards sonographic thyroid nodules evaluation","volume":"33","author":"Tsantis","year":"2009","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhu, L.C., Ye, Y.L., Luo, W.H., Su, M., Wei, H.P., Zhang, X.B., Wei, J., and Zou, C.L. (2013). A model to discriminate malignant from benign thyroid nodules using artificial neural network. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0082211"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lim, K.J., Choi, C.S., Yoon, D.Y., Chang, S.K., Kim, K.K., Han, H., Kim, S.S., Lee, J., and Jeon, Y.H. (2008). Computer-Aided Diagnosis for the Differentiation of Malignant from Benign Thyroid Nodules on Ultrasonography, Pubmed.","DOI":"10.1016\/j.acra.2007.12.022"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.ultras.2017.02.003","article-title":"Fusion of spatial gray level dependency and fractal texture features for the characterization of thyroid lesions","volume":"77","author":"Raghavendra","year":"2017","journal-title":"Ultrasonics"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1753","DOI":"10.7863\/ultra.15.14.10045","article-title":"A model using texture features to differentiate the nature of thyroid nodules on sonography","volume":"34","author":"Song","year":"2015","journal-title":"J. Ultrasound Med."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Schenke, S.A., Wuestemann, J., Zimny, M., and Kreissl, M.C. (2020). Ultrasound Assessment of Autonomous Thyroid Nodules before and after Radioiodine Therapy Using Thyroid Imaging Reporting and Data System (TIRADS). Diagnostics, 10.","DOI":"10.3390\/diagnostics10121038"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Gomes Ataide, E.J., Ponugoti, N., Illanes, A., Schenke, S., Kreissl, M., and Friebe, M. (2020). Thyroid Nodule Classification for Physician Decision Support Using Machine Learning-Evaluated Geometric and Morphological Features. Sensors, 20.","DOI":"10.3390\/s20216110"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kwon, M.R., Shin, J.H., Park, H., Cho, H., Kim, E., and Hahn, S.Y. (2020). Radiomics Based on Thyroid Ultrasound Can Predict Distant Metastasis of Follicular Thyroid Carcinoma. J. Clin. Med., 9.","DOI":"10.3390\/jcm9072156"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Nguyen, D.T., Kang, J.K., Pham, T.D., Batchuluun, G., and Park, K.R. (2020). Ultrasound image-based diagnosis of malignant thyroid nodule using artificial intelligence. Sensors, 20.","DOI":"10.3390\/s20071822"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1001\/jamaoto.2019.3073","article-title":"Machine learning by ultrasonography for genetic risk stratification of thyroid nodules","volume":"146","author":"Daniels","year":"2020","journal-title":"JAMA Otolaryngol. Head Neck Surg."},{"key":"ref_35","unstructured":"Colombia, Universidad Nacional de Colombia (2019, July 26). Digital Database of Thyroid Ultrasound Images. Universidad Nacional de Colombia. Available online: http:\/\/cimalab.intec.co\/?lang=en=project=31."},{"key":"ref_36","unstructured":"Tan, L., and Jiang, J. (2019, July 26). Chapter 13\u2014Image Processing Basics. s.l.: Science Direct. Available online: https:\/\/www.globalspec.com\/reference\/81808\/203279\/chapter-13-image-processing-basics."},{"key":"ref_37","first-page":"8","article-title":"Binarization Techniques used for Grey Scale Images","volume":"71","author":"Puneet","year":"2013","journal-title":"Bathinida Int. J. Comput. Appl."},{"key":"ref_38","first-page":"8","article-title":"Statistical feature extraction to classify oral cancers","volume":"4","author":"Anuradha","year":"2013","journal-title":"J. Glob. Res. Comput. Sci."},{"key":"ref_39","unstructured":"Rai, H. (2019, February 06). Support Vector Machine-Part 2. Neural Networks the Way Information Moves. Available online: https:\/\/neuralnetset.blogspot.com\/2016\/02\/support-vector-machine-part-2.html."},{"key":"ref_40","unstructured":"Wikipedia (2019, July 29). Artificial Neural Network. Available online: https:\/\/en.wikipedia.org\/wiki\/Artificial_neural_network."},{"key":"ref_41","unstructured":"Parveen, K. (2014). Artificial Neural Networks\u2014A Study, IJEERT."},{"key":"ref_42","unstructured":"Alam, M. (2016). Codes in MATLAB for training artificial neural network using particle swarm optimization. Res. Gate, 1\u201316."}],"container-title":["Medicina"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1648-9144\/57\/6\/527\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:07:07Z","timestamp":1760162827000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1648-9144\/57\/6\/527"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,24]]},"references-count":42,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["medicina57060527"],"URL":"https:\/\/doi.org\/10.3390\/medicina57060527","relation":{},"ISSN":["1648-9144"],"issn-type":[{"value":"1648-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,24]]}}}