{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T21:48:30Z","timestamp":1776894510207,"version":"3.51.2"},"reference-count":30,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T00:00:00Z","timestamp":1773532800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Biomimetics"],"abstract":"<jats:p>This paper presents an integrated multi-modal framework for detecting hyperthyroidism-associated abnormalities, namely exophthalmos and thyroid-related neck swelling, through the joint analysis of frontal facial and neck images using a deep learning-based approach. The objective of this research is to develop an integrated AI framework that improves hyperthyroid-related abnormality detection by simultaneously analyzing facial images of both the eye and neck based on pattern clinical knowledge. The multi-modal framework mimics a biological visual mechanism by using a dual-pathway architecture that concurrently processes foveal-like details of the eyes and neck. It integrates these high-resolution visual embeddings with quantitative morphological measurements to simulate a clinician\u2019s ability to fuse observation with physical assessment. The proposed system employs a multi-faceted decision-making process derived from three distinct data components: two from frontal face analysis and one from neck region analysis. Specifically, eye regions extracted from facial images are preprocessed using the YOLOv11s model. The proposed system leverages a dual-pathway processing architecture to extract comprehensive diagnostic features. For the eye dataset, the framework utilizes a face mesh-based eye landmark (FMEL) to extract both eye regions and perform eyes unfold processing. These regions are subsequently analyzed by the proposed sclera map unwrapping engine (SMUE) to derive quantitative sclera metrics from both the left and right eyes. To optimize classification, a dual-branch architecture is employed by integrating CNN visual embeddings with SMUE-derived statistical features through a feature fusion layer. Simultaneously, the neck processing path executes the neck region of interest (ROI) prediction {upper, lower} to segment critical regions for goiter assessment via the proposed neck \u03bc\u2212\u03c3 ensemble thresholding (NSET) algorithm. The experimental results demonstrate that the proposed algorithm for eye analysis achieved a mean average precision (mAP50) of 96.4%, with a specific mAP50 of 98.6% for the hyperthyroid class. Regarding quantitative scleral measurement, the SMUE process revealed distinct morphological differences, with the experimental data group exhibiting consistently higher pixel distances across the reference points compared with the normal group. Furthermore, the proposed NSET algorithm yielded the highest performance for swollen neck classification with an mAP50 of 92.0%, significantly outperforming the baseline deep learning models while maintaining lower computational complexity.<\/jats:p>","DOI":"10.3390\/biomimetics11030210","type":"journal-article","created":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T08:41:26Z","timestamp":1773650486000},"page":"210","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Hyper-Thyro Vision: An Integrated Framework for Hyperthyroidism Diagnostic Facial Image Analysis Based on Deep Learning"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-0877-8388","authenticated-orcid":false,"given":"Poonyisa","family":"Thepmangkorn","sequence":"first","affiliation":[{"name":"The Electrical Engineering Graduate Program, Faculty of Engineering and Technology, Mahanakorn University of Technology, Nongchok, Bangkok 10530, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2357-2365","authenticated-orcid":false,"given":"Suchada","family":"Sitjongsataporn","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, School of Electrical and Electronic Engineering (SEE), Mahanakorn University of Technology, Nongchok, Bangkok 10530, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhao, H., Zheng, C., Zhang, H., Rao, M., Li, Y., Fang, D., Huang, J., Zhang, W., and Yuan, G. (2023). Diagnosis of thyroid disease using deep convolutional neural network models applied to thyroid scintigraphy images: A multicenter study. Front. Endocrinol., 14.","DOI":"10.3389\/fendo.2023.1224191"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.21037\/qims-22-551","article-title":"Deep learning-based image analysis of eyelid morphology in thyroid-associated ophthalmopathy","volume":"13","author":"Shao","year":"2023","journal-title":"Quant. Imaging Med. Surg."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liu, Y., Li, Q., Xu, Y., Chen, Y., and Men, Y. (2023). Comparison of the safety between propylthiouracil and methimazole with hyperthyroidism in pregnancy: A systematic review and meta-analysis. PLoS ONE, 18.","DOI":"10.1371\/journal.pone.0286097"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e002264","DOI":"10.1136\/bmjophth-2025-002264","article-title":"AI-based assessment of Clinical Activity Score and detection of active thyroid eye disease using facial images: Validation of Glandy CAS","volume":"10","author":"Shin","year":"2025","journal-title":"BMJ Open Ophthalmol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Han, Y., Xie, J., Li, X., Xu, X., Sun, B., Liu, H., and Yan, C. (2025). Deep learning system for the auxiliary diagnosis of thyroid eye disease: Evaluation of ocular inflammation, eyelid retraction, and eye movement disorder. Front. Cell Dev. Biol., 13.","DOI":"10.3389\/fcell.2025.1609231"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"109507","DOI":"10.1016\/j.compbiomed.2024.109507","article-title":"A review of convolutional neural network based methods for medical image classification","volume":"185","author":"Chen","year":"2025","journal-title":"Comput. Biol. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1007\/s10278-024-00981-7","article-title":"From CNN to Transformer: A Review of Medical Image Segmentation Models","volume":"37","author":"Yao","year":"2024","journal-title":"J. Imaging Inform. Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e18750362370697","DOI":"10.2174\/0118750362370697250630063814","article-title":"A Review of Deep Learning-based Multi-modal Medical Image Fusion","volume":"18","author":"Shailesh","year":"2025","journal-title":"Open Bioinform. J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1038\/s41746-023-00811-0","article-title":"Self-supervised learning for medical image classification: A systematic review and implementation guidelines","volume":"6","author":"Anuj","year":"2023","journal-title":"npj Digit. Med."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ansari, Y., Mourad, O., Qaraqe, K., and Serpedin, E. (2023). Deep learning for ECG Arrhythmia detection and classification: An overview of progress for period 2017\u20132023. Front. Physiol., 14.","DOI":"10.3389\/fphys.2023.1246746"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"13604","DOI":"10.1038\/s41598-023-40219-0","article-title":"Breast cancer histopathology image-based gene expression prediction using spatial transcriptomics data and deep learning","volume":"13","author":"Rahaman","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"74","DOI":"10.3991\/ijoe.v20i01.45247","article-title":"Classification of Diabetic Retinopathy by Deep Learning","volume":"20","author":"Hsairi","year":"2024","journal-title":"Int. J. Online Biomed. Eng. (iJOE)"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1007\/s10462-024-11033-5","article-title":"Edge deep learning in computer vision and medical diagnostics: A comprehensive survey","volume":"58","author":"Xu","year":"2025","journal-title":"Artif. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, S., Ren, J., and Guo, X. (2024). A high-accuracy lightweight network model for X-ray image diagnosis: A case study of COVID detection. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0303049"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2539079","DOI":"10.1080\/21681163.2025.2539079","article-title":"Enhancing diabetic retinopathy classification accuracy through dual-attention mechanism in deep learning","volume":"13","author":"Hannan","year":"2025","journal-title":"Comput. Methods Biomech. Biomed. Eng. Imaging Vis."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhang, P., Xu, Q., and Jiang, F. (2025). The diagnostic value of convolutional neural networks in thyroid cancer detection using ultrasound images. Front. Oncol., 15.","DOI":"10.3389\/fonc.2025.1534228"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"100894","DOI":"10.1016\/j.prime.2025.100894","article-title":"Enhancing thyroid nodule assessment with deep learning and ultrasound imaging","volume":"11","author":"Jatinder","year":"2025","journal-title":"Adv. Electr. Eng. Electron. Energy"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chiaw-Ling, C., Kaiping, Z., Ann, K.K., Ming-Han, H.L., Daniel, T., Chen, P.W., Guoyu, H., Beng, C.O., and Si, W.K. (2023). Application of artificial intelligence in the assessment of thyroid eye disease (TED)\u2014A scoping review. Front. Endocrinol., 14.","DOI":"10.3389\/fendo.2023.1300196"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ing, E., and Bondok, M. (2025). Oculoplastics and Augmented Intelligence: A Literature Review. J. Clin. Med., 14.","DOI":"10.3390\/jcm14196875"},{"key":"ref_20","unstructured":"Irsyad, A., Tengyue, Z., Shrayes, R., Zhuyu, Q., Brandon, T., Hexiang, F., Sile, W., Ashwath, R., Shreeram, A., and Vedrana, I. (2025). STACT-Time: Spatio-Temporal Cross Attention for Cine Thyroid Ultrasound Time Series Classification. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chen, W., Ni, X., Qian, C., Yang, L., Zhang, Z., Li, M., Kong, F., Huang, M., He, M., and Yin, Y. (2024). The value of a neural network based on multi-scale feature fusion to ultrasound images for the differentiation in thyroid follicular neoplasms. BMC Med. Imaging, 24.","DOI":"10.1186\/s12880-024-01244-1"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1007\/s12020-024-04091-w","article-title":"Deep learning based analysis of dynamic video ultrasonography for predicting cervical lymph node metastasis in papillary thyroid carcinoma","volume":"87","author":"Qian","year":"2025","journal-title":"Endocrine"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e18750362305982","DOI":"10.2174\/0118750362305982240627034926","article-title":"A Comparative Study on Thyroid Nodule Classification using Transfer Learning Methods","volume":"17","author":"Vidhushavarshini","year":"2024","journal-title":"Open Bioinform. J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e38579","DOI":"10.1016\/j.heliyon.2024.e38579","article-title":"An integrated global and local thresholding method for segmenting blood vessels in angiography","volume":"10","author":"Zhang","year":"2024","journal-title":"Heliyon"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Savelonas, M. (2025). An Overview of AI-Guided Thyroid Ultrasound Image Segmentation and Classification for Nodule Assessment. Big Data Cogn. Comput., 9.","DOI":"10.3390\/bdcc9100255"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kant, V., and Jagadish, S. (2025, January 9\u201311). Thyroid Disease Detection Through EfficientNetB2: Enhancing Early Diagnosis with Deep Learning. Proceedings of the OPJU International Technology Conference (OTCON) on Smart Computing for Innovation and Advancement in Industry 5.0, Raigarh, India.","DOI":"10.1109\/OTCON65728.2025.11070475"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Venkatesan, D., Krishnamoorthi, N., and Mahadevan, S. (2023, January 23\u201325). Study on Hyperthyroidism using Thermal Image Analysis. Proceedings of the IEEE International Conference on Intelligent Technologies (CONIT), Hubli, India.","DOI":"10.1109\/CONIT59222.2023.10205811"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Flora, G.D., and Venkataramanan, C. (2025, January 23\u201325). Intelligent Classification System for Thyroid Disease Diagnosis using Medical Imaging Data with Extreme Learning Machine. Proceedings of the IEEE International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.","DOI":"10.1109\/ICCMC65190.2025.11140684"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Anitha, M., Keerthana, R., Regunath, E., and Hariram, R. (2025, January 12\u201314). Smart Thyroid: A Deep Learning-Driven SVM Model for Thyroid Diagnosis. Proceedings of the IEEE International Conference on Intelligent Sustainable Systems (ICISS), Tirunelveli, India.","DOI":"10.1109\/ICISS63372.2025.11076246"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 7\u201313). Deep Learning Face Attributes in the Wild. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.425"}],"container-title":["Biomimetics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-7673\/11\/3\/210\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T09:25:21Z","timestamp":1773653121000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-7673\/11\/3\/210"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,15]]},"references-count":30,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["biomimetics11030210"],"URL":"https:\/\/doi.org\/10.3390\/biomimetics11030210","relation":{},"ISSN":["2313-7673"],"issn-type":[{"value":"2313-7673","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,15]]}}}