{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T17:35:51Z","timestamp":1793900151025,"version":"4.8.0"},"reference-count":33,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T00:00:00Z","timestamp":1712016000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Endocrinol."],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Thyroid-associated ophthalmopathy (TAO) is the most prevalent autoimmune orbital condition, significantly impacting patients\u2019 appearance and quality of life. Early and accurate identification of active TAO along with timely treatment can enhance prognosis and reduce the occurrence of severe cases. Although the Clinical Activity Score (CAS) serves as an effective assessment system for TAO, it is susceptible to assessor experience bias. This study aimed to develop an ensemble deep learning system that combines anterior segment slit-lamp photographs of patients with facial images to simulate expert assessment of TAO.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method<\/jats:title>\n                    <jats:p>The study included 156 patients with TAO who underwent detailed diagnosis and treatment at Shanxi Eye Hospital Affiliated to Shanxi Medical University from May 2020 to September 2023. Anterior segment slit-lamp photographs and facial images were used as different modalities and analyzed from multiple perspectives. Two ophthalmologists with more than 10 years of clinical experience independently determined the reference CAS for each image. An ensemble deep learning model based on the residual network was constructed under supervised learning to predict five key inflammatory signs (redness of the eyelids and conjunctiva, and swelling of the eyelids, conjunctiva, and caruncle or plica) associated with TAO, and to integrate these objective signs with two subjective symptoms (spontaneous retrobulbar pain and pain on attempted upward or downward gaze) in order to assess TAO activity.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The proposed model achieved 0.906 accuracy, 0.833 specificity, 0.906 precision, 0.906 recall, and 0.906 F1-score in active TAO diagnosis, demonstrating advanced performance in predicting CAS and TAO activity signs compared to conventional single-view unimodal approaches. The integration of multiple views and modalities, encompassing both anterior segment slit-lamp photographs and facial images, significantly improved the prediction accuracy of the model for TAO activity and CAS.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The ensemble multi-view multimodal deep learning system developed in this study can more accurately assess the clinical activity of TAO than traditional methods that solely rely on facial images. This innovative approach is intended to enhance the efficiency of TAO activity assessment, providing a novel means for its comprehensive, early, and precise evaluation.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fendo.2024.1365350","type":"journal-article","created":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T04:46:14Z","timestamp":1712033174000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["An ensemble deep learning diagnostic system for determining Clinical Activity Scores in thyroid-associated ophthalmopathy: integrating multi-view multimodal images from anterior segment slit-lamp photographs and facial images"],"prefix":"10.3389","volume":"15","author":[{"given":"Chunfang","family":"Yan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaoxia","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanghua","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Han","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruiqi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guiqin","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Rao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weihua","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,4,2]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.3389\/fendo.2020.615993","article-title":"Epidemiology, natural history, risk factors, and prevention of graves\u2019 orbitopathy","volume":"11","author":"Bartalena","year":"2020","journal-title":"Front Endocrinol"},{"key":"B2","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1186\/s12886-023-02805-8","article-title":"A clinical study of topical treatment for thyroid-associated ophthalmopathy with dry eye syndrome","volume":"23","author":"Sun","year":"2023","journal-title":"BMC Ophthalmol"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1530\/eje-21-0479","article-title":"The 2021 european group on graves\u2019 orbitopathy (eugogo) clinical practice guidelines for the medical management of graves\u2019 orbitopathy","volume":"185","author":"Bartalena","year":"2021","journal-title":"Eur J Endocrinol"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.3389\/fendo.2022.900204","article-title":"Treating thyroid associated ophthalmopathy in pediatric patients","volume":"13","author":"Dong","year":"2022","journal-title":"Front Endocrinol"},{"key":"B5","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1136\/bjo.73.8.639","article-title":"Clinical criteria for the assessment of disease activity in graves\u2019 ophthalmopathy: a novel approach","volume":"73","author":"Mourits","year":"1989","journal-title":"Br J Ophthalmol"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2007.0315","article-title":"Consensus statement of the european group on graves\u2019 orbitopathy (eugogo) on management of graves\u2019 orbitopathy","volume":"18","author":"Bartalena","year":"2008","journal-title":"Thyroid"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12902-018-0240-8","article-title":"A single-center retrospective study of factors related to the effects of intravenous glucocorticoid therapy in moderate-to-severe and active thyroid-associated ophthalmopathy","volume":"18","author":"Wang","year":"2018","journal-title":"BMC Endocrine Disord"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1001\/jamaophthalmol.2020.3442","article-title":"Outcomes of adversarial attacks on deep learning models for ophthalmology imaging domains","volume":"138","author":"Yoo","year":"2020","journal-title":"JAMA Ophthalmol"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1016\/j.survophthal.2021.03.003","article-title":"Artificial intelligence: the unstoppable revolution in ophthalmology","volume":"67","author":"Benet","year":"2022","journal-title":"Survey Ophthalmol"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1386","DOI":"10.18240\/ijo.2023.09.04","article-title":"Artificial intelligence assisted pterygium diagnosis: current status and perspectives","volume":"16","author":"Chen","year":"2023","journal-title":"Int J Ophthalmol"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.3389\/fendo.2023.1244601","article-title":"Development and evaluation of a risk prediction model for diabetes mellitus type 2 patients with vision-threatening diabetic retinopathy","volume":"14","author":"Gong","year":"2023","journal-title":"Front Endocrinol"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2022.920716","article-title":"An intelligent diagnostic system for thyroid-associated ophthalmopathy based on facial images","volume":"9","author":"Huang","year":"2022","journal-title":"Front Med"},{"key":"B13","doi-asserted-by":"publisher","first-page":"22085","DOI":"10.1038\/s41598-022-25887-8","article-title":"Machine learning-assisted system using digital facial images to predict the clinical activity score in thyroid-associated orbitopathy","volume":"12","author":"Moon","year":"2022","journal-title":"Sci Rep"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1136\/bjo-2022-321833","article-title":"Ensemble neural network model for detecting thyroid eye disease using external photographs","volume":"107","author":"Karlin","year":"2023","journal-title":"Br J Ophthalmol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1097\/IOP.0000000000002517","article-title":"Kinematics of the upper eyelid and the globe during downward excursion with comparative analysis in patients with thyroid eye disease","volume":"40","author":"Abboud","year":"2023","journal-title":"Ophthalmic Plast Reconstructive Surg"},{"key":"B16","doi-asserted-by":"publisher","first-page":"2291","DOI":"10.1007\/s10792-022-02625-7","article-title":"Nonsurgical treatment for upper eyelid retraction in patients with inactive graves\u2019 orbitopathy","volume":"43","author":"Vokurka Topljak","year":"2023","journal-title":"Int Ophthalmol"},{"key":"B17","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1097\/ICO.0000000000003318","article-title":"Automatic classification of slit-lamp photographs by imaging illumination","volume":"43","author":"Lu","year":"2024","journal-title":"Cornea"},{"key":"B18","doi-asserted-by":"publisher","first-page":"17851","DOI":"10.1016\/j.media.2020.101798","article-title":"Deep learning for identifying corneal diseases from ocular surface slit-lamp photographs","volume":"10","author":"Gu","year":"2020","journal-title":"Scientific Reports"},{"key":"B19","doi-asserted-by":"publisher","first-page":"106048","DOI":"10.1016\/j.cmpb.2021.106048","article-title":"Development of a deep learning-based image quality control system to detect and filter out ineligible slit-lamp images: a multicenter study","volume":"203","author":"Li","year":"2021","journal-title":"Computer Methods and Programs in Biomedicine"},{"key":"B20","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1046\/j.1365-2265.1997.2331047.x","article-title":"Clinical activity score as a guide in the management of patients with graves\u2019 ophthalmopathy","volume":"47","author":"Mourits","year":"1997","journal-title":"Clin Endocrinol"},{"key":"B21","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2016.91","article-title":"You only look once: Unified, real-time object detection","author":"Redmon","year":"2016"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2004.10934","article-title":"Yolov4: Optimal speed and accuracy of object detection","author":"Bochkovskiy","year":"2020","journal-title":"arXiv preprint arXiv"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729392","article-title":"Stochastic estimation of the maximum of a regression function","volume":"23","author":"Kiefer","year":"1952","journal-title":"Ann Math Stat"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.48550\/arXiv.1412.6980","article-title":"Adam: A method for stochastic optimization","author":"Kingma","year":"2014","journal-title":"Proc. 3rd Int. Conf. Learn. Representations"},{"key":"B25","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","author":"He","year":"2016"},{"key":"B26","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1002\/bltj.1948.27.issue-3","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell System Tech J"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2008.0014","article-title":"Pediatric thyroid\u2013associated orbitopathy: the children\u2019s hospital of philadelphia experience and literature review","volume":"18","author":"Goldstein","year":"2008","journal-title":"Thyroid"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecl.2009.01.004","article-title":"Thyroid-associated orbitopathy: who and how to treat","volume":"38","author":"Dickinson","year":"2009","journal-title":"Endocrinol Metab Clinics North America"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2015\/678194","article-title":"Thyroid stimulating but not blocking autoantibodies are highly prevalent in severe and active thyroid-associated orbitopathy: a prospective study","volume":"2015","author":"Kampmann","year":"2015","journal-title":"Int J Endocrinol"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1007\/s00417-022-05760-0","article-title":"Ocular hypertension in patients with active thyroid-associated orbitopathy: a predictor of disease severity, particularly of extraocular muscle enlargement","volume":"260","author":"Karhanov\u00e1","year":"2022","journal-title":"Graefe\u2019s Arch Clin Exp Ophthalmol"},{"key":"B31","doi-asserted-by":"crossref","DOI":"10.1109\/EMBC44109.2020.9175664","article-title":"Explainable diabetic retinopathy using efficientnet","author":"Chetoui","year":"2020"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1361","DOI":"10.18240\/ijo.2023.09.02","article-title":"Guidelines on clinical research evaluation of artificial intelligence in ophthalmology, (2023)","volume":"16","author":"Yang","year":"2023","journal-title":"Int J Ophthalmol"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1093\/clinchem\/39.4.561","article-title":"Receiver-operating characteristic (roc) plots: a fundamental evaluation tool in clinical medicine","volume":"39","author":"Zweig","year":"1993","journal-title":"Clin Chem"}],"container-title":["Frontiers in Endocrinology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2024.1365350\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T04:46:17Z","timestamp":1712033177000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2024.1365350\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,2]]},"references-count":33,"alternative-id":["10.3389\/fendo.2024.1365350"],"URL":"https:\/\/doi.org\/10.3389\/fendo.2024.1365350","relation":{},"ISSN":["1664-2392"],"issn-type":[{"value":"1664-2392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,2]]},"article-number":"1365350"}}