{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,26]],"date-time":"2026-09-26T06:31:52Z","timestamp":1790404312493,"version":"4.1.0"},"reference-count":40,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T00:00:00Z","timestamp":1694736000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>The present study was conducted to investigate the potential of radiomics to develop an explainable AI-based system to be applied to ultra-widefield fundus retinographies (UWF-FRTs) with the objective of predicting the presence of the early signs of Age-related Macular Degeneration (AMD) and stratifying subjects with low- versus high-risk of AMD. The ultimate aim was to provide clinicians with an automatic classifier and a signature of objective quantitative image biomarkers of AMD. The use of Machine Learning (ML) and radiomics was based on intensity and texture analysis in the macular region, detected by a Deep Learning (DL)-based macular detector. Two-hundred and twenty six UWF-FRTs were retrospectively collected from two centres and manually annotated to train and test the algorithms. Notably, the combination of the ML-based radiomics model and the DL-based macular detector reported 93% sensitivity and 74% specificity when applied to the data of the centre used for external testing, capturing explainable features associated with drusen or pigmentary abnormalities. In comparison to the human operator\u2019s annotations, the system yielded a 0.79 Cohen \u03ba, demonstrating substantial concordance. To our knowledge, these results are the first provided by a radiomic approach for AMD supporting the suitability of an explainable feature extraction method combined with ML for UWF-FRT.<\/jats:p>","DOI":"10.3390\/diagnostics13182965","type":"journal-article","created":{"date-parts":[[2023,9,17]],"date-time":"2023-09-17T23:25:26Z","timestamp":1694993126000},"page":"2965","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Radiomic-Based Machine Learning System to Diagnose Age-Related Macular Degeneration from Ultra-Widefield Fundus Retinography"],"prefix":"10.3390","volume":"13","author":[{"given":"Matteo","family":"Interlenghi","sequence":"first","affiliation":[{"name":"DeepTrace Technologies S.R.L., 20122 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7271-0536","authenticated-orcid":false,"given":"Giancarlo","family":"Sborgia","sequence":"additional","affiliation":[{"name":"Department of Medical Science, Neuroscience and Sense Organs, Eye Clinic, University of Bari Aldo Moro, 70121 Bari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alessandro","family":"Venturi","sequence":"additional","affiliation":[{"name":"DeepTrace Technologies S.R.L., 20122 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1383-1850","authenticated-orcid":false,"given":"Rodolfo","family":"Sardone","sequence":"additional","affiliation":[{"name":"National Institute of Gastroenterology\u2014IRCCS \u201cSaverio de Bellis\u201d, 70013 Castellana Grotte, Italy"},{"name":"Unit of Statistics and Epidemiology, Local Healthcare Authority of Taranto, 74121 Taranto, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentina","family":"Pastore","sequence":"additional","affiliation":[{"name":"Department of Medical Science, Neuroscience and Sense Organs, Eye Clinic, University of Bari Aldo Moro, 70121 Bari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8768-899X","authenticated-orcid":false,"given":"Giacomo","family":"Boscia","sequence":"additional","affiliation":[{"name":"Department of Medical Science, Neuroscience and Sense Organs, Eye Clinic, University of Bari Aldo Moro, 70121 Bari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3016-3620","authenticated-orcid":false,"given":"Luca","family":"Landini","sequence":"additional","affiliation":[{"name":"Department of Medical Science, Neuroscience and Sense Organs, Eye Clinic, University of Bari Aldo Moro, 70121 Bari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1904-1262","authenticated-orcid":false,"given":"Giacomo","family":"Scotti","sequence":"additional","affiliation":[{"name":"Department of Medical Science, Neuroscience and Sense Organs, Eye Clinic, University of Bari Aldo Moro, 70121 Bari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7951-3591","authenticated-orcid":false,"given":"Alfredo","family":"Niro","sequence":"additional","affiliation":[{"name":"Eye Clinic, Hospital \u201cSS. Annunziata\u201d, ASL Taranto, 74121 Taranto, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Federico","family":"Moscara","sequence":"additional","affiliation":[{"name":"Department of Medical Science, Neuroscience and Sense Organs, Eye Clinic, University of Bari Aldo Moro, 70121 Bari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luca","family":"Bandi","sequence":"additional","affiliation":[{"name":"DeepTrace Technologies S.R.L., 20122 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9312-4675","authenticated-orcid":false,"given":"Christian","family":"Salvatore","sequence":"additional","affiliation":[{"name":"DeepTrace Technologies S.R.L., 20122 Milan, Italy"},{"name":"Department of Science, Technology and Society, University School for Advanced Studies IUSS Pavia, 27100 Pavia, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7191-5417","authenticated-orcid":false,"given":"Isabella","family":"Castiglioni","sequence":"additional","affiliation":[{"name":"Department of Physics \u201cGiuseppe Occhialini\u201d, University of Milan-Bicocca, 20126 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1001\/archopht.122.4.564","article-title":"Prevalence of age-related macular degeneration in the United States","volume":"122","author":"Friedman","year":"2004","journal-title":"Arch. Ophthalmol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1519","DOI":"10.1016\/S0161-6420(93)31466-1","article-title":"Age-related macular degeneration histopathologic studies. The 1992 Lorenz E. Zimmerman Lecture","volume":"100","author":"Green","year":"1993","journal-title":"Ophthalmology"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1016\/j.ophtha.2019.11.004","article-title":"Consensus Nomenclature for Reporting Neovascular Age-Related Macular Degeneration Data","volume":"127","author":"Spaide","year":"2020","journal-title":"Ophthalmology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"838","DOI":"10.1002\/phar.1264","article-title":"Age-Related Macular Degeneration","volume":"33","author":"Cheung","year":"2013","journal-title":"Pharmacotherapy"},{"key":"ref_5","first-page":"74","article-title":"Age-Related Macular Degeneration","volume":"59","author":"Gheorghe","year":"2015","journal-title":"Rom. J. Ophthalmol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/S0002-9394(01)01237-5","article-title":"Verteporfin therapy of subfoveal choroidal neovascularization in age-related macular degeneration: Two-year results of a randomized clinical trial including lesions with occult with no classic choroidal neovascularization-verteporfin in photodynamic therapy report 2","volume":"133","author":"Bressler","year":"2002","journal-title":"Am. J. Ophthalmol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Macular Photocoagulation Study Group (1993). Laser Photocoagulation of Subfoveal Neovascular Lesions of Age-Related Macular Degeneration: Updated Findings From Two Clinical Trials. Arch. Ophthalmol., 111, 1200\u20131209.","DOI":"10.1001\/archopht.1993.01090090052019"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.1056\/NEJMoa054481","article-title":"Ranibizumab for Neovascular Age-Related Macular Degeneration","volume":"355","author":"Rosenfeld","year":"2006","journal-title":"N. Engl. J. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.ophtha.2019.04.017","article-title":"HAWK and HARRIER: Phase 3, Multicenter, Randomized, Double-Masked Trials of Brolucizumab for Neovascular Age-Related Macular Degeneration","volume":"127","author":"Dugel","year":"2020","journal-title":"Ophthalmology"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"100076","DOI":"10.1016\/j.xops.2021.100076","article-title":"TENAYA and LUCERNE","volume":"1","author":"Khanani","year":"2021","journal-title":"Ophthalmol. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lucente, A., Taloni, A., Scorcia, V., and Giannaccare, G. (2023). Widefield and Ultra-Widefield Retinal Imaging: A Geometrical Analysis. Life, 13.","DOI":"10.3390\/life13010202"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1016\/j.oret.2019.05.007","article-title":"Classification and Guidelines for Widefield Imaging","volume":"3","author":"Choudhry","year":"2019","journal-title":"Ophthalmol. Retin."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"710329","DOI":"10.3389\/fmed.2021.710329","article-title":"The Impact of Artificial Intelligence and Deep Learning in Eye Diseases: A Review","volume":"8","author":"Nuzzi","year":"2021","journal-title":"Front. Med."},{"key":"ref_14","first-page":"264","article-title":"Promising Artificial Intelligence-Machine Learning-Deep Learning Algorithms in Ophthalmology","volume":"8","author":"Balyen","year":"2019","journal-title":"Asia-Pacific J. Ophthalmol. (Phila.)"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1613\/jair.1.13200","article-title":"Explainable Deep Learning: A Field Guide for the Uninitiated","volume":"73","author":"Ras","year":"2022","journal-title":"J. Artif. Intell. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 12). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_17","unstructured":"Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2023, August 29). Densely Connected Convolutional Networks. Available online: http:\/\/arxiv.org\/abs\/1608.06993."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"838","DOI":"10.1016\/j.ygyno.2021.04.004","article-title":"Using rADioMIcs and machine learning with ultrasonography for the differential diagnosis of myometRiAL tumors (the ADMIRAL pilot study). Radiomics and differential diagnosis of myometrial tumors","volume":"161","author":"Chiappa","year":"2021","journal-title":"Gynecol. Oncol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1007\/s40477-020-00503-5","article-title":"The Adoption of Radiomics and machine learning improves the diagnostic processes of women with Ovarian MAsses (the AROMA pilot study)","volume":"24","author":"Chiappa","year":"2021","journal-title":"J. Ultrasound"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. YOLO9000: Better, Faster, Stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21\u201326 July 2017.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 20\u201325 June 2009.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2307\/1932409","article-title":"Measures of the Amount of Ecologic Association Between Species","volume":"26","author":"Dice","year":"1945","journal-title":"Ecology"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A Coefficient of Agreement for Nominal Scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1148\/radiol.2020191145","article-title":"Image biomarker standardisation initiative","volume":"295","author":"Zwanenburg","year":"2020","journal-title":"Radiology"},{"key":"ref_25","unstructured":"(2023, January 09). Trace4\u2014Technical Sheet. Available online: http:\/\/www.deeptracetech.com\/files\/TechnicalSheet__TRACE4.pdf."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1037\/0033-2909.86.2.420","article-title":"Intraclass correlations: Uses in assessing rater reliability","volume":"86","author":"Shrout","year":"1979","journal-title":"Psychol. Bull."},{"key":"ref_27","unstructured":"He, H., Bai, Y., Garcia, E.A., and Li, S. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, China, 1\u20138 June 2008."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1016\/S0031-3203(96)00142-2","article-title":"The use of the area under the ROC curve in the evaluation of machine learning algorithms","volume":"30","author":"Bradley","year":"1997","journal-title":"Pattern Recognit."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1214\/aoms\/1177730491","article-title":"On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other","volume":"18","author":"Mann","year":"1947","journal-title":"Ann. Math. Stat."},{"key":"ref_30","unstructured":"Bonferroni, C.E. (1936). Teoria Statistica Delle Classi e Calcolo Delle Probabilit\u00e0, Seeber."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1269","DOI":"10.1007\/s10792-018-0940-0","article-title":"Accuracy of ultra-wide-field fundus ophthalmoscopy-assisted deep learning, a machine-learning technology, for detecting age-related macular degeneration","volume":"39","author":"Matsuba","year":"2018","journal-title":"Int. Ophthalmol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1111\/ceo.13575","article-title":"Development and validation of a deep-learning algorithm for the detection of neovascular age-related macular degeneration from colour fundus photographs","volume":"47","author":"Keel","year":"2019","journal-title":"Clin. Exp. Ophthalmol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1007\/s00417-017-3850-3","article-title":"Automated detection of exudative age-related macular degeneration in spectral domain optical coherence tomography using deep learning","volume":"256","author":"Treder","year":"2018","journal-title":"Graefe\u2019s Arch. Clin. Exp. Ophthalmol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1001\/jamaophthalmol.2017.3782","article-title":"Automated Grading of Age-Related Macular Degeneration From Color Fundus Images Using Deep Convolutional Neural Networks","volume":"135","author":"Burlina","year":"2017","journal-title":"JAMA Ophthalmol"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1264","DOI":"10.1109\/21.44046","article-title":"Textural features corresponding to textural properties","volume":"19","author":"Amadasun","year":"1989","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1159\/000358536","article-title":"Age-Related Macular Degeneration: Clinical Findings, Histopathology and Imaging Techniques","volume":"53","author":"Zarbin","year":"2014","journal-title":"Dev. Ophthalmol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"92776","DOI":"10.1109\/ACCESS.2021.3093358","article-title":"Automatic Diabetic Foot Prediction Through Fundus Images by Radiomics Features","volume":"9","author":"Liang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1186\/s12967-021-02818-1","article-title":"Automatic identification of myopic maculopathy related imaging features in optic disc region via machine learning methods","volume":"19","author":"Du","year":"2021","journal-title":"J. Transl. Med."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Baumal, C.R. (2018). Current Management of Diabetic Retinopathy, Elsevier.","DOI":"10.1016\/B978-0-323-48452-7.00004-4"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3737","DOI":"10.1007\/s00417-022-05741-3","article-title":"Deep learning for ultra-widefield imaging: A scoping review","volume":"260","author":"Bhambra","year":"2022","journal-title":"Graefe\u2019s Arch. Clin. Exp. Ophthalmol."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/18\/2965\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:51:59Z","timestamp":1760129519000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/18\/2965"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,15]]},"references-count":40,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["diagnostics13182965"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics13182965","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,15]]}}}