{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T20:06:39Z","timestamp":1785269199158,"version":"3.55.0"},"reference-count":27,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2020,8,6]],"date-time":"2020-08-06T00:00:00Z","timestamp":1596672000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MR\/P027881\/1"],"award-info":[{"award-number":["MR\/P027881\/1"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Reliable outcome measures are required for clinical trials investigating novel agents for preventing progression of capillary non-perfusion (CNP) in retinal vascular diseases. Currently, accurate quantification of topographical distribution of CNP on ultrawide field fluorescein angiography (UWF-FA) by retinal experts is subjective and lack standardisation. A U-net style network was trained to extract a dense segmentation of CNP from a newly created dataset of 75 UWF-FA images. A subset of 20 images was also segmented by a second expert grader for inter-grader reliability evaluation. Further, a circular grid centred on the FAZ was used to provide standardised CNP distribution analysis. The model for dense segmentation was five-fold cross-validated achieving area under the receiving operating characteristic of 0.82 (0.03) and area under precision-recall curve 0.73 (0.05). Inter-grader assessment on the 20 image subset achieves: precision 59.34 (10.92), recall 76.99 (12.5), and dice similarity coefficient (DSC) 65.51 (4.91), and the centred operating point of the automated model reached: precision 64.41 (13.66), recall 70.02 (16.2), and DSC 66.09 (13.32). Agreement of CNP grid assessment reached: Kappa 0.55 (0.03), perfused intraclass correlation (ICC) 0.89 (0.77, 0.93), non-perfused ICC 0.86 (0.73, 0.92), inter-grader agreement of CNP grid assessment values are Kappa 0.43 (0.03), perfused ICC 0.70 (0.48, 0.83), non-perfused ICC 0.71 (0.48, 0.83). Automated dense segmentation of CNP in UWF-FA images achieves performance levels comparable to inter-grader agreement values. A grid placed on the deep learning-based automatic segmentation of CNP generates a reliable and quantifiable method of measurement of CNP, to overcome the subjectivity of human graders.<\/jats:p>","DOI":"10.3390\/jcm9082537","type":"journal-article","created":{"date-parts":[[2020,8,6]],"date-time":"2020-08-06T09:41:21Z","timestamp":1596706881000},"page":"2537","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Deep Learning-Based Segmentation and Quantification of Retinal Capillary Non-Perfusion on Ultra-Wide-Field Retinal Fluorescein Angiography"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8268-5389","authenticated-orcid":false,"given":"Joan M.","family":"Nunez do Rio","sequence":"first","affiliation":[{"name":"Institute of Ophthalmology, University College London, London EC1V 9EL, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1885-4624","authenticated-orcid":false,"given":"Piyali","family":"Sen","sequence":"additional","affiliation":[{"name":"Institute of Ophthalmology, University College London, London EC1V 9EL, UK"},{"name":"NIHR Moorfields Biomedical Research Centre, Moorfields Eye Hospital, London EC1V 2PD, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rajna","family":"Rasheed","sequence":"additional","affiliation":[{"name":"Institute of Ophthalmology, University College London, London EC1V 9EL, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Akanksha","family":"Bagchi","sequence":"additional","affiliation":[{"name":"NIHR Moorfields Biomedical Research Centre, Moorfields Eye Hospital, London EC1V 2PD, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6685-4402","authenticated-orcid":false,"given":"Luke","family":"Nicholson","sequence":"additional","affiliation":[{"name":"Institute of Ophthalmology, University College London, London EC1V 9EL, UK"},{"name":"NIHR Moorfields Biomedical Research Centre, Moorfields Eye Hospital, London EC1V 2PD, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5108-2179","authenticated-orcid":false,"given":"Adam M.","family":"Dubis","sequence":"additional","affiliation":[{"name":"Institute of Ophthalmology, University College London, London EC1V 9EL, UK"},{"name":"NIHR Moorfields Biomedical Research Centre, Moorfields Eye Hospital, London EC1V 2PD, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9152-3194","authenticated-orcid":false,"given":"Christos","family":"Bergeles","sequence":"additional","affiliation":[{"name":"King\u2019s College London, School of Biomedical Engineering &amp; Imaging Sciences, London SE1 7EU, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8952-0659","authenticated-orcid":false,"given":"Sobha","family":"Sivaprasad","sequence":"additional","affiliation":[{"name":"Institute of Ophthalmology, University College London, London EC1V 9EL, UK"},{"name":"NIHR Moorfields Biomedical Research Centre, Moorfields Eye Hospital, London EC1V 2PD, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"556","DOI":"10.2337\/dc11-1909","article-title":"Global Prevalence and Major Risk Factors of Diabetic Retinopathy","volume":"35","author":"Yau","year":"2012","journal-title":"Diabetes Care"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1001\/archophthalmol.2010.193","article-title":"Standard Care vs Corticosteroid for Retinal Vein Occlusion (SCORE) Study System for Evaluation of Stereoscopic Color Fundus Photographs and Fluorescein Angiograms: SCORE Study Report 9","volume":"128","author":"Blodi","year":"2010","journal-title":"Arch. Ophthalmol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1016\/j.ajo.2015.09.003","article-title":"Validation of Concentric Rings Method as a Topographic Measure of Retinal Nonperfusion in Ultra-Widefield Fluorescein Angiography","volume":"160","author":"Nicholson","year":"2015","journal-title":"Am. J. Ophthalmol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2211","DOI":"10.1001\/jama.2017.18152","article-title":"Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images from Multiethnic Populations with Diabetes","volume":"318","author":"Ting","year":"2017","journal-title":"JAMA"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2402","DOI":"10.1001\/jama.2016.17216","article-title":"Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs","volume":"316","author":"Gulshan","year":"2016","journal-title":"JAMA"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1182","DOI":"10.1001\/jamaophthalmol.2019.2923","article-title":"Diagnostic Accuracy of Community-Based Diabetic Retinopathy Screening with an Offline Artificial Intelligence System on a Smartphone","volume":"137","author":"Natarajan","year":"2019","journal-title":"JAMA Ophthalmol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1342","DOI":"10.1038\/s41591-018-0107-6","article-title":"Clinically Applicable Deep Learning for Diagnosis and Referral in Retinal Disease","volume":"24","author":"Ledsam","year":"2018","journal-title":"Nat. Med."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jasiobedzki, P., McLeod, D., and Taylor, C.J. (1991). Detection of Non-Perfused Zones in Retinal Images. Computer-Based Medical Systems-Proceedings of the Fourth Annual IEEE Symposium. IEEE Computer Society, IEEE.","DOI":"10.1109\/CBMS.1991.128960"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Buchanan, C.R., and Trucco, E. (2008, January 20). Contextual Detection of Diabetic Pathology in Wide-Field Retinal Angiograms. Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada.","DOI":"10.1109\/IEMBS.2008.4650444"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sivaswamy, J., Agarwal, A., Chawla, M., Rani, A., and Das, T. (2008, January 28\u201331). Extraction of Capillary Non-Perfusion from Fundus Fluorescein Angiogram. Proceedings of the International Joint Conference on Biomedical Engineering Systems and Technologies, Funchal, Madeira, Portugal.","DOI":"10.1007\/978-3-540-92219-3_13"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"183","DOI":"10.15171\/bi.2015.27","article-title":"Detection of Retinal Capillary Nonperfusion in Fundus Fluorescein Angiogram of Diabetic Retinopathy","volume":"5","author":"Rasta","year":"2015","journal-title":"BioImpacts BI"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zheng, Y., Kwong, M.T., MacCormick, I.J.C., Beare, N.A.V., and Harding, S.P. (2014). A Comprehensive Texture Segmentation Framework for Segmentation of Capillary Non-Perfusion Regions in Fundus Fluorescein Angiograms. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0093624"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2193","DOI":"10.1016\/S0140-6736(17)31193-5","article-title":"Clinical Efficacy of Intravitreal Aflibercept versus Panretinal Photocoagulation for Best Corrected Visual Acuity in Patients with Proliferative Diabetic Retinopathy at 52 Weeks (CLARITY): A Multicentre, Single-Blinded, Randomised, Controlled, Phase 2b, N","volume":"389","author":"Sivaprasad","year":"2017","journal-title":"Lancet"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1038\/s41433-019-0342-1","article-title":"Randomised Trial of Wide-Field Guided PRP for Diabetic Macular Oedema Treated with Ranibizumab","volume":"33","author":"Talks","year":"2019","journal-title":"Eye"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1159\/000501372","article-title":"ETDRS Grading of Diabetic Retinopathy: Still the Gold Standard?","volume":"62","author":"Solomon","year":"2019","journal-title":"Ophthalmic Res."},{"key":"ref_16","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. Convolutional Networks for Biomedical Image Segmentation. Paper Presented at the International Conference on Medical Image Computing and Computer-Assisted Intervention."},{"key":"ref_17","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_18","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). Tensorflow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv."},{"key":"ref_19","unstructured":"Sutskever, I., Martens, J., Dahl, G., and Hinton, G. (2013, January 17\u201319). On the Importance of Initialization and Momentum in Deep Learning. Proceedings of the International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sudre, C.H., Li, W., Vercauteren, T., Ourselin, S., and Cardoso, M.J. (2017). Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Springer.","DOI":"10.1007\/978-3-319-67558-9_28"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater Reliability: The Kappa Statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Med."},{"key":"ref_22","first-page":"360","article-title":"Understanding Interobserver Agreement: The Kappa Statistic","volume":"37","author":"Viera","year":"2005","journal-title":"Fam. Med."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Early Treatment Diabetic Retinopathy Study Research Group (1991). Classification of Diabetic Retinopathy from Fluorescein Angiograms: ETDRS Report Number 11. Ophthalmology, 98, 807\u2013822.","DOI":"10.1016\/S0161-6420(13)38013-0"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1037\/1082-989X.1.1.30","article-title":"Forming Inferences about Some Intraclass Correlation Coefficients","volume":"1","author":"McGraw","year":"1996","journal-title":"Psychol. Methods"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1109\/TMI.2004.825627","article-title":"Ridge-Based Vessel Segmentation in Color Images of the Retina","volume":"23","author":"Staal","year":"2004","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1109\/TMI.2003.815900","article-title":"Locating the Optic Nerve in a Retinal Image Using the Fuzzy Convergence of the Blood Vessels","volume":"22","author":"Hoover","year":"2003","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1001\/jamaophthalmol.2019.0440","article-title":"Retinal Nonperfusion Characteristics on Ultra-Widefield Angiography in Eyes with Severe Nonproliferative Diabetic Retinopathy and Proliferative Diabetic Retinopathy","volume":"137","author":"Nicholson","year":"2019","journal-title":"JAMA Ophthalmol."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/9\/8\/2537\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:57:04Z","timestamp":1760176624000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/9\/8\/2537"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,6]]},"references-count":27,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["jcm9082537"],"URL":"https:\/\/doi.org\/10.3390\/jcm9082537","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,6]]}}}