{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,14]],"date-time":"2026-10-14T22:40:44Z","timestamp":1792017644484,"version":"4.4.0"},"reference-count":45,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2021,8,6]],"date-time":"2021-08-06T00:00:00Z","timestamp":1628208000000},"content-version":"vor","delay-in-days":217,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"name":"Okayama Medical Research Association"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Journal of Ophthalmology"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>\n                    <jats:italic>Background<\/jats:italic>\n                    . Retinopathy of prematurity (ROP) occurs in preterm infants and may contribute to blindness. Deep learning (DL) models have been used for ophthalmologic diagnoses. We performed a systematic review and meta\u2010analysis of published evidence to summarize and evaluate the diagnostic accuracy of DL algorithms for ROP by fundus images.\n                    <jats:italic>Methods<\/jats:italic>\n                    . We searched PubMed, EMBASE, Web of Science, and Institute of Electrical and Electronics Engineers Xplore Digital Library on June 13, 2021, for studies using a DL algorithm to distinguish individuals with ROP of different grades, which provided accuracy measurements. The pooled sensitivity and specificity values and the area under the curve (AUC) of summary receiver operating characteristics curves (SROC) summarized overall test performance. The performances in validation and test datasets were assessed together and separately. Subgroup analyses were conducted between the definition and grades of ROP. Threshold and nonthreshold effects were tested to assess biases and evaluate accuracy factors associated with DL models.\n                    <jats:italic>Results<\/jats:italic>\n                    . Nine studies with fifteen classifiers were included in our meta\u2010analysis. A total of 521,586 objects were applied to DL models. For combined validation and test datasets in each study, the pooled sensitivity and specificity were 0.953 (95% confidence intervals (CI): 0.946\u20130.959) and 0.975 (0.973\u20130.977), respectively, and the AUC was 0.984 (0.978\u20130.989). For the validation dataset and test dataset, the AUC was 0.977 (0.968\u20130.986) and 0.987 (0.982\u20130.992), respectively. In the subgroup analysis of ROP vs. normal and differentiation of two ROP grades, the AUC was 0.990 (0.944\u20130.994) and 0.982 (0.964\u20130.999), respectively.\n                    <jats:italic>Conclusions<\/jats:italic>\n                    . Our study shows that DL models can play an essential role in detecting and grading ROP with high sensitivity, specificity, and repeatability. The application of a DL\u2010based automated system may improve ROP screening and diagnosis in the future.\n                  <\/jats:p>","DOI":"10.1155\/2021\/8883946","type":"journal-article","created":{"date-parts":[[2021,8,6]],"date-time":"2021-08-06T15:50:06Z","timestamp":1628265006000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Accuracy of Deep Learning Algorithms for the Diagnosis of Retinopathy of Prematurity by Fundus Images: A Systematic Review and Meta\u2010Analysis"],"prefix":"10.1155","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3170-9894","authenticated-orcid":false,"given":"Jingjing","family":"Zhang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7916-2875","authenticated-orcid":false,"given":"Yangyang","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Toshiharu","family":"Mitsuhashi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Toshihiko","family":"Matsuo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2021,8,6]]},"reference":[{"key":"e_1_2_9_1_2","doi-asserted-by":"publisher","DOI":"10.1016\/s0140-6736(13)60178-6"},{"key":"e_1_2_9_2_2","doi-asserted-by":"publisher","DOI":"10.1891\/0730-0832.26.6.371"},{"key":"e_1_2_9_3_2","article-title":"What is the real gold standard for ROP screening?","volume":"29","author":"Trese M. T.","year":"2009","journal-title":"Retina"},{"key":"e_1_2_9_4_2","doi-asserted-by":"publisher","DOI":"10.1001\/archopht.121.12.1684"},{"key":"e_1_2_9_5_2","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/5278196"},{"key":"e_1_2_9_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/tnn.2001.925572"},{"key":"e_1_2_9_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ophtha.2017.08.046"},{"key":"e_1_2_9_8_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"key":"e_1_2_9_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2020.105320"},{"key":"e_1_2_9_10_2","doi-asserted-by":"publisher","DOI":"10.1049\/iet-ipr.2018.5425"},{"key":"e_1_2_9_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/jtehm.2018.2835315"},{"key":"e_1_2_9_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/access.2019.2930120"},{"key":"e_1_2_9_13_2","doi-asserted-by":"publisher","DOI":"10.1167\/tvst.9.2.10"},{"key":"e_1_2_9_14_2","doi-asserted-by":"crossref","unstructured":"CarneiroG. MateusD. PeterL.et al. Deep learning and data labeling for medical applications Proceedings of the First International Workshop Labels 2016 and Second International Workshop Dlmia 2016 Held in Conjunction with Miccai 2016 Athens Greece October 2016.","DOI":"10.1007\/978-3-319-46976-8"},{"key":"e_1_2_9_15_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2017.19163"},{"key":"e_1_2_9_16_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781119536604"},{"key":"e_1_2_9_17_2","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-155-8-201110180-00009"},{"key":"e_1_2_9_18_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-6-31"},{"key":"e_1_2_9_19_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-6-31"},{"key":"e_1_2_9_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2016.07.011"},{"key":"e_1_2_9_21_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1185"},{"key":"e_1_2_9_22_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-2-9"},{"key":"e_1_2_9_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2005.01.016"},{"key":"e_1_2_9_24_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaophthalmol.2018.1934"},{"key":"e_1_2_9_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ebiom.2018.08.033"},{"key":"e_1_2_9_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/tmi.2018.2863562"},{"key":"e_1_2_9_27_2","doi-asserted-by":"publisher","DOI":"10.1167\/tvst.8.6.23"},{"key":"e_1_2_9_28_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1187\/4\/042057"},{"key":"e_1_2_9_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/access.2018.2881042"},{"key":"e_1_2_9_30_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9091444"},{"key":"e_1_2_9_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbe.2021.02.005"},{"key":"e_1_2_9_32_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2021.8758"},{"key":"e_1_2_9_33_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1187\/4\/042057"},{"key":"e_1_2_9_34_2","volume-title":"Deep Learning for Image Quality Assessment of Fundus Images in Retinopathy of Prematurity","author":"Coyner A. S.","year":"2018"},{"key":"e_1_2_9_35_2","doi-asserted-by":"publisher","DOI":"10.1097\/jto.0b013e3181ec173d"},{"key":"e_1_2_9_36_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1099"},{"key":"e_1_2_9_37_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2017171920"},{"key":"e_1_2_9_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2881042"},{"key":"e_1_2_9_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.oret.2019.01.015"},{"key":"e_1_2_9_40_2","doi-asserted-by":"publisher","DOI":"10.3109\/01658107.2013.773451"},{"key":"e_1_2_9_41_2","doi-asserted-by":"publisher","DOI":"10.1111\/aos.14264"},{"key":"e_1_2_9_42_2","article-title":"Preventing deep neural network from overfitting","volume":"7","author":"Skalski P.","year":"2018","journal-title":"Towards Data Science"},{"key":"e_1_2_9_43_2","unstructured":"GeirhosR. RubischP. MichaelisC.et al. ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness 2018 https:\/\/arxiv.org\/abs\/1811.12231."},{"key":"e_1_2_9_44_2","doi-asserted-by":"publisher","DOI":"10.1042\/bsr20180497"},{"key":"e_1_2_9_45_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.38793.637789.2f"}],"container-title":["Journal of Ophthalmology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2021\/8883946","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1155\/2021\/8883946","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2021\/8883946","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T03:06:03Z","timestamp":1783652763000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2021\/8883946"}},"subtitle":[],"editor":[{"given":"Heba A","family":"El Gendy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1155\/2021\/8883946"],"URL":"https:\/\/doi.org\/10.1155\/2021\/8883946","archive":["Portico"],"relation":{},"ISSN":["2090-004X","2090-0058"],"issn-type":[{"value":"2090-004X","type":"print"},{"value":"2090-0058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]},"assertion":[{"value":"2020-09-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-27","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-06","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"8883946"}}