{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,19]],"date-time":"2026-11-19T03:58:40Z","timestamp":1795060720248,"version":"4.10.2"},"reference-count":38,"publisher":"American Medical Association (AMA)","issue":"8","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Ophthalmol"],"published-print":{"date-parts":[[2022,8,1]]},"abstract":"<jats:sec id=\"ab-eoi220037-4\">\n                    <jats:title>Importance<\/jats:title>\n                    <jats:p>Retinopathy of prematurity (ROP) is a leading cause of preventable blindness that disproportionately affects children born in low- and middle-income countries (LMICs). In-person and telemedical screening examinations can reduce this risk but are challenging to implement in LMICs owing to the multitude of at-risk infants and lack of trained ophthalmologists.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"ab-eoi220037-5\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To implement an ROP risk model using retinal images from a single baseline examination to identify infants who will develop treatment-requiring (TR)\u2013ROP in LMIC telemedicine programs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"ab-eoi220037-6\">\n                    <jats:title>Design, Setting, and Participants<\/jats:title>\n                    <jats:p>In this diagnostic study conducted from February 1, 2019, to June 30, 2021, retinal fundus images were collected from infants as part of an Indian ROP telemedicine screening program. An artificial intelligence (AI)\u2013derived vascular severity score (VSS) was obtained from images from the first examination after 30 weeks\u2019 postmenstrual age. Using 5-fold cross-validation, logistic regression models were trained on 2 variables (gestational age and VSS) for prediction of TR-ROP. The model was externally validated on test data sets from India, Nepal, and Mongolia. Data were analyzed from October 20, 2021, to April 20, 2022.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"ab-eoi220037-7\">\n                    <jats:title>Main Outcomes and Measures<\/jats:title>\n                    <jats:p>Primary outcome measures included sensitivity, specificity, positive predictive value, and negative predictive value for predictions of future occurrences of TR-ROP; the number of weeks before clinical diagnosis when a prediction was made; and the potential reduction in number of examinations required.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"ab-eoi220037-8\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>A total of 3760 infants (median [IQR] postmenstrual age, 37 [5] weeks; 1950 male infants [51.9%]) were included in the study. The diagnostic model had a sensitivity and specificity, respectively, for each of the data sets as follows: India, 100.0% (95% CI, 87.2%-100.0%) and 63.3% (95% CI, 59.7%-66.8%); Nepal, 100.0% (95% CI, 54.1%-100.0%) and 77.8% (95% CI, 72.9%-82.2%); and Mongolia, 100.0% (95% CI, 93.3%-100.0%) and 45.8% (95% CI, 39.7%-52.1%). With the AI model, infants with TR-ROP were identified a median (IQR) of 2.0 (0-11) weeks before TR-ROP diagnosis in India, 0.5 (0-2.0) weeks before TR-ROP diagnosis in Nepal, and 0 (0-5.0) weeks before TR-ROP diagnosis in Mongolia. If low-risk infants were never screened again, the population could be effectively screened with 45.0% (India, 664\/1476), 38.4% (Nepal, 151\/393), and 51.3% (Mongolia, 266\/519) fewer examinations required.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"ab-eoi220037-9\">\n                    <jats:title>Conclusions and Relevance<\/jats:title>\n                    <jats:p>Results of this diagnostic study suggest that there were 2 advantages to implementation of this risk model: (1) the number of examinations for low-risk infants could be reduced without missing cases of TR-ROP, and (2) high-risk infants could be identified and closely monitored before development of TR-ROP.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1001\/jamaophthalmol.2022.2135","type":"journal-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T11:32:12Z","timestamp":1657193532000},"page":"791","source":"Crossref","is-referenced-by-count":56,"title":["External Validation of a Retinopathy of Prematurity Screening Model Using Artificial Intelligence in 3 Low- and Middle-Income Populations"],"prefix":"10.1001","volume":"140","author":[{"given":"Aaron S.","family":"Coyner","sequence":"first","affiliation":[{"name":"Casey Eye Institute, Oregon Health & Science University, Portland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minn A.","family":"Oh","sequence":"additional","affiliation":[{"name":"Casey Eye Institute, Oregon Health & Science University, Portland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Parag K.","family":"Shah","sequence":"additional","affiliation":[{"name":"Pediatric Retina and Ocular Oncology Division, Aravind Eye Hospital, Coimbatore, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Praveer","family":"Singh","sequence":"additional","affiliation":[{"name":"Massachusetts General Hospital and Brigham and Women\u2019s Hospital Center for Clinical Data Science, Boston, Massachusetts"},{"name":"Radiology, Massachusetts General Hospital\/Harvard Medical School, Charlestown, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susan","family":"Ostmo","sequence":"additional","affiliation":[{"name":"Casey Eye Institute, Oregon Health & Science University, Portland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nita G.","family":"Valikodath","sequence":"additional","affiliation":[{"name":"Illinois Eye and Ear Infirmary, University of Illinois at Chicago, Chicago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Cole","sequence":"additional","affiliation":[{"name":"Illinois Eye and Ear Infirmary, University of Illinois at Chicago, Chicago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tala","family":"Al-Khaled","sequence":"additional","affiliation":[{"name":"Illinois Eye and Ear Infirmary, University of Illinois at Chicago, Chicago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sanyam","family":"Bajimaya","sequence":"additional","affiliation":[{"name":"Tilganga Institute of Ophthalmology, Kathmandu, Nepal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sagun","family":"K.C.","sequence":"additional","affiliation":[{"name":"Helen Keller International, Kathmandu, Nepal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tsengelmaa","family":"Chuluunbat","sequence":"additional","affiliation":[{"name":"National Center for Maternal and Child Health, Ulaanbaatar, Mongolia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bayalag","family":"Munkhuu","sequence":"additional","affiliation":[{"name":"National Center for Maternal and Child Health, Ulaanbaatar, Mongolia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Prema","family":"Subramanian","sequence":"additional","affiliation":[{"name":"Pediatric Retina and Ocular Oncology Division, Aravind Eye Hospital, Coimbatore, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Narendran","family":"Venkatapathy","sequence":"additional","affiliation":[{"name":"Pediatric Retina and Ocular Oncology Division, Aravind Eye Hospital, Coimbatore, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karyn E.","family":"Jonas","sequence":"additional","affiliation":[{"name":"Illinois Eye and Ear Infirmary, University of Illinois at Chicago, Chicago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joelle A.","family":"Hallak","sequence":"additional","affiliation":[{"name":"Illinois Eye and Ear Infirmary, University of Illinois at Chicago, Chicago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"R.V. Paul","family":"Chan","sequence":"additional","affiliation":[{"name":"Illinois Eye and Ear Infirmary, University of Illinois at Chicago, Chicago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael F.","family":"Chiang","sequence":"additional","affiliation":[{"name":"National Eye Institute, National Institutes of Health, Bethesda, Maryland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jayashree","family":"Kalpathy-Cramer","sequence":"additional","affiliation":[{"name":"Massachusetts General Hospital and Brigham and Women\u2019s Hospital Center for Clinical Data Science, Boston, Massachusetts"},{"name":"Radiology, Massachusetts General Hospital\/Harvard Medical School, Charlestown, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J. Peter","family":"Campbell","sequence":"additional","affiliation":[{"name":"Casey Eye Institute, Oregon Health & Science University, Portland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","reference":[{"issue":"1","key":"eoi220037r1","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1542\/peds.2004-1413","article-title":"The incidence and course of retinopathy of prematurity: findings from the early treatment for retinopathy of prematurity study.","volume":"116","author":"Good","year":"2005","journal-title":"Pediatrics"},{"issue":"12","key":"eoi220037r2","doi-asserted-by":"publisher","first-page":"1684","DOI":"10.1001\/archopht.121.12.1684","article-title":"Revised indications for the treatment of retinopathy of prematurity: results of the early treatment for retinopathy of prematurity randomized trial.","volume":"121","author":"Early Treatment for Retinopathy Of Prematurity Cooperative Group","year":"2003","journal-title":"Arch Ophthalmol"},{"issue":"6","key":"eoi220037r3","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2018-3061","article-title":"Screening examination of premature infants for retinopathy of prematurity.","volume":"142","author":"Fierson","year":"2018","journal-title":"Pediatrics"},{"issue":"10","key":"eoi220037r4","doi-asserted-by":"publisher","first-page":"e51","DOI":"10.1016\/j.ophtha.2021.05.031","article-title":"International classification of retinopathy of prematurity, third edition.","volume":"128","author":"Chiang","year":"2021","journal-title":"Ophthalmology"},{"key":"eoi220037r5","doi-asserted-by":"publisher","first-page":"S5","DOI":"10.1186\/1742-4755-10-S1-S5","article-title":"Born too soon: care for the preterm baby.","volume":"10","author":"Lawn","year":"2013","journal-title":"Reprod Health"},{"key":"eoi220037r6","doi-asserted-by":"publisher","first-page":"S2","DOI":"10.1186\/1742-4755-10-S1-S2","article-title":"Born too soon: the global epidemiology of 15 million preterm births.","volume":"10","author":"Blencowe","year":"2013","journal-title":"Reprod Health"},{"key":"eoi220037r7","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1038\/pr.2013.205","article-title":"Preterm-associated visual impairment and estimates of retinopathy of prematurity at regional and global levels for 2010.","volume":"74","author":"Blencowe","year":"2013","journal-title":"Pediatr Res"},{"key":"eoi220037r8","doi-asserted-by":"publisher","first-page":"31","DOI":"10.2147\/EB","article-title":"Retinopathy of prematurity blindness worldwide: phenotypes in the third epidemic.","volume":"8","author":"Quinn","year":"2016","journal-title":"Eye Brain"},{"issue":"5","key":"eoi220037r9","doi-asserted-by":"publisher","first-page":"e518","DOI":"10.1542\/peds.2004-1180","article-title":"Characteristics of infants with severe retinopathy of prematurity in countries with low, moderate, and high levels of development: implications for screening programs.","volume":"115","author":"Gilbert","year":"2005","journal-title":"Pediatrics"},{"issue":"4","key":"eoi220037r10","doi-asserted-by":"publisher","first-page":"49","DOI":"10.5693\/djo.01.2019.08.002","article-title":"The current state of retinopathy of prematurity in India, Kenya, Mexico, Nigeria, Philippines, Romania, Thailand, and Venezuela.","volume":"25","author":"Bowe","year":"2019","journal-title":"Digit J Ophthalmol"},{"key":"eoi220037r11","doi-asserted-by":"publisher","first-page":"S108","DOI":"10.4103\/ijo.IJO_1827_19","article-title":"Operational guidelines for ROP in India: a summary.","volume":"68","author":"Shukla","year":"2020","journal-title":"Indian J Ophthalmol"},{"issue":"1","key":"eoi220037r12","doi-asserted-by":"publisher","first-page":"52","DOI":"10.22608\/21620989","article-title":"Telemedicine for ROP.","volume":"7","author":"Shah","year":"2018","journal-title":"Asia Pac J Ophthalmol (Phila)"},{"issue":"1","key":"eoi220037r13","doi-asserted-by":"publisher","first-page":"41","DOI":"10.4103\/0301-4738.126178","article-title":"The KIDROP model of combining strategies for providing retinopathy of prematurity screening in underserved areas in India using wide-field imaging, telemedicine, nonphysician graders, and smart phone reporting.","volume":"62","author":"Vinekar","year":"2014","journal-title":"Indian J Ophthalmol"},{"issue":"3","key":"eoi220037r14","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2020-016618","article-title":"Applications of artificial intelligence for retinopathy of prematurity screening.","volume":"147","author":"Campbell","year":"2021","journal-title":"Pediatrics"},{"issue":"6","key":"eoi220037r15","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1016\/j.survophthal.2009.02.020","article-title":"Telemedicine for retinopathy of prematurity diagnosis: evaluation and challenges.","volume":"54","author":"Richter","year":"2009","journal-title":"Surv Ophthalmol"},{"issue":"5","key":"eoi220037r16","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1001\/jamaophthalmol.2018.0649","article-title":"Diagnostic accuracy of ophthalmoscopy vs telemedicine in examinations for retinopathy of prematurity.","volume":"136","author":"Biten","year":"2018","journal-title":"JAMA Ophthalmol"},{"issue":"3","key":"eoi220037r17","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1016\/j.jaapos.2020.01.014","article-title":"Evaluation of artificial intelligence-based telemedicine screening for retinopathy of prematurity.","volume":"24","author":"Greenwald","year":"2020","journal-title":"J AAPOS"},{"issue":"5","key":"eoi220037r18","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1001\/jamaophthalmol.2021.0377","article-title":"Preterm infant stress during handheld optical coherence tomography vs binocular indirect ophthalmoscopy examination for retinopathy of prematurity.","volume":"139","author":"Mangalesh","year":"2021","journal-title":"JAMA Ophthalmol"},{"issue":"2","key":"eoi220037r19","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1001\/archpedi.155.2.173","article-title":"Consensus statement for the prevention and management of pain in the newborn.","volume":"155","author":"Anand","year":"2001","journal-title":"Arch Pediatr Adolesc Med"},{"issue":"1","key":"eoi220037r20","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1097\/00006982-200501000-00008","article-title":"The effects of comfort care on the pain response in preterm infants undergoing screening for retinopathy of prematurity.","volume":"25","author":"Rush","year":"2005","journal-title":"Retina"},{"issue":"4","key":"eoi220037r21","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1097\/ANC.0b013e318225a332","article-title":"Physiologic effects of retinopathy of prematurity screening examinations.","volume":"11","author":"Mitchell","year":"2011","journal-title":"Adv Neonatal Care"},{"issue":"6","key":"eoi220037r22","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2021-051772","article-title":"Single-examination risk prediction of severe retinopathy of prematurity.","volume":"148","author":"Coyner","year":"2021","journal-title":"Pediatrics"},{"issue":"9","key":"eoi220037r23","doi-asserted-by":"publisher","first-page":"1022","DOI":"10.1001\/jamaophthalmol.2019.2433","article-title":"Monitoring disease progression with a quantitative severity scale for retinopathy of prematurity using deep learning.","volume":"137","author":"Taylor","year":"2019","journal-title":"JAMA Ophthalmol"},{"issue":"8","key":"eoi220037r24","doi-asserted-by":"publisher","first-page":"1105","DOI":"10.1016\/j.ophtha.2020.01.052","article-title":"Aggressive posterior retinopathy of prematurity: clinical and quantitative Imaging features in a large North American cohort.","volume":"127","author":"Bellsmith","year":"2020","journal-title":"Ophthalmology"},{"issue":"5","key":"eoi220037r25","doi-asserted-by":"publisher","first-page":"333","DOI":"10.3928\/01913913-20200804-01","article-title":"Development of screening criteria for retinopathy of prematurity in Ulaanbaatar, Mongolia, using a web-based data management system.","volume":"57","author":"Olson","year":"2020","journal-title":"J Pediatr Ophthalmol Strabismus"},{"issue":"7","key":"eoi220037r26","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1001\/jamaophthalmol.2018.1934","article-title":"Automated diagnosis of plus disease in retinopathy of prematurity using deep convolutional neural networks.","volume":"136","author":"Brown","year":"2018","journal-title":"JAMA Ophthalmol"},{"issue":"7","key":"eoi220037r27","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1016\/j.ophtha.2020.10.025","article-title":"Evaluation of a deep learning-derived quantitative retinopathy of prematurity severity scale.","volume":"128","author":"Campbell","year":"2021","journal-title":"Ophthalmology"},{"issue":"1","key":"eoi220037r28","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1002\/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3","article-title":"Index for rating diagnostic tests.","volume":"3","author":"Youden","year":"1950","journal-title":"Cancer"},{"issue":"1","key":"eoi220037r29","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1080\/00031305.1978.10479236","article-title":"Variations of box plots.","volume":"32","author":"McGill","year":"1978","journal-title":"Am Stat"},{"issue":"11","key":"eoi220037r30","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1167\/iovs.61.11.29","article-title":"Calculating sensitivity, specificity, and predictive values for correlated eye data.","volume":"61","author":"Ying","year":"2020","journal-title":"Invest Ophthalmol Vis Sci"},{"issue":"3","key":"eoi220037r31","first-page":"123","article-title":"The incidence of retinopathy of prematurity in a neonatal care unit.","volume":"43","author":"Charan","year":"1995","journal-title":"Indian J Ophthalmol"},{"issue":"2","key":"eoi220037r32","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s13312-015-0594-1","article-title":"Incidence and risk factors for retinopathy of prematurity in neonates.","volume":"52","author":"Chattopadhyay","year":"2015","journal-title":"Indian Pediatr"},{"issue":"5","key":"eoi220037r33","doi-asserted-by":"crossref","first-page":"264.e1","DOI":"10.1016\/j.jaapos.2019.05.014","article-title":"Aggressive posterior retinopathy of prematurity in 2 cohorts of patients in South India: implications for primary, secondary, and tertiary prevention.","volume":"23","author":"Shah","year":"2019","journal-title":"J AAPOS"},{"issue":"12","key":"eoi220037r34","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1001\/archophthalmol.2012.2524","article-title":"The CHOP postnatal weight gain, birth weight, and gestational age retinopathy of prematurity risk model.","volume":"130","author":"Binenbaum","year":"2012","journal-title":"Arch Ophthalmol"},{"issue":"8","key":"eoi220037r35","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1001\/jamaophthalmol.2017.2295","article-title":"Validation of the Children\u2019s Hospital of Philadelphia Retinopathy of Prematurity (CHOP ROP) model.","volume":"135","author":"Binenbaum","year":"2017","journal-title":"JAMA Ophthalmol"},{"key":"eoi220037r36","article-title":"Evaluation of an artificial intelligence system for retinopathy of prematurity screening in Nepal and Mongolia.","author":"Cole","journal-title":"Ophthalmol Sci"},{"issue":"5","key":"eoi220037r37","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.oret.2019.01.015","article-title":"Automated fundus image quality assessment in retinopathy of prematurity using deep convolutional neural networks.","volume":"3","author":"Coyner","year":"2019","journal-title":"Ophthalmol Retina"},{"key":"eoi220037r38","first-page":"1224","article-title":"Deep learning for image quality assessment of fundus images in retinopathy of prematurity.","volume":"2018","author":"Coyner","year":"2018","journal-title":"AMIA Annu Symp Proc"}],"container-title":["JAMA Ophthalmology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamaophthalmology\/articlepdf\/2794136\/jamaophthalmology_coyner_2022_oi_220037_1660767194.63609.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,28]],"date-time":"2024-09-28T14:26:57Z","timestamp":1727533617000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamaophthalmology\/fullarticle\/2794136"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,1]]},"references-count":38,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2022,8,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamaophthalmol.2022.2135","relation":{},"ISSN":["2168-6165"],"issn-type":[{"value":"2168-6165","type":"print"}],"subject":[],"published":{"date-parts":[[2022,8,1]]}}}