{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:57:53Z","timestamp":1782845873153,"version":"3.54.5"},"reference-count":36,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Access to screening continues to be a barrier for the early detection of diabetic retinopathy (DR). Primary care\u2013based diabetic retinopathy screening could improve access, but operational challenges, such as cost and workflow management, hamper the widespread adoption of retinal camera systems in primary care clinics in the United States.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to develop and evaluate a retinal screening system suitable for integration into a primary care workflow.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n We developed a nonmydriatic, 45\u00b0 field imaging retinal camera system, the Verily Numetric Retinal Camera (VNRC; Verily Life Sciences LLC), able to generate high-fidelity retinal images enabled by on-device intelligent features. The VNRC output flows into cloud-based software that accepts and routes digitized images for grading. We evaluated the performance and usability of the VNRC in 2 studies. A retrospective performance study compared the performance of VNRC against a reference camera (Crystalvue NFC-700 [Crystalvue Medical]) as well as the correlation between VNRC capture status and gradability (as determined by ophthalmologist graders). The usability study simulated a primary care setting for a combined cohort of trained and untrained users (corresponding to patients in the simulation) and operators (corresponding to health care personnel in the simulation), where respondents completed a questionnaire about their user experience after attempting to capture images with the VNRC.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n In the comparative performance study (N=108, K=206 images), a total of 98.5% (203\/206) of images captured by the VNRC were graded as sufficient for clinical interpretation compared to 97.1% (200\/206) of Crystalvue NFC-700 images (difference in proportion was 0.015, 95% CI \u20130.007 to 0.033). In the quality control algorithm evaluation (N=172, K=343 images), we found a positive association (\n \u03c6<\/jats:italic>\n =0.58, 95% CI 0.45\u20100.69) between gradability status (gradable or nongradable) as determined by ophthalmologists and the capture status (recapture not-needed or needed) as determined by the VNRC quality control algorithm. In the usability study (n=15 users and n=30 operators), all participating users (15\/15) indicated that they were able to have both eyes screened easily. Most users and operators indicated agreement (from somewhat agree to strongly agree) with statements describing the imaging process as intuitive (15\/15, 100% and 29\/30, 97%), comfortable (15\/15, 100% and 30\/30, 100%), and allowing for a positive experience (15\/15, 100% and 30\/30, 100%), of users and operators, respectively.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Our findings about the performance and usability of this retinal camera system support its deployment as an integrated end-to-end retinal service for primary care. These results warrant additional studies to fully characterize real-world usability across a wider and diverse set of primary care clinics.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/70331","type":"journal-article","created":{"date-parts":[[2025,7,17]],"date-time":"2025-07-17T21:11:37Z","timestamp":1752786697000},"page":"e70331-e70331","source":"Crossref","is-referenced-by-count":1,"title":["Performance of a Retinal Imaging Camera With On-Device Intelligence for Primary Care: Retrospective Study"],"prefix":"10.2196","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-6891-5188","authenticated-orcid":false,"given":"Matthew","family":"Silvestrini","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7611-5744","authenticated-orcid":false,"given":"Clarissa","family":"Lui","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-2816-7142","authenticated-orcid":false,"given":"Anil","family":"Patwardhan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7743-8675","authenticated-orcid":false,"given":"Ying","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3192-7821","authenticated-orcid":false,"given":"Tayyeba","family":"Ali","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7688-4796","authenticated-orcid":false,"given":"Elie","family":"Glik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2868-096X","authenticated-orcid":false,"given":"Honglei","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8084-9045","authenticated-orcid":false,"given":"Brian","family":"Levinstein","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6747-2717","authenticated-orcid":false,"given":"Adrianna","family":"Wenz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-6799-6178","authenticated-orcid":false,"given":"Nathan","family":"Shemonski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7593-7066","authenticated-orcid":false,"given":"Lin","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6586-4473","authenticated-orcid":false,"given":"Ian","family":"Atkinson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8098-1157","authenticated-orcid":false,"given":"Sam","family":"Kavusi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,7,17]]},"reference":[{"key":"R1","unstructured":"National diabetes statistics report. Centers for Disease Control and Prevention; May 15, 2024. URL: https:\/\/www.cdc.gov\/diabetes\/php\/data-research\/?CDC_AAref_Val=https:\/\/www.cdc.gov\/diabetes\/pdfs\/data\/statistics\/national-diabetes-statistics-report.pdf [Accessed 18-11-2024]"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","first-page":"26","DOI":"10.2337\/dci23-0085","article-title":"Economic costs of diabetes in the U.S. in 2022","volume":"47","author":"Parker","journal-title":"Diabetes Care"},{"issue":"14","key":"R3","doi-asserted-by":"publisher","DOI":"10.1172\/jci.insight.93751","article-title":"Diabetic retinopathy: current understanding, mechanisms, and treatment strategies","volume":"2","author":"Duh","journal-title":"JCI Insight"},{"issue":"7","key":"R4","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1001\/jamaophthalmol.2024.0046","article-title":"Longitudinal trends and disparities in diabetic retinopathy within an aggregate health care network","volume":"142","author":"Markle","journal-title":"JAMA Ophthalmol"},{"issue":"8","key":"R5","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1001\/jamaophthalmol.2023.2289","article-title":"Prevalence of diabetic retinopathy in the US in 2021","volume":"141","author":"Lundeen","journal-title":"JAMA Ophthalmol"},{"issue":"Suppl 1","key":"R6","doi-asserted-by":"publisher","first-page":"S231","DOI":"10.2337\/dc24-S012","article-title":"12. Retinopathy, neuropathy, and foot care: standards of care in diabetes-2024","volume":"47","author":"American Diabetes Association Professional Practice Committee","journal-title":"Diabetes Care"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","first-page":"180","DOI":"10.2337\/dc13-1507","article-title":"Barriers to eye care among people aged 40 years and older with diagnosed diabetes, 2006-2010","volume":"37","author":"Chou","journal-title":"Diabetes Care"},{"issue":"3","key":"R8","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1001\/archopht.123.3.387","article-title":"Perceived barriers to diabetic eye care: qualitative study of patients and physicians","volume":"123","author":"Hartnett","journal-title":"Arch Ophthalmol"},{"issue":"6","key":"R9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0269231","article-title":"Associations between healthcare utilization and access and diabetic retinopathy complications using All of Us nationwide survey data","volume":"17","author":"Chan","journal-title":"PLoS ONE"},{"issue":"5","key":"R10","doi-asserted-by":"publisher","first-page":"642","DOI":"10.1001\/jamainternmed.2017.0204","article-title":"Implementation and evaluation of a large-scale teleretinal diabetic retinopathy screening program in the Los Angeles County Department of Health Services","volume":"177","author":"Daskivich","journal-title":"JAMA Intern Med"},{"issue":"6","key":"R11","doi-asserted-by":"publisher","first-page":"515","DOI":"10.1007\/s00592-017-0974-1","article-title":"The English National Screening Programme for diabetic retinopathy 2003-2016","volume":"54","author":"Scanlon","journal-title":"Acta Diabetol"},{"issue":"1","key":"R12","doi-asserted-by":"publisher","DOI":"10.1186\/s13098-015-0110-8","article-title":"Comparison between binocular indirect ophthalmoscopy and digital retinography for diabetic retinopathy screening: the multicenter Brazilian type 1 diabetes study","volume":"7","author":"Malerbi","journal-title":"Diabetol Metab Syndr"},{"issue":"7","key":"R13","doi-asserted-by":"publisher","first-page":"548","DOI":"10.1016\/j.oret.2022.03.002","article-title":"Comparison of handheld retinal imaging with ETDRS 7-standard field photography for diabetic retinopathy and diabetic macular edema","volume":"6","author":"Salongcay","journal-title":"Ophthalmol Retina"},{"key":"R14","author":"Jalkiewicz","journal-title":"Ophthalmol Management"},{"issue":"5","key":"R15","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1001\/archopht.119.5.758","article-title":"Understanding the value of diabetic retinopathy screening","volume":"119","author":"Fong","journal-title":"Arch Ophthalmol"},{"issue":"16","key":"R16","doi-asserted-by":"publisher","first-page":"1009","DOI":"10.2147\/OPTH.S342965","article-title":"Factors affecting compliance with diabetic retinopathy screening: a qualitative study comparing English and Spanish speakers","volume":"16","author":"Hudson","journal-title":"Clin Ophthalmol"},{"issue":"11","key":"R17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0206742","article-title":"Factors influencing patient adherence with diabetic eye screening in rural communities: a qualitative study","volume":"13","author":"Liu","journal-title":"PLoS ONE"},{"issue":"9","key":"R18","doi-asserted-by":"publisher","DOI":"10.1007\/s11892-019-1187-5","article-title":"Scaling up teleophthalmology for diabetic eye screening: opportunities for widespread implementation in the USA","volume":"19","author":"Liu","journal-title":"Curr Diab Rep"},{"key":"R19","unstructured":"NFC-700 fully automated non-mydriatic retinal camera. Crystalvue. URL: https:\/\/www.crystalvue.com.tw\/data\/files\/1623122722411841591.pdf [Accessed 18-11-2024]"},{"key":"R20","unstructured":"510(k) summary. US Food and Drug Administration; Jan 2, 2019. URL: https:\/\/www.accessdata.fda.gov\/cdrh_docs\/pdf18\/K182199.pdf [Accessed 18-11-2024]"},{"issue":"2","key":"R21","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1364\/ao.48.000221","article-title":"Fundus camera systems: a comparative analysis","volume":"48","author":"DeHoog","journal-title":"Appl Opt"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.2147\/OPTH.S279872","article-title":"Dynamic pupillometry in type 2 diabetes: pupillary autonomic dysfunction and the severity of diabetic retinopathy","volume":"14","author":"Bista Karki","journal-title":"Clin Ophthalmol"},{"key":"R23","doi-asserted-by":"crossref","unstructured":"Kavusi S El Gamal A . Quantitative study of high-dynamic-range image sensor architectures. Presented at: Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications V. SPIE. 264-275; San Jose, CA. Jun 7, 2004.[doi: 10.1117\/12.544517]","DOI":"10.1117\/12.544517"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1016\/j.optlastec.2018.06.061","article-title":"An approach for de-noising and contrast enhancement of retinal fundus image using CLAHE","volume":"110","author":"Sahu","journal-title":"Optics & Laser Technology"},{"key":"R25","unstructured":"Youssif AA Ghalwash AZ Ghoneim AS . Comparative study of contrast enhancement and illumination equalization methods for retinal vasculature segmentation. Presented at: Cairo International Biomedical Engineering Conference (CIBEC\u201906). 1-5; 2006.URL: https:\/\/www.researchgate.net\/publication\/224014522_Comparative_Study_of_Contrast_Enhancement_and_Illumination_Equalization_Methods_for_Retinal_Vasculature_Segmentation [Accessed 03-07-2025]"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"Makedonsky K Patwardhan A Kim A Silvestrini M Lui C Kavusi S . Technical feasibility study for a retinal camera system. Endocrinology (including Diabetes Mellitus and Metabolic Disease). Preprint posted online on 2024. [doi: 10.1101\/2024.12.20.24319469]","DOI":"10.1101\/2024.12.20.24319469"},{"issue":"119","key":"R27","first-page":"4","volume":"36","author":"Bascaran","journal-title":"Community Eye Health"},{"issue":"1","key":"R28","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1177\/1932296816682033","article-title":"Can commercially available handheld retinal cameras effectively screen diabetic retinopathy?","volume":"11","author":"Cuadros","journal-title":"J Diabetes Sci Technol"},{"key":"R29","author":"Leonard","journal-title":"Rev Ophthalmol"},{"issue":"6","key":"R30","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1038\/s41591-023-02293-9","article-title":"Lessons learned from translating AI from development to deployment in healthcare","volume":"29","author":"Widner","journal-title":"Nat Med"},{"issue":"4","key":"R31","doi-asserted-by":"publisher","DOI":"10.1016\/j.xops.2023.100330","article-title":"AI-human hybrid workflow enhances teleophthalmology for the detection of diabetic retinopathy","volume":"3","author":"Dow","journal-title":"Ophthalmol Sci"},{"issue":"3-4","key":"R32","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1159\/000530903","article-title":"Comparison of 2-field and 5-field mydriatic handheld retinal imaging in a community-based diabetic retinopathy screening program","volume":"246","author":"Aquino","journal-title":"Ophthalmologica"},{"issue":"1","key":"R33","doi-asserted-by":"publisher","first-page":"2352018","DOI":"10.1080\/07853890.2024.2352018","article-title":"Comparison of 21 artificial intelligence algorithms in automated diabetic retinopathy screening using handheld fundus camera","volume":"56","author":"Kubin","journal-title":"Ann Med"},{"issue":"4","key":"R34","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0198979","article-title":"Systematic review on barriers and enablers for access to diabetic retinopathy screening services in different income settings","volume":"14","author":"Piyasena","journal-title":"PLoS One"},{"issue":"13","key":"R35","doi-asserted-by":"publisher","DOI":"10.5888\/pcd13.160193","article-title":"Divergent perceptions of barriers to diabetic retinopathy screening among patients and care providers, Los Angeles, California, 2014\u20132015","volume":"13","author":"Lu","journal-title":"Prev Chronic Dis"},{"issue":"3","key":"R36","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1089\/tmj.2015.0068","article-title":"Fundus photography in the 21st century--a review of recent technological advances and their implications for worldwide healthcare","volume":"22","author":"Panwar","journal-title":"Telemed J E Health"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2025\/1\/e70331","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:58:58Z","timestamp":1782842338000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2025\/1\/e70331"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,17]]},"references-count":36,"URL":"https:\/\/doi.org\/10.2196\/70331","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,17]]},"article-number":"v9i1e70331"}}