{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T21:09:21Z","timestamp":1793912961228,"version":"4.8.0"},"reference-count":65,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Med"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Primary diabetes care and diabetic retinopathy (DR) screening persist as major public health challenges due to a shortage of trained primary care physicians (PCPs), particularly in low-resource settings. Here, to bridge the gaps, we developed an integrated image\u2013language system (DeepDR-LLM), combining a large language model (LLM module) and image-based deep learning (DeepDR-Transformer), to provide individualized diabetes management recommendations to PCPs. In a retrospective evaluation, the LLM module demonstrated comparable performance to PCPs and endocrinology residents when tested in English and outperformed PCPs and had comparable performance to endocrinology residents in Chinese. For identifying referable DR, the average PCP\u2019s accuracy was 81.0% unassisted and 92.3% assisted by DeepDR-Transformer. Furthermore, we performed a single-center real-world prospective study, deploying DeepDR-LLM. We compared diabetes management adherence of patients under the unassisted PCP arm (\n                    <jats:italic>n<\/jats:italic>\n                    \u2009=\u2009397) with those under the PCP+DeepDR-LLM arm (\n                    <jats:italic>n<\/jats:italic>\n                    \u2009=\u2009372). Patients with newly diagnosed diabetes in the PCP+DeepDR-LLM arm showed better self-management behaviors throughout follow-up (\n                    <jats:italic>P<\/jats:italic>\n                    \u2009&lt;\u20090.05). For patients with referral DR, those in the PCP+DeepDR-LLM arm were more likely to adhere to DR referrals (\n                    <jats:italic>P<\/jats:italic>\n                    \u2009&lt;\u20090.01). Additionally, DeepDR-LLM deployment improved the quality and empathy level of management recommendations. Given its multifaceted performance, DeepDR-LLM holds promise as a digital solution for enhancing primary diabetes care and DR screening.\n                  <\/jats:p>","DOI":"10.1038\/s41591-024-03139-8","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T06:01:44Z","timestamp":1721368904000},"page":"2886-2896","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":243,"title":["Integrated image-based deep learning and language models for primary diabetes care"],"prefix":"10.1038","volume":"30","author":[{"given":"Jiajia","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5102-0067","authenticated-orcid":false,"given":"Zhouyu","family":"Guan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carol Y.","family":"Cheung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingfeng","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6214-6924","authenticated-orcid":false,"given":"Lee-Ling","family":"Lim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cynthia Ciwei","family":"Lim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paisan","family":"Ruamviboonsuk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rajiv","family":"Raman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leonor","family":"Corsino","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justin B.","family":"Echouffo-Tcheugui","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea O. Y.","family":"Luk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3500-5840","authenticated-orcid":false,"given":"Li Jia","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5015-0945","authenticated-orcid":false,"given":"Xiaodong","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haslina","family":"Hamzah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiang","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2608-9026","authenticated-orcid":false,"given":"Xiangning","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0281-8039","authenticated-orcid":false,"given":"Ruhan","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2749-7793","authenticated-orcid":false,"given":"Ya Xing","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tingli","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiao","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolong","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Yin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Wan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Du","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ten Cheer","family":"Quek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jocelyn Hui Lin","family":"Goh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dawei","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoyan","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8505-6593","authenticated-orcid":false,"given":"Truong X.","family":"Nguyen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9377-7377","authenticated-orcid":false,"given":"Simon K. H.","family":"Szeto","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peranut","family":"Chotcomwongse","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rachid","family":"Malek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nargiza","family":"Normatova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nilufar","family":"Ibragimova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ramyaa","family":"Srinivasan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pingting","family":"Zhong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3167-0851","authenticated-orcid":false,"given":"Wenyong","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenxin","family":"Deng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Ruan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cuntai","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenxi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chan","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rongping","family":"Dai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4520-646X","authenticated-orcid":false,"given":"Sky Wei Chee","family":"Koh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adina","family":"Abdullah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas Ken Yoong","family":"Hee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong Chang","family":"Tan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhong Hong","family":"Liew","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6554-2703","authenticated-orcid":false,"given":"Carolyn Shan-Yeu","family":"Tien","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shih Ling","family":"Kao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7488-0985","authenticated-orcid":false,"given":"Amanda Yuan Ling","family":"Lim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shao Feng","family":"Mok","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lina","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Gu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tingyao","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Di","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheyuan","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8831-1644","authenticated-orcid":false,"given":"Yiming","family":"Qin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2000-8363","authenticated-orcid":false,"given":"Ling","family":"Dai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziyao","family":"Meng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jia","family":"Shu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuwei","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nan","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tingting","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shan","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gengyou","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shujie","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dan","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5604-7527","authenticated-orcid":false,"given":"Weizhi","family":"Ma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minyi","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinping","family":"Guan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4029-3322","authenticated-orcid":false,"given":"Xiaokang","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Covadonga","family":"Bascaran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charles R.","family":"Cleland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuqian","family":"Bao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elif I.","family":"Ekinci","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0583-3717","authenticated-orcid":false,"given":"Alicia","family":"Jenkins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1325-1194","authenticated-orcid":false,"given":"Juliana C. N.","family":"Chan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5482-2646","authenticated-orcid":false,"given":"Yong Mong","family":"Bee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sobha","family":"Sivaprasad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan E.","family":"Shaw","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0475-3096","authenticated-orcid":false,"given":"Rafael","family":"Sim\u00f3","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9239-745X","authenticated-orcid":false,"given":"Pearse A.","family":"Keane","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0655-885X","authenticated-orcid":false,"given":"Ching-Yu","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gavin Siew Wei","family":"Tan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6244-2168","authenticated-orcid":false,"given":"Weiping","family":"Jia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6752-797X","authenticated-orcid":false,"given":"Yih-Chung","family":"Tham","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0526-5545","authenticated-orcid":false,"given":"Huating","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8510-2556","authenticated-orcid":false,"given":"Bin","family":"Sheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8448-1264","authenticated-orcid":false,"given":"Tien Yin","family":"Wong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,19]]},"reference":[{"key":"3139_CR1","volume":"183","author":"H Sun","year":"2022","unstructured":"Sun, H. et al. IDF Diabetes Atlas: global, regional and country-level diabetes prevalence estimates for 2021 and projections for 2045. Diabetes Res. Clin. Pract. 183, 109119 (2022).","journal-title":"Diabetes Res. Clin. Pract."},{"key":"3139_CR2","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/S0140-6736(23)00914-5","volume":"402","author":"AF Walker","year":"2023","unstructured":"Walker, A. F. et al. Interventions to address global inequity in diabetes: international progress. Lancet 402, 250\u2013264 (2023).","journal-title":"Lancet"},{"key":"3139_CR3","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1111\/jdi.13908","volume":"13","author":"W Jia","year":"2022","unstructured":"Jia, W. Diabetes care in China: innovations and implications. J. Diabetes Investig. 13, 1795\u20131797 (2022).","journal-title":"J. Diabetes Investig."},{"key":"3139_CR4","doi-asserted-by":"crossref","first-page":"2019","DOI":"10.1016\/S0140-6736(20)32374-6","volume":"396","author":"JCN Chan","year":"2021","unstructured":"Chan, J. C. N. et al. The Lancet Commission on diabetes: using data to transform diabetes care and patient lives. Lancet 396, 2019\u20132082 (2021).","journal-title":"Lancet"},{"key":"3139_CR5","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1016\/S2213-8587(22)00133-4","volume":"10","author":"YM Bee","year":"2022","unstructured":"Bee, Y. M., Tai, E. S. & Wong, T. Y. Singapore\u2019s \u2018War on Diabetes\u2019. Lancet Diabetes Endocrinol. 10, 391\u2013392 (2022).","journal-title":"Lancet Diabetes Endocrinol."},{"key":"3139_CR6","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/S0140-6736(23)00909-1","volume":"402","author":"S Agarwal","year":"2023","unstructured":"Agarwal, S. et al. The role of structural racism and geographical inequity in diabetes outcomes. Lancet 402, 235\u2013249 (2023).","journal-title":"Lancet"},{"key":"3139_CR7","doi-asserted-by":"publisher","unstructured":"Tobias, D. K. et al. Second international consensus report on gaps and opportunities for the clinical translation of precision diabetes medicine. Nat. Med. https:\/\/doi.org\/10.1038\/s41591-023-02502-5 (2023).","DOI":"10.1038\/s41591-023-02502-5"},{"key":"3139_CR8","doi-asserted-by":"crossref","first-page":"2987","DOI":"10.4103\/ijo.IJO_1411_21","volume":"69","author":"D Yim","year":"2021","unstructured":"Yim, D., Chandra, S., Sondh, R., Thottarath, S. & Sivaprasad, S. Barriers in establishing systematic diabetic retinopathy screening through telemedicine in low- and middle-income countries. Indian J. Ophthalmol. 69, 2987\u20132992 (2021).","journal-title":"Indian J. Ophthalmol."},{"key":"3139_CR9","doi-asserted-by":"publisher","unstructured":"Wong, T. Y. & Sabanayagam, C. Strategies to tackle the global burden of diabetic retinopathy: from epidemiology to artificial intelligence. Ophthalmologica https:\/\/doi.org\/10.1159\/000502387 (2020).","DOI":"10.1159\/000502387"},{"key":"3139_CR10","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1111\/j.1442-9071.2011.02599.x","volume":"40","author":"E Fenwick","year":"2012","unstructured":"Fenwick, E. et al. Social and emotional impact of diabetic retinopathy: a review. Clin. Exp. Ophthalmol. 40, 27\u201338 (2012).","journal-title":"Clin. Exp. Ophthalmol."},{"key":"3139_CR11","doi-asserted-by":"crossref","first-page":"556","DOI":"10.2337\/dc11-1909","volume":"35","author":"JWY Yau","year":"2012","unstructured":"Yau, J. W. Y. et al. Global prevalence and major risk factors of diabetic retinopathy. Diabetes Care 35, 556\u2013564 (2012).","journal-title":"Diabetes Care"},{"key":"3139_CR12","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1111\/dme.12119","volume":"30","author":"LM Ruta","year":"2013","unstructured":"Ruta, L. M. et al. Prevalence of diabetic retinopathy in type 2 diabetes in developing and developed countries. Diabet. Med 30, 387\u2013398 (2013).","journal-title":"Diabet. Med"},{"key":"3139_CR13","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/S0140-6736(09)62124-3","volume":"376","author":"N Cheung","year":"2010","unstructured":"Cheung, N., Mitchell, P. & Wong, T. Y. Diabetic retinopathy. Lancet 376, 124\u2013136 (2010).","journal-title":"Lancet"},{"key":"3139_CR14","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1111\/ceo.12696","volume":"44","author":"DSW Ting","year":"2016","unstructured":"Ting, D. S. W., Cheung, G. C. M. & Wong, T. Y. Diabetic retinopathy: global prevalence, major risk factors, screening practices and public health challenges: a review. Clin. Exp. Ophthalmol. 44, 260\u2013277 (2016).","journal-title":"Clin. Exp. Ophthalmol."},{"key":"3139_CR15","doi-asserted-by":"crossref","first-page":"1580","DOI":"10.1016\/j.ophtha.2021.04.027","volume":"128","author":"ZL Teo","year":"2021","unstructured":"Teo, Z. L. et al. Global prevalence of diabetic retinopathy and projection of burden through 2045: systematic review and meta-analysis. Ophthalmology 128, 1580\u20131591 (2021).","journal-title":"Ophthalmology"},{"key":"3139_CR16","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.preteyeres.2007.12.001","volume":"27","author":"N Cheung","year":"2008","unstructured":"Cheung, N. & Wong, T. Y. Diabetic retinopathy and systemic vascular complications. Prog. Retin. Eye Res. 27, 161\u2013176 (2008).","journal-title":"Prog. Retin. Eye Res."},{"key":"3139_CR17","doi-asserted-by":"crossref","first-page":"1608","DOI":"10.1016\/j.ophtha.2018.04.007","volume":"125","author":"TY Wong","year":"2018","unstructured":"Wong, T. Y. et al. Guidelines on diabetic eye care: the International Council of Ophthalmology recommendations for screening, follow-up, referral, and treatment based on resource settings. Ophthalmology 125, 1608\u20131622 (2018).","journal-title":"Ophthalmology"},{"key":"3139_CR18","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/S2213-8587(19)30411-5","volume":"8","author":"S Vujosevic","year":"2020","unstructured":"Vujosevic, S. et al. Screening for diabetic retinopathy: new perspectives and challenges. Lancet Diabetes Endocrinol. 8, 337\u2013347 (2020).","journal-title":"Lancet Diabetes Endocrinol."},{"key":"3139_CR19","volume":"72","author":"DSW Ting","year":"2019","unstructured":"Ting, D. S. W. et al. Deep learning in ophthalmology: the technical and clinical considerations. Prog. Retin. Eye Res. 72, 100759 (2019).","journal-title":"Prog. Retin. Eye Res."},{"key":"3139_CR20","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1097\/ICU.0000000000000693","volume":"31","author":"DV Gunasekeran","year":"2020","unstructured":"Gunasekeran, D. V., Ting, D. S. W., Tan, G. S. W. & Wong, T. Y. Artificial intelligence for diabetic retinopathy screening, prediction and management. Curr. Opin. Ophthalmol. 31, 357\u2013365 (2020).","journal-title":"Curr. Opin. Ophthalmol."},{"key":"3139_CR21","volume":"4","author":"Z Guan","year":"2023","unstructured":"Guan, Z. et al. Artificial intelligence in diabetes management: advancements, opportunities, and challenges. Cell Rep. Med 4, 101213 (2023).","journal-title":"Cell Rep. Med"},{"key":"3139_CR22","doi-asserted-by":"crossref","first-page":"2211","DOI":"10.1001\/jama.2017.18152","volume":"318","author":"DSW Ting","year":"2017","unstructured":"Ting, D. S. W. et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318, 2211\u20132223 (2017).","journal-title":"JAMA"},{"key":"3139_CR23","doi-asserted-by":"crossref","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"3139_CR24","volume":"12","author":"L Dai","year":"2021","unstructured":"Dai, L. et al. A deep learning system for detecting diabetic retinopathy across the disease spectrum. Nat. Commun. 12, 3242 (2021).","journal-title":"Nat. Commun."},{"key":"3139_CR25","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1007\/s00125-022-05727-0","volume":"65","author":"J Grauslund","year":"2022","unstructured":"Grauslund, J. Diabetic retinopathy screening in the emerging era of artificial intelligence. Diabetologia 65, 1415\u20131423 (2022).","journal-title":"Diabetologia"},{"key":"3139_CR26","doi-asserted-by":"crossref","first-page":"219","DOI":"10.4103\/2452-2325.329064","volume":"33","author":"A Sheikh","year":"2021","unstructured":"Sheikh, A., Bhatti, A., Adeyemi, O., Raja, M. & Sheikh, I. The utility of smartphone-based artificial intelligence approaches for diabetic retinopathy: a literature review and meta-analysis. J. Curr. Ophthalmol. 33, 219\u2013226 (2021).","journal-title":"J. Curr. Ophthalmol."},{"key":"3139_CR27","doi-asserted-by":"crossref","first-page":"e489","DOI":"10.1016\/S2214-109X(20)30488-5","volume":"9","author":"MJ Burton","year":"2021","unstructured":"Burton, M. J. et al. The Lancet Global Health Commission on Global Eye Health: vision beyond 2020. Lancet Glob. Health 9, e489\u2013e551 (2021).","journal-title":"Lancet Glob. Health"},{"key":"3139_CR28","unstructured":"OpenAI. GPT-4 Technical Report. Preprint at https:\/\/arxiv.org\/abs\/2303.08774 (2023)."},{"key":"3139_CR29","doi-asserted-by":"crossref","first-page":"e107","DOI":"10.1016\/S2589-7500(23)00021-3","volume":"5","author":"SB Patel","year":"2023","unstructured":"Patel, S. B. & Lam, K. ChatGPT: the future of discharge summaries? Lancet Digit. Health 5, e107\u2013e108 (2023).","journal-title":"Lancet Digit. Health"},{"key":"3139_CR30","doi-asserted-by":"crossref","first-page":"e179","DOI":"10.1016\/S2589-7500(23)00048-1","volume":"5","author":"SR Ali","year":"2023","unstructured":"Ali, S. R., Dobbs, T. D., Hutchings, H. A. & Whitaker, I. S. Using ChatGPT to write patient clinic letters. Lancet Digit. Health 5, e179\u2013e181 (2023).","journal-title":"Lancet Digit. Health"},{"key":"3139_CR31","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","volume":"620","author":"K Singhal","year":"2023","unstructured":"Singhal, K. et al. Large language models encode clinical knowledge. Nature 620, 172\u2013180 (2023).","journal-title":"Nature"},{"key":"3139_CR32","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1038\/d41586-023-00340-6","volume":"614","author":"C Stokel-Walker","year":"2023","unstructured":"Stokel-Walker, C. & Van Noorden, R. What ChatGPT and generative AI mean for science. Nature 614, 214\u2013216 (2023).","journal-title":"Nature"},{"key":"3139_CR33","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1016\/S1473-3099(23)00113-5","volume":"23","author":"A Howard","year":"2023","unstructured":"Howard, A., Hope, W. & Gerada, A. ChatGPT and antimicrobial advice: the end of the consulting infection doctor? Lancet Infect. Dis. 23, 405\u2013406 (2023).","journal-title":"Lancet Infect. Dis."},{"key":"3139_CR34","doi-asserted-by":"crossref","first-page":"e103","DOI":"10.2337\/dc23-0197","volume":"46","author":"GGR Sng","year":"2023","unstructured":"Sng, G. G. R., Tung, J. Y. M., Lim, D. Y. Z. & Bee, Y. M. Potential and pitfalls of ChatGPT and natural-language artificial intelligence models for diabetes education. Diabetes Care 46, e103\u2013e105 (2023).","journal-title":"Diabetes Care"},{"key":"3139_CR35","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1111\/aos.15661","volume":"101","author":"I Potapenko","year":"2023","unstructured":"Potapenko, I. et al. Artificial intelligence-based chatbot patient information on common retinal diseases using ChatGPT. Acta Ophthalmol. 101, 829\u2013831 (2023).","journal-title":"Acta Ophthalmol."},{"key":"3139_CR36","doi-asserted-by":"publisher","unstructured":"Waisberg, E. et al. Google\u2019s AI chatbot \u2018Bard\u2019: a side-by-side comparison with ChatGPT and its utilization in ophthalmology. Eye https:\/\/doi.org\/10.1038\/s41433-023-02760-0 (2023).","DOI":"10.1038\/s41433-023-02760-0"},{"key":"3139_CR37","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","volume":"183","author":"JW Ayers","year":"2023","unstructured":"Ayers, J. W. et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Intern. Med. 183, 589\u2013596 (2023).","journal-title":"JAMA Intern. Med."},{"key":"3139_CR38","unstructured":"Touvron, H. et al. LLaMA: open and efficient foundation language models. Preprint at https:\/\/arxiv.org\/abs\/2302.13971v1 (2023)."},{"key":"3139_CR39","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","volume":"29","author":"AJ Thirunavukarasu","year":"2023","unstructured":"Thirunavukarasu, A. J. et al. Large language models in medicine. Nat. Med. 29, 1930\u20131940 (2023).","journal-title":"Nat. Med."},{"key":"3139_CR40","doi-asserted-by":"crossref","first-page":"e059205","DOI":"10.1136\/bmjopen-2021-059205","volume":"12","author":"K Curran","year":"2022","unstructured":"Curran, K. et al. Impact of targeted diabetic retinopathy training for graders in Vietnam and the implications for future diabetic retinopathy screening programmes: a diagnostic test accuracy study. BMJ Open 12, e059205 (2022).","journal-title":"BMJ Open"},{"key":"3139_CR41","doi-asserted-by":"crossref","first-page":"2571","DOI":"10.1016\/j.ophtha.2016.08.021","volume":"123","author":"HV Nguyen","year":"2016","unstructured":"Nguyen, H. V. et al. Cost-effectiveness of a national telemedicine diabetic retinopathy screening program in Singapore. Ophthalmology 123, 2571\u20132580 (2016).","journal-title":"Ophthalmology"},{"key":"3139_CR42","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1007\/s00592-021-01687-w","volume":"58","author":"PH Scanlon","year":"2021","unstructured":"Scanlon, P. H. The contribution of the English NHS Diabetic Eye Screening Programme to reductions in diabetes-related blindness, comparisons within Europe, and future challenges. Acta Diabetol. 58, 521\u2013530 (2021).","journal-title":"Acta Diabetol."},{"key":"3139_CR43","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1007\/s00592-017-0974-1","volume":"54","author":"PH Scanlon","year":"2017","unstructured":"Scanlon, P. H. The English National Screening Programme for diabetic retinopathy 2003\u20132016. Acta Diabetol. 54, 515\u2013525 (2017).","journal-title":"Acta Diabetol."},{"key":"3139_CR44","doi-asserted-by":"crossref","first-page":"S5","DOI":"10.2337\/dc23-Srev","volume":"46","author":"NA ElSayed","year":"2023","unstructured":"ElSayed, N. A. et al. Summary of revisions: standards of care in diabetes\u20142023. Diabetes Care 46, S5\u2013S9 (2023).","journal-title":"Diabetes Care"},{"key":"3139_CR45","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1007\/s40123-018-0153-7","volume":"7","author":"BJ Fenner","year":"2018","unstructured":"Fenner, B. J., Wong, R. L. M., Lam, W.-C., Tan, G. S. W. & Cheung, G. C. M. Advances in retinal imaging and applications in diabetic retinopathy screening: a review. Ophthalmol. Ther. 7, 333\u2013346 (2018).","journal-title":"Ophthalmol. Ther."},{"key":"3139_CR46","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1038\/s41746-022-00597-7","volume":"5","author":"KE Henry","year":"2022","unstructured":"Henry, K. E. et al. Human-machine teaming is key to AI adoption: clinicians\u2019 experiences with a deployed machine learning system. NPJ Digit. Med. 5, 97 (2022).","journal-title":"NPJ Digit. Med."},{"key":"3139_CR47","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","volume":"28","author":"P Rajpurkar","year":"2022","unstructured":"Rajpurkar, P., Chen, E., Banerjee, O. & Topol, E. J. AI in health and medicine. Nat. Med. 28, 31\u201338 (2022).","journal-title":"Nat. Med."},{"key":"3139_CR48","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1016\/j.scib.2024.01.004","volume":"69","author":"B Sheng","year":"2024","unstructured":"Sheng, B. et al. Large language models for diabetes care: potentials and prospects. Sci. Bull. 69, 583\u2013588 (2024).","journal-title":"Sci. Bull."},{"key":"3139_CR49","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1007\/s11684-021-0897-7","volume":"16","author":"C Cai","year":"2022","unstructured":"Cai, C. et al. Effectiveness of quality of care for patients with type 2 diabetes in China: findings from the Shanghai Integration Model (SIM). Front. Med. 16, 126\u2013138 (2022).","journal-title":"Front. Med."},{"key":"3139_CR50","volume":"14","author":"X Hou","year":"2023","unstructured":"Hou, X. et al. Prevalence of diabetic retinopathy and vision-threatening diabetic retinopathy in adults with diabetes in China. Nat. Commun. 14, 4296 (2023).","journal-title":"Nat. Commun."},{"key":"3139_CR51","doi-asserted-by":"crossref","first-page":"1675","DOI":"10.1016\/j.ophtha.2019.06.016","volume":"126","author":"Z Sun","year":"2019","unstructured":"Sun, Z. et al. OCT angiography metrics predict progression of diabetic retinopathy and development of diabetic macular edema: a prospective study. Ophthalmology 126, 1675\u20131684 (2019).","journal-title":"Ophthalmology"},{"key":"3139_CR52","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1093\/ije\/dyaa238","volume":"50","author":"S Majithia","year":"2021","unstructured":"Majithia, S. et al. Cohort Profile: The Singapore Epidemiology of Eye Diseases study (SEED). Int. J. Epidemiol. 50, 41\u201352 (2021).","journal-title":"Int. J. Epidemiol."},{"key":"3139_CR53","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1080\/09286586.2017.1290257","volume":"24","author":"R Raman","year":"2017","unstructured":"Raman, R. et al. Incidence and progression of diabetic retinopathy in urban India: Sankara nethralaya-diabetic retinopathy epidemiology and molecular genetics study (SN-DREAMS II), Report 1. Ophthalm. Epidemiol. 24, 294\u2013302 (2017).","journal-title":"Ophthalm. Epidemiol."},{"key":"3139_CR54","doi-asserted-by":"crossref","first-page":"e235","DOI":"10.1016\/S2589-7500(22)00017-6","volume":"4","author":"P Ruamviboonsuk","year":"2022","unstructured":"Ruamviboonsuk, P. et al. Real-time diabetic retinopathy screening by deep learning in a multisite national screening programme: a prospective interventional cohort study. Lancet Digit. Health 4, e235\u2013e244 (2022).","journal-title":"Lancet Digit. Health"},{"key":"3139_CR55","doi-asserted-by":"crossref","first-page":"1677","DOI":"10.1016\/S0161-6420(03)00475-5","volume":"110","author":"C Wilkinson","year":"2003","unstructured":"Wilkinson, C. et al. Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. Ophthalmology 110, 1677\u20131682 (2003).","journal-title":"Ophthalmology"},{"key":"3139_CR56","doi-asserted-by":"crossref","unstructured":"Early Treatment Diabetic Retinopathy Study research group. Photocoagulation for diabetic macular edema. Early Treatment Diabetic Retinopathy Study report number 1. Arch. Ophthalmol. 103, 1796\u20131806 (1985).","DOI":"10.1001\/archopht.1985.01050120030015"},{"key":"3139_CR57","doi-asserted-by":"crossref","unstructured":"American Diabetes Association Professional Practice Committee. 2. Classification and diagnosis of diabetes: standards of medical care in diabetes\u20142022. Diabetes Care 45, S17\u2013S38 (2022).","DOI":"10.2337\/dc22-S002"},{"key":"3139_CR58","unstructured":"Cui, Y., Yang, Z. & Yao, X. Efficient and effective text encoding for Chinese LLaMA and Alpaca. Preprint at https:\/\/arxiv.org\/abs\/2304.08177v3 (2023)."},{"key":"3139_CR59","unstructured":"Hu, E. J. et al. LoRA: low-rank adaptation of large language models. Preprint at https:\/\/arxiv.org\/abs\/2106.09685v2 (2021)."},{"key":"3139_CR60","unstructured":"Houlsby, N. et al. Parameter-efficient transfer learning for NLP. Preprint at https:\/\/arxiv.org\/abs\/1902.00751v2 (2019)."},{"key":"3139_CR61","unstructured":"Dosovitskiy, A. et al. An image is worth 16\u2009\u00d7\u200916 words: transformers for image recognition at scale. Preprint at https:\/\/arxiv.org\/abs\/2010.11929v2 (2020)."},{"key":"3139_CR62","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. ImageNet: a large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition 248\u2013255 (IEEE, 2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"3139_CR63","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","volume":"22","author":"SJ Pan","year":"2010","unstructured":"Pan, S. J. & Yang, Q. A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 1345\u20131359 (2010).","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"3139_CR64","unstructured":"Chinese Diabetes Society and National Office for Primary Diabetes Care. National guidelines for the prevention and control of diabetes in primary care (2022). Chin. J. Intern. Med. 61, 249\u2013262 (2022)."},{"key":"3139_CR65","doi-asserted-by":"publisher","unstructured":"Li, J. Integrated image-based deep learning and language models for primary diabetes care. Zenodo https:\/\/doi.org\/10.5281\/zenodo.11501225 (2024).","DOI":"10.5281\/zenodo.11501225"}],"container-title":["Nature Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41591-024-03139-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41591-024-03139-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41591-024-03139-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,16]],"date-time":"2024-10-16T18:06:20Z","timestamp":1729101980000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41591-024-03139-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,19]]},"references-count":65,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["3139"],"URL":"https:\/\/doi.org\/10.1038\/s41591-024-03139-8","relation":{},"ISSN":["1078-8956","1546-170X"],"issn-type":[{"value":"1078-8956","type":"print"},{"value":"1546-170X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,19]]},"assertion":[{"value":"26 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}