{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T07:43:47Z","timestamp":1777275827583,"version":"3.51.4"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T00:00:00Z","timestamp":1696377600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T00:00:00Z","timestamp":1696377600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"The project was supported by Orbis International and the Global Vision Foundation."}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Autonomous artificial intelligence (AI) promises to increase healthcare productivity, but real-world evidence is lacking. We developed a clinic productivity model to generate testable hypotheses and study design for a preregistered cluster-randomized clinical trial, in which we tested the hypothesis that a previously validated US FDA-authorized AI for diabetic eye exams increases clinic productivity (number of completed care encounters per hour per specialist physician) among patients with diabetes. Here we report that 105 clinic days are cluster randomized to either intervention (using AI diagnosis; 51 days; 494 patients) or control (not using AI diagnosis; 54 days; 499 patients). The prespecified primary endpoint is met: AI leads to 40% higher productivity (1.59 encounters\/hour, 95% confidence interval [CI]: 1.37\u20131.80) than control (1.14 encounters\/hour, 95% CI: 1.02\u20131.25), <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.00; the secondary endpoint (productivity in all patients) is also met. Autonomous AI increases healthcare system productivity, which could potentially increase access and reduce health disparities. ClinicalTrials.gov NCT05182580.<\/jats:p>","DOI":"10.1038\/s41746-023-00931-7","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T19:01:54Z","timestamp":1696446114000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":59,"title":["Autonomous artificial intelligence increases real-world specialist clinic productivity in a cluster-randomized trial"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3490-0037","authenticated-orcid":false,"given":"Michael D.","family":"Abramoff","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3355-3878","authenticated-orcid":false,"given":"Noelle","family":"Whitestone","sequence":"additional","affiliation":[]},{"given":"Jennifer L.","family":"Patnaik","sequence":"additional","affiliation":[]},{"given":"Emily","family":"Rich","sequence":"additional","affiliation":[]},{"given":"Munir","family":"Ahmed","sequence":"additional","affiliation":[]},{"given":"Lutful","family":"Husain","sequence":"additional","affiliation":[]},{"given":"Mohammad Yeadul","family":"Hassan","sequence":"additional","affiliation":[]},{"given":"Md. Sajidul Huq","family":"Tanjil","sequence":"additional","affiliation":[]},{"given":"Dena","family":"Weitzman","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9248-5153","authenticated-orcid":false,"given":"Tinglong","family":"Dai","sequence":"additional","affiliation":[]},{"given":"Brandie D.","family":"Wagner","sequence":"additional","affiliation":[]},{"given":"David H.","family":"Cherwek","sequence":"additional","affiliation":[]},{"given":"Nathan","family":"Congdon","sequence":"additional","affiliation":[]},{"given":"Khairul","family":"Islam","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"931_CR1","doi-asserted-by":"publisher","first-page":"1681","DOI":"10.1056\/NEJMp2008628","volume":"384","author":"RJ Lavizzo-Mourey","year":"2021","unstructured":"Lavizzo-Mourey, R. J., Besser, R. E. & Williams, D. R. Understanding and mitigating health inequities\u2014past, current, and future directions. N. Engl. J. Med. 384, 1681\u20131684 (2021).","journal-title":"N. Engl. J. Med."},{"key":"931_CR2","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1080\/13576280600937911","volume":"19","author":"JJ Guilbert","year":"2006","unstructured":"Guilbert, J. J. The World Health Report 2006: working together for health. Educ. Health 19, 385\u2013387 (2006).","journal-title":"Educ. Health"},{"key":"931_CR3","doi-asserted-by":"publisher","DOI":"10.1186\/1478-4491-2-13","volume":"2","author":"P Zurn","year":"2004","unstructured":"Zurn, P., Dal Poz, M. R., Stilwell, B. & Adams, O. Imbalance in the health workforce. Hum. Resour. Health 2, 13 (2004).","journal-title":"Hum. Resour. Health"},{"key":"931_CR4","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1377\/hlthaff.14.2.248","volume":"14","author":"RM Monaco","year":"1995","unstructured":"Monaco, R. M. & Phelps, J. H. Health care prices, the federal budget, and economic growth. Health Aff. 14, 248\u2013259 (1995).","journal-title":"Health Aff."},{"key":"931_CR5","doi-asserted-by":"publisher","first-page":"1984","DOI":"10.1016\/S0140-6736(04)17482-5","volume":"364","author":"L Chen","year":"2004","unstructured":"Chen, L. et al. Human resources for health: overcoming the crisis. Lancet 364, 1984\u20131990 (2004).","journal-title":"Lancet"},{"key":"931_CR6","unstructured":"O\u2019Brien, P. & Gostin, L. Health worker shortages and global justice. Health Worker Shortages and Global Justice, Millbank Memorial Fund. (2011). https:\/\/www.milbank.org\/publications\/health-worker-shortages-and-global-justice\/."},{"key":"931_CR7","doi-asserted-by":"publisher","first-page":"784","DOI":"10.1111\/j.1475-6773.2008.00942.x","volume":"44","author":"PS Hussey","year":"2009","unstructured":"Hussey, P. S. et al. A systematic review of health care efficiency measures. Health Serv. Res. 44, 784\u2013805 (2009).","journal-title":"Health Serv. Res."},{"key":"931_CR8","first-page":"163","volume":"2","author":"J Backman","year":"1949","unstructured":"Backman, J. & Gainsbrugh, M. Productivity and living standards. Ind. Labor Relat. Rev. 2, 163\u2013194 (1949).","journal-title":"Ind. Labor Relat. Rev."},{"key":"931_CR9","unstructured":"Baumol, W. J. The Cost Disease: Why Computers Get Cheaper and Health Care Doesn\u2019t (Yale University Press, 2012)."},{"key":"931_CR10","unstructured":"US Bureau of Labor Statistics. Major Sector Productivity and Costs, Vol. 2017 (US Department of Labor, Bureau of Labor Statistics, 2017)."},{"key":"931_CR11","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1108\/IJHCQA-04-2015-0050","volume":"29","author":"VJ Kamarainen","year":"2016","unstructured":"Kamarainen, V. J., Peltokorpi, A., Torkki, P. & Tallbacka, K. Measuring healthcare productivity\u2014from unit to system level. Int. J. Health Care Qual. Assur. 29, 288\u2013299 (2016).","journal-title":"Int. J. Health Care Qual. Assur."},{"key":"931_CR12","doi-asserted-by":"publisher","first-page":"2274","DOI":"10.1001\/jama.2019.19695","volume":"322","author":"AB Frakt","year":"2019","unstructured":"Frakt, A. B. Making health care more productive. JAMA 322, 2274\u20132275 (2019).","journal-title":"JAMA"},{"key":"931_CR13","first-page":"39","volume":"1","author":"MD Abr\u00e0moff","year":"2018","unstructured":"Abr\u00e0moff, M. D., Lavin, P. T., Birch, M., Shah, N. & Folk, J. C. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. Nat. Digit. Med. 1, 39 (2018).","journal-title":"Nat. Digit. Med."},{"key":"931_CR14","unstructured":"U.S. Food & Drug Administration (FDA). FDA Permits Marketing of Artificial Intelligence-based Device to Detect Certain Diabetes-related Eye Problems. https:\/\/www.fda.gov\/newsevents\/newsroom\/pressannouncements\/ucm604357.htm (FDA, 2018)."},{"key":"931_CR15","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1038\/s41746-022-00621-w","volume":"5","author":"MD Abramoff","year":"2022","unstructured":"Abramoff, M. D. et al. A reimbursement framework for artificial intelligence in healthcare. NPJ Digit. Med. 5, 72 (2022).","journal-title":"NPJ Digit. Med."},{"key":"931_CR16","unstructured":"Centers for Medicare & Medicaid Services. Proposal to Establish Values for Remote Retinal Imaging (CPT code 92229) (Pages 56ff). Medicare Program; CY 2022 Payment Policies under the Physician Fee Schedule (2021)."},{"key":"931_CR17","unstructured":"Lorenzoni, L., Marino, A., Morgan, D. & James, C. Health Spending Projections to 2030: New Results Based on a Revised OECD Methodology. OECD Working Papers no. 110 (2019)."},{"key":"931_CR18","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1017\/S1744133114000127","volume":"9","author":"G Bevan","year":"2014","unstructured":"Bevan, G. & Brown, L. D. The political economy of rationing health care in England and the US: the \u2018accidental logics\u2019 of political settlements. Health Econ. Policy Law 9, 273\u2013294 (2014).","journal-title":"Health Econ. Policy Law"},{"key":"931_CR19","doi-asserted-by":"publisher","first-page":"2551","DOI":"10.1056\/NEJMhpr1310415","volume":"369","author":"D Blumenthal","year":"2013","unstructured":"Blumenthal, D., Stremikis, K. & Cutler, D. Health care spending\u2014a giant slain or sleeping? N. Engl. J. Med. 369, 2551\u20132557 (2013).","journal-title":"N. Engl. J. Med."},{"key":"931_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1086\/655816","volume":"11","author":"DM Cutler","year":"2011","unstructured":"Cutler, D. M. Where are the health care entrepreneurs? The failure of organizational innovation in health care. Innov. Policy Econ. 11, 1\u201328 (2011).","journal-title":"Innov. Policy Econ."},{"key":"931_CR21","doi-asserted-by":"crossref","unstructured":"Oliner, S. D., Sichel, D. E. & Stiroh, K. J. Explaining a Productive Decade. FEDS Working Paper No. 2007-63 (2007).","DOI":"10.2139\/ssrn.1160248"},{"key":"931_CR22","doi-asserted-by":"crossref","unstructured":"Bhargava, H. K. & Mishra, A. Electronic Medical Records and Physician Productivity: Evidence from Panel Data Analysis (Social Science Research Network, 2011).","DOI":"10.2139\/ssrn.1952287"},{"key":"931_CR23","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1080\/15265161.2020.1819469","volume":"20","author":"DS Char","year":"2020","unstructured":"Char, D. S., Abr\u00e0moff, M. D. & Feudtner, C. Identifying ethical considerations for machine learning healthcare applications. Am. J. Bioeth. 20, 7\u201317 (2020).","journal-title":"Am. J. Bioeth."},{"key":"931_CR24","doi-asserted-by":"publisher","first-page":"e14","DOI":"10.1016\/j.ophtha.2021.08.023","volume":"129","author":"MD Abramoff","year":"2022","unstructured":"Abramoff, M. D. et al. Foundational considerations for artificial intelligence using ophthalmic images. Ophthalmology 129, e14\u2013e32 (2022).","journal-title":"Ophthalmology"},{"key":"931_CR25","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1038\/s41746-023-00913-9","volume":"6","author":"MD Abramoff","year":"2023","unstructured":"Abramoff, M. D. et al. Considerations for addressing bias in artificial intelligence for health equity. NPJ Digit Med. 6, 170 (2023).","journal-title":"NPJ Digit Med"},{"key":"931_CR26","doi-asserted-by":"publisher","first-page":"e0139148","DOI":"10.1371\/journal.pone.0139148","volume":"10","author":"MB Hansen","year":"2015","unstructured":"Hansen, M. B. et al. Results of automated retinal image analysis for detection of diabetic retinopathy from the Nakuru Study, Kenya. PLoS ONE 10, e0139148 (2015).","journal-title":"PLoS ONE"},{"key":"931_CR27","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1038\/s41746-023-00785-z","volume":"6","author":"R Channa","year":"2023","unstructured":"Channa, R., Wolf, R. M., Abramoff, M. D. & Lehmann, H. P. Effectiveness of artificial intelligence screening in preventing vision loss from diabetes: a policy model. NPJ Digit. Med. 6, 53 (2023).","journal-title":"NPJ Digit. Med."},{"key":"931_CR28","doi-asserted-by":"publisher","first-page":"109119","DOI":"10.1016\/j.diabres.2021.109119","volume":"183","author":"H Sun","year":"2022","unstructured":"Sun, H. et al. IDF Diabetes Atlas: global, regional and country-level diabetes prevalence estimates for 2021 and projections for 2045. Diabetes Res. Clin. Pr. 183, 109119 (2022).","journal-title":"Diabetes Res. Clin. Pr."},{"key":"931_CR29","doi-asserted-by":"publisher","first-page":"1680","DOI":"10.1056\/NEJMp2200089","volume":"386","author":"J Concato","year":"2022","unstructured":"Concato, J. & Corrigan-Curay, J. Real-world evidence\u2014where are we now? N. Engl. J. Med. 386, 1680\u20131682 (2022).","journal-title":"N. Engl. J. Med."},{"key":"931_CR30","doi-asserted-by":"crossref","unstructured":"Hassin, R. Rational Queueing 1st edn (Chapman and Hall\/CRC, 2016).","DOI":"10.1201\/b20014"},{"key":"931_CR31","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1287\/msom.2019.0778","volume":"22","author":"T Dai","year":"2019","unstructured":"Dai, T. & Tayur, S. Healthcare operations management: a snapshot of emerging research. Manuf. Serv. Oper. Manag. 22, 869\u2013887 (2019).","journal-title":"Manuf. Serv. Oper. Manag."},{"key":"931_CR32","doi-asserted-by":"crossref","unstructured":"Fundus photographic risk factors for progression of diabetic retinopathy. ETDRS report number 12. Early Treatment Diabetic Retinopathy Study Research Group. Ophthalmology 98, 823\u2013833 (1991).","DOI":"10.1016\/S0161-6420(13)38014-2"},{"key":"931_CR33","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1167\/iovs.17-21873","volume":"59","author":"MD Abramoff","year":"2018","unstructured":"Abramoff, M. D. et al. Approach for a clinically useful comprehensive classification of vascular and neural aspects of diabetic retinal disease. Invest. Ophthalmol. Vis. Sci. 59, 519\u2013527 (2018).","journal-title":"Invest. Ophthalmol. Vis. Sci."},{"key":"931_CR34","unstructured":"American Academy of Ophthalmology Retina\/Vitreous Panel & Hoskins Center for Quality Eye Care. Preferred Practice Patterns: Diabetic Retinopathy (ed. American Academy of Ophthalmology Retina Panel) (American Academy of Ophthalmology, 2016)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00931-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00931-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00931-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,21]],"date-time":"2023-11-21T12:14:30Z","timestamp":1700568870000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00931-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,4]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["931"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00931-7","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,4]]},"assertion":[{"value":"8 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"M.D.A. reports the following conflicts of interest: Investor, Director, Consultant, Digital Diagnostics Inc., Coralville, Iowa, USA; patents and patent applications assigned to the University of Iowa and Digital Diagnostics that are relevant to the subject matter of this manuscript; Chair, Healthcare AI Coalition, Washington DC; member, American Academy of Ophthalmology (AAO) AI Committee; member, AI Workgroup Digital Medicine Payment Advisory Group (DMPAG); member, Collaborative Community for Ophthalmic Imaging (CCOI), Washington DC; Chair, Foundational Principles of AI CCOI Workgroup. D.W. is an employee of Digital Diagnostics. The other authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"184"}}