{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T02:47:37Z","timestamp":1779158857132,"version":"3.51.4"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T00:00:00Z","timestamp":1709769600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"name":"Universit\u00e9 Paris Cit\u00e9","award":["ANR-18-IDEX-0001"],"award-info":[{"award-number":["ANR-18-IDEX-0001"]}]},{"name":"French Agence Nationale de la Recherche","award":["ANR-22-CPJ1-0047-01"],"award-info":[{"award-number":["ANR-22-CPJ1-0047-01"]}]},{"name":"French Agence Nationale de la Recherche"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,4,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>The timely initiation of renal replacement therapy (RRT) for acute kidney injury (AKI) requires sequential decision-making tailored to individuals\u2019 evolving characteristics. To learn and validate optimal strategies for RRT initiation, we used reinforcement learning on clinical data from routine care and randomized controlled trials.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and methods<\/jats:title>\n                    <jats:p>We used the MIMIC-III database for development and AKIKI trials for validation. Participants were adult ICU patients with severe AKI receiving mechanical ventilation or catecholamine infusion. We used a doubly robust estimator to learn when to start RRT after the occurrence of severe AKI for three days in a row. We developed a \u201ccrude strategy\u201d maximizing the population-level hospital-free days at day 60 (HFD60) and a \u201cstringent strategy\u201d recommending RRT when there is significant evidence of benefit for an individual. For validation, we evaluated the causal effects of implementing our learned strategies versus following current best practices on HFD60.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We included 3748 patients in the development set and 1068 in the validation set. Through external validation, the crude and stringent strategies yielded an average difference of 13.7 [95% CI \u22125.3 to 35.7] and 14.9 [95% CI \u22123.2 to 39.2] HFD60, respectively, compared to current best practices. The stringent strategy led to initiating RRT within 3 days in 14% of patients versus 38% under best practices.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Implementing our strategies could improve the average number of days that ICU patients spend alive and outside the hospital while sparing RRT for many.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>We developed and validated a practical and interpretable dynamic decision support system for RRT initiation in the ICU.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocae004","type":"journal-article","created":{"date-parts":[[2024,1,17]],"date-time":"2024-01-17T00:48:41Z","timestamp":1705452521000},"page":"1074-1083","source":"Crossref","is-referenced-by-count":12,"title":["Personalizing renal replacement therapy initiation in the intensive care unit: a reinforcement learning-based strategy with external validation on the AKIKI randomized controlled trials"],"prefix":"10.1093","volume":"31","author":[{"given":"Fran\u00e7ois","family":"Grolleau","sequence":"first","affiliation":[{"name":"Universit\u00e9 Paris Cit\u00e9 and Universit\u00e9 Sorbonne Paris Nord, INSERM, INRAE, Center for Research in Epidemiology and StatisticS (CRESS) , Paris, F-75004, France"},{"name":"Centre d\u2019Epid\u00e9miologie Clinique, AP-HP, H\u00f4pital H\u00f4tel Dieu , Paris, F-75004, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fran\u00e7ois","family":"Petit","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Cit\u00e9 and Universit\u00e9 Sorbonne Paris Nord, INSERM, INRAE, Center for Research in Epidemiology and StatisticS (CRESS) , Paris, F-75004, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"St\u00e9phane","family":"Gaudry","sequence":"additional","affiliation":[{"name":"Service de R\u00e9animation M\u00e9dico-Chirurgicale, AP-HP, H\u00f4pital Avicenne, Universit\u00e9 Sorbonne Paris Nord , Bobigny, 93430, France"},{"name":"Health Care Simulation Center, UFR SMBH, Sorbonne Paris Cit\u00e9 , Bobigny, 93017, France"},{"name":"INSERM UMR S1155, Sorbonne Universit\u00e9, CORAKID, H\u00f4pital Tenon , Paris, 75020, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u00c9lise","family":"Diard","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Cit\u00e9 and Universit\u00e9 Sorbonne Paris Nord, INSERM, INRAE, Center for Research in Epidemiology and StatisticS (CRESS) , Paris, F-75004, France"},{"name":"Centre d\u2019Epid\u00e9miologie Clinique, AP-HP, H\u00f4pital H\u00f4tel Dieu , Paris, F-75004, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jean-Pierre","family":"Quenot","sequence":"additional","affiliation":[{"name":"Department of Intensive Care, Fran\u00e7ois Mitterrand University Hospital , Dijon, 21000, France"},{"name":"Lipness Team, INSERM Research Center, LNC-UMR1231 and LabEx LipSTIC , Dijon, 21000, France"},{"name":"INSERM CIC 1432, Clinical Epidemiology, University of Burgundy , Dijon, 21000, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Didier","family":"Dreyfuss","sequence":"additional","affiliation":[{"name":"INSERM UMR S1155, Sorbonne Universit\u00e9, CORAKID, H\u00f4pital Tenon , Paris, 75020, France"},{"name":"Service de M\u00e9decine Intensive-R\u00e9animation, Sorbonne Universit\u00e9, H\u00f4pital Louis Mourier, AP-HP, Universit\u00e9 Paris-Cit\u00e9 , Paris, F-75018, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Viet-Thi","family":"Tran","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Cit\u00e9 and Universit\u00e9 Sorbonne Paris Nord, INSERM, INRAE, Center for Research in Epidemiology and StatisticS (CRESS) , Paris, F-75004, France"},{"name":"Centre d\u2019Epid\u00e9miologie Clinique, AP-HP, H\u00f4pital H\u00f4tel Dieu , Paris, F-75004, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5277-4679","authenticated-orcid":false,"given":"Rapha\u00ebl","family":"Porcher","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Cit\u00e9 and Universit\u00e9 Sorbonne Paris Nord, INSERM, INRAE, Center for Research in Epidemiology and StatisticS (CRESS) , Paris, F-75004, France"},{"name":"Centre d\u2019Epid\u00e9miologie Clinique, AP-HP, H\u00f4pital H\u00f4tel Dieu , Paris, F-75004, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,3,7]]},"reference":[{"issue":"8","key":"2024041923353079400_ocae004-B1","doi-asserted-by":"crossref","first-page":"1411","DOI":"10.1007\/s00134-015-3934-7","article-title":"Epidemiology of acute kidney injury in critically ill patients: the multinational AKI-EPI study","volume":"41","author":"Hoste","year":"2015","journal-title":"Intensive Care Med"},{"issue":"10","key":"2024041923353079400_ocae004-B2","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1056\/NEJMra2104090","article-title":"Extracorporeal kidney-replacement therapy for acute kidney injury","volume":"386","author":"Gaudry","year":"2022","journal-title":"N Engl J Med"},{"issue":"10212","key":"2024041923353079400_ocae004-B3","doi-asserted-by":"crossref","first-page":"1949","DOI":"10.1016\/S0140-6736(19)32563-2","article-title":"Acute kidney injury","volume":"394","author":"Ronco","year":"2019","journal-title":"Lancet"},{"issue":"2","key":"2024041923353079400_ocae004-B4","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.kint.2020.04.020","article-title":"Controversies in acute kidney injury: conclusions from a Kidney Disease: Improving Global Outcomes (KDIGO) Conference","volume":"98","author":"Ostermann","year":"2020","journal-title":"Kidney Int"},{"issue":"2","key":"2024041923353079400_ocae004-B5","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1056\/NEJMoa1603017","article-title":"Initiation strategies for renal-replacement therapy in the intensive care unit","volume":"375","author":"Gaudry","year":"2016","journal-title":"N Engl J Med"},{"issue":"15","key":"2024041923353079400_ocae004-B6","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.1056\/NEJMoa1803213","article-title":"Timing of renal-replacement therapy in patients with acute kidney injury and sepsis","volume":"379","author":"Barbar","year":"2018","journal-title":"N Engl J Med"},{"issue":"3","key":"2024041923353079400_ocae004-B7","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1056\/NEJMoa2000741","article-title":"Timing of initiation of renal-replacement therapy in acute kidney injury","volume":"383","author":"STARRT-AKI Investigators Canadian Critical Care Trials Group, Australian and New Zealand Intensive Care Society Clinical Trials Group","year":"2020","journal-title":"N Engl J Med"},{"issue":"12","key":"2024041923353079400_ocae004-B8","first-page":"CD010612","article-title":"Timing of renal replacement therapy initiation for acute kidney injury","volume":"12","author":"Fayad","year":"2018","journal-title":"Cochrane Database Syst Rev"},{"issue":"10235","key":"2024041923353079400_ocae004-B9","doi-asserted-by":"crossref","first-page":"1506","DOI":"10.1016\/S0140-6736(20)30531-6","article-title":"Delayed versus early initiation of renal replacement therapy for severe acute kidney injury: a systematic review and individual patient data meta-analysis of randomised clinical trials","volume":"395","author":"Gaudry","year":"2020","journal-title":"Lancet"},{"issue":"4","key":"2024041923353079400_ocae004-B10","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1164\/rccm.201908-1595WS","article-title":"Identifying clinical research priorities in adult pulmonary and critical care. NHLBI working group report","volume":"202","author":"Semler","year":"2020","journal-title":"Am J Respir Crit Care Med"},{"issue":"1","key":"2024041923353079400_ocae004-B11","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1093\/jamia\/ocac143","article-title":"Computer clinical decision support that automates personalized clinical care: a challenging but needed healthcare delivery strategy","volume":"30","author":"Morris","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2024041923353079400_ocae004-B12","first-page":"1","article-title":"Precision medicine and its imprecise history","volume":"2","author":"Phillips","year":"2020","journal-title":"Harvard Data Sci Rev"},{"issue":"16","key":"2024041923353079400_ocae004-B13","doi-asserted-by":"crossref","first-page":"1673","DOI":"10.1056\/NEJMoa052122","article-title":"Trastuzumab plus adjuvant chemotherapy for operable HER2-positive breast cancer","volume":"353","author":"Romond","year":"2005","journal-title":"N Engl J Med"},{"issue":"9","key":"2024041923353079400_ocae004-B14","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1164\/rccm.201810-1906CP","article-title":"Timing of renal replacement therapy for severe acute kidney injury in critically Ill patients","volume":"199","author":"Gaudry","year":"2019","journal-title":"Am J Respir Crit Care Med"},{"issue":"1","key":"2024041923353079400_ocae004-B15","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1186\/s13054-021-03600-x","article-title":"When should we start renal-replacement therapy in critically ill patients with acute kidney injury: do we finally have the answer?","volume":"25","author":"Bagshaw","year":"2021","journal-title":"Critical Care"},{"issue":"7","key":"2024041923353079400_ocae004-B16","doi-asserted-by":"crossref","first-page":"814","DOI":"10.1164\/rccm.201810-2032ED","article-title":"Precision medicine in acute kidney injury: a promising future?","volume":"199","author":"Schaub","year":"2019","journal-title":"Am J Respir Crit Care Med"},{"issue":"1","key":"2024041923353079400_ocae004-B17","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1186\/s13054-022-03936-y","article-title":"Personalization of renal replacement therapy initiation: a secondary analysis of the AKIKI and IDEAL-ICU trials","volume":"26","author":"Grolleau","year":"2022","journal-title":"Critical Care"},{"issue":"3","key":"2024041923353079400_ocae004-B18","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1007\/s13142-014-0265-0","article-title":"Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research","volume":"4","author":"Almirall","year":"2014","journal-title":"Transl Behav Med"},{"key":"2024041923353079400_ocae004-B19","doi-asserted-by":"crossref","DOI":"10.1201\/9780429192692","volume-title":"Dynamic Treatment Regimes: Statistical Methods for Precision Medicine","author":"Tsiatis","year":"2019"},{"issue":"533","key":"2024041923353079400_ocae004-B20","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1080\/01621459.2020.1831925","article-title":"Learning when-to-treat policies","volume":"116","author":"Nie","year":"2021","journal-title":"J Am Stat Assoc"},{"issue":"10","key":"2024041923353079400_ocae004-B21","doi-asserted-by":"crossref","first-page":"1722","DOI":"10.1093\/jamia\/ocac088","article-title":"Optimizing the dynamic treatment regime of in-hospital warfarin anticoagulation in patients after surgical valve replacement using reinforcement learning","volume":"29","author":"Zeng","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2024041923353079400_ocae004-B22","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1186\/s13054-022-04252-1","article-title":"Timing of dialysis in acute kidney injury using routinely collected data and dynamic treatment regimes","volume":"26","author":"Morzywo\u0142ek","year":"2022","journal-title":"Crit Care"},{"issue":"1","key":"2024041923353079400_ocae004-B23","doi-asserted-by":"crossref","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Sci Data"},{"issue":"1","key":"2024041923353079400_ocae004-B24","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1093\/jamia\/ocx084","article-title":"The MIMIC code repository: enabling reproducibility in critical care research","volume":"25","author":"Johnson","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"10281","key":"2024041923353079400_ocae004-B25","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1016\/S0140-6736(21)00350-0","article-title":"Comparison of two delayed strategies for renal replacement therapy initiation for severe acute kidney injury (AKIKI 2): a multicentre, open-label, randomised, controlled trial","volume":"397","author":"Gaudry","year":"2021","journal-title":"Lancet"},{"issue":"1","key":"2024041923353079400_ocae004-B26","first-page":"1","article-title":"KDIGO clinical practice guideline for acute kidney injury","volume":"2","author":"Kidney Disease: Improving Global Outcomes (KDIGO) Acute Kidney Injury Work Group","year":"2012","journal-title":"Kidney Int Suppl"},{"issue":"11","key":"2024041923353079400_ocae004-B27","doi-asserted-by":"crossref","first-page":"e1063","DOI":"10.1097\/CCM.0000000000005337","article-title":"Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021","volume":"49","author":"Evans","year":"2021","journal-title":"Crit Care Med"},{"issue":"8","key":"2024041923353079400_ocae004-B28","doi-asserted-by":"crossref","first-page":"902","DOI":"10.1164\/rccm.202104-1063PP","article-title":"Hospital-free days: a pragmatic and patient-centered outcome for trials among critically and seriously ill patients","volume":"204","author":"Auriemma","year":"2021","journal-title":"Am J Respir Crit Care Med"},{"key":"2024041923353079400_ocae004-B29","first-page":"469","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton","year":"2018"},{"issue":"3","key":"2024041923353079400_ocae004-B30","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1111\/biom.12306","article-title":"Doubly-robust dynamic treatment regimen estimation via weighted least squares","volume":"71","author":"Wallace","year":"2015","journal-title":"Biometrics"},{"issue":"8","key":"2024041923353079400_ocae004-B31","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1093\/aje\/kwv254","article-title":"Using big data to emulate a target trial when a randomized trial is not available","volume":"183","author":"Hern\u00e1n","year":"2016","journal-title":"Am J Epidemiol"},{"key":"2024041923353079400_ocae004-B32","first-page":"80","author":"Precup","year":"2000"},{"issue":"5","key":"2024041923353079400_ocae004-B33","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1007\/s00134-020-05934-6","article-title":"Contemporary strategies to improve clinical trial design for critical care research: insights from the First Critical Care Clinical Trialists Workshop","volume":"46","author":"Harhay","year":"2020","journal-title":"Intensive Care Med"},{"key":"2024041923353079400_ocae004-B34","article-title":"Cooperative inverse reinforcement learning","volume":"29","author":"Hadfield-Menell","year":"2016","journal-title":"Adv Neural Inf Process Syst"},{"issue":"1","key":"2024041923353079400_ocae004-B35","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1038\/s41591-018-0310-5","article-title":"Guidelines for reinforcement learning in healthcare","volume":"25","author":"Gottesman","year":"2019","journal-title":"Nat Med"},{"issue":"2","key":"2024041923353079400_ocae004-B36","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1007\/s00134-019-05898-2","article-title":"Clinical management of sepsis can be improved by artificial intelligence: yes","volume":"46","author":"Komorowski","year":"2020","journal-title":"Intensive Care Med"},{"issue":"00","key":"2024041923353079400_ocae004-B37","doi-asserted-by":"crossref","first-page":"1220","DOI":"10.1037\/hea0000305","article-title":"Microrandomized trials: an experimental design for developing just-in-time adaptive interventions","volume":"34S","author":"Klasnja","year":"2015","journal-title":"Health Psychol"},{"issue":"10","key":"2024041923353079400_ocae004-B38","doi-asserted-by":"crossref","first-page":"e2019209","DOI":"10.1001\/jamanetworkopen.2020.19209","article-title":"Recommendations on Acute kidney injury biomarkers from the acute disease quality initiative consensus conference: a consensus statement","volume":"3","author":"Ostermann","year":"2020","journal-title":"JAMA Netw Open"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/5\/1074\/57286286\/ocae004.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/5\/1074\/57286286\/ocae004.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,19]],"date-time":"2024-04-19T19:36:25Z","timestamp":1713555385000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/5\/1074\/7624146"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,7]]},"references-count":38,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,3,7]]},"published-print":{"date-parts":[[2024,4,19]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae004","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.06.13.23291349","asserted-by":"object"}]},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,5,1]]},"published":{"date-parts":[[2024,3,7]]}}}