{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T00:59:15Z","timestamp":1783385955207,"version":"3.54.6"},"reference-count":37,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2025,12,26]],"date-time":"2025-12-26T00:00:00Z","timestamp":1766707200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Clinical Trials"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>Desirability of outcome ranking (DOOR) is a paradigm for the design, monitoring, analysis, interpretation, and reporting of clinical trials based on patient-centric benefit-risk evaluation, developed to address limitations of existing approaches and advance clinical trial science. The first step in implementing DOOR is defining an ordinal DOOR outcome representing a global patient-centric response, a cumulative summary of the benefits and harms for an individual patient. This article aims to develop an analysis methodology for the setting where the DOOR outcome is a progressive time-varying state, and there is interest in event times and times that patients spend in more and less desirable states.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>We develop methods to estimate and make inferences about the temporal treatment effects. If the k-levels of the DOOR outcome are monotone, then k \u2013 1 non-overlapping Kaplan-Meier survival curves can be estimated and plotted. The areas under the curves asymptotically follow a multivariate Gaussian distribution. We apply restricted mean survival time (RMST) concepts to the ordinal Kaplan-Meier curves and provide steps for estimating the covariance structure.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>Simulation studies demonstrate that the proposed methods perform well in practical settings. We generate censoring time under a uniform distribution and event times under a multi-state structure. The proposed estimators have small biases, the 95% confidence intervals have correct coverage probabilities, and the proposed tests accurately control the type I error rate under the null hypothesis. We illustrate the methods using data from Adaptive COVID-19 Treatment Trial (ACTT-1), a clinical trial that compared remdesivir vs placebo for the treatment of COVID-19 infection.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion:<\/jats:title>\n                    <jats:p>Ordinal DOOR outcomes, which incorporate benefits and harms and represent an overall patient response, have recently been recommended by the Council for International Organizations of Medical Sciences (CIOMS) as a standard approach to benefit:risk analysis. Such endpoints recognize the cumulative nature of outcomes on patients, account for correlations between efficacy and safety, incorporate multivariate survival outcomes, offer generalizability to inform clinical practice, and recognize finer gradations of patient response and binary outcomes. Robust and interpretable analysis methodologies for ordinal outcomes are needed.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>Restricted mean survival time is a useful nonparametric approach for robust treatment effect estimation. We provide a framework for inference using multiple RMSTs to analyze DOOR and other ordinal outcomes using an interpretable time metric.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/17407745251385582","type":"journal-article","created":{"date-parts":[[2025,12,26]],"date-time":"2025-12-26T15:29:56Z","timestamp":1766762996000},"page":"23-32","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Desirability of outcome ranking (DOOR) analysis for multivariate survival outcomes with application to ACTT-1 trial"],"prefix":"10.1177","volume":"23","author":[{"given":"Shiyu","family":"Shu","sequence":"first","affiliation":[{"name":"Department of Biostatistics and Bioinformatics, The George Washington University, Washington, DC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7304-9591","authenticated-orcid":false,"given":"Guoqing","family":"Diao","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Bioinformatics, The George Washington University, Washington, DC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Toshimitsu","family":"Hamasaki","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Bioinformatics, The George Washington University, Washington, DC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3186-172X","authenticated-orcid":false,"given":"Scott","family":"Evans","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Bioinformatics, The George Washington University, Washington, DC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,12,26]]},"reference":[{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.4244\/EIJ-D-19-00953"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCULATIONAHA.115.017719"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.2307\/3001968"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177730491"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.3923"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1093\/eurheartj\/ehr352"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1093\/cid\/civ495"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1080\/19466315.2021.1927824"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1080\/19466315.2016.1207561"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa2007764"},{"key":"e_1_3_4_12_2","unstructured":"Council for International Organizations of Medical Sciences (CIOMS) Working Group. Benefit-Risk balance for medicinal products. Technical Report Council for International Organizations of Medical Sciences (CIOMS) Geneva Switzerland 2025 https:\/\/cioms.ch\/publications\/product\/benefit-risk-balance-for-medicinal-products\/"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2023.09.016"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1093\/cid\/ciac692"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1972.tb00899.x"},{"issue":"2","key":"e_1_3_4_16_2","first-page":"107","article-title":"A brief overview of restricted mean survival time estimators and associated variances","volume":"3","author":"Nemes S","year":"2020","unstructured":"Nemes S, B\u00fclow E, Gustavsson A. A brief overview of restricted mean survival time estimators and associated variances. Statistics 2020; 3(2): 107\u2013119.","journal-title":"Statistics"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1958.10501452"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0022172400014443"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0021900200047574"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/b97377"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.8206"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1093\/biostatistics\/kxz018"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1111\/biom.13237"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1093\/biostatistics\/kxt050"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2014.55.2208"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoncol.2017.2797"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.8896"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.9728"},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1111\/biom.13752"},{"key":"e_1_3_4_30_2","volume-title":"Asymptotic statistics","author":"Van der Vaart AW","year":"2000","unstructured":"Van der Vaart AW. Asymptotic statistics, vol. 3. Cambridge University Press, 2000."},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40121-023-00900-3"},{"key":"e_1_3_4_32_2","first-page":"1","article-title":"Longitudinal benefit: risk analysis through the desirability of outcome ranking (door) with application to ACTT-1 trial","volume":"2024","author":"Shu S","unstructured":"Shu S, Diao G, Hamasaki T, et al. Longitudinal benefit: risk analysis through the desirability of outcome ranking (door) with application to ACTT-1 trial. Stat Biopharm Res 2024: 1\u20138.","journal-title":"Stat Biopharm Res"},{"key":"e_1_3_4_33_2","first-page":"1","article-title":"Trial design with win statistics for multiple time-to-event endpoints with hierarchy","volume":"9","author":"Barnhart HX","year":"2024","unstructured":"Barnhart HX, Lokhnygina Y, Matsouaka RA, et al. Trial design with win statistics for multiple time-to-event endpoints with hierarchy. Stat Biopharm Res 2024; 9: 1\u201319.","journal-title":"Stat Biopharm Res"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1080\/19466315.2016.1234974"},{"key":"e_1_3_4_35_2","doi-asserted-by":"crossref","unstructured":"Lee D Wettermark B Lu CY et al. Special applications of pharmacoepidemiology Chapter 23. John Wiley & Sons pp. 387\u2013463 https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/9781119701101.ch23; https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/9781119701101.ch23","DOI":"10.1002\/9781119701101.ch23"},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-68560-1"},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-05988-9_13"},{"key":"e_1_3_4_38_2","first-page":"1501","article-title":"A survey of product-integration with a view toward application in survival analysis","volume":"1990","author":"Gill RD","unstructured":"Gill RD, Johansen S. A survey of product-integration with a view toward application in survival analysis. Ann Stat 1990: 1501\u20131555.","journal-title":"Ann Stat"}],"container-title":["Clinical Trials"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/17407745251385582","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/17407745251385582","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/17407745251385582","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T17:29:30Z","timestamp":1777397370000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/17407745251385582"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,26]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["10.1177\/17407745251385582"],"URL":"https:\/\/doi.org\/10.1177\/17407745251385582","relation":{},"ISSN":["1740-7745","1740-7753"],"issn-type":[{"value":"1740-7745","type":"print"},{"value":"1740-7753","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,26]]}}}