{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T05:06:32Z","timestamp":1780376792902,"version":"3.54.1"},"reference-count":21,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T00:00:00Z","timestamp":1776988800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["R01 CA240991"],"award-info":[{"award-number":["R01 CA240991"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,5,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Issues with randomized controlled trial generalizability are well described, but whether these issues result from differences in patient treatment across contexts remains unknown. We studied treatment of patients with high-risk prostate cancer after radical prostatectomy inside and outside a randomized controlled trial evaluating the impact of a genomic classifier on post\u2013radical prostatectomy treatment decision making (Genomics in Michigan Impacting Observation of Radiation [G-MINOR]; ClinicalTrials.gov identifier NCT02783950).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>G-MINOR enrolled 338 patients; propensity score\u2013matched eligible but unenrolled patient cohorts (pretrial and trial contemporary) from the Michigan Urological Surgery Improvement Collaborative (MUSIC), in which the trial was embedded, were compared for rates and time to secondary treatment (adjuvant or salvage therapy) after prostatectomy.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Among 338 patients in the G-MINOR cohort, 69 (31 adjuvant, 38 salvage) received secondary treatment compared with 266 (183 adjuvant, 83 salvage) and 104 (60 adjuvant, 44 salvage) in the 1014 contemporary and 338 pretrial\u2013matched MUSIC cohorts. Time to secondary treatment was much shorter in the MUSIC cohort across all comparisons. For example, matching G-MINOR to synchronous MUSIC patients demonstrated 84% vs 74% estimated 2-year treatment-free survival for trial and real-world patients, respectively (P\u2009&amp;lt;\u2009.001).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Controlling for key clinicopathologic factors, patients in the G-MINOR randomized controlled trial and MUSIC cohorts were treated differently, even after stratifying by genomic risk. These findings suggest that challenges in randomized controlled trial generalizability extend beyond the representativeness of trial participants. Differences in management may also explain why divergent patient outcomes are observed in randomized controlled trials vs real-world settings.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jncics\/pkag040","type":"journal-article","created":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T11:37:51Z","timestamp":1775993871000},"source":"Crossref","is-referenced-by-count":0,"title":["Understanding randomized controlled trial generalizability through an embedded molecular diagnostics trial"],"prefix":"10.1093","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0692-2909","authenticated-orcid":false,"given":"Patrick","family":"Lewicki","sequence":"first","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arnav","family":"Srivastava","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ralph","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Johnson","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Khurshid","family":"Ghani","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kevin","family":"Ginsburg","sequence":"additional","affiliation":[{"name":"Department of Urology, Wayne State University , Detroit, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tudor","family":"Borza","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristian","family":"Stensland","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simpa S","family":"Salami","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elai","family":"Davicioni","sequence":"additional","affiliation":[{"name":"Veracyte, Inc , South San Francisco, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rodney L","family":"Dunn","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie","family":"Daignault-Newton","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ganesh S","family":"Palapattu","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel E","family":"Spratt","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, University Hospitals Seidman Cancer Center , Cleveland, OH,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Cher","sequence":"additional","affiliation":[{"name":"Department of Urology, Wayne State University , Detroit, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Schipper","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of Michigan , Ann Arbor, MI,","place":["United States"]},{"name":"Department of Radiation Oncology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2331-3758","authenticated-orcid":false,"given":"Robert T","family":"Dess","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1140-0603","authenticated-orcid":false,"given":"Todd M","family":"Morgan","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Udit","family":"Singhal","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Michigan , Ann Arbor, MI,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,4,24]]},"reference":[{"key":"2026060200361095800_pkag040-B1","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1046\/j.1365-2702.2003.00662.x","article-title":"Hierarchy of evidence: a framework for ranking evidence evaluating healthcare interventions","volume":"12","author":"Evans","year":"2003","journal-title":"J Clin Nurs"},{"key":"2026060200361095800_pkag040-B2","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1007\/s11121-014-0513-z","article-title":"Assessing the generalizability of randomized trial results to target populations","volume":"16","author":"Stuart","year":"2015","journal-title":"Prev Sci"},{"key":"2026060200361095800_pkag040-B3","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1186\/s13063-015-1023-4","article-title":"A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results","volume":"16","author":"Kennedy-Martin","year":"2015","journal-title":"Trials"},{"key":"2026060200361095800_pkag040-B4","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1016\/S0002-8703(03)00189-3","article-title":"Most hospitalized older persons do not meet the enrollment criteria for clinical trials in heart failure","volume":"146","author":"Masoudi","year":"2003","journal-title":"Am Heart J"},{"key":"2026060200361095800_pkag040-B5","first-page":"1138","article-title":"Most patients receiving routine care for rheumatoid arthritis in 2001 did not meet inclusion criteria for most recent clinical trials or American college of rheumatology criteria for remission","volume":"30","author":"Sokka","year":"2003","journal-title":"J Rheumatol"},{"key":"2026060200361095800_pkag040-B6","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1038\/sj.bjc.6600514","article-title":"Effects of patient selection on the applicability of results from a randomised clinical trial (EORTC 10853) investigating breast-conserving therapy for DCIS","volume":"87","author":"Bijker","year":"2002","journal-title":"Br J Cancer"},{"key":"2026060200361095800_pkag040-B7","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1001\/jama.286.6.708","article-title":"Representation of elderly persons and women in published randomized trials of acute coronary syndromes","volume":"286","author":"Lee","year":"2001","journal-title":"JAMA"},{"key":"2026060200361095800_pkag040-B8","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1080\/028418602753669490","article-title":"Selection of patients may limit the generalizability of results from cancer trials","volume":"41","author":"Foss\u00e5","year":"2002","journal-title":"Acta Oncol"},{"key":"2026060200361095800_pkag040-B9","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1056\/NEJMp1615879","article-title":"Reevaluating eligibility criteria - balancing patient protection and participation in oncology trials","volume":"376","author":"Beaver","year":"2017","journal-title":"N Engl J Med"},{"key":"2026060200361095800_pkag040-B10","doi-asserted-by":"publisher","first-page":"3737","DOI":"10.1200\/JCO.2017.73.7916","article-title":"Broadening eligibility criteria to make clinical trials more representative: American society of clinical oncology and friends of cancer research joint research statement","volume":"35","author":"Kim","year":"2017","journal-title":"J Clin Oncol"},{"key":"2026060200361095800_pkag040-B11","doi-asserted-by":"publisher","first-page":"2815","DOI":"10.1200\/JCO.2015.62.1854","article-title":"Modernizing eligibility criteria for molecularly driven trials","volume":"33","author":"Kim","year":"2015","journal-title":"J Clin Oncol"},{"key":"2026060200361095800_pkag040-B12","doi-asserted-by":"publisher","first-page":"h4672","DOI":"10.1136\/bmj.h4672","article-title":"Understanding the Hawthorne effect","volume":"351","author":"Sedgwick","year":"2015","journal-title":"BMJ"},{"key":"2026060200361095800_pkag040-B13","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/S0140-6736(04)17670-8","article-title":"External validity of randomised controlled trials: \u201cto whom do the results of this trial apply?","volume":"365","author":"Rothwell","year":"2005","journal-title":"Lancet"},{"key":"2026060200361095800_pkag040-B14","doi-asserted-by":"publisher","first-page":"e206359","DOI":"10.1001\/jamasurg.2020.6359","article-title":"Evaluation of patient- and surgeon-specific variations in patient-reported urinary outcomes 3 months after radical prostatectomy from a statewide improvement collaborative","volume":"156","author":"Auffenberg","year":"2021","journal-title":"JAMA Surgery"},{"key":"2026060200361095800_pkag040-B15","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1016\/j.eururo.2024.09.011","article-title":"Impact of gene expression classifier testing on adjuvant treatment following radical prostatectomy: the G-MINOR prospective randomized cluster-crossover trial","volume":"87","author":"Morgan","year":"2025","journal-title":"Eur Urol."},{"key":"2026060200361095800_pkag040-B16","author":"Cooperberg MR, Hilton JF, Carroll PR","year":"2011"},{"key":"2026060200361095800_pkag040-B17"},{"key":"2026060200361095800_pkag040-B18","doi-asserted-by":"publisher","first-page":"dju002","DOI":"10.1093\/jnci\/dju002","article-title":"Comparison of survival outcomes among cancer patients treated in and out of clinical trials","volume":"106","author":"Unger","year":"2014","journal-title":"J Natl Cancer Inst"},{"key":"2026060200361095800_pkag040-B19","doi-asserted-by":"publisher","first-page":"15368","DOI":"10.3390\/ijerph192215368","article-title":"Benefits of participation in clinical trials: an umbrella review","volume":"19","author":"Bouzalmate-Hajjaj","year":"2022","journal-title":"Int J Environ Res Public Health"},{"key":"2026060200361095800_pkag040-B20","doi-asserted-by":"publisher","first-page":"2105","DOI":"10.1001\/jama.2024.6281","article-title":"Survival benefit associated with participation in clinical trials of anticancer drugs: a systematic review and meta-analysis","volume":"331","author":"Iskander","year":"2024","journal-title":"JAMA"},{"key":"2026060200361095800_pkag040-B21","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1097\/SLA.0000000000001750","article-title":"Impact of a risk calculator on risk perception and surgical decision making: a randomized trial","volume":"264","author":"Sacks","year":"2016","journal-title":"Ann Surg"}],"container-title":["JNCI Cancer Spectrum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jncics\/advance-article-pdf\/doi\/10.1093\/jncics\/pkag040\/68145020\/pkag040.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jncics\/article-pdf\/10\/3\/pkag040\/68145020\/pkag040.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jncics\/article-pdf\/10\/3\/pkag040\/68145020\/pkag040.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T04:36:28Z","timestamp":1780374988000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jncics\/article\/doi\/10.1093\/jncics\/pkag040\/8661587"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,24]]},"references-count":21,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,5,9]]}},"URL":"https:\/\/doi.org\/10.1093\/jncics\/pkag040","relation":{},"ISSN":["2515-5091"],"issn-type":[{"value":"2515-5091","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,6]]},"published":{"date-parts":[[2026,4,24]]},"article-number":"pkag040"}}