{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T03:29:56Z","timestamp":1793071796002,"version":"4.5.0"},"reference-count":27,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2023,1,20]],"date-time":"2023-01-20T00:00:00Z","timestamp":1674172800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100002491","name":"Bristol Myers Squibb Company","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100002491","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Knowledge of treatment assignment may affect patient-reported outcomes (PROs), which is of concern in oncology, where open-label trials are common. This study measured the magnitude of open-label bias by comparing PROs for similar patient groups in oncology trials with different degrees of concealment.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Individual patient data from ipilimumab arms of 2 melanoma and docetaxel arms of 2 non-small cell lung cancer (NSCLC) trials were adjusted for differences using propensity score weighting. Patients were aware of treatment assignment in CA184-022 and CheckMate 057 (open-label) but not in MDX010-20 and VITAL (blinded). Overall survival (OS) and mean changes from baseline to week 12 in the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30 (melanoma) and Lung Cancer Symptom Scale (NSCLC) scores were compared between open-label and blinded groups.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>After adjustment, baseline characteristics were balanced between blinded (melanoma, n\u2009=\u2009125; NSCLC, n\u2009=\u2009424) and open-label (melanoma, n\u2009=\u200969; NSCLC, n\u2009=\u2009205) groups. Study discontinuation and PRO completion rates at week 12 and OS were similar. There was no clear direction in differences in change scores between groups. In the melanoma trials, role functioning (mean = -5.2, 95% confidence interval [CI] = \u221215.4 to 5.0), global health status (mean = -1.3, 95% CI = -8.7 to 6.1), and pain (mean = 6.2 , 95% CI = \u22121.8 to 14.2) favored the blinded, whereas emotional functioning (mean = 2.2, 95% CI = -5.8 to 10.2) and diarrhea (mean = -8.3, 95% CI = \u221217.3 to 0.7) favored the open-label group. In the NSCLC trials, changes in dyspnea (mean = 5.4, 95% CI = -0.7 to 11.5) favored the blinded and changes in appetite (mean = -1.2, 95% CI = -8.1 to 5.7) favored the open-label group. None were clinically or statistically significant.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>This study adds to the growing evidence demonstrating that concerns regarding open-label bias should not prohibit the interpretation of large and meaningful treatment effects on PROs.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jncics\/pkad002","type":"journal-article","created":{"date-parts":[[2023,1,20]],"date-time":"2023-01-20T13:01:39Z","timestamp":1674219699000},"source":"Crossref","is-referenced-by-count":22,"title":["Assessing the impact of open-label designs in patient-reported outcomes: investigation in oncology clinical trials"],"prefix":"10.1093","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8624-4556","authenticated-orcid":false,"given":"Jennifer","family":"Lord-Bessen","sequence":"first","affiliation":[{"name":"Bristol Myers Squibb , Lawrenceville, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Signorovitch","sequence":"additional","affiliation":[{"name":"Analysis Group, Inc , Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min","family":"Yang","sequence":"additional","affiliation":[{"name":"Analysis Group, Inc , Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mihaela","family":"Georgieva","sequence":"additional","affiliation":[{"name":"Analysis Group, Inc , Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica","family":"Roydhouse","sequence":"additional","affiliation":[{"name":"Menzies Institute for Medical Research, University of Tasmania , Hobart, TAS, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,1,20]]},"reference":[{"key":"2023031723202748000_","author":"European Medicines Agency"},{"key":"2023031723202748000_","author":"Food and Drug Administration"},{"issue":"4","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1001\/jamaoncol.2018.6205","article-title":"Investigating potential bias in patient-reported outcomes in open-label cancer trials","volume":"5","author":"Roydhouse","year":"2019","journal-title":"JAMA Oncol"},{"issue":"1","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1097\/PHM.0000000000000521","article-title":"Blinding in physical therapy trials and its association with treatment effects: a meta-epidemiological study","volume":"96","author":"Armijo-Olivo","year":"2017","journal-title":"Am J Phys Med Rehabil"},{"issue":"4","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1093\/ije\/dyu115","article-title":"Bias due to lack of patient blinding in clinical trials. A systematic review of trials randomizing patients to blind and nonblind sub-studies","volume":"43","author":"Hrobjartsson","year":"2014","journal-title":"Int J Epidemiol"},{"issue":"11","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1001\/jamainternmed.2013.627","article-title":"Characteristics of oncology clinical trials: insights from a systematic analysis of ClinicalTrials.gov","volume":"173","author":"Hirsch","year":"2013","journal-title":"JAMA Intern Med"},{"issue":"5","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1093\/jnci\/djy181","article-title":"Blinding and patient-reported outcome completion rates in US Food and Drug Administration cancer trial submissions, 2007-2017","volume":"111","author":"Roydhouse","year":"2019","journal-title":"J Natl Cancer Inst"},{"issue":"6","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1001\/jamaoncol.2016.3328","article-title":"Trustworthiness of patient-reported outcomes in unblinded cancer clinical trials","volume":"3","author":"Atkinson","year":"2017","journal-title":"JAMA Oncol"},{"issue":"20","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"7363","DOI":"10.1002\/cam4.3335","article-title":"Investigating the impact of open label design on patient-reported outcome results in prostate cancer randomized controlled trials","volume":"9","author":"Mouillet","year":"2020","journal-title":"Cancer Med"},{"key":"2023031723202748000_","doi-asserted-by":"publisher","DOI":"10.1007\/s11136-021-02945-8","article-title":"Impact of open-label versus blinded study design on patient-reported outcomes data in randomized clinical trials of immunotherapy in advanced or metastatic cancer patients: a systematic review","author":"Anota","year":"2022","journal-title":"Qual Life Res"},{"key":"2023031723202748000_","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/djab177","article-title":"Impact of blinding on patient-reported outcome differences between treatment arms in cancer randomized controlled trials","author":"Efficace","year":"2022","journal-title":"J Natl Cancer Inst"},{"issue":"6","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"822","DOI":"10.1016\/j.jval.2020.12.015","article-title":"Does knowledge of treatment assignment affect patient report of symptoms, function, and health status? An evaluation using multiple myeloma trials","volume":"24","author":"Roydhouse","year":"2021","journal-title":"Value Health"},{"issue":"8","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1056\/NEJMoa1003466","article-title":"Improved survival with ipilimumab in patients with metastatic melanoma","volume":"363","author":"Hodi","year":"2010","journal-title":"N Engl J Med"},{"issue":"2","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/S1470-2045(09)70334-1","article-title":"Ipilimumab monotherapy in patients with pretreated advanced melanoma: a randomised, double-blind, multicentre, phase 2, dose-ranging study","volume":"11","author":"Wolchok","year":"2010","journal-title":"Lancet Oncol"},{"issue":"29","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"3640","DOI":"10.1200\/JCO.2012.42.6932","article-title":"Aflibercept and docetaxel versus docetaxel alone after platinum failure in patients with advanced or metastatic non-small-cell lung cancer: a randomized, controlled phase III trial","volume":"30","author":"Ramlau","year":"2012","journal-title":"J Clin Oncol"},{"issue":"1","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.ejca.2018.05.005","article-title":"Evaluation of health-related quality of life and symptoms in patients with advanced non-squamous non-small cell lung cancer treated with nivolumab or docetaxel in CheckMate 057","volume":"102","author":"Reck","year":"2018","journal-title":"Eur J Cancer"},{"issue":"5","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1093\/jnci\/85.5.365","article-title":"The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology","volume":"85","author":"Aaronson","year":"1993","journal-title":"J Natl Cancer Inst"},{"key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"S51","DOI":"10.1016\/S0959-8049(05)80262-X","article-title":"Quality of life assessment in individuals with lung cancer: testing the Lung Cancer Symptom Scale (LCSS)","volume":"29A(suppl 1)","author":"Hollen","year":"1993","journal-title":"Eur J Cancer"},{"issue":"4","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/BF00365725","article-title":"Quality of life during clinical trials: conceptual model for the Lung Cancer Symptom Scale (LCSS)","volume":"2","author":"Hollen","year":"1994","journal-title":"Support Care Cancer"},{"issue":"3","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1080\/00273171.2011.568786","article-title":"An introduction to propensity score methods for reducing the effects of confounding in observational studies","volume":"46","author":"Austin","year":"2011","journal-title":"Multivariate Behav Res"},{"issue":"28","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"3661","DOI":"10.1002\/sim.6607","article-title":"Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies","volume":"34","author":"Austin","year":"2015","journal-title":"Stat Med"},{"issue":"4","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/S0895-4356(00)00321-8","article-title":"Validating recommendations for coronary angiography following acute myocardial infarction in the elderly: a matched analysis using propensity scores","volume":"54","author":"Normand","year":"2001","journal-title":"J Clin Epidemiol"},{"issue":"5","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1097\/01.MLR.0000062554.74615.4C","article-title":"Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation","volume":"41","author":"Norman","year":"2003","journal-title":"Med Care"},{"issue":"1","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1200\/JCO.1998.16.1.139","article-title":"Interpreting the significance of changes in health-related quality-of-life scores","volume":"16","author":"Osoba","year":"1998","journal-title":"J Clin Oncol"},{"issue":"1_suppl 1","key":"2023031723202748000_","article-title":"Evaluating clinical versus statistical significance with the LCSS quality of life instrument and the Karnofsky Performance Status (KPS)","volume":"29","author":"Hollen","year":"2000","journal-title":"Lung Cancer"},{"issue":"1","key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1093\/annonc\/mdp478","article-title":"Influence of an independent review committee on assessment of response rate and progression-free survival in phase III clinical trials","volume":"21","author":"Tang","year":"2010","journal-title":"Ann Oncol"},{"key":"2023031723202748000_","doi-asserted-by":"crossref","first-page":"e18702","DOI":"10.1200\/JCO.2018.36.15_suppl.e18702","article-title":"Exploring open-label bias in patient-reported outcome (PRO) emotional domain scores in cancer trials","volume":"36(suppl 15)","author":"Chakravarti","year":"2018","journal-title":"J Clin Oncol"}],"container-title":["JNCI Cancer Spectrum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jncics\/advance-article-pdf\/doi\/10.1093\/jncics\/pkad002\/48800276\/pkad002.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jncics\/article-pdf\/7\/2\/pkad002\/49555868\/pkad002.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jncics\/article-pdf\/7\/2\/pkad002\/49555868\/pkad002.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,21]],"date-time":"2023-03-21T19:25:32Z","timestamp":1679426732000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jncics\/article\/doi\/10.1093\/jncics\/pkad002\/6994189"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,20]]},"references-count":27,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jncics\/pkad002","relation":{},"ISSN":["2515-5091"],"issn-type":[{"value":"2515-5091","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,4,1]]},"published":{"date-parts":[[2023,1,20]]},"article-number":"pkad002"}}