{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T01:48:41Z","timestamp":1789696121287,"version":"4.0.1"},"reference-count":47,"publisher":"BMJ","issue":"12","license":[{"start":{"date-parts":[[2024,12,12]],"date-time":"2024-12-12T00:00:00Z","timestamp":1733961600000},"content-version":"unspecified","delay-in-days":11,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"National Cancer Institute of the National Institutes of Health","award":["R03CA292987"],"award-info":[{"award-number":["R03CA292987"]}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open"],"accepted":{"date-parts":[[2024,11,27]]},"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:sec>\n                  <jats:title>Introduction<\/jats:title>\n                  <jats:p>Non-response significantly undermines the representativeness of patient-reported outcome (PRO) data, thereby compromising its utility for facilitating high-value, equitable, patient-centred care in cancer clinics. Quality improvement studies are needed to assess the representativeness of PRO data collected in routine care, identify the underlying causes of non-response and develop novel methods to ensure data representativeness. Using a multilevel framework and a mixed-methods approach, we have three aims: (1) characterise the non-response of the Global-10 across clinic, provider and patient levels; (2) identify multilevel causes of non-response and potential strategies to improve representativeness in PRO collection; and (3) develop effective modifications to missing-data methods to enhance the representativeness of pre-existing PRO data.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods and analysis<\/jats:title>\n                  <jats:p>Our primary data source is the Patient Reported Outcomes Measurement Information System Global-10, collected as part of routine care at the Radiation Oncology clinics within the Mass General Brigham (MGB) healthcare system. Other sources include (1) Harvard Catalyst for provider-specific data, (2) MGB administrative data, (3) public Centers for Medicare &amp; Medicaid Services data and (4) the National Plan and Provider Enumeration System. We will conduct quantitative analyses to assess variations in Global-10 non-response across multilevel factors. Additionally, we will use qualitative interviews with patients and clinical professionals to understand the causes of non-response and to formulate strategies to expand the reach of PRO collection to underrepresented cancer patients, improve their completions and enhance overall data representativeness. Finally, we will integrate implementation science knowledge and findings from the first two aims into missing-data methods to manage non-response in the pre-existing Global-10 data and to evaluate their performance in preserving representativeness.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Ethics and dissemination<\/jats:title>\n                  <jats:p>The study protocol was reviewed and approved by the Institutional Review Board at the Dana-Farber\/Harvard Cancer Center (24-225). Written informed consent will be obtained from participants. Study findings will be disseminated through peer-reviewed publications and presentations at national and international conferences.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1136\/bmjopen-2024-097127","type":"journal-article","created":{"date-parts":[[2024,12,12]],"date-time":"2024-12-12T23:19:27Z","timestamp":1734045567000},"page":"e097127","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":8,"title":["Enhancing representativeness of patient-reported outcomes in routine radiation oncology care: a quality improvement protocol to address non-response"],"prefix":"10.1136","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3512-1115","authenticated-orcid":false,"given":"Chengbo","family":"Zeng","sequence":"first","affiliation":[{"name":"Patient Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA"},{"name":"Harvard Medical School, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil E","family":"Martin","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Department of Radiation Oncology, Brigham and Women's Hospital, Boston, Massachusetts, USA"},{"name":"Department of Radiation Oncology, Dana-Farber Cancer Institute, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea L","family":"Pusic","sequence":"additional","affiliation":[{"name":"Patient Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA"},{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Division of Plastic and Reconstructive Surgery, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria O","family":"Edelen","sequence":"additional","affiliation":[{"name":"Patient Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA"},{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"RAND Corporation, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason B","family":"Liu","sequence":"additional","affiliation":[{"name":"Patient Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA"},{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Division of Surgical Oncology, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2024,12,12]]},"reference":[{"key":"2025101815194648000_14.12.e097127.1","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2015.63.0830"},{"key":"2025101815194648000_14.12.e097127.2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2022.9265"},{"key":"2025101815194648000_14.12.e097127.3","doi-asserted-by":"crossref","DOI":"10.1136\/bmjoq-2022-001922","article-title":"Patient-reported outcome and experience measures for quality improvement in pregnancy and childbirth care: a retrospective cohort study","volume":"12","author":"Klootwijk","year":"2023","journal-title":"BMJ Open Qual"},{"key":"2025101815194648000_14.12.e097127.4","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2023.7271"},{"key":"2025101815194648000_14.12.e097127.5","doi-asserted-by":"crossref","first-page":"S801","DOI":"10.1007\/s11606-014-2892-z","article-title":"Patient-reported outcomes in clinical trials of rare diseases","volume":"29 Suppl 3","author":"Basch","year":"2014","journal-title":"J Gen Intern Med"},{"key":"2025101815194648000_14.12.e097127.6","doi-asserted-by":"publisher","DOI":"10.1007\/s11136-011-0054-x"},{"key":"2025101815194648000_14.12.e097127.7","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0258(19980315\/15)17:5\/7<517::AID-SIM799>3.0.CO;2-S"},{"key":"2025101815194648000_14.12.e097127.8","doi-asserted-by":"crossref","DOI":"10.2196\/28915","article-title":"Data Quality of Longitudinally Collected Patient-Reported Outcomes After Thoracic Surgery: Comparison of Paper- and Web-Based Assessments","volume":"23","author":"Yu","year":"2021","journal-title":"J Med Internet Res"},{"key":"2025101815194648000_14.12.e097127.9","doi-asserted-by":"crossref","DOI":"10.1186\/s13104-015-1364-9","article-title":"Non-compliance with randomised allocation and missing outcome data in randomised controlled trials evaluating surgical interventions: a systematic review","volume":"8","author":"Adewuyi","year":"2015","journal-title":"BMC Res Notes"},{"key":"2025101815194648000_14.12.e097127.10","doi-asserted-by":"crossref","DOI":"10.1186\/1477-7525-10-34","article-title":"Factors associated with non-response in routine use of patient reported outcome measures after elective surgery in England","volume":"10","author":"Hutchings","year":"2012","journal-title":"Health Qual Life Outcomes"},{"key":"2025101815194648000_14.12.e097127.11","doi-asserted-by":"crossref","first-page":"7964","DOI":"10.1245\/s10434-022-12477-1","article-title":"Who Are We Missing: Does Engagement in Patient-Reported Outcome Measures for Breast Cancer Vary by Age, Race, or Disease Stage?","volume":"29","author":"Srour","year":"2022","journal-title":"Ann Surg Oncol"},{"key":"2025101815194648000_14.12.e097127.12","doi-asserted-by":"crossref","DOI":"10.1016\/j.ijrobp.2021.07.637","article-title":"Patient Reported Outcome Measure (PROM) Collection Rates When Part of Routine Clinical Workflow in an Academic Radiation Oncology Department","volume":"111","author":"Kim","year":"2021","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"2025101815194648000_14.12.e097127.13","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2020.34630","article-title":"Systemic Kidney Transplant Inequities for Black Individuals: Examining the Contribution of Racialized Kidney Function Estimating Equations","volume":"4","author":"Boulware","year":"2021","journal-title":"JAMA Netw Open"},{"key":"2025101815194648000_14.12.e097127.14","unstructured":"Agency for Healthcare Research and Quality . Disparities. 2018. Available: https:\/\/www.ahrq.gov\/topics\/disparities.html#accordions"},{"key":"2025101815194648000_14.12.e097127.15","unstructured":"Amercian Medical Association . Reducing disparities in health care. 2019. Available: https:\/\/www.ama-assn.org\/delivering-care\/patient-support-advocacy\/reducing-disparities-health-care"},{"key":"2025101815194648000_14.12.e097127.16","doi-asserted-by":"crossref","first-page":"1120","DOI":"10.1038\/s41591-022-01781-8","article-title":"Patient reported outcome assessment must be inclusive and equitable","volume":"28","author":"Calvert","year":"2022","journal-title":"Nat Med"},{"key":"2025101815194648000_14.12.e097127.17","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2015-010938","article-title":"Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review","volume":"6","author":"Mercieca-Bebber","year":"2016","journal-title":"BMJ Open"},{"key":"2025101815194648000_14.12.e097127.18","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2022-061761","article-title":"Impetus of US hospital leaders to invest in patient-reported outcome measures (PROMs): a qualitative study","volume":"12","author":"Mou","year":"2022","journal-title":"BMJ Open"},{"key":"2025101815194648000_14.12.e097127.19","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2020-012206"},{"key":"2025101815194648000_14.12.e097127.20","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2020.2764","article-title":"Factors Associated With Increased Collection of Patient-Reported Outcomes Within a Large Health Care System","volume":"3","author":"Sisodia","year":"2020","journal-title":"JAMA Netw Open"},{"key":"2025101815194648000_14.12.e097127.21","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1177\/1740774517741113","article-title":"A systematic review and development of a classification framework for factors associated with missing patient-reported outcome data","volume":"15","author":"Palmer","year":"2018","journal-title":"Clin Trials"},{"key":"2025101815194648000_14.12.e097127.22","doi-asserted-by":"crossref","DOI":"10.1186\/s41687-021-00375-1","article-title":"A multi-level approach for the use of routinely collected patient-reported outcome measures (PROMs) data in healthcare systems","volume":"5","author":"Al Sayah","year":"2021","journal-title":"J Patient Rep Outcomes"},{"key":"2025101815194648000_14.12.e097127.23","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1186\/1748-5908-4-50","article-title":"Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science","volume":"4","author":"Damschroder","year":"2009","journal-title":"Implementation Sci"},{"key":"2025101815194648000_14.12.e097127.24","doi-asserted-by":"crossref","first-page":"3035","DOI":"10.1007\/s11136-020-02600-8","article-title":"Prospective application of implementation science theories and frameworks to inform use of PROMs in routine clinical care within an integrated pain network","volume":"30","author":"Ahmed","year":"2021","journal-title":"Qual Life Res"},{"key":"2025101815194648000_14.12.e097127.25","doi-asserted-by":"crossref","first-page":"3015","DOI":"10.1007\/s11136-020-02564-9","article-title":"ISOQOL PROMs\/PREMs in Clinical Practice Implementation Science Work Group. Using an implementation science approach to implement and evaluate patient-reported outcome measures (PROM) initiatives in routine care settings","volume":"30","author":"Stover","year":"2021","journal-title":"Qual Life Res"},{"key":"2025101815194648000_14.12.e097127.26","doi-asserted-by":"crossref","first-page":"2265","DOI":"10.1093\/jamia\/ocab138","article-title":"Digital disparities: lessons learned from a patient reported outcomes program during the COVID-19 pandemic","volume":"28","author":"Sisodia","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2025101815194648000_14.12.e097127.27","doi-asserted-by":"crossref","unstructured":"Liu JB , Kaplan RS , Bates DW , et al . Mass General Brigham\u2019s Patient-Reported Outcomes Measurement System: A Decade of Learnings. NEJM Catalyst 2024;5. doi:10.1056\/CAT.23.0397","DOI":"10.1056\/CAT.23.0397"},{"key":"2025101815194648000_14.12.e097127.28","unstructured":"National plan & provider enumeration system. 2023. Available: https:\/\/nppes.cms.hhs.gov\/#\/"},{"key":"2025101815194648000_14.12.e097127.29","unstructured":"Harvard catalyst. 2023. Available: https:\/\/catalyst.harvard.edu\/"},{"key":"2025101815194648000_14.12.e097127.30","unstructured":"Centers for medicare & medicaid services. 2023. Available: https:\/\/www.cms.gov\/"},{"key":"2025101815194648000_14.12.e097127.31","doi-asserted-by":"publisher","DOI":"10.1007\/s11136-009-9496-9"},{"key":"2025101815194648000_14.12.e097127.32","doi-asserted-by":"publisher","DOI":"10.1177\/1049732318821692"},{"key":"2025101815194648000_14.12.e097127.33","doi-asserted-by":"crossref","DOI":"10.1186\/s12874-018-0594-7","article-title":"Characterising and justifying sample size sufficiency in interview-based studies: systematic analysis of qualitative health research over a 15-year period","volume":"18","author":"Vasileiou","year":"2018","journal-title":"BMC Med Res Methodol"},{"key":"2025101815194648000_14.12.e097127.34","unstructured":"Enders CK . Applied Missing Data Analysis. Second Edition. The Guiford Press, 2022."},{"key":"2025101815194648000_14.12.e097127.35","doi-asserted-by":"publisher","DOI":"10.2147\/CLEP.S129785"},{"key":"2025101815194648000_14.12.e097127.36","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2288-12-184","article-title":"Auxiliary variables in multiple imputation in regression with missing X: a warning against including too many in small sample research","volume":"12","author":"Hardt","year":"2012","journal-title":"BMC Med Res Methodol"},{"key":"2025101815194648000_14.12.e097127.37","doi-asserted-by":"publisher","DOI":"10.1080\/19312458.2011.624490"},{"key":"2025101815194648000_14.12.e097127.38","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0258(19990730)18:14<1879::AID-SIM225>3.0.CO;2-6"},{"key":"2025101815194648000_14.12.e097127.39","doi-asserted-by":"crossref","first-page":"2729","DOI":"10.3390\/math11122729","article-title":"Enhancing Precision in Large-Scale Data Analysis: An Innovative Robust Imputation Algorithm for Managing Outliers and Missing Values","volume":"11","author":"Templ","year":"2023","journal-title":"Math"},{"key":"2025101815194648000_14.12.e097127.40","doi-asserted-by":"publisher","DOI":"10.1177\/0962280210395740"},{"key":"2025101815194648000_14.12.e097127.41","doi-asserted-by":"crossref","DOI":"10.1186\/s12874-020-00947-7","article-title":"An evaluation of inverse probability weighting using the propensity score for baseline covariate adjustment in smaller population randomised controlled trials with a continuous outcome","volume":"20","author":"Raad","year":"2020","journal-title":"BMC Med Res Methodol"},{"key":"2025101815194648000_14.12.e097127.42","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2288-6-57","article-title":"Dealing with missing data in a multi-question depression scale: a comparison of imputation methods","volume":"6","author":"Shrive","year":"2006","journal-title":"BMC Med Res Methodol"},{"key":"2025101815194648000_14.12.e097127.43","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2022.16715","article-title":"Trends in Missing Race and Ethnicity Information After Imputation in HealthCare.gov Marketplace Enrollment Data, 2015-2021","volume":"5","author":"Branham","year":"2022","journal-title":"JAMA Netw Open"},{"key":"2025101815194648000_14.12.e097127.44","doi-asserted-by":"crossref","DOI":"10.1186\/s41687-021-00360-8","article-title":"Use of the PROMIS-10 global health in patients with chronic low back pain in outpatient physical therapy: a retrospective cohort study","volume":"5","author":"Pak","year":"2021","journal-title":"J Patient Rep Outcomes"},{"key":"2025101815194648000_14.12.e097127.45","doi-asserted-by":"crossref","DOI":"10.1186\/s12874-020-01038-3","article-title":"Missing-data analysis: socio- demographic, clinical and lifestyle determinants of low response rate on self- reported psychological and nutrition related multi- item instruments in the context of the ATTICA epidemiological study","volume":"20","author":"Tsiampalis","year":"2020","journal-title":"BMC Med Res Methodol"},{"key":"2025101815194648000_14.12.e097127.46","unstructured":"HealthMeasures . PROMIS\u00ae score cut points. 2020. Available: https:\/\/www.healthmeasures.net\/score-and-interpret\/interpret-scores\/promis\/promis-score-cut-points"},{"key":"2025101815194648000_14.12.e097127.47","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1002\/cncr.31895","article-title":"Distribution of global health measures from routinely collected PROMIS surveys in patients with breast cancer or prostate cancer","volume":"125","author":"Seneviratne","year":"2019","journal-title":"Cancer"}],"container-title":["BMJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjopen-2024-097127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T22:19:54Z","timestamp":1760825994000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopen.bmj.com\/lookup\/doi\/10.1136\/bmjopen-2024-097127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12]]},"references-count":47,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12,12]]},"published-print":{"date-parts":[[2024,12]]}},"alternative-id":["10.1136\/bmjopen-2024-097127"],"URL":"https:\/\/doi.org\/10.1136\/bmjopen-2024-097127","relation":{},"ISSN":["2044-6055","2044-6055"],"issn-type":[{"value":"2044-6055","type":"print"},{"value":"2044-6055","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12]]}}}