{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,3]],"date-time":"2026-11-03T04:42:33Z","timestamp":1793680953898,"version":"4.5.1"},"reference-count":37,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T00:00:00Z","timestamp":1675036800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100004330","name":"GSK","doi-asserted-by":"publisher","award":["212225"],"award-info":[{"award-number":["212225"]}],"id":[{"id":"10.13039\/100004330","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,5,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>The patient-reported outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) is used to assess symptomatic adverse events in oncology trials. Currently, no standard for PRO-CTCAE analysis exists.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Key methods of descriptive analysis and longitudinal modeling using PRO-CTCAE data from an oncology clinical trial, DRiving Excellence in Approaches to Multiple Myeloma-2 (DREAMM-2), a phase II trial of belantamab mafodotin in multiple myeloma (NCT03525678), were explored. Descriptive methods included maximum postbaseline ratings, mean change over time, ratings above a predefined cutoff, line graphs, and stacked bar charts to illustrate patient-reported adverse events at one timepoint or dynamics over time. Analysis methods involving modeling over time included toxicity over time (ToxT) (repeated measurement model, time-to-event, area under the curve analyses), generalized estimating equations (GEE), and ordinal log-linear models (OLLMs).<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Visualizations of PRO-CTCAE data highlighted different aspects of the data. Selection of the appropriate visualization will depend on the audience and message to be conveyed. Consistent results were obtained by all modeling approaches; no difference was found between dose groups of the DREAMM-2 study in any PRO-CTCAE item by the ToxT approach or the more sophisticated GEE and OLLM methods. Interpretation of GEE results was the most challenging. OLLM supported the interval nature of the PRO-CTCAE response scale in the DREAMM-2 study. All modeling approaches account for multiple testing (driven by the number of items).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Descriptive analyses and longitudinal modeling approaches are complementary approaches to presenting PRO-CTCAE data. In modeling, the ToxT approach may be a good compromise compared with more sophisticated analyses.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jnci\/djad018","type":"journal-article","created":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T21:22:32Z","timestamp":1675113752000},"page":"586-596","source":"Crossref","is-referenced-by-count":23,"title":["A toolbox of different approaches to analyze and present PRO-CTCAE data in oncology studies"],"prefix":"10.1093","volume":"115","author":[{"given":"Antoine","family":"Regnault","sequence":"first","affiliation":[{"name":"Modus Outcomes, A Division of THREAD , Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ang\u00e9ly","family":"Loubert","sequence":"additional","affiliation":[{"name":"Modus Outcomes, A Division of THREAD , Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6977-0220","authenticated-orcid":false,"given":"Boris","family":"Gorsh","sequence":"additional","affiliation":[{"name":"GSK , Upper Providence, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Randy","family":"Davis","sequence":"additional","affiliation":[{"name":"GSK , Upper Providence, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Cardellino","sequence":"additional","affiliation":[{"name":"GSK , Upper Providence, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristin","family":"Creel","sequence":"additional","affiliation":[{"name":"Modus Outcomes, A Division of THREAD , Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"St\u00e9phane","family":"Qu\u00e9r\u00e9","sequence":"additional","affiliation":[{"name":"Modus Outcomes, A Division of THREAD , Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sandhya","family":"Sapra","sequence":"additional","affiliation":[{"name":"GSK , Upper Providence, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linda","family":"Nelsen","sequence":"additional","affiliation":[{"name":"GSK , Upper Providence, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9813-6800","authenticated-orcid":false,"given":"Laurie","family":"Eliason","sequence":"additional","affiliation":[{"name":"GSK , Upper Providence, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,1,30]]},"reference":[{"issue":"6","key":"2023050808190381900_djad018-B1","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1177\/1740774518799985","article-title":"Patient-reported outcomes version of the common terminology criteria for adverse events: methods for item selection in industry-sponsored oncology clinical trials","volume":"15","author":"Trask","year":"2018","journal-title":"Clin Trials"},{"key":"2023050808190381900_djad018-B2","author":"U.S. Food and Drug Administration"},{"key":"2023050808190381900_djad018-B3","author":"European Medicines Agency"},{"issue":"9","key":"2023050808190381900_djad018-B4","doi-asserted-by":"publisher","first-page":"dju244","DOI":"10.1093\/jnci\/dju244","article-title":"Development of the National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE)","volume":"106","author":"Basch","year":"2014","journal-title":"J Natl Cancer Inst"},{"issue":"7","key":"2023050808190381900_djad018-B5","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1158\/1078-0432.CCR-15-2035","article-title":"Focusing on core patient-reported outcomes in cancer clinical trials: symptomatic adverse events, physical function, and disease-related symptoms","volume":"22","author":"Kluetz","year":"2016","journal-title":"Clin Cancer Res"},{"issue":"suppl 15","key":"2023050808190381900_djad018-B6","doi-asserted-by":"crossref","first-page":"e18587","DOI":"10.1200\/JCO.2021.39.15_suppl.e18587","article-title":"Landscape review of the patient reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE) in oncology: adoption and recent learnings","volume":"39","author":"Regnault","year":"2021","journal-title":"J Clin Oncol"},{"issue":"4","key":"2023050808190381900_djad018-B7","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1016\/j.clinthera.2016.03.011","article-title":"Methods for implementing and reporting patient-reported outcome (PRO) measures of symptomatic adverse events in cancer clinical trials","volume":"38","author":"Basch","year":"2016","journal-title":"Clin Ther"},{"key":"2023050808190381900_djad018-B8"},{"issue":"2","key":"2023050808190381900_djad018-B9","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/S1470-2045(19)30788-0","article-title":"Belantamab mafodotin for relapsed or refractory multiple myeloma (DREAMM-2): a two-arm, randomised, open-label, phase 2 study","volume":"21","author":"Lonial","year":"2020","journal-title":"Lancet Oncol"},{"issue":"20","key":"2023050808190381900_djad018-B10","doi-asserted-by":"crossref","first-page":"3128","DOI":"10.1182\/blood-2013-10-535088","article-title":"Novel anti-B-cell maturation antigen antibody-drug conjugate (GSK2857916) selectively induces killing of multiple myeloma","volume":"123","author":"Tai","year":"2014","journal-title":"Blood"},{"issue":"22","key":"2023050808190381900_djad018-B11","doi-asserted-by":"crossref","first-page":"4198","DOI":"10.1002\/cncr.33809","article-title":"Longer term outcomes with single-agent belantamab mafodotin in patients with relapsed or refractory multiple myeloma: 13-month follow-up from the pivotal DREAMM-2 study","volume":"127","author":"Lonial","year":"2021","journal-title":"Cancer"},{"key":"2023050808190381900_djad018-B12","author":"National Institute of Health National Cancer Institute"},{"key":"2023050808190381900_djad018-B13","author":"U.S. Food and Drug Administration"},{"issue":"suppl 15","key":"2023050808190381900_djad018-B14","doi-asserted-by":"crossref","first-page":"e18612","DOI":"10.1200\/JCO.2021.39.15_suppl.e18612","article-title":"Graphical representations of patient tolerability data: recommendations from the National Cancer Institute (NCI) Cancer Moonshot Standardization Working Group","volume":"39","author":"Gresham","year":"2021","journal-title":"J Clin Oncol"},{"issue":"5","key":"2023050808190381900_djad018-B15","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1016\/j.jgo.2021.12.017","article-title":"Overview of Sankey flow diagrams: focusing on symptom trajectories in older adults with advanced cancer","volume":"13","author":"Otto","year":"2022","journal-title":"J Geriatr Oncol"},{"issue":"4","key":"2023050808190381900_djad018-B16","doi-asserted-by":"crossref","first-page":"933","DOI":"10.2307\/2533433","article-title":"A random-effects ordinal regression model for multilevel analysis","volume":"50","author":"Hedeker","year":"1994","journal-title":"Biometrics"},{"key":"2023050808190381900_djad018-B17","article-title":"Cumulative link models for ordinal regression with the R package ordinal","author":"Christensen"},{"issue":"12","key":"2023050808190381900_djad018-B18","doi-asserted-by":"crossref","first-page":"1266","DOI":"10.1093\/jnci\/djaa028","article-title":"Evaluating treatment tolerability in cancer clinical trials using the toxicity index","volume":"112","author":"Gresham","year":"2020","journal-title":"J Natl Cancer Inst"},{"issue":"6","key":"2023050808190381900_djad018-B19","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1002\/sim.8858","article-title":"On the properties of the toxicity index and its statistical efficiency","volume":"40","author":"Razaee","year":"2021","journal-title":"Stat Med"},{"issue":"2","key":"2023050808190381900_djad018-B20","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.jpainsymman.2021.07.031","article-title":"Evaluating treatment tolerability using the toxicity index with patient-reported outcomes data","volume":"63","author":"Langlais","year":"2022","journal-title":"J Pain Symptom Manage"},{"issue":"4","key":"2023050808190381900_djad018-B21","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1016\/j.pec.2015.10.027","article-title":"Graphical displays of patient-reported outcomes (PRO) for use in clinical practice: what makes a pro picture worth a thousand words?","volume":"99","author":"Bantug","year":"2016","journal-title":"Patient Educ Couns"},{"issue":"2","key":"2023050808190381900_djad018-B22","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s11136-018-2020-3","article-title":"Making a picture worth a thousand numbers: recommendations for graphically displaying patient-reported outcomes data","volume":"28","author":"Snyder","year":"2019","journal-title":"Qual Life Res"},{"issue":"8","key":"2023050808190381900_djad018-B23","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1177\/0272989X18791177","article-title":"Picture this: presenting longitudinal patient-reported outcome research study results to patients","volume":"38","author":"Tolbert","year":"2018","journal-title":"Med Decis Making"},{"issue":"1","key":"2023050808190381900_djad018-B24","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1177\/1740774520975120","article-title":"Composite grading algorithm for the National Cancer Institute's Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)","volume":"18","author":"Basch","year":"2021","journal-title":"Clin Trials"},{"issue":"3","key":"2023050808190381900_djad018-B25","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1016\/j.cct.2011.12.002","article-title":"Analysing randomised controlled trials with missing data: choice of approach affects conclusions","volume":"33","author":"Fielding","year":"2012","journal-title":"Contemp Clin Trials"},{"issue":"1","key":"2023050808190381900_djad018-B26","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1186\/1477-7525-6-57","article-title":"Simple imputation methods were inadequate for missing not at random (MNAR) quality of life data","volume":"6","author":"Fielding","year":"2008","journal-title":"Health Qual Life Outcomes"},{"issue":"1","key":"2023050808190381900_djad018-B27","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1186\/1477-7525-7-57","article-title":"Investigating the missing data mechanism in quality of life outcomes: a comparison of approaches","volume":"7","author":"Fielding","year":"2009","journal-title":"Health Qual Life Outcomes"},{"issue":"10","key":"2023050808190381900_djad018-B28","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1177\/0269216313486952","article-title":"Recommendations for managing missing data, attrition and response shift in palliative and end-of-life care research: part of the MORECare research method guidance on statistical issues","volume":"27","author":"Preston","year":"2013","journal-title":"Palliat Med"},{"issue":"9","key":"2023050808190381900_djad018-B29","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1200\/OP.20.00264","article-title":"Electronic patient-reported outcomes as digital therapeutics to improve cancer outcomes","volume":"16","author":"Basch","year":"2020","journal-title":"J Clin Oncol Oncol Pract"},{"issue":"1","key":"2023050808190381900_djad018-B30","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/biomet\/73.1.13","article-title":"Longitudinal data analysis using generalized linear models","volume":"73","author":"Liang","year":"1986","journal-title":"Biometrika"},{"issue":"3","key":"2023050808190381900_djad018-B31","first-page":"439","article-title":"Quasi-likelihood functions, generalized linear models, and the Gauss\u2014Newton method","volume":"61","author":"Wedderburn","year":"1974","journal-title":"Biometrika"},{"issue":"435","key":"2023050808190381900_djad018-B32","doi-asserted-by":"crossref","first-page":"1024","DOI":"10.1080\/01621459.1996.10476973","article-title":"Marginal regression models for clustered ordinal measurements","volume":"91","author":"Heagerty","year":"1996","journal-title":"J Am Stat Assoc"},{"issue":"25","key":"2023050808190381900_djad018-B33","doi-asserted-by":"crossref","first-page":"2417","DOI":"10.1056\/NEJMoa1805052","article-title":"Sorafenib for advanced and refractory desmoid tumors","volume":"379","author":"Gounder","year":"2018","journal-title":"N Engl J Med"},{"key":"2023050808190381900_djad018-B34","doi-asserted-by":"crossref","DOI":"10.4135\/9781412985369","volume-title":"Ordinal log-Linear Models","author":"Ishii-Kuntz","year":"1994"},{"key":"2023050808190381900_djad018-B35","doi-asserted-by":"crossref","DOI":"10.4135\/9781412984812","volume-title":"Logistic Regression Models for Ordinal Response Variables","author":"O'Connell","year":"2006"},{"issue":"10","key":"2023050808190381900_djad018-B36","doi-asserted-by":"crossref","first-page":"2457","DOI":"10.1007\/s11136-015-0974-y","article-title":"Communicating patient-reported outcome scores using graphic formats: results from a mixed-methods evaluation","volume":"24","author":"Brundage","year":"2015","journal-title":"Qual Life Res"},{"issue":"1","key":"2023050808190381900_djad018-B37","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/s11136-017-1710-6","article-title":"Presenting comparative study PRO results to clinicians and researchers: beyond the eye of the beholder","volume":"27","author":"Brundage","year":"2018","journal-title":"Qual Life Res"}],"container-title":["JNCI: Journal of the National Cancer Institute"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jnci\/advance-article-pdf\/doi\/10.1093\/jnci\/djad018\/49418286\/djad018.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jnci\/article-pdf\/115\/5\/586\/50206889\/djad018.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jnci\/article-pdf\/115\/5\/586\/50206889\/djad018.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,5]],"date-time":"2023-12-05T19:25:41Z","timestamp":1701804341000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jnci\/article\/115\/5\/586\/7009234"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,30]]},"references-count":37,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,1,30]]},"published-print":{"date-parts":[[2023,5,8]]}},"URL":"https:\/\/doi.org\/10.1093\/jnci\/djad018","relation":{},"ISSN":["0027-8874","1460-2105"],"issn-type":[{"value":"0027-8874","type":"print"},{"value":"1460-2105","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,5,1]]},"published":{"date-parts":[[2023,1,30]]}}}