{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T05:06:22Z","timestamp":1784264782240,"version":"3.55.0"},"reference-count":36,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T00:00:00Z","timestamp":1784073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000054","name":"US National Cancer Institute","doi-asserted-by":"publisher","award":["HHSN261200800043C"],"award-info":[{"award-number":["HHSN261200800043C"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"US National Cancer Institute","doi-asserted-by":"publisher","award":["HHSN261201000063C"],"award-info":[{"award-number":["HHSN261201000063C"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"US National Cancer Institute","doi-asserted-by":"publisher","award":["HHSN261200800001E"],"award-info":[{"award-number":["HHSN261200800001E"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"US National Cancer Institute","doi-asserted-by":"publisher","award":["P30 CA015083"],"award-info":[{"award-number":["P30 CA015083"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010544","name":"Exelixis, Inc.","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100010544","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cancers"],"abstract":"<jats:p>Background\/Objectives: The PRO-CTCAE Average Composite Score (ACS), calculated as the mean of PRO-CTCAE composite scores, summarizes overall symptom and side effect burden. This study evaluated the test\u2013retest reliability, responsiveness to change, known-groups validity, and sensitivity to group differences in the ACS. Methods: Analyses used the original PRO-CTCAE validation dataset, including lung (n = 174), breast (n = 222), and head and neck (n = 139) cancer cohorts, and data from the COMET-2 randomized phase III trial comparing cabozantinib (n = 53) and mitoxantrone\u2013prednisone (n = 54) in men with previously treated prostate cancer. Test\u2013retest reliability was assessed using intraclass correlation coefficients (ICCs) from two-way mixed-effects models for agreement. Responsiveness was evaluated by relating ACS change scores (Visit 1 minus follow-up Visit 2) to patient-reported global ratings of change (GRC; worsened, unchanged, or improved) using standardized response means (SRMs) and Jonckheere\u2013Terpstra trend tests. Known-groups validity was examined by comparing mean ACS values between ECOG performance status groups (0\u20131 vs. 2\u20134). Sensitivity to treatment group differences was assessed using model-based area-under-the-curve (AUC) comparisons of longitudinal ACS trajectories. Results: Test\u2013retest reliability was acceptable, with ICCs among GRC-defined stable patients of 0.80 (95% CI: 0.70\u20130.87) in lung cancer, 0.84 (95% CI: 0.77\u20130.89) in breast cancer, and 0.77 (95% CI: 0.63\u20130.86) in head and neck cancer; ICCs based on assessments completed one day apart ranged from 0.88 to 0.90. The ACS demonstrated responsiveness, with SRMs of 0.30\/0.15\/\u22120.37 (lung), 0.29\/0.14\/\u22120.40 (breast), and \u22120.01\/\u22120.20\/\u22120.56 (head\/neck) for improved\/no-change\/worsened groups, respectively, and significant monotonic trends across GRC categories (all p &lt; 0.01). Known-groups validity was supported by conceptually expected differences in ACS values across distinct levels of self-reported patient-reported physical functioning and ECOG performance status categories. Mean ACS values were lower among patients with good versus limited physical functioning (0.71 vs. 1.23 in lung cancer, 0.52 vs. 1.19 in breast cancer, and 0.69 vs. 1.29 in head and neck cancer) and among patients with ECOG PS 0\u20131 versus 2\u20134 (0.93 vs. 1.31, 0.74 vs. 1.22, and 0.90 vs. 1.06, respectively). In COMET-2, higher symptom burden was detected in the cabozantinib arm compared with the mitoxantrone\u2013prednisone arm (AUC difference = 1.5, 95% CI: 0.2\u20132.8, p = 0.02). Conclusions: The ACS demonstrated acceptable test\u2013retest reliability, responsiveness, and known-groups validity across multiple cancer populations. These findings support its use as a complementary summary measure of overall symptomatic adverse event burden alongside individual symptom-level analyses.<\/jats:p>","DOI":"10.3390\/cancers18142265","type":"journal-article","created":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T01:05:07Z","timestamp":1784163907000},"page":"2265","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Psychometric Evaluation of the PRO-CTCAE Average Composite Score: Reliability, Responsiveness, Known-Groups Validity, and Sensitivity to Group Differences"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1301-4319","authenticated-orcid":false,"given":"Minji K.","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9912-1085","authenticated-orcid":false,"given":"Amylou C.","family":"Dueck","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Scottsdale, AZ 85259, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Blake T.","family":"Langlais","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Scottsdale, AZ 85259, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5305-6193","authenticated-orcid":false,"given":"Gina L.","family":"Mazza","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Scottsdale, AZ 85259, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gita","family":"Thanarajasingam","sequence":"additional","affiliation":[{"name":"Division of Hematology, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3526-3938","authenticated-orcid":false,"given":"Allison M.","family":"Deal","sequence":"additional","affiliation":[{"name":"Lineberger Comprehensive Cancer Center, University of North Carolina, Chapel Hill, NC 27599, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brie N.","family":"Noble","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Scottsdale, AZ 85259, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9430-2256","authenticated-orcid":false,"given":"Lauren","family":"Rogak","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Scottsdale, AZ 85259, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tito R.","family":"Mendoza","sequence":"additional","affiliation":[{"name":"Center for Cancer Research, National Cancer Institute, Rockville, MD 20850, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4153-9972","authenticated-orcid":false,"given":"Sandra A.","family":"Mitchell","sequence":"additional","affiliation":[{"name":"Division of Cancer Control and Population Sciences, National Cancer Institute, Rockville, MD 20850, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ethan","family":"Basch","sequence":"additional","affiliation":[{"name":"Lineberger Comprehensive Cancer Center, University of North Carolina, Chapel Hill, NC 27599, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,7,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1001\/jamaoncol.2015.2639","article-title":"Validity and Reliability of the US National Cancer Institute\u2019s Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)","volume":"1","author":"Dueck","year":"2015","journal-title":"JAMA Oncol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2047","DOI":"10.1007\/s11136-023-03374-5","article-title":"Reliability and validity of PRO-CTCAE\u00ae daily reporting with a 24-hour recall period","volume":"32","author":"Lee","year":"2023","journal-title":"Qual. Life Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e35951","DOI":"10.1002\/cncr.35951","article-title":"Methods for implementing and reporting the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events to measure patient-reported adverse events in cancer clinical trials","volume":"131","author":"Dueck","year":"2025","journal-title":"Cancer"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1093\/jnci\/djad018","article-title":"A toolbox of different approaches to analyze and present PRO-CTCAE data in oncology studies","volume":"115","author":"Regnault","year":"2023","journal-title":"JNCI J. Natl. Cancer Inst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lee, M.K., Mitchell, S.A., Basch, E., Deal, A.M., Langlais, B.T., Thanarajasingam, G., Ginos, B.F., Rogak, L., Mendoza, T.R., and Bennett, A.V. (2025). Psychometric Properties and Interpretability of PRO-CTCAE((R)) Average Composite Scores as a Summary Metric of Symptomatic Adverse Event Burden. Cancers, 17.","DOI":"10.3390\/cancers17213459"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2057","DOI":"10.1007\/s11136-015-0954-2","article-title":"Reflective, causal, and composite indicators of quality of life: A conceptual or an empirical distinction?","volume":"24","author":"Costa","year":"2015","journal-title":"Qual. Life Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e3","DOI":"10.1016\/j.jpainsymman.2017.10.024","article-title":"What Do \u201cNone,\u201d \u201cMild,\u201d \u201cModerate,\u201d \u201cSevere,\u201d and \u201cVery Severe\u201d Mean to Patients with Cancer? Content Validity of PRO-CTCAE Response Scales","volume":"55","author":"Atkinson","year":"2018","journal-title":"J. Pain. Symptom Manag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1901","DOI":"10.1007\/s11136-025-03950-x","article-title":"COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures: Version 2.0","volume":"34","author":"Gagnier","year":"2025","journal-title":"Qual. Life Res."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mokkink, L.B., Elsman, E., and Terwee, C.B. (2024). COSMIN Guideline for Conducting a Systematic Reviews of Patient-Reported Outcome Measures, Manual Version 2.0, COSMIN.","DOI":"10.1007\/s11136-024-03761-6"},{"key":"ref_10","unstructured":"U.S. Food and Drug Administration (2024). Core Patient-Reported Outcomes in Cancer Clinical Trials: Guidance for Industry, Center for Biologics Evaluation and Research."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1016\/j.eururo.2018.11.033","article-title":"Cabozantinib Versus Mitoxantrone-prednisone in Symptomatic Metastatic Castration-resistant Prostate Cancer: A Randomized Phase 3 Trial with a Primary Pain Endpoint","volume":"75","author":"Basch","year":"2019","journal-title":"Eur. Urol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e193332","DOI":"10.1001\/jamaoncol.2019.3332","article-title":"Assessment of Adverse Events From the Patient Perspective in a Phase 3 Metastatic Castration-Resistant Prostate Cancer Clinical Trial","volume":"6","author":"Dueck","year":"2020","journal-title":"JAMA Oncol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.jpainsymman.2021.07.031","article-title":"Evaluating Treatment Tolerability Using the Toxicity Index With Patient-Reported Outcomes Data","volume":"63","author":"Langlais","year":"2022","journal-title":"J. Pain. Symptom Manag."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1007\/s11136-021-03000-2","article-title":"Missing data strategies for the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) in Alliance A091105 and COMET-2","volume":"31","author":"Mazza","year":"2022","journal-title":"Qual. Life Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3005","DOI":"10.1200\/JCO.2015.65.5597","article-title":"Phase III Study of Cabozantinib in Previously Treated Metastatic Castration-Resistant Prostate Cancer: COMET-1","volume":"34","author":"Smith","year":"2016","journal-title":"J. Clin. Oncol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1186\/s41687-023-00611-w","article-title":"A multi-method approach to selecting PRO-CTCAE symptoms for patient-reported outcome in women with endometrial or ovarian cancer undergoing chemotherapy","volume":"7","author":"Christiansen","year":"2023","journal-title":"J. Patient Rep. Outcomes"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Escudero-Vilaplana, V., Bernal, E., Casado, G., Collado-Borrell, R., Diez-Fernandez, R., Fernandez Roman, A.B., Folguera, C., Gonzalez-Cortijo, L., Herrero-Fernandez, M., and Marquina, G. (2022). Defining a Standard Set of Patient-Reported Outcomes for Patients With Advanced Ovarian Cancer. Front. Oncol., 12.","DOI":"10.3389\/fonc.2022.885910"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"100775","DOI":"10.1016\/j.esmoop.2022.100775","article-title":"Selecting a PRO-CTCAE-based subset for patient-reported symptom monitoring in prostate cancer patients: A modified Delphi procedure","volume":"8","author":"Feldman","year":"2023","journal-title":"ESMO Open"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3013","DOI":"10.1007\/s11136-024-03767-0","article-title":"Using a modified Delphi procedure to select a PRO-CTCAE-based subset for patient-reported symptomatic toxicity monitoring in rectal cancer patients","volume":"33","author":"Geurts","year":"2024","journal-title":"Qual. Life Res."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"G\u00fcnther, M., Hentschel, L., Schuler, M., M\u00fcller, T., Sch\u00fctte, K., Ko, Y.D., Schmidt-Wolf, I., and Jaehde, U. (2023). Developing tumor-specific PRO-CTCAE item sets: Analysis of a cross-sectional survey in three German outpatient cancer centers. BMC Cancer, 23.","DOI":"10.1186\/s12885-023-11115-7"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1186\/s41687-021-00326-w","article-title":"Development of patient-reported outcomes item set to evaluate acute treatment toxicity to pelvic online magnetic resonance-guided radiotherapy","volume":"5","author":"Moller","year":"2021","journal-title":"J. Patient Rep. Outcomes"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.ijrobp.2018.04.048","article-title":"Content Validity of Anatomic Site-Specific Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) Item Sets for Assessment of Acute Symptomatic Toxicities in Radiation Oncology","volume":"102","author":"Sandler","year":"2018","journal-title":"Int. J. Radiat. Oncol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1186\/s41687-019-0141-2","article-title":"Patient-reported outcomes item selection for bladder cancer patients in chemo- or immunotherapy","volume":"3","author":"Taarnhoj","year":"2019","journal-title":"J. Patient Rep. Outcomes"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e26574","DOI":"10.2196\/26574","article-title":"Selecting a Subset Based on the Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events for Patient-Reported Symptom Monitoring in Lung Cancer Treatment: Mixed Methods Study","volume":"7","author":"Veldhuijzen","year":"2021","journal-title":"JMIR Cancer"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1177\/1740774520975120","article-title":"Composite grading algorithm for the National Cancer Institute\u2019s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)","volume":"18","author":"Basch","year":"2021","journal-title":"Clin. Trials"},{"key":"ref_26","unstructured":"Langlais, B., Klanderman, M., Noble, B., Voss, M., and Dueck, A. (2026, July 01). ProAE: Tools for PRO-CTCAE Scoring, Analysis, and Graphical Display. Available online: https:\/\/CRAN.R-project.org\/."},{"key":"ref_27","unstructured":"Deal, A.M.N.B.N., Mazza, G.L., Dueck, A.C., and Lee, M.K. (2025, January 24). Evaluating missing data imputation strategies for PRO-CTCAE composite average. Proceedings of the International Society for Quality of Life, Milwaukee, WI, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1007\/s11136-018-2076-0","article-title":"Assessing test-retest reliability of patient-reported outcome measures using intraclass correlation coefficients: Recommendations for selecting and documenting the analytical formula","volume":"28","author":"Qin","year":"2019","journal-title":"Qual. Life Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.jclinepi.2006.03.012","article-title":"Quality criteria were proposed for measurement properties of health status questionnaires","volume":"60","author":"Terwee","year":"2007","journal-title":"J. Clin. Epidemiol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1186\/s12955-016-0489-4","article-title":"Thresholds for clinical importance for four key domains of the EORTC QLQ-C30: Physical functioning, emotional functioning, fatigue and pain","volume":"14","author":"Giesinger","year":"2016","journal-title":"Health Qual. Life Out."},{"key":"ref_31","unstructured":"Pinheiro, J., Bates, D., and R Core Team (2026). nlme: Linear and Nonlinear Mixed Effects Models, R Package Version 3.1-169, Comprehensive R Archive Network."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"101547","DOI":"10.1016\/j.conctc.2025.101547","article-title":"Use of patient-reported outcomes version of the common terminology criteria for adverse events in oncology clinical trials","volume":"47","author":"Rogak","year":"2025","journal-title":"Contemp. Clin. Trials Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1266","DOI":"10.1093\/jnci\/djaa028","article-title":"Evaluating Treatment Tolerability in Cancer Clinical Trials Using the Toxicity Index","volume":"112","author":"Gresham","year":"2020","journal-title":"JNCI J. Natl. Cancer Inst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1002\/sim.8858","article-title":"On the properties of the toxicity index and its statistical efficiency","volume":"40","author":"Razaee","year":"2021","journal-title":"Stat. Med."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"14839","DOI":"10.1038\/s41598-024-62307-5","article-title":"Developing a fit-for-purpose composite symptom score as a symptom burden endpoint for clinical trials in patients with malignant pleural mesothelioma","volume":"14","author":"Cleeland","year":"2024","journal-title":"Sci. Rep."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1002\/cncr.27744","article-title":"Recommendations for including multiple symptoms as endpoints in cancer clinical trials","volume":"119","author":"Cleeland","year":"2013","journal-title":"Cancer"}],"container-title":["Cancers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6694\/18\/14\/2265\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T04:25:18Z","timestamp":1784262318000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6694\/18\/14\/2265"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,15]]},"references-count":36,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2026,7]]}},"alternative-id":["cancers18142265"],"URL":"https:\/\/doi.org\/10.3390\/cancers18142265","relation":{},"ISSN":["2072-6694"],"issn-type":[{"value":"2072-6694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,15]]}}}