{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T00:26:26Z","timestamp":1747182386229,"version":"3.40.5"},"reference-count":41,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2023,5,12]],"date-time":"2023-05-12T00:00:00Z","timestamp":1683849600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/100006034","name":"University of Southern California","doi-asserted-by":"publisher","award":["HHSN261201000034C"],"award-info":[{"award-number":["HHSN261201000034C"]}],"id":[{"id":"10.13039\/100006034","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Health Services Research"],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>To develop a risk adjustment approach and test reliability and validity for oncology survival measures.<\/jats:p><\/jats:sec><jats:sec><jats:title>Data Sources and Study Setting<\/jats:title><jats:p>We used the National Cancer Institute's Surveillance, Epidemiology, and End Results (SEER)\u2010Medicare data from 2010 to 2013, with mortality data through 2015.<\/jats:p><\/jats:sec><jats:sec><jats:title>Study Design<\/jats:title><jats:p>We developed 2\u2010year risk\u2010standardized survival rates (RSSR) for melanoma, non\u2010small cell lung cancer (NSCLC), and small cell lung cancer (SCLC). Patients were attributed to group practices based on the plurality of visits. We identified the risk\u2010adjustment variables via bootstrap and calculated the RSSRs. Reliability was tested via three approaches: (1) signal\u2010to\u2010noise ratio (SNR) reliability, (2) split\u2010half, and (3) test\u2013retest using bootstrap. We tested known group validity by stage at diagnosis using Cohen's <jats:italic>d<\/jats:italic>.<\/jats:p><\/jats:sec><jats:sec><jats:title>Data Collection\/Extraction Methods<\/jats:title><jats:p>We selected all patients enrolled in Medicare and linked to SEER during the measurement period with an incident first primary diagnosis of stage I\u2013IV melanoma, NSCLC, or SCLC. We excluded patients with missing data on month and\/or stage of diagnosis.<\/jats:p><\/jats:sec><jats:sec><jats:title>Principal Findings<\/jats:title><jats:p>Results are based on patients with melanoma (<jats:italic>n<\/jats:italic>\u2009=\u20094344); NSCLC (<jats:italic>n<\/jats:italic>\u2009=\u200916,080); and SCLC (<jats:italic>n<\/jats:italic>\u2009=\u20092807) diagnosed between 2012 and 2013. The median (interquartile range) for the RSSRs at the group practice\u2010level were 0.89 (0.83\u20130.87) for melanoma, 0.37 (0.30\u20130.43) for NSCLC, and 0.19 (0.11\u20130.25) for SCLC. C\u2010statistics for the models ranged from 0.725 to 0.825. The reliability varied by approach with median SNR 0.20, 0.25, and 0.13; median test\u2013retest 0.59, 0.57, and 0.56; median split\u2010half reliability 0.21, 0.29, and 0.29 for melanoma, NSCLC, and SCLC, respectively. Cohen's <jats:italic>d<\/jats:italic> for stage I\u2010IIIa and IIIb+ was 1.27, 0.86, 0.60 for melanoma, NSCLC, and SCLC, respectively.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Our results suggest that these cancer survival measures demonstrated adequate test\u2013retest reliability and expected findings for the known\u2010group validity analysis. If data limitations and feasibility challenges can be addressed, implementation of these quality measures may provide a survival metric used for oncology quality improvement efforts.<\/jats:p><\/jats:sec>","DOI":"10.1111\/1475-6773.14164","type":"journal-article","created":{"date-parts":[[2023,5,13]],"date-time":"2023-05-13T06:33:35Z","timestamp":1683959615000},"page":"1131-1140","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["The reliability and validity of lung cancer and melanoma clinical quality survival measures"],"prefix":"10.1111","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2318-9614","authenticated-orcid":false,"given":"Emma","family":"Pendl\u2010Robinson","sequence":"first","affiliation":[{"name":"Mathematica Policy Research  Princeton New Jersey USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keri L.","family":"Calkins","sequence":"additional","affiliation":[{"name":"Mathematica Policy Research  Ann Arbor Michigan USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samuel E.","family":"Simon","sequence":"additional","affiliation":[{"name":"Mathematica Policy Research  Cambridge Massachusetts USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kirsten","family":"Barrett","sequence":"additional","affiliation":[{"name":"Mathematica Policy Research  Washington DC USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9610-8424","authenticated-orcid":false,"given":"Dmitriy","family":"Poznyak","sequence":"additional","affiliation":[{"name":"Mathematica Policy Research  Princeton New Jersey USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2023,5,12]]},"reference":[{"unstructured":"Centers for Disease Control and Prevention.An Update on Cancer Deaths in the United States. Centers for Disease Control and Prevention. Published February 23 2021. Accessed September 2 2021.https:\/\/www.cdc.gov\/cancer\/dcpc\/research\/update\u2010on\u2010cancer\u2010deaths\/index.htm","key":"e_1_2_7_2_1"},{"doi-asserted-by":"publisher","key":"e_1_2_7_3_1","DOI":"10.1002\/cncr.32802"},{"unstructured":"National Quality Forum (NQF).NQF: Cancer 2015\u20132017 Technical Report. Published 2017a. Accessed September 2 2021.https:\/\/www.qualityforum.org\/Publications\/2017\/01\/Cancer_2015\u20102017_Technical_Report.aspx","key":"e_1_2_7_4_1"},{"doi-asserted-by":"publisher","key":"e_1_2_7_5_1","DOI":"10.1016\/j.athoracsur.2016.07.003"},{"doi-asserted-by":"publisher","key":"e_1_2_7_6_1","DOI":"10.1093\/jncimonographs\/lgu024"},{"doi-asserted-by":"publisher","key":"e_1_2_7_7_1","DOI":"10.1001\/jamaoncol.2015.3151"},{"doi-asserted-by":"publisher","key":"e_1_2_7_8_1","DOI":"10.1200\/JOP.2015.004622"},{"doi-asserted-by":"publisher","key":"e_1_2_7_9_1","DOI":"10.1245\/s10434\u2010019\u201007323\u2010w"},{"doi-asserted-by":"publisher","key":"e_1_2_7_10_1","DOI":"10.1001\/jamanetworkopen.2021.2474"},{"unstructured":"NQF.Draft Acceptable Reliability Thresholds. Published online 2021.https:\/\/www.qualityforum.org\/WorkArea\/linkit.aspx?LinkIdentifier=id&ItemID=95263","key":"e_1_2_7_11_1"},{"unstructured":"National Cancer Institute Division of Cancer Control and Population Sciences.Surveillance epidemiology and end results (SEER). National Cancer Institute. 2021:1\u20134. Accessed October 7 2021.https:\/\/seer.cancer.gov\/about\/factsheets\/SEER_Overview.pdf","key":"e_1_2_7_12_1"},{"issue":"4","key":"e_1_2_7_13_1","first-page":"188","article-title":"Charlson comorbidity index: ICD\u20109 update and ICD\u201010 translation","volume":"12","author":"Glasheen WP","year":"2019","journal-title":"Am Health Drug Benefits"},{"issue":"1","key":"e_1_2_7_14_1","first-page":"10","article-title":"Easy way to learn standardization: direct and indirect methods","volume":"7","author":"Naing NN","year":"2000","journal-title":"Malays J Med Sci"},{"doi-asserted-by":"publisher","key":"e_1_2_7_15_1","DOI":"10.1186\/1471\u20102288\u201012\u201082"},{"doi-asserted-by":"publisher","key":"e_1_2_7_16_1","DOI":"10.1201\/9781315372778"},{"doi-asserted-by":"publisher","key":"e_1_2_7_17_1","DOI":"10.1007\/978-3-319-75747-6_2"},{"doi-asserted-by":"publisher","key":"e_1_2_7_18_1","DOI":"10.1007\/978\u20103\u2010030\u201073976\u20108_9"},{"unstructured":"DraelosR.Measuring performance: AUPRC and average precision. Glass Box. Published March 2 2019. Accessed September 23 2021.https:\/\/glassboxmedicine.com\/2019\/03\/02\/measuring-performance-auprc\/","key":"e_1_2_7_19_1"},{"doi-asserted-by":"publisher","key":"e_1_2_7_20_1","DOI":"10.1007\/978\u20103\u2010030\u201016399\u20100"},{"doi-asserted-by":"publisher","key":"e_1_2_7_21_1","DOI":"10.1177\/2515245919879695"},{"unstructured":"Agency for Healthcare Research and Quality Agency for Healthcare Research and Quality (AHRQ).Quality Indicator Empirical Methods. Published online September 2019. 76.","key":"e_1_2_7_22_1"},{"unstructured":"Agency for Healthcare Research and Quality Agency for Healthcare Research and Quality (AHRQ).Quality Indicator Empirical Methods. Published online November 2014. 56.","key":"e_1_2_7_23_1"},{"doi-asserted-by":"publisher","key":"e_1_2_7_24_1","DOI":"10.1007\/978\u20101\u20104757\u20103462\u20101_5"},{"doi-asserted-by":"publisher","key":"e_1_2_7_25_1","DOI":"10.1177\/0962280215618688"},{"doi-asserted-by":"crossref","unstructured":"AdamsJL.The Reliability of Provider Profiling: A Tutorial. Published online June 25 2009. Accessed May 12 2021.https:\/\/www.rand.org\/pubs\/technical_reports\/TR653.html","key":"e_1_2_7_26_1","DOI":"10.7249\/TR653"},{"doi-asserted-by":"publisher","key":"e_1_2_7_27_1","DOI":"10.4135\/9781412953948.n398"},{"doi-asserted-by":"publisher","key":"e_1_2_7_28_1","DOI":"10.1007\/978-3-642-37131-8_4"},{"doi-asserted-by":"publisher","key":"e_1_2_7_29_1","DOI":"10.1007\/978\u201094\u2010007\u20100753\u20105"},{"doi-asserted-by":"publisher","key":"e_1_2_7_30_1","DOI":"10.1002\/cncr.22938"},{"doi-asserted-by":"publisher","key":"e_1_2_7_31_1","DOI":"10.1177\/107327480501200403"},{"volume-title":"Statistical power analysis for the behavioral sciences","year":"1988","author":"Cohen J","key":"e_1_2_7_32_1"},{"doi-asserted-by":"publisher","key":"e_1_2_7_33_1","DOI":"10.1377\/hlthaff.2020.01764"},{"doi-asserted-by":"publisher","key":"e_1_2_7_34_1","DOI":"10.1016\/j.athoracsur.2009.05.053"},{"doi-asserted-by":"publisher","key":"e_1_2_7_35_1","DOI":"10.1016\/j.athoracsur.2009.05.056"},{"doi-asserted-by":"publisher","key":"e_1_2_7_36_1","DOI":"10.1016\/j.athoracsur.2009.05.055"},{"doi-asserted-by":"publisher","key":"e_1_2_7_37_1","DOI":"10.1002\/cam4.1152"},{"doi-asserted-by":"publisher","key":"e_1_2_7_38_1","DOI":"10.1093\/jncimonographs\/lgz029"},{"doi-asserted-by":"publisher","key":"e_1_2_7_39_1","DOI":"10.1377\/hblog20201222.615286"},{"unstructured":"Centers for Medicare & Medicaid Services.Oncology Care Model. CMS Innovation Center. Published August 30 2021. Accessed September 2 2021.https:\/\/innovation.cms.gov\/innovation-models\/oncology-care","key":"e_1_2_7_40_1"},{"unstructured":"Quality Payment Program.Merit\u2010based incentive payment system (MIPS) 2022 reporting MIPS quality measures through Medicare part B claims quick start guide for small practices (traditional MIPS). U.S Centers for Medicare & Medicaid Services. 2022:1\u201337.https:\/\/qpp-cm-prod-content.s3.amazonaws.com\/uploads\/1711\/2022%20Part%20B%20Claims%20Measure%20Quick%20Start%20Guide.pdf","key":"e_1_2_7_41_1"},{"unstructured":"Centers for Medicare & Medicaid Services.Hybrid Measure Overview. CMS QualityNet. Accessed February 16 2023.https:\/\/qualitynet.cms.gov\/inpatient\/measures\/hybrid","key":"e_1_2_7_42_1"}],"container-title":["Health Services Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/1475-6773.14164","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,6]],"date-time":"2023-09-06T01:44:28Z","timestamp":1693964668000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1475-6773.14164"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,12]]},"references-count":41,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["10.1111\/1475-6773.14164"],"URL":"https:\/\/doi.org\/10.1111\/1475-6773.14164","archive":["Portico"],"relation":{},"ISSN":["0017-9124","1475-6773"],"issn-type":[{"type":"print","value":"0017-9124"},{"type":"electronic","value":"1475-6773"}],"subject":[],"published":{"date-parts":[[2023,5,12]]},"assertion":[{"value":"2023-05-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}