{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T23:26:00Z","timestamp":1793316360370,"version":"4.5.0"},"reference-count":22,"publisher":"American Medical Association (AMA)","issue":"9","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"\n Importance<\/jats:title>\n The conditions required for health record data sources to accurately assess treatment effectiveness remain unclear. Emulation of randomized clinical trials (RCTs) with health record data and subsequent calibration of the results can help elucidate this.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n To pilot an emulation of the KEYNOTE-189 RCT using a commercially available electronic health record (EHR) data source.<\/jats:p>\n <\/jats:sec>\n \n Design, Setting, and Participants<\/jats:title>\n \n This retrospective cohort study used an EHR database spanning from April 2007 to February 2023. Follow-up began on treatment initiation and proceeded until an outcome event, loss to follow-up, end of data, or end of study period (640 days). The population-based cohort was ascertained from EHRs provided by 52 health systems across the US. Eligibility criteria were defined as closely as possible to the benchmark RCT. Patients with non\u2013small cell lung cancer initiating first-line treatment for metastatic disease were included. Patients with evidence of squamous non\u2013small cell lung cancer, primary nonlung malignant neoplasms, or identified\n EGFR<\/jats:italic>\n \/\n ALK<\/jats:italic>\n variations were excluded. Data were analyzed from June to October 2023.\n <\/jats:p>\n <\/jats:sec>\n \n Exposures<\/jats:title>\n Initiation of first-line pembrolizumab and chemotherapy and chemotherapy alone. Chemotherapy in both groups was defined as a combination of pemetrexed and platinum-based (carboplatin or cisplatin) therapy.<\/jats:p>\n <\/jats:sec>\n \n Main Outcomes and Measures<\/jats:title>\n Outcomes of interest were 12-month survival probability and mortality hazard ratio (HR).<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n A total of 1854 patients (mean [SD] age, 63.7 [9.6] years; 971 [52.4%] men) were eligible, including 589 patients who initiated pembrolizumab and chemotherapy and 1265 patients who initiated chemotherapy only. The cohort included 364 Black patients (19.6%) and 1445 White patients (77.9%). The 12-month survival probabilities were 0.60 (95% CI, 0.54-0.65) in the pembrolizumab group and 0.58 (95% CI, 0.55-0.62) in the chemotherapy-only group, compared with 0.69 (95% CI, 0.64-0.74) in the KEYNOTE-189 pembrolizumab group and 0.49 (95% CI, 0.42-0.56) in the KEYNOTE-189 chemotherapy-only group. The mortality HR was 0.95 (95% CI, 0.78-1.16), compared with 0.49 (95% CI, 0.38-0.64) in the KEYNOTE-189 RCT.<\/jats:p>\n <\/jats:sec>\n \n Conclusions and Relevance<\/jats:title>\n In this cohort study piloting an RCT emulation, results were incongruous with the benchmark trial. Differences in patient treatment and data capture between the RCT and EHR populations, confounding by indication, treatment crossover, and accuracy of captured diagnoses may explain these findings. Future feasibility assessments will require data sources to have important oncology-specific measures curated.<\/jats:p>\n <\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2024.36535","type":"journal-article","created":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T11:32:24Z","timestamp":1727695944000},"page":"e2436535","source":"Crossref","is-referenced-by-count":11,"title":["Calibrating Observational Health Record Data Against a Randomized Trial"],"prefix":"10.1001","volume":"7","author":[{"given":"David","family":"Merola","sequence":"first","affiliation":[{"name":"Aetion, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ulka","family":"Campbell","sequence":"additional","affiliation":[{"name":"Aetion, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Lenis","sequence":"additional","affiliation":[{"name":"Aetion, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Schneeweiss","sequence":"additional","affiliation":[{"name":"Division of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women\u2019s Hospital and Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shirley","family":"Wang","sequence":"additional","affiliation":[{"name":"Division of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women\u2019s Hospital and Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ann","family":"Madsen","sequence":"additional","affiliation":[{"name":"Aetion, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gillis","family":"Carrigan","sequence":"additional","affiliation":[{"name":"Center for Observational Research, Amgen, San Francisco, California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victoria","family":"Chia","sequence":"additional","affiliation":[{"name":"Center for Observational Research, Amgen, San Francisco, California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Osayi E.","family":"Ovbiosa","sequence":"additional","affiliation":[{"name":"AbbVie, North Chicago, Illinois"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simone","family":"Pinheiro","sequence":"additional","affiliation":[{"name":"AbbVie, North Chicago, Illinois"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nelson","family":"Pace","sequence":"additional","affiliation":[{"name":"AbbVie, North Chicago, Illinois"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amanda","family":"Bruno","sequence":"additional","affiliation":[{"name":"Bayer Pharmaceuticals, Philadelphia, Pennsylvania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Stewart","sequence":"additional","affiliation":[{"name":"Friends of Cancer Research, Washington, District of Columbia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sajan","family":"Khosla","sequence":"additional","affiliation":[{"name":"AstraZeneca, Gaithersburg, Maryland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiduo","family":"Zhang","sequence":"additional","affiliation":[{"name":"AstraZeneca, Gaithersburg, Maryland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mothaffar","family":"Rimawi","sequence":"additional","affiliation":[{"name":"Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rachele","family":"Hendricks-Sturrup","sequence":"additional","affiliation":[{"name":"Duke-Margolis Center for Health Policy, Washington, District of Columbia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jenny","family":"Huang","sequence":"additional","affiliation":[{"name":"Gilead Sciences, Foster City, California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aliki","family":"Taylor","sequence":"additional","affiliation":[{"name":"Gilead Sciences, Foster City, California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"XiaoLong","family":"Jiao","sequence":"additional","affiliation":[{"name":"Pfizer, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren","family":"Becnel","sequence":"additional","affiliation":[{"name":"Pfizer, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lynn","family":"McRoy","sequence":"additional","affiliation":[{"name":"Pfizer, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joy","family":"Eckert","sequence":"additional","affiliation":[{"name":"Reagan-Udall Foundation for the Food and Drug Administration, Washington, District of Columbia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carla","family":"Rodriguez","sequence":"additional","affiliation":[{"name":"Reagan-Udall Foundation for the Food and Drug Administration, Washington, District of Columbia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Orsolya","family":"Lunacsek","sequence":"additional","affiliation":[{"name":"Bayer Pharmaceuticals, Whippany, New Jersey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raymond","family":"Harvey","sequence":"additional","affiliation":[{"name":"Johnson & Johnson, New Brunswick, New Jersey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joel","family":"Greshock","sequence":"additional","affiliation":[{"name":"Johnson & Johnson, New Brunswick, New Jersey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Khaled","family":"Sarsour","sequence":"additional","affiliation":[{"name":"Johnson & Johnson, New Brunswick, New Jersey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Belli","sequence":"additional","affiliation":[{"name":"COTA Healthcare, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"C. K.","family":"Wang","sequence":"additional","affiliation":[{"name":"COTA Healthcare, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Fernandes","sequence":"additional","affiliation":[{"name":"COTA Healthcare, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Chen","sequence":"additional","affiliation":[{"name":"Tempus, Chicago, Illinois"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"San Francisco","sequence":"additional","affiliation":[{"name":"Tempus, Chicago, Illinois"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chithra","family":"Sangli","sequence":"additional","affiliation":[{"name":"Tempus, Chicago, Illinois"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yana","family":"Natanzon","sequence":"additional","affiliation":[{"name":"ConcertAI, Cambridge, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"K. Arnold","family":"Chan","sequence":"additional","affiliation":[{"name":"TriNetX, Cambridge, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil","family":"Dhopeshwarkar","sequence":"additional","affiliation":[{"name":"TriNetX, Cambridge, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Shapiro","sequence":"additional","affiliation":[{"name":"xCures, Oakland, California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asher","family":"Wasserman","sequence":"additional","affiliation":[{"name":"xCures, Oakland, California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jameson","family":"Quinn","sequence":"additional","affiliation":[{"name":"xCures, Oakland, California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Megan","family":"Rees","sequence":"additional","affiliation":[{"name":"Loopback Analytics, Dallas, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Travis","family":"Robinson","sequence":"additional","affiliation":[{"name":"Loopback Analytics, Dallas, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ben","family":"Taylor","sequence":"additional","affiliation":[{"name":"Aetion, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer R.","family":"Rider","sequence":"additional","affiliation":[{"name":"Aetion, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2024,9,30]]},"reference":[{"key":"zoi241074r1","doi-asserted-by":"publisher","first-page":"b5087","DOI":"10.1136\/bmj.b5087","article-title":"Problem of immortal time bias in cohort studies: example using statins for preventing progression of diabetes.","volume":"340","author":"L\u00e9vesque","year":"2010","journal-title":"BMJ"},{"key":"zoi241074r2","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.jclinepi.2016.04.014","article-title":"Specifying a target trial prevents immortal time bias and other self-inflicted injuries in observational analyses.","volume":"79","author":"Hern\u00e1n","year":"2016","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"zoi241074r3","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1002\/cpt.2466","article-title":"The Structured Process to Identify Fit-For-Purpose Data: A Data Feasibility Assessment Framework.","volume":"111","author":"Gatto","year":"2022","journal-title":"Clin Pharmacol Ther"},{"issue":"1","key":"zoi241074r4","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1002\/cpt.1480","article-title":"A structured preapproval and postapproval comparative study design framework to generate valid and transparent real-world evidence for regulatory decisions.","volume":"106","author":"Gatto","year":"2019","journal-title":"Clin Pharmacol Ther"},{"issue":"1","key":"zoi241074r5","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1002\/cpt.2466","article-title":"The structured process to identify fit-for-purpose data: a data feasibility assessment framework.","volume":"111","author":"Gatto","year":"2022","journal-title":"Clin Pharmacol Ther"},{"key":"zoi241074r6","doi-asserted-by":"publisher","first-page":"601","DOI":"10.2147\/CLEP.S358583","article-title":"A framework for visualizing study designs and data observability in electronic health record data.","volume":"14","author":"Wang","year":"2022","journal-title":"Clin Epidemiol"},{"issue":"10","key":"zoi241074r8","doi-asserted-by":"publisher","first-page":"1002","DOI":"10.1161\/CIRCULATIONAHA.120.051718","article-title":"Emulating randomized clinical trials with nonrandomized real-world evidence studies: first results from the RCT DUPLICATE Initiative.","volume":"143","author":"Franklin","year":"2021","journal-title":"Circulation"},{"issue":"4","key":"zoi241074r9","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1002\/cpt.1633","article-title":"Nonrandomized real-world evidence to support regulatory decision making: process for a randomized trial replication project.","volume":"107","author":"Franklin","year":"2020","journal-title":"Clin Pharmacol Ther"},{"issue":"6","key":"zoi241074r10","doi-asserted-by":"publisher","first-page":"1217","DOI":"10.1002\/cpt.2800","article-title":"The Aetion coalition to advance real-world evidence through randomized controlled trial emulation initiative: oncology.","volume":"113","author":"Merola","year":"2023","journal-title":"Clin Pharmacol Ther"},{"issue":"22","key":"zoi241074r11","doi-asserted-by":"publisher","first-page":"2078","DOI":"10.1056\/NEJMoa1801005","article-title":"Pembrolizumab plus chemotherapy in metastatic non\u2013small-cell lung cancer.","volume":"378","author":"Gandhi","year":"2018","journal-title":"N Engl J Med"},{"issue":"4","key":"zoi241074r13","doi-asserted-by":"publisher","first-page":"735","DOI":"10.1002\/cpt.1793","article-title":"Emulation differences vs. biases when calibrating real-world evidence findings against randomized controlled trials.","volume":"107","author":"Franklin","year":"2020","journal-title":"Clin Pharmacol Ther"},{"key":"zoi241074r14","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.jclinepi.2017.11.021","article-title":"Electronic medical records can be used to emulate target trials of sustained treatment strategies.","volume":"96","author":"Danaei","year":"2018","journal-title":"J Clin Epidemiol"},{"issue":"25","key":"zoi241074r15","doi-asserted-by":"publisher","first-page":"3083","DOI":"10.1002\/sim.3697","article-title":"Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples.","volume":"28","author":"Austin","year":"2009","journal-title":"Stat Med"},{"issue":"7","key":"zoi241074r16","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1136\/jech.2004.029496","article-title":"Estimating causal effects from epidemiological data.","volume":"60","author":"Hern\u00e1n","year":"2006","journal-title":"J Epidemiol Community Health"},{"issue":"5","key":"zoi241074r17","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1002\/pds.1200","article-title":"Sensitivity analysis and external adjustment for unmeasured confounders in epidemiologic database studies of therapeutics.","volume":"15","author":"Schneeweiss","year":"2006","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"zoi241074r18","doi-asserted-by":"publisher","first-page":"157","DOI":"10.2147\/CLEP.S129785","article-title":"Missing data and multiple imputation in clinical epidemiological research.","volume":"9","author":"Pedersen","year":"2017","journal-title":"Clin Epidemiol"},{"issue":"2","key":"zoi241074r19","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1002\/cpt.2443","article-title":"Real-world overall survival using oncology electronic health record data: Friends of Cancer Research Pilot.","volume":"111","author":"Lasiter","year":"2022","journal-title":"Clin Pharmacol Ther"},{"issue":"11","key":"zoi241074r20","doi-asserted-by":"publisher","first-page":"2321","DOI":"10.1158\/1078-0432.CCR-21-3646","article-title":"Continuation of pembrolizumab with additional chemotherapy after progression with PD-1\/PD-L1 inhibitor monotherapy in patients with advanced NSCLC: a randomized, placebo-controlled phase II study.","volume":"28","author":"Jung","year":"2022","journal-title":"Clin Cancer Res"},{"issue":"3","key":"zoi241074r21","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1097\/COC.0000000000000513","article-title":"Survival implications of de novo versus recurrent metastatic non\u2013small cell lung cancer.","volume":"42","author":"Moore","year":"2019","journal-title":"Am J Clin Oncol"},{"issue":"5","key":"zoi241074r22","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2022.14046","article-title":"Association between smoking history and overall survival in patients receiving pembrolizumab for first-line treatment of advanced non\u2013small cell lung cancer.","volume":"5","author":"Popat","year":"2022","journal-title":"JAMA Netw Open"},{"key":"zoi241074r7","unstructured":"Wang? SW, Potteg\u00e5rd? A, Crown? W, . Harmonized Protocol Template to Enhance Reproducibility (HARPER) of hypothesis evaluating real-world evidence studies on treatment effects: a good practices report of a joint ISPE\/ISPOR task force. Accessed June 28, 2022. https:\/\/osf.io\/6qxpf\/"},{"key":"zoi241074r12","unstructured":"Merola? D, Campbell? U, Lenis? D, . Emulation of the KEYNOTE-189 trial using electronic health records. Accessed August 29. 2024. https:\/\/clinicaltrials.gov\/study\/NCT05908799"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2824209\/merola_2024_oi_241074_1727207867.9753.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T11:32:26Z","timestamp":1727695946000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2824209"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,30]]},"references-count":22,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2024,9,3]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2024.36535","relation":{"is-referenced-by":[{"id-type":"doi","id":"10.1007\/s15010-025-02563-3","asserted-by":"object"}]},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,30]]}}}