{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T14:15:48Z","timestamp":1789827348871,"version":"4.0.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,5,28]],"date-time":"2022-05-28T00:00:00Z","timestamp":1653696000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,28]],"date-time":"2022-05-28T00:00:00Z","timestamp":1653696000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Observational data are increasingly being used to conduct external comparisons to clinical trials. In this study, we empirically examined whether different methodological approaches to longitudinal missing data affected study conclusions in this setting.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We used data from one clinical trial and one prospective observational study, both Norwegian multicenter studies including patients with recently diagnosed rheumatoid arthritis and implementing similar treatment strategies, but with different stringency. A binary disease remission status was defined at 6, 12, and 24\u2009months in both studies. After identifying patterns of longitudinal missing outcome data, we evaluated the following five approaches to handle missingness: analyses of patients with complete follow-up data, multiple imputation (MI), inverse probability of censoring weighting (IPCW), and two combinations of MI and IPCW.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We found a complex non-monotone missing data pattern in the observational study (<jats:italic>N<\/jats:italic>\u2009=\u2009328), while missing data in the trial (<jats:italic>N<\/jats:italic>\u2009=\u2009188) was monotone due to drop-out. In the observational study, only 39.0% of patients had complete outcome data, compared to 89.9% in the trial. All approaches to missing data indicated favorable outcomes of the treatment strategy in the trial and resulted in similar study conclusions. Variations in results across approaches were mainly due to variations in estimated outcomes for the observational data.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Five different approaches to handle longitudinal missing data resulted in similar conclusions in our example. However, the extent and complexity of missing observational data affected estimated comparative outcomes across approaches, highlighting the need for careful consideration of methods to account for missingness in this setting. Based on this empirical examination, we recommend using a prespecified advanced missing data approach to account for longitudinal missing data, and to conduct alternative approaches in sensitivity analyses.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12874-022-01639-0","type":"journal-article","created":{"date-parts":[[2022,5,28]],"date-time":"2022-05-28T12:02:48Z","timestamp":1653739368000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Using observational study data as an external control group for a clinical trial: an empirical comparison of methods to account for longitudinal missing data"],"prefix":"10.1186","volume":"22","author":[{"given":"Vibeke","family":"Norvang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Espen A.","family":"Haavardsholm","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sara K.","family":"Tedeschi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Houchen","family":"Lyu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph","family":"Sexton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria D.","family":"Mjaavatten","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tore K.","family":"Kvien","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel H.","family":"Solomon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kazuki","family":"Yoshida","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,5,28]]},"reference":[{"key":"1639_CR1","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1002\/cpt.1658","volume":"107","author":"BK Beaulieu-Jones","year":"2020","unstructured":"Beaulieu-Jones BK, Finlayson SG, Yuan W, Altman RB, Kohane IS, Prasad V, et al. Examining the Use of Real-World Evidence in the Regulatory Process. Clin Pharmacol Ther. 2020;107:843\u201352.","journal-title":"Clin Pharmacol Ther"},{"key":"1639_CR2","unstructured":"US Food and Drug Administration. Real-world evidence. https:\/\/www.fda.gov\/science-research\/science-and-research-special-topics\/real-world-evidence. Assessed 30 September 2021."},{"key":"1639_CR3","doi-asserted-by":"publisher","first-page":"867","DOI":"10.1002\/cpt.1351","volume":"105","author":"JM Franklin","year":"2019","unstructured":"Franklin JM, Glynn RJ, Martin D, Schneeweiss S. Evaluating the Use of Nonrandomized Real-World Data Analyses for Regulatory Decision Making. Clin Pharmacol Ther. 2019;105:867\u201377.","journal-title":"Clin Pharmacol Ther"},{"key":"1639_CR4","doi-asserted-by":"publisher","first-page":"1228","DOI":"10.1002\/pds.4975","volume":"29","author":"M Burcu","year":"2020","unstructured":"Burcu M, Dreyer NA, Franklin JM, Blum MD, Critchlow CW, Perfetto EM, et al. Real-world evidence to support regulatory decision-making for medicines: Considerations for external control arms. Pharmacoepidemiol Drug Saf. 2020;29:1228\u201335.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"1639_CR5","doi-asserted-by":"publisher","first-page":"457","DOI":"10.2147\/CLEP.S242097","volume":"12","author":"K Thorlund","year":"2020","unstructured":"Thorlund K, Dron L, Park JJH, Mills EJ. Synthetic and External Controls in Clinical Trials - A Primer for Researchers. Clin Epidemiol. 2020;12:457\u201367.","journal-title":"Clin Epidemiol"},{"key":"1639_CR6","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1002\/cpt.1723","volume":"107","author":"H Schmidli","year":"2020","unstructured":"Schmidli H, H\u00e4ring DA, Thomas M, Cassidy A, Weber S, Bretz F. Beyond Randomized Clinical Trials: Use of External Controls. Clin Pharmacol Ther. 2020;107:806\u201316.","journal-title":"Clin Pharmacol Ther"},{"key":"1639_CR7","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1093\/rheumatology\/kex394","volume":"57","author":"G Kilcher","year":"2018","unstructured":"Kilcher G, Hummel N, Didden EM, Egger M, Reichenbach S. Rheumatoid arthritis patients treated in trial and real world settings: comparison of randomized trials with registries. Rheumatology (Oxford). 2018;57:354\u201369.","journal-title":"Rheumatology (Oxford)"},{"key":"1639_CR8","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1007\/s10654-019-00516-3","volume":"34","author":"NS Weiss","year":"2019","unstructured":"Weiss NS. Generalizing from the results of randomized studies of treatment: Can non-randomized studies be of help? Eur J Epidemiol. 2019;34:715\u20138.","journal-title":"Eur J Epidemiol"},{"key":"1639_CR9","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1080\/10543406.2017.1372773","volume":"28","author":"RF Potthoff","year":"2018","unstructured":"Potthoff RF. Differential losses to follow-up that are outcome-dependent can vitiate a clinical trial: Simulation results. J Biopharm Stat. 2018;28:633\u201344.","journal-title":"J Biopharm Stat"},{"key":"1639_CR10","doi-asserted-by":"publisher","first-page":"e23","DOI":"10.1097\/MLR.0000000000000011","volume":"54","author":"S Haneuse","year":"2016","unstructured":"Haneuse S. Distinguishing Selection Bias and Confounding Bias in Comparative Effectiveness Research. Med Care. 2016;54:e23\u20139.","journal-title":"Med Care"},{"key":"1639_CR11","doi-asserted-by":"publisher","unstructured":"Norvang V, Brinkmann GH, Yoshida K, Lillegraven S, Aga AB, Sexton J, et al. Achievement of remission in two early rheumatoid arthritis cohorts implementing different treat-to-target strategies. Arthritis Rheum. 2020. https:\/\/doi.org\/10.1002\/art.41232.","DOI":"10.1002\/art.41232"},{"key":"1639_CR12","doi-asserted-by":"publisher","first-page":"i4205","DOI":"10.1136\/bmj.i4205","volume":"354","author":"EA Haavardsholm","year":"2016","unstructured":"Haavardsholm EA, Aga AB, Olsen IC, Lillegraven S, Hammer HB, Uhlig T, et al. Ultrasound in management of rheumatoid arthritis: ARCTIC randomised controlled strategy trial. BMJ. 2016;354:i4205.","journal-title":"BMJ."},{"key":"1639_CR13","doi-asserted-by":"publisher","first-page":"808","DOI":"10.1016\/j.semarthrit.2018.07.004","volume":"48","author":"GH Brinkmann","year":"2019","unstructured":"Brinkmann GH, Norvang V, Norli ES, Grovle L, Haugen AJ, Lexberg AS, et al. Treat to target strategy in early rheumatoid arthritis versus routine care - A comparative clinical practice study. Semin Arthritis Rheum. 2019;48:808\u201314.","journal-title":"Semin Arthritis Rheum"},{"key":"1639_CR14","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1136\/annrheumdis-2015-207524","volume":"75","author":"JS Smolen","year":"2016","unstructured":"Smolen JS, Breedveld FC, Burmester GR, Bykerk V, Dougados M, Emery P, et al. Treating rheumatoid arthritis to target: 2014 update of the recommendations of an international task force. Ann Rheum Dis. 2016;75:3\u201315.","journal-title":"Ann Rheum Dis"},{"key":"1639_CR15","doi-asserted-by":"publisher","first-page":"1540","DOI":"10.1002\/acr.24042","volume":"71","author":"BR England","year":"2019","unstructured":"England BR, Tiong BK, Bergman MJ, Curtis JR, Kazi S, Mikuls TR, et al. 2019 Update of the American College of Rheumatology Recommended Rheumatoid Arthritis Disease Activity Measures. Arthritis Care Res. 2019;71:1540\u201355.","journal-title":"Arthritis Care Res"},{"key":"1639_CR16","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1136\/annrheumdis-2019-216655","volume":"79","author":"JS Smolen","year":"2020","unstructured":"Smolen JS, Landew\u00e9 RBM, Bijlsma JWJ, Burmester GR, Dougados M, Kerschbaumer A, et al. EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2019 update. Ann Rheum Dis. 2020;79:685\u201399.","journal-title":"Ann Rheum Dis"},{"issue":"73","key":"1639_CR17","doi-asserted-by":"publisher","first-page":"1108","DOI":"10.1002\/art.41752","volume":"2021","author":"L Fraenkel","year":"2021","unstructured":"Fraenkel L, Bathon JM, England BR, St. Clair EW, Arayssi T, Carandang K, et al. American College of Rheumatology Guideline for the Treatment of Rheumatoid Arthritis. Arthritis Rheum. 2021;2021(73):1108\u201323.","journal-title":"Arthritis Rheum"},{"issue":"4","key":"1639_CR18","doi-asserted-by":"publisher","first-page":"6317","DOI":"10.1136\/ard.2009.123919","volume":"69","author":"JS Smolen","year":"2010","unstructured":"Smolen JS, Aletaha D, Bijlsma JW, Breedveld FC, Boumpas D, Burmester G, et al. Treating rheumatoid arthritis to target: recommendations of an international task force. Ann Rheum Dis. 2010;69(4):6317.","journal-title":"Ann Rheum Dis"},{"key":"1639_CR19","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1093\/aje\/kwv254","volume":"183","author":"MA Hern\u00e1n","year":"2016","unstructured":"Hern\u00e1n MA, Robins JM. Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available. Am J Epidemiol. 2016;183:758\u201364.","journal-title":"Am J Epidemiol"},{"key":"1639_CR20","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1093\/biomet\/70.1.41","volume":"70","author":"PR Rosenbaum","year":"1983","unstructured":"Rosenbaum PR, Rubin DB. The central role of propensity score in observational studies for causal effects. Biometrika. 1983;70:41\u201355.","journal-title":"Biometrika."},{"key":"1639_CR21","doi-asserted-by":"publisher","first-page":"3661","DOI":"10.1002\/sim.6607","volume":"34","author":"PC Austin","year":"2015","unstructured":"Austin PC, Stuart EA. Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies. Stat Med. 2015;34:3661\u201379.","journal-title":"Stat Med"},{"issue":"3","key":"1639_CR22","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1093\/aje\/kwx350","volume":"187","author":"B Sun","year":"2018","unstructured":"Sun B, Perkins NJ, Cole SR, Harel O, Mitchell EM, Schisterman EF, et al. Inverse-Probability-Weighted Estimation for Monotone and Nonmonotone Missing Data. Am J Epidemiol. 2018;187(3):585\u201391.","journal-title":"Am J Epidemiol"},{"issue":"1","key":"1639_CR23","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1177\/0962280212448721","volume":"25","author":"C Tseng","year":"2016","unstructured":"Tseng C, Elashoff R, Li N, Li G. Longitudinal data analysis with non-ignorable missing data. Stat Methods Med Res. 2016;25(1):205\u201320.","journal-title":"Stat Methods Med Res"},{"key":"1639_CR24","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1177\/0962280210395740","volume":"22","author":"SR Seaman","year":"2013","unstructured":"Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2013;22:278\u201395.","journal-title":"Stat Methods Med Res"},{"key":"1639_CR25","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316696","volume-title":"Multiple Imputation for Nonresponse in Surveys","author":"DB Rubin","year":"1987","unstructured":"Rubin DB. Multiple Imputation for Nonresponse in Surveys. Inc.: John Wiley & Sons; 1987."},{"key":"1639_CR26","doi-asserted-by":"publisher","DOI":"10.1201\/9780429492259","volume-title":"Flexible Imputation of Missing Data","author":"S van Buuren","year":"2018","unstructured":"van Buuren S. Flexible Imputation of Missing Data. 2nd ed. Boca Raton: CRC Press, Taylor & Francis Group; 2018.","edition":"2"},{"key":"1639_CR27","doi-asserted-by":"publisher","first-page":"576","DOI":"10.1093\/aje\/kwx349","volume":"187","author":"O Harel","year":"2018","unstructured":"Harel O, Mitchell EM, Perkins NJ, Cole SR, Tchetgen EJT, Sun BL, et al. Multiple Imputation for Incomplete Data in Epidemiologic Studies. Am J Epidemiol. 2018;187:576\u201384.","journal-title":"Am J Epidemiol"},{"key":"1639_CR28","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1002\/sim.4067","volume":"30","author":"IR White","year":"2011","unstructured":"White IR, Royston P, Wood AM. Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. 2011;30:377\u201399.","journal-title":"Stat Med"},{"key":"1639_CR29","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1093\/aje\/kwx348","volume":"187","author":"NJ Perkins","year":"2018","unstructured":"Perkins NJ, Cole SR, Harel O, Tchetgen EJT, Sun BL, Mitchell EM, et al. Principled Approaches to Missing Data in Epidemiologic Studies. Am J Epidemiol. 2018;187:568\u201375.","journal-title":"Am J Epidemiol"},{"issue":"4","key":"1639_CR30","first-page":"304","volume":"185","author":"FP Leacy","year":"2017","unstructured":"Leacy FP, Floyd S, Yates TA, White IR. Analyses of Sensitivity to the Missing-at-Random Assumption Using Multiple Imputation With Delta Adjustment: Application to a Tuberculosis\/HIV Prevalence Survey With Incomplete HIV-Status Data. Am J Epidemiol. 2017;185(4):304\u201315.","journal-title":"Am J Epidemiol"},{"issue":"1","key":"1639_CR31","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1177\/0962280211403597","volume":"22","author":"L Li","year":"2013","unstructured":"Li L, Shen C, Li X, Robins JM. On weighting approaches for missing data. Stat Methods Med Res. 2013;22(1):14\u201330.","journal-title":"Stat Methods Med Res"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-022-01639-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-022-01639-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-022-01639-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,28]],"date-time":"2022-05-28T12:03:33Z","timestamp":1653739413000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-022-01639-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,28]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1639"],"URL":"https:\/\/doi.org\/10.1186\/s12874-022-01639-0","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,28]]},"assertion":[{"value":"23 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 May 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 May 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The ARCTIC trial was approved by an independent ethics committee (the Regional Committee for Medical and Health Research Ethics South-East; reference number 2010\/744). Patients gave written informed consent prior to inclusion in the study. The NOR-VEAC study was approved by an independent ethics committee (the Regional Committee for Medical and Health Research Ethics South-East; reference number 2010\/719). Patients gave written informed consent prior to inclusion in the study. Both studies were conducted in accordance with the guidelines and regulations applicable in Norway.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"E. A. Haavardsholm has received research grants to the ARCTIC trial from AbbVie, MSD, Pfizer, Roche and UCB; all other authors declare no conflict of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"152"}}