{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T12:13:17Z","timestamp":1790856797107,"version":"4.1.0"},"reference-count":39,"publisher":"Becaris Publishing Limited","issue":"9","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Comp. Eff. Res."],"published-print":{"date-parts":[[2024,9]]},"abstract":"<jats:p>\n            <jats:bold>Aim:<\/jats:bold>\n            Regulatory and health technology assessment (HTA) agencies have increasingly published frameworks,\u00a0guidelines, and recommendations for the use of real-world evidence (RWE) in healthcare decision-making. Variations in the scope and content of these documents, with updates running in parallel, may create challenges for their implementation especially during the market authorization and reimbursement\u00a0phases of a medicine's\u00a0life\u00a0cycle. This environmental scan aimed to comprehensively identify and\u00a0summarize the guidance\u00a0documents\u00a0for RWE\u00a0developed by most well-established\u00a0regulatory and reimbursement agencies, as well as\u00a0other organizations focused on healthcare decision-making, and present their similarities and differences.\u00a0\n            <jats:bold>Methods:<\/jats:bold>\n            RWE guidance documents, including white papers from regulatory and HTA agencies, were\u00a0reviewed in March 2024. Data on scope and recommendations from each body were extracted by two reviewers and similarities and differences were summarized across four topics: study planning, choosing fit-for-purpose data, study conduct, and reporting. Post-authorization or non-pharmacological guidance was excluded.\n            <jats:bold>Results:<\/jats:bold>\n            Forty-six documents were identified across multiple agencies; US FDA produced the most RWE-related guidance. All agencies addressed specific and\u00a0often similar methodological issues related to study design, data fitness-for-purpose,\u00a0reliability, and reproducibility,\u00a0although inconsistency in terminologies on these topics was noted. Two HTA bodies (National Institute for Health and Care Excellence [NICE] and Canada's Drug Agency) each centralized all related RWE guidance under a unified framework. RWE quality tools and checklists were not consistently named and some differences in preferences were noted. European Medicines Agency, NICE, Haute Autorit\u00e9 de Sant\u00e9, and the Institute for Quality and Efficiency in Health\u00a0Care included specific recommendations on the use of analytical approaches to address RWE complexities and increase trust in its findings.\n            <jats:bold>Conclusion:<\/jats:bold>\n            Similarities in agencies' expectations on RWE studies\u00a0design, quality elements, and reporting will facilitate evidence generation strategy and\u00a0activities\u00a0for manufacturers facing multiple, including\u00a0global,\u00a0regulatory and reimbursement\u00a0submissions and re-submissions. A\u00a0strong preference by decision-making bodies\u00a0for local real-world data\u00a0generation may hinder opportunities for data sharing and outputs from international federated data networks. Closer collaboration between decision-making\u00a0agencies towards a harmonized RWE roadmap, which can be centrally preserved in a living mode,\u00a0will provide manufacturers and researchers\u00a0clarity on minimum acceptance requirements and expectations, especially as novel methodologies for RWE generation\u00a0are rapidly emerging.\n          <\/jats:p>","DOI":"10.57264\/cer-2024-0061","type":"journal-article","created":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T10:43:43Z","timestamp":1723459423000},"source":"Crossref","is-referenced-by-count":19,"title":["The maze of real-world evidence frameworks: from a desert to a jungle! An environmental scan and comparison across regulatory and health technology assessment agencies"],"prefix":"10.57264","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5536-8038","authenticated-orcid":false,"given":"Grammati","family":"Sarri","sequence":"first","affiliation":[{"name":"Cytel, Inc., London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9532-546X","authenticated-orcid":false,"given":"Luis G","family":"Hernandez","sequence":"additional","affiliation":[{"name":"Global Pricing, Value &amp; Access; Global Health Economics &amp; US HEOR \u2013 Oncology, Takeda Pharmaceuticals America, Inc., Lexington, MA 02421, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"36897","reference":[{"key":"e_1_3_8_3_2","unstructured":"US Food & Drug Administration. Real-World Evidence. https:\/\/www.fda.gov\/science-research\/science-and-research-special-topics\/real-world-evidence"},{"issue":"1","key":"e_1_3_8_4_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1002\/cpt.2410","article-title":"Evolving acceptance and use of RWE for regulatory decision making on the benefit\/risk assessment of a drug in Japan","volume":"111","author":"Nishioka K","year":"2022","unstructured":"Nishioka K, Makimura T, Ishiguro A Evolving acceptance and use of RWE for regulatory decision making on the benefit\/risk assessment of a drug in Japan. Clin. Pharmacol. Ther. 111(1), 35\u201343 (2022).","journal-title":"Clin. Pharmacol. Ther."},{"key":"e_1_3_8_5_2","unstructured":"Canadian Agency for Drugs and Technologies in Health. Guidance for Reporting Real-World Evidence 2023. https:\/\/www.cadth.ca\/sites\/default\/files\/RWE\/MG0020\/MG0020-RWE-Guidance-Report-Secured.pdf"},{"key":"e_1_3_8_6_2","unstructured":"National Institute for Health and Care Excellence. NICE real-world evidence framework 2022. https:\/\/www.nice.org.uk\/corporate\/ecd9\/resources\/nice-realworld-evidence-framework-pdf-1124020816837#:~:text=The%20framework%20aims%20to%20improve the%20section%20on%20NICE%20guidance"},{"key":"e_1_3_8_7_2","unstructured":"International Coalition of Medicines Regulatory Authorities. ICMRA statement on international collaboration to enable real-world evidence (RWE) for regulatory decision-making 2022. https:\/\/www.icmra.info\/drupal\/sites\/default\/files\/2022-07\/icmra_statement_on_rwe.pdf"},{"key":"e_1_3_8_8_2","unstructured":"Duke-Margolis Institute for Health Policy. Real-World Evidence Collaborative. https:\/\/healthpolicy.duke.edu\/projects\/real-world-evidence-collaborative"},{"key":"e_1_3_8_9_2","unstructured":"Real-world Evidence Alliance. https:\/\/rwealliance.org\/"},{"key":"e_1_3_8_10_2","unstructured":"US Food & Drug Administration. Guidance document. Use of Real-World Evidence to Support Regulatory Decision-Making for Medical Devices. Guidance for Industry and Food and Drug Administration Staff 2017. https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/use-real-world-evidence-support-regulatory-decision-making-medical-devices"},{"key":"e_1_3_8_11_2","unstructured":"Faria R Hernandez Alava M Manca A NICE DSU Technical Support Document 17: the use of observational data to inform estimates of treatment effectiveness in technology appraisal: Methods for comparative individual patient data 2015. http:\/\/www.nicedsu.org.uk"},{"key":"e_1_3_8_12_2","unstructured":"European Medicines Agency. European medicines agencies network strategy to 2025. https:\/\/www.ema.europa.eu\/en\/documents\/report\/european-union-medicines-agencies-network-strategy-2025-protecting-public-health-time-rapid-change_en.pdf"},{"key":"e_1_3_8_13_2","unstructured":"European Medicines Agency. Guideline on registry-based studies 2021. https:\/\/www.ema.europa.eu\/en\/documents\/scientific-guideline\/guideline-registry-based-studies_en.pdf-0"},{"key":"e_1_3_8_14_2","unstructured":"European Commission. European Health Data Space. https:\/\/health.ec.europa.eu\/ehealth-digital-health-and-care\/european-health-data-space_en"},{"key":"e_1_3_8_15_2","unstructured":"European Medicines Agency. Technical workshop on real-world metadata for regulatory purposes. https:\/\/www.ema.europa.eu\/en\/events\/technical-workshop-real-world-metadata-regulatory-purposes"},{"key":"e_1_3_8_16_2","unstructured":"European Medicines Agency. Data Analysis and Real World Interrogation Network (DARWIN EU). https:\/\/www.ema.europa.eu\/en\/about-us\/how-we-work\/big-data\/data-analysis-real-world-interrogation-network-darwin-eu"},{"key":"e_1_3_8_17_2","unstructured":"European Medicines Agency. Learnings initiative webinar for optimal use of big data for regulatory purpose. https:\/\/www.ema.europa.eu\/en\/events\/learnings-initiative-webinar-optimal-use-big-data-regulatory-purpose"},{"key":"e_1_3_8_18_2","unstructured":"European Commission. Horizon Europe Work Programme 2021-2022 2022. https:\/\/ec.europa.eu\/info\/funding-tenders\/opportunities\/docs\/2021-2027\/horizon\/wp-call\/2021-2022\/wp-4-health_horizon-2021-2022_en.pdf"},{"key":"e_1_3_8_19_2","unstructured":"US Food & Drug Administration. Real-World Data: Assessing Electronic Health Records and Medical Claims Data To Support Regulatory Decision-Making for Drug and Biological Products. Draft Guidance for Industry 2021. https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/real-world-data-assessing-electronic-health-records-and-medical-claims-data-support-regulatory"},{"key":"e_1_3_8_20_2","unstructured":"US Food & Drug Administration. Considerations for the Design and Conduct of Externally Controlled Trials for Drug and Biological Products. Guidance document 2023. https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/considerations-design-and-conduct-externally-controlled-trials-drug-and-biological-products"},{"key":"e_1_3_8_21_2","unstructured":"Medicines & Healthcare Products Regulatory Agency. MHRA guidance on the use of real-world data in clinical studies to support regulatory decisions 2021. https:\/\/www.gov.uk\/government\/publications\/mhra-guidance-on-the-use-of-real-world-data-in-clinical-studies-to-support-regulatory-decisions\/mhra-guidance-on-the-use-of-real-world-data-in-clinical-studies-to-support-regulatory-decisions"},{"key":"e_1_3_8_22_2","unstructured":"Medicines & Healthcare Products Regulatory Agency. Guidance on randomised controlled trials using real-world data to support regulatory decisions (2021). https:\/\/www.gov.uk\/government\/publications\/mhra-guidance-on-the-use-of-real-world-data-in-clinical-studies-to-support-regulatory-decisions\/mhra-guideline-on-randomised-controlled-trials-using-real-world-data-to-support-regulatory-decisions#:~:text=This%20guideline%20is%20aimed%20at RWD%20for%20supporting%20regulatory%20decisions"},{"key":"e_1_3_8_23_2","unstructured":"Haute Autorit\u00e9 de Sant\u00e9. Real-world studies for the assessment of medicinal products and medical devices (2021). https:\/\/www.has-sante.fr\/jcms\/p_3284524\/en\/real-world-studies-for-the-assessment-of-medicinal-products-and-medical-devices"},{"key":"e_1_3_8_24_2","unstructured":"Institut f\u00fcr Qualit\u00e4t und Wirtschaftlichkeit im Gesundheitswesen (IQWiG). Concepts for the generation of routine practice data and their analysis for the benefit assessment of drugs according to \u00a735a Social Code Book V (SGB V) 2020. https:\/\/www.iqwig.de\/download\/a19-43_routine-practice-data-for-the-benefit-assessment-of-drugs_extract-of-rapid-report_v1-0.pdf"},{"key":"e_1_3_8_25_2","unstructured":"European Network for Health Technology Assessment (EUnetHTA). Individual Practical Guideline Document: D4.3.1: Direct and Indirect Comparisons 2022. https:\/\/www.eunethta.eu\/wp-content\/uploads\/2022\/12\/EUnetHTA-21-D4.3.1-Direct-and-indirect-comparisons-v1.0.pdf"},{"key":"e_1_3_8_26_2","unstructured":"HTA CG. Methodological Guideline for Quantitative Evidence Synthesis: Direct and Indirect Comparisons 2024. https:\/\/health.ec.europa.eu\/document\/download\/4ec8288e-6d15-49c5-a490-d8ad7748578f_en?filename=hta_methodological-guideline_direct-indirect-comparisons_en.pdf"},{"issue":"1","key":"e_1_3_8_27_2","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1002\/pds.5507","article-title":"HARmonized Protocol Template to Enhance Reproducibility of hypothesis evaluating real-world evidence studies on treatment effects: a good practices report of a joint ISPE\/ISPOR task force","volume":"32","author":"Wang SV","year":"2023","unstructured":"Wang SV, Potteg\u00e5rd A, Crown W HARmonized Protocol Template to Enhance Reproducibility of hypothesis evaluating real-world evidence studies on treatment effects: a good practices report of a joint ISPE\/ISPOR task force. Pharmacoepidemiol. Drug Saf. 32(1), 44\u201355 (2023).","journal-title":"Pharmacoepidemiol. Drug Saf."},{"issue":"9","key":"e_1_3_8_28_2","doi-asserted-by":"crossref","first-page":"1128","DOI":"10.1016\/j.jval.2020.04.002","article-title":"Improving transparency to build trust in real-world secondary data studies for hypothesis testing-why, what, and how: recommendations and a road map from the Real-World Evidence Transparency Initiative","volume":"23","author":"Orsini LS","year":"2020","unstructured":"Orsini LS, Berger M, Crown W Improving transparency to build trust in real-world secondary data studies for hypothesis testing-why, what, and how: recommendations and a road map from the Real-World Evidence Transparency Initiative. Value Health 23(9), 1128\u20131136 (2020).","journal-title":"Value Health"},{"issue":"8","key":"e_1_3_8_29_2","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1093\/aje\/kwv254","article-title":"Using big data to emulate a target trial when a randomized trial is not available","volume":"183","author":"Hern\u00e1n MA","year":"2016","unstructured":"Hern\u00e1n MA, Robins JM. Using big data to emulate a target trial when a randomized trial is not available. Am. J. Epidemiol. 183(8), 758\u2013764 (2016).","journal-title":"Am. J. Epidemiol."},{"key":"e_1_3_8_30_2","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1186\/1471-2288-8-70","article-title":"Reducing bias through directed acyclic graphs","volume":"8","author":"Shrier I","year":"2008","unstructured":"Shrier I, Platt RW. Reducing bias through directed acyclic graphs. BMC Med. Res. Methodol. 8, 70 (2008).","journal-title":"BMC Med. Res. Methodol."},{"issue":"6","key":"e_1_3_8_31_2","doi-asserted-by":"crossref","first-page":"1969","DOI":"10.1093\/ije\/dyu149","article-title":"Good practices for quantitative bias analysis","volume":"43","author":"Lash TL","year":"2014","unstructured":"Lash TL, Fox MP, MacLehose RF Good practices for quantitative bias analysis. Int. J. Epidemiol. 43(6), 1969\u20131985 (2014).","journal-title":"Int. J. Epidemiol."},{"issue":"2","key":"e_1_3_8_32_2","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1136\/bmjebm-2020-111493","article-title":"Framework for the synthesis of non-randomised studies and randomised controlled trials: a guidance on conducting a systematic review and meta-analysis for healthcare decision making","volume":"27","author":"Sarri G","year":"2022","unstructured":"Sarri G, Patorno E, Yuan H Framework for the synthesis of non-randomised studies and randomised controlled trials: a guidance on conducting a systematic review and meta-analysis for healthcare decision making. BMJ Evid. Based Med. 27(2), 109\u2013119 (2022).","journal-title":"BMJ Evid. Based Med."},{"key":"e_1_3_8_33_2","doi-asserted-by":"crossref","first-page":"m4856","DOI":"10.1136\/bmj.m4856","article-title":"STaRT-RWE: structured template for planning and reporting on the implementation of real world evidence studies","volume":"372","author":"Wang SV","year":"2021","unstructured":"Wang SV, Pinheiro S, Hua W STaRT-RWE: structured template for planning and reporting on the implementation of real world evidence studies. BMJ 372, m4856 (2021).","journal-title":"BMJ"},{"key":"e_1_3_8_34_2","unstructured":"European Network for Health Technology Assessment (EUnetHTA). Vision paper on the sustainable availability of the proposed Registry Evaluation and Quality Standards Tool (REQueST). https:\/\/www.eunethta.eu\/wp-content\/uploads\/2019\/10\/EUnetHTAJA3_Vision_paper-on-REQueST-tool.pdf"},{"issue":"10","key":"e_1_3_8_35_2","doi-asserted-by":"crossref","first-page":"1002","DOI":"10.1161\/CIRCULATIONAHA.120.051718","article-title":"Emulating randomized clinical trials with nonrandomized real-world evidence studies: first results from the RCT DUPLICATE Initiative","volume":"143","author":"Franklin JM","year":"2021","unstructured":"Franklin JM, Patorno E, Desai RJ Emulating randomized clinical trials with nonrandomized real-world evidence studies: first results from the RCT DUPLICATE Initiative. Circulation 143(10), 1002\u20131013 (2021).","journal-title":"Circulation"},{"issue":"3","key":"e_1_3_8_36_2","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1016\/j.clinthera.2022.01.012","article-title":"Real-world evidence for regulatory decision-making: guidance from around the world","volume":"44","author":"Burns L","year":"2022","unstructured":"Burns L, Roux NL, Kalesnik-Orszulak R Real-world evidence for regulatory decision-making: guidance from around the world. Clin. Ther. 44(3), 420\u2013437 (2022).","journal-title":"Clin. Ther."},{"key":"e_1_3_8_37_2","doi-asserted-by":"publisher","DOI":"10.2217\/cer-2020-0228"},{"key":"e_1_3_8_38_2","doi-asserted-by":"publisher","DOI":"10.2217\/cer-2022-0006"},{"key":"e_1_3_8_39_2","unstructured":"IDERHA. Public Consultation. https:\/\/www.iderha.org\/outreach\/public-consultation"},{"key":"e_1_3_8_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40273-020-00981-9"},{"key":"e_1_3_8_41_2","doi-asserted-by":"crossref","first-page":"1289365","DOI":"10.3389\/fphar.2023.1289365","article-title":"Advancing the use of real world evidence in health technology assessment: insights from a multi-stakeholder workshop","volume":"14","author":"Claire R","year":"2023","unstructured":"Claire R, Elvidge J, Hanif S Advancing the use of real world evidence in health technology assessment: insights from a multi-stakeholder workshop. Front. Pharmacol. 14, 1289365 (2023).","journal-title":"Front. Pharmacol."}],"container-title":["Journal of Comparative Effectiveness Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/becarispublishing.com\/doi\/pdf\/10.57264\/cer-2024-0061","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T11:26:14Z","timestamp":1724671574000},"score":1,"resource":{"primary":{"URL":"https:\/\/becarispublishing.com\/doi\/10.57264\/cer-2024-0061"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9]]},"references-count":39,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2024,9]]}},"alternative-id":["10.57264\/cer-2024-0061"],"URL":"https:\/\/doi.org\/10.57264\/cer-2024-0061","relation":{},"ISSN":["2042-6305","2042-6313"],"issn-type":[{"value":"2042-6305","type":"print"},{"value":"2042-6313","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9]]},"article-number":"e240061"}}