{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T03:13:29Z","timestamp":1790738009005,"version":"4.1.0"},"reference-count":78,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,5,10]],"date-time":"2021-05-10T00:00:00Z","timestamp":1620604800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,10]],"date-time":"2021-05-10T00:00:00Z","timestamp":1620604800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Innovative Medicines Initiative 2 Joint Undertaking","award":["Grant Agreement 777450"],"award-info":[{"award-number":["Grant Agreement 777450"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ther Innov Regul Sci"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>There is increased recognition that incorporating patients\u2019 perspectives and insights into the medicines development process results in better health outcomes and benefits for all involved stakeholders. Despite the increased interest and the existence of frameworks and practical recommendations, patient engagement (PE) is not yet considered standard practice. The objective of this work was to provide a roadmap to support systematic change in all stakeholder organisations involved in medicines development across Europe, patients and patient organisations, medicines developers, academia, regulatory authorities, Health Technology Assessment bodies, payers, policy-makers and public research funders, to sustain PE practices.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A mixed-methods approach was used by the EU-funded Innovative Medicines Initiative PARADIGM Consortium to co-develop the sustainability roadmap including background work to identify success factors and scenarios for sustainable PE. The roadmap development was based on the Theory of Change concept and populated with findings from (1) interviews with national\/ and international institutions with the potential to increase PE uptake by other stakeholders; (2) multi-stakeholder workshops and webinars; and (3) consultations with specific stakeholder groups, Consortium members and a consultative body formed by international PE initiatives.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>This roadmap sets strategic goals for the PE community to achieve meaningful and systematic PE through changes in the culture, processes and resources of stakeholder organisations. It brings in key PARADIGM outputs to work in a coordinated fashion with existing frameworks and mechanisms to achieve system-wide sustained PE.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The roadmap provides a framework for all stakeholders to take collective action within their organisations and across Europe to implement PE in a sustainable manner.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s43441-021-00282-z","type":"journal-article","created":{"date-parts":[[2021,5,10]],"date-time":"2021-05-10T10:02:30Z","timestamp":1620640950000},"page":"936-953","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":41,"title":["Sustaining Meaningful Patient Engagement Across the Lifecycle of Medicines: A Roadmap for Action"],"prefix":"10.1007","volume":"55","author":[{"given":"Maria","family":"Cavaller-Bellaubi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6345-5323","authenticated-orcid":false,"given":"Stuart D.","family":"Faulkner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bryan","family":"Teixeira","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mathieu","family":"Boudes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eva","family":"Molero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas","family":"Brooke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"McKeaveney","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeffrey","family":"Southerton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria Jos\u00e9","family":"Vicente","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil","family":"Bertelsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan","family":"Garc\u00eda-Burgos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vinciane","family":"Pirard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kirsty","family":"Reid","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9345-8659","authenticated-orcid":false,"given":"Elisa","family":"Ferrer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,5,10]]},"reference":[{"issue":"6","key":"282_CR1","doi-asserted-by":"publisher","first-page":"929","DOI":"10.1177\/2168479015580384","volume":"49","author":"A Hoos","year":"2015","unstructured":"Hoos A, Anderson J, Boutin M, et al. Partnering with patients in the development and lifecycle of medicines: a call for action. Ther Innov Regul Sci. 2015;49(6):929\u201339. https:\/\/doi.org\/10.1177\/2168479015580384.","journal-title":"Ther Innov Regul Sci"},{"issue":"3","key":"282_CR2","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1007\/s40290-019-00284-1","volume":"33","author":"K Getz","year":"2019","unstructured":"Getz K. Reflections on the evolution of patient engagement in drug development. Pharm Med. 2019;33(3):179\u201385. https:\/\/doi.org\/10.1007\/s40290-019-00284-1.","journal-title":"Pharm Med"},{"key":"282_CR3","doi-asserted-by":"publisher","DOI":"10.1038\/d41573-019-00164-y","author":"M Mavris","year":"2019","unstructured":"Mavris M, Helms AF, Bere N. Engaging patients in medicines regulation: a tale of two agencies. Nat Rev Drug Discov. 2019. https:\/\/doi.org\/10.1038\/d41573-019-00164-y.","journal-title":"Nat Rev Drug Discov"},{"issue":"1","key":"282_CR4","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1111\/hex.12951","volume":"23","author":"LE Vat","year":"2019","unstructured":"Vat LE, Finlay T, Jan Schuitmaker Warnaar T, et al. Evaluating the \u201creturn on patient engagement initiatives\u201d in medicines research and development: a literature review. Health Expect. 2019;23(1):5\u201318. https:\/\/doi.org\/10.1111\/hex.12951.","journal-title":"Health Expect"},{"key":"282_CR5","doi-asserted-by":"publisher","DOI":"10.1111\/hex.13191","author":"LE Vat","year":"2021","unstructured":"Vat LE, Finlay T, Robinson P, et al. Evaluation of patient engagement in medicines development: a multi-stakeholder framework with metrics. Health Expect. 2021. https:\/\/doi.org\/10.1111\/hex.13191.","journal-title":"Health Expect"},{"issue":"5","key":"282_CR6","doi-asserted-by":"publisher","first-page":"612","DOI":"10.1177\/2168479017706405","volume":"51","author":"J Geissler","year":"2017","unstructured":"Geissler J, Ryll B, di Priolo SL, Uhlenhopp M. Improving patient involvement in medicines research and development: a practical roadmap. Ther Innov Regul Sci. 2017;51(5):612\u20139. https:\/\/doi.org\/10.1177\/2168479017706405.","journal-title":"Ther Innov Regul Sci"},{"issue":"3","key":"282_CR7","doi-asserted-by":"publisher","first-page":"e0193579-18","DOI":"10.1371\/journal.pone.0193579","volume":"13","author":"E Manaf\u00f2","year":"2018","unstructured":"Manaf\u00f2 E, Petermann L, Vandall-Walker V, Mason-Lai P. Patient and public engagement in priority setting: a systematic rapid review of the literature. PLoS ONE. 2018;13(3):e0193579-18. https:\/\/doi.org\/10.1371\/journal.pone.0193579.","journal-title":"PLoS ONE"},{"issue":"2","key":"282_CR8","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1370\/afm.2042","volume":"15","author":"S Sheridan","year":"2017","unstructured":"Sheridan S, Schrandt S, Forsythe L, Hilliard TS, Paez KA. The PCORI engagement rubric: promising practices for partnering in research. Ann Fam Med. 2017;15(2):165\u201370. https:\/\/doi.org\/10.1370\/afm.2042.","journal-title":"Ann Fam Med"},{"issue":"2","key":"282_CR9","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1177\/2168479017720247","volume":"52","author":"D Bloom","year":"2018","unstructured":"Bloom D, Beetsch J, Harker M, et al. The rules of engagement: CTTI recommendations for successful collaborations between sponsors and patient groups around clinical trials. Ther Innov Regul Sci. 2018;52(2):206\u201313. https:\/\/doi.org\/10.1177\/2168479017720247.","journal-title":"Ther Innov Regul Sci"},{"key":"282_CR10","unstructured":"European AIDS Treatment Group (EATG). The European Community Advisory Board (ECAB). http:\/\/www.eatg.org\/ecab\/. Accessed 31 Jan 2021."},{"key":"282_CR11","unstructured":"EURORDIS-Rare Diseases Europe. Community Advisory Board Programme (EUROCAB). https:\/\/www.eurordis.org\/content\/eurordis-community-advisory-board-cab-programme. Accessed 31 Jan 2021."},{"key":"282_CR12","unstructured":"Revised framework for interaction between the European Medicines Agency and patients and consumers and their organisations. https:\/\/www.ema.europa.eu\/en\/documents\/other\/revised-framework-interaction-between-european-medicines-agency-healthcare-professionals-their_en.pdf. Published 16 December 2016. Accessed 31 Jan 2021."},{"key":"282_CR13","unstructured":"Parallel consultation with regulators and health technology assessment bodies. European Medicines Agency (EMA) and European Network for Health Technology Assessment (EUnetHTA). https:\/\/www.ema.europa.eu\/en\/human-regulatory\/research-development\/scientific-advice-protocol-assistance\/parallel-consultation-regulators-health-technology-assessment-bodies. Accessed 31 Jan 2021."},{"key":"282_CR14","unstructured":"Mechanisms of coordinated access to orphan medicinal products (MoCA). Revised terms of reference. https:\/\/www.eurordis.org\/content\/moca. Published 25 January 2016. Accessed 31 Jan 2021."},{"key":"282_CR15","unstructured":"Outcome report on pilot to involve patients in benefit\/risk discussions at CHMP meetings. https:\/\/www.ema.europa.eu\/en\/documents\/report\/outcome-report-pilot-involve-patients-benefit\/risk-discussions-chmp-meetings_en.pdf. Published 3 March 2017. Accessed 31 Jan 2021."},{"key":"282_CR16","unstructured":"UK Medicines and Healthcare Products Regulatory Agency (MHRA) guidance: opportunities for patients and the public to be involved in the work of the MHRA. https:\/\/www.gov.uk\/guidance\/opportunities-for-patients-and-the-public-to-be-involved-in-the-work-of-the-mhra. Accessed 31 Jan 2021."},{"key":"282_CR17","unstructured":"European Network for Health Technology Assessment (EUnetHTA). Patient input in Relative Effectiveness Assessments. https:\/\/eunethta.eu\/wp-content\/uploads\/2019\/06\/Final_290519_Patient-Input-in-REAs.pdf. Published May 29, 2019. Accessed 31 Jan 2021."},{"issue":"1","key":"282_CR18","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/s40900-016-0036-9","volume":"2","author":"S Berglas","year":"2016","unstructured":"Berglas S, Jutai L, MacKean G, Weeks L. Patients\u2019 perspectives can be integrated in health technology assessments: an exploratory analysis of CADTH Common Drug Review. Res Involv Engagem. 2016;2(1):21\u201313. https:\/\/doi.org\/10.1186\/s40900-016-0036-9.","journal-title":"Res Involv Engagem"},{"key":"282_CR19","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-020-05152-2","author":"C Leopold","year":"2020","unstructured":"Leopold C, Lu CY, Wagner AK. Integrating public preferences into national reimbursement decisions: a descriptive comparison of approaches in Belgium and New Zealand. BMC Health Serv Res. 2020. https:\/\/doi.org\/10.1186\/s12913-020-05152-2.","journal-title":"BMC Health Serv Res"},{"key":"282_CR20","unstructured":"FDA patient-focused drug development guidance series for enhancing the incorporation of the patient's voice in medical product development and regulatory decision making. https:\/\/www.fda.gov\/drugs\/development-approval-process-drugs\/fda-patient-focused-drug-development-guidance-series-enhancing-incorporation-patients-voice-medical. Accessed 31 Jan 2021."},{"key":"282_CR21","unstructured":"Rogers EM. Diffusion of innovations, 5th edn. https:\/\/books.google.es\/books?id=9U1K5LjUOwEC&printsec=frontcover&redir_esc=y#v=onepage&q&f=false."},{"key":"282_CR22","unstructured":"Scroggs L. The Eisenhower matrix. https:\/\/todoist.com\/es\/productivity-methods\/eisenhower-matrix. Accessed 31 Jan 2021."},{"issue":"1","key":"282_CR23","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1097\/MLR.0000000000000273","volume":"53","author":"EM Perfetto","year":"2015","unstructured":"Perfetto EM, Burke L, Oehrlein EM, Epstein RS. Patient-focused drug development: a new direction for collaboration. Med Care. 2015;53(1):9\u201317. https:\/\/doi.org\/10.1097\/MLR.0000000000000273.","journal-title":"Med Care"},{"key":"282_CR24","doi-asserted-by":"publisher","first-page":"334","DOI":"10.3389\/fmed.2018.00231","volume":"5","author":"A Hunter","year":"2018","unstructured":"Hunter A, Facey K, Thomas V, et al. EUPATI guidance for patient involvement in medicines research and development: health technology assessment. Front Med. 2018;5:334\u2013410. https:\/\/doi.org\/10.3389\/fmed.2018.00231.","journal-title":"Front Med"},{"key":"282_CR25","doi-asserted-by":"publisher","first-page":"230","DOI":"10.3389\/fmed.2018.00251","volume":"5","author":"I Klingmann","year":"2018","unstructured":"Klingmann I, Heckenberg A, Warner K, et al. EUPATI and patients in medicines research and development: guidance for patient involvement in ethical review of clinical trials. Front Med. 2018;5:230\u2013311. https:\/\/doi.org\/10.3389\/fmed.2018.00251.","journal-title":"Front Med"},{"key":"282_CR26","doi-asserted-by":"publisher","first-page":"74","DOI":"10.3389\/fmed.2018.00230","volume":"5","author":"D Haerry","year":"2018","unstructured":"Haerry D, Landgraf C, Warner K, et al. EUPATI and patients in medicines research and development: guidance for patient involvement in regulatory processes. Front Med. 2018;5:74\u201311. https:\/\/doi.org\/10.3389\/fmed.2018.00230.","journal-title":"Front Med"},{"key":"282_CR27","doi-asserted-by":"publisher","first-page":"929","DOI":"10.3389\/fmed.2018.00270","volume":"5","author":"K Warner","year":"2018","unstructured":"Warner K, See W, Haerry D, Klingmann I, Hunter A, May M. EUPATI guidance for patient involvement in medicines research and development (R&D); guidance for pharmaceutical industry-led medicines R&D. Front Med. 2018;5:929\u201338. https:\/\/doi.org\/10.3389\/fmed.2018.00270.","journal-title":"Front Med"},{"key":"282_CR28","doi-asserted-by":"publisher","DOI":"10.1007\/s43441-020-00176-6","author":"M Elmer","year":"2020","unstructured":"Elmer M, Florek C, Gabryelski L, et al. Amplifying the voice of the patient in clinical research: development of toolkits for use in designing and conducting patient-centered clinical studies. Ther Innov Regul Sci. 2020. https:\/\/doi.org\/10.1007\/s43441-020-00176-6.","journal-title":"Ther Innov Regul Sci"},{"issue":"1","key":"282_CR29","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1136\/bmjinnov-2018-000317","volume":"5","author":"K Deane","year":"2019","unstructured":"Deane K, Delbecque L, Gorbenko O, et al. Co-creation of patient engagement quality guidance for medicines development: an international multistakeholder initiative. BMJ Innov. 2019;5(1):43\u201355. https:\/\/doi.org\/10.1136\/bmjinnov-2018-000317.","journal-title":"BMJ Innov"},{"key":"282_CR30","unstructured":"Hickey G, Brearley S, Coldham T, et al. NIHR Guidance on co-producing a research project. In: INVOLVE. 2018, Southampton. https:\/\/www.invo.org.uk\/wp-content\/uploads\/2019\/04\/Copro_Guidance_Feb19.pdf. Accessed 31 Jan 2021."},{"issue":"6","key":"282_CR31","doi-asserted-by":"publisher","first-page":"2449","DOI":"10.1111\/hex.12213","volume":"18","author":"TA Abma","year":"2015","unstructured":"Abma TA, Pittens CACM, Visse M, Elberse JE, Broerse JEW. Patient involvement in research programming and implementation: a responsive evaluation of the Dialogue Model for research agenda setting. Health Expect. 2015;18(6):2449\u201364. https:\/\/doi.org\/10.1111\/hex.12213.","journal-title":"Health Expect"},{"key":"282_CR32","doi-asserted-by":"publisher","DOI":"10.1186\/s40900-015-0004-9","author":"D Supple","year":"2015","unstructured":"Supple D, et al. From tokenism to meaningful engagement: best practices in patient involvement in an EU project. Res Involv Engagem. 2015. https:\/\/doi.org\/10.1186\/s40900-015-0004-9.","journal-title":"Res Involv Engagem"},{"issue":"1","key":"282_CR33","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1111\/jep.12805","volume":"24","author":"A Price","year":"2017","unstructured":"Price A, Albarqouni L, Kirkpatrick J, et al. Patient and public involvement in the design of clinical trials: an overview of systematic reviews. J Eval Clin Pract. 2017;24(1):240\u201353. https:\/\/doi.org\/10.1111\/jep.12805.","journal-title":"J Eval Clin Pract"},{"key":"282_CR34","unstructured":"Innovative Medicines Initiative (IMI) PARADIGM (Patients Active in Research And Dialogues for an Improved Generation of Medicines). https:\/\/imi-paradigm.eu. Accessed 31 Jan 2021."},{"key":"282_CR35","unstructured":"Deliverable D6.5. Patient Engagement Sustainability Roadmap. PARADIGM WP6 Sustainability Strategy. https:\/\/imi-paradigm.eu\/wp-content\/uploads\/2020\/09\/PARADIGM-D6.5_PE-Sustainability-roadmap_FINAL.pdf. Accessed 1 Feb 2021."},{"issue":"1","key":"282_CR36","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1177\/2168479016659104","volume":"51","author":"M Boutin","year":"2017","unstructured":"Boutin M, Dewulf L, Hoos A, et al. Culture and process change as a priority for patient engagement in medicines development. Ther Innov Regul Sci. 2017;51(1):29\u201338. https:\/\/doi.org\/10.1177\/2168479016659104.","journal-title":"Ther Innov Regul Sci"},{"key":"282_CR37","unstructured":"Deliverable D6.1 Assessment review of existing sustainability models. PARADIGM WP6 Sustainability Strategy. https:\/\/imi-paradigm.eu\/wp-content\/uploads\/2019\/11\/M09_D-6.1-Assessment-review-of-the-existing-sustainability-models-1.pdf. Published November 2018. Accessed 1 Feb 2021."},{"key":"282_CR38","doi-asserted-by":"publisher","DOI":"10.1111\/hex.13207","author":"SD Faulkner","year":"2021","unstructured":"Faulkner SD, Li SS, Pakarinen C, et al. Understanding multi-stakeholder needs, preferences and expectations to define effective practices and processes of patient engagement in medicine development: a mixed-methods study. Health Expect. 2021. https:\/\/doi.org\/10.1111\/hex.13207.","journal-title":"Health Expect"},{"key":"282_CR39","unstructured":"Deliverable D6.2. List of the relevant models addressing sustainability for all stakeholders. PARADIGM WP6 Sustainability Strategy. https:\/\/imi-paradigm.eu\/wp-content\/uploads\/2019\/11\/M16_D-6.2-Shortlist-of-sustainability-scenarios-V1.3_FINAL_Submission_IMI-1.pdf. Published May 7, 2018. Accessed 1 Feb 2021."},{"key":"282_CR40","unstructured":"Deliverable D6.3. Refined list of the relevant models addressing sustainability for all stakeholders. PARADIGM WP6 Sustainability Strategy. https:\/\/imi-paradigm.eu\/wp-content\/uploads\/2020\/09\/M22_D6.3-Refined-list-of-the-relevant-models-addressing-sustainability-for-all-stakeholders.pdf. Accessed 1 Feb 2021."},{"key":"282_CR41","unstructured":"The Association of the British Pharmaceutical Industry (ABPI) medicines optimisation 2016\u20132020. https:\/\/abpi.org.uk\/media\/1668\/abpi_slideck_chapter5.pdf. Accessed 31 Jan 2021."},{"key":"282_CR42","unstructured":"Government of Canada SME suitability roadmap 2012. https:\/\/www.ic.gc.ca\/eic\/site\/csr-rse.nsf\/eng\/h_rs00174.html#roadmap. Accessed 31 Jan 2021."},{"key":"282_CR43","unstructured":"Cundall Sustainability Roadmap. https:\/\/cundall.com\/Knowledgehub\/Sustainability-Roadmap.aspx. Accessed 31 Jan 2021."},{"key":"282_CR44","unstructured":"European Medicines Agency (EMA) Heads of Medicines Agencies (HMA)-EMA Joint Big Data Taskforce\u2014summary report 2019. https:\/\/www.ema.europa.eu\/en\/documents\/minutes\/hma\/ema-joint-task-force-big-data-summary-report_en.pdf. Accessed 31 Jan 2021."},{"key":"282_CR45","unstructured":"The Economist. Scenario planning. https:\/\/www.economist.com\/news\/2008\/09\/01\/scenario-planning. Published 1 September 2008. Accessed 31 Jan 2021."},{"issue":"2","key":"282_CR46","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1080\/08956308.2004.11671620","volume":"47","author":"JD Strauss","year":"2016","unstructured":"Strauss JD, Radnor M. Roadmapping for dynamic and uncertain environments. Res Technol Manag. 2016;47(2):51\u20138. https:\/\/doi.org\/10.1080\/08956308.2004.11671620.","journal-title":"Res Technol Manag"},{"issue":"9","key":"282_CR47","doi-asserted-by":"publisher","first-page":"2251","DOI":"10.2166\/wst.2016.065","volume":"73","author":"JU Hasse","year":"2016","unstructured":"Hasse JU, Weingaertner DE. From vision to action: roadmapping as a strategic method and tool to implement climate change adaptation\u2014the example of the roadmap \u201cwater sensitive urban design 2020.\u201d Water Sci Technol. 2016;73(9):2251\u20139. https:\/\/doi.org\/10.2166\/wst.2016.065.","journal-title":"Water Sci Technol"},{"key":"282_CR48","unstructured":"Webb A. How to do strategic planning like a futurist. July 2019:1\u20138. https:\/\/hbr.org\/2019\/07\/how-to-do-strategic-planning-like-a-futurist. Accessed 31 Jan 2021."},{"key":"282_CR49","unstructured":"Phaal R. Roadmapping. Cambridge roadmapping. https:\/\/www.cambridgeroadmapping.net\/roadmapping. Accessed 31 Jan 2021."},{"issue":"1\u20132","key":"282_CR50","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/S0040-1625(03)00072-6","volume":"71","author":"R Phaal","year":"2004","unstructured":"Phaal R, Farrukh CJP, Probert DR. Technology roadmapping\u2014a planning framework for evolution and revolution. Technol Forecast Soc Change. 2004;71(1\u20132):5\u201326. https:\/\/doi.org\/10.1016\/S0040-1625(03)00072-6.","journal-title":"Technol Forecast Soc Change"},{"issue":"3","key":"282_CR51","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1016\/j.dss.2012.02.004","volume":"53","author":"MD Ahmed","year":"2012","unstructured":"Ahmed MD, Sundaram D. Sustainability modelling and reporting: from roadmap to implementation. Decis Support Syst. 2012;53(3):611\u201324. https:\/\/doi.org\/10.1016\/j.dss.2012.02.004.","journal-title":"Decis Support Syst"},{"key":"282_CR52","doi-asserted-by":"publisher","DOI":"10.1016\/j.scs.2017.10.008","author":"M Ibrahim","year":"2017","unstructured":"Ibrahim M, El-Zaart A, Adams C. Smart sustainable cities roadmap: readiness for transformation towards urban sustainability. Sustain Cities Soc. 2017. https:\/\/doi.org\/10.1016\/j.scs.2017.10.008.","journal-title":"Sustain Cities Soc"},{"issue":"2","key":"282_CR53","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1080\/08956308.2003.11671553","volume":"46","author":"A McMillan","year":"2016","unstructured":"McMillan A. Roadmapping\u2014agent of change. Res Technol Manag. 2016;46(2):40\u20137. https:\/\/doi.org\/10.1080\/08956308.2003.11671553.","journal-title":"Res Technol Manag"},{"issue":"3","key":"282_CR54","first-page":"163","volume":"1","author":"V Kamtsiou","year":"2006","unstructured":"Kamtsiou V, Naeve A, Stergioulas LK, Koskinen T. Roadmapping as a knowledge creation process: the PROLEARN roadmap. J Univers Knowl Manag. 2006;1(3):163\u201373.","journal-title":"J Univers Knowl Manag"},{"issue":"2","key":"282_CR55","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1177\/1473095213519356","volume":"14","author":"JE Innes","year":"2013","unstructured":"Innes JE, Booher DE. A turning point for planning theory? Overcoming dividing discourses. Plan Theory. 2013;14(2):195\u2013213. https:\/\/doi.org\/10.1177\/1473095213519356.","journal-title":"Plan Theory"},{"key":"282_CR56","unstructured":"Vogel I. ESPA guide to working with Theory of Change for research projects. https:\/\/www.imainternational.com\/images\/listing_doc\/ESPA-Theory-of-Change-Manual-FINAL.pdf. Accessed 31 Jan 2021."},{"key":"282_CR57","unstructured":"Anderson AA. Theory of change tool for strategic planning. The Aspen Institute Roundtable on Community Change. https:\/\/www.theoryofchange.org\/pdf\/tocII_final4.pdf. Published October 2004. Accessed 31 Jan 2021."},{"key":"282_CR58","unstructured":"Allen W. Diagramming a theory of change\u2014Learning for Sustainability. July 2016. https:\/\/learningforsustainability.net\/post\/diagramming-theory-change\/. Accessed 31 Jan 2021."},{"issue":"5","key":"282_CR59","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1177\/2168479016662902","volume":"50","author":"MY Smith","year":"2016","unstructured":"Smith MY, Hammad TA, Metcalf M, et al. Patient engagement at a tipping point\u2014the need for cultural change across patient, sponsor, and regulator stakeholders: insights from the DIA Conference, \u201cPatient Engagement in Benefit Risk Assessment Throughout the Life Cycle of Medical Products.\u201d Ther Innov Regul Sci. 2016;50(5):546\u201353. https:\/\/doi.org\/10.1177\/2168479016662902.","journal-title":"Ther Innov Regul Sci"},{"issue":"10","key":"282_CR60","doi-asserted-by":"publisher","first-page":"e0140232-10","DOI":"10.1371\/journal.pone.0140232","volume":"10","author":"SK Smith","year":"2015","unstructured":"Smith SK, Selig W, Harker M, et al. Patient engagement practices in clinical research among patient groups, industry, and academia in the United States: a survey. PLoS ONE. 2015;10(10):e0140232-10. https:\/\/doi.org\/10.1371\/journal.pone.0140232.","journal-title":"PLoS ONE"},{"issue":"6","key":"282_CR61","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1016\/j.jval.2016.04.009","volume":"19","author":"MM Lowe","year":"2016","unstructured":"Lowe MM, Blaser DA, Cone L, et al. Increasing patient involvement in drug development. Value Health. 2016;19(6):869\u201378. https:\/\/doi.org\/10.1016\/j.jval.2016.04.009.","journal-title":"Value Health"},{"key":"282_CR62","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0875-z","author":"R Janssens","year":"2019","unstructured":"Janssens R, Huys I, Overbeeke E, et al. Opportunities and challenges for the inclusion of patient preferences in the medical product life cycle: a systematic review. BMC Med Inform Decis Mak. 2019. https:\/\/doi.org\/10.1186\/s12911-019-0875-z.","journal-title":"BMC Med Inform Decis Mak"},{"key":"282_CR63","unstructured":"Code of conduct - PARADIGM. 2020. http:\/\/imi-paradigm.eu\/petoolbox\/code-of-conduct\/. Accessed 31 Jan 2021."},{"key":"282_CR64","unstructured":"Patient-Focused Medicines Development (PFMD) Patient Engagement Quality Guidance. https:\/\/patientfocusedmedicine.org\/peqg\/patient-engagement-quality-guidance.pdf. Published 15 May 2018. Accessed 1 Feb 2021."},{"issue":"7","key":"282_CR65","doi-asserted-by":"publisher","first-page":"1006","DOI":"10.1097\/ACM.0000000000003137","volume":"95","author":"R Englander","year":"2019","unstructured":"Englander R, Holmboe E, Batalden P, et al. Coproducing health professions education: a prerequisite to coproducing health care services? Acad Med. 2019;95(7):1006\u201313. https:\/\/doi.org\/10.1097\/ACM.0000000000003137.","journal-title":"Acad Med"},{"issue":"6","key":"282_CR66","doi-asserted-by":"publisher","first-page":"1035","DOI":"10.1111\/hex.12797","volume":"21","author":"M Boudes","year":"2018","unstructured":"Boudes M, Robinson P, Bertelsen N, et al. What do stakeholders expect from patient engagement: are these expectations being met? Health Expect. 2018;21(6):1035\u201345. https:\/\/doi.org\/10.1111\/hex.12797.","journal-title":"Health Expect"},{"key":"282_CR67","unstructured":"European Medicines Agency (EMA) Regulatory Science to 2025. Strategic reflection. https:\/\/www.ema.europa.eu\/en\/documents\/regulatory-procedural-guideline\/ema-regulatory-science-2025-strategic-reflection_en.pdf. Accessed 31 Jan 2021."},{"key":"282_CR68","unstructured":"Fujiwara Y. Promoting patient and public involvement in Japan. https:\/\/www.pmda.go.jp\/files\/000235787.pdf. Accessed 31 Jan 2021."},{"key":"282_CR69","unstructured":"ICH harmonised guideline. General considerations for clinical studies E8(R1). Draft version. Currently under public consultation. https:\/\/www.ema.europa.eu\/en\/documents\/scientific-guideline\/draft-ich-guideline-e8-r1-general-considerations-clinical-studies-step-2b_en.pdf. Published 8 May 2019. Accessed 31 Jan 2021."},{"key":"282_CR70","unstructured":"Sweeney F. Renovation of ICH guidelines. What is changing and how is EMA contributing? 2020. https:\/\/www.ema.europa.eu\/en\/documents\/presentation\/presentation-41-renovation-ich-guidelines-what-changing-how-ema-contributing-f-sweeney_en.pdf. Accessed 31 Jan 2021."},{"key":"282_CR71","unstructured":"Council for International Organizations (CIOMS) Working Group XI: Patient Involvement. https:\/\/cioms.ch\/working-groups\/working-group-xi-patient-involvement\/. Accessed 31 Jan 2021."},{"key":"282_CR72","unstructured":"Recommendations on the required capabilities for patient engagement. http:\/\/imi-paradigm.eu\/petoolbox\/pe-capabilities\/. Accessed 31 Jan 2021."},{"key":"282_CR73","unstructured":"PARADIGM Patient Engagement Toolbox. https:\/\/imi-paradigm.eu\/petoolbox\/. Accessed 31 Jan 2021."},{"key":"282_CR74","unstructured":"Deliverable D6.4. Sustainability of the PARADIGM outputs. PARADIGM WP6 Sustainability Strategy. https:\/\/imi-paradigm.eu\/wp-content\/uploads\/2020\/09\/M30_D6.4-Sustainability-of-the-PARADIGM-outputs-1.pdf. Accessed 1 Feb 2021."},{"key":"282_CR75","unstructured":"Patient Engagement Open Forum. https:\/\/patientengagementopenforum.org. Accessed 31 Jan 2021."},{"key":"282_CR76","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.m2575","author":"T Richards","year":"2020","unstructured":"Richards T, Scowcroft H. Patient and public involvement in COVID-19 policy making. BMJ. 2020. https:\/\/doi.org\/10.1136\/bmj.m2575.","journal-title":"BMJ"},{"key":"282_CR77","unstructured":"EURORDIS Rare Barometer survey \u201cHow has COVID-19 impacted people with rare diseases?\u201d. https:\/\/download2.eurordis.org\/rbv\/covid19survey\/covid_infographics_final.pdf. Published November 2020. Accessed 31 Jan 2021."},{"key":"282_CR78","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1007\/s43441-020-00235-y","volume":"55","author":"PJ Pitts","year":"2021","unstructured":"Pitts PJ, Hou\u00ffez F. Patient contribution to the development and safe use of medicines during the Covid-19 pandemic. Ther Innov Regul Sci 2021;55(1):247\u2013249","journal-title":"Ther Innov Regul Sci"}],"container-title":["Therapeutic Innovation &amp; Regulatory Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43441-021-00282-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43441-021-00282-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43441-021-00282-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,3]],"date-time":"2021-08-03T13:26:38Z","timestamp":1627997198000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43441-021-00282-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,10]]},"references-count":78,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["282"],"URL":"https:\/\/doi.org\/10.1007\/s43441-021-00282-z","relation":{},"ISSN":["2168-4790","2168-4804"],"issn-type":[{"value":"2168-4790","type":"print"},{"value":"2168-4804","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,10]]},"assertion":[{"value":"9 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The following authors have no conflict of interest to disclose: Maria Cavaller Bellaubi, Stuart D. Faulkner, Bryan Teixeira, Mathieu Boudes, Eva Molero, Nicholas Brooke, Laura McKeaveney, Jeffrey Southerton, Maria Jos\u00e9 Vicente, Juan Garc\u00eda-Burgos, Vinciane Pirard, Kirsty Reid and Elisa Ferrer. Neil Bertelsen works with a variety of stakeholder groups on patient involvement in healthcare decisions. This includes work as a consultant to patient groups and to the industry.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}