{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T01:26:55Z","timestamp":1777426015794,"version":"3.51.4"},"reference-count":82,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T00:00:00Z","timestamp":1751328000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T00:00:00Z","timestamp":1751328000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Health Res Policy Sys"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Co-creation has emerged as a crucial strategy for addressing complex public health challenges, including promotion and prevention of mental health concerns. While the evidence base for effective interventions continues to grow, significant gaps remain in their implementation and integration into real-world settings. Co-creation offers a valuable tool for strengthening mental health promotion strategies, ensuring that interventions are evidence-based, contextually relevant, culturally sensitive, sustainable and acceptable to those directly affected. However, there is a paucity of studies examining the evaluation of co-creation research, particularly regarding how participatory methods foster adaptation and influence outcomes and long-term sustainability. This protocol outlines a study designed to implement, evaluate and strengthen co-creation methodologies through a participatory and formative evaluation approach. <\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>This study adopts a mixed-methods design within the ADVANCE project, a multi-country initiative focused on co-creating mental health promotion and prevention interventions with groups in vulnerable situations across seven European countries. End-users, healthcare professionals, and decision-makers will be engaged throughout the project in both intervention design and evaluation. Co-creation activities initiated with intervention scenario building and prioritization, drawing on desk reviews and online Delphi surveys co-developed with locally-set Society Advisory Groups (SAGs). The selection of intervention scenarios for implementation was performed using scenario-based workshops involving stakeholders in six partner countries. A second goal is to evaluate the co-creation process, which was co-designed in consultation with country teams and SAGs. A longitudinal qualitative study based on semistructured interviews with co-creators across two time points will be conducted, following the co-development of the interview guide through an online World Caf\u00e9. <\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Discussion<\/jats:title>\n            <jats:p>This study introduces an innovative approach by embedding participatory and formative evaluation into the co-creation process, enabling ongoing adaptation of co-creation activities. Through continuous stakeholder engagement, the project seeks to address barriers deriving from power imbalances, conflicting priorities, and resource limitations. Qualitative and participatory methods will be combined to elicit stakeholders\u2019 views, identify drawbacks and promote adjustments to ensure meaningful collaboration and reduce participation fatigue. Expected outcomes include actionable recommendations to inform policy, reduce stigma and foster the co-creation of more inclusive, effective, sustainable and scalable mental health promotion and prevention strategies across Europe. <\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/s12961-025-01349-1","type":"journal-article","created":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T08:16:46Z","timestamp":1751357806000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Co-creating mental health promotion and prevention interventions with groups in vulnerable situations in Europe: a mixed-methods study protocol for co-creation implementation and participatory evaluation"],"prefix":"10.1186","volume":"23","author":[{"given":"Raquel","family":"Teixeira","sequence":"first","affiliation":[]},{"given":"Cl\u00e1udia","family":"de Freitas","sequence":"additional","affiliation":[]},{"given":"Liuska","family":"Sanna","sequence":"additional","affiliation":[]},{"given":"Eleonora","family":"Prina","sequence":"additional","affiliation":[]},{"given":"Giulia","family":"Turrini","sequence":"additional","affiliation":[]},{"given":"Amber S.","family":"Brizar","sequence":"additional","affiliation":[]},{"given":"C\u0103t\u0103lin","family":"Gherdan","sequence":"additional","affiliation":[]},{"given":"Evaldas","family":"Kazlauskas","sequence":"additional","affiliation":[]},{"given":"Aust\u0117ja","family":"Dumarkait\u0117","sequence":"additional","affiliation":[]},{"given":"Henrik","family":"Wasmus","sequence":"additional","affiliation":[]},{"given":"Leonie","family":"Fleck","sequence":"additional","affiliation":[]},{"given":"Ulrich","family":"Reininghaus","sequence":"additional","affiliation":[]},{"given":"Melanie","family":"Mack","sequence":"additional","affiliation":[]},{"given":"Chiara","family":"Scarampi","sequence":"additional","affiliation":[]},{"given":"Maritta","family":"V\u00e4lim\u00e4ki","sequence":"additional","affiliation":[]},{"given":"Maija","family":"Satamo","sequence":"additional","affiliation":[]},{"given":"Wietse A.","family":"Tol","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,7,1]]},"reference":[{"issue":"3","key":"1349_CR1","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1332\/174426419X15532579188099","volume":"15","author":"G Bammer","year":"2019","unstructured":"Bammer G. Key issues in co-creation with stakeholders when research problems are complex. Evid Policy. 2019;15(3):423\u201335.","journal-title":"Evid Policy"},{"issue":"3","key":"1349_CR2","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1016\/j.healthpol.2010.11.002","volume":"101","author":"B Hannigan","year":"2011","unstructured":"Hannigan B, Coffey M. Where the wicked problems are: the case of mental health. Health Policy. 2011;101(3):220\u20137.","journal-title":"Health Policy"},{"key":"1349_CR3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13756-016-0119-2","volume":"5","author":"AF van Woezik","year":"2016","unstructured":"van Woezik AF, Braakman-Jansen LM, Kulyk O, Siemons L, van Gemert-Pijnen JE. Tackling wicked problems in infection prevention and control: a guideline for co-creation with stakeholders. Antimicrob Resist Infect Control. 2016;5:1\u201312.","journal-title":"Antimicrob Resist Infect Control"},{"key":"1349_CR4","unstructured":"OECD\/European Union. Health at a glance: Europe 2018: state of health in the EU cycle. 2018;OECD Publishing, Paris."},{"key":"1349_CR5","unstructured":"World Health Organization. WHO European framework for action on mental health 2021\u20132025: World Health Organization. Regional Office for Europe; 2022."},{"key":"1349_CR6","unstructured":"Eurostat. Mental health and related issues statistics - Self-perceived mental health and access to care. 2021."},{"key":"1349_CR7","unstructured":"OECD\/European Union. Health at a glance: Europe 2022: state of health in the EU cycle. 2022.;OECD Publishing, Paris."},{"key":"1349_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.healthpol.2023.104878","volume":"136","author":"JR Cummings","year":"2023","unstructured":"Cummings JR, Zhang X, Gandr\u00e9 C, Morsella A, Shields-Zeeman L, Winkelmann J, et\u00a0al. Challenges facing mental health systems arising from the COVID-19 pandemic: evidence from 14 European and North American countries. Health Policy. 2023;136: 104878.","journal-title":"Health Policy"},{"key":"1349_CR9","unstructured":"European Parliament. Resolution on mental health in the European Union. 2019."},{"issue":"8","key":"1349_CR10","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1016\/S2215-0366(19)30132-4","volume":"6","author":"J Firth","year":"2019","unstructured":"Firth J, Siddiqi N, Koyanagi A, Siskind D, Rosenbaum S, Galletly C, et\u00a0al. The Lancet Psychiatry Commission: a blueprint for protecting physical health in people with mental illness. The Lancet Psychiatry. 2019;6(8):675\u2013712.","journal-title":"The Lancet Psychiatry"},{"issue":"5","key":"1349_CR11","doi-asserted-by":"publisher","first-page":"e1003606","DOI":"10.1371\/journal.pmed.1003606","volume":"18","author":"LK-D Le","year":"2021","unstructured":"Le LK-D, Esturas AC, Mihalopoulos C, Chiotelis O, Bucholc J, Chatterton ML, et\u00a0al. Cost-effectiveness evidence of mental health prevention and promotion interventions: a systematic review of economic evaluations. PLoS Med. 2021;18(5):e1003606.","journal-title":"PLoS Med"},{"key":"1349_CR12","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.euroneuro.2020.10.007","volume":"41","author":"GS de Pablo","year":"2020","unstructured":"de Pablo GS, De Micheli A, Nieman DH, Correll CU, Kessing LV, Pfennig A, et\u00a0al. Universal and selective interventions to promote good mental health in young people: systematic review and meta-analysis. Eur Neuropsychopharmacol. 2020;41:28\u201339.","journal-title":"Eur Neuropsychopharmacol"},{"key":"1349_CR13","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2020.101955","volume":"83","author":"P Cuijpers","year":"2021","unstructured":"Cuijpers P, Pineda BS, Quero S, Karyotaki E, Struijs SY, Figueroa CA, et\u00a0al. Psychological interventions to prevent the onset of depressive disorders: a meta-analysis of randomized controlled trials. Clin Psychol Rev. 2021;83: 101955.","journal-title":"Clin Psychol Rev"},{"key":"1349_CR14","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1007\/s10464-008-9165-0","volume":"41","author":"JA Durlak","year":"2008","unstructured":"Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Commun Psychol. 2008;41:327\u201350.","journal-title":"Am J Commun Psychol"},{"key":"1349_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2019.04.025","volume":"283","author":"MS Bauer","year":"2020","unstructured":"Bauer MS, Kirchner J. Implementation science: what is it and why should I care? Psychiatry Res. 2020;283: 112376.","journal-title":"Psychiatry Res"},{"issue":"1","key":"1349_CR16","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s12529-020-09848-x","volume":"27","author":"RC Shelton","year":"2020","unstructured":"Shelton RC, Lee M, Brotzman LE, Wolfenden L, Nathan N, Wainberg ML. What is dissemination and implementation science?: an introduction and opportunities to advance behavioral medicine and public health globally. Int J Behav Med. 2020;27(1):3\u201320.","journal-title":"Int J Behav Med"},{"issue":"1","key":"1349_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1748-5908-1-1","volume":"1","author":"M Eccles","year":"2006","unstructured":"Eccles M, Mittman B. Welcome to implementation science. Implement Sci. 2006;1(1):1\u20133.","journal-title":"Implement Sci"},{"issue":"S1","key":"1349_CR18","doi-asserted-by":"publisher","first-page":"S40","DOI":"10.2105\/AJPH.2009.184036","volume":"100","author":"N Wallerstein","year":"2010","unstructured":"Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(S1):S40\u20136.","journal-title":"Am J Public Health"},{"key":"1349_CR19","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1146\/annurev-publhealth-060722-024251","volume":"45","author":"S Ramanadhan","year":"2023","unstructured":"Ramanadhan S, Alem\u00e1n R, Bradley CD, Cruz JL, Safaeinili N, Simonds V, et\u00a0al. Using participatory implementation science to advance health equity. Annu Rev Public Health. 2023;45:47.","journal-title":"Annu Rev Public Health"},{"key":"1349_CR20","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1146\/annurev.publhealth.29.091307.083824","volume":"29","author":"M Cargo","year":"2008","unstructured":"Cargo M, Mercer SL. The value and challenges of participatory research: strengthening its practice. Annu Rev Public Health. 2008;29:325\u201350.","journal-title":"Annu Rev Public Health"},{"issue":"3","key":"1349_CR21","doi-asserted-by":"publisher","DOI":"10.17061\/phrp3432419","volume":"34","author":"C Middel","year":"2024","unstructured":"Middel C, Blake M, Boelsen-Robinson T, Mackenbach J, Stuber J, Vargas C, et\u00a0al. Co-creation in public health research: an introduction to basic principles. Public Health Res Pract. 2024;34(3): e3432419.","journal-title":"Public Health Res Pract"},{"issue":"8","key":"1349_CR22","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1080\/15265161.2019.1619877","volume":"19","author":"S Lignou","year":"2019","unstructured":"Lignou S, Capitao L, Hamer-Hunt JM, Singh I. Co-production: an ethical model for mental health research? Am J Bioeth. 2019;19(8):49\u201351.","journal-title":"Am J Bioeth"},{"key":"1349_CR23","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.socscimed.2015.04.019","volume":"135","author":"C De Freitas","year":"2015","unstructured":"De Freitas C, Martin G. Inclusive public participation in health: policy, practice and theoretical contributions to promote the involvement of marginalised groups in healthcare. Soc Sci Med. 2015;135:31\u20139.","journal-title":"Soc Sci Med"},{"key":"1349_CR24","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1111\/hex.12988","volume":"24","author":"P Friesen","year":"2021","unstructured":"Friesen P, Lignou S, Sheehan M, Singh I. Measuring the impact of participatory research in psychiatry: How the search for epistemic justifications obscures ethical considerations. Health Expect. 2021;24:54\u201361.","journal-title":"Health Expect"},{"issue":"1","key":"1349_CR25","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1353\/cpr.2016.0011","volume":"10","author":"MC Gibbons","year":"2016","unstructured":"Gibbons MC, Illangasekare SL, Smith E, Kub J. A community health initiative: evaluation and early lessons learned. Prog Commun Health Partnerships Res Educ Action. 2016;10(1):89\u2013101.","journal-title":"Prog Commun Health Partnerships Res Educ Action"},{"issue":"3","key":"1349_CR26","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2018-025584","volume":"9","author":"M Anselma","year":"2019","unstructured":"Anselma M, Altenburg T, Chinapaw M. Kids in action: the protocol of a youth participatory action research project to promote physical activity and dietary behaviour. BMJ Open. 2019;9(3): e025584.","journal-title":"BMJ Open"},{"issue":"7","key":"1349_CR27","doi-asserted-by":"publisher","DOI":"10.1136\/bmjgh-2023-014483","volume":"9","author":"GR Longworth","year":"2024","unstructured":"Longworth GR, De Boer J, Goh K, Agnello DM, McCaffrey L, Restrepo JRZ, et\u00a0al. Navigating process evaluation in co-creation: a Health CASCADE scoping review of used frameworks and assessed components. BMJ Glob Health. 2024;9(7): e014483.","journal-title":"BMJ Glob Health"},{"issue":"6","key":"1349_CR28","doi-asserted-by":"publisher","DOI":"10.1111\/hex.70103","volume":"27","author":"SJ Fitzpatrick","year":"2024","unstructured":"Fitzpatrick SJ, Lamb H, Oldman E, Giugni M, Chakouch C, Morse AR, et\u00a0al. Co-creation in research: further reflections from the \u2018co-creating safe spaces\u2019 project. Health Expect. 2024;27(6): e70103.","journal-title":"Health Expect"},{"key":"1349_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12961-021-00699-w","volume":"19","author":"J Popp","year":"2021","unstructured":"Popp J, Gr\u00fcne E, Carl J, Semrau J, Pfeifer K. Co-creating physical activity interventions: a mixed methods evaluation approach. Health Res Policy Syst. 2021;19:1\u20139.","journal-title":"Health Res Policy Syst"},{"issue":"2","key":"1349_CR30","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1111\/1468-0009.12197","volume":"94","author":"T Greenhalgh","year":"2016","unstructured":"Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving research impact through co-creation in community-based health services: literature review and case study. Milbank Q. 2016;94(2):392\u2013429.","journal-title":"Milbank Q"},{"issue":"1","key":"1349_CR31","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1186\/s12961-024-01126-6","volume":"22","author":"GR Longworth","year":"2024","unstructured":"Longworth GR, Goh K, Agnello DM, Messiha K, Beeckman M, Zapata-Restrepo JR, et\u00a0al. A review of implementation and evaluation frameworks for public health interventions to inform co-creation: a Health CASCADE study. Health Res Policy Syst. 2024;22(1):39.","journal-title":"Health Res Policy Syst"},{"issue":"2","key":"1349_CR32","doi-asserted-by":"publisher","first-page":"e12","DOI":"10.2196\/humanfactors.4361","volume":"2","author":"SK Orlowski","year":"2015","unstructured":"Orlowski SK, Venning A, Winsall M, Jones G, Wyld K, Damarell R, Antezana G, Schrader G, Smith D, Collin P, Bidargaddi N. Participatory research as one piece of the puzzle: a systematic review of consumer involvement in design of technology-based youth mental health and well-being interventions. JMIR Hum Factors. 2015;2(2):e12.","journal-title":"JMIR Hum Factors"},{"key":"1349_CR33","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssmmh.2022.100152","volume":"2","author":"MC Greene","year":"2022","unstructured":"Greene MC, Bonz A, Isaacs R, Cristobal M, Vega C, Andersen LS, et\u00a0al. Community-based participatory design of a psychosocial intervention for migrant women in Ecuador and Panama. SSM-Mental Health. 2022;2: 100152.","journal-title":"SSM-Mental Health"},{"key":"1349_CR34","doi-asserted-by":"publisher","first-page":"200279","DOI":"10.1016\/j.mhp.2023.200279","volume":"30","author":"E G\u00fcell","year":"2023","unstructured":"G\u00fcell E, Benito-Amat C, Molas-Gallart J. Priority setting in mental health research: a scoping review of participatory methods. Mental Health Prevent. 2023;30:200279.","journal-title":"Mental Health Prevent."},{"key":"1349_CR35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40359-015-0089-9","volume":"3","author":"MS Bauer","year":"2015","unstructured":"Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol. 2015;3:1\u201312.","journal-title":"BMC Psychol"},{"key":"1349_CR36","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2019.112532","volume":"283","author":"AR Elwy","year":"2020","unstructured":"Elwy AR, Wasan AD, Gillman AG, Johnston KL, Dodds N, McFarland C, et\u00a0al. Using formative evaluation methods to improve clinical implementation efforts: description and an example. Psychiatry Res. 2020;283: 112532.","journal-title":"Psychiatry Res"},{"issue":"10","key":"1349_CR37","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1111\/tmi.13643","volume":"26","author":"A MacFarlane","year":"2021","unstructured":"MacFarlane A, Ogoro M, de Freitas C, Niranjan V, Severoni S, Waagensen E. Migrants\u2019 involvement in health policy, service development and research in the WHO European Region: a narrative review of policy and practice. Trop Med Int Health. 2021;26(10):1164\u201376.","journal-title":"Trop Med Int Health"},{"issue":"2","key":"1349_CR38","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.psi.2014.07.007","volume":"23","author":"C De Freitas","year":"2014","unstructured":"De Freitas C, Garc\u00eda-Ramirez M, Aamb\u00f8 A, Buttigieg SC. Transforming health policies through migrant user involvement: lessons learnt from three European countries. Psychosoc Interv. 2014;23(2):105\u201313.","journal-title":"Psychosoc Interv"},{"key":"1349_CR39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40900-018-0133-z","volume":"5","author":"CF Leask","year":"2019","unstructured":"Leask CF, Sandlund M, Skelton DA, Altenburg TM, Cardon G, Chinapaw MJ, et\u00a0al. Framework, principles and recommendations for utilising participatory methodologies in the co-creation and evaluation of public health interventions. Res Involv Engage. 2019;5:1\u201316.","journal-title":"Res Involv Engage"},{"issue":"80","key":"1349_CR40","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1002\/ev.1114","volume":"1998","author":"JB Cousins","year":"1998","unstructured":"Cousins JB, Whitmore E. Framing participatory evaluation. N Dir Eval. 1998;1998(80):5\u201323.","journal-title":"N Dir Eval"},{"key":"1349_CR41","unstructured":"Mental Health Europe. Guidelines for co-creation research in mental health. Brussels: MHE; 2023. Available at: https:\/\/www.mentalhealtheurope.org\/wp-content\/uploads\/2024\/04\/Mental-Health-Europes-Guidelines-for-Cocreation.pdf."},{"issue":"4","key":"1349_CR42","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1016\/S0005-7894(04)80013-3","volume":"35","author":"SC Hayes","year":"2004","unstructured":"Hayes SC. Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies. Behav Ther. 2004;35(4):639\u201365.","journal-title":"Behav Ther"},{"key":"1349_CR43","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1146\/annurev-clinpsy-032210-104449","volume":"7","author":"SC Hayes","year":"2011","unstructured":"Hayes SC, Villatte M, Levin M, Hildebrandt M. Open, aware, and active: contextual approaches as an emerging trend in the behavioral and cognitive therapies. Annu Rev Clin Psychol. 2011;7:141\u201368.","journal-title":"Annu Rev Clin Psychol"},{"issue":"6","key":"1349_CR44","doi-asserted-by":"publisher","first-page":"778","DOI":"10.1016\/j.beth.2017.06.003","volume":"48","author":"JN Kirby","year":"2017","unstructured":"Kirby JN, Tellegen CL, Steindl SR. A meta-analysis of compassion-based interventions: current state of knowledge and future directions. Behav Ther. 2017;48(6):778\u201392.","journal-title":"Behav Ther"},{"issue":"12","key":"1349_CR45","doi-asserted-by":"publisher","DOI":"10.2196\/27462","volume":"10","author":"A Schick","year":"2021","unstructured":"Schick A, Paetzold I, Rauschenberg C, Hirjak D, Banaschewski T, Meyer-Lindenberg A, et\u00a0al. Effects of a novel, transdiagnostic, hybrid ecological momentary intervention for improving resilience in youth (EMIcompass): protocol for an exploratory randomized controlled trial. JMIR Res Protocols. 2021;10(12): e27462.","journal-title":"JMIR Res Protocols"},{"issue":"3","key":"1349_CR46","doi-asserted-by":"publisher","first-page":"592","DOI":"10.1093\/schbul\/sbac212","volume":"49","author":"U Reininghaus","year":"2023","unstructured":"Reininghaus U, Paetzold I, Rauschenberg C, Hirjak D, Banaschewski T, Meyer-Lindenberg A, et\u00a0al. Effects of a novel, transdiagnostic ecological momentary intervention for prevention, and early intervention of severe mental disorder in youth (EMIcompass): findings from an exploratory randomized controlled trial. Schizophr Bull. 2023;49(3):592\u2013604.","journal-title":"Schizophr Bull"},{"issue":"1","key":"1349_CR47","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1002\/wps.20947","volume":"21","author":"J Hall","year":"2022","unstructured":"Hall J, Jordan S, van Ommeren M, Au T, Sway RA, Crawford J, et\u00a0al. Sustainable Technology for Adolescents and youth to Reduce Stress (STARS): a WHO transdiagnostic chatbot for distressed youth. World Psychiatry. 2022;21(1):156.","journal-title":"World Psychiatry"},{"key":"1349_CR48","unstructured":"World Health Organization. Doing what matters in times of stress. An illustrated Guide. 2020."},{"issue":"2","key":"1349_CR49","doi-asserted-by":"publisher","first-page":"e254","DOI":"10.1016\/S2214-109X(19)30504-2","volume":"8","author":"WA Tol","year":"2020","unstructured":"Tol WA, Leku MR, Lakin DP, Carswell K, Augustinavicius J, Adaku A, et\u00a0al. Guided self-help to reduce psychological distress in South Sudanese female refugees in Uganda: a cluster randomised trial. Lancet Glob Health. 2020;8(2):e254\u201363.","journal-title":"Lancet Glob Health"},{"issue":"1","key":"1349_CR50","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1002\/wps.20939","volume":"21","author":"C Acarturk","year":"2022","unstructured":"Acarturk C, Uygun E, Ilkkursun Z, Carswell K, Tedeschi F, Batu M, et\u00a0al. Effectiveness of a WHO Self-Help psychological intervention for preventing mental disorders among Syrian refugees in Turkey: a randomized controlled trial. World Psychiatry. 2022;21(1):88\u201395.","journal-title":"World Psychiatry"},{"issue":"6","key":"1349_CR51","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1159\/000517504","volume":"90","author":"M Purgato","year":"2021","unstructured":"Purgato M, Carswell K, Tedeschi F, Acarturk C, Anttila M, Au T, et\u00a0al. Effectiveness of self-help plus in preventing mental disorders in refugees and asylum seekers in Western Europe: a multinational randomized controlled trial. Psychother Psychosom. 2021;90(6):403\u201314.","journal-title":"Psychother Psychosom"},{"key":"1349_CR52","unstructured":"Mental Health Europe. Mental Health Europe\u2019s toolkit on co-creation. 2024 Accessed 21 May 2025. Available from: https:\/\/www.mentalhealtheurope.org\/library\/co-creation-toolkit\/."},{"issue":"1","key":"1349_CR53","doi-asserted-by":"publisher","first-page":"2","DOI":"10.5334\/spo.81","volume":"5","author":"M Mack","year":"2025","unstructured":"Mack M, Scarampi C, Joly-Burra E, Zuber S, de Freitas C, Teixeira R, et\u00a0al. Enhancing mental health and cognitive function in older adults: a Swiss perspective on public health interventions and stigma mitigation strategies informed by a desk review. Swiss Psychol Open. 2025;5(1):2.","journal-title":"Swiss Psychol Open."},{"key":"1349_CR54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1748-5908-5-69","volume":"5","author":"D Levac","year":"2010","unstructured":"Levac D, Colquhoun H, O\u2019Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:1\u20139.","journal-title":"Implement Sci"},{"issue":"1","key":"1349_CR55","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1080\/1364557032000119616","volume":"8","author":"H Arksey","year":"2005","unstructured":"Arksey H, O\u2019Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19\u201332.","journal-title":"Int J Soc Res Methodol"},{"key":"1349_CR56","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13031-017-0103-3","volume":"11","author":"MC Greene","year":"2017","unstructured":"Greene MC, Jordans MJ, Kohrt BA, Ventevogel P, Kirmayer LJ, Hassan G, et\u00a0al. Addressing culture and context in humanitarian response: preparing desk reviews to inform mental health and psychosocial support. Confl Heal. 2017;11:1\u201310.","journal-title":"Confl Heal"},{"key":"1349_CR57","volume-title":"Business model generation: a handbook for visionaries, game changers, and challengers","author":"A Osterwalder","year":"2010","unstructured":"Osterwalder A, Pigneur Y. Business model generation: a handbook for visionaries, game changers, and challengers. John Wiley & Sons; 2010."},{"issue":"4","key":"1349_CR58","doi-asserted-by":"publisher","first-page":"1008","DOI":"10.1046\/j.1365-2648.2000.t01-1-01567.x","volume":"32","author":"F Hasson","year":"2000","unstructured":"Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008\u201315.","journal-title":"J Adv Nurs"},{"issue":"3","key":"1349_CR59","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1136\/ebnurs-2020-103303","volume":"23","author":"D Barrett","year":"2020","unstructured":"Barrett D, Heale R. What are Delphi studies? Evid Based Nurs. 2020;23(3):68\u20139.","journal-title":"Evid Based Nurs"},{"issue":"4","key":"1349_CR60","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/j.eujim.2015.07.002","volume":"7","author":"EG Trevelyan","year":"2015","unstructured":"Trevelyan EG, Robinson N. Delphi methodology in health research: how to do it? Eur J Integr Med. 2015;7(4):423\u20138.","journal-title":"Eur J Integr Med"},{"issue":"3","key":"1349_CR61","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1287\/mnsc.9.3.458","volume":"9","author":"N Dalkey","year":"1963","unstructured":"Dalkey N, Helmer O. An experimental application of the Delphi method to the use of experts. Manage Sci. 1963;9(3):458\u201367.","journal-title":"Manage Sci"},{"key":"1349_CR62","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1093\/ijpor\/12.2.209","volume":"12","author":"QA Raaijmakers","year":"2000","unstructured":"Raaijmakers QA, Van Hoof J, Hart H, Verbogt T, Vollebergh WA. Adolescents\u2019 midpoint responses on Likert-type scale items: neutral or missing values? Int J Public Opinion Res. 2000;12:208\u201316.","journal-title":"Int J Public Opinion Res."},{"issue":"4","key":"1349_CR63","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1016\/j.jclinepi.2013.12.002","volume":"67","author":"IR Diamond","year":"2014","unstructured":"Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et\u00a0al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401\u20139.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"1349_CR64","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-015-0083-1","volume":"15","author":"HC Vollmar","year":"2015","unstructured":"Vollmar HC, Ostermann T, Reda\u00e8lli M. Using the scenario method in the context of health and health care\u2013A scoping review. BMC Med Res Methodol. 2015;15(1):1\u201310.","journal-title":"BMC Med Res Methodol"},{"issue":"4","key":"1349_CR65","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1016\/j.futures.2009.11.021","volume":"42","author":"CA Varum","year":"2010","unstructured":"Varum CA, Melo C. Directions in scenario planning literature\u2013A review of the past decades. Futures. 2010;42(4):355\u201369.","journal-title":"Futures"},{"key":"1349_CR66","volume-title":"Scenarios: the art of strategic conversation","author":"K Van der Heijden","year":"2005","unstructured":"Van der Heijden K. Scenarios: the art of strategic conversation. John Wiley & Sons; 2005."},{"issue":"3","key":"1349_CR67","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1016\/S2215-0366(16)30219-X","volume":"4","author":"D Giacco","year":"2017","unstructured":"Giacco D, Amering M, Bird V, Craig T, Ducci G, Gallinat J, et\u00a0al. Scenarios for the future of mental health care: a social perspective. Lancet Psychiatry. 2017;4(3):257\u201360.","journal-title":"Lancet Psychiatry"},{"key":"1349_CR68","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1472-6947-11-1","volume":"11","author":"JJ Bierbooms","year":"2011","unstructured":"Bierbooms JJ, Bongers IM, van Oers HA. A scenario analysis of the future residential requirements for people with mental health problems in Eindhoven. BMC Med Inform Decis Mak. 2011;11:1\u201312.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"1349_CR69","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1177\/1524839903257692","volume":"5","author":"JA Neiner","year":"2004","unstructured":"Neiner JA, Howze EH, Greaney ML. Using scenario planning in public health: anticipating alternative futures. Health Promot Pract. 2004;5(1):69\u201379.","journal-title":"Health Promot Pract"},{"issue":"3","key":"1349_CR70","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2020-044289","volume":"11","author":"C de Freitas","year":"2021","unstructured":"de Freitas C, Amorim M, Machado H, Teles EL, Baptista MJ, Renedo A, et\u00a0al. Public and patient involvement in health data governance (DATAGov): protocol of a people-centred, mixed-methods study on data use and sharing for rare diseases care and research. BMJ Open. 2021;11(3): e044289.","journal-title":"BMJ Open"},{"issue":"3","key":"1349_CR71","first-page":"278","volume":"34","author":"A MacFarlane","year":"2017","unstructured":"MacFarlane A, Galvin R, O\u2019Sullivan M, McInerney C, Meagher E, Burke D, et\u00a0al. Participatory methods for research prioritization in primary care: an analysis of the World Caf\u00e9 approach in Ireland and the USA. Fam Pract. 2017;34(3):278\u201384.","journal-title":"Fam Pract"},{"key":"1349_CR72","unstructured":"Brown J. The world caf\u00e9: shaping our futures through conversations that matter: ReadHowYouWant. com; 2010."},{"issue":"16","key":"1349_CR73","doi-asserted-by":"publisher","first-page":"9969","DOI":"10.3390\/ijerph19169969","volume":"19","author":"J Albrecht","year":"2022","unstructured":"Albrecht J, Stark AL, Dongas E, Wrona KJ, Dockweiler C. Hosting an Online World Caf\u00e9 to develop an understanding of digital health promoting settings from a citizen\u2019s perspective\u2014Methodological potentials and challenges. Int J Environ Res Public Health. 2022;19(16):9969.","journal-title":"Int J Environ Res Public Health"},{"issue":"2","key":"1349_CR74","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","volume":"3","author":"V Braun","year":"2006","unstructured":"Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77\u2013101.","journal-title":"Qual Res Psychol"},{"issue":"2","key":"1349_CR75","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1093\/heapro\/daaa063","volume":"36","author":"DV Heimburg","year":"2021","unstructured":"Heimburg DV, Cluley V. Advancing complexity-informed health promotion: a scoping review to link health promotion and co-creation. Health Promot Int. 2021;36(2):581\u2013600.","journal-title":"Health Promot Int"},{"key":"1349_CR76","doi-asserted-by":"crossref","unstructured":"Keshavarz Mohammadi N. One step back toward the future of health promotion: complexity-informed health promotion. Oxford University Press; 2019. p. 635\u20139.","DOI":"10.1093\/heapro\/daz084"},{"issue":"1","key":"1349_CR77","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1093\/pubmed\/fdz126","volume":"43","author":"K Halvorsrud","year":"2021","unstructured":"Halvorsrud K, Kucharska J, Adlington K, R\u00fcdell K, Brown Hajdukova E, Nazroo J, et\u00a0al. Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature. J Public Health. 2021;43(1):197\u2013208.","journal-title":"J Public Health"},{"issue":"10","key":"1349_CR78","doi-asserted-by":"publisher","first-page":"e0240543","DOI":"10.1371\/journal.pone.0240543","volume":"15","author":"A van Dijk-de Vries","year":"2020","unstructured":"van Dijk-de Vries A, Stevens A, van der Weijden T, Beurskens AJ. How to support a co-creative research approach in order to foster impact. The development of a co-creation impact compass for healthcare researchers. PLoS ONE. 2020;15(10):e0240543.","journal-title":"PLoS ONE"},{"key":"1349_CR79","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s40271-014-0065-0","volume":"7","author":"J Brett","year":"2014","unstructured":"Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et\u00a0al. A systematic review of the impact of patient and public involvement on service users, researchers and communities. The Patient-Patient-Centered Outcomes Res. 2014;7:387\u201395.","journal-title":"The Patient-Patient-Centered Outcomes Res"},{"issue":"5","key":"1349_CR80","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1111\/j.1369-7625.2012.00795.x","volume":"17","author":"J Brett","year":"2014","unstructured":"Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et\u00a0al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2014;17(5):637\u201350.","journal-title":"Health Expect"},{"issue":"3","key":"1349_CR81","first-page":"S44","volume":"201","author":"T Janamian","year":"2014","unstructured":"Janamian T, Jackson C, Dunbar J. Co-creating value in research: stakeholders\u2019 perspectives. Med J Aust. 2014;201(3):S44\u20136.","journal-title":"Med J Aust"},{"issue":"1","key":"1349_CR82","doi-asserted-by":"publisher","DOI":"10.2196\/59772","volume":"13","author":"DM Agnello","year":"2024","unstructured":"Agnello DM, Balaskas G, Steiner A, Chastin S. Methods used in co-creation within the health CASCADE Co-creation database and gray literature: systematic methods overview. Interactive J Med Res. 2024;13(1): e59772.","journal-title":"Interactive J Med Res"}],"container-title":["Health Research Policy and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12961-025-01349-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12961-025-01349-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12961-025-01349-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T09:07:04Z","timestamp":1751360824000},"score":1,"resource":{"primary":{"URL":"https:\/\/health-policy-systems.biomedcentral.com\/articles\/10.1186\/s12961-025-01349-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,1]]},"references-count":82,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["1349"],"URL":"https:\/\/doi.org\/10.1186\/s12961-025-01349-1","relation":{},"ISSN":["1478-4505"],"issn-type":[{"value":"1478-4505","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,1]]},"assertion":[{"value":"28 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 May 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was approved by: the Ethics Committee for Human Sciences at the University of Turku, Finland (no. 40\/2023) on 14 August 2023; the Research Ethics Committee for SCIENCE and SUND of University of Copenhagen, Denmark (no. 504-0467\/24-5000) on 2 February 2024; the Vilnius University Committee on Research Ethics in Psychology, Lithuania [no. (1.13 E) 250000-KT-33] on 20 February 2024; the Comitato di Approvazione della Ricerca sulla Persona (CARP) of the University of Verona, Italy (no. 35\/R1\/2023) on 6 February 2024; the Scientific and Ethical Review Board of the Faculty of Behaviour & Movement Sciences, Vrije Universiteit Amsterdam, the Netherlands (no. VCWE-2024-037R1) on 20 March 2024; the II Ethics Committee of the Medical Faculty of Heidelberg University, Germany (no. 2024-535) on 5 March 2024 and further waved on 11 February 2025; and, by the Ethics Committee of the Institute of Public Health of the University of Porto, Portugal (no. CE24271) on 25 July 2024, amended on 5 February 2025. The study adheres to the principles outlined in the Helsinki Declaration of 2008. For co-creation activities undertaken in the first year of the project, recruitment and data collection commenced only after approval was obtained. Informed consent was obtained from all participants prior to their involvement in the study. Financial compensation was offered to end-users who participated in scenario-based workshops to ensure that this aspect did not represent a barrier to their participation. The compensation amounts varied by country and were determined by what was outlined in the Grant Agreement of the Advance Project. Future research concerning co-creation evaluation will start only after participants provide written informed consent to take part in the World Caf\u00e9 and in the interviews. No compensation will be offered for participation in the World Caf\u00e9 and in the interviews.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"87"}}