{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T15:11:34Z","timestamp":1778685094810,"version":"3.51.4"},"reference-count":43,"publisher":"BMJ","issue":"5","license":[{"start":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T00:00:00Z","timestamp":1778630400000},"content-version":"unspecified","delay-in-days":12,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["[223508\/Z\/21\/Z], [227535\/Z\/23\/Z]"],"award-info":[{"award-number":["[223508\/Z\/21\/Z], [227535\/Z\/23\/Z]"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open"],"accepted":{"date-parts":[[2026,4,29]]},"published-print":{"date-parts":[[2026,5]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Research and mental health services agree that more youth co-production in service design and delivery is needed, but there is little consensus on how to do it well. This study is trying to find agreement about the best ways to do this.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods and analysis<\/jats:title>\n                    <jats:p>A realist eDelphi study will be conducted. People with experience of co-production and engagement in youth mental health services will be invited to participate. This will include young people with relevant lived experience, family members\/carers of young people with mental ill health, youth mental health researchers and other professionals with experience of youth engagement work (eg, mental healthcare staff, mental health service managers and participation\/engagement professionals in the sector). The target is to recruit 10\u201320 participants from each of these four groups (40\u201380 participants total).<\/jats:p>\n                    <jats:p>The following steps will be taken: (1) an advisory group of young people will use results from a realist literature review completed prior to this study, to generate the first list of items for the survey; (2) using the online survey tool Qualtrics, participants will be invited to rate these items in an online survey. A prompt question formatted using a realist framework will allow participants to comment on their rating and how this survey item works (or does not work) in this context, for young people or other stakeholders. Participants will be able to add further suggestions at this stage; (3) using Qualtrics, a second survey round will be completed which will include the new suggestions from participants, and original items with their average participant ratings and comments displayed. Participants will be asked to rerate items in this round; (4) a list of items will be generated that comprises survey items believed to be \u2018essential\u2019 or \u2018important\u2019 by 80% or more of the participants; (5) this list will be discussed with the Youth Advisory Group to generate a final recommendations document and consider creative outputs and dissemination methods. Data analysis will include raw numbers, means and frequencies.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Ethics and dissemination<\/jats:title>\n                    <jats:p>Ethical approval has been granted by the University of Birmingham Research Ethics Committee (Ref: ERN_1550-Apr2024). Both traditional and non-traditional outputs will be created (eg, conference presentations, publications, a plain English summary and social media infographics).<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/bmjopen-2025-105765","type":"journal-article","created":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T14:26:07Z","timestamp":1778682367000},"page":"e105765","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":0,"title":["Designing and delivering youth mental health services for young people, with young people: what works? A protocol for a realist eDelphi study on effective co-production"],"prefix":"10.1136","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9346-3084","authenticated-orcid":false,"given":"Verity Rose","family":"Jones","sequence":"first","affiliation":[{"name":"Social Policy, University of Birmingham College of Social Sciences, Birmingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Imaan","family":"Rathore","sequence":"additional","affiliation":[{"name":"Youth Advisory Group, University of Birmingham, Institute of Mental Health, Birmingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Justin","family":"Waring","sequence":"additional","affiliation":[{"name":"Social Sciences and Humanities, Loughborough University, Loughborough, England, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicola","family":"Wright","sequence":"additional","affiliation":[{"name":"School of Health Sciences, University of Nottingham, Nottingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9751-6262","authenticated-orcid":false,"given":"Sarah-Jane Hannah","family":"Fenton","sequence":"additional","affiliation":[{"name":"College of Social Sciences, University of Birmingham, Birmingham, West Midlands, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"239","published-online":{"date-parts":[[2026,5,13]]},"reference":[{"key":"2026051307252837000_16.5.e105765.1","unstructured":"Katterl S , Lambert C , MacBean C , et al . Not before time: state acknowledgement of harm. Wellways; 2023. Available: www.wellways.org\/wp-content\/uploads\/2024\/04\/NOT-BE1.pdf"},{"key":"2026051307252837000_16.5.e105765.2","unstructured":"United-Nations . Mental health and human rights. United Nations Office of the High Commissioner for Human Rights; 2023. Available: https:\/\/www.ohchr.org\/en\/health\/mental-health-and-human-rights"},{"key":"2026051307252837000_16.5.e105765.3","doi-asserted-by":"publisher","DOI":"10.1002\/wps.20938"},{"key":"2026051307252837000_16.5.e105765.4","unstructured":"Roper C , Grey F , Cadogan E . Coproduction: putting principles into practice. Lelan; 2018. Available: https:\/\/www.lelan.org.au\/project\/co-production-putting-principles-into-practice-in-mental-health-contexts"},{"key":"2026051307252837000_16.5.e105765.5","unstructured":"NDTi . Progressing transformative co-production in mental health. 2016. Available: https:\/\/www.ndti.org.uk\/resources\/coproduction-in-mental-health-toolkit"},{"key":"2026051307252837000_16.5.e105765.6","unstructured":"Slay J , Stephens L . Co-production in mental health: a literature review. New Economics Foundation; 2013. Available: https:\/\/neweconomics.org\/2013\/11\/co-production-mental-health"},{"key":"2026051307252837000_16.5.e105765.7","unstructured":"NICE . Transition between inpatient mental health settings and community or care home settings. NICE; 2016. Available: https:\/\/www.nice.org.uk\/guidance\/ng53"},{"key":"2026051307252837000_16.5.e105765.8","unstructured":"WHO . World mental health report. World Health Organisation; 2022. Available: https:\/\/www.who.int\/teams\/mental-health-and-substance-use\/world-mental-health-report"},{"key":"2026051307252837000_16.5.e105765.9","unstructured":"Think Local Act Personal . Ladder of coproduction. Social Care Institute for Excellence; 2021. Available: https:\/\/www.thinklocalactpersonal.org.uk\/Latest\/Co-production-The-ladder-of-co-production"},{"key":"2026051307252837000_16.5.e105765.10","unstructured":"Fenton S-J , Carr S , Boyden L , et al . Valuing youth involvement in mental health service design and delivery. In: Theodosiou L , Knightsmith P , Lavis P , et al ., eds. Children and young people\u2019s mental health. Shoreham by Sea: Pavilion, 2020: 163\u201378."},{"key":"2026051307252837000_16.5.e105765.11","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph18168831"},{"key":"2026051307252837000_16.5.e105765.12","doi-asserted-by":"crossref","DOI":"10.1002\/jcv2.12272","article-title":"A rapid realist review of literature examining Co-production in mental health services for youth","volume":"4","author":"Jones","year":"2024","journal-title":"JCPP Adv"},{"key":"2026051307252837000_16.5.e105765.13","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2017-018800","article-title":"User involvement in adolescents\u2019 mental healthcare: protocol for a systematic review","volume":"7","author":"Viksveen","year":"2017","journal-title":"BMJ Open"},{"key":"2026051307252837000_16.5.e105765.14","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1007\/s10488-022-01223-0","article-title":"Participation of Children and Youth in Mental Health Policymaking: A Scoping Review [Part I]","volume":"50","author":"Yamaguchi","year":"2023","journal-title":"Adm Policy Ment Health"},{"key":"2026051307252837000_16.5.e105765.15","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1111\/hex.13650","article-title":"Youth engagement in mental health research: A systematic review","volume":"26","author":"McCabe","year":"2023","journal-title":"Health Expect"},{"key":"2026051307252837000_16.5.e105765.16","doi-asserted-by":"publisher","DOI":"10.1177\/0004867415600891"},{"key":"2026051307252837000_16.5.e105765.17","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2648.2006.03716.x"},{"key":"2026051307252837000_16.5.e105765.18","doi-asserted-by":"crossref","unstructured":"Keeney S , Hasson F , McKenna H . The Delphi technique in nursing and health research. Hoboken, New Jersey: Wiley-Blackwell, 2010.","DOI":"10.1002\/9781444392029"},{"key":"2026051307252837000_16.5.e105765.19","unstructured":"NIHR . UK standards for public involvement. NIHR; 2019. Available: https:\/\/sites.google.com\/nihr.ac.uk\/pi-standards\/home"},{"key":"2026051307252837000_16.5.e105765.20","unstructured":"Pawson R , Tilley N . Realistic evaluation. London: SAGE publications, 1997."},{"key":"2026051307252837000_16.5.e105765.21","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-publhealth-031816-044451"},{"key":"2026051307252837000_16.5.e105765.22","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-022-08743-3"},{"key":"2026051307252837000_16.5.e105765.23","unstructured":"World Economic Forum . A global framework for youth mental health 2020. World Economic Forum; 2020. Available: https:\/\/www3.weforum.org\/docs\/WEF_Youth_Mental_Health_2020.pdf"},{"key":"2026051307252837000_16.5.e105765.24","doi-asserted-by":"crossref","DOI":"10.2196\/51530","article-title":"Evaluating the Problem of Fraudulent Participants in Health Care Research: Multimethod Pilot Study","volume":"8","author":"Kumarasamy","year":"2024","journal-title":"JMIR Form Res"},{"key":"2026051307252837000_16.5.e105765.25","unstructured":"Saunders M , Townsend K . Choosing participants. In: Cassell C , Cunliffe AL , Grandy G , eds. The SAGE handbook of qualitative business and management research methods. Thousand Oaks, California: SAGE Publications Ltd, 2018."},{"key":"2026051307252837000_16.5.e105765.26","unstructured":"French B , Rennick-Egglestone S , Babbage C , et al . Non-genuine participation in online research guidance on handling potential non-genuine participants in online research. Nottingham Uo; 2025. Available: https:\/\/nottingham-repository.worktribe.com\/output\/54253510\/non-genuine-participation-in-online-research-guidance-on-handling-potential-non-genuine-participants-in-online-research"},{"key":"2026051307252837000_16.5.e105765.27","doi-asserted-by":"crossref","first-page":"2841","DOI":"10.1007\/s11135-021-01252-1","article-title":"Ensuring survey research data integrity in the era of internet bots","volume":"56","author":"Griffin","year":"2022","journal-title":"Qual Quant"},{"key":"2026051307252837000_16.5.e105765.28","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s11135-024-01973-z","article-title":"Online surveys: lessons learned in detecting and protecting against insincerity and bots","volume":"59","author":"Thompson","year":"2025","journal-title":"Qual Quant"},{"key":"2026051307252837000_16.5.e105765.29","doi-asserted-by":"crossref","unstructured":"Fricker M . Epistemic injustice: power and the ethics of knowing. Oxford: Oxford University Press, 2007.","DOI":"10.1093\/acprof:oso\/9780198237907.001.0001"},{"key":"2026051307252837000_16.5.e105765.30","doi-asserted-by":"publisher","DOI":"10.1186\/1748-5908-8-103"},{"key":"2026051307252837000_16.5.e105765.31","doi-asserted-by":"crossref","unstructured":"Wong G , Westhorp G , Manzano A , et al . RAMESES II reporting standards for realist evaluations. BioMed Central Ltd, 2016.","DOI":"10.1186\/s12916-016-0643-1"},{"key":"2026051307252837000_16.5.e105765.32","doi-asserted-by":"publisher","DOI":"10.1186\/1741-7015-11-1"},{"key":"2026051307252837000_16.5.e105765.33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3390\/youth4010001","article-title":"A Protocol for a Rapid Realist Review of Literature Examining Co-Production in Youth Mental Health Services","volume":"4","author":"Jones","year":"2023","journal-title":"Youth"},{"key":"2026051307252837000_16.5.e105765.34","unstructured":"Qualtrics. Provo, Utah; 2024. Available: https:\/\/www.qualtrics.com"},{"key":"2026051307252837000_16.5.e105765.35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3310\/XQWU4117","article-title":"Early evaluation of the Children and Young People\u2019s Mental Health Trailblazer programme: a rapid mixed-methods study","volume":"11","author":"Ellins","year":"2023","journal-title":"Health Soc Care Deliv Res"},{"key":"2026051307252837000_16.5.e105765.36","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1027\/0227-5910\/a000938","article-title":"Involving Young People With Lived and Living Experience of Suicide in Suicide Research","volume":"45","author":"Webb","year":"2024","journal-title":"Crisis"},{"key":"2026051307252837000_16.5.e105765.37","unstructured":"Greenhalgh T , Pawson R , Wong G , et al . Realist interviewing. RAMESES II; 2017. Available: https:\/\/www.ramesesproject.org\/media\/RAMESES_II_Realist_interviewing.pdf"},{"key":"2026051307252837000_16.5.e105765.38","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0206584","article-title":"The #chatsafe project. Developing guidelines to help young people communicate safely about suicide on social media: A Delphi study","volume":"13","author":"Robinson","year":"2018","journal-title":"PLoS ONE"},{"key":"2026051307252837000_16.5.e105765.39","doi-asserted-by":"crossref","first-page":"854","DOI":"10.1177\/13623613231196805","article-title":"Understanding the post-diagnostic support priorities of autistic adults in the United Kingdom: A co-produced modified Delphi study","volume":"28","author":"Crowson","year":"2024","journal-title":"Autism"},{"key":"2026051307252837000_16.5.e105765.40","unstructured":"Pawson R , Greenhalgh T , Harvey G , et al . Realist synthesis: an introduction. In: Programme ERM. University Of Manchester, 2004."},{"key":"2026051307252837000_16.5.e105765.41","unstructured":"Searle J . The building blocks of social reality. In: Searle J , ed. The construction of social reality. London: Penguin, 1995: 1\u201329."},{"key":"2026051307252837000_16.5.e105765.42","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2018-024501","article-title":"The impact of general practitioners working in or alongside emergency departments: a rapid realist review","volume":"9","author":"Cooper","year":"2019","journal-title":"BMJ Open"},{"key":"2026051307252837000_16.5.e105765.43","unstructured":"Westhorp G . Realist impact evaluation: an introduction. ODI Global; 2014. Available: https:\/\/odi.org\/en\/publications\/realist-impact-evaluation-an-introduction\/"}],"container-title":["BMJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjopen-2025-105765","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T14:26:29Z","timestamp":1778682389000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopen.bmj.com\/lookup\/doi\/10.1136\/bmjopen-2025-105765"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5]]},"references-count":43,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,5,13]]},"published-print":{"date-parts":[[2026,5]]}},"alternative-id":["10.1136\/bmjopen-2025-105765"],"URL":"https:\/\/doi.org\/10.1136\/bmjopen-2025-105765","relation":{},"ISSN":["2044-6055","2044-6055"],"issn-type":[{"value":"2044-6055","type":"print"},{"value":"2044-6055","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5]]}}}