{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T08:38:13Z","timestamp":1782808693582,"version":"3.54.5"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"16","license":[{"start":{"date-parts":[[2022,2,7]],"date-time":"2022-02-07T00:00:00Z","timestamp":1644192000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,7]],"date-time":"2022-02-07T00:00:00Z","timestamp":1644192000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"publisher","award":["PJT-155970"],"award-info":[{"award-number":["PJT-155970"]}],"id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100023330","name":"Cochrane","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100023330","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J GEN INTERN MED"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Health research teams increasingly partner with stakeholders to produce research that is relevant, accessible, and widely used. Previous work has covered stakeholder group identification.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Objective<\/jats:title>\n                <jats:p>We aimed to develop factors for health research teams to consider during identification and invitation of individual representatives in a multi-stakeholder research partnership, with the aim of forming equitable and informed teams.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Design<\/jats:title>\n                <jats:p>Consensus development.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Participants<\/jats:title>\n                <jats:p>We involved 16 stakeholders from the international Multi-Stakeholder Engagement (MuSE) Consortium, including patients and the public, providers, payers of health services\/purchasers, policy makers, programme managers, peer review editors, and principal investigators.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Approach<\/jats:title>\n                <jats:p>We engaged stakeholders in factor development and as co-authors of this manuscript. Using a modified Delphi approach, we gathered stakeholder views concerning a preliminary list of 18 factors. Over two feedback rounds, using qualitative and quantitative analysis, we concentrated these into ten factors.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Key Results<\/jats:title>\n                <jats:p>We present seven highly desirable factors: \u2018expertise or experience\u2019, \u2018ability and willingness to represent the stakeholder group\u2019, \u2018inclusivity (equity, diversity and intersectionality)\u2019, \u2018communication skills\u2019, \u2018commitment and time capacity\u2019, \u2018financial and non-financial relationships and activities, and conflict of interest\u2019, \u2018training support and funding needs\u2019. Additionally, three factors are desirable: \u2018influence\u2019, \u2018research relevant values\u2019, \u2018previous stakeholder engagement\u2019.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>We present factors for research teams to consider during identification and invitation of individual representatives in a multi-stakeholder research partnership. Policy makers and guideline developers may benefit from considering the factors in stakeholder identification and invitation. Research funders may consider stipulating consideration of the factors in funding applications. We outline how these factors can be implemented and exemplify how their use has the potential to improve the quality and relevancy of health research.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11606-022-07411-w","type":"journal-article","created":{"date-parts":[[2022,2,7]],"date-time":"2022-02-07T19:03:51Z","timestamp":1644260631000},"page":"4047-4053","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Factors to Consider During Identification and Invitation of Individuals in a Multi-stakeholder Research Partnership"],"prefix":"10.1007","volume":"37","author":[{"given":"Roses","family":"Parker","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0969-602X","authenticated-orcid":false,"given":"Eve","family":"Tomlinson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas W.","family":"Concannon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elie","family":"Akl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Petkovic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vivian A.","family":"Welch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sally","family":"Crowe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marisha","family":"Palm","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ana","family":"Marusic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Comfort","family":"Ekanem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Imad Bou","family":"Akl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Saginur","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lorenzo","family":"Moja","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tanja","family":"Kuchenm\u00fcller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nevilene","family":"Slingers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ligia","family":"Teixeira","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Dormer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eddy","family":"Lang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thurayya","family":"Arayssi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Regina","family":"Greer-Smith","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asma Ben","family":"Brahem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"Avey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Tugwell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,2,7]]},"reference":[{"issue":"8","key":"7411_CR1","doi-asserted-by":"publisher","first-page":"985","DOI":"10.1007\/s11606-012-2037-1","volume":"27","author":"TW Concannon","year":"2012","unstructured":"Concannon TW, Meissner P, Grunbaum JA, McElwee N, Guise J-M, Santa J, et al. A new taxonomy for stakeholder engagement in patient-centered outcomes research. J Gen Intern Med. 2012;27(8):985\u201391.","journal-title":"J Gen Intern Med."},{"key":"7411_CR2","doi-asserted-by":"crossref","unstructured":"Heneghan C, Mahtani KR, Goldacre B, Godlee F, Macdonald H, Jarvies D. Evidence based medicine manifesto for better healthcare. British Medical Journal Publishing Group; 2017.","DOI":"10.1136\/bmj.j2973"},{"key":"7411_CR3","unstructured":"PCORI. The Value of Engagement [Internet]. The value of engagement. 2018 [cited 2021 Jun 28]. Available from: https:\/\/www.pcori.org\/engagement\/value-engagement"},{"issue":"7","key":"7411_CR4","doi-asserted-by":"publisher","first-page":"e017124","DOI":"10.1136\/bmjopen-2017-017124","volume":"8","author":"S Staniszewska","year":"2018","unstructured":"Staniszewska S, Denegri S, Matthews R, Minogue V. Reviewing progress in public involvement in NIHR research: developing and implementing a new vision for the future. BMJ Open. 2018;8(7):e017124.","journal-title":"BMJ Open."},{"issue":"3","key":"7411_CR5","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1177\/1524839906289376","volume":"7","author":"NB Wallerstein","year":"2006","unstructured":"Wallerstein NB, Duran B. Using community-based participatory research to address health disparities. Health Promot Pract. 2006;7(3):312\u201323.","journal-title":"Health Promot Pract."},{"issue":"4","key":"7411_CR6","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1111\/hex.12888","volume":"22","author":"T Greenhalgh","year":"2019","unstructured":"Greenhalgh T, Hinton L, Finlay T, Macfarlane A, Fahy N, Clyde B, et al. Frameworks for supporting patient and public involvement in research: Systematic review and co-design pilot. Health Expect. 2019;22(4):785\u2013801.","journal-title":"Health Expect."},{"issue":"3","key":"7411_CR7","doi-asserted-by":"publisher","first-page":"245","DOI":"10.2217\/cer-2016-0063","volume":"6","author":"LP Forsythe","year":"2017","unstructured":"Forsythe LP, Frank LB, Workman TA, Borsky A, Hilliard T, Harwell D, et al. Health researcher views on comparative effectiveness research and research engagement. J Comp Eff Res. 2017;6(3):245\u201356.","journal-title":"J Comp Eff Res."},{"key":"7411_CR8","unstructured":"PCORI. PCORI Engagement Rubric. PCORI (Patient-Centered Outcomes Research Institute) website [Internet]. 2014 Feb [cited 2021 Apr 23]. Available from: https:\/\/www.pcori.org\/sites\/default\/files\/Engagement-Rubric.pdf"},{"key":"7411_CR9","unstructured":"Cochrane. Cochrane Knowledge Translation Framework [Internet]. 2017 [cited 2021 Jan 8]. Available from: https:\/\/community.cochrane.org\/sites\/default\/files\/uploads\/Cochrane%20Knowledge%20Translation%20Framework%281%29.pdf"},{"issue":"2","key":"7411_CR10","doi-asserted-by":"publisher","first-page":"181","DOI":"10.2217\/cer.12.7","volume":"1","author":"PA Deverka","year":"2012","unstructured":"Deverka PA, Lavallee DC, Desai PJ, Esmail LC, Ramsey SD, Veenstra DL, et al. Stakeholder participation in comparative effectiveness research: defining a framework for effective engagement. J Comp Eff Res. 2012;1(2):181\u201394.","journal-title":"J Comp Eff Res."},{"issue":"3","key":"7411_CR11","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1007\/s11606-018-4738-6","volume":"34","author":"TW Concannon","year":"2019","unstructured":"Concannon TW, Grant S, Welch V, Petkovic J, Selby J, Crowe S, et al. Practical guidance for involving stakeholders in health research. J Gen Intern Med. 2019;34(3):458\u201363.","journal-title":"J Gen Intern Med."},{"key":"7411_CR12","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.jclinepi.2019.12.009","volume":"120","author":"R Fadlallah","year":"2020","unstructured":"Fadlallah R, El-Harakeh A, Bou-Karroum L, Lotfi T, El-Jardali F, Hishi L, et al. A common framework of steps and criteria for prioritizing topics for evidence syntheses: a systematic review. J Clin Epidemiol. 2020;120:67\u201385.","journal-title":"J Clin Epidemiol."},{"issue":"12","key":"7411_CR13","doi-asserted-by":"publisher","first-page":"1692","DOI":"10.1007\/s11606-014-2878-x","volume":"29","author":"TW Concannon","year":"2014","unstructured":"Concannon TW, Fuster M, Saunders T, Patel K, Wong JB, Leslie LK, et al. A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research. J Gen Intern Med. 2014;29(12):1692\u2013701.","journal-title":"J Gen Intern Med."},{"key":"7411_CR14","unstructured":"Esposito D, Heeringa J, Bradley K, Croake S, Kimmey L. PCORI dissemination and implementation framework. Wash DC Patient-Centered Outcomes Res Inst. 2015;"},{"key":"7411_CR15","doi-asserted-by":"publisher","first-page":"643","DOI":"10.2471\/BLT.05.026658","volume":"84","author":"P Tugwell","year":"2006","unstructured":"Tugwell P, Robinson V, Grimshaw J, Santesso N. Systematic reviews and knowledge translation. Bull World Health Organ. 2006;84:643\u201351.","journal-title":"Bull World Health Organ."},{"key":"7411_CR16","doi-asserted-by":"crossref","unstructured":"Edwards HA, Huang J, Jansky L, Mullins CD. What works when: mapping patient and stakeholder engagement methods along the ten-step continuum framework. J Comp Eff Res. 2021;(0).","DOI":"10.2217\/cer-2021-0043"},{"key":"7411_CR17","unstructured":"Federal Coordinating Council for Comparative Effectiveness Research. Report to the President and Congress [Internet]. Washington, DC: U.S.: Department of Health and Human Services; 2009. Available from: https:\/\/osp.od.nih.gov\/wp-content\/uploads\/FCCCER-Report-to-the-President-and-Congress-2009.pdf"},{"key":"7411_CR18","unstructured":"Institute of Medicine. Initial national priorities for comparative effectiveness research [Internet]. 2009 [cited 2021 Apr 12]. Available from: https:\/\/www.nap.edu\/catalog\/12648\/initial-national-priorities-for-comparative-effectiveness-research"},{"key":"7411_CR19","unstructured":"McClellan M, Benner J, Garber AM, Meltzer DO, Tunis SR, Pearson S. Comparative effectiveness research: will it bend the health care cost curve and improve quality. Implement Comp Eff Res Priorities Methods Impact. 2009;"},{"issue":"1","key":"7411_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12961-016-0107-2","volume":"14","author":"MO Kok","year":"2016","unstructured":"Kok MO, Gyapong JO, Wolffers I, Ofori-Adjei D, Ruitenberg J. Which health research gets used and why? An empirical analysis of 30 cases. Health Res Policy Syst. 2016;14(1):1\u201318.","journal-title":"Health Res Policy Syst."},{"issue":"1","key":"7411_CR21","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1007\/s11606-015-3450-z","volume":"31","author":"LP Forsythe","year":"2016","unstructured":"Forsythe LP, Ellis LE, Edmundson L, Sabharwal R, Rein A, Konopka K, et al. Patient and stakeholder engagement in the PCORI pilot projects: description and lessons learned. J Gen Intern Med. 2016;31(1):13\u201321.","journal-title":"J Gen Intern Med."},{"key":"7411_CR22","unstructured":"NICE. How NICE clinical guidelines are developed: an overview for stakeholders, the public and the NHS. Process and Methods Guides. Natl Inst Health Clin Excell Httppublications Nice Org Ukpmg6f. 2012;"},{"key":"7411_CR23","unstructured":"Chen Y, Yang K, Norris S. RIGHT Explanation and Elaboration: guidance for reporting practice guidelines. 2020-08-28]. http:\/\/right-statement. org\/uploads\/e1c3506a2062dd4ccc7f36c0. pdf. 2021."},{"key":"7411_CR24","unstructured":"G-I-N Public Working Group. Patient and public involvement in guidelines. URL Httpsgin Netdocument-Storeworking-Groups-Doc-Publictoolkittoolkit-2015 Accessed 2020-06-01. 2015;"},{"key":"7411_CR25","doi-asserted-by":"crossref","unstructured":"Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. bmj. 2017;358.","DOI":"10.1136\/bmj.j3453"},{"key":"7411_CR26","unstructured":"Tomlinson E, Parker R. Six-step stakeholder engagement framework. 2021 Jun;21."},{"key":"7411_CR27","doi-asserted-by":"crossref","unstructured":"Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess Winch Engl. 1998;2(3):i\u201388.","DOI":"10.3310\/hta2030"},{"issue":"3","key":"7411_CR28","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1287\/mnsc.9.3.458","volume":"9","author":"N Dalkey","year":"1963","unstructured":"Dalkey N, Helmer O. An experimental application of the Delphi method to the use of experts. Manag Sci. 1963;9(3):458\u201367.","journal-title":"Manag Sci."},{"key":"7411_CR29","unstructured":"Involve. Exploring the impact of public involvement on the quality of research: examples. Involve Eastleigh, UK; 2013."},{"issue":"2","key":"7411_CR30","doi-asserted-by":"publisher","first-page":"128","DOI":"10.7326\/M16-1565","volume":"166","author":"Y Chen","year":"2017","unstructured":"Chen Y, Yang K, Maru\u0161i\u0107 A, Qaseem A, Meerpohl JJ, Flottorp S, et al. A reporting tool for practice guidelines in health care: the RIGHT statement. Ann Intern Med. 2017;166(2):128\u201332.","journal-title":"Ann Intern Med."}],"container-title":["Journal of General Internal Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11606-022-07411-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11606-022-07411-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11606-022-07411-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,29]],"date-time":"2022-11-29T21:57:55Z","timestamp":1669759075000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11606-022-07411-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,7]]},"references-count":30,"journal-issue":{"issue":"16","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["7411"],"URL":"https:\/\/doi.org\/10.1007\/s11606-022-07411-w","relation":{},"ISSN":["0884-8734","1525-1497"],"issn-type":[{"value":"0884-8734","type":"print"},{"value":"1525-1497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,7]]},"assertion":[{"value":"24 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No ethics approval is required as all individuals contributing data to this project were actively involved in planning and conduct as part of the research team and as manuscript co-authors. This was confirmed by a university-based Director of Research Ethics and is in line with INVOLVE UK recommendations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"None exist: AM, ABB, CEE, EL, ET, EA, IB, JP, LD, LT, LM, MA, MP, MS, NS, PT, RGS, RP, SC, TK, TA.TC \u2014 recipient of grants or contracts from: Centers for Disease Control and Prevention\/NIOSH; National Institutes of Health\/NCATS;Patient-Centered Outcomes Research Institute; National Evaluation System for health Technology; Centers for Medicare and Medicaid Innovation. 100 shares of Moderna, Inc.VW \u2014 a co-principal investigator on the CIHR grant (PJT-155970) which is funding the Multi-Stakeholder Engagement (MuSE) ConsortiumET, RP \u2014 worked for Cochrane for the majority of project duration.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}]}}