{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,6]],"date-time":"2026-09-06T23:15:55Z","timestamp":1788736555345,"version":"build-2803163510"},"reference-count":59,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T00:00:00Z","timestamp":1732492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T00:00:00Z","timestamp":1732492800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"crossref","award":["Project Grant"],"award-info":[{"award-number":["Project Grant"]}],"id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Medical Research Council","award":["MC_UU_00022\/2"],"award-info":[{"award-number":["MC_UU_00022\/2"]}]},{"name":"Scottish Government Chief Scientist Office","award":["SPHSU17"],"award-info":[{"award-number":["SPHSU17"]}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Campbell Systematic Reviews: Better Evidence for a Better World"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Health guideline developers engage with interested people and groups to ensure that guidelines and their recommendations are relevant and useful to those who will be affected by them. These \u2018interest-holders\u2019 include patients, payers\/purchasers of health services, payers of health research, peer review editors, product makers, programme managers, policymakers, providers, principal investigators, and the public. The Guidelines International Network (GIN) and McMaster University Guideline Development Checklist describes 146 steps of the guideline process organized into 18 topics. While one topic focuses on engagement, it does not describe how to engage with interest-holders. In addition, interest-holder input could be sought throughout the guideline development process. This scoping review is part of a series of four related reviews. The three other reviews address barriers and facilitators to engagement in guideline development, managing conflicts of interest in guideline development, and assessing the impact of interest-holder engagement on guideline development. The four reviews will inform the development of guidance for multi-interest-holder engagement in guideline development; the GIN-McMaster Guideline Development Checklist Extension for Engagement.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>The objective of this scoping review is to identify, describe, and summarise existing guidance and methods for multi-interest-holder engagement throughout the health guideline development process.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Search Methods<\/jats:title>\n                    <jats:p>We conducted one comprehensive search for studies of engagement in guidelines to meet the inclusion criteria of one or more of the four systematic reviews in this series. We searched MEDLINE (OVID), CINAHL (EBSCO), EMBASE (OVID), PsycInfo (OVID) and SCOPUS databases up to September 2022. We did not include limits for date, study design, or language. We searched websites of agencies and organizations that engage interest-holder groups, such as the Agency for Healthcare Research and Quality (AHRQ), CIHR Strategy for Patient-Oriented Research (SPOR), National Institute for Health and Care Research (NIHR) Be Part of Research, Guidelines International Network (G-I-N), the National Institute for Health and Care Excellence, and the PatientCentred Outcomes Research Institute (PCORI). We handsearched the websites of guideline producing agencies. We solicited additional grey literature from the members of the MuSE Consortium.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Selection Criteria<\/jats:title>\n                    <jats:p>Studies were included in this review if they reported on engagement of any of our identified groups, patients, payers\/funders of research, payers\/purchasers of health services, policymakers, programme managers, providers, principal investigators\/researchers, peer review editors, product makers in the development of a health guideline. Titles and abstracts of identified citations were screened independently, in duplicate. The full text of potentially relevant papers were screened for eligibility into one or more of the four reviews in the series. Screening was done independently, by two reviewers. The team held weekly meetings with all reviewers involved in screening to discuss and resolve conflicts.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Data Collection and Analysis<\/jats:title>\n                    <jats:p>Two reviewers extracted relevant data into a pilot-tested data extraction form using Excel. We used the GIN-McMaster guideline development checklist as a framework for extracting the available guidance for each of our identified interest-holder groups throughout the development process. We presented descriptive statistics of the number of papers reporting guidance for each groups across the steps of the guideline process. We synthesized the relevant text using a qualitative meta-summary approach.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Main Results<\/jats:title>\n                    <jats:p>We included 16 papers (from 17 reports). These papers were from Australia, Denmark, the Netherlands, the UK, and the USA, and eight papers were international (countries not specified). The papers provided guidance for at least one of our interest-holder groups for at least one stage of guideline development. We mapped this guidance to the GIN-McMaster Guideline Development Checklist to identify the available guidance for each of our interest-holder groups across all stages of the guideline development process. Guidance was available for patient engagement in 15 of the 16 papers. At least two papers provided guidance for each of the 18 topics of the GIN-McMaster Guideline Development Checklist. For healthcare providers, 9 papers provided guidance for their engagement across 10 of the 18 guideline development topics. Guidance for engaging with the public was provided for 14 of the 18 topics and reported in 4 of our included papers. For payers\/purchasers of health services, policymakers, product makers, programme managers, and principal investigators, 2\u20133 papers provided guidance for these groups across 4\u20137 topics of the GIN-McMaster checklist. We did not identify any specific guidance for payers of health research or for editors of peer-reviewed journals.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Authors' Conclusions<\/jats:title>\n                    <jats:p>Guidance for interst-holder engagement in guidelines is available but has focused primarily on patients. We will utilize the guidance identified in this scoping review to inform the GIN-McMaster Guideline Development Checklist Extension for engagement. Combined with the information obtained from the other systematic reviews in this series, we will address the gaps in guidance for the other identified interest-holder groups.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/cl2.70006","type":"journal-article","created":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T06:30:11Z","timestamp":1732516211000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":10,"title":["Guidance for engagement in health guideline development: A scoping review"],"prefix":"10.1177","volume":"20","author":[{"given":"Jennifer","family":"Petkovic","sequence":"first","affiliation":[{"name":"Bruy\u00e8re Research Institute, University of Ottawa, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alison","family":"Riddle","sequence":"additional","affiliation":[{"name":"School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Marmora, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lyubov","family":"Lytvyn","sequence":"additional","affiliation":[{"name":"Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joanne","family":"Khabsa","sequence":"additional","affiliation":[{"name":"American University of Beirut Medical Center, Clinical Research Institute, Beirut, Lebanon"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elie A.","family":"Akl","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, American University of Beirut Medical Center, Beirut, Lebanon"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5238-7097","authenticated-orcid":false,"given":"Vivian","family":"Welch","sequence":"additional","affiliation":[{"name":"Methods Centre, Bruy\u00e8re Research Institute, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0262-5621","authenticated-orcid":false,"given":"Olivia","family":"Magwood","sequence":"additional","affiliation":[{"name":"C.T. Lamont Primary Health Care Research Centre, Bruyere Research Institute, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pearl","family":"Atwere","sequence":"additional","affiliation":[{"name":"Bruyere Research Institute, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian D.","family":"Graham","sequence":"additional","affiliation":[{"name":"School of Epidemiology, Public Health and Preventative Medicine, University of Ottawa, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7775-3022","authenticated-orcid":false,"given":"Sean","family":"Grant","sequence":"additional","affiliation":[{"name":"HEDCO Institute for Evidence-Based Educational Practice, University of Oregon, Eugene, Oregon, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denny","family":"John","sequence":"additional","affiliation":[{"name":"Campbell Collaboration, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Srinivasa Vittal","family":"Katikireddi","sequence":"additional","affiliation":[{"name":"MRC\/CSO Social and Public Health Sciences Unit, University of Glasgow, Glasgow, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Etienne V.","family":"Langlois","sequence":"additional","affiliation":[{"name":"Alliance for Health Policy and Systems Research, World Health Organization, Geneva, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Reem A.","family":"Mustafa","sequence":"additional","affiliation":[{"name":"Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada"},{"name":"Department of Internal Medicine and Population Health, University of Kansas Medical Centre, Kansas City, Kansas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex","family":"Todhunter-Brown","sequence":"additional","affiliation":[{"name":"Nursing, Midwifery and Allied Health Professions, Research Unit, Glasgow Caledonian University, Glasgow, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Holger","family":"Sch\u00fcnemann","sequence":"additional","affiliation":[{"name":"Departments of Health Research Methods, Evidence, and Impact and of Medicine, McMaster University, Hamilton, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Airton T.","family":"Stein","sequence":"additional","affiliation":[{"name":"Department of Public Health, Universidade Federal de Ci\u00eancias da Sa\u00fade, Porto Alegre, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas W.","family":"Concannon","sequence":"additional","affiliation":[{"name":"The RAND Corporation, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Tugwell","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada"},{"name":"Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2024,11,25]]},"reference":[{"key":"e_1_3_8_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.colegn.2022.08.003"},{"key":"e_1_3_8_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/cesm.70007"},{"key":"e_1_3_8_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/1364557032000119616"},{"key":"e_1_3_8_5_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40900-017-0070-2"},{"key":"e_1_3_8_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/hex.13018"},{"key":"e_1_3_8_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/hex.12467"},{"key":"e_1_3_8_8_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-018-0745-6"},{"key":"e_1_3_8_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/hex.12467"},{"key":"e_1_3_8_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.euf.2021.09.018"},{"key":"e_1_3_8_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/hex.12067"},{"key":"e_1_3_8_12_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.j80"},{"key":"e_1_3_8_13_1","doi-asserted-by":"publisher","DOI":"10.1183\/20734735.009517"},{"key":"e_1_3_8_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-018-4738-6"},{"key":"e_1_3_8_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-012-2037-1"},{"key":"e_1_3_8_16_1","doi-asserted-by":"publisher","DOI":"10.18546\/RFA.01.1.11"},{"key":"e_1_3_8_17_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs.2010.049031"},{"key":"e_1_3_8_18_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb020847"},{"key":"e_1_3_8_19_1","doi-asserted-by":"publisher","DOI":"10.1186\/1748-5908-7-60"},{"key":"e_1_3_8_20_1","doi-asserted-by":"publisher","DOI":"10.1136\/archdischild-2017-312629"},{"key":"e_1_3_8_21_1","doi-asserted-by":"publisher","DOI":"10.2217\/cer.14.79"},{"key":"e_1_3_8_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-019-05436-2"},{"key":"e_1_3_8_23_1","doi-asserted-by":"publisher","DOI":"10.1186\/1478-4505-4-15"},{"key":"e_1_3_8_24_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-020-01509-0"},{"key":"e_1_3_8_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049732312448541"},{"key":"e_1_3_8_26_1","unstructured":"GIN. (2021). GIN public toolkit. Guidelines International Network. https:\/\/g-i-n.net\/wpcontent\/uploads\/2023\/07\/Toolkit-combined.pdf"},{"key":"e_1_3_8_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-020-06514-6"},{"key":"e_1_3_8_28_1","first-page":"924","article-title":"GRADE: An emerging consensus on rating quality of evidence and strength of recommendations","volume":"336","author":"Guyatt G. H.","year":"2008","unstructured":"Guyatt G. H., Oxman A. D., Vist G. E., Kunz R., Falck-Ytter Y., Alonso-Coello P., Sch\u00fcnemann H. J. (2008). GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ (London), 336, 924\u2013926.","journal-title":"BMJ (London)"},{"key":"e_1_3_8_29_1","doi-asserted-by":"publisher","DOI":"10.12688\/f1000research.15162.1"},{"key":"e_1_3_8_30_1","volume-title":"Clinical practice guidelines we can trust","author":"Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines","year":"2011","unstructured":"Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. (2011). Clinical practice guidelines we can trust. In Graham R., Mancher M., Wolman D. Miller, Greenfield S., Steinberg E. (Eds.). National Academies Press."},{"key":"e_1_3_8_31_1","doi-asserted-by":"publisher","DOI":"10.1513\/pats.201208-061ST"},{"key":"e_1_3_8_32_1","doi-asserted-by":"publisher","DOI":"10.1002\/cl2.1232"},{"key":"e_1_3_8_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40271-019-00389-4"},{"key":"e_1_3_8_34_1","doi-asserted-by":"publisher","DOI":"10.1513\/pats.201208-056ST"},{"key":"e_1_3_8_35_1","doi-asserted-by":"publisher","DOI":"10.1186\/1748-5908-3-54"},{"key":"e_1_3_8_36_1","doi-asserted-by":"publisher","DOI":"10.1186\/1748-5908-5-69"},{"key":"e_1_3_8_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eururo.2017.02.008"},{"key":"e_1_3_8_38_1","doi-asserted-by":"publisher","DOI":"10.1002\/cl2.1237"},{"key":"e_1_3_8_39_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-019-0956-5"},{"key":"e_1_3_8_40_1","doi-asserted-by":"publisher","DOI":"10.1186\/1478-4505-12-34"},{"key":"e_1_3_8_41_1","doi-asserted-by":"publisher","DOI":"10.21307\/eb-2018-002"},{"key":"e_1_3_8_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1369-7625.2007.00476.x"},{"key":"e_1_3_8_43_1","doi-asserted-by":"publisher","DOI":"10.1186\/1478-4505-4-20"},{"key":"e_1_3_8_44_1","doi-asserted-by":"publisher","DOI":"10.46658\/JBIMES-20-12"},{"key":"e_1_3_8_45_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-020-1272-5"},{"key":"e_1_3_8_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/cl2.1242"},{"key":"e_1_3_8_47_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-018-0852-0"},{"key":"e_1_3_8_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/1355819619841647"},{"key":"e_1_3_8_49_1","doi-asserted-by":"publisher","DOI":"10.1111\/jan.14743"},{"key":"e_1_3_8_50_1","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-156-7-201204030-00009"},{"key":"e_1_3_8_51_1","doi-asserted-by":"publisher","DOI":"10.7748\/ns.20.2.48.s57"},{"key":"e_1_3_8_52_1","doi-asserted-by":"crossref","unstructured":"Ribeiro D. M. Cardoso M. Silva F. Q. B. Franca C. (2014). Using qualitative metasummary to synthesize empirical findings in literature reviews. In: Proceedings from the 8th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement Torino Italy.","DOI":"10.1145\/2652524.2652562"},{"key":"e_1_3_8_53_1","doi-asserted-by":"publisher","DOI":"10.1002\/nur.20176"},{"key":"e_1_3_8_54_1","unstructured":"Schunemann H. Brozek J. Guyatt G. Oxman A. (2013). Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach. https:\/\/gdt.gradepro.org\/app\/handbook\/handbook.html#h.svwngs6pm0f2"},{"key":"e_1_3_8_55_1","doi-asserted-by":"publisher","DOI":"10.1186\/1478-4505-4-13"},{"key":"e_1_3_8_56_1","doi-asserted-by":"publisher","DOI":"10.1503\/cmaj.131237"},{"key":"e_1_3_8_57_1","doi-asserted-by":"publisher","DOI":"10.7326\/M18-0850"},{"key":"e_1_3_8_58_1","doi-asserted-by":"publisher","DOI":"10.2471\/BLT.05.026658"},{"key":"e_1_3_8_59_1","doi-asserted-by":"publisher","DOI":"10.1183\/20734735.012011"},{"key":"e_1_3_8_60_1","unstructured":"World Health Organization. (2003). Guidelines for WHO guidelines. Global Programme on Evidence for Health Policy WHO."}],"container-title":["Campbell Systematic Reviews: Better Evidence for a Better World"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1002\/cl2.70006","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1002\/cl2.70006","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1002\/cl2.70006","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,31]],"date-time":"2026-08-31T07:21:26Z","timestamp":1788160886000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1002\/cl2.70006"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,25]]},"references-count":59,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["10.1002\/cl2.70006"],"URL":"https:\/\/doi.org\/10.1002\/cl2.70006","relation":{"has-review":[{"id-type":"doi","id":"10.1002\/CL2.70006\/v1\/decision1","asserted-by":"object"}]},"ISSN":["1891-1803","1891-1803"],"issn-type":[{"value":"1891-1803","type":"print"},{"value":"1891-1803","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,25]]},"article-number":"cl2.70006"}}