{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T14:51:59Z","timestamp":1781880719782,"version":"3.54.5"},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,7,11]],"date-time":"2022-07-11T00:00:00Z","timestamp":1657497600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,11]],"date-time":"2022-07-11T00:00:00Z","timestamp":1657497600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Methods for developing national recommendations vary widely. The successful adoption of new guidance into routine practice is dependent on buy-in from the clinicians delivering day-to-day patient care and must be considerate of existing resource constraints, as well as being aspirational in its scope. This initiative aimed to produce guidelines for the management of head and neck squamous cell carcinoma of unknown primary (HNSCCUP) using a novel methodology to maximise the likelihood of national adoption.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A voluntary steering committee oversaw 3 phases of development: 1) clarification of topic areas, data collection and assimilation, including systematic reviews and a National Audit of Practice; 2) a National Consensus Day, presenting data from the above to generate candidate consensus statements for indicative voting by attendees; and 3) a National Delphi Exercise seeking agreement on the candidate consensus statements, including representatives from all 58 UK Head and Neck Multidisciplinary Teams (MDT). Methodology was published online in advance of the Consensus Day and Delphi exercise.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Four topic areas were identified to frame guideline development. The National Consensus Day was attended by 227 participants (54 in-person and 173 virtual). Results from 7 new systematic reviews were presented, alongside 7 expert stakeholder presentations and interim data from the National Audit and from relevant ongoing Clinical Trials. This resulted in the generation of 35 statements for indicative voting by attendees which, following steering committee ratification, led to 30 statements entering the National Delphi exercise.<\/jats:p>\n                <jats:p>After 3 rounds (with a further statement added after round 1), 27 statements had reached \u2018strong agreement\u2019 (<jats:italic>n<\/jats:italic>\u00a0=\u200925, 2, 0 for each round, respectively), a single statement achieved \u2018agreement\u2019 only (round 3), and \u2018no agreement\u2019 could be reached for 3 statements (response rate 98% for each round). Subsequently, 28 statements were adopted into the National MDT Guidelines for HNSCCUP.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The described methodology demonstrated an effective multi-phase strategy for the development of national practice recommendations. It may serve as a cost-effective model for future guideline development for controversial or rare conditions where there is a paucity of available evidence or where there is significant variability in management practices across a healthcare service.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12874-022-01667-w","type":"journal-article","created":{"date-parts":[[2022,7,11]],"date-time":"2022-07-11T16:07:57Z","timestamp":1657555677000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Methodology for the development of National Multidisciplinary Management Recommendations using a multi-stage meta-consensus initiative"],"prefix":"10.1186","volume":"22","author":[{"given":"John C.","family":"Hardman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kevin","family":"Harrington","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Roques","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sanjai","family":"Sood","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jemy","family":"Jose","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shane","family":"Lester","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Pracy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ricard","family":"Simo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Costa","family":"Repanos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frank","family":"Stafford","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chris","family":"Jennings","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stuart C.","family":"Winter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hugh","family":"Wheatly","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jarrod","family":"Homer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"B. Nirmal","family":"Kumar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vinidh","family":"Paleri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,7,11]]},"reference":[{"key":"1667_CR1","volume-title":"GRADE handbook [Internet]. Grading of Recommendations, Assessment, Development and Evaluation (GRADE) Working Group","author":"H Sch\u00fcnemann","year":"2013","unstructured":"Sch\u00fcnemann H, Bro\u017cek J, Guyatt G, Oxman A. GRADE handbook [Internet]. Grading of Recommendations, Assessment, Development and Evaluation (GRADE) Working Group; 2013 [cited 2021 Dec 20]. Available from: https:\/\/gdt.gradepro.org\/app\/handbook\/handbook.html"},{"key":"1667_CR2","volume-title":"Developing NICE guidelines: the manual","author":"National Institute for health and care excellence","year":"2020","unstructured":"National Institute for health and care excellence. Developing NICE guidelines: the manual: NICE; 2020. Available from: https:\/\/www.nice.org.uk\/process\/pmg20\/chapter\/the-validation-process-for-draft-guidelines-and-dealing-with-stakeholder-comments"},{"key":"1667_CR3","volume-title":"ESMO Standard Operating Procedures for Clinical Practice Guidelines (Version 1.0)","author":"European Society for Medical Oncology (ESMO)","year":"2021","unstructured":"European Society for Medical Oncology (ESMO). ESMO Standard Operating Procedures for Clinical Practice Guidelines (Version 1.0). 2021 [cited 2022 Jan 18]. Available from: https:\/\/www.esmo.org\/guidelines\/esmo-guidelines-methodology"},{"key":"1667_CR4","doi-asserted-by":"publisher","first-page":"S170","DOI":"10.1017\/S0022215116000591","volume":"130","author":"K Mackenzie","year":"2016","unstructured":"Mackenzie K, Watson M, Jankowska P, Bhide S, Simo R. Investigation and management of the unknown primary with metastatic neck disease: United Kingdom National Multidisciplinary Guidelines. J Laryngol Otol. 2016;130:S170\u20135.","journal-title":"J Laryngol Otol"},{"key":"1667_CR5","volume-title":"Cancer of the upper aerodigestive tract: assessment and management in people aged 16 and over. NICE guideline [NG36]","author":"National Institute for Health and Care Excellence","year":"2018","unstructured":"National Institute for Health and Care Excellence. Cancer of the upper aerodigestive tract: assessment and management in people aged 16 and over. NICE guideline [NG36]: NICE; 2018. [cited 2021 Aug 10]. Available from: https:\/\/www.nice.org.uk\/guidance\/ng36"},{"key":"1667_CR6","doi-asserted-by":"publisher","first-page":"2570","DOI":"10.1200\/JCO.20.00275","volume":"38","author":"E Maghami","year":"2020","unstructured":"Maghami E, Ismaila N, Alvarez A, Chernock R, Duvvuri U, Geiger J, et al. Diagnosis and Management of Squamous Cell Carcinoma of unknown primary in the head and neck: ASCO guideline. JCO. 2020;38:2570\u201396.","journal-title":"JCO."},{"key":"1667_CR7","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1111\/jop.13161","volume":"50","author":"A Schache","year":"2021","unstructured":"Schache A, Kerawala C, Ahmed O, Brennan PA, Cook F, Garrett M, et al. British Association of Head and Neck Oncologists (BAHNO) standards 2020. J Oral Pathol Med. 2021;50:262\u201373.","journal-title":"J Oral Pathol Med"},{"key":"1667_CR8","doi-asserted-by":"publisher","first-page":"1462","DOI":"10.1016\/j.annonc.2020.07.011","volume":"31","author":"J-P Machiels","year":"2020","unstructured":"Machiels J-P, Ren\u00e9 Leemans C, Golusinski W, Grau C, Licitra L, Gregoire V, et al. Squamous cell carcinoma of the oral cavity, larynx, oropharynx and hypopharynx: EHNS-ESMO-ESTRO clinical practice guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2020;31:1462\u201375.","journal-title":"Ann Oncol"},{"key":"1667_CR9","volume-title":"Head and Neck Cancer Guidelines (Version 1.2022)","author":"National Comprehensive Cancer Network","year":"2021","unstructured":"National Comprehensive Cancer Network. Head and Neck Cancer Guidelines (Version 1.2022). 2021 [cited 2022 Jan 6]. Available from: https:\/\/www.nccn.org\/professionals\/physician_gls\/pdf\/head-and-neck.pdf"},{"key":"1667_CR10","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.im.2003.11.002","volume":"42","author":"C Okoli","year":"2004","unstructured":"Okoli C, Pawlowski SD. The Delphi method as a research tool: an example, design considerations and applications. Inf Manag. 2004;42:15\u201329.","journal-title":"Inf Manag"},{"key":"1667_CR11","doi-asserted-by":"publisher","first-page":"e0251395","DOI":"10.1371\/journal.pone.0251395","volume":"16","author":"ME Smith","year":"2021","unstructured":"Smith ME, Hardman JC, Mehta N, Jones GH, Mandavia R, Anderson C, et al. Acute otitis externa: consensus definition, diagnostic criteria and core outcome set development. PLoS One. 2021;16:e0251395.","journal-title":"PLoS One"},{"key":"1667_CR12","doi-asserted-by":"publisher","first-page":"4373","DOI":"10.1007\/s00405-021-06957-5","volume":"278","author":"C Piazza","year":"2021","unstructured":"Piazza C, Paderno A, Sjogren EV, Bradley PJ, Eckel HE, M\u00e4kitie A, et al. Salvage carbon dioxide transoral laser microsurgery for laryngeal cancer after (chemo)radiotherapy: a European laryngological Society consensus statement. Eur Arch Otorhinolaryngol. 2021;278:4373\u201381.","journal-title":"Eur Arch Otorhinolaryngol"},{"key":"1667_CR13","unstructured":"Dalkey NC. The Delphi method: an experimental study of group opinion.\u00a0Santa Monica: RAND Corporation; https:\/\/www.rand.org\/pubs\/research_memoranda\/RM5888.html"},{"key":"1667_CR14","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1634\/theoncologist.2-3-142","volume":"2","author":"Briasoulis null, Pavlidis null.","year":"1997","unstructured":"Briasoulis null, Pavlidis null. Cancer of unknown primary origin. Oncologist. 1997;2:142\u201352.","journal-title":"Oncologist."},{"key":"1667_CR15","doi-asserted-by":"publisher","first-page":"4177","DOI":"10.1002\/cncr.33800","volume":"127","author":"JC Hardman","year":"2021","unstructured":"Hardman JC, Tikka T, Paleri V, ENT UK, BAHNO and INTEGRATE (the UK ENT trainee research network). Remote triage incorporating symptom-based risk stratification for suspected head and neck cancer referrals: a prospective population-based study. Cancer. 2021;127:4177\u201389.","journal-title":"Cancer."},{"key":"1667_CR16","unstructured":"Head and neck cancers incidence statistics. Cancer Research UK 2017 [cited 2021 Apr 6]. Available from: https:\/\/www.cancerresearchuk.org\/health-professional\/cancer-statistics\/statistics-by-cancer-type\/head-and-neck-cancers\/incidence"},{"key":"1667_CR17","doi-asserted-by":"publisher","first-page":"e012559","DOI":"10.1136\/bmjopen-2016-012559","volume":"6","author":"DW Hamilton","year":"2016","unstructured":"Hamilton DW, Heaven B, Thomson RG, Wilson JA, Exley C. Multidisciplinary team decision-making in cancer and the absent patient: a qualitative study. BMJ Open. 2016;6:e012559.","journal-title":"BMJ Open"},{"key":"1667_CR18","unstructured":"INTEGRATE (The UK ENT Trainee Research Network). National Audit of the Management of Head and Neck Squamous Cell Carcinoma of Unknown Primary . ENT UK HNSCCUP Multidisciplinary Consensus Day; 2021 Nov 15 [cited 2022 Feb 10]; SAGE, Gateshead, UK. Available from: entintegrate.co.uk\/hnsccup."},{"key":"1667_CR19","doi-asserted-by":"crossref","unstructured":"Foreword. J Laryngol Otol. 2016;130:S1\u20132.","DOI":"10.1017\/S0022215116001195"},{"key":"1667_CR20","unstructured":"National Comprehensive Cancer Network. Development and Update of Guidelines [Internet]. NCCN. Undated [cited 2022 Jan 18]. Available from: https:\/\/www.nccn.org\/guidelines\/guidelines-process\/development-and-update-of-guidelines"},{"key":"1667_CR21","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1007\/s00520-019-04877-z","volume":"28","author":"GC Brady","year":"2020","unstructured":"Brady GC, Goodrich J, Roe JWG. Using experience-based co-design to improve the pre-treatment care pathway for people diagnosed with head and neck cancer. Support Care Cancer. 2020;28:739\u201345.","journal-title":"Support Care Cancer"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-022-01667-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-022-01667-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-022-01667-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,11]],"date-time":"2022-07-11T16:08:46Z","timestamp":1657555726000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-022-01667-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,11]]},"references-count":21,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1667"],"URL":"https:\/\/doi.org\/10.1186\/s12874-022-01667-w","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,11]]},"assertion":[{"value":"29 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 June 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was conducted in accordance with the UK Policy Framework for Health and Social Care Research.The ENT UK H&N Society reviewed and approved the research protocol before the exercise started and provided oversight at every stage.Informed consented was obtained from all participants prior to each stage.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"189"}}