{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,14]],"date-time":"2025-12-14T20:01:17Z","timestamp":1765742477704,"version":"3.37.3"},"reference-count":20,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,6,21]],"date-time":"2021-06-21T00:00:00Z","timestamp":1624233600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,21]],"date-time":"2021-06-21T00:00:00Z","timestamp":1624233600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000272","name":"National Institute for Health Research","doi-asserted-by":"publisher","award":["DRF-2015-08-023"],"award-info":[{"award-number":["DRF-2015-08-023"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Trials"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Core outcome sets (COS) should be relevant to key stakeholders and widely applicable and usable. Ideally, they are developed for international use to allow optimal data synthesis from trials. Electronic Delphi surveys are commonly used to facilitate global participation; however, this has limitations. It is common for these surveys to be conducted in a single language potentially excluding those not fluent in that tongue. The aim of this study is to summarise current approaches for optimising international participation in Delphi studies and make recommendations for future practice.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A comprehensive literature review of current approaches to translating Delphi surveys for COS development was undertaken. A standardised methodology adapted from international guidance derived from 12 major sets of translation guidelines in the field of outcome reporting was developed. As a case study, this was applied to a COS project for surgical trials in gastric cancer to translate a Delphi survey into 7 target languages from regions active in gastric cancer research.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Three hundred thirty-two abstracts were screened and four studies addressing COS development in rheumatoid and osteoarthritis, vascular malformations and polypharmacy were eligible for inclusion. There was wide variation in methodological approaches to translation, including the number of forward translations, the inclusion of back translation, the employment of cognitive debriefing and how discrepancies and disagreements were handled. Important considerations were identified during the development of the gastric cancer survey including establishing translation groups, timelines, understanding financial implications, strategies to maximise recruitment and regulatory approvals. The methodological approach to translating the Delphi surveys was easily reproducible by local collaborators and resulted in an additional 637 participants to the 315 recruited to complete the source language survey. Ninety-nine per cent of patients and 97% of healthcare professionals from non-English-speaking regions used translated surveys.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Consideration of the issues described will improve planning by other COS developers and can be used to widen international participation from both patients and healthcare professionals.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s13063-021-05338-x","type":"journal-article","created":{"date-parts":[[2021,6,21]],"date-time":"2021-06-21T12:03:10Z","timestamp":1624276990000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Methods for conducting international Delphi surveys to optimise global participation in core outcome set development: a case study in gastric cancer informed by a comprehensive literature review"],"prefix":"10.1186","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5751-1846","authenticated-orcid":false,"given":"Bilal","family":"Alkhaffaf","sequence":"first","affiliation":[]},{"given":"Jane M.","family":"Blazeby","sequence":"additional","affiliation":[]},{"given":"Aleksandra","family":"Metryka","sequence":"additional","affiliation":[]},{"given":"Anne-Marie","family":"Glenny","sequence":"additional","affiliation":[]},{"given":"Ademola","family":"Adeyeye","sequence":"additional","affiliation":[]},{"given":"Paulo Matos","family":"Costa","sequence":"additional","affiliation":[]},{"given":"Ismael Diez","family":"del Val","sequence":"additional","affiliation":[]},{"given":"Suzanne S.","family":"Gisbertz","sequence":"additional","affiliation":[]},{"given":"Ali","family":"Guner","sequence":"additional","affiliation":[]},{"given":"Simon","family":"Law","sequence":"additional","affiliation":[]},{"given":"Hyuk-Joon","family":"Lee","sequence":"additional","affiliation":[]},{"given":"Ziyu","family":"Li","sequence":"additional","affiliation":[]},{"given":"Koji","family":"Nakada","sequence":"additional","affiliation":[]},{"given":"Rafael Mauricio Restrepo","family":"Nu\u00f1ez","sequence":"additional","affiliation":[]},{"given":"Daniel","family":"Reim","sequence":"additional","affiliation":[]},{"given":"John V.","family":"Reynolds","sequence":"additional","affiliation":[]},{"given":"Peter","family":"Vorwald","sequence":"additional","affiliation":[]},{"given":"Daniela","family":"Zanotti","sequence":"additional","affiliation":[]},{"given":"William","family":"Allum","sequence":"additional","affiliation":[]},{"given":"M. Asif","family":"Chaudry","sequence":"additional","affiliation":[]},{"given":"Ewen","family":"Griffiths","sequence":"additional","affiliation":[]},{"given":"Paula R.","family":"Williamson","sequence":"additional","affiliation":[]},{"given":"Iain A.","family":"Bruce","sequence":"additional","affiliation":[]},{"name":"on behalf of the GASTROS International Working Group","sequence":"additional","affiliation":[]},{"given":"Shuangxi","family":"Li","sequence":"additional","affiliation":[]},{"given":"Yu-long","family":"He","sequence":"additional","affiliation":[]},{"given":"Zekuan","family":"Xu","sequence":"additional","affiliation":[]},{"given":"Yingwei","family":"Xue","sequence":"additional","affiliation":[]},{"given":"Han","family":"Liang","sequence":"additional","affiliation":[]},{"given":"Guoxin","family":"Li","sequence":"additional","affiliation":[]},{"given":"Enhao","family":"Zhao","sequence":"additional","affiliation":[]},{"given":"Philipp","family":"Neumann","sequence":"additional","affiliation":[]},{"given":"Linda","family":"O\u2019Neill","sequence":"additional","affiliation":[]},{"given":"Emer","family":"Guinan","sequence":"additional","affiliation":[]},{"given":"Gian Luca","family":"Baiocchi","sequence":"additional","affiliation":[]},{"given":"Giovanni","family":"de Manzoni","sequence":"additional","affiliation":[]},{"given":"Eliza R. C.","family":"Hagens","sequence":"additional","affiliation":[]},{"given":"Mark I.","family":"van Berge Henegouwen","sequence":"additional","affiliation":[]},{"given":"Patr\u00edcia","family":"Lages","sequence":"additional","affiliation":[]},{"given":"Susana","family":"Onofre","sequence":"additional","affiliation":[]},{"given":"Gabriel Salcedo","family":"Caba\u00f1as","sequence":"additional","affiliation":[]},{"given":"Maria Posada","family":"Gonzalez","sequence":"additional","affiliation":[]},{"given":"Cristina Marin","family":"Campos","sequence":"additional","affiliation":[]},{"given":"Bahar","family":"Candas","sequence":"additional","affiliation":[]},{"given":"Bahad\u0131r Emre","family":"Baki","sequence":"additional","affiliation":[]},{"given":"Muhammed Selim","family":"Bodur","sequence":"additional","affiliation":[]},{"given":"Reyyan","family":"Yildirim","sequence":"additional","affiliation":[]},{"given":"Arif Burak","family":"Cekic","sequence":"additional","affiliation":[]},{"given":"Jean-Baptiste","family":"Beuscart","sequence":"additional","affiliation":[]},{"given":"Sophie","family":"Horbach","sequence":"additional","affiliation":[]},{"given":"Christopher","family":"Mecoli","sequence":"additional","affiliation":[]},{"given":"Toby O.","family":"Smith","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,6,21]]},"reference":[{"issue":"S3","key":"5338_CR1","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1186\/s13063-017-1978-4","volume":"18","author":"PR Williamson","year":"2017","unstructured":"Williamson PR, Altman DG, Bagley H, et al. The COMET handbook: version 1.0. Trials. 2017;18(S3):280. https:\/\/doi.org\/10.1186\/s13063-017-1978-4.","journal-title":"Trials"},{"issue":"12","key":"5338_CR2","doi-asserted-by":"publisher","first-page":"e0209869","DOI":"10.1371\/journal.pone.0209869","volume":"13","author":"E Gargon","year":"2018","unstructured":"Gargon E, Gorst SL, Harman NL, Smith V, Matvienko-Sikar K, Williamson PR. Choosing important health outcomes for comparative effectiveness research: 4th annual update to a systematic review of core outcome sets for research. Gillies K, ed. PLoS One. 2018;13(12):e0209869. https:\/\/doi.org\/10.1371\/journal.pone.0209869.","journal-title":"PLoS One"},{"issue":"10","key":"5338_CR3","doi-asserted-by":"publisher","first-page":"e021796","DOI":"10.1136\/BMJOPEN-2018-021796","volume":"8","author":"B Alkhaffaf","year":"2018","unstructured":"Alkhaffaf B, Blazeby JM, Williamson PR, Bruce IA, Glenny A-M. Reporting of outcomes in gastric cancer surgery trials: a systematic review. BMJ Open. 2018;8(10):e021796. https:\/\/doi.org\/10.1136\/BMJOPEN-2018-021796.","journal-title":"BMJ Open"},{"key":"5338_CR4","doi-asserted-by":"crossref","unstructured":"Wild D, Grove A, Martin M, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR Task Force for Translation and Cultural Adaptation background and rationale. Value Health. 2005;8(2):94-104.","DOI":"10.1111\/j.1524-4733.2005.04054.x"},{"issue":"1","key":"5338_CR5","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1186\/s13063-017-2100-7","volume":"18","author":"B Alkhaffaf","year":"2017","unstructured":"Alkhaffaf B, Glenny A-M, Blazeby JM, Williamson P, Bruce IA. Standardising the reporting of outcomes in gastric cancer surgery trials: protocol for the development of a core outcome set and accompanying outcome measurement instrument set (The GASTROS Study). Trials. 2017;18(1):370. https:\/\/doi.org\/10.1186\/s13063-017-2100-7.","journal-title":"Trials"},{"issue":"2","key":"5338_CR6","doi-asserted-by":"publisher","first-page":"e034782","DOI":"10.1136\/bmjopen-2019-034782","volume":"10","author":"B Alkhaffaf","year":"2020","unstructured":"Alkhaffaf B, Blazeby JM, Bruce IA, Morris RL. Patient priorities in relation to surgery for gastric cancer: qualitative interviews with gastric cancer surgery patients to inform the development of a core outcome set. BMJ Open. 2020;10(2):e034782. https:\/\/doi.org\/10.1136\/bmjopen-2019-034782.","journal-title":"BMJ Open"},{"key":"5338_CR7","unstructured":"Core Outcome Measures in Effectiveness Trials Initiative (COMET). COMET database. http:\/\/cometinitiative.org\/studies\/search. Accessed 8 Jan 2019."},{"key":"5338_CR8","unstructured":"Survey Research Center.\u00a0 Guidelines for Best Practice in Cross-Cultural Surveys. Ann Arbor, MI: Survey Research Center, Institute for Social Research, University of Michigan. 2010 Retrieved 17\/06\/2021 from\u00a0http:\/\/www.ccsg.isr.umich.edu\/."},{"issue":"8","key":"5338_CR9","doi-asserted-by":"publisher","first-page":"981","DOI":"10.3899\/JRHEUM.181194","volume":"46","author":"TO Smith","year":"2019","unstructured":"Smith TO, Hawker GA, Hunter DJ, et al. The OMERACT-OARSI core domain set for measurement in clinical trials of hip and\/or knee osteoarthritis. J Rheumatol. 2019;46(8):981\u20139. https:\/\/doi.org\/10.3899\/JRHEUM.181194.","journal-title":"J Rheumatol"},{"issue":"1","key":"5338_CR10","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/s12916-018-1007-9","volume":"16","author":"J-B Beuscart","year":"2018","unstructured":"Beuscart J-B, Knol W, Cullinan S, Schneider C, Dalleur O, Boland B, et al. International core outcome set for clinical trials of medication review in multi-morbid older patients with polypharmacy. BMC Med. 2018;16(1):21. https:\/\/doi.org\/10.1186\/s12916-018-1007-9.","journal-title":"BMC Med"},{"issue":"11","key":"5338_CR11","doi-asserted-by":"publisher","first-page":"1683","DOI":"10.3899\/jrheum.161252","volume":"44","author":"JK Park","year":"2017","unstructured":"Park JK, Mecoli CA, Alexanderson H, Regardt M, Christopher-Stine L, Casal-Dom\u00ednguez M, et al. Advancing the development of patient-reported outcomes for adult myositis at OMERACT 2016: an international Delphi study. J Rheumatol. 2017;44(11):1683\u20137. https:\/\/doi.org\/10.3899\/jrheum.161252.","journal-title":"J Rheumatol"},{"issue":"2","key":"5338_CR12","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1111\/bjd.16029","volume":"178","author":"SER Horbach","year":"2018","unstructured":"Horbach SER, van der Horst CMAM, Blei F, van der Vleuten CJM, Frieden IJ, Richter GT, et al. Development of an international core outcome set for peripheral vascular malformations: the OVAMA project. Br J Dermatol. 2018;178(2):473\u201381. https:\/\/doi.org\/10.1111\/bjd.16029.","journal-title":"Br J Dermatol."},{"key":"5338_CR13","unstructured":"OMERACT: Outcome Measures in Rheumatology. Handbook | OMERACT Handbook. https:\/\/omeracthandbook.org\/handbook. Accessed 5 Oct 2019."},{"key":"5338_CR14","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1016\/j.jclinepi.2017.12.020","volume":"96","author":"S Dodd","year":"2018","unstructured":"Dodd S, Clarke M, Becker L, Mavergames C, Fish R, Williamson PR. A taxonomy has been developed for outcomes in medical research to help improve knowledge discovery. J Clin Epidemiol. 2018;96:84\u201392. https:\/\/doi.org\/10.1016\/j.jclinepi.2017.12.020.","journal-title":"J Clin Epidemiol"},{"issue":"6","key":"5338_CR15","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1080\/14737167.2017.1384316","volume":"17","author":"D Kuli\u015b","year":"2017","unstructured":"Kuli\u015b D, Whittaker C, Greimel E, Bottomley A, Koller M. Reviewing back translation reports of questionnaires: the EORTC conceptual framework and experience. Expert Rev Pharmacoeconomics Outcomes Res. 2017;17(6):523\u201330. https:\/\/doi.org\/10.1080\/14737167.2017.1384316.","journal-title":"Expert Rev Pharmacoeconomics Outcomes Res"},{"issue":"1","key":"5338_CR16","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1007\/s10120-018-0839-5","volume":"22","author":"GL Baiocchi","year":"2019","unstructured":"Baiocchi GL, Giacopuzzi S, Marrelli D, Reim D, Piessen G, Matos da Costa P, et al. International consensus on a complications list after gastrectomy for cancer. Gastric Cancer. 2019;22(1):172\u201389. https:\/\/doi.org\/10.1007\/s10120-018-0839-5.","journal-title":"Gastric Cancer"},{"key":"5338_CR17","unstructured":"COMET Initiative - YouTube. https:\/\/www.youtube.com\/channel\/UCxkjZ-gL12_QXAzn8cO2nsg?&ab_channel=COMETInitiative. Accessed 7 Sept 2019."},{"issue":"12","key":"5338_CR18","doi-asserted-by":"publisher","first-page":"865","DOI":"10.1016\/S2468-1253(18)30264-4","volume":"3","author":"R Fish","year":"2018","unstructured":"Fish R, Sanders C, Adams R, Brewer J, Brookes ST, DeNardo J, et al. A core outcome set for clinical trials of chemoradiotherapy interventions for anal cancer (CORMAC): a patient and health-care professional consensus. Lancet Gastroenterol Hepatol. 2018;3(12):865\u201373. https:\/\/doi.org\/10.1016\/S2468-1253(18)30264-4.","journal-title":"Lancet Gastroenterol Hepatol"},{"key":"5338_CR19","unstructured":"What are the top 200 most spoken languages? | Ethnologue. https:\/\/www.ethnologue.com\/guides\/ethnologue200. Accessed 12 Oct 2019."},{"issue":"1","key":"5338_CR20","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1186\/s13012-018-0763-4","volume":"13","author":"Z Wang","year":"2018","unstructured":"Wang Z, Norris SL, Bero L. The advantages and limitations of guideline adaptation frameworks. Implement Sci. 2018;13(1):72. https:\/\/doi.org\/10.1186\/s13012-018-0763-4.","journal-title":"Implement Sci"}],"container-title":["Trials"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13063-021-05338-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13063-021-05338-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13063-021-05338-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,21]],"date-time":"2021-06-21T12:11:02Z","timestamp":1624277462000},"score":1,"resource":{"primary":{"URL":"https:\/\/trialsjournal.biomedcentral.com\/articles\/10.1186\/s13063-021-05338-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,21]]},"references-count":20,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["5338"],"URL":"https:\/\/doi.org\/10.1186\/s13063-021-05338-x","relation":{},"ISSN":["1745-6215"],"issn-type":[{"type":"electronic","value":"1745-6215"}],"subject":[],"published":{"date-parts":[[2021,6,21]]},"assertion":[{"value":"7 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 May 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 June 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study describes the methodology used to undertake a Delphi survey. The study was given ethical approval by the North West - Greater Manchester East Research Ethics Committee (18\/NW\/0347) and governance approvals by Manchester University Hospitals NHS Foundation Trust.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Paula Williamson is a member of the COMET Initiative Management Group.Paula Williamson developed the DelphiManager software described in this article.The remaining authors report no conflicts of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"410"}}