{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,30]],"date-time":"2026-10-30T04:02:36Z","timestamp":1793332956530,"version":"4.5.0"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T00:00:00Z","timestamp":1734739200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T00:00:00Z","timestamp":1734739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000272","name":"National Institute for Health and Care Research","doi-asserted-by":"publisher","award":["NIHR300051"],"award-info":[{"award-number":["NIHR300051"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"National Institute for Health and Care Research","doi-asserted-by":"publisher","award":["NIHR300051"],"award-info":[{"award-number":["NIHR300051"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The choice of a single primary outcome in randomised trials can be difficult, especially in mental health where interventions may be complex and target several outcomes simultaneously. We carried out a systematic review to assess the quality of the analysis and reporting of multiple outcomes in mental health RCTs, comparing approaches with current CONSORT and other regulatory guidance.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>The review included all late-stage mental health trials published between 1st January 2019 to 31st December 2020 in 9 leading medical and mental health journals. Pilot and feasibility trials, non-randomised trials, and early phase trials were excluded. The total number of primary, secondary and other outcomes was recorded, as was any strategy used to incorporate multiple primary outcomes in the primary analysis.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>There were 147 included mental health trials. Most trials (101\/147) followed CONSORT guidance by specifying a single primary outcome with other outcomes defined as secondary and analysed in separate statistical analyses, although a minority (10\/147) did not specify any outcomes as primary. Where multiple primary outcomes were specified (33\/147), most (26\/33) did not correct for multiplicity, contradicting regulatory guidance. The median number of clinical outcomes reported across studies was 8 (IQR 5\u201311 ).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Most trials are correctly following CONSORT guidance. However, there was little consideration given to multiplicity or correlation between outcomes even where multiple primary outcomes were stated. Trials should correct for multiplicity when multiple primary outcomes are specified or describe some other strategy to address the multiplicity. Overall, very few mental health trials are taking advantage of multiple outcome strategies in the primary analysis, especially more complex strategies such as multivariate modelling. More work is required to show these exist, aid interpretation, increase efficiency and are easily implemented.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Registration<\/jats:title>\n                <jats:p>Our systematic review protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) on 11th January 2023 (CRD42023382274).<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12874-024-02451-8","type":"journal-article","created":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T04:53:07Z","timestamp":1734756787000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["The analysis and reporting of multiple outcomes in mental health trials: a methodological systematic review"],"prefix":"10.1186","volume":"24","author":[{"given":"Dominic","family":"Stringer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mollie","family":"Payne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ben","family":"Carter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Emsley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,12,21]]},"reference":[{"key":"2451_CR1","doi-asserted-by":"publisher","unstructured":"Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332. https:\/\/doi.org\/10.1136\/bmj.c332","DOI":"10.1136\/bmj.c332"},{"key":"2451_CR2","doi-asserted-by":"publisher","unstructured":"Skivington K et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:n2061. https:\/\/doi.org\/10.1136\/bmj.n2061","DOI":"10.1136\/bmj.n2061"},{"key":"2451_CR3","doi-asserted-by":"publisher","unstructured":"Wykes T, et al. Cognitive remediation Works but how should we provide it? An adaptive randomized controlled trial of delivery methods using a patient nominated recovery outcome in first-episode participants. Schizophr Bull. 2023;49(3):614\u201325. https:\/\/doi.org\/10.1093\/schbul\/sbac214","DOI":"10.1093\/schbul\/sbac214"},{"key":"2451_CR4","doi-asserted-by":"publisher","unstructured":"Bowie CR, et al. Cognitive remediation for schizophrenia: an expert working group white paper on core techniques. Schizophr Res. 2020;215:49\u201353. https:\/\/doi.org\/10.1016\/j.schres.2019.10.047","DOI":"10.1016\/j.schres.2019.10.047"},{"key":"2451_CR5","unstructured":"B. Collins and others. Outcomes for mental health services: what really matters. King\u2019s Fund. 2019."},{"key":"2451_CR6","doi-asserted-by":"publisher","unstructured":"Williamson PR et al. The COMET handbook: version 1.0, Trials. 2017;18(3):280. https:\/\/doi.org\/10.1186\/s13063-017-1978-4","DOI":"10.1186\/s13063-017-1978-4"},{"key":"2451_CR7","doi-asserted-by":"publisher","unstructured":"Tyler KM, Normand S-LT, Horton NJ. The use and abuse of multiple outcomes in randomized controlled depression trials. Contemp Clin Trials. 2011;32(2):299\u2013304. https:\/\/doi.org\/10.1016\/j.cct.2010.12.007","DOI":"10.1016\/j.cct.2010.12.007"},{"issue":"29","key":"2451_CR8","doi-asserted-by":"publisher","first-page":"5172","DOI":"10.1002\/sim.5990","volume":"32","author":"A Dmitrienko","year":"2013","unstructured":"Dmitrienko A, D\u2019Agostino Sr R. Traditional multiplicity adjustment methods in clinical trials. Stat Med. 2013;32(29):5172\u2013218. https:\/\/doi.org\/10.1002\/sim.5990","journal-title":"Stat Med"},{"key":"2451_CR9","doi-asserted-by":"publisher","unstructured":"Butcher NJ et al. Guidelines for reporting outcomes in trial reports: the CONSORT-outcomes 2022 extension. JAMA. 2022;328(22):2252\u20132264. https:\/\/doi.org\/10.1001\/jama.2022.21022","DOI":"10.1001\/jama.2022.21022"},{"key":"2451_CR10","doi-asserted-by":"publisher","unstructured":"Vickerstaff V, Ambler G, King M, Nazareth I, Omar RZ. Are multiple primary outcomes analysed appropriately in randomised controlled trials? A review. Contemp. Clin. Trials. 2015;45:8\u201312. https:\/\/doi.org\/10.1016\/j.cct.2015.07.016","DOI":"10.1016\/j.cct.2015.07.016"},{"key":"2451_CR11","doi-asserted-by":"publisher","unstructured":"Pocock SJ, Gregson J, Collier TJ, Ferreira JP, Stone GW. The win ratio in cardiology trials: lessons learnt, new developments, and wise future use. Eur Heart J. 2024;ehae647. https:\/\/doi.org\/10.1093\/eurheartj\/ehae647","DOI":"10.1093\/eurheartj\/ehae647"},{"key":"2451_CR12","unstructured":"MHRA. Good clinical practice guide. 2012."},{"key":"2451_CR13","unstructured":"EMA. Multiplicity issues in clinical trials - Scientific guideline, European Medicines Agency. Accessed: Jan. 04, 2023. [Online]. Available: https:\/\/www.ema.europa.eu\/en\/multiplicity-issues-clinical-trials-scientific-guideline"},{"key":"2451_CR14","unstructured":"C. for D. E. and Research. Multiple endpoints in clinical trials guidance for industry, U.S. Food and Drug Administration. Accessed: Jan. 04, 2023. [Online]. Available: https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/multiple-endpoints-clinical-trials-guidance-industry"},{"key":"2451_CR15","doi-asserted-by":"publisher","unstructured":"Page MJ et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71, https:\/\/doi.org\/10.1136\/bmj.n71","DOI":"10.1136\/bmj.n71"},{"key":"2451_CR16","unstructured":"Miller RGJ. Simultaneous statistical inference. Springer Science & Business Media; 2012."},{"key":"2451_CR17","doi-asserted-by":"publisher","first-page":"626","DOI":"10.2307\/2283989","volume":"62","author":"Z \u0160id\u00e1k","year":"1967","unstructured":"\u0160id\u00e1k Z. Rectangular confidence regions for the means of multivariate normal distributions. J Am Stat Assoc. 1967;62:626\u201333. https:\/\/doi.org\/10.2307\/2283989","journal-title":"J Am Stat Assoc"},{"key":"2451_CR18","doi-asserted-by":"publisher","unstructured":"Hommel G. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika. 1988;75(2):383\u2013386. https:\/\/doi.org\/10.1093\/biomet\/75.2.383","DOI":"10.1093\/biomet\/75.2.383"},{"key":"2451_CR19","doi-asserted-by":"publisher","unstructured":"Sankoh AJ, Li H, D\u2019Agostino RB. Composite and multicomponent end points in clinical trials. Stat. Med. 2017;36(28):4437\u20134440. https:\/\/doi.org\/10.1002\/sim.7386","DOI":"10.1002\/sim.7386"},{"key":"2451_CR20","doi-asserted-by":"crossref","unstructured":"O\u2019Brien PC. Procedures for comparing samples with multiple endpoints. Biometrics. 1984;40(4):1079\u20131087.","DOI":"10.2307\/2531158"},{"issue":"10","key":"2451_CR21","doi-asserted-by":"publisher","first-page":"e108784","DOI":"10.1371\/journal.pone.0108784","volume":"9","author":"JM Lachin","year":"2014","unstructured":"Lachin JM. Applications of the Wei-Lachin multivariate one-sided test for multiple outcomes on possibly different scales. Plos one. 2014;9(10):e108784. https:\/\/doi.org\/10.1371\/journal.pone.0108784","journal-title":"Oct"},{"key":"2451_CR22","doi-asserted-by":"publisher","unstructured":"Pocock SJ, Ariti CA, Collier TJ, Wang D. The win ratio: a new approach to the analysis of composite endpoints in clinical trials based on clinical priorities. Eur Heart J. 2012;33(2):176\u201382. https:\/\/doi.org\/10.1093\/eurheartj\/ehr352","DOI":"10.1093\/eurheartj\/ehr352"},{"key":"2451_CR23","doi-asserted-by":"publisher","unstructured":"Goldstein H, Carpenter J, Kenward MG, Levin KA. Multilevel models with multivariate mixed response types. Stat. Model. 2009;9(3):173\u2013197. https:\/\/doi.org\/10.1177\/1471082X0800900301","DOI":"10.1177\/1471082X0800900301"},{"key":"2451_CR24","doi-asserted-by":"publisher","unstructured":"McCulloch C. Joint modelling of mixed outcome types using latent variables. Stat. Methods Med. Res. 2008;17(1):53\u201373. https:\/\/doi.org\/10.1177\/0962280207081240","DOI":"10.1177\/0962280207081240"},{"key":"2451_CR25","unstructured":"of the Commissioner O. Step 3: clinical research. FDA. 2019, Accessed: Mar. 01, 2023. [Online]. Available: https:\/\/www.fda.gov\/patients\/drug-development-process\/step-3-clinical-research"},{"key":"2451_CR26","doi-asserted-by":"publisher","unstructured":"Daly EJ et al. Efficacy of esketamine nasal spray plus oral antidepressant treatment for relapse prevention in patients with treatment-resistant depression: a randomized clinical trial. JAMA Psychiatry. 2019;76(9):893\u2013903. https:\/\/doi.org\/10.1001\/jamapsychiatry.2019.1189","DOI":"10.1001\/jamapsychiatry.2019.1189"},{"key":"2451_CR27","doi-asserted-by":"publisher","unstructured":"Haight BR, et al. Efficacy and safety of a monthly Buprenorphine depot injection for opioid use disorder: a multicentre, randomised, double-blind, placebo-controlled, phase 3 trial. Lancet. 2019;393(10173):778\u201390. https:\/\/doi.org\/10.1016\/S0140-6736(18)32259-1","DOI":"10.1016\/S0140-6736(18)32259-1"},{"key":"2451_CR28","doi-asserted-by":"crossref","unstructured":"Cui L, Hung HMJ, Wang S-J. Modification of sample size in group sequential clinical trials. Biometrics. 1999;55(3):853\u2013857.","DOI":"10.1111\/j.0006-341X.1999.00853.x"},{"key":"2451_CR29","doi-asserted-by":"publisher","unstructured":"Bakal JA, Westerhout CM, Armstrong PW. Impact of weighted composite compared to traditional composite endpoints for the design of randomized controlled trials. Stat. Methods Med. Res. 2015;24(6):980\u2013988. https:\/\/doi.org\/10.1177\/0962280211436004","DOI":"10.1177\/0962280211436004"},{"key":"2451_CR30","doi-asserted-by":"publisher","unstructured":"Li G, et al. An introduction to multiplicity issues in clinical trials: the what, why, when and how. Int J Epidemiol. 2016;46. https:\/\/doi.org\/10.1093\/ije\/dyw320","DOI":"10.1093\/ije\/dyw320"},{"key":"2451_CR31","doi-asserted-by":"publisher","unstructured":"Parker RA, Weir CJ. Multiple secondary outcome analyses: precise interpretation is important. Trials. 2022;23(1):27. https:\/\/doi.org\/10.1186\/s13063-021-05975-2","DOI":"10.1186\/s13063-021-05975-2"},{"key":"2451_CR32","doi-asserted-by":"publisher","unstructured":"Moher D et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. https:\/\/doi.org\/10.1136\/bmj.c869","DOI":"10.1136\/bmj.c869"},{"key":"2451_CR33","doi-asserted-by":"publisher","unstructured":"Khan MS, et al. Prevalence of multiplicity and appropriate adjustments among cardiovascular randomized clinical trials published in major medical journals. JAMA Netw Open. 2020;3(4):e203082. https:\/\/doi.org\/10.1001\/jamanetworkopen.2020.3082","DOI":"10.1001\/jamanetworkopen.2020.3082"},{"key":"2451_CR34","doi-asserted-by":"publisher","unstructured":"Pike K, Reeves BC, Rogers CA. Approaches to multiplicity in publicly funded pragmatic randomised controlled trials: a survey of clinical trials units and a rapid review of published trials. BMC Med. Res. Methodol. 2022;22(1):39. https:\/\/doi.org\/10.1186\/s12874-022-01525-9","DOI":"10.1186\/s12874-022-01525-9"},{"key":"2451_CR35","doi-asserted-by":"publisher","unstructured":"Freemantle N, Calvert M, Wood J, Eastaugh J, Griffin C. Composite outcomes in randomized trials greater precision but with greater uncertainty? JAMA. 2003;289(19):2554\u20132559. https:\/\/doi.org\/10.1001\/jama.289.19.2554","DOI":"10.1001\/jama.289.19.2554"},{"key":"2451_CR36","doi-asserted-by":"publisher","unstructured":"Mozetic de Barros V, Pacheco RL, Cabrera Martimbianco AL, Mozetic V, Junior SC, Riera R. Definition and reporting of composite outcomes are often inadequate in randomized clinical trials on pharmacological interventions for coronary artery disease. J Clin Epidemiol. 2024;165:111212. https:\/\/doi.org\/10.1016\/j.jclinepi.2023.11.002","DOI":"10.1016\/j.jclinepi.2023.11.002"},{"key":"2451_CR37","doi-asserted-by":"publisher","unstructured":"Baart SJ, et al. Joint modeling of longitudinal markers and time-to-event outcomes: an application and tutorial in patients after surgical repair of transposition of the great arteries. Circ Cardiovasc Qual Outcomes. 2021;14(11):e007593. https:\/\/doi.org\/10.1161\/CIRCOUTCOMES.120.007593","DOI":"10.1161\/CIRCOUTCOMES.120.007593"},{"key":"2451_CR38","doi-asserted-by":"publisher","unstructured":"Jones CW, Keil LG, Holland WC, Caughey MC, Platts-Mills TF. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015;13(1):282. https:\/\/doi.org\/10.1186\/s12916-015-0520-3","DOI":"10.1186\/s12916-015-0520-3"},{"key":"2451_CR39","doi-asserted-by":"publisher","unstructured":"Moher D, Schulz KF, Altman D, for the CONSORT Group. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA. 2001;285(15):1987\u20131991. https:\/\/doi.org\/10.1001\/jama.285.15.1987","DOI":"10.1001\/jama.285.15.1987"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-024-02451-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-024-02451-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-024-02451-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T05:13:13Z","timestamp":1734757993000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-024-02451-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,21]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2451"],"URL":"https:\/\/doi.org\/10.1186\/s12874-024-02451-8","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,21]]},"assertion":[{"value":"7 August 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 December 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"317"}}