{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T01:39:31Z","timestamp":1792978771074,"version":"4.5.0"},"reference-count":19,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,8,5]],"date-time":"2019-08-05T00:00:00Z","timestamp":1564963200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,8,5]],"date-time":"2019-08-05T00:00:00Z","timestamp":1564963200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"published-print":{"date-parts":[[2019,12]]},"DOI":"10.1186\/s12874-019-0804-y","type":"journal-article","created":{"date-parts":[[2019,8,5]],"date-time":"2019-08-05T15:02:53Z","timestamp":1565017373000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["Risk of bias judgments for random sequence generation in Cochrane systematic reviews were\u00a0frequently not in line with Cochrane Handbook"],"prefix":"10.1186","volume":"19","author":[{"given":"Ognjen","family":"Barcot","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matija","family":"Boric","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tina","family":"Poklepovic Pericic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marija","family":"Cavar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Svjetlana","family":"Dosenovic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ivana","family":"Vuka","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8467-6061","authenticated-orcid":false,"given":"Livia","family":"Puljak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,8,5]]},"reference":[{"key":"804_CR1","unstructured":"OCEBM Levels of Evidence Working Group. The Oxford 2011 levels of evidence. Oxford Centre for Evidence-Based Medicine. Available at: \n                    http:\/\/www.cebm.net\/index.aspx?o=5653\n                    \n                  . Accessed 20 July 2019."},{"key":"804_CR2","doi-asserted-by":"publisher","first-page":"e1002028","DOI":"10.1371\/journal.pmed.1002028","volume":"13","author":"MJ Page","year":"2016","unstructured":"Page MJ, Shamseer L, Altman DG, Tetzlaff J, Sampson M, Tricco AC, Catala-Lopez F, Li L, Reid EK, Sarkis-Onofre R, Moher D. Epidemiology and reporting characteristics of systematic reviews of biomedical research: a cross-sectional study. PLoS Med. 2016;13:e1002028.","journal-title":"PLoS Med"},{"key":"804_CR3","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1093\/aje\/kwj069","volume":"163","author":"LL Gluud","year":"2006","unstructured":"Gluud LL. Bias in clinical intervention research. Am J Epidemiol. 2006;163:493\u2013501.","journal-title":"Am J Epidemiol"},{"key":"804_CR4","doi-asserted-by":"publisher","first-page":"d5928","DOI":"10.1136\/bmj.d5928","volume":"343","author":"JP Higgins","year":"2011","unstructured":"Higgins JP, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.","journal-title":"BMJ"},{"key":"804_CR5","doi-asserted-by":"publisher","first-page":"j2490","DOI":"10.1136\/bmj.j2490","volume":"357","author":"A Dechartres","year":"2017","unstructured":"Dechartres A, Trinquart L, Atal I, Moher D, Dickersin K, Boutron I, Perrodeau E, Altman DG, Ravaud P. Evolution of poor reporting and inadequate methods over time in 20 920 randomised controlled trials included in Cochrane reviews: research on research study. BMJ. 2017;357:j2490.","journal-title":"BMJ"},{"key":"804_CR6","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.jclinepi.2018.10.002","volume":"106","author":"I Propadalo","year":"2019","unstructured":"Propadalo I, Tranfic M, Vuka I, Barcot O, Pericic TP, Puljak L. In Cochrane reviews, risk of bias assessments for allocation concealment were frequently not in line with Cochrane's handbook guidance. J Clin Epidemiol. 2019;106:10\u20137.","journal-title":"J Clin Epidemiol"},{"key":"804_CR7","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1016\/j.jclinepi.2019.05.012","volume":"113","author":"O Barcot","year":"2019","unstructured":"Barcot O, Boric M, Dosenovic S, Pericic TP, Cavar M, Puljak L. Risk of bias assessments for blinding of participants and personnel in Cochrane reviews were frequently inadequate. J Clin Epidemiol. 2019;113:104\u201313.","journal-title":"J Clin Epidemiol"},{"key":"804_CR8","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1186\/s12874-019-0717-9","volume":"19","author":"A Babic","year":"2019","unstructured":"Babic A, Tokalic R, Amilcar Silva Cunha J, Novak I, Suto J, Vidak M, Miosic I, Vuka I, Poklepovic Pericic T, Puljak L. Assessments of attrition bias in Cochrane systematic reviews are highly inconsistent and thus hindering trial comparability. BMC Med Res Methodol. 2019;19:76.","journal-title":"BMC Med Res Methodol"},{"key":"804_CR9","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/j.jclinepi.2019.04.007","volume":"112","author":"F Saric","year":"2019","unstructured":"Saric F, Barcot O, Puljak L. Risk of bias assessments for selective reporting were inadequate in the majority of Cochrane reviews. J Clin Epidemiol. 2019;112:53\u20138.","journal-title":"J Clin Epidemiol"},{"key":"804_CR10","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1186\/s12874-019-0718-8","volume":"19","author":"A Babic","year":"2019","unstructured":"Babic A, Pijuk A, Brazdilova L, Georgieva Y, Raposo Pereira MA, Poklepovic Pericic T, Puljak L. The judgement of biases included in the category \"other bias\" in Cochrane systematic reviews of interventions: a systematic survey. BMC Med Res Methodol. 2019;19:77.","journal-title":"BMC Med Res Methodol"},{"key":"804_CR11","unstructured":"Higgins JPT, Green Se. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration. Available from \n                    https:\/\/training.cochrane.org\/handbook\n                    \n                  . Accessed 20 July 2019."},{"key":"804_CR12","unstructured":"Higgins JPT, Sterne JAC, Savovi\u0107 J, Page MJ, Hrobjartsson A, Boutron I, Reeves B, Eldridge S. A revised tool for assessing risk of bias in randomized trials In: Chandler J, McKenzie J, Boutron I, Welch V (editors). Cochrane Methods. Cochrane Database of Systematic Reviews 2016, Issue 10 (Suppl 1). \n                    dx.doi.org\/10.1002\/14651858.CD201601\n                    \n                  ."},{"key":"804_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3310\/hta16350","volume":"16","author":"J Savovic","year":"2012","unstructured":"Savovic J, Jones H, Altman D, Harris R, Juni P, Pildal J, Als-Nielsen B, Balk E, Gluud C, Gluud L, et al. Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies. Health Technol Assess. 2012;16:1\u201382.","journal-title":"Health Technol Assess"},{"key":"804_CR14","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1186\/s13063-015-0920-x","volume":"16","author":"BC Kahan","year":"2015","unstructured":"Kahan BC, Rehal S, Cro S. Risk of selection bias in randomised trials. Trials. 2015;16:405.","journal-title":"Trials"},{"key":"804_CR15","doi-asserted-by":"publisher","first-page":"973","DOI":"10.1016\/j.jclinepi.2012.07.005","volume":"66","author":"L Hartling","year":"2013","unstructured":"Hartling L, Hamm MP, Milne A, Vandermeer B, Santaguida PL, Ansari M, Tsertsvadze A, Hempel S, Shekelle P, Dryden DM. Testing the risk of Bias tool showed low reliability between individual reviewers and across consensus assessments of reviewer pairs. J Clin Epidemiol. 2013;66:973\u201381.","journal-title":"J Clin Epidemiol"},{"key":"804_CR16","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.jclinepi.2012.08.003","volume":"66","author":"BR da Costa","year":"2013","unstructured":"da Costa BR, Hilfiker R, Egger M. PEDro's bias: summary quality scores should not be used in meta-analysis. J Clin Epidemiol. 2013;66:75\u20137.","journal-title":"J Clin Epidemiol"},{"key":"804_CR17","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1186\/s13643-017-0441-7","volume":"6","author":"BR da Costa","year":"2017","unstructured":"da Costa BR, Beckett B, Diaz A, Resta NM, Johnston BC, Egger M, Juni P, Armijo-Olivo S. Effect of standardized training on the reliability of the Cochrane risk of bias assessment tool: a prospective study. Syst Rev. 2017;6:44.","journal-title":"Syst Rev"},{"key":"804_CR18","doi-asserted-by":"publisher","first-page":"265","DOI":"10.3389\/fpsyt.2017.00265","volume":"8","author":"PMM Okuda","year":"2017","unstructured":"Okuda PMM, Klaiman C, Bradshaw J, Reid M, Cogo-Moreira H. Assessing risk of Bias in randomized controlled trials for autism Spectrum disorder. Front Psychiatry. 2017;8:265.","journal-title":"Front Psychiatry"},{"issue":"1","key":"804_CR19","doi-asserted-by":"publisher","first-page":"e1586","DOI":"10.1002\/mpr.1586","volume":"27","author":"Ra\u00edssa Rodrigues-Tartari","year":"2017","unstructured":"Rodrigues-Tartari R, Swardfager W, Salum GA, Rohde LA, Cogo-Moreira H. Assessing risk of bias in randomized controlled trials of methylphenidate for children and adolescents with attention deficit hyperactivity disorder (ADHD). Int J Methods Psychiatr Res. 2018;27.","journal-title":"International Journal of Methods in Psychiatric Research"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-019-0804-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12874-019-0804-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-019-0804-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T23:11:05Z","timestamp":1596496265000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-019-0804-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,5]]},"references-count":19,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["804"],"URL":"https:\/\/doi.org\/10.1186\/s12874-019-0804-y","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,5]]},"assertion":[{"value":"23 May 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 July 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 August 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This study involved only analysis of data from published scientific literature; we did not collect any primary data.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Livia Puljak is Section Editor of BMC Medical Research Methodology; however, she was not involved in any way in handling and decision-making regarding this manuscript. Other authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"170"}}