{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T04:25:34Z","timestamp":1791260734379,"version":"4.1.0"},"reference-count":20,"publisher":"BMJ","issue":"3","license":[{"start":{"date-parts":[[2024,3,11]],"date-time":"2024-03-11T00:00:00Z","timestamp":1710115200000},"content-version":"unspecified","delay-in-days":10,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000272","name":"NIHR","doi-asserted-by":"crossref","award":["NIHR203568"],"award-info":[{"award-number":["NIHR203568"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open"],"accepted":{"date-parts":[[2024,1,30]]},"published-print":{"date-parts":[[2024,3]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Randomised controlled trials (RCTs) inform healthcare decisions. It is now apparent that some published RCTs contain false data and some appear to have been entirely fabricated. Systematic reviews are performed to identify and synthesise all RCTs that have been conducted on a given topic. While it is usual to assess methodological features of the RCTs in the process of undertaking a systematic review, it is not usual to consider whether the RCTs contain false data. Studies containing false data therefore go unnoticed and contribute to systematic review conclusions. The INveStigating ProblEmatic Clinical Trials in Systematic Reviews (INSPECT-SR) project will develop a tool to assess the trustworthiness of RCTs in systematic reviews of healthcare-related interventions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods and analysis<\/jats:title>\n                    <jats:p>The INSPECT-SR tool will be developed using expert consensus in combination with empirical evidence, over five stages: (1) a survey of experts to assemble a comprehensive list of checks for detecting problematic RCTs, (2) an evaluation of the feasibility and impact of applying the checks to systematic reviews, (3) a Delphi survey to determine which of the checks are supported by expert consensus, culminating in, (4) a consensus meeting to select checks to be included in a draft tool and to determine its format and (5) prospective testing of the draft tool in the production of new health systematic reviews, to allow refinement based on user feedback. We anticipate that the INSPECT-SR tool will help researchers to identify problematic studies and will help patients by protecting them from the influence of false data on their healthcare.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Ethics and dissemination<\/jats:title>\n                    <jats:p>The University of Manchester ethics decision tool was used, and this returned the result that ethical approval was not required for this project (30 September 2022), which incorporates secondary research and surveys of professionals about subjects relating to their expertise. Informed consent will be obtained from all survey participants. All results will be published as open-access articles. The final tool will be made freely available.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/bmjopen-2024-084164","type":"journal-article","created":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T02:40:28Z","timestamp":1710211228000},"page":"e084164","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":45,"title":["Protocol for the development of a tool (INSPECT-SR) to identify problematic randomised controlled trials in systematic reviews of health interventions"],"prefix":"10.1136","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3513-4677","authenticated-orcid":false,"given":"Jack","family":"Wilkinson","sequence":"first","affiliation":[{"name":"Centre for Biostatistics, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Calvin","family":"Heal","sequence":"additional","affiliation":[{"name":"Centre for Biostatistics, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George A","family":"Antoniou","sequence":"additional","affiliation":[{"name":"Manchester Vascular Centre, Manchester University NHS Foundation Trust, Manchester, UK"},{"name":"Division of Cardiovascular Sciences, School of Medical Sciences, Manchester Academic Health Science Centre, The University of Manchester Faculty of Biology Medicine and Health, Manchester, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ella","family":"Flemyng","sequence":"additional","affiliation":[{"name":"Evidence Production and Methods Directorate, Cochrane, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zarko","family":"Alfirevic","sequence":"additional","affiliation":[{"name":"Department of Women's and Children's Health, University of Liverpool, Liverpool, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4813-5628","authenticated-orcid":false,"given":"Alison","family":"Avenell","sequence":"additional","affiliation":[{"name":"Health Services Research Unit, University of Aberdeen, Aberdeen, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ginny","family":"Barbour","sequence":"additional","affiliation":[{"name":"Medical Journal of Australia, Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas J L","family":"Brown","sequence":"additional","affiliation":[{"name":"Department of Psychology, Linnaeus University, V\u00e4xj\u00f6, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Carlisle","sequence":"additional","affiliation":[{"name":"Anaesthesia and Critical Care, Torbay Hospital, Torquay, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2926-7257","authenticated-orcid":false,"given":"Mike","family":"Clarke","sequence":"additional","affiliation":[{"name":"Northern Ireland Methodology Hub, Queen's University Belfast, Belfast, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick","family":"Dicker","sequence":"additional","affiliation":[{"name":"Department of Epidemiology and Public Health, Royal College of Surgeons in Ireland, Dublin, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jo C","family":"Dumville","sequence":"additional","affiliation":[{"name":"Division of Nursing, Midwifery and Social Work, School of Health Sciences, The University of Manchester, Manchester, UK"},{"name":"NIHR Manchester Biomedical Research Centre, Manchester University NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7803-0096","authenticated-orcid":false,"given":"Andrew","family":"Grey","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of Auckland, Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steph","family":"Grohmann","sequence":"additional","affiliation":[{"name":"Evidence Production and Methods Directorate, Cochrane, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lyle","family":"Gurrin","sequence":"additional","affiliation":[{"name":"School of Population and Global Health, The University of Melbourne, Melbourne, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7026-144X","authenticated-orcid":false,"given":"Jill Alison","family":"Hayden","sequence":"additional","affiliation":[{"name":"Community Health & Epidemiology, Dalhousie University, Halifax, Nova Scotia, Canada"},{"name":"Department of Community Health & Epidemiology, Faculty of Medicine, Dalhousie University, Halifax, Nova Scotia, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Heathers","sequence":"additional","affiliation":[{"name":"SafeBeat Rx Inc, St Louis, Missouri, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2796-9220","authenticated-orcid":false,"given":"Kylie Elizabeth","family":"Hunter","sequence":"additional","affiliation":[{"name":"Evidence Integration, NHMRC Clinical Trials Centre, University of Sydney, Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Toby","family":"Lasserson","sequence":"additional","affiliation":[{"name":"Evidence Production and Methods Directorate, Cochrane, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Lam","sequence":"additional","affiliation":[{"name":"Independent Lay Member, Cheshire, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1694-1142","authenticated-orcid":false,"given":"Sarah","family":"Lensen","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynaecology, Royal Women\u2019s Hospital, University of Melbourne, Melbourne, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tianjing","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, University of Colorado, Denver, Colorado, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8980-0909","authenticated-orcid":false,"given":"Wentao","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, Monash University, Clayton, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth","family":"Loder","sequence":"additional","affiliation":[{"name":"BMJ Publishing, London, UK"},{"name":"Department of Neurology, Brigham and Women's Hospital, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Lundh","sequence":"additional","affiliation":[{"name":"Centre of Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark"},{"name":"Department of Respiratory Medicine and Infectious Diseases, Copenhagen University Hospital\u2014Bispebjerg and Frederiksberg, Kobenhavn, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gideon","family":"Meyerowitz-Katz","sequence":"additional","affiliation":[{"name":"School of Health and Society, University of Wollongong, Wollongong, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8337-550X","authenticated-orcid":false,"given":"Ben W","family":"Mol","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil E","family":"O'Connell","sequence":"additional","affiliation":[{"name":"Department of Clinical Science, Brunel University, Uxbridge, UK"},{"name":"Centre for Health and Wellbeing across the Lifecourse, Dept of Health Sciences, Brunel University, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8635-6953","authenticated-orcid":false,"given":"Lisa","family":"Parker","sequence":"additional","affiliation":[{"name":"School of Pharmacy, Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Barbara K","family":"Redman","sequence":"additional","affiliation":[{"name":"Division of Medical Ethics, New York University Grossman School of Medicine, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lene","family":"Seidler","sequence":"additional","affiliation":[{"name":"Evidence Integration, NHMRC Clinical Trials Centre, University of Sydney, Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyle A","family":"Sheldrick","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, University of New South Wales, Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1471-4237","authenticated-orcid":false,"given":"Emma","family":"Sydenham","sequence":"additional","affiliation":[{"name":"Cochrane Central Production Service, Cochrane, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Torgerson","sequence":"additional","affiliation":[{"name":"York Trials Unit, Dept of Health Sciences, University of York, York, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Madelon","family":"van Wely","sequence":"additional","affiliation":[{"name":"Cochrane Gynaecology and Fertility Satellite and Cochrane Sexually Transmitted Infection Group, Cochrane, Duivendrecht, The Netherlands"},{"name":"Reproduction and Development Research Institute, Amsterdam University Medical Center, Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6622-8134","authenticated-orcid":false,"given":"Rui","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1893-6651","authenticated-orcid":false,"given":"Lisa","family":"Bero","sequence":"additional","affiliation":[{"name":"Center for Bioethics and Humanities, University of Colorado\u2014Anschutz Medical Campus, Denver, Colorado, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2579-9325","authenticated-orcid":false,"given":"Jamie J","family":"Kirkham","sequence":"additional","affiliation":[{"name":"Centre for Biostatistics, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2024,3,11]]},"reference":[{"key":"2025121422090732000_14.3.e084164.1","doi-asserted-by":"publisher","DOI":"10.1097\/MJT.0000000000001402"},{"key":"2025121422090732000_14.3.e084164.2","doi-asserted-by":"crossref","DOI":"10.1093\/ofid\/ofab358","article-title":"Meta-analysis of randomized trials of ivermectin to treat SARS-Cov-2 infection","volume":"8","author":"Hill","year":"2021","journal-title":"Open Forum Infect Dis"},{"key":"2025121422090732000_14.3.e084164.3","doi-asserted-by":"crossref","first-page":"1853","DOI":"10.1038\/s41591-021-01535-y","article-title":"The lesson of Ivermectin: meta-analyses based on summary data alone are inherently unreliable","volume":"27","author":"Lawrence","year":"2021","journal-title":"Nat Med"},{"key":"2025121422090732000_14.3.e084164.4","unstructured":"Brown NJL . 2023. Available: http:\/\/steamtraen.blogspot.com\/2021\/07\/Some-problems-with-the-data-from-a-Covid-study.html"},{"key":"2025121422090732000_14.3.e084164.5","doi-asserted-by":"crossref","DOI":"10.1093\/ofid\/ofab645","article-title":"Ivermectin for COVID-19: addressing potential bias and medical fraud","volume":"9","author":"Hill","year":"2022","journal-title":"Open Forum Infect Dis"},{"key":"2025121422090732000_14.3.e084164.6","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.166.12.1256"},{"key":"2025121422090732000_14.3.e084164.7","doi-asserted-by":"crossref","DOI":"10.1001\/jamainternmed.2018.2853","article-title":"Revised meta-analysis of vitamin K and fractures","volume":"178","author":"Grey","year":"2018","journal-title":"JAMA Intern Med"},{"key":"2025121422090732000_14.3.e084164.8","doi-asserted-by":"crossref","first-page":"1745","DOI":"10.1111\/1471-0528.14267","article-title":"Does tranexamic acid prevent postpartum haemorrhage? A systematic review of randomised controlled trials","volume":"123","author":"Ker","year":"2016","journal-title":"BJOG"},{"key":"2025121422090732000_14.3.e084164.9","article-title":"Psychological therapies for the management of chronic pain (excluding headache) in adults","volume":"8","author":"Williams","year":"2020","journal-title":"Cochrane Database Syst Rev"},{"key":"2025121422090732000_14.3.e084164.10","unstructured":"Cochrane . Cochrane database of systematic reviews: editorial policies Cochrane library. 2021 Available: https:\/\/www.cochranelibrary.com\/cdsr\/editorial-policies"},{"key":"2025121422090732000_14.3.e084164.11","article-title":"When beauty is but skin deep: dealing with problematic studies in systematic reviews","volume":"6","author":"Boughton","year":"2021","journal-title":"Cochrane Database Syst Rev"},{"key":"2025121422090732000_14.3.e084164.12","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.d5928","article-title":"The Cochrane collaboration\u2019s tool for assessing risk of bias in randomised trials","volume":"343","author":"Higgins","year":"2011","journal-title":"BMJ"},{"key":"2025121422090732000_14.3.e084164.13","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.l4898","article-title":"Rob 2: a revised tool for assessing risk of bias in randomised trials","volume":"366","author":"Sterne","year":"2019","journal-title":"BMJ"},{"key":"2025121422090732000_14.3.e084164.14","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.39490.551019.BE"},{"key":"2025121422090732000_14.3.e084164.15","unstructured":"TACIT . Tool for addressing conflicts of interest in trials. 2023 Available: https:\/\/tacit.one\/"},{"key":"2025121422090732000_14.3.e084164.16","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2021.05.012"},{"key":"2025121422090732000_14.3.e084164.17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jclinepi.2022.07.006","article-title":"Experts identified warning signs of fraudulent research: a qualitative study to inform a screening tool","volume":"151","author":"Parker","year":"2022","journal-title":"J Clin Epidemiol"},{"key":"2025121422090732000_14.3.e084164.18","doi-asserted-by":"crossref","DOI":"10.1186\/s41073-023-00130-8","article-title":"Checklist to assess trustworthiness in randomised controlled trials (TRACT checklist): concept proposal and pilot","volume":"8","author":"Mol","year":"2023","journal-title":"Res Integr Peer Rev"},{"key":"2025121422090732000_14.3.e084164.19","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1002\/jrsm.1599","article-title":"Identifying and managing problematic trials: a research integrity assessment tool for randomized controlled trials in evidence synthesis","volume":"14","author":"Weibel","year":"2023","journal-title":"Res Synth Methods"},{"key":"2025121422090732000_14.3.e084164.20","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-019-03959-6"}],"container-title":["BMJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjopen-2024-084164","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T06:09:16Z","timestamp":1765778956000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopen.bmj.com\/lookup\/doi\/10.1136\/bmjopen-2024-084164"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3]]},"references-count":20,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3,11]]},"published-print":{"date-parts":[[2024,3]]}},"alternative-id":["10.1136\/bmjopen-2024-084164"],"URL":"https:\/\/doi.org\/10.1136\/bmjopen-2024-084164","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.09.21.23295626","asserted-by":"object"}]},"ISSN":["2044-6055","2044-6055"],"issn-type":[{"value":"2044-6055","type":"print"},{"value":"2044-6055","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3]]}}}