{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T07:41:50Z","timestamp":1793173310441,"version":"4.5.0"},"reference-count":39,"publisher":"BMJ","issue":"6","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["Evid Based Med"],"published-print":{"date-parts":[[2016,12]]},"abstract":"<jats:p>Peer-reviewed publications and conference proceedings are the mainstay of data sources for systematic reviews and network meta-analyses (NMA), but access to informative unpublished data is now becoming commonplace. To explore the usefulness of three types of \u2018grey\u2019 literature-clinical trials registries, clinical study reports and data from regulatory authorities-we conducted four case studies. The reporting of outcome data in peer-reviewed publications, the clinical trials registries and the clinical study reports for two clinical trials\u2014one in melanoma, one in juvenile idiopathic arthritis (JIA)\u2014was examined. In addition, we assessed the value of including unpublished data from the European Medicines Agency (EMA) and US Food and Drug Administration (FDA) in evidence syntheses of hepatitis C virus (HCV) and chronic obstructive pulmonary disease (COPD), respectively. For the clinical trials in melanoma and JIA, we identified outcome parameters on ClinicalTrials.gov additional to those reported in the peer-reviewed publications: subgroup data and additional efficacy end points\/extended follow-up, respectively. The clinical study report also provided results for several subgroups unavailable elsewhere. For HCV and COPD, additional outcome data were obtained from the EMA European Public Assessment Report (EPAR) and the FDA, respectively, including data on subgroups and mortality. We conclude that data from these grey literature sources have the potential to influence results of systematic reviews and NMAs, and may thus have implications for healthcare decisions. However, it is important to consider carefully the availability, reliability and consequent usability of these data sources in systematic reviews and NMAs.<\/jats:p>","DOI":"10.1136\/ebmed-2016-110494","type":"journal-article","created":{"date-parts":[[2016,9,29]],"date-time":"2016-09-29T22:38:37Z","timestamp":1475188717000},"page":"208-213","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":18,"title":["Value and usability of unpublished data sources for systematic reviews and network meta-analyses"],"prefix":"10.1136","volume":"21","clinical-trial-number":[{"clinical-trial-number":"nct01245062","registry":"10.18810\/clinical-trials-gov"},{"clinical-trial-number":"nct00988221","registry":"10.18810\/clinical-trials-gov"},{"clinical-trial-number":"nct01245062","registry":"10.18810\/clinical-trials-gov"},{"clinical-trial-number":"nct00988221","registry":"10.18810\/clinical-trials-gov"}],"author":[{"given":"Nicholas James Anthony","family":"Halfpenny","sequence":"first","affiliation":[{"name":"Department of Health Economics & Epidemiology, ICON plc, Abingdon, Oxon, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joan Mary","family":"Quigley","sequence":"additional","affiliation":[{"name":"Department of Health Economics & Epidemiology, ICON plc, Abingdon, Oxon, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juliette Catherine","family":"Thompson","sequence":"additional","affiliation":[{"name":"Department of Health Economics & Epidemiology, ICON plc, Abingdon, Oxon, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David Alexander","family":"Scott","sequence":"additional","affiliation":[{"name":"Department of Health Economics & Epidemiology, ICON plc, Abingdon, Oxon, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2016,9,29]]},"reference":[{"key":"2025082623075053000_21.6.208.1","unstructured":"Higgins J , Green S . Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. 3\/2011 2011. http:\/\/www.cochrane-handbook.org"},{"key":"2025082623075053000_21.6.208.2","unstructured":"Centre for Reviews and Dissemination. Systematic Reviews: CRD's guidance for undertaking reviews in health care. Centre for Reviews and Dissemination, 2009."},{"key":"2025082623075053000_21.6.208.3","doi-asserted-by":"crossref","first-page":"161","DOI":"10.36076\/ppj.2008\/11\/161","article-title":"Evidence-based medicine, systematic reviews, and guidelines in interventional pain management, part I: introduction and general considerations","volume":"11","author":"Manchikanti","year":"2008","journal-title":"Pain Physician"},{"key":"2025082623075053000_21.6.208.4","unstructured":"Schlosser R . The role of systematic reviews in evidence-based practice, research, and development. National Centre for the Dissemination of Disability Research (NCDDR), 2008."},{"key":"2025082623075053000_21.6.208.5","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2014.06.001"},{"key":"2025082623075053000_21.6.208.6","doi-asserted-by":"crossref","first-page":"A612","DOI":"10.1016\/j.jval.2013.08.1763","article-title":"Confronting heterogeneity: using systematic review effectively for meta-analysis","volume":"16","author":"Quigley","year":"2013","journal-title":"Value Health"},{"key":"2025082623075053000_21.6.208.7","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X9801800110"},{"key":"2025082623075053000_21.6.208.8","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.331.7521.897"},{"key":"2025082623075053000_21.6.208.9","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1106"},{"key":"2025082623075053000_21.6.208.10","doi-asserted-by":"crossref","unstructured":"Hopewell S , McDonald S , Clarke M , et al . Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev 2007;(2):MR000010. doi:10.1002\/14651858.MR000010.pub3","DOI":"10.1002\/14651858.MR000010.pub2"},{"key":"2025082623075053000_21.6.208.11","unstructured":"EMA. Posting of clinical trial summary results in European Clinical Trials Database (EudraCT) to become mandatory for sponsors as of 21 July 2014. 2014. http:\/\/www.ema.europa.eu\/ema\/index.jsp?curl=pages\/news_and_events\/news\/2014\/06\/news_detail_002127.jsp&mid=WC0b01ac058004d5c1"},{"key":"2025082623075053000_21.6.208.12","unstructured":"EMA Committee for medicinal products for human use (CHMP). Time allowed for applicants to respond to questions and issues raised during the assessment of new marketing authorisation applications in the centralised procedure. 2009 (EMEA\/75401\/2006 Rev. 2). http:\/\/www.ema.europa.eu\/docs\/en_GB\/document_library\/Regulatory_and_procedural_guideline\/2009\/10\/WC500005056.pdf (accessed 16 Sept 2016)."},{"key":"2025082623075053000_21.6.208.13","unstructured":"FDA. Suggested format for developing and responding to deficiencies in accordance with the least burdensome provisions of FDAMA; final guidance for industry and FDA staff. 2000. http:\/\/www.fda.gov\/downloads\/MedicalDevices\/DeviceRegulationandGuidance\/GuidanceDocuments\/ucm073680.pdf (accessed 16 Sept 2016)."},{"key":"2025082623075053000_21.6.208.14","unstructured":"Bryden P , Quigley J , Padhiar A , et al . The relative efficacy and safety of simeprevir-based triple therapy compared to boceprevir and telaprevir in treatment-na\u00efve patients chronically infected with hepatitis C virus genotype 1: Bayesian network meta-analyses. Liver Meeting; 2013."},{"key":"2025082623075053000_21.6.208.15","doi-asserted-by":"publisher","DOI":"10.1136\/thoraxjnl-2012-201926"},{"key":"2025082623075053000_21.6.208.16","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1203421"},{"key":"2025082623075053000_21.6.208.17","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mdt580"},{"key":"2025082623075053000_21.6.208.18","unstructured":"GlaxoSmithKline. A Phase III randomized, open-label study comparing GSK1120212 to chemotherapy in subjects with advanced or metastatic BRAF V600E\/K mutation-positive melanoma. November 2014. http:\/\/www.gsk-clinicalstudyregister.com\/study\/114267?csrf_token=1455140350.58%23%23b84b9535ceb8c286571a3fbc99a10841244f5697&search_terms=trametinib&titles=&study_ids=&study_type=&document_type=&recruitment=&conditions=melanoma&compounds=&lead=&collaborators=&gender=&patient_level_data=&age_from=&age_from_type=&age_to=&age_to_type=&first_receive_from=&first_receive_to=&last_updated_from=&last_updated_to=&country=&state=&search=Search#csr"},{"key":"2025082623075053000_21.6.208.19","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-10-54"},{"key":"2025082623075053000_21.6.208.20","doi-asserted-by":"publisher","DOI":"10.1136\/annrheumdis-2014-205351"},{"key":"2025082623075053000_21.6.208.21","doi-asserted-by":"publisher","DOI":"10.1002\/sim.5688"},{"key":"2025082623075053000_21.6.208.22","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1010494"},{"key":"2025082623075053000_21.6.208.23","doi-asserted-by":"publisher","DOI":"10.1186\/s12890-015-0138-4"},{"key":"2025082623075053000_21.6.208.24","doi-asserted-by":"crossref","first-page":"771","DOI":"10.2147\/COPD.S3935","article-title":"Tiotropium and exercise training in COPD patients: effects on dyspnea and exercise tolerance","volume":"3","author":"Ambrosino","year":"2008","journal-title":"Int J Chron Obstruct Pulmon Dis"},{"key":"2025082623075053000_21.6.208.25","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa0805800"},{"key":"2025082623075053000_21.6.208.26","doi-asserted-by":"publisher","DOI":"10.1183\/09031936.02.00269802"},{"key":"2025082623075053000_21.6.208.27","doi-asserted-by":"publisher","DOI":"10.1136\/thorax.58.5.399"},{"key":"2025082623075053000_21.6.208.28","unstructured":"FDA. Highlights of prescribing information. KEYTRUDA. 2014. http:\/\/www.accessdata.fda.gov\/drugsatfda_docs\/label\/2014\/125514lbl.pdf"},{"key":"2025082623075053000_21.6.208.29","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2014.06.019"},{"key":"2025082623075053000_21.6.208.30","unstructured":"FDA. FDA Transparency Initiative. 2014. http:\/\/www.fda.gov\/AboutFDA\/Transparency\/TransparencyInitiative\/"},{"key":"2025082623075053000_21.6.208.31","unstructured":"EMA. European Medicines Agency policy on publication of clinical data for medicinal products for human use. 2014."},{"key":"2025082623075053000_21.6.208.32","doi-asserted-by":"publisher","DOI":"10.1016\/S0895-4356(02)00520-6"},{"key":"2025082623075053000_21.6.208.33","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.d7202"},{"key":"2025082623075053000_21.6.208.34","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2013.05.006"},{"key":"2025082623075053000_21.6.208.35","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.g4145"},{"key":"2025082623075053000_21.6.208.36","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/0197-2456(92)90201-A","article-title":"Suspended judgment. Editorial peer review: let us put it on trial","volume":"13","author":"Rennie","year":"1992","journal-title":"Control Clin Trials"},{"key":"2025082623075053000_21.6.208.37","doi-asserted-by":"publisher","DOI":"10.1016\/0895-4356(92)90085-2"},{"key":"2025082623075053000_21.6.208.38","doi-asserted-by":"crossref","unstructured":"Rothstein HR , Sutton AJ , Borenstein M . Publication bias in meta-analysis. Prevention, assessment and adjustments. Wiley, 2005.","DOI":"10.1002\/0470870168"},{"key":"2025082623075053000_21.6.208.39","unstructured":"Norris SL , Holmer HK , Ogden LA , et al . Selective outcome reporting as a source of bias in reviews of comparative effectiveness. Rockville, MD: Agency for Healthcare Research and Quality, 2012."}],"container-title":["Evidence Based Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/ebmed-2016-110494","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,27]],"date-time":"2025-08-27T06:08:03Z","timestamp":1756274883000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebm.bmj.com\/lookup\/doi\/10.1136\/ebmed-2016-110494"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,9,29]]},"references-count":39,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2016,11,23]]},"published-print":{"date-parts":[[2016,12]]}},"alternative-id":["10.1136\/ebmed-2016-110494"],"URL":"https:\/\/doi.org\/10.1136\/ebmed-2016-110494","relation":{},"ISSN":["1356-5524","1473-6810"],"issn-type":[{"value":"1356-5524","type":"print"},{"value":"1473-6810","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,9,29]]}}}