{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T23:01:02Z","timestamp":1780786862753,"version":"3.54.1"},"reference-count":34,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T00:00:00Z","timestamp":1677196800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100006400","name":"Alnylam Pharmaceuticals, Inc","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006400","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100004325","name":"AstraZeneca","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004325","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,4,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Observational studies can impact patient care but must be robust and reproducible. Nonreproducibility is primarily caused by unclear reporting of design choices and analytic procedures. This study aimed to: (1) assess how the study logic described in an observational study could be interpreted by independent researchers and (2) quantify the impact of interpretations\u2019 variability on patient characteristics.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Nine teams of highly qualified researchers reproduced a cohort from a study by Albogami et al. The teams were provided the clinical codes and access to the tools to create cohort definitions such that the only variable part was their logic choices. We executed teams\u2019 cohort definitions against the database and compared the number of subjects, patient overlap, and patient characteristics.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>On average, the teams\u2019 interpretations fully aligned with the master implementation in 4 out of 10 inclusion criteria with at least 4 deviations per team. Cohorts\u2019 size varied from one-third of the master cohort size to 10 times the cohort size (2159\u201363\u00a0619 subjects compared to 6196 subjects). Median agreement was 9.4% (interquartile range 15.3\u201316.2%). The teams\u2019 cohorts significantly differed from the master implementation by at least 2 baseline characteristics, and most of the teams differed by at least 5.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Independent research teams attempting to reproduce the study based on its free-text description alone produce different implementations that vary in the population size and composition. Sharing analytical code supported by a common data model and open-source tools allows reproducing a study unambiguously thereby preserving initial design choices.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad009","type":"journal-article","created":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T15:09:59Z","timestamp":1677251399000},"page":"859-868","source":"Crossref","is-referenced-by-count":14,"title":["Reproducible variability: assessing investigator discordance across 9 research teams attempting to reproduce the same observational study"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0847-6682","authenticated-orcid":false,"given":"Anna","family":"Ostropolets","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yasser","family":"Albogami","sequence":"additional","affiliation":[{"name":"Department of Clinical Pharmacy, College of Pharmacy, King Saud University , Riyadh, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mitchell","family":"Conover","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan M","family":"Banda","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Georgia State University , Atlanta, Georgia, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"suffix":"Jr","given":"William A","family":"Baumgartner","sequence":"additional","affiliation":[{"name":"Division of General Internal Medicine, Department of Medicine, University of Colorado Anschutz Medical Campus , Aurora, Colorado, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2570-2124","authenticated-orcid":false,"given":"Clair","family":"Blacketer","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Priyamvada","family":"Desai","sequence":"additional","affiliation":[{"name":"Research IT, Technology and Digital Solutions, Stanford Medicine , Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Scott L","family":"DuVall","sequence":"additional","affiliation":[{"name":"VA Salt Lake City Health Care System , Salt Lake City, Utah, USA"},{"name":"Department of Internal Medicine, University of Utah School of Medicine , Salt Lake City, Utah, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen","family":"Fortin","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James P","family":"Gilbert","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asieh","family":"Golozar","sequence":"additional","affiliation":[{"name":"Odysseus Data Services , New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joshua","family":"Ide","sequence":"additional","affiliation":[{"name":"Johnson & Johnson , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew S","family":"Kanter","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David M","family":"Kern","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1802-1777","authenticated-orcid":false,"given":"Chungsoo","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences, Ajou University Graduate School of Medicine , Suwon, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lana Y H","family":"Lai","sequence":"additional","affiliation":[{"name":"Department of Informatics, Imaging & Data Sciences, University of Manchester , Manchester, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7434-6571","authenticated-orcid":false,"given":"Chenyu","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Pittsburgh , Pittsburgh, Pennsylvania, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feifan","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School , Worcester, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristine E","family":"Lynch","sequence":"additional","affiliation":[{"name":"VA Salt Lake City Health Care System , Salt Lake City, Utah, USA"},{"name":"Department of Internal Medicine, University of Utah School of Medicine , Salt Lake City, Utah, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Evan","family":"Minty","sequence":"additional","affiliation":[{"name":"O\u2019Brien Institute for Public Health, Faculty of Medicine, University of Calgary , Calgary, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria In\u00eas","family":"Neves","sequence":"additional","affiliation":[{"name":"Real World Solutions, IQVIA , Durham, North Carolina, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ding Quan","family":"Ng","sequence":"additional","affiliation":[{"name":"Department of Pharmaceutical Sciences, School of Pharmacy & Pharmaceutical Sciences, University of California , Irvine, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tontel","family":"Obene","sequence":"additional","affiliation":[{"name":"Mississippi Urban Research Center, Jackson State University , Jackson, Mississippi, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victor","family":"Pera","sequence":"additional","affiliation":[{"name":"Department of Medical Informatics, Erasmus University Medical Center , Rotterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicole","family":"Pratt","sequence":"additional","affiliation":[{"name":"Quality Use of Medicines and Pharmacy Research Centre, University of South Australia , Adelaide, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gowtham","family":"Rao","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7218-2558","authenticated-orcid":false,"given":"Nadav","family":"Rappoport","sequence":"additional","affiliation":[{"name":"Department of Software and Information Systems Engineering, Ben-Gurion University of the Negev , Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ines","family":"Reinecke","sequence":"additional","affiliation":[{"name":"Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universit\u00e4t Dresden , Dresden, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paola","family":"Saroufim","sequence":"additional","affiliation":[{"name":"Cleveland Institute for Computational Biology, Case Western Reserve University , Cleveland, Ohio, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Azza","family":"Shoaibi","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katherine","family":"Simon","sequence":"additional","affiliation":[{"name":"VA Tennessee Valley Health Care System, Vanderbilt University Medical Center , Nashville, Tennessee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc A","family":"Suchard","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of California , Los Angeles, California, USA"},{"name":"Department of Human Genetics, University of California , Los Angeles, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9491-2737","authenticated-orcid":false,"given":"Joel N","family":"Swerdel","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erica A","family":"Voss","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Weaver","sequence":"additional","affiliation":[{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4356-4645","authenticated-orcid":false,"given":"Linying","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George","family":"Hripcsak","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, New York, USA"},{"name":"Medical Informatics Services, New York-Presbyterian Hospital , New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick B","family":"Ryan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, New York, USA"},{"name":"Observational Health Data Analytics, Janssen Research & Development , Titusville, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,2,24]]},"reference":[{"issue":"10","key":"2023041909005277100_ocad009-B1","doi-asserted-by":"crossref","first-page":"1818","DOI":"10.1377\/hlthaff.2010.0666","article-title":"Why observational studies should be among the tools used in comparative effectiveness research","volume":"29","author":"Dreyer","year":"2010","journal-title":"Health Aff (Millwood)"},{"key":"2023041909005277100_ocad009-B2","doi-asserted-by":"crossref","first-page":"441","DOI":"10.2217\/cer.12.47","article-title":"A tall order on a tight timeframe: stakeholder perspectives on comparative effectiveness research using electronic clinical data","volume":"1","author":"Holve","year":"2012","journal-title":"J Comp Eff Res"},{"issue":"1","key":"2023041909005277100_ocad009-B3","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/MCSE.2020.3048406","article-title":"Trustworthy computational evidence through transparency and reproducibility","volume":"23","author":"Barba","year":"2021","journal-title":"Comput Sci Eng"},{"key":"2023041909005277100_ocad009-B4","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1002\/cpt.329","article-title":"Transparency and reproducibility of observational cohort studies using large healthcare databases.: transparency and reproducibility in healthcare databases","volume":"99","author":"Wang","year":"2016","journal-title":"Clin Pharmacol Ther"},{"issue":"8","key":"2023041909005277100_ocad009-B5","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1093\/jamia\/ocy028","article-title":"Does health informatics have a replication crisis?","volume":"25","author":"Coiera","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2023041909005277100_ocad009-B6","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1146\/annurev-psych-020821-114157","article-title":"Replicability, robustness, and reproducibility in psychological science","volume":"73","author":"Nosek","year":"2022","journal-title":"Annu Rev Psychol"},{"issue":"1","key":"2023041909005277100_ocad009-B7","doi-asserted-by":"crossref","first-page":"201494","DOI":"10.1098\/rsos.201494","article-title":"Analytic reproducibility in articles receiving open data badges at the journal Psychological Science: an observational study","volume":"8","author":"Hardwicke","year":"2021","journal-title":"R Soc Open Sci"},{"key":"2023041909005277100_ocad009-B8","doi-asserted-by":"crossref","first-page":"e71601","DOI":"10.7554\/eLife.71601","article-title":"Investigating the replicability of preclinical cancer biology","volume":"10","author":"Errington","year":"2021","journal-title":"ELife"},{"key":"2023041909005277100_ocad009-B9","doi-asserted-by":"crossref","first-page":"aac4716","DOI":"10.1126\/science.aac4716","article-title":"Estimating the reproducibility of psychological science","volume":"349","author":"Open Science Collaboration","year":"2015","journal-title":"Science"},{"issue":"4","key":"2023041909005277100_ocad009-B10","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.jclinepi.2007.11.006","article-title":"STROBE\u2014a checklist to STrengthen the Reporting of OBservational studies in Epidemiology","volume":"61","author":"Knottnerus","year":"2008","journal-title":"J Clin Epidemiol"},{"key":"2023041909005277100_ocad009-B11","doi-asserted-by":"crossref","first-page":"e1001885","DOI":"10.1371\/journal.pmed.1001885","article-title":"RECORD Working Committee, The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement","volume":"12","author":"Benchimol","year":"2015","journal-title":"PLoS Med"},{"issue":"3","key":"2023041909005277100_ocad009-B12","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1002\/pds.4381","article-title":"Strengthening standards, transparency, and collaboration to support medicine evaluation: ten years of the European Network of Centres for Pharmacoepidemiology and Pharmacovigilance (ENCePP)","volume":"27","author":"Kurz","year":"2018","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"2023041909005277100_ocad009-B13","doi-asserted-by":"crossref","first-page":"m4856","DOI":"10.1136\/bmj.m4856","article-title":"STaRT-RWE: structured template for planning and reporting on the implementation of real world evidence studies","volume":"372","author":"Wang","year":"2021","journal-title":"BMJ"},{"key":"2023041909005277100_ocad009-B14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12916-014-0241-z","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement","volume":"13","author":"Collins","year":"2015","journal-title":"BMC Med"},{"issue":"9","key":"2023041909005277100_ocad009-B15","doi-asserted-by":"crossref","first-page":"e0202447","DOI":"10.1371\/journal.pone.0202447","article-title":"Use of reproducible research practices in public health: a survey of public health analysts","volume":"13","author":"Harris","year":"2018","journal-title":"PLoS One"},{"issue":"2","key":"2023041909005277100_ocad009-B16","doi-asserted-by":"crossref","first-page":"190806","DOI":"10.1098\/rsos.190806","article-title":"An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014\u20132017)","volume":"7","author":"Hardwicke","year":"2020","journal-title":"R Soc Open Sci"},{"key":"2023041909005277100_ocad009-B17","doi-asserted-by":"crossref","first-page":"1344","DOI":"10.2337\/dc20-1794","article-title":"Glucagon-like peptide 1 receptor agonists and chronic lower respiratory disease exacerbations among patients with type 2 diabetes","volume":"44","author":"Albogami","year":"2021","journal-title":"Dia Care"},{"issue":"8","key":"2023041909005277100_ocad009-B18","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1016\/j.jval.2017.08.3018","article-title":"Reporting to improve reproducibility and facilitate validity assessment for healthcare database studies V1.0","volume":"20","author":"Wang","year":"2017","journal-title":"Value Health"},{"key":"2023041909005277100_ocad009-B19","author":"ATLAS","year":"2022"},{"key":"2023041909005277100_ocad009-B20","article-title":"Comparing sets of patterns with the Jaccard index","volume":"22","author":"Fletcher","year":"2018","journal-title":"AJIS"},{"key":"2023041909005277100_ocad009-B21","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.1080\/03610910902859574","article-title":"Using the standardized difference to compare the prevalence of a binary variable between two groups in observational research","volume":"38","author":"Austin","year":"2009","journal-title":"Commun Stat Simul Comput"},{"key":"2023041909005277100_ocad009-B22","article-title":"Practices, norms, and aspirations regarding the construction, validation, and reuse of code sets in the analysis of real-world data","author":"Gold","year":"2021","journal-title":"Medrxiv"},{"issue":"2","key":"2023041909005277100_ocad009-B23","doi-asserted-by":"crossref","first-page":"e0192033","DOI":"10.1371\/journal.pone.0192033","article-title":"Inferring pregnancy episodes and outcomes within a network of observational databases","volume":"13","author":"Matcho","year":"2018","journal-title":"PLoS One"},{"key":"2023041909005277100_ocad009-B24","doi-asserted-by":"crossref","first-page":"908","DOI":"10.1111\/j.1475-6773.2006.00635.x","article-title":"Development of an algorithm to identify pregnancy episodes in an integrated health care delivery system","volume":"42","author":"Hornbrook","year":"2007","journal-title":"Health Serv Res"},{"issue":"11","key":"2023041909005277100_ocad009-B25","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1002\/pds.935","article-title":"Strategies for identifying pregnancies in the automated medical records of the General Practice Research Database","volume":"13","author":"Hardy","year":"2004","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"2023041909005277100_ocad009-B26","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1002\/pds.1862","article-title":"The identification of pregnancies within the general practice research database","volume":"19","author":"Devine","year":"2010","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"5","key":"2023041909005277100_ocad009-B27","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1002\/pds.3407","article-title":"Validation of an algorithm to estimate gestational age in electronic health plan databases","volume":"22","author":"Li","year":"2013","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"1","key":"2023041909005277100_ocad009-B28","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1002\/pds.3284","article-title":"Algorithms to estimate the beginning of pregnancy in administrative databases: estimating the beginning of pregnancy","volume":"22","author":"Margulis","year":"2013","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"8","key":"2023041909005277100_ocad009-B29","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1002\/pds.3467","article-title":"Evaluation of pregnancy outcome records in the German Pharmacoepidemiological Research Database (GePaRD)","volume":"22","author":"Mikolajczyk","year":"2013","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"7829","key":"2023041909005277100_ocad009-B30","doi-asserted-by":"crossref","first-page":"E14","DOI":"10.1038\/s41586-020-2766-y","article-title":"Transparency and reproducibility in artificial intelligence","volume":"586","author":"Haibe-Kains","year":"2020","journal-title":"Nature"},{"key":"2023041909005277100_ocad009-B31","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1146\/annurev-publhealth-012420-105110","article-title":"Reproducible research: a retrospective","volume":"42","author":"Peng","year":"2021","journal-title":"Annu Rev Public Health"},{"issue":"10","key":"2023041909005277100_ocad009-B32","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1038\/gim.2013.72","article-title":"The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future","volume":"15","author":"Gottesman","year":"2013","journal-title":"Genet Med"},{"key":"2023041909005277100_ocad009-B33","doi-asserted-by":"crossref","first-page":"i886","DOI":"10.1136\/bmj.i886","article-title":"All BMJ research papers should share their analytic code","volume":"352","author":"Goldacre","year":"2016","journal-title":"BMJ"},{"key":"2023041909005277100_ocad009-B34","doi-asserted-by":"crossref","first-page":"l6365","DOI":"10.1136\/bmj.l6365","article-title":"Why researchers should share their analytic code","volume":"367","author":"Goldacre","year":"2019","journal-title":"BMJ"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/5\/859\/49873056\/ocad009.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/5\/859\/49873056\/ocad009.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,19]],"date-time":"2023-04-19T09:23:06Z","timestamp":1681896186000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/5\/859\/7056675"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,24]]},"references-count":34,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,2,24]]},"published-print":{"date-parts":[[2023,4,19]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad009","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,5,1]]},"published":{"date-parts":[[2023,2,24]]}}}