{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T03:32:22Z","timestamp":1787628742103,"version":"build-2736575974"},"reference-count":21,"publisher":"American Medical Association (AMA)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"Importance<\/jats:title>Preprints have been widely adopted to enhance the timely dissemination of research across many scientific fields. Concerns remain that early, public access to preliminary medical research has the potential to propagate misleading or faulty research that has been conducted or interpreted in error.<\/jats:p><\/jats:sec>Objective<\/jats:title>To evaluate the concordance among study characteristics, results, and interpretations described in preprints of clinical studies posted to medRxiv that are subsequently published in peer-reviewed journals (preprint-journal article pairs).<\/jats:p><\/jats:sec>Design, Setting, and Participants<\/jats:title>This cross-sectional study assessed all preprints describing clinical studies that were initially posted to medRxiv in September 2020 and subsequently published in a peer-reviewed journal as of September 15, 2022.<\/jats:p><\/jats:sec>Main Outcomes and Measures<\/jats:title>For preprint-journal article pairs describing clinical trials, observational studies, and meta-analyses that measured health-related outcomes, the sample size, primary end points, corresponding results, and overarching conclusions were abstracted and compared. Sample size and results from primary end points were considered concordant if they had exact numerical equivalence.<\/jats:p><\/jats:sec>Results<\/jats:title>Among 1399 preprints first posted on medRxiv in September 2020, a total of 1077 (77.0%) had been published as of September 15, 2022, a median of 6 months (IQR, 3-8 months) after preprint posting. Of the 547 preprint-journal article pairs describing clinical trials, observational studies, or meta-analyses, 293 (53.6%) were related to COVID-19. Of the 535 pairs reporting sample sizes in both sources, 462 (86.4%) were concordant; 43 (58.9%) of the 73 pairs with discordant sample sizes had larger samples in the journal publication. There were 534 pairs (97.6%) with concordant and 13 pairs (2.4%) with discordant primary end points. Of the 535 pairs with numerical results for the primary end points, 434 (81.1%) had concordant primary end point results; 66 of the 101 discordant pairs (65.3%) had effect estimates that were in the same direction and were statistically consistent. Overall, 526 pairs (96.2%) had concordant study interpretations, including 82 of the 101 pairs (81.2%) with discordant primary end point results.<\/jats:p><\/jats:sec>Conclusions and Relevance<\/jats:title>Most clinical studies posted as preprints on medRxiv and subsequently published in peer-reviewed journals had concordant study characteristics, results, and final interpretations. With more than three-fourths of preprints published in journals within 24 months, these results may suggest that many preprints report findings that are consistent with the final peer-reviewed publications.<\/jats:p><\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2022.45847","type":"journal-article","created":{"date-parts":[[2022,12,9]],"date-time":"2022-12-09T16:30:55Z","timestamp":1670603455000},"page":"e2245847","source":"Crossref","is-referenced-by-count":41,"title":["Comparison of Clinical Study Results Reported in medRxiv Preprints vs Peer-reviewed Journal Articles"],"prefix":"10.1001","volume":"5","author":[{"given":"Guneet","family":"Janda","sequence":"first","affiliation":[{"name":"Yale School of Medicine, New Haven, Connecticut"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vishal","family":"Khetpal","sequence":"additional","affiliation":[{"name":"Department of Medicine, Warren Alpert Medical School of Brown University, Providence, Rhode Island"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoting","family":"Shi","sequence":"additional","affiliation":[{"name":"Department of Environmental Health Sciences, Yale School of Public Health, New Haven, Connecticut"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph S.","family":"Ross","sequence":"additional","affiliation":[{"name":"Section of General Medicine and the National Clinician Scholars Program, Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut"},{"name":"Center for Outcomes Research and Evaluation, Yale\u2013New Haven Health System, New Haven, Connecticut"},{"name":"Department of Health Policy and Management, Yale School of Public Health, New Haven, Connecticut"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joshua D.","family":"Wallach","sequence":"additional","affiliation":[{"name":"Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2022,12,9]]},"reference":[{"issue":"7475","key":"zoi221296r1","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1038\/503180a","article-title":"Preprints come to life.","volume":"503","author":"Callaway","year":"2013","journal-title":"Nature"},{"issue":"7359","key":"zoi221296r2","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1038\/476145a","article-title":"ArXiv at 20.","volume":"476","author":"Ginsparg","year":"2011","journal-title":"Nature"},{"issue":"7","key":"zoi221296r3","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.11127","article-title":"Assessment of preprint policies of top-ranked clinical journals.","volume":"3","author":"Massey","year":"2020","journal-title":"JAMA Netw Open"},{"issue":"3","key":"zoi221296r4","doi-asserted-by":"publisher","first-page":"e115","DOI":"10.1016\/S2542-5196(21)00011-5","article-title":"Lessons from the influx of preprints during the early COVID-19 pandemic.","volume":"5","author":"Brierley","year":"2021","journal-title":"Lancet Planet Health"},{"issue":"4","key":"zoi221296r5","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3000959","article-title":"The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape.","volume":"19","author":"Fraser","year":"2021","journal-title":"PLoS Biol"},{"issue":"1","key":"zoi221296r6","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1038\/s41591-021-01654-6","article-title":"Rise of the preprint: how rapid data sharing during COVID-19 has changed science forever.","volume":"28","author":"Watson","year":"2022","journal-title":"Nat Med"},{"issue":"18","key":"zoi221296r7","doi-asserted-by":"publisher","first-page":"1840","DOI":"10.1001\/jama.2020.20674","article-title":"Preprints involving medical research\u2014do the benefits outweigh the challenges?","volume":"324","author":"Flanagin","year":"2020","journal-title":"JAMA"},{"issue":"7","key":"zoi221296r8","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-051821","article-title":"Cross-sectional study of preprints and final journal publications from COVID-19 studies: discrepancies in results reporting and spin in interpretation.","volume":"11","author":"Bero","year":"2021","journal-title":"BMJ Open"},{"issue":"2","key":"zoi221296r9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3001285","article-title":"Tracking changes between preprint posting and journal publication during a pandemic.","volume":"20","author":"Brierley","year":"2022","journal-title":"PLoS Biol"},{"issue":"3","key":"zoi221296r10","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2021.2110","article-title":"Assessment of concordance and discordance among clinical studies posted as preprints and subsequently published in high-impact journals.","volume":"4","author":"Shi","year":"2021","journal-title":"JAMA Netw Open"},{"key":"zoi221296r12","doi-asserted-by":"publisher","first-page":"51","DOI":"10.3233\/DS-210032","article-title":"BioVenn\u2014an R and Python package for the comparison and visualization of biological lists using area-proportional Venn diagrams.","volume":"4","author":"Hulsen","year":"2021","journal-title":"Data Sci"},{"issue":"4","key":"zoi221296r13","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1007\/s00799-018-0234-1","article-title":"Comparing published scientific journal articles to their pre-print versions.","volume":"20","author":"Klein","year":"2019","journal-title":"Int J Digital Libraries"},{"issue":"1","key":"zoi221296r14","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1186\/s12916-020-01880-8","article-title":"Changes in evidence for studies assessing interventions for COVID-19 reported in preprints: meta-research study.","volume":"18","author":"Oikonomidi","year":"2020","journal-title":"BMC Med"},{"issue":"2","key":"zoi221296r15","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2022.101258","article-title":"A study of referencing changes in preprint-publication pairs across multiple fields.","volume":"16","author":"Akbaritabar","year":"2022","journal-title":"J Informetrics"},{"issue":"12","key":"zoi221296r16","doi-asserted-by":"publisher","first-page":"1109","DOI":"10.1001\/jama.2017.11816","article-title":"The rush to publication: an editorial and scientific mistake.","volume":"318","author":"Bauchner","year":"2017","journal-title":"JAMA"},{"key":"zoi221296r17","doi-asserted-by":"publisher","first-page":"k3628","DOI":"10.1136\/bmj.k3628","article-title":"Will research preprints improve healthcare for patients?","volume":"362","author":"Krumholz","year":"2018","journal-title":"BMJ"},{"key":"zoi221296r19","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.45133","article-title":"Tracking the popularity and outcomes of all bioRxiv preprints.","volume":"8","author":"Abdill","year":"2019","journal-title":"Elife"},{"key":"zoi221296r20","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.10927","article-title":"Publication rate and citation counts for preprints released during the COVID-19 pandemic: the good, the bad and the ugly.","volume":"9","author":"A\u00f1azco","year":"2021","journal-title":"PeerJ"},{"issue":"1","key":"zoi221296r21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41073-017-0045-8","article-title":"Biomedical journal speed and efficiency: a cross-sectional pilot survey of author experiences.","volume":"3","author":"Wallach","year":"2018","journal-title":"Res Integr Peer Rev"},{"key":"zoi221296r11","unstructured":"Altmetric. What are altmetrics? 2022. Accessed September 7, 2022. https:\/\/www.altmetric.com\/about-altmetrics\/what-are-altmetrics\/"},{"key":"zoi221296r18","doi-asserted-by":"crossref","unstructured":"Kapp? P, Esmail? L, Ghosn? L, Ravaud? P, Boutron? I. Transparency and reporting characteristics of COVID-19 randomized controlled trials.? medRxiv. Preprint posted February 4, 2022. doi:10.1101\/2022.02.03.22270357","DOI":"10.1101\/2022.02.03.22270357"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2799350\/janda_2022_oi_221296_1669995582.44505.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,9]],"date-time":"2022-12-09T16:30:58Z","timestamp":1670603458000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2799350"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,9]]},"references-count":21,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,12,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2022.45847","relation":{},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,9]]}}}