{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T03:36:47Z","timestamp":1771645007926,"version":"3.50.1"},"reference-count":15,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2017,12,22]],"date-time":"2017-12-22T00:00:00Z","timestamp":1513900800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/about_us\/legal\/notices"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ACI-1345426"],"award-info":[{"award-number":["ACI-1345426"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U54GM104938 and P20GM103636"],"award-info":[{"award-number":["U54GM104938 and P20GM103636"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,5,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Studies, mostly from the operations\/management literature, have shown that the rate of human error increases with task complexity. What is not known is how many errors make it into the published literature, given that they must slip by peer-review. By identifying paired, dependent values within text for reported calculations of varying complexity, we can identify discrepancies, quantify error rates and identify mitigating factors.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We extracted statistical ratios from MEDLINE abstracts (hazard ratio, odds ratio, relative risk), their 95% CIs, and their P-values. We re-calculated the ratios and P-values using the reported CIs. For comparison, we also extracted percent\u2013ratio pairs, one of the simplest calculation tasks. Over 486 000 published values were found and analyzed for discrepancies, allowing for rounding and significant figures. Per reported item, discrepancies were less frequent in percent\u2013ratio calculations (2.7%) than in ratio\u2013CI and P-value calculations (5.6\u20137.5%), and smaller discrepancies were more frequent than large ones. Systematic discrepancies (multiple incorrect calculations of the same type) were higher for more complex tasks (14.3%) than simple ones (6.7%). Discrepancy rates decreased with increasing journal impact factor (JIF) and increasing number of authors, but with diminishing returns and JIF accounting for most of the effect. Approximately 87% of the 81 937 extracted P-values were \u2264 0.05.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Using a simple, yet accurate, approach to identifying paired values within text, we offer the first quantitative evaluation of published error frequencies within these types of calculations.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Supplementary information<\/jats:title>\n                  <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btx811","type":"journal-article","created":{"date-parts":[[2017,12,22]],"date-time":"2017-12-22T02:00:50Z","timestamp":1513908050000},"page":"1758-1766","source":"Crossref","is-referenced-by-count":18,"title":["Algorithmic identification of discrepancies between published ratios and their reported confidence intervals and <i>P<\/i>-values"],"prefix":"10.1093","volume":"34","author":[{"given":"Constantin","family":"Georgescu","sequence":"first","affiliation":[{"name":"Arthritis and Clinical Immunology Research Program, Division of Genomics and Data Sciences, Oklahoma Medical Research Foundation, Oklahoma City, Oklahoma"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2776-3545","authenticated-orcid":false,"given":"Jonathan D","family":"Wren","sequence":"additional","affiliation":[{"name":"Arthritis and Clinical Immunology Research Program, Division of Genomics and Data Sciences, Oklahoma Medical Research Foundation, Oklahoma City, Oklahoma"},{"name":"Department of Biochemistry and Molecular Biology, University of Oklahoma Health Sciences Center"},{"name":"Oklahoma Center for Neuroscience, University of Oklahoma Health Sciences Center"}]}],"member":"286","published-online":{"date-parts":[[2017,12,22]]},"reference":[{"key":"2023012810010933000_btx811-B1","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1207\/s15516709cog0804_5","article-title":"Error detection processes in statistical problem solving","volume":"8","author":"Allwood","year":"1984","journal-title":"Cogn. Sci"},{"key":"2023012810010933000_btx811-B2","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1197\/jamia.M1683","article-title":"Accuracy of references in five biomedical informatics journals","volume":"12","author":"Aronsky","year":"2005","journal-title":"J. Am. Med. Inform. Assoc"},{"key":"2023012810010933000_btx811-B3","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1161\/CIRCRESAHA.114.303819","article-title":"Reproducibility in science: improving the standard for basic and preclinical research","volume":"116","author":"Begley","year":"2015","journal-title":"Circ. Res"},{"key":"2023012810010933000_btx811-B4","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1038\/505612a","article-title":"Policy: NIH plans to enhance reproducibility","volume":"505","author":"Collins","year":"2014","journal-title":"Nature"},{"key":"2023012810010933000_btx811-B5","doi-asserted-by":"crossref","first-page":"3855","DOI":"10.1128\/IAI.05661-11","article-title":"Retracted science and the retraction index","volume":"79","author":"Fang","year":"2011","journal-title":"Infect. Immun"},{"key":"2023012810010933000_btx811-B6","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-5470-6_6","volume-title":"Error Patterns in Skilled and Novice Transcription Typing","author":"Grudin","year":"1983"},{"key":"2023012810010933000_btx811-B7","doi-asserted-by":"crossref","first-page":"S7.","DOI":"10.1186\/1471-2105-15-S11-S7","article-title":"Trends in the production of scientific data analysis resources","volume":"15 (Suppl 11)","author":"Hennessey","year":"2014","journal-title":"BMC Bioinformatics"},{"key":"2023012810010933000_btx811-B8","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-1164-3_11","volume-title":"Error-Minimizing Mechanisms: Boosting or Editing","author":"Mattson","year":"1992"},{"key":"2023012810010933000_btx811-B9","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.3758\/s13428-015-0664-2","article-title":"The prevalence of statistical reporting errors in psychology (1985-2013)","volume":"48","author":"Nuijten","year":"2015","journal-title":"Behav. Res. Methods"},{"key":"2023012810010933000_btx811-B10","doi-asserted-by":"crossref","first-page":"712.","DOI":"10.1038\/nrd3439-c1","article-title":"Believe it or not: how much can we rely on published data on potential drug targets?","volume":"10","author":"Prinz","year":"2011","journal-title":"Nature Rev. Drug Discov"},{"key":"2023012810010933000_btx811-B11","author":"Tsao","year":"1990"},{"key":"2023012810010933000_btx811-B12","doi-asserted-by":"crossref","first-page":"e114876","DOI":"10.1371\/journal.pone.0114876","article-title":"Statistical reporting errors and collaboration on statistical analyses in psychological science","volume":"9","author":"Veldkamp","year":"2014","journal-title":"PloS One"},{"key":"2023012810010933000_btx811-B13","volume-title":"Spelling Errors in Handwriting: A Corpus and Distributional Analysis","author":"Wing","year":"1980"},{"key":"2023012810010933000_btx811-B14","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1093\/bioinformatics\/btg465","article-title":"404 not found: the stability and persistence of URLs published in MEDLINE","volume":"20","author":"Wren","year":"2004","journal-title":"Bioinformatics"},{"key":"2023012810010933000_btx811-B15","doi-asserted-by":"crossref","first-page":"109.","DOI":"10.1177\/1740774516669505","article-title":"Clinical trial IDs need to be validated prior to publication because hundreds of invalid National Clinical Trial Identifications are regularly entering MEDLINE","volume":"14","author":"Wren","year":"2017","journal-title":"Clin. Trials"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/10\/1758\/48935619\/bioinformatics_34_10_1758.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/10\/1758\/48935619\/bioinformatics_34_10_1758.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,28]],"date-time":"2023-01-28T10:01:31Z","timestamp":1674900091000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/34\/10\/1758\/4772681"}},"subtitle":[],"editor":[{"given":"Janet","family":"Kelso","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2017,12,22]]},"references-count":15,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2018,5,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btx811","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,5,15]]},"published":{"date-parts":[[2017,12,22]]}}}