{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T22:18:15Z","timestamp":1767046695065},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,18]],"date-time":"2020-02-18T00:00:00Z","timestamp":1581984000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2020,2,18]],"date-time":"2020-02-18T00:00:00Z","timestamp":1581984000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2020,4]]},"DOI":"10.1007\/s11192-020-03353-4","type":"journal-article","created":{"date-parts":[[2020,2,18]],"date-time":"2020-02-18T10:02:51Z","timestamp":1582020171000},"page":"143-157","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Reproducibility issues with correlating Beall-listed publications and research awards at a small Canadian business school"],"prefix":"10.1007","volume":"123","author":[{"given":"Panagiotis","family":"Tsigaris","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaime A.","family":"Teixeira da Silva","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,2,18]]},"reference":[{"issue":"7604","key":"3353_CR1","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1038\/533452a","volume":"533","author":"M Baker","year":"2016","unstructured":"Baker, M. (2016). 1,500 scientists lift the lid on reproducibility. Nature,533(7604), 452\u2013454. https:\/\/doi.org\/10.1038\/533452a.","journal-title":"Nature"},{"key":"3353_CR2","doi-asserted-by":"publisher","first-page":"2","DOI":"10.6017\/ihe.2016.86.9358","volume":"86","author":"J Beall","year":"2016","unstructured":"Beall, J. (2016a). Essential information about predatory publishers and journals. International Higher Education,86, 2\u20133. https:\/\/doi.org\/10.6017\/ihe.2016.86.9358.","journal-title":"International Higher Education"},{"issue":"7607","key":"3353_CR3","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1038\/534326a","volume":"534","author":"J Beall","year":"2016","unstructured":"Beall, J. (2016b). Predatory journals: Ban predators from the scientific record. Nature,534(7607), 326. https:\/\/doi.org\/10.1038\/534326a.","journal-title":"Nature"},{"issue":"1","key":"3353_CR4","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1038\/s41562-017-0189-z","volume":"2","author":"DJ Benjamin","year":"2018","unstructured":"Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E. J., Berk, R., et al. (2018). Redefine statistical significance. Nature Human Behaviour,2(1), 6\u201310. https:\/\/doi.org\/10.1038\/s41562-017-0189-z.","journal-title":"Nature Human Behaviour"},{"issue":"11","key":"3353_CR5","doi-asserted-by":"publisher","first-page":"2613","DOI":"10.1073\/pnas.1710755115","volume":"115","author":"I Boutron","year":"2018","unstructured":"Boutron, I., & Ravaud, P. (2018). Misrepresentation and distortion of research in biomedical literature. Proceedings of the National Academy of Sciences USA,115(11), 2613\u20132619. https:\/\/doi.org\/10.1073\/pnas.1710755115.","journal-title":"Proceedings of the National Academy of Sciences USA"},{"key":"3353_CR6","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1038\/s41562-018-0399-z","volume":"2","author":"CF Camerer","year":"2018","unstructured":"Camerer, C. F., Dreber, A., Holzmeister, F., Ho, T. H., Huber, J., Johannesson, M., et al. (2018). Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour,2, 637\u2013644. https:\/\/doi.org\/10.1038\/s41562-018-0399-z.","journal-title":"Nature Human Behaviour"},{"issue":"9","key":"3353_CR7","doi-asserted-by":"publisher","first-page":"e2002173","DOI":"10.1371\/journal.pbio.2002173","volume":"15","author":"K Chiu","year":"2017","unstructured":"Chiu, K., Grundy, Q., & Bero, L. (2017). \u2018Spin\u2019 in published biomedical literature: A methodological systematic review. PLoS Biology,15(9), e2002173. https:\/\/doi.org\/10.1371\/journal.pbio.2002173.","journal-title":"PLoS Biology"},{"issue":"11","key":"3353_CR8","doi-asserted-by":"publisher","first-page":"2628","DOI":"10.1073\/pnas.1708272114","volume":"115","author":"D Fanelli","year":"2018","unstructured":"Fanelli, D. (2018). Is science really facing a reproducibility crisis, and do we need it to? Proceedings of the National Academy of Sciences USA,115(11), 2628\u20132631. https:\/\/doi.org\/10.1073\/pnas.1708272114.","journal-title":"Proceedings of the National Academy of Sciences USA"},{"issue":"605","key":"3353_CR9","doi-asserted-by":"publisher","first-page":"F236","DOI":"10.1111\/ecoj.12461","volume":"127","author":"J Ioannidis","year":"2017","unstructured":"Ioannidis, J., Stanley, T. D., & Doucouliagos, H. (2017). The power of bias in economics research. The Economic Journal,127(605), F236\u2013F265. https:\/\/doi.org\/10.1111\/ecoj.12461.","journal-title":"The Economic Journal"},{"issue":"4","key":"3353_CR10","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1177\/17456916177539","volume":"13","author":"JC Kaufman","year":"2018","unstructured":"Kaufman, J. C., & Gl\u0103veanu, V. P. (2018). The road to uncreative science is paved with good intentions: ideas, implementations, and uneasy balances. Perspectives on Psychological Science,13(4), 457\u2013465. https:\/\/doi.org\/10.1177\/17456916177539.","journal-title":"Perspectives on Psychological Science"},{"issue":"7668","key":"3353_CR11","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1038\/548387a","volume":"548","author":"GJ Lithgow","year":"2017","unstructured":"Lithgow, G. J., Driscoll, M., & Phillips, P. (2017). A long journey to reproducible results. Nature,548(7668), 387\u2013388. https:\/\/doi.org\/10.1038\/548387a.","journal-title":"Nature"},{"key":"3353_CR12","doi-asserted-by":"publisher","first-page":"48175","DOI":"10.7554\/eLife.48175","volume":"8","author":"TR Makin","year":"2019","unstructured":"Makin, T. R., & de Xivry, J. J. O. (2019). Ten common statistical mistakes to watch out for when writing or reviewing a manuscript. eLife,8, 48175. https:\/\/doi.org\/10.7554\/eLife.48175.","journal-title":"eLife"},{"issue":"7670","key":"3353_CR13","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1038\/549023a","volume":"549","author":"D Moher","year":"2017","unstructured":"Moher, D., Shamseer, L., Cobey, K. D., Lalu, M. M., Galipeau, J., Avey, M. T., et al. (2017). Stop this waste of people, animals and money. Nature,549(7670), 23\u201325. https:\/\/doi.org\/10.1038\/549023a.","journal-title":"Nature"},{"key":"3353_CR14","unstructured":"NAS (National Academies of Sciences, Engineering, and Medicine) (2016). Statistical challenges in assessing and fostering the reproducibility of scientific results: Summary of a workshop. National Academies Press. https:\/\/www.nap.edu\/catalog\/21915\/statistical-challenges-in-assessing-and-fostering-the-reproducibility-of-scientific-results. Accessed Jan 8 2020"},{"issue":"3","key":"3353_CR16","doi-asserted-by":"publisher","first-page":"137","DOI":"10.3138\/jsp.48.3.137","volume":"48","author":"D Pyne","year":"2017","unstructured":"Pyne, D. (2017). The rewards of predatory publishing at a small business school. Journal of Scholarly Publishing,48(3), 137\u2013160. https:\/\/doi.org\/10.3138\/jsp.48.3.137.","journal-title":"Journal of Scholarly Publishing"},{"key":"3353_CR17","unstructured":"Shen, D., & Lu, Z. (2006). Computation of correlation coefficient and its confidence interval in SAS. SUGI: Paper #170-31, 6\u00a0pp. http:\/\/www2.sas.com\/proceedings\/sugi31\/170-31.pdf. Accessed 8 Jan 2020"},{"issue":"6","key":"3353_CR18","doi-asserted-by":"publisher","first-page":"102071","DOI":"10.1016\/j.acalib.2019.102071","volume":"45","author":"JA Teixeira da Silva","year":"2019","unstructured":"Teixeira da Silva, J. A., Dobr\u00e1nszki, J., Tsigaris, P., & Al-Khatib, A. (2019). Predatory and exploitative behaviour in academic publishing: An assessment. The Journal of Academic Librarianship,45(6), 102071. https:\/\/doi.org\/10.1016\/j.acalib.2019.102071.","journal-title":"The Journal of Academic Librarianship"},{"issue":"6","key":"3353_CR19","doi-asserted-by":"publisher","first-page":"781","DOI":"10.1016\/j.acalib.2018.09.017","volume":"44","author":"JA Teixeira da Silva","year":"2018","unstructured":"Teixeira da Silva, J. A., & Tsigaris, P. (2018). What value do whitelists and blacklists have in academia? The Journal of Academic Librarianship,44(6), 781\u2013792. https:\/\/doi.org\/10.1016\/j.acalib.2018.09.017.","journal-title":"The Journal of Academic Librarianship"},{"issue":"4","key":"3353_CR21","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1108\/JICES-06-2018-0059","volume":"17","author":"JA Teixeira da Silva","year":"2019","unstructured":"Teixeira da Silva, J. A., & Tsigaris, P. (2019). How hyped media and misleading editorials can influence impressions about Beall\u2019s lists of \u201cpredatory\u201d publications. Journal of Information, Communication & Ethics in Society,17(4), 438\u2013444. https:\/\/doi.org\/10.1108\/JICES-06-2018-0059.","journal-title":"Journal of Information, Communication & Ethics in Society"},{"key":"3353_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.acalib.2019.102070","author":"JA Teixeira da Silva","year":"2020","unstructured":"Teixeira da Silva, J. A., & Tsigaris, P. (2020). Issues with criteria to evaluate blacklists: An epidemiological approach. The Journal of Academic Librarianship. https:\/\/doi.org\/10.1016\/j.acalib.2019.102070.","journal-title":"The Journal of Academic Librarianship"},{"issue":"2","key":"3353_CR23","doi-asserted-by":"publisher","first-page":"139","DOI":"10.3138\/jsp.50.2.05","volume":"50","author":"P Tsigaris","year":"2019","unstructured":"Tsigaris, P. (2019). Letter to the editors. Journal of Scholarly Publishing,50(2), 139\u2013142. https:\/\/doi.org\/10.3138\/jsp.50.2.05.","journal-title":"Journal of Scholarly Publishing"},{"issue":"2","key":"3353_CR24","doi-asserted-by":"publisher","first-page":"35","DOI":"10.3390\/publications7020035","volume":"7","author":"P Tsigaris","year":"2019","unstructured":"Tsigaris, P., & Teixeira da Silva, J. A. (2019a). Did the research faculty at a small Canadian business school publish in \u201cpredatory\u201d venues? This depends on the publishing blacklist. Publications,7(2), 35. https:\/\/doi.org\/10.3390\/publications7020035.","journal-title":"Publications"},{"issue":"1","key":"3353_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2478\/sc-2019-0001","volume":"19","author":"P Tsigaris","year":"2019","unstructured":"Tsigaris, P., & Teixeira da Silva, J. A. (2019b). Moderation by ResearchGate related to comments on \u201cpredatory\u201d publishing practices. Social Communication,19(1), 1\u20138. https:\/\/doi.org\/10.2478\/sc-2019-0001.","journal-title":"Social Communication"},{"issue":"2","key":"3353_CR26","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1097\/AOG.0000000000001818","volume":"129","author":"M Turrentine","year":"2017","unstructured":"Turrentine, M. (2017). It\u2019s all how you \u201cspin\u201d it: interpretive bias in research findings in the obstetrics and gynecology literature. Obstetrics and Gynecology,129(2), 239\u2013242. https:\/\/doi.org\/10.1097\/AOG.0000000000001818.","journal-title":"Obstetrics and Gynecology"},{"issue":"2","key":"3353_CR27","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1007\/s11192-018-2690-1","volume":"115","author":"FH Wallace","year":"2018","unstructured":"Wallace, F. H., & Perri, T. J. (2018). Economists behaving badly: Publications in predatory journals. Scientometrics,115(2), 749\u2013766. https:\/\/doi.org\/10.1007\/s11192-018-2690-1.","journal-title":"Scientometrics"},{"issue":"7","key":"3353_CR28","first-page":"557","volume":"20","author":"S Wright","year":"1921","unstructured":"Wright, S. (1921). Correlation and causation. Journal of Agricultural Research,20(7), 557\u2013585.","journal-title":"Journal of Agricultural Research"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03353-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-020-03353-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03353-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,19]],"date-time":"2021-02-19T09:48:26Z","timestamp":1613728106000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-020-03353-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,18]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,4]]}},"alternative-id":["3353"],"URL":"https:\/\/doi.org\/10.1007\/s11192-020-03353-4","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,18]]},"assertion":[{"value":"18 July 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 February 2020","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare no conflicts of interest. The authors have challenged the findings of the Pyne paper on numerous occasions. The first author of this paper (Panagiotis Tsigaris), works at the same institute as Derek Pyne, and has an interest in re-examining his colleague\u2019s controversial findings and conclusions as his and his institution\u2019s reputation are at stake. The authors declare no other relevant conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}]}}