{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T21:33:22Z","timestamp":1778708002061,"version":"3.51.4"},"reference-count":47,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2020,3,26]],"date-time":"2020-03-26T00:00:00Z","timestamp":1585180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Publications"],"abstract":"<jats:p>Predatory journals are Open Access journals of highly questionable scientific quality. Such journals pretend to use peer review for quality assurance, and spam academics with requests for submissions, in order to collect author payments. In recent years predatory journals have received a lot of negative media. While much has been said about the harm that such journals cause to academic publishing in general, an overlooked aspect is how much articles in such journals are actually read and in particular cited, that is if they have any significant impact on the research in their fields. Other studies have already demonstrated that only some of the articles in predatory journals contain faulty and directly harmful results, while a lot of the articles present mediocre and poorly reported studies. We studied citation statistics over a five-year period in Google Scholar for 250 random articles published in such journals in 2014 and found an average of 2.6 citations per article, and that 56% of the articles had no citations at all. For comparison, a random sample of articles published in the approximately 25,000 peer reviewed journals included in the Scopus index had an average of 18, 1 citations in the same period with only 9% receiving no citations. We conclude that articles published in predatory journals have little scientific impact.<\/jats:p>","DOI":"10.3390\/publications8020017","type":"journal-article","created":{"date-parts":[[2020,3,31]],"date-time":"2020-03-31T10:29:38Z","timestamp":1585650578000},"page":"17","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":58,"title":["How Frequently Are Articles in Predatory Open Access Journals Cited"],"prefix":"10.3390","volume":"8","author":[{"given":"Bo-Christer","family":"Bj\u00f6rk","sequence":"first","affiliation":[{"name":"Hanken School of Economics, P.O. Box 479, FI-00101 Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sari","family":"Kanto-Karvonen","sequence":"additional","affiliation":[{"name":"Department of Information Studies and Interactive Media, Tampere University, FI-33014 Tampere, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6085-5663","authenticated-orcid":false,"given":"J. Tuomas","family":"Harviainen","sequence":"additional","affiliation":[{"name":"Department of Information Studies and Interactive Media, Tampere University, FI-33014 Tampere, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,26]]},"reference":[{"key":"ref_1","first-page":"92","article-title":"Predatory journals\u2014Authors and readers beware","volume":"65","author":"Vakil","year":"2019","journal-title":"Can. Fam. Physician"},{"key":"ref_2","unstructured":"Hern, A., and Duncan, P. (2018, August 10). Predatory Publishers: The Journals That Churn Out Fake Science. The Guardian, 2018. Available online: https:\/\/www.theguardian.com\/technology\/2018\/aug\/10\/predatory-publishers-the-journals-who-churn-out-fake-science."},{"key":"ref_3","unstructured":"Eysenbach, G. (2008, March 08). Black Sheep among Open Access Journals and Publishers. Gunther Eysenbach Random Research Rants Blog, 2008. Available online: http:\/\/www.webcitation.org\/5YIqkyRE4."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1038\/489179a","article-title":"Predatory publishers are corrupting open access","volume":"489","author":"Beall","year":"2012","journal-title":"Nature"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1126\/science.342.6154.60","article-title":"Who\u2019s afraid of peer review?","volume":"342","author":"Bohannon","year":"2013","journal-title":"Science"},{"key":"ref_6","first-page":"1069","article-title":"The story of fake impact factor companies and how we detected them","volume":"7","author":"Jalalian","year":"2015","journal-title":"Elec. Physician"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1093\/asj\/sjw247","article-title":"Are predatory conferences the dark side of the open access movement?","volume":"37","author":"Cress","year":"2017","journal-title":"Aesthet. Surg. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1080\/00213624.2008.11507173","article-title":"An introduction to the economics of fake degrees","volume":"42","author":"Grolleau","year":"2008","journal-title":"J. Econ. Issues"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/s12525-017-0249-2","article-title":"Scholarly journal publishing in transition\u2014from restricted to open access","volume":"27","year":"2017","journal-title":"Electron. Mark"},{"key":"ref_10","unstructured":"Jubb, M., Plume, A., Oeben, S., Brammer, L., Johnson, R., B\u00fct\u00fcn, C., and Pinfield, S. (2018, June 17). Monitoring the Transition to Open Access\u2014December 2017. Report, Universities UK. Available online: https:\/\/www.universitiesuk.ac.uk\/policy-and-analysis\/reports\/Documents\/2017\/monitoring-transition-open-access-2017.pdf."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e4375","DOI":"10.7717\/peerj.4375","article-title":"The state of OA: A large-scale analysis of the prevalence and impact of open access articles","volume":"6","author":"Piwowar","year":"2018","journal-title":"PeerJ"},{"key":"ref_12","unstructured":"Beall, J. (2012). Criteria for Determining Predatory Open-Access Publishers, [2nd edition]. Available online: http:\/\/scholarlyoa.files.wordpress.com\/2012\/11\/criteria-2012-2.pdf."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1080\/03007995.2017.1358160","article-title":"Analysis of thirteen predatory publishers: A trap for eager-to-publish researchers","volume":"34","author":"Bolshete","year":"2018","journal-title":"Curr. Med. Res. Opin."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.12688\/f1000research.15256.1","article-title":"What is a predatory journal? A scoping review [version 2; referees: 3 approved]","volume":"7","author":"Cobey","year":"2018","journal-title":"F1000 Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e00411","DOI":"10.1128\/mBio.00411-19","article-title":"\u2018Blacklists\u2019 and \u2018whitelists\u2019 to tackle predatory publishing: A cross-sectional comparison and thematic analysis","volume":"10","author":"Strinzel","year":"2019","journal-title":"mBio"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1038\/d41586-019-03759-y","article-title":"Predatory journals: No definition, no defence","volume":"576","author":"Grudniewicz","year":"2019","journal-title":"Nature"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"132","DOI":"10.5860\/crln.76.3.9277","article-title":"Beyond Beall\u2019s list: Better understanding predatory publishers","volume":"76","author":"Berger","year":"2015","journal-title":"Coll. Res. Libr. News"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1016\/j.acalib.2018.09.017","article-title":"What value do journal whitelists and blacklists have in academia?","volume":"44","author":"Tsigaris","year":"2018","journal-title":"J. Acad. Lib."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"52","DOI":"10.5860\/crl.79.1.52","article-title":"Format aside: Applying Beall\u2019s criteria to assess the predatory nature of both oa and non-oa library and information science journals","volume":"79","author":"Olivarez","year":"2018","journal-title":"Coll. Res. Libr."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.amjmed.2017.10.054","article-title":"Predatory publishing: What are the alternatives to Beall\u2019s list","volume":"131","author":"Strielkowski","year":"2018","journal-title":"Am. J. Med."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Baker, M. (2016, May 09). Open-access Index Delists Thousands of Journals. Available online: https:\/\/www.nature.com\/news\/open-access-index-delists-thousands-of-journals-1.19871.","DOI":"10.1038\/nature.2016.19871"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/s11948-014-9521-4","article-title":"Penetrating the omerta of predatory publishing: The Romanian connection","volume":"21","author":"Djuric","year":"2015","journal-title":"Sci. Eng. Ethics"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"69","DOI":"10.5937\/GeoPan1403069L","article-title":"Predatory and fake scientific journals\/publishers\u2014a global outbreak with rising trend: A review","volume":"18","author":"Basarin","year":"2014","journal-title":"Geogr. Pannonica"},{"key":"ref_24","unstructured":"Spears, T. (2019, October 28). Respectable Medical Journal Turns to Dark Side. Ottawa Citizen, 2014. Available online: http:\/\/ottawacitizen.com\/technology\/science\/respected-medical-journal-turns-to-dark-side."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Shen, C., and Bj\u00f6rk, B.-C. (2015). \u201cPredatory\u201d open access: A longitudinal study of article volumes and market characteristics. BMC Med., 13.","DOI":"10.1186\/s12916-015-0469-2"},{"key":"ref_26","unstructured":"Kanto-Karvinen, S. (2019). Saalistajajulkaisijat\u2014Uhka Tieteelle? [Predatory publishers\u2014A threat to science?]. [Master\u2019s Thesis, Tampere University]."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.1002\/asi.23265","article-title":"Who publishes in predatory journals","volume":"66","author":"Xia","year":"2015","journal-title":"J. Assoc. Inf. Sci. Tech."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1016\/j.respol.2018.04.013","article-title":"A walk on the wild side: \u2018Predatory\u2019 journals and information asymmetries in scientific evaluations","volume":"48","author":"Bagues","year":"2019","journal-title":"Res. Policy"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1038\/549023a","article-title":"Stop this waste of people, animals and money","volume":"549","author":"Moher","year":"2017","journal-title":"Nat. News"},{"key":"ref_30","unstructured":"Mach\u00e1\u010dek, V., and Srholec, M. (2019, October 28). Predatory Journals in Scopus. Study 16\/2016, IDEA Think Tank, Economic Institute of the Czech Academy of Sciences. Available online: https:\/\/idea-en.cerge-ei.cz\/files\/IDEA_Study_2_2017_Predatory_journals_in_Scopus\/files\/downloads\/IDEA_Study_2_2017_Predatory_journals_in_Scopus.pdf."},{"key":"ref_31","first-page":"150","article-title":"Scholarly databases under scrutiny","volume":"52","author":"Demir","year":"2020","journal-title":"J. Lib. Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1002\/leap.1214","article-title":"Why do researchers decide to publish in questionable journals? A review of the literature","volume":"32","author":"Frandsen","year":"2019","journal-title":"Learn Pub."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1177\/0011392113508127","article-title":"Peripheral scholarship and the context of foreign paid publishing in Nigeria","volume":"62","author":"Omobowale","year":"2014","journal-title":"Curr. Sociol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1002\/leap.1167","article-title":"Where Arab social science and humanities scholars choose to publish: Falling in the predatory journals trap","volume":"31","author":"Shehata","year":"2018","journal-title":"Learn Pub."},{"key":"ref_35","unstructured":"Davis, P. (2019, June 10). Open Access Publisher Accepts Nonsense Manuscript for Dollars. Scholarly Kitchen blog, 2009. Available online: http:\/\/scholarlykitchen.sspnet.org\/2009\/06\/10\/nonsense-for-dollars."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.outlook.2017.05.005","article-title":"Quality of articles published in predatory nursing journals","volume":"66","author":"Oermann","year":"2018","journal-title":"Nurs. Outlook"},{"key":"ref_37","first-page":"427","article-title":"How questionable are predatory social science journals?","volume":"18","author":"McCutcheon","year":"2016","journal-title":"N. Am. J. Psy."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1087\/20150105","article-title":"Penetration of Nigerian predatory biomedical open access journals 2007\u20132012: A bibiliometric study","volume":"28","author":"Nwagwu","year":"2015","journal-title":"Learn Pub."},{"key":"ref_39","unstructured":"Andersson, R. (2019, October 28). Citation Contamination: References to Predatory Journals in the Legitimate Scientific Literature. Scholarly Kitchen Blog. Available online: https:\/\/scholarlykitchen.sspnet.org\/2019\/10\/28\/citation-contamination-references-to-predatory-journals-in-the-legitimate-scientific-literature\/."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1007\/s11192-017-2520-x","article-title":"Are predatory journals undermining the credibility of science? A bibliometric analysis of citers","volume":"113","author":"Frandsen","year":"2017","journal-title":"Scientometrics"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.joi.2016.11.008","article-title":"Can we use Google Scholar to identify highly-cited documents?","volume":"11","author":"Harzing","year":"2017","journal-title":"J. Informetr."},{"key":"ref_42","first-page":"50","article-title":"The open access citation advantage: Does it exist and what does it mean for libraries?","volume":"37","author":"Lewis","year":"2018","journal-title":"Inf. Technol. Libr."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1002\/asi.23694","article-title":"Are Wikipedia citations important evidence of the impact of scholarly articles and books?","volume":"68","author":"Kousha","year":"2017","journal-title":"J. Assoc. Inf. Sci. Tech."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2116","DOI":"10.1002\/asi.23687","article-title":"Amplifying the impact of open access: Wikipedia and the diffusion of science","volume":"68","author":"Teplitskiy","year":"2017","journal-title":"J. Assoc. Inf. Sci. Tech."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"755","DOI":"10.31269\/triplec.v15i2.867","article-title":"Who is actually harmed by predatory publishers?","volume":"15","author":"Eve","year":"2017","journal-title":"TripleC: Commun. Capital. Crit."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1002\/asi.24124","article-title":"Social media presence of scholarly journals","volume":"70","author":"Zheng","year":"2019","journal-title":"J. Assoc. Inf. Sci. Tech."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1038\/550188e","article-title":"Predatory journals: Research that isn\u2019t read doesn\u2019t exist","volume":"550","author":"Donovan","year":"2017","journal-title":"Nat. News Comment"}],"container-title":["Publications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2304-6775\/8\/2\/17\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:11:54Z","timestamp":1760173914000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2304-6775\/8\/2\/17"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,26]]},"references-count":47,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["publications8020017"],"URL":"https:\/\/doi.org\/10.3390\/publications8020017","relation":{},"ISSN":["2304-6775"],"issn-type":[{"value":"2304-6775","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,26]]}}}