{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T23:30:07Z","timestamp":1782516607073,"version":"3.54.5"},"reference-count":49,"publisher":"MIT Press","issue":"1","license":[{"start":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T00:00:00Z","timestamp":1680739200000},"content-version":"vor","delay-in-days":95,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"publisher","award":["UMO-2017\/26\/E\/HS2\/00019"],"award-info":[{"award-number":["UMO-2017\/26\/E\/HS2\/00019"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This study uses content-based citation analysis to move beyond the simplified classification of predatory journals. We present that, when we analyze papers not only in terms of the quantity of their citations but also the content of these citations, we are able to show the various roles played by papers published in journals accused of being predatory. To accomplish this, we analyzed the content of 9,995 citances (i.e., citation sentences) from 6,706 papers indexed in the Web of Science Core Collection, which cites papers published in so-called \u201cpredatory\u201d (or questionable) journals. The analysis revealed that the vast majority of such citances are neutral (97.3%), and negative citations of articles published in the analyzed journals are almost completely nonexistent (0.8%). Moreover, the analysis revealed that the most frequently mentioned countries in the citances are India, Pakistan, and Iran, with mentions of Western countries being rare. This highlights a geopolitical bias and shows the usefulness of looking at such journals as mislocated centers of scholarly communication. The analyzed journals provide regional data prevalent for mainstream scholarly discussions, and the idea of predatory publishing hides geopolitical inequalities in global scholarly publishing. Our findings also contribute to the further development of content-based citation analysis.<\/jats:p>","DOI":"10.1162\/qss_a_00242","type":"journal-article","created":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T11:23:15Z","timestamp":1675423395000},"page":"44-67","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":18,"title":["Are papers published in predatory journals worthless? A geopolitical dimension revealed by content-based analysis of citations"],"prefix":"10.1162","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7102-493X","authenticated-orcid":true,"given":"Zehra","family":"Ta\u015fk\u0131n","sequence":"first","affiliation":[{"name":"Department of Information Management, Hacettepe University, Ankara, Turkey"},{"name":"Scholarly Communication Research Group, Adam Mickiewicz University, Pozna\u0144, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1097-9032","authenticated-orcid":true,"given":"Franciszek","family":"Krawczyk","sequence":"additional","affiliation":[{"name":"Scholarly Communication Research Group, Adam Mickiewicz University, Pozna\u0144, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6530-3609","authenticated-orcid":true,"given":"Emanuel","family":"Kulczycki","sequence":"additional","affiliation":[{"name":"Scholarly Communication Research Group, Adam Mickiewicz University, Pozna\u0144, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2023,3,1]]},"reference":[{"key":"2023040615410482700_","first-page":"80","article-title":"Reference scope identification in citing sentences","volume-title":"Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Abu-Jbara","year":"2012"},{"key":"2023040615410482700_","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.6282403","volume-title":"Action plan for diamond open access","author":"Ancion","year":"2022"},{"key":"2023040615410482700_","first-page":"81","article-title":"Sentiment analysis of citations using sentence structure-based features","volume-title":"Proceedings of the ACL 2011 Student Session","author":"Athar","year":"2011"},{"issue":"7415","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1038\/489179a","article-title":"Predatory publishers are corrupting open access","volume":"489","author":"Beall","year":"2012","journal-title":"Nature"},{"key":"2023040615410482700_","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/10747.003.0018","article-title":"Scientific soundness and the problem of predatory journals","volume-title":"Pseudoscience: The conspiracy against science","author":"Beall","year":"2018"},{"issue":"4","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1002\/asi.4630330404","article-title":"Characteristics of a literature as predictors of relatedness between cited and citing works","volume":"33","author":"Bonzi","year":"1982","journal-title":"Journal of the American Society for Information Science"},{"issue":"2","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/BF02017571","article-title":"Motivations for citation: A comparison of self citation and citation to others","volume":"21","author":"Bonzi","year":"1991","journal-title":"Scientometrics"},{"issue":"1","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1002\/asi.4630370106","article-title":"Evidence of complex citer motivations","volume":"37","author":"Brooks","year":"1986","journal-title":"Journal of the American Society for Information Science"},{"key":"2023040615410482700_","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctt5hjn6c","volume-title":"A geopolitics of academic writing","author":"Canagarajah","year":"2002"},{"issue":"4","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1002\/(SICI)1097-4571(198907)40:4&lt;284::AID-ASI10&gt;3.0.CO;2-Z","article-title":"Citation behavior: Classification, utility, and location","volume":"40","author":"Cano","year":"1989","journal-title":"Journal of the American Society for Information Science"},{"issue":"4","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1177\/030631277500500403","article-title":"Content analysis of references: Adjunct or alternative to citation counting?","volume":"5","author":"Chubin","year":"1975","journal-title":"Social Studies of Science"},{"key":"2023040615410482700_","article-title":"New WoS April 29 Release Notes","author":"Clarivate","year":"2021"},{"issue":"1","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1108\/eb026703","article-title":"The need for a theory of citing","volume":"37","author":"Cronin","year":"1981","journal-title":"Journal of Documentation"},{"issue":"4","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"1296","DOI":"10.1016\/j.joi.2018.10.008","article-title":"Predatory journals: Who publishes in them and why?","volume":"12","author":"Demir","year":"2018","journal-title":"Journal of Informetrics"},{"issue":"2","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"755","DOI":"10.31269\/triplec.v15i2.867","article-title":"Who is actually harmed by predatory publishers?","volume":"15","author":"Eve","year":"2017","journal-title":"TripleC"},{"issue":"11","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"e0224541","DOI":"10.1371\/journal.pone.0224541","article-title":"Identifying publications in questionable journals in the context of performance-based research funding","volume":"14","author":"Eykens","year":"2019","journal-title":"PLOS ONE"},{"issue":"3","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"1513","DOI":"10.1007\/s11192-017-2520-x","article-title":"Are predatory journals undermining the credibility of science? A bibliometric analysis of citers","volume":"113","author":"Frandsen","year":"2017","journal-title":"Scientometrics"},{"key":"2023040615410482700_","first-page":"84","article-title":"Can citation indexing be automated?","volume":"1","author":"Garfield","year":"1970","journal-title":"Essays of an Information Scientist"},{"issue":"7786","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1038\/d41586-019-03759-y","article-title":"Predatory journals: No definition, no defence","volume":"576","author":"Grudniewicz","year":"2019","journal-title":"Nature"},{"issue":"7548","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1038\/520429a","article-title":"Bibliometrics: The Leiden Manifesto for research metrics","volume":"520","author":"Hicks","year":"2015","journal-title":"Nature"},{"issue":"8","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"6551","DOI":"10.1007\/s11192-021-04055-1","article-title":"A decade of in-text citation analysis based on natural language processing and machine learning techniques: An overview of empirical studies","volume":"126","author":"Iqbal","year":"2021","journal-title":"Scientometrics"},{"issue":"3","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1177\/0015732519854934","article-title":"Economic effects of tariff liberalization of prospective India-GCC FTA: A computable general equilibrium analysis","volume":"54","author":"Ismail","year":"2019","journal-title":"Foreign Trade Review"},{"issue":"6","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1086\/693896","article-title":"The pharmaceutical assemblage: Rethinking Sowa Rigpa and the herbal pharmaceutical industry in Asia","volume":"58","author":"Kloos","year":"2017","journal-title":"Current Anthropology"},{"issue":"2","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"102271","DOI":"10.1016\/j.acalib.2020.102271","article-title":"How is open access accused of being predatory? The impact of Beall\u2019s lists of predatory journals on academic publishing","volume":"47","author":"Krawczyk","year":"2021","journal-title":"Journal of Academic Librarianship"},{"issue":"1","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"1984641","DOI":"10.1080\/25729861.2021.1984641","article-title":"On the geopolitics of academic publishing: The mislocated centers of scholarly communication","volume":"4","author":"Krawczyk","year":"2021","journal-title":"Tapuya: Latin American Science, Technology and Society"},{"key":"2023040615410482700_","doi-asserted-by":"publisher","DOI":"10.1177\/01655515221087674","article-title":"Questionable conferences and presenters from top-ranked universities","author":"Kulczycki","year":"2022","journal-title":"Journal of Information Science"},{"issue":"10","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"8541","DOI":"10.1007\/s11192-021-04121-8","article-title":"Citation patterns between impact-factor and questionable journals","volume":"126","author":"Kulczycki","year":"2021","journal-title":"Scientometrics"},{"issue":"45","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"13823","DOI":"10.1073\/pnas.1502280112","article-title":"The incidence and role of negative citations in science","volume":"112","author":"Lacetera","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"8","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"1566","DOI":"10.1080\/03075079.2021.1942822","article-title":"What drives global science? The four competing narratives","volume":"47","author":"Marginson","year":"2021","journal-title":"Studies in Higher Education"},{"issue":"6","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"530","DOI":"10.1002\/(SICI)1097-4571(19980501)49:6&lt;530::AID-ASI5&gt;3.0.CO;2-8","article-title":"Citation context versus the frequency counts of citation histories","volume":"49","author":"Mari\u010di\u0107","year":"1998","journal-title":"Journal of the American Society for Information Science"},{"key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1007\/s11192-020-03729-6","article-title":"Citation contagion: A citation analysis of selected predatory marketing journals","volume":"126","author":"Moussa","year":"2021","journal-title":"Scientometrics"},{"key":"2023040615410482700_","first-page":"81","article-title":"Citances: Citation sentences for semantic analysis of bioscience text","volume-title":"Proceedings of the SIGIR\u201904 Workshop on Search and Discovery in Bioinformatics","author":"Nakov","year":"2004"},{"issue":"3","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"882","DOI":"10.1162\/qss_a_00146","article-title":"scite: A smart citation index that displays the context of citations and classifies their intent using deep learning","volume":"2","author":"Nicholson","year":"2021","journal-title":"Quantitative Science Studies"},{"issue":"3","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1111\/jnu.12557","article-title":"Analysis of citation patterns and impact of predatory sources in the nursing literature","volume":"52","author":"Oermann","year":"2020","journal-title":"Journal of Nursing Scholarship"},{"key":"2023040615410482700_","volume-title":"DORA","author":"Read the Declaration","year":".."},{"issue":"6423","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1126\/science.363.6423.111","article-title":"How to shine in Indonesian science? Game the system","volume":"363","author":"Rochmyaningsih","year":"2019","journal-title":"Science"},{"key":"2023040615410482700_","doi-asserted-by":"publisher","DOI":"10.4324\/9780203767016","volume-title":"Centers and peripheries in knowledge production","author":"Rodriguez Medina","year":"2014"},{"key":"2023040615410482700_","article-title":"Sfdora.Org","author":"San Francisco Declaration on Research Assessment","year":".."},{"issue":"11","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"1386","DOI":"10.1002\/asi.24339","article-title":"Demarcating spectrums of predatory publishing: Economic and institutional sources of academic legitimacy","volume":"71","author":"Siler","year":"2020","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"2023040615410482700_","first-page":"203","article-title":"Do you sincerely want to be cited? Or: Read before you cite","volume-title":"Scholarly metrics under the microscope: From citation analysis to academic auditing","author":"Simkin","year":"2015"},{"issue":"1","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1177\/030631277700700111","article-title":"Science studies: Bibliometric and content analysis","volume":"7","author":"Spiegel-Rosing","year":"1977","journal-title":"Social Studies of Science"},{"issue":"1","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1007\/s11192-017-2560-2","article-title":"A content-based citation analysis study based on text categorization","volume":"114","author":"Ta\u015fk\u0131n","year":"2018","journal-title":"Scientometrics"},{"issue":"1","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"102481","DOI":"10.1016\/j.acalib.2021.102481","article-title":"An integrated paradigm shift to deal with \u2018predatory publishing\u2019","volume":"48","author":"Teixeira da Silva","year":"2022","journal-title":"Journal of Academic Librarianship"},{"key":"2023040615410482700_","volume-title":"Argumentative zoning: Information extraction from scientific text","author":"Teufel","year":"1999"},{"key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/B978-012691360-6\/50005-7","article-title":"Interrater reliability and agreement","volume-title":"Handbook of applied multivariate statistics and mathematical modeling","author":"Tinsley","year":"2000"},{"key":"2023040615410482700_","first-page":"19","article-title":"Are all citations equal? Or, Did we op. cit. your idem?","volume-title":"Journal of Academic Librarianship","author":"Voos","year":"1976"},{"key":"2023040615410482700_","doi-asserted-by":"publisher","DOI":"10.13140\/RG.2.1.4929.1363","volume-title":"The metric tide: Report of the independent review of the role of metrics in research assessment and management","author":"Wilsdon","year":"2015"},{"issue":"1","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.joi.2013.11.001","article-title":"Classification method for detecting coercive self-citation in journals","volume":"8","author":"Yu","year":"2014","journal-title":"Journal of Informetrics"},{"issue":"2","key":"2023040615410482700_","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1002\/asi.23179","article-title":"Measuring academic influence: Not all citations are equal","volume":"66","author":"Zhu","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/4\/1\/44\/2078463\/qss_a_00242.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/4\/1\/44\/2078463\/qss_a_00242.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T11:42:35Z","timestamp":1680781355000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/4\/1\/44\/114726\/Are-papers-published-in-predatory-journals"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3,1]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00242","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v3\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v3\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v1\/review3","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00242\/v2\/review2","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}