{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:30:07Z","timestamp":1777854607316,"version":"3.51.4"},"reference-count":20,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2025,5,1]],"date-time":"2025-05-01T00:00:00Z","timestamp":1746057600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,5,1]],"date-time":"2025-05-01T00:00:00Z","timestamp":1746057600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["Iscte_SIIC\/01\/2022"],"award-info":[{"award-number":["Iscte_SIIC\/01\/2022"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UIDB\/50008\/2020"],"award-info":[{"award-number":["UIDB\/50008\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UIDB\/50021\/2020"],"award-info":[{"award-number":["UIDB\/50021\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Science"],"abstract":"<jats:p>The number of citations received by a research paper is a vital metric for both researchers and institutions. Various indexing databases share common citations, facilitating cross-database comparison to identify citations missing from multiple databases, which are not contributing to the total citation count of a paper. To tackle this problem, we developed an automated method to detect missing citations by utilising multiple indexing databases. We focus on identifying missing citations in Web of Science and Scopus, using OpenAlex to enhance the process and demonstrate the benefits of cross-referencing databases for more comprehensive citation tracking. We compared the results of a previous experiment where we did not use Scopus. This way, we could measure the impact of adding Scopus to our approach. By using the same data set as before, the papers we were able to analyse increased from 1539 to 1989, and we were able to find a total of 1075 missing citations in Web of Science as opposed to the 696 we found without including Scopus. As for the results in Scopus, we identified 1137 missing citations in the same set of papers, totalling 2212 missing citations found. This outcome proves that these indexing databases cannot accurately detect all citations. Also, for more recent publications, we detected a bigger discrepancy in missing citations found in Web of Science when compared with Scopus. We can also conclude that adding different databases can provide us with better results and a more accurate view of the citation list of a paper.<\/jats:p>","DOI":"10.1177\/01655515251330579","type":"journal-article","created":{"date-parts":[[2025,5,1]],"date-time":"2025-05-01T12:05:11Z","timestamp":1746101111000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["Detecting incoherent citation data among three bibliometric platforms: OpenAlex, Scopus and Web of Science"],"prefix":"10.1177","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-1150-1217","authenticated-orcid":false,"given":"David","family":"Rodrigues","sequence":"first","affiliation":[{"name":"Iscte\u2013Instituto Universit\u00e1rio de Lisboa, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3045-0304","authenticated-orcid":false,"given":"Ant\u00f3nio","family":"Lopes","sequence":"additional","affiliation":[{"name":"Iscte\u2013Instituto Universit\u00e1rio de Lisboa, Portugal"},{"name":"Instituto de Telecomunica\u00e7\u00f5es, Iscte\u2013Instituto Universit\u00e1rio de Lisboa, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1075-0177","authenticated-orcid":false,"given":"Fernando","family":"Batista","sequence":"additional","affiliation":[{"name":"Iscte\u2013Instituto Universit\u00e1rio de Lisboa, Portugal"},{"name":"INESC-ID Lisboa, Portugal"}]}],"member":"179","published-online":{"date-parts":[[2025,5]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","unstructured":"Rodrigues D Lopes AL Batista F. Web of science citation gaps: an automatic approach to detect indexed but missing citations. In: Sim\u00f5es A Ber\u00f3n MM Portela F eds. 12th Symposium on Languages Applications and Technologies (SLATE 2023) Open Access Series in Informatics (OASIcs) volume 113. Dagstuhl Germany: Schloss Dagstuhl \u2013 Leibniz-Zentrum f\u00fcr Informatik. ISBN978-3-95977-291-4 2023 pp. 5:1\u20135:11. DOI: 10.4230\/OASIcs.SLATE.2023.5. https:\/\/drops.dagstuhl.de\/opus\/volltexte\/2023\/18519","DOI":"10.4230\/OASIcs.SLATE.2023.5"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","unstructured":"Garc\u00eda-P\u00e9rez MA. Accuracy and completeness of publication and citation records in the web of science PsycINFO and Google Scholar: a case study for the computation of H indices in psychology. J Am Soc Inf Sci Technol 2010; 61(10): 2070\u20132085. DOI: 10.1002\/asi.21372. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/asi.21372. https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.21372","DOI":"10.1002\/asi.21372"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","unstructured":"Moed HF Bar-Ilan J Halevi G. A new methodology for comparing Google Scholar and Scopus. J Informetr 2016; 10(2): 533\u2013551. DOI: 10.1016\/j.joi.2016.04.017. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1751157715302285","DOI":"10.1016\/j.joi.2016.04.017"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","unstructured":"Krauskopf E. Missing documents in Scopus: the case of the journal Enfermeria Nefrologica. Scientometrics 2019; 119: 543\u2013547. DOI: 10.1007\/s11192-019-03040-z. https:\/\/doi.org\/10.1007\/s11192-019-03040-z","DOI":"10.1007\/s11192-019-03040-z"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","unstructured":"Teplitskiy M Duede E Menietti M et al. How status of research papers affects the way they are read and cited. Res Policy 2022; 51(4): 104484. DOI: 10.1016\/j.respol.2022.104484. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0048733322000129","DOI":"10.1016\/j.respol.2022.104484"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","unstructured":"Buchanan RA. Accuracy of cited references: the role of citation databases. Coll Res Libr 2006; 67(4): 292\u2013303. DOI: 10.5860\/crl.67.4.292. https:\/\/crl.acrl.org\/index.php\/crl\/article\/view\/15806","DOI":"10.5860\/crl.67.4.292"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","unstructured":"Cioffi A Coppini S Massari A et al. Identifying and correcting invalid citations due to DOI errors in Crossref data. Scientometrics 2022; 127: 3593\u20133612. DOI: 10.1007\/s11192-022-04367-w. https:\/\/doi.org\/10.1007\/s11192-022-04367-w","DOI":"10.1007\/s11192-022-04367-w"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-018-2980-7"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","unstructured":"Franceschini F Maisano D Mastrogiacomo L. Errors in DOI indexing by bibliometric databases. Scientometrics 2015; 102: 2181\u20132186. DOI: 10.1007\/s11192-014-1503-4. https:\/\/doi.org\/10.1007\/s11192-014-1503-4","DOI":"10.1007\/s11192-014-1503-4"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","unstructured":"Rivkin A. Manuscript referencing errors and their impact on shaping current evidence. Am J Pharm Educ 2020; 84(7): ajpe7846. DOI: 10.5688\/ajpe7846. https:\/\/www.ajpe.org\/content\/84\/7\/ajpe7846. https:\/\/www.ajpe.org\/content\/84\/7\/ajpe7846.full.pdf","DOI":"10.5688\/ajpe7846"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","unstructured":"Tahamtan I Bornmann L. What do citation counts measure? An updated review of studies on citations in scientific documents published between 2006 and 2018. Scientometrics 2019; 121: 1635\u20131684. DOI: 10.1007\/s11192-019-03243-4. https:\/\/doi.org\/10.1007\/s11192-019-03243-4","DOI":"10.1007\/s11192-019-03243-4"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","unstructured":"Mart\u00edn-Mart\u00edn A Orduna-Malea E Delgado L\u00f3pez-C\u00f3zar E. Coverage of highly-cited documents in Google Scholar Web of Science and Scopus: a multidisciplinary comparison. Scientometrics 2018; 116: 2175\u20132188. DOI: 10.1007\/s11192-018-2820-9. https:\/\/doi.org\/10.1007\/s11192-018-2820-9","DOI":"10.1007\/s11192-018-2820-9"},{"key":"e_1_3_3_14_2","first-page":"48","article-title":"Ike Antkare one of the great stars in the scientific firmament","volume":"6","author":"Labb\u00e9 C.","year":"2010","unstructured":"Labb\u00e9 C. Ike Antkare one of the great stars in the scientific firmament. ISSI Newsl 2010; 6: 48\u201352.","journal-title":"ISSI Newsl"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","unstructured":"van Eck NJ Waltman L. Accuracy of citation data in Web of Science and Scopus. arXiv. Epub ahead of print June 2019. DOI: 10.48550\/ARXIV.1906.07011. https:\/\/arxiv.org\/abs\/1906.07011","DOI":"10.48550\/ARXIV.1906.07011"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","unstructured":"Franceschini F Maisano D Mastrogiacomo L. A novel approach for estimating the omitted-citation rate of bibliometric databases with an application to the field of bibliometrics. J Am Soc Inf Sci Technol 2013; 64(10): 2149\u20132156. DOI: 10.1002\/asi.22898. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/asi.22898. https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.22898","DOI":"10.1002\/asi.22898"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","unstructured":"Franceschini F Maisano D Mastrogiacomo L. Do Scopus and WoS correct \u2018old\u2019 omitted citations? Scientometrics 2016; 107: 321\u2013335. DOI: 10.1007\/s11192-016-1867-8. https:\/\/doi.org\/10.1007\/s11192-016-1867-8","DOI":"10.1007\/s11192-016-1867-8"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","unstructured":"Visser M van Eck NJ Waltman L. Large-scale comparison of bibliographic data sources: Scopus Web of Science Dimensions Crossref and Microsoft academic. Quant Sci Stud 2021; 2(1): 20\u201341. DOI: 10.1162\/qss_a_00112. https:\/\/doi.org\/10.1162\/qss_a_00112. https:\/\/direct.mit.edu\/qss\/article-pdf\/2\/1\/20\/1906541\/qss_a_00112.pdf","DOI":"10.1162\/qss_a_00112"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","unstructured":"Priem J Piwowar H Orr R. OpenAlex: a fully-open index of scholarly works authors venues institutions and concepts. arXiv. Epub ahead of print May 2022. DOI: 10.48550\/ARXIV.2205.01833. https:\/\/arxiv.org\/abs\/2205.01833","DOI":"10.48550\/ARXIV.2205.01833"},{"key":"e_1_3_3_20_2","doi-asserted-by":"crossref","unstructured":"Besan\u00e7on L Cabanac G Labb\u00e9 C et al. Sneaked references: Fabricated reference metadata distort citation counts. J Assoc Inf Sci Technol 2024; 75(12): 1368\u20131379. DOI: 10.1002\/asi.24896. https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/asi.24896","DOI":"10.1002\/asi.24896"},{"key":"e_1_3_3_21_2","first-page":"1","article-title":"Reference coverage analysis of OpenAlex compared to Web of Science and Scopus","author":"Culbert JH","year":"2025","unstructured":"Culbert JH, Hobert A, Jahn N, et al. Reference coverage analysis of OpenAlex compared to Web of Science and Scopus. Scientometrics 2025: 1\u201318. DOI: 10.1007\/s11192-025-05293-3. https:\/\/doi.org\/10.1007\/s11192-025-05293-3","journal-title":"Scientometrics"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515251330579","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01655515251330579","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515251330579","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:10:32Z","timestamp":1777504232000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01655515251330579"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5]]},"references-count":20,"alternative-id":["10.1177\/01655515251330579"],"URL":"https:\/\/doi.org\/10.1177\/01655515251330579","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5]]},"article-number":"01655515251330579"}}