{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T20:12:59Z","timestamp":1772827979412,"version":"3.50.1"},"reference-count":38,"publisher":"MIT Press","issue":"3","content-domain":{"domain":["www.mitpressjournals.org"],"crossmark-restriction":true},"short-container-title":["Quantitative Science Studies"],"published-print":{"date-parts":[[2020,8]]},"abstract":"<jats:p>Many research and higher education institutions are interested in their contribution to achieving the United Nation\u2019s Sustainable Development Goals (SDG). Commercial services from Elsevier and Times Higher Education are addressing this by developing bibliometric queries for measuring SDG-related publications and SDG university rankings. However, such services should be evaluated carefully before use due to the challenging nature of interpreting the SDGs, delimiting relevance, and building queries. The aim of this bibliometric study was to build independent queries to find scholarly publications related to SDG 1, SDG 2, SDG 3, SDG 7, SDG 13, and SDG 14 using a consistent method based on SDG targets and indicators (the Bergen approach), and compare sets of publications retrieved by the Bergen and Elsevier approaches. Our results show that approach made a large difference, with little overlap in publications retrieved by the two approaches. We further demonstrate that different approaches can alter resulting country rankings. Choice of search terms, how they are combined, and query structure play a role, related to differing interpretations of the SDGs and viewpoints on relevance. Our results suggest that currently available SDG rankings and tools should be used with caution at their current stage of development.<\/jats:p>","DOI":"10.1162\/qss_a_00071","type":"journal-article","created":{"date-parts":[[2020,6,15]],"date-time":"2020-06-15T20:51:24Z","timestamp":1592254284000},"page":"1092-1108","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":70,"title":["Mapping scholarly publications related to the Sustainable Development Goals: Do independent bibliometric approaches get the same results?"],"prefix":"10.1162","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2826-5935","authenticated-orcid":true,"given":"Caroline S.","family":"Armitage","sequence":"first","affiliation":[{"name":"University of Bergen Library, University of Bergen, Bergen, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8927-5948","authenticated-orcid":true,"given":"Marta","family":"Lorenz","sequence":"additional","affiliation":[{"name":"University of Bergen Library, University of Bergen, Bergen, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7078-7126","authenticated-orcid":true,"given":"Susanne","family":"Mikki","sequence":"additional","affiliation":[{"name":"University of Bergen Library, University of Bergen, Bergen, Norway"}]}],"member":"281","reference":[{"issue":"1","key":"bib1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2478\/jdis-2019-0001","volume":"4","author":"Aksnes D. W.","year":"2019","journal-title":"Journal of Data and Information Science"},{"key":"bib2","volume-title":"Replication data for: Mapping scholarly publications related to the Sustainable Development Goals: Do independent bibliometric approaches get the same results?","author":"Armitage C. S.","year":"2020"},{"key":"bib3","volume-title":"SDG analysis: Bibliometrics of relevance","author":"AURORA Universities Network"},{"issue":"1","key":"bib4","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1038\/nmat4834","volume":"16","author":"Chu S.","year":"2017","journal-title":"Nature Materials"},{"key":"bib5","author":"Duran-Silva N.","year":"2019","journal-title":"Zenodo"},{"key":"bib6","volume-title":"SciVal","author":"Elsevier","year":"2019"},{"key":"bib7","volume-title":"Policy Support and Governance; Food Loss and Food Waste","author":"Food and Agriculture Organization","year":"2019"},{"issue":"6303","key":"bib8","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1126\/science.aai8837","volume":"353","author":"Gluckman P.","year":"2016","journal-title":"Science"},{"issue":"7","key":"bib9","doi-asserted-by":"crossref","first-page":"e0160393","DOI":"10.1371\/journal.pone.0160393","volume":"11","author":"Haunschild R.","year":"2016","journal-title":"PLOS ONE"},{"issue":"1","key":"bib10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1787\/hemp-v21-art4-en","volume":"21","author":"Hazelkorn E.","year":"2009","journal-title":"Higher Education Management and Policy"},{"issue":"8","key":"bib11","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1002\/asi.23250","volume":"66","author":"Hj\u00f8rland B.","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"bib12","volume-title":"Review of Targets for the Sustainable Development Goals: The Science Perspective","author":"ICSU &amp; ISSC","year":"2015"},{"key":"bib13","volume-title":"Report of the Inter-agency and Expert Group on Sustainable Development Goal Indicators (E\/CN.3\/2017.2)","author":"Inter-agency Expert Group on SDG Indicators","year":"2017"},{"key":"bib14","volume-title":"Identifying research supporting the United Nations Sustainable Development Goals. Mendeley Data, v1 (2019-10-10)","author":"Jayabalasingham B.","year":"2019"},{"key":"bib15","doi-asserted-by":"crossref","unstructured":"Jetten, T. H., Veldhuizen, L. J. L., Siebert, M. & Darroch, P. I. (2019). An explorative study on a university\u2019s outreach in the field of UN Sustainable Development Goal 2 [Research report]. Retrieved from Wageningen University & Research: https:\/\/doi.org\/10.18174\/476199","DOI":"10.18174\/476199"},{"issue":"9","key":"bib16","doi-asserted-by":"crossref","first-page":"3295","DOI":"10.3390\/su10093295","volume":"10","author":"K\u00f6rfgen A.","year":"2018","journal-title":"Sustainability"},{"issue":"2","key":"bib17","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1080\/13504509.2017.1342103","volume":"25","author":"Leal Filho W.","year":"2018","journal-title":"International Journal of Sustainable Development & World Ecology"},{"issue":"1","key":"bib18","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/s11192-015-1765-5","volume":"106","author":"Mongeon P.","year":"2016","journal-title":"Scientometrics"},{"key":"bib19","volume-title":"Analyzing UN SDG research with SciVal\u2014The case of University of Auckland","author":"Mu J.","year":"2019"},{"key":"bib20","volume-title":"Navigating the Structure of Research on Sustainable Development Goals","author":"Nakamura M.","year":"2019"},{"issue":"5938","key":"bib21","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1126\/science.1178591","volume":"325","author":"Reid W. V.","year":"2009","journal-title":"Science"},{"key":"bib22","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1007\/978-3-319-09785-5_9","volume-title":"Incentives and Performance: Governance of Research Organizations","author":"Schmoch U.","year":"2015"},{"key":"bib23","volume-title":"How to participate in Times Higher Education rankings","author":"Times Higher Education","year":"2018"},{"key":"bib24","volume-title":"THE University Impact Rankings 2019: Methodology","author":"Times Higher Education","year":"2019"},{"issue":"3","key":"bib25","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1089\/sus.2018.0037","volume":"12","author":"Torabian J.","year":"2019","journal-title":"Sustainability: The Journal of Record"},{"key":"bib26","volume-title":"The Millennium Development Goals Report 2015 Summary","author":"United Nations","year":"2015"},{"key":"bib27","volume-title":"Transforming our world: The 2030 Agenda for Sustainable Development","author":"United Nations","year":"2015"},{"key":"bib28","volume-title":"2018 HLPF Review of SDG implementation: SDG 7- Ensure access to affordable, reliable, sustainable and modern energy for all","author":"United Nations","year":"2018"},{"key":"bib29","volume-title":"Academic Impact; About UNAI","author":"United Nations","year":"2019"},{"key":"bib30","volume-title":"Review of SDG implementation and interrelations among goals. Discussion on SDG 13\u2014Climate action","author":"United Nations","year":"2019"},{"key":"bib31","volume-title":"2017 HLPF Thematic Review of SDG 1: End poverty in all its forms everywhere","author":"United Nations (ECESA plus)","year":"2017"},{"key":"bib32","volume-title":"2017 HLPF Thematic review of SDG2: End hunger, achieve food security and improved nutrition, and promote sustainable agriculture","author":"United Nations (ECESA plus)","year":"2017"},{"key":"bib33","volume-title":"2017 HLPF Thematic Review of SDG3: Ensure healthy lives and promote well-being for all at all ages","author":"United Nations (ECESA plus)","year":"2017"},{"key":"bib34","volume-title":"2017 HLFP Thematic Review of SDG 14: Conserve and sustainably use the oceans, seas and marine resources for sustainable development","author":"United Nations (ECESA plus)","year":"2017"},{"key":"bib35","volume-title":"Sustainable Development Goals: Guidelines for the use of the SDG logo including the colour wheel, and 17 icons","author":"United Nations Department of Global Communications","year":"2019"},{"key":"bib36","volume-title":"Capacity Development, UNDAF companion guidance","author":"United Nations Development Group","year":"2017"},{"issue":"2","key":"bib37","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1007\/s11192-009-0146-3","volume":"84","author":"Van Eck N. J.","year":"2010","journal-title":"Scientometrics"},{"issue":"3","key":"bib38","doi-asserted-by":"crossref","first-page":"1803","DOI":"10.1007\/s11192-019-03264-z","volume":"121","author":"Vera-Baceta M. A.","year":"2019","journal-title":"Scientometrics"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/qss_a_00071","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,2]],"date-time":"2023-10-02T11:37:01Z","timestamp":1696246621000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/1\/3\/1092-1108\/96106"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8]]},"references-count":38,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,8]]}},"alternative-id":["10.1162\/qss_a_00071"],"URL":"https:\/\/doi.org\/10.1162\/qss_a_00071","relation":{},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8]]},"assertion":[{"value":"2020-01-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-29","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}