{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,1]],"date-time":"2026-03-01T14:19:16Z","timestamp":1772374756222,"version":"3.50.1"},"reference-count":24,"publisher":"MIT Press","issue":"2","license":[{"start":{"date-parts":[[2024,3,25]],"date-time":"2024-03-25T00:00:00Z","timestamp":1711324800000},"content-version":"vor","delay-in-days":84,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The United Nations (UN) Sustainable Development Goals (SDGs) challenge the global community to build a world where no one is left behind. Recognizing that research plays a fundamental part in supporting these goals, attempts have been made to classify research publications according to their relevance in supporting each of the UN\u2019s SDGs. In this paper, we outline the methodology that we followed when mapping research articles to SDGs and which is adopted by Times Higher Education in its Social Impact rankings. We compare our solution with other existing queries and models mapping research papers to SDGs. We also discuss various aspects in which the methodology can be improved and generalized to other types of content apart from research articles. The results presented in this paper are the outcome of the SDG Research Mapping Initiative, which was established as a partnership between the University of Southern Denmark, the Aurora European Universities Alliance (represented by Vrije Universiteit Amsterdam), the University of Auckland, and Elsevier to bring together broad expertise and share best practices on identifying research contributions to UN\u2019s Sustainable Development Goals.<\/jats:p>","DOI":"10.1162\/qss_a_00304","type":"journal-article","created":{"date-parts":[[2024,3,25]],"date-time":"2024-03-25T13:35:34Z","timestamp":1711373734000},"page":"408-425","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":21,"title":["Evaluating approaches to identifying research supporting the United Nations Sustainable Development Goals"],"prefix":"10.1162","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9445-9637","authenticated-orcid":true,"given":"Yury","family":"Kashnitsky","sequence":"first","affiliation":[{"name":"Elsevier BV, Amsterdam, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4970-424X","authenticated-orcid":true,"given":"Guillaume","family":"Roberge","sequence":"additional","affiliation":[{"name":"Elsevier BV, Montreal, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7839-8678","authenticated-orcid":true,"given":"Jingwen","family":"Mu","sequence":"additional","affiliation":[{"name":"The University of Auckland Faculty of Science, Auckland, New Zealand"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8001-1097","authenticated-orcid":true,"given":"Kevin","family":"Kang","sequence":"additional","affiliation":[{"name":"The University of Auckland Faculty of Science, Auckland, New Zealand"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1507-1322","authenticated-orcid":true,"given":"Weiwei","family":"Wang","sequence":"additional","affiliation":[{"name":"The University of Auckland Faculty of Science, Auckland, New Zealand"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6397-4759","authenticated-orcid":true,"given":"Maurice","family":"Vanderfeesten","sequence":"additional","affiliation":[{"name":"Vrije Universiteit Amsterdam, Amsterdam, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1196-4679","authenticated-orcid":true,"given":"Maxime","family":"Rivest","sequence":"additional","affiliation":[{"name":"Elsevier BV, Montreal, Canada"},{"name":"McGill University, Montreal, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-7645-9148","authenticated-orcid":true,"given":"Savvas","family":"Chamezopoulos","sequence":"additional","affiliation":[{"name":"Elsevier BV, Amsterdam, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6419-640X","authenticated-orcid":true,"given":"Robert","family":"Jaworek","sequence":"additional","affiliation":[{"name":"Palacky University Olomouc, Olomouc, Czech Republic"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4768-9648","authenticated-orcid":true,"given":"Ma\u00e9va","family":"Vignes","sequence":"additional","affiliation":[{"name":"University of Southern Denmark, Odense, Denmark"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2751-1463","authenticated-orcid":true,"given":"Bamini","family":"Jayabalasingham","sequence":"additional","affiliation":[{"name":"Elsevier BV, Amsterdam, Netherlands"},{"name":"Elsevier BV, New York, NY, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-4929-0774","authenticated-orcid":true,"given":"Finne","family":"Boonen","sequence":"additional","affiliation":[{"name":"Elsevier BV, Amsterdam, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1619-5204","authenticated-orcid":true,"given":"Chris","family":"James","sequence":"additional","affiliation":[{"name":"Elsevier BV, Amsterdam, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6319-850X","authenticated-orcid":true,"given":"Marius","family":"Doornenbal","sequence":"additional","affiliation":[{"name":"Elsevier BV, Amsterdam, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-4643-4000","authenticated-orcid":true,"given":"Isabelle","family":"Labrosse","sequence":"additional","affiliation":[{"name":"Elsevier BV, Montreal, Canada"}]}],"member":"281","published-online":{"date-parts":[[2024,5,1]]},"reference":[{"key":"2024060614393706400_bib1","doi-asserted-by":"publisher","DOI":"10.18710\/98CMDR","volume-title":"Replication data for: Mapping scholarly publications related to the Sustainable Development Goals: Do independent bibliometric approaches get the same results?","author":"Armitage","year":"2020"},{"issue":"3","key":"2024060614393706400_bib2","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1162\/qss_a_00071","article-title":"Mapping scholarly publications related to the Sustainable Development Goals: Do independent bibliometric approaches get the same results?","volume":"1","author":"Armitage","year":"2020","journal-title":"Quantitative Science Studies"},{"key":"2024060614393706400_bib3","doi-asserted-by":"publisher","DOI":"10.17632\/y2zyy9vwzy.1","volume-title":"Elsevier 2023 Sustainable Development Goals (SDGs) mapping","author":"Bedard-Vallee","year":"2023"},{"key":"2024060614393706400_bib4","doi-asserted-by":"publisher","first-page":"106731","DOI":"10.1016\/j.dib.2021.106731","article-title":"Dataset of search queries to map scientific publications to the UN sustainable development goals","volume":"34","author":"Bordignon","year":"2021","journal-title":"Data in Brief"},{"key":"2024060614393706400_bib5","volume-title":"Countries\u2019 research priorities in relation to the Sustainable Development Goals","author":"Confraria","year":"2022"},{"key":"2024060614393706400_bib6","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.3567769","article-title":"A controlled vocabulary defining the semantic perimeter of Sustainable Development Goals (1.2) [Data set]","author":"Duran-Silva","year":"2019","journal-title":"Zenodo"},{"key":"2024060614393706400_bib7","doi-asserted-by":"publisher","DOI":"10.17632\/87txkw7khs.1","article-title":"Identifying research supporting the United Nations Sustainable Development Goals (Version 1.0) [Data set]","author":"Jayabalasingham","year":"2019","journal-title":"Mendeley"},{"key":"2024060614393706400_bib8","volume-title":"The University of Auckland SDG keywords mapping","author":"Jingwen","year":"2022"},{"key":"2024060614393706400_bib9","volume-title":"Art is long, life is short: An SDG Classification System for DESA Publications","author":"LaFleur","year":"2019"},{"key":"2024060614393706400_bib10","volume-title":"Navigating the structure of research on sustainable development goals","author":"Nakamura","year":"2019"},{"key":"2024060614393706400_bib11","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2005.14569","article-title":"OSDG\u2014Open-source approach to classify text data by UN Sustainable Development Goals [Data set]","author":"Pukelis","year":"2020","journal-title":"arXiv"},{"issue":"4","key":"2024060614393706400_bib12","doi-asserted-by":"publisher","first-page":"976","DOI":"10.1162\/qss_a_00215","article-title":"A comparison of different methods of identifying publications related to the United Nations Sustainable Development Goals: Case study of SDG 13\u2014Climate action","volume":"3","author":"Purnell","year":"2022","journal-title":"Quantitative Science Studies"},{"key":"2024060614393706400_bib13","doi-asserted-by":"publisher","DOI":"10.17632\/9sxdykm8s4.1","article-title":"Improving the Scopus and Aurora queries to identify research that supports the United Nations Sustainable Development Goals (SDGs) 2021 (Version 3.0) [Data set]","author":"Rivest","year":"2021","journal-title":"Mendeley"},{"key":"2024060614393706400_bib14","doi-asserted-by":"publisher","DOI":"10.17632\/6bjy52jkm9.1","article-title":"Elsevier 2022 Sustainable Development Goals (SDG) Mapping (Version 1.0) [Data set]","author":"Roberge","year":"2022","journal-title":"Digital Commons Data"},{"key":"2024060614393706400_bib15","article-title":"Conjunto de datos: Categorization of articles 2017 with authorship of Pontificia Universidad Cat\u00f3lica de Chile, through the SDGS [Data set]","author":"Rodr\u00edguez","year":"2021"},{"key":"2024060614393706400_bib16","volume-title":"Impact rankings 2022: Methodology","author":"Ross","year":"2022"},{"key":"2024060614393706400_bib17","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4917171","article-title":"Evaluation on accuracy of mapping science to the United Nations\u2019 Sustainable Development Goals (SDGs) of the Aurora SDG queries","author":"Schmidt","year":"2021","journal-title":"Zenodo"},{"key":"2024060614393706400_bib18","volume-title":"South African SDG Hub","author":"South African SDG Hub","year":"2023"},{"key":"2024060614393706400_bib19","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.6487606","article-title":"AI for mapping multi-lingual academic papers to the United Nations\u2019 Sustainable Development Goals (SDGs)","author":"Vanderfeesten","year":"2022","journal-title":"Zenodo"},{"key":"2024060614393706400_bib20","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4883250","article-title":"Search queries for \u201cMapping Research Output to the Sustainable Development Goals (SDGs)\u201d (Version 5.0.2) [Data set]","author":"Vanderfeesten","year":"2020","journal-title":"Zenodo"},{"key":"2024060614393706400_bib21","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2544385\/v2","article-title":"Mapping research to the Sustainable Development Goals (SDGs), PREPRINT (Version 2)","author":"Wang","year":"2023","journal-title":"Research Square"},{"key":"2024060614393706400_bib22","doi-asserted-by":"publisher","DOI":"10.6084\/m9.figshare.12200081.v2","volume-title":"Contextualizing sustainable development research","author":"Wastl","year":"2020"},{"key":"2024060614393706400_bib23","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2301.11353","article-title":"Using novel data and ensemble models to improve automated labeling of Sustainable Development Goals","author":"Wulff","year":"2023","journal-title":"arXiv"},{"key":"2024060614393706400_bib24","doi-asserted-by":"publisher","first-page":"516","DOI":"10.1109\/DSAA49011.2020.00066","article-title":"Matching research publications to the United Nations\u2019 Sustainable Development Goals by multi-label-learning with hierarchical categories","volume-title":"IEEE 7th International Conference on Data Science and Advanced Analytics (DSAA)","author":"Zhang","year":"2020"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/5\/2\/408\/2376617\/qss_a_00304.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/5\/2\/408\/2376617\/qss_a_00304.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,6]],"date-time":"2024-06-06T10:39:53Z","timestamp":1717670393000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/5\/2\/408\/120309\/Evaluating-approaches-to-identifying-research"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"references-count":24,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,5,1]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00304","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00304\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00304\/v3\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00304\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00304\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00304\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00304\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00304\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00304\/v3\/decision1","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024]]},"published":{"date-parts":[[2024]]}}}