{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T06:53:27Z","timestamp":1789714407634,"version":"4.0.1"},"reference-count":49,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2022,9,22]],"date-time":"2022-09-22T00:00:00Z","timestamp":1663804800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Climate change is an ongoing topic in nearly all areas of society since many years. A discussion of climate change without referring to scientific results is not imaginable. This is especially the case for policies since action on the macro scale is required to avoid costly consequences for society. In this study, we deal with the question of how research on climate change and policy are connected. In 2019, the new Overton database of policy documents was released including links to research papers that are cited by policy documents. The use of results and recommendations from research on climate change might be reflected in citations of scientific papers in policy documents. Although we suspect a lot of uncertainty related to the coverage of policy documents in Overton, there seems to be an impact of international climate policy cycles on policy document publication. We observe local peaks in climate policy documents around major decisions in international climate diplomacy. Our results point out that IGOs and think tanks\u2013with a focus on climate change\u2013have published more climate change policy documents than expected. We found that climate change papers that are cited in climate change policy documents received significantly more citations on average than climate change papers that are not cited in these documents. Both areas of society (science and policy) focus on similar climate change research fields: biology, earth sciences, engineering, and disease sciences. Based on these and other empirical results in this study, we propose a simple model of policy impact considering a chain of different document types: The chain starts with scientific assessment reports (systematic reviews) that lead via science communication documents (policy briefs, policy reports or plain language summaries) and government reports to legislative documents.<\/jats:p>","DOI":"10.1371\/journal.pone.0274693","type":"journal-article","created":{"date-parts":[[2022,9,22]],"date-time":"2022-09-22T18:22:48Z","timestamp":1663870968000},"page":"e0274693","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":50,"title":["How relevant is climate change research for climate change policy? An empirical analysis based on Overton data"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0810-7091","authenticated-orcid":true,"given":"Lutz","family":"Bornmann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robin","family":"Haunschild","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7814-8951","authenticated-orcid":true,"given":"Kevin","family":"Boyack","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Werner","family":"Marx","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan C.","family":"Minx","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2022,9,22]]},"reference":[{"issue":"41","key":"pone.0274693.ref001","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1080\/14786449608620846","article-title":"On the influence of carbonic acid in the air upon the temperature of the ground","volume":"5","author":"S. Arrhenius","year":"1896","journal-title":"Philosophical Magazine and Journal of Science Series"},{"key":"pone.0274693.ref002","author":"SR Weart","year":"2008"},{"key":"pone.0274693.ref003","author":"IPCC","year":"2014"},{"key":"pone.0274693.ref004","author":"IPCC","year":"2021"},{"issue":"6192","key":"pone.0274693.ref005","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1126\/science.1255998","article-title":"Mapmakers and navigators, facts and values","volume":"345","author":"O Edenhofer","year":"2014","journal-title":"Science"},{"key":"pone.0274693.ref006","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511721731","volume-title":"A history of the science and politics of climate change: The role of the Intergovernmental Panel on Climate Change.","author":"B. Bolin","year":"2007"},{"issue":"8","key":"pone.0274693.ref007","article-title":"A multistage crucible of revision and approval shapes IPCC policymaker summaries","volume":"2","author":"KJ Mach","year":"2016","journal-title":"Science Advances"},{"issue":"6256","key":"pone.0274693.ref008","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1126\/science.aaa8976","article-title":"Added value from IPCC approval sessions","volume":"350","author":"CB Field","year":"2015","journal-title":"Science"},{"key":"pone.0274693.ref009","first-page":"157","article-title":"A bibliometrics-based research framework for exploring policy evolution: A case study of China\u2019s information technology policies","author":"C Yang","year":"2020","journal-title":"Technological Forecasting and Social Change"},{"key":"pone.0274693.ref010","article-title":"Machine-learning-based evidence and attribution mapping of 100,000 climate impact studies","author":"M Callaghan","year":"2021","journal-title":"Nat Clim Change"},{"issue":"6525","key":"pone.0274693.ref011","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1126\/science.abe3084","article-title":"Coevolution of policy and science during the pandemic","volume":"371","author":"Y Yin","year":"2021","journal-title":"Science"},{"key":"pone.0274693.ref012","first-page":"347","volume-title":"Theories of informetrics and scholarly communication.","author":"L. Bornmann","year":"2016"},{"issue":"1","key":"pone.0274693.ref013","doi-asserted-by":"crossref","first-page":"e290102","DOI":"10.3145\/epi.2020.ene.02","article-title":"Altmetrics and societal impact measurements: Match or mismatch? A literature review.","volume":"29","author":"I Tahamtan","year":"2020","journal-title":"El Profesional de la Informaci\u00f3n"},{"key":"pone.0274693.ref014","article-title":"New possibilities of studying the interactions between policy and science: A descriptive exploration of the policy documents indexed by Overton.","author":"Z Fang","journal-title":"Quantitative Science Studies. in press"},{"issue":"7307","key":"pone.0274693.ref015","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1136\/bmj.323.7307.275","article-title":"Evidence based policy: Proceed with care","volume":"323","author":"N Black","year":"2001","journal-title":"British Medical Journal"},{"issue":"5","key":"pone.0274693.ref016","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1007\/s12115-014-9820-z","article-title":"The political epistemology of science-based policy-making","volume":"51","author":"DB Pedersen","year":"2014","journal-title":"Society"},{"key":"pone.0274693.ref017","volume-title":"Project acronym: OpenUP","author":"European Commission","year":"2016"},{"issue":"3","key":"pone.0274693.ref018","doi-asserted-by":"crossref","first-page":"1681","DOI":"10.1007\/s11192-017-2544-2","article-title":"Types of evidence cited in Australian Government publications.","volume":"113","author":"S Vilkins","year":"2017","journal-title":"Scientometrics"},{"key":"pone.0274693.ref019","author":"T. Arthur","year":"2016","journal-title":"Categorizing policy document citations in PlumX"},{"key":"pone.0274693.ref020","author":"A Michalek","year":"2017"},{"issue":"3","key":"pone.0274693.ref021","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1007\/s11192-016-2115-y","article-title":"Policy documents as sources for measuring societal impact: How often is climate change research mentioned in policy-related documents?","volume":"109","author":"L Bornmann","year":"2016","journal-title":"Scientometrics"},{"issue":"3","key":"pone.0274693.ref022","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.1007\/s11192-016-2237-2","article-title":"How many scientific papers are mentioned in policy-related documents? An empirical investigation using Web of Science and Altmetric data","volume":"110","author":"R Haunschild","year":"2017","journal-title":"Scientometrics"},{"issue":"9","key":"pone.0274693.ref023","article-title":"What can Altmetric.com tell us about policy citations of research? An analysis of Altmetric.com data for research articles from the University of Sheffield.","volume":"2","author":"A Tattersall","year":"2018","journal-title":"Frontiers in Research Metrics and Analytics"},{"issue":"3","key":"pone.0274693.ref024","doi-asserted-by":"crossref","first-page":"2519","DOI":"10.1007\/s11192-020-03564-9","article-title":"An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics","volume":"124","author":"Z Fang","year":"2020","journal-title":"Scientometrics"},{"issue":"3","key":"pone.0274693.ref025","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1162\/qss_a_00060","article-title":"Powerful numbers: Exemplary quantitative studies of science that had policy impact","volume":"1","author":"D Hicks","year":"2020","journal-title":"Quantitative Science Studies"},{"issue":"1","key":"pone.0274693.ref026","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0048-7333(91)90080-A","article-title":"Academic research and industrial innovation","volume":"20","author":"E. Mansfield","year":"1991","journal-title":"Research Policy"},{"issue":"7\u20138","key":"pone.0274693.ref027","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1016\/S0048-7333(97)00043-7","article-title":"Academic research and industrial innovation: An update of empirical findings","volume":"26","author":"E. Mansfield","year":"1998","journal-title":"Research Policy"},{"issue":"2","key":"pone.0274693.ref028","first-page":"616","article-title":"A large-scale validation of the relationship between cross-disciplinary research and its uptake in policy-related documents, using the novel Overton altmetrics database","volume":"2","author":"H Pinheiro","year":"2021","journal-title":"Quantitative Science Studies"},{"key":"pone.0274693.ref029","author":"M Szomszor","year":"2022","journal-title":"Overton: A bibliometric database of policy document citations"},{"key":"pone.0274693.ref030","author":"R Core Team","year":"2019"},{"key":"pone.0274693.ref031","article-title":"Tidyverse: Easily install and load the \u2019Tidyverse\u2019. R package version 1.2.1.","author":"H. Wickham","year":"2017"},{"issue":"3","key":"pone.0274693.ref032","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1007\/s12109-020-09736-y","article-title":"CiteScore: Advances, evolution, applications, and limitations","volume":"36","author":"JA Teixeira da Silva","year":"2020","journal-title":"Publishing Research Quarterly"},{"issue":"7","key":"pone.0274693.ref033","article-title":"A review of trends and drivers of greenhouse gas emissions by sector from 1990 to 2018","volume":"16","author":"WF Lamb","year":"2021","journal-title":"Environmental Research Letters"},{"issue":"11","key":"pone.0274693.ref034","doi-asserted-by":"crossref","first-page":"5213","DOI":"10.5194\/essd-13-5213-2021","article-title":"A comprehensive and synthetic dataset for global, regional, and national greenhouse gas emissions by sector 1970\u20132018 with an extension to 2019","volume":"13","author":"JC Minx","year":"2021","journal-title":"Earth System Science Data"},{"key":"pone.0274693.ref035","first-page":"1","article-title":"Global carbon budget 2021","volume":"2021","author":"P Friedlingstein","year":"2021","journal-title":"Earth System Science Data Discussion"},{"key":"pone.0274693.ref036","doi-asserted-by":"crossref","DOI":"10.18356\/9789210011181","volume-title":"Emissions gap report 2021: The heat is on\u2013A world of climate promises not yet delivered","author":"United Nations Environment Programme","year":"2021"},{"issue":"6568","key":"pone.0274693.ref037","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1126\/science.abl8976","article-title":"Can updated climate pledges limit warming well below 2 degrees C? Increased ambition and implementation are essential","volume":"374","author":"Y Ou","year":"2021","journal-title":"Science"},{"issue":"7","key":"pone.0274693.ref038","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0160393","article-title":"Climate change research in view of bibliometrics.","volume":"11","author":"R Haunschild","year":"2016","journal-title":"Plos One"},{"issue":"8","key":"pone.0274693.ref039","doi-asserted-by":"crossref","first-page":"E514","DOI":"10.1016\/S2542-5196(21)00179-0","article-title":"Systematic mapping of global research on climate and health: A machine learning review","volume":"5","author":"L Berrang-Ford","year":"2021","journal-title":"Lancet Planet Health"},{"key":"pone.0274693.ref040","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/978-3-030-02511-3_8","volume-title":"Springer handbook of science and technology indicators","author":"KW Boyack","year":"2019"},{"issue":"1","key":"pone.0274693.ref041","doi-asserted-by":"crossref","first-page":"5233","DOI":"10.1038\/s41598-019-41695-z","article-title":"From Louvain to Leiden: Guaranteeing well-connected communities.","volume":"9","author":"VA Traag","year":"2019","journal-title":"Scientific Reports"},{"key":"pone.0274693.ref042","volume-title":"SPIE 7868, Visualization and Data Analysis","author":"S Martin","year":"2011"},{"issue":"3","key":"pone.0274693.ref043","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0018029","article-title":"Clustering more than two million biomedical publications: Comparing the accuracies of nine text-based similarity approaches.","volume":"6","author":"KW Boyack","year":"2011","journal-title":"PLoS ONE"},{"issue":"6","key":"pone.0274693.ref044","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1016\/S0306-4573(00)00015-7","article-title":"A probabilistic model of information retrieval: Development and comparative experiments: Part 1","volume":"36","author":"K Sparck Jones","year":"2000","journal-title":"Information Processing & Management"},{"issue":"6","key":"pone.0274693.ref045","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1016\/S0306-4573(00)00016-9","article-title":"A probabilistic model of information retrieval: Development and comparative experiments: Part 2.","volume":"36","author":"K Sparck Jones","year":"2000","journal-title":"Information Processing & Management"},{"issue":"7","key":"pone.0274693.ref046","doi-asserted-by":"crossref","first-page":"e39464","DOI":"10.1371\/journal.pone.0039464","article-title":"Design and update of a classification system: The UCSD map of science","volume":"7","author":"K B\u00f6rner","year":"2012","journal-title":"PLOS ONE"},{"issue":"1","key":"pone.0274693.ref047","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11192-013-1020-x","article-title":"How should the societal impact of research be generated and measured? A proposal for a simple and practicable approach to allow interdisciplinary comparisons.","volume":"98","author":"L Bornmann","year":"2014","journal-title":"Scientometrics"},{"issue":"1","key":"pone.0274693.ref048","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1093\/ppmgov\/gvz020","article-title":"Pathways from research into public decision making: Intermediaries as the third community","volume":"3","author":"KR Isett","year":"2019","journal-title":"Perspectives on Public Management and Governance"},{"key":"pone.0274693.ref049","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/j.envsci.2017.05.014","article-title":"Learning about climate change solutions in the IPCC and beyond.","volume":"77","author":"JC Minx","year":"2017","journal-title":"Environmental Science & Policy."}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0274693","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,27]],"date-time":"2023-11-27T14:34:46Z","timestamp":1701095686000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0274693"}},"subtitle":[],"editor":[{"given":"Alberto","family":"Baccini","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2022,9,22]]},"references-count":49,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,9,22]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0274693","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,22]]}}}