{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T21:43:24Z","timestamp":1787694204492,"version":"build-2784847793"},"reference-count":123,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T00:00:00Z","timestamp":1717718400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T00:00:00Z","timestamp":1717718400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"FAIR - Future AI Research","award":["PE00000013"],"award-info":[{"award-number":["PE00000013"]}]},{"name":"FAIR - Future AI Research","award":["PE00000013"],"award-info":[{"award-number":["PE00000013"]}]},{"name":"Ipazia S.p.A."}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EPJ Data Sci."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Over the last decade, several regulatory bodies have started requiring the disclosure of non-financial information from publicly listed companies, in light of the investors\u2019 increasing attention to Environmental, Social, and Governance (ESG) issues. Publicly released information on sustainability practices is often disclosed in diverse, unstructured, and multi-modal documentation. This poses a challenge in efficiently gathering and aligning the data into a unified framework to derive insights related to Corporate Social Responsibility (CSR). Thus, using Information Extraction (IE) methods becomes an intuitive choice for delivering insightful and actionable data to stakeholders. In this study, we employ Large Language Models (LLMs), In-Context Learning, and the Retrieval-Augmented Generation (RAG) paradigm to extract structured insights related to ESG aspects from companies\u2019 sustainability reports. We then leverage graph-based representations to conduct statistical analyses concerning the extracted insights. These analyses revealed that ESG criteria cover a wide range of topics, exceeding 500, often beyond those considered in existing categorizations, and are addressed by companies through a variety of initiatives. Moreover, disclosure similarities emerged among companies from the same region or sector, validating ongoing hypotheses in the ESG literature. Lastly, by incorporating additional company attributes into our analyses, we investigated which factors impact the most on companies\u2019 ESG ratings, showing that ESG disclosure affects the obtained ratings more than other financial or company data.<\/jats:p>","DOI":"10.1140\/epjds\/s13688-024-00481-2","type":"journal-article","created":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T12:02:04Z","timestamp":1717761724000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Glitter or gold? Deriving structured insights from sustainability reports via large language models"],"prefix":"10.1140","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-9691-9464","authenticated-orcid":false,"given":"Marco","family":"Bronzini","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9661-0329","authenticated-orcid":false,"given":"Carlo","family":"Nicolini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1275-2333","authenticated-orcid":false,"given":"Bruno","family":"Lepri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2765-5395","authenticated-orcid":false,"given":"Andrea","family":"Passerini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1260-4640","authenticated-orcid":false,"given":"Jacopo","family":"Staiano","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,6,7]]},"reference":[{"key":"481_CR1","unstructured":"United Nations: the sustainable development agenda. https:\/\/www.un.org\/sustainabledevelopment\/development-agenda. Accessed 22-09-2023"},{"key":"481_CR2","unstructured":"European Union: non-financial reporting directive (NFRD). https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/PDF\/?uri=CELEX:32014L0095. Accessed 2023-07-04"},{"key":"481_CR3","unstructured":"European Union: corporate sustainability reporting directive (CSRD). https:\/\/finance.ec.europa.eu\/capital-markets-union-and-financial-markets\/company-reporting-and-auditing\/company-reporting\/corporate-sustainability-reporting_en. Accessed 2023-07-04"},{"key":"481_CR4","unstructured":"Wong C, Petroy E (2020) Rate the raters 2020: investor survey and interview results. Survey report, SustainAbility Institute by ERM. https:\/\/www.sustainability.com\/globalassets\/sustainability.com\/thinking\/pdfs\/sustainability-ratetheraters2020-report.pdf"},{"issue":"8","key":"481_CR5","doi-asserted-by":"publisher","first-page":"1597","DOI":"10.1002\/smj.2407","volume":"37","author":"AK Chatterji","year":"2016","unstructured":"Chatterji AK, Durand R, Levine DI, Touboul S (2016) Do ratings of firms converge? Implications for managers, investors and strategy researchers. Strateg Manag J 37(8):1597\u20131614","journal-title":"Strateg Manag J"},{"issue":"1","key":"481_CR6","doi-asserted-by":"publisher","first-page":"49","DOI":"10.3905\/jwm.2021.1.130","volume":"24","author":"S Abhayawansa","year":"2021","unstructured":"Abhayawansa S, Tyagi S (2021) Sustainable investing: the black box of environmental, social, and governance (ESG) ratings. J Wealth Manag 24(1):49\u201354","journal-title":"J Wealth Manag"},{"issue":"5","key":"481_CR7","doi-asserted-by":"publisher","first-page":"1426","DOI":"10.1002\/csr.2177","volume":"28","author":"M Billio","year":"2021","unstructured":"Billio M, Costola M, Hristova I, Latino C, Pelizzon L (2021) Inside the esg ratings: (dis)agreement and performance. Corp Soc-Responsib Environ Manag 28(5):1426\u20131445","journal-title":"Corp Soc-Responsib Environ Manag"},{"issue":"6","key":"481_CR8","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.1093\/rof\/rfac033","volume":"26","author":"F Berg","year":"2022","unstructured":"Berg F, Koelbel JF, Rigobon R (2022) Aggregate confusion: the divergence of ESG ratings. Rev Finance 26(6):1315\u20131344","journal-title":"Rev Finance"},{"issue":"057","key":"481_CR9","doi-asserted-by":"publisher","DOI":"10.5089\/9798400235283.001.A001","volume":"2023","author":"T Ehlers","year":"2023","unstructured":"Ehlers T, Elsenhuber U, Jegarasasingam K, Jondeau E (2023) Deconstructing ESG scores: how to invest with your own criteria? IMF Work Pap 2023(057):001. https:\/\/doi.org\/10.5089\/9798400235283.001.A001","journal-title":"IMF Work Pap"},{"key":"481_CR10","first-page":"1877","volume":"33","author":"T Brown","year":"2020","unstructured":"Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A et al. (2020) Language models are few-shot learners. Adv Neural Inf Process Syst 33:1877\u20131901","journal-title":"Adv Neural Inf Process Syst"},{"key":"481_CR11","unstructured":"Wei J, Bosma M, Zhao VY, Guu K, Yu AW, Lester B, Du N, Dai AM, Le QV (2021) Finetuned language models are zero-shot learners. arXiv preprint. arXiv:2109.01652"},{"key":"481_CR12","unstructured":"Wei J, Tay Y, Bommasani R, Raffel C, Zoph B, Borgeaud S, Yogatama D, Bosma M, Zhou D, Metzler D, Chi EH, Hashimoto T, Vinyals O, Liang P, Dean J, Fedus W (2022) Emergent abilities of large language models. arXiv:2206.07682"},{"key":"481_CR13","first-page":"4765","volume-title":"Advances in neural information processing systems","author":"SM Lundberg","year":"2017","unstructured":"Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems, vol\u00a030. Curran Associates, Red Hook, pp\u00a04765\u20134774. http:\/\/papers.nips.cc\/paper\/7062-a-unified-approach-to-interpreting-model-predictions.pdf"},{"key":"481_CR14","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511984068","volume-title":"Bipartite graphs and their applications","author":"AS Asratian","year":"1998","unstructured":"Asratian AS, Denley TM, H\u00e4ggkvist R (1998) Bipartite graphs and their applications, vol\u00a0131. Cambridge University Press, Cambridge"},{"issue":"2","key":"481_CR15","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1016\/j.physa.2006.04.047","volume":"371","author":"J-L Guillaume","year":"2006","unstructured":"Guillaume J-L, Latapy M (2006) Bipartite graphs as models of complex networks. Phys A, Stat Mech Appl 371(2):795\u2013813","journal-title":"Phys A, Stat Mech Appl"},{"key":"481_CR16","unstructured":"Xu C, Sun Q, Zheng K, Geng X, Zhao P, Feng J, Tao C, Jiang D (2023) WizardLM: empowering large language models to follow complex instructions. arXiv:2304.12244"},{"key":"481_CR17","unstructured":"Dong Q, Li L, Dai D, Zheng C, Wu Z, Chang B, Sun X, Xu J, Li L, Sui Z (2023) A survey on in-context learning. arXiv:2301.00234"},{"key":"481_CR18","first-page":"9459","volume":"33","author":"P Lewis","year":"2020","unstructured":"Lewis P, Perez E, Piktus A, Petroni F, Karpukhin V, Goyal N, K\u00fcttler H, Lewis M, Yih W-T, Rockt\u00e4schel T et al. (2020) Retrieval-augmented generation for knowledge-intensive nlp tasks. Adv Neural Inf Process Syst 33:9459\u20139474","journal-title":"Adv Neural Inf Process Syst"},{"key":"481_CR19","first-page":"22199","volume":"35","author":"T Kojima","year":"2022","unstructured":"Kojima T, Gu SS, Reid M, Matsuo Y, Iwasawa Y (2022) Large language models are zero-shot reasoners. Adv Neural Inf Process Syst 35:22199\u201322213","journal-title":"Adv Neural Inf Process Syst"},{"issue":"7","key":"481_CR20","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.13309","volume":"47","author":"S Trott","year":"2023","unstructured":"Trott S, Jones C, Chang T, Michaelov J, Bergen B (2023) Do large language models know what humans know? Cogn Sci 47(7):13309","journal-title":"Cogn Sci"},{"key":"481_CR21","unstructured":"Zhao WX, Zhou K, Li J, Tang T, Wang X, Hou Y, Min Y, Zhang B, Zhang J, Dong Z et al (2023) A survey of large language models. arXiv preprint. arXiv:2303.18223"},{"key":"481_CR22","first-page":"1","volume-title":"Extended abstracts of the 2021 CHI conference on human factors in computing systems","author":"L Reynolds","year":"2021","unstructured":"Reynolds L, McDonell K (2021) Prompt programming for large language models: beyond the few-shot paradigm. In: Extended abstracts of the 2021 CHI conference on human factors in computing systems, pp\u00a01\u20137"},{"key":"481_CR23","unstructured":"Wang Y, Zhong W, Li L, Mi F, Zeng X, Huang W, Shang L, Jiang X, Liu Q (2023) Aligning large language models with human: a survey. arXiv:2307.12966"},{"key":"481_CR24","unstructured":"Zhang S, Dong L, Li X, Zhang S, Sun X, Wang S, Li J, Hu R, Zhang T, Wu F et al (2023) Instruction tuning for large language models: a survey. arXiv preprint. arXiv:2308.10792"},{"key":"481_CR25","unstructured":"Carta S, Giuliani A, Piano L, Podda AS, Pompianu L, Tiddia SG (2023) Iterative zero-shot LLM prompting for knowledge graph construction. arXiv:2307.01128"},{"key":"481_CR26","doi-asserted-by":"crossref","unstructured":"Meyer L-P, Stadler C, Frey J, Radtke N, Junghanns K, Meissner R, Dziwis G, Bulert K, Martin M (2023) Llm-assisted knowledge graph engineering: experiments with chatgpt. arXiv preprint. arXiv:2307.06917","DOI":"10.1007\/978-3-658-43705-3_8"},{"key":"481_CR27","unstructured":"Trajanoska M, Stojanov R, Trajanov D (2023) Enhancing knowledge graph construction using large language models. arXiv:2305.04676"},{"key":"481_CR28","unstructured":"Zhu Y, Wang X, Chen J, Qiao S, Ou Y, Yao Y, Deng S, Chen H, Zhang N (2023) LLMs for knowledge graph construction and reasoning: recent capabilities and future opportunities. arXiv:2305.13168"},{"issue":"4","key":"481_CR29","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1561\/1500000063","volume":"14","author":"R Reinanda","year":"2020","unstructured":"Reinanda R, Meij E, de Rijke M et al. (2020) Knowledge graphs: an information retrieval perspective. Found Trends Inf Retr 14(4):289\u2013444","journal-title":"Found Trends Inf Retr"},{"key":"481_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-030-37439-6","volume-title":"Knowledge graphs: methodology, tools and selected use cases","author":"D Fensel","year":"2020","unstructured":"Fensel D, \u015eim\u015fek U, Angele K, Huaman E, K\u00e4rle E, Panasiuk O, Toma I, Umbrich J, Wahler A, Fensel D et al. (2020) Introduction: what is a knowledge graph? In: Knowledge graphs: methodology, tools and selected use cases, pp\u00a01\u201310"},{"issue":"4","key":"481_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3447772","volume":"54","author":"A Hogan","year":"2021","unstructured":"Hogan A, Blomqvist E, Cochez M, d\u2019Amato C, Melo GD, Gutierrez C, Kirrane S, Gayo JEL, Navigli R, Neumaier S et al. (2021) Knowledge graphs. ACM Comput Surv 54(4):1\u201337","journal-title":"ACM Comput Surv"},{"key":"481_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.irfa.2021.101731","volume":"75","author":"EP-Y Yu","year":"2021","unstructured":"Yu EP-Y, Van Luu B (2021) International variations in esg disclosure\u2014do cross-listed companies care more? Int Rev Financ Anal 75:101731","journal-title":"Int Rev Financ Anal"},{"key":"481_CR33","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1007\/s10551-016-3139-1","volume":"150","author":"M Baldini","year":"2018","unstructured":"Baldini M, Maso LD, Liberatore G, Mazzi F, Terzani S (2018) Role of country-and firm-level determinants in environmental, social, and governance disclosure. J Bus Ethics 150:79\u201398","journal-title":"J Bus Ethics"},{"issue":"2","key":"481_CR34","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1111\/j.1745-6622.2012.00380.x","volume":"24","author":"RG Eccles","year":"2012","unstructured":"Eccles RG, Krzus MP, Rogers J, Serafeim G (2012) The need for sector-specific materiality and sustainability reporting standards. J Appl Corp Finance 24(2):65\u201371","journal-title":"J Appl Corp Finance"},{"issue":"6","key":"481_CR35","doi-asserted-by":"publisher","first-page":"1697","DOI":"10.2308\/accr-51383","volume":"91","author":"M Khan","year":"2016","unstructured":"Khan M, Serafeim G, Yoon A (2016) Corporate sustainability: first evidence on materiality. Account Rev 91(6):1697\u20131724","journal-title":"Account Rev"},{"issue":"2","key":"481_CR36","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1111\/jacf.12411","volume":"32","author":"C Busco","year":"2020","unstructured":"Busco C, Consolandi C, Eccles RG, Sofra E (2020) A preliminary analysis of SASB reporting: disclosure topics, financial relevance, and the financial intensity of ESG materiality. J Appl Corp Finance 32(2):117\u2013125","journal-title":"J Appl Corp Finance"},{"key":"481_CR37","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1487\/1\/012016","volume":"1487","author":"X Zou","year":"2020","unstructured":"Zou X (2020) A survey on application of knowledge graph. J Phys Conf Ser 1487:012016","journal-title":"J Phys Conf Ser"},{"issue":"2","key":"481_CR38","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1109\/TNNLS.2021.3070843","volume":"33","author":"S Ji","year":"2021","unstructured":"Ji S, Pan S, Cambria E, Marttinen P, Philip SY (2021) A survey on knowledge graphs: representation, acquisition, and applications. IEEE Trans Neural Netw Learn Syst 33(2):494\u2013514","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"481_CR39","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1145\/3459637.3482416","volume-title":"Proceedings of the 30th ACM international conference on information & knowledge management","author":"Z Jia","year":"2021","unstructured":"Jia Z, Pramanik S, Saha Roy R, Weikum G (2021) Complex temporal question answering on knowledge graphs. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp\u00a0792\u2013802"},{"key":"481_CR40","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113764","volume":"165","author":"B Shao","year":"2021","unstructured":"Shao B, Li X, Bian G (2021) A survey of research hotspots and frontier trends of recommendation systems from the perspective of knowledge graph. Expert Syst Appl 165:113764","journal-title":"Expert Syst Appl"},{"key":"481_CR41","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-37439-6","volume-title":"Knowledge graphs","author":"D Fensel","year":"2020","unstructured":"Fensel D, Simsek U, Angele K, Huaman E, K\u00e4rle E, Panasiuk O, Toma I, Umbrich J, Wahler A (2020) Knowledge graphs. Springer, Cham"},{"key":"481_CR42","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s11704-016-5228-9","volume":"12","author":"J Yan","year":"2018","unstructured":"Yan J, Wang C, Cheng W, Gao M, Zhou A (2018) A retrospective of knowledge graphs. Front Comput Sci 12:55\u201374","journal-title":"Front Comput Sci"},{"key":"481_CR43","doi-asserted-by":"publisher","first-page":"917","DOI":"10.18653\/v1\/P17-1085","volume-title":"Proceedings of the 55th annual meeting of the association for computational linguistics (volume 1: long papers)","author":"A Katiyar","year":"2017","unstructured":"Katiyar A, Cardie C (2017) Going out on a limb: joint extraction of entity mentions and relations without dependency trees. In: Proceedings of the 55th annual meeting of the association for computational linguistics (volume 1: long papers), pp\u00a0917\u2013928"},{"key":"481_CR44","doi-asserted-by":"crossref","unstructured":"Wang Y, Yu B, Zhang Y, Liu T, Zhu H, Sun L (2020) Tplinker: single-stage joint extraction of entities and relations through token pair linking. arXiv preprint. arXiv:2010.13415","DOI":"10.18653\/v1\/2020.coling-main.138"},{"key":"481_CR45","unstructured":"Niklaus C, Cetto M, Freitas A, Handschuh S (2018) A survey on open information extraction. arXiv preprint. arXiv:1806.05599"},{"key":"481_CR46","doi-asserted-by":"publisher","first-page":"1107","DOI":"10.18653\/v1\/2020.findings-emnlp.99","volume-title":"Findings of the association for computational linguistics: EMNLP 2020","author":"Y Ro","year":"2020","unstructured":"Ro Y, Lee Y, Kang P (2020) Multi2OIE: multilingual open information extraction based on multi-head attention with BERT. In: Findings of the association for computational linguistics: EMNLP 2020. Association for Computational Linguistics, Online, pp\u00a01107\u20131117. https:\/\/doi.org\/10.18653\/v1\/2020.findings-emnlp.99. https:\/\/aclanthology.org\/2020.findings-emnlp.99"},{"key":"481_CR47","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.18653\/v1\/2021.emnlp-main.94","volume-title":"Proceedings of the 2021 conference on empirical methods in natural language processing","author":"C Wang","year":"2021","unstructured":"Wang C, Liu X, Chen Z, Hong H, Tang J, Song D (2021) Zero-shot information extraction as a unified text-to-triple translation. In: Proceedings of the 2021 conference on empirical methods in natural language processing. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, pp\u00a01225\u20131238. https:\/\/doi.org\/10.18653\/v1\/2021.emnlp-main.94. https:\/\/aclanthology.org\/2021.emnlp-main.94"},{"key":"481_CR48","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint. arXiv:1810.04805"},{"key":"481_CR49","unstructured":"Liu P, Gao W, Dong W, Huang S, Zhang Y (2022) Open information extraction from 2007 to 2022 \u2013 a survey. arXiv:2208.08690"},{"key":"481_CR50","unstructured":"Pan S, Luo L, Wang Y, Chen C, Wang J, Wu X (2023) Unifying large language models and knowledge graphs: a\u00a0roadmap. arXiv preprint. arXiv:2306.08302"},{"key":"481_CR51","unstructured":"Chen J, Ma L, Li X, Thakurdesai N, Xu J, Cho JHD, Nag K, Korpeoglu E, Kumar S, Achan K (2023) Knowledge graph completion models are few-shot learners: an empirical study of relation labeling in e-commerce with LLMs. arXiv:2305.09858"},{"key":"481_CR52","unstructured":"Axelsson A, Skantze G (2023) Using large language models for zero-shot natural language generation from knowledge graphs. arXiv:2307.07312"},{"key":"481_CR53","volume-title":"Corporate social responsibility and environmental management","author":"C Chou","year":"2023","unstructured":"Chou C, Clark R, Kimbrough SO (2023) What do firms say in reporting on impacts of climate change? An approach to monitoring ESG actions and environmental policy. In: Corporate social responsibility and environmental management"},{"issue":"11","key":"481_CR54","doi-asserted-by":"publisher","first-page":"4753","DOI":"10.3390\/su12114753","volume":"12","author":"V Raghupathi","year":"2020","unstructured":"Raghupathi V, Ren J, Raghupathi W (2020) Identifying corporate sustainability issues by analyzing shareholder resolutions: a machine-learning text analytics approach. Sustainability 12(11):4753","journal-title":"Sustainability"},{"key":"481_CR55","unstructured":"Marodon R, Jacouton J-B, Laulanie A (2022) The proof is in the pudding. revealing the SDGs with artificial intelligence. Working paper 85f81dba-c8e2-4255-878a-0, Agence Fran\u00e7aise de D\u00e9veloppement. https:\/\/ideas.repec.org\/p\/avg\/wpaper\/en14520.html"},{"key":"481_CR56","unstructured":"SDG Prospector \u2013 artificial intelligence serving the SDGs. https:\/\/www.sdgprospector.org. Accessed 22-09-2023"},{"key":"481_CR57","doi-asserted-by":"crossref","unstructured":"Webersinke N, Kraus M, Bingler JA, Leippold M (2021) Climatebert: a pretrained language model for climate-related text. arXiv preprint. arXiv:2110.12010","DOI":"10.2139\/ssrn.4229146"},{"key":"481_CR58","doi-asserted-by":"crossref","unstructured":"Vaghefi SA, Wang Q, Muccione V, Ni J, Kraus M, Bingler J, Schimanski T, Colesanti-Senni C, Stammbach D, Webersinke N et al (2023). Chatclimate: grounding conversational ai in climate science","DOI":"10.2139\/ssrn.4414628"},{"key":"481_CR59","unstructured":"ChatClimate grounded on the latest IPCC report. https:\/\/www.chatclimate.ai. Accessed 22-09-2023"},{"key":"481_CR60","doi-asserted-by":"crossref","unstructured":"Ni J, Bingler J, Colesanti-Senni C, Kraus M, Gostlow G, Schimanski T, Stammbach D, Vaghefi SA, Wang Q, Webersinke N et al (2023) Paradigm shift in sustainability disclosure analysis: empowering stakeholders with chatreport, a language model-based tool. arXiv preprint. arXiv:2306.15518","DOI":"10.2139\/ssrn.4476733"},{"key":"481_CR61","unstructured":"TCFD (2017) Recommendations of the task force on climate-related financial disclosures. Task force on climate-related financial disclosures. https:\/\/assets.bbhub.io\/company\/sites\/60\/2021\/10\/FINAL-2017-TCFD-Report.pdf"},{"issue":"3","key":"481_CR62","doi-asserted-by":"publisher","first-page":"946","DOI":"10.5465\/amr.2007.25275684","volume":"32","author":"JL Campbell","year":"2007","unstructured":"Campbell JL (2007) Why would corporations behave in socially responsible ways? An institutional theory of corporate social responsibility. Acad Manag Rev 32(3):946\u2013967","journal-title":"Acad Manag Rev"},{"key":"481_CR63","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1007\/s10551-019-04164-1","volume":"167","author":"S Drempetic","year":"2020","unstructured":"Drempetic S, Klein C, Zwergel B (2020) The influence of firm size on the ESG score: corporate sustainability ratings under review. J Bus Ethics 167:333\u2013360","journal-title":"J Bus Ethics"},{"key":"481_CR64","unstructured":"European Union: EU emissions trading system (EU ETS). https:\/\/climate.ec.europa.eu\/eu-action\/eu-emissions-trading-system-eu-ets_en. Accessed 2023-09-25"},{"key":"481_CR65","unstructured":"European Union: fit for 55. https:\/\/www.consilium.europa.eu\/en\/policies\/green-deal\/fit-for-55-the-eu-plan-for-a-green-transition\/. Accessed 2023-09-25"},{"key":"481_CR66","volume-title":"The devil is in the details: the divergence in esg data and implications for responsible investing","author":"MJ LaBella","year":"2019","unstructured":"LaBella MJ, Sullivan L, Russell J, Novikov D (2019) The devil is in the details: the divergence in esg data and implications for responsible investing. QS Investors, New York"},{"key":"481_CR67","doi-asserted-by":"publisher","DOI":"10.1016\/j.frl.2023.104014","volume":"55","author":"J Dobrick","year":"2023","unstructured":"Dobrick J, Klein C, Zwergel B (2023) Size bias in refinitiv esg data. Finance Res Lett 55:104014","journal-title":"Finance Res Lett"},{"key":"481_CR68","unstructured":"Admin@Evo (2023) Why impact materiality is critical to double materiality assessments. Section: blog. https:\/\/gistimpact.com\/news-insights\/why-impact-materiality-is-critical-to-double-materiality-assessments\/. Accessed 2024-04-19"},{"key":"481_CR69","unstructured":"Working paper: balancing your materiality assessment. Deloitte (2022). https:\/\/www2.deloitte.com\/content\/dam\/Deloitte\/nl\/Documents\/risk\/deloitte-nl-risk-double-materiality.pdf"},{"key":"481_CR70","unstructured":"Doyle TM (2018) Ratings that don\u2019t rate: the subjective world of esg ratings agencies. American Council for Capital Formation, 65\u201371"},{"key":"481_CR71","doi-asserted-by":"publisher","DOI":"10.1787\/eb61fd29-en","volume-title":"OECD business and finance outlook 2020: sustainable and resilient finance. OECD business and finance outlook","author":"OECD","year":"2020","unstructured":"OECD (2020) OECD business and finance outlook 2020: sustainable and resilient finance. OECD business and finance outlook, vol\u00a06. OECD, Paris. https:\/\/doi.org\/10.1787\/eb61fd29-en."},{"key":"481_CR72","unstructured":"Aliakbari E, Globerman S (2023) The impracticality of standardizing ESG reporting (ESG: myths and realities)"},{"key":"481_CR73","unstructured":"SSAB: SASB reporters. https:\/\/sasb.org\/company-use\/sasb-reporters. Accessed 2022-04-07"},{"key":"481_CR74","unstructured":"IR Solutions: ResponsibilityReports. https:\/\/www.responsibilityreports.com. Accessed 2022-04-07"},{"key":"481_CR75","unstructured":"Hugging Face: statistics on the number of monolingual models by language hosted on the Hugging Face platform. https:\/\/huggingface.co\/languages. Accessed 2023-07-04"},{"key":"481_CR76","unstructured":"Refinitiv: environmental, social and governance (ESG) scores from Refinitiv \u2013 May 2022. https:\/\/www.refinitiv.com\/content\/dam\/marketing\/en_us\/documents\/methodology\/refinitiv-esg-scores-methodology.pdf. Accessed 2023-07-10"},{"issue":"5","key":"481_CR77","doi-asserted-by":"publisher","first-page":"1782","DOI":"10.1002\/csr.2326","volume":"29","author":"\u00d6 Sahin","year":"2022","unstructured":"Sahin \u00d6, Bax K, Czado C, Paterlini S (2022) Environmental, social, governance scores and the missing pillar\u2014why does missing information matter? Corp Soc-Responsib Environ Manag 29(5):1782\u20131798","journal-title":"Corp Soc-Responsib Environ Manag"},{"key":"481_CR78","unstructured":"Artifex: PyMuPDF \u2013 pypi.org. https:\/\/pypi.org\/project\/PyMuPDF. Accessed 22-09-2023"},{"key":"481_CR79","doi-asserted-by":"publisher","first-page":"110","DOI":"10.18653\/v1\/2020.nlposs-1.15","volume-title":"Proceedings of second workshop for NLP open source software (NLP-OSS)","author":"N Sadvilkar","year":"2020","unstructured":"Sadvilkar N, Neumann M (2020) PySBD: pragmatic sentence boundary disambiguation. In: Proceedings of second workshop for NLP open source software (NLP-OSS). Association for Computational Linguistics, Online, pp\u00a0110\u2013114. https:\/\/www.aclweb.org\/anthology\/2020.nlposs-1.15"},{"key":"481_CR80","unstructured":"Sadvilkar N PySBD \u2013 pypi.org. pypi.org\/project\/pysbd. Accessed 22-09-2023"},{"key":"481_CR81","volume-title":"Search engines: information retrieval in practice","author":"WB Croft","year":"2010","unstructured":"Croft WB, Metzler D, Strohman T (2010) Search engines: information retrieval in practice, vol\u00a0520. Addison-Wesley, Reading"},{"issue":"2\u20133","key":"481_CR82","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1561\/1500000032","volume":"10","author":"H Bast","year":"2016","unstructured":"Bast H, Buchhold B, Haussmann E (2016) Semantic search on text and knowledge bases. Found Trends Inf Retr 10(2\u20133):119\u2013271","journal-title":"Found Trends Inf Retr"},{"key":"481_CR83","doi-asserted-by":"crossref","unstructured":"Reimers N, Gurevych I (2019) Sentence-bert: sentence embeddings using siamese bert-networks. arXiv preprint. arXiv:1908.10084","DOI":"10.18653\/v1\/D19-1410"},{"key":"481_CR84","unstructured":"Muennighoff N (2022) SGPT: GPT sentence embeddings for semantic search. arXiv:2202.08904"},{"issue":"4","key":"481_CR85","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3486250","volume":"40","author":"J Guo","year":"2022","unstructured":"Guo J, Cai Y, Fan Y, Sun F, Zhang R, Cheng X (2022) Semantic models for the first-stage retrieval: a comprehensive review. ACM Trans Inf Syst 40(4):1\u201342","journal-title":"ACM Trans Inf Syst"},{"key":"481_CR86","volume-title":"Information retrieval: implementing and evaluating search engines","author":"S Buttcher","year":"2016","unstructured":"Buttcher S, Clarke CL, Cormack GV (2016) Information retrieval: implementing and evaluating search engines. Mit Press, Cambridge"},{"issue":"4","key":"481_CR87","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1109\/TASLP.2016.2520371","volume":"24","author":"H Palangi","year":"2016","unstructured":"Palangi H, Deng L, Shen Y, Gao J, He X, Chen J, Song X, Ward R (2016) Deep sentence embedding using long short-term memory networks: analysis and application to information retrieval. IEEE\/ACM Trans Audio Speech Lang Process 24(4):694\u2013707","journal-title":"IEEE\/ACM Trans Audio Speech Lang Process"},{"key":"481_CR88","unstructured":"Yang W, Zhang H, Lin J (2019) Simple applications of bert for ad hoc document retrieval. arXiv preprint. arXiv:1903.10972"},{"key":"481_CR89","unstructured":"NLP Group of The University of Hong Kong: Instructor-xl \u22c5 Hugging Face \u2013 huggingface.co. https:\/\/huggingface.co\/hkunlp\/instructor-xl. Accessed 25-09-2023"},{"key":"481_CR90","doi-asserted-by":"crossref","unstructured":"Su H, Kasai J, Wang Y, Hu Y, Ostendorf M, Yih W-T, Smith NA, Zettlemoyer L, Yu T et al (2022) One embedder, any task: Instruction-finetuned text embeddings. arXiv preprint. arXiv:2212.09741","DOI":"10.18653\/v1\/2023.findings-acl.71"},{"key":"481_CR91","unstructured":"Allen Institute for AI: open information extraction \u2013 demo. https:\/\/demo.allennlp.org\/open-information-extraction. Accessed 2023-07-10"},{"key":"481_CR92","unstructured":"Yurtsev E Kor \u2013 pypi.org. https:\/\/pypi.org\/project\/kor. Accessed 25-09-2023"},{"key":"481_CR93","unstructured":"Chung HW, Hou L, Longpre S, Zoph B, Tay Y, Fedus W, Li E, Wang X, Dehghani M, Brahma S et al (2022) Scaling instruction-finetuned language models. arXiv preprint. arXiv:2210.11416"},{"key":"481_CR94","unstructured":"Touvron H, Lavril T, Izacard G, Martinet X, Lachaux M-A, Lacroix T, Rozi\u00e8re B, Goyal N, Hambro E, Azhar F, Rodriguez A, Joulin A, Grave E, Lample G (2023) LLaMA: open and efficient foundation language models. arXiv:2302.13971"},{"key":"481_CR95","unstructured":"Taori R, Gulrajani I, Zhang T, Dubois Y, Li X, Guestrin C, Liang P, Hashimoto TB (2023) Stanford alpaca: an instruction-following llama model"},{"key":"481_CR96","unstructured":"Jobbins T TheBloke\/wizardLM-7B-HF \u22c5 Hugging Face. https:\/\/huggingface.co\/TheBloke\/wizardLM-7B-HF. Accessed 25-09-2023"},{"key":"481_CR97","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199591756.001.0001","volume-title":"The structure of complex networks: theory and applications","author":"E Estrada","year":"2011","unstructured":"Estrada E (2011) The structure of complex networks: theory and applications. Oxford University Press, London. https:\/\/doi.org\/10.1093\/acprof:oso\/9780199591756.001.0001"},{"key":"481_CR98","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199206650.001.0001","volume-title":"Networks: an introduction","author":"M Newman","year":"2010","unstructured":"Newman M (2010) Networks: an introduction. Oxford University Press, London"},{"key":"481_CR99","doi-asserted-by":"publisher","DOI":"10.1007\/b106453","volume-title":"Network analysis: methodological foundations","author":"U Brandes","year":"2005","unstructured":"Brandes U (2005) Network analysis: methodological foundations, vol\u00a03418. Springer, Berlin"},{"key":"481_CR100","first-page":"300","volume-title":"2017 2nd international conference on modelling, simulation and applied mathematics (MSAM2017)","author":"J Zhang","year":"2017","unstructured":"Zhang J, Luo Y (2017) Degree centrality, betweenness centrality, and closeness centrality in social network. In: 2017 2nd international conference on modelling, simulation and applied mathematics (MSAM2017). Atlantis Press, pp\u00a0300\u2013303"},{"issue":"2","key":"481_CR101","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/S0378-8733(96)00300-0","volume":"19","author":"K Faust","year":"1997","unstructured":"Faust K (1997) Centrality in affiliation networks. Soc Netw 19(2):157\u2013191","journal-title":"Soc Netw"},{"issue":"2","key":"481_CR102","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1140\/epjb\/e2004-00111-4","volume":"38","author":"M Barthelemy","year":"2004","unstructured":"Barthelemy M (2004) Betweenness centrality in large complex networks. Eur Phys J B 38(2):163\u2013168","journal-title":"Eur Phys J B"},{"key":"481_CR103","volume-title":"Elements of information theory","author":"TM Cover","year":"1999","unstructured":"Cover TM (1999) Elements of information theory. Wiley, New York"},{"key":"481_CR104","unstructured":"Costa LdF (2021) Further generalizations of the Jaccard index. arXiv preprint. arXiv:2110.09619"},{"issue":"2","key":"481_CR105","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1111\/j.1600-0706.2011.20301.x","volume":"121","author":"JN Gotelli","year":"2012","unstructured":"Gotelli JN, Ulrich W (2012) Statistical challenges in null model analysis. Oikos 121(2):171\u2013180","journal-title":"Oikos"},{"key":"481_CR106","volume-title":"Feature engineering for machine learning: principles and techniques for data scientists","author":"A Zheng","year":"2018","unstructured":"Zheng A, Casari A (2018) Feature engineering for machine learning: principles and techniques for data scientists. \u201cO\u2019Reilly Media, Inc.\u201d, Newton"},{"key":"481_CR107","first-page":"508","volume-title":"Encyclopedia of measurement and statistics","author":"H Abdi","year":"2007","unstructured":"Abdi H (2007) The Kendall rank correlation coefficient. In: Encyclopedia of measurement and statistics. Sage, Thousand Oaks, pp\u00a0508\u2013510"},{"key":"481_CR108","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-642-00296-0","volume-title":"Noise reduction in speech processing","author":"I Cohen","year":"2009","unstructured":"Cohen I, Huang Y, Chen J, Benesty J, Benesty J, Chen J, Huang Y, Cohen I (2009) Pearson correlation coefficient. In: Noise reduction in speech processing, pp\u00a01\u20134"},{"key":"481_CR109","volume-title":"An introduction to statistical methods and data analysis","author":"RL Ott","year":"2015","unstructured":"Ott RL, Longnecker MT (2015) An introduction to statistical methods and data analysis. Cengage Learning. Boston"},{"key":"481_CR110","doi-asserted-by":"publisher","DOI":"10.1002\/9781118625590","volume-title":"Applied regression analysis","author":"NR Draper","year":"1998","unstructured":"Draper NR, Smith H (1998) Applied regression analysis, vol\u00a0326. Wiley, New York"},{"issue":"1","key":"481_CR111","first-page":"93","volume":"93","author":"C Dismuke","year":"2006","unstructured":"Dismuke C, Lindrooth R (2006) Ordinary least squares. Methods Des Outcomes Res 93(1):93\u2013104","journal-title":"Methods Des Outcomes Res"},{"issue":"2","key":"481_CR112","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","volume":"67","author":"H Zou","year":"2005","unstructured":"Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. J R Stat Soc, Ser B, Stat Methodol 67(2):301\u2013320","journal-title":"J R Stat Soc, Ser B, Stat Methodol"},{"key":"481_CR113","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The elements of statistical learning: data mining, inference, and prediction","author":"T Hastie","year":"2009","unstructured":"Hastie T, Tibshirani R, Friedman JH, Friedman JH (2009) The elements of statistical learning: data mining, inference, and prediction, vol\u00a02. Springer, Berlin"},{"key":"481_CR114","doi-asserted-by":"publisher","unstructured":"Berrar D (2018) Cross-validation. https:\/\/doi.org\/10.1016\/B978-0-12-809633-8.20349-X","DOI":"10.1016\/B978-0-12-809633-8.20349-X"},{"key":"481_CR115","unstructured":"Find industry topics. SASB. https:\/\/sasb.org\/standards\/materiality-finder\/find\/?company[0]=IT0005239360. Accessed 2023-12-21"},{"key":"481_CR116","unstructured":"Sustainalytics: ESG risk ratings \u2013 methodology abstract, version 2.1. https:\/\/connect.sustainalytics.com\/hubfs\/INV\/Methodology\/Sustainalytics_ESG%20Ratings_Methodology%20Abstract.pdf. Accessed 2023-07-10"},{"key":"481_CR117","doi-asserted-by":"publisher","first-page":"12697","DOI":"10.1007\/978-981-15-1967-3","volume-title":"International conference on machine learning","author":"Z Zhao","year":"2021","unstructured":"Zhao Z, Wallace E, Feng S, Klein D, Singh S (2021) Calibrate before use: improving few-shot performance of language models. In: International conference on machine learning. PMLR, pp\u00a012697\u201312706"},{"key":"481_CR118","volume-title":"Natural language processing with transformers","author":"L Tunstall","year":"2022","unstructured":"Tunstall L, Von Werra L, Wolf T (2022) Natural language processing with transformers. \u201cO\u2019Reilly Media, Inc.\u201d, Newton"},{"key":"481_CR119","doi-asserted-by":"crossref","unstructured":"Hewitt J, Manning CD, Liang P (2022) Truncation sampling as language model desmoothing. arXiv preprint. arXiv:2210.15191","DOI":"10.18653\/v1\/2022.findings-emnlp.249"},{"issue":"4","key":"481_CR120","doi-asserted-by":"publisher","first-page":"310","DOI":"10.1080\/00031305.2016.1256839","volume":"71","author":"D Zhang","year":"2017","unstructured":"Zhang D (2017) A coefficient of determination for generalized linear models. Am Stat 71(4):310\u2013316","journal-title":"Am Stat"},{"issue":"1","key":"481_CR121","doi-asserted-by":"publisher","first-page":"79","DOI":"10.3354\/cr030079","volume":"30","author":"CJ Willmott","year":"2005","unstructured":"Willmott CJ, Matsuura K (2005) Advantages of the mean absolute error (mae) over the root mean square error (rmse) in assessing average model performance. Clim Res 30(1):79\u201382","journal-title":"Clim Res"},{"issue":"3","key":"481_CR122","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1016\/j.ijforecast.2015.12.003","volume":"32","author":"S Kim","year":"2016","unstructured":"Kim S, Kim H (2016) A new metric of absolute percentage error for intermittent demand forecasts. Int J Forecast 32(3):669\u2013679","journal-title":"Int J Forecast"},{"issue":"3","key":"481_CR123","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1080\/00224065.1998.11979858","volume":"30","author":"LS Nelson","year":"1998","unstructured":"Nelson LS (1998) The Anderson-Darling test for normality. J Qual Technol 30(3):298","journal-title":"J Qual Technol"}],"container-title":["EPJ Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-024-00481-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1140\/epjds\/s13688-024-00481-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-024-00481-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T13:03:22Z","timestamp":1717765402000},"score":1,"resource":{"primary":{"URL":"https:\/\/epjdatascience.springeropen.com\/articles\/10.1140\/epjds\/s13688-024-00481-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,7]]},"references-count":123,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["481"],"URL":"https:\/\/doi.org\/10.1140\/epjds\/s13688-024-00481-2","relation":{},"ISSN":["2193-1127"],"issn-type":[{"value":"2193-1127","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,7]]},"assertion":[{"value":"2 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 May 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 June 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"41"}}