{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T23:35:44Z","timestamp":1761176144782,"version":"build-2065373602"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686318","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:00:00Z","timestamp":1761004800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,10,21]]},"abstract":"<jats:p>Commonsense reasoning is a key aspect of human intelligence. If we are to develop robust and deep intelligent systems, then we need to understand the diversity and complexity of commonsense reasoning across the gamut of human activities. An interesting class of commonsense reasoning problems arises when people are faced with natural disasters. To investigate this topic, we present RESPONSE, a human-curated dataset containing 1789 annotated instances featuring 6037 sets of questions designed to assess LLMs\u2019 commonsense reasoning in disaster situations across different time frames. The dataset includes problem descriptions, missing resources, time-sensitive solutions, and their justifications, with a subset validated by environmental engineers. Through both automatic metrics and human evaluation, we compare LLM-generated recommendations against human responses. Our findings show that even state-of-the-art models like GPT-4 achieve only 37% human-evaluated correctness for immediate response actions, highlighting significant room for improvement in LLMs\u2019 ability for commonsense reasoning in crises.<\/jats:p>","DOI":"10.3233\/faia250904","type":"book-chapter","created":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T09:45:31Z","timestamp":1761126331000},"source":"Crossref","is-referenced-by-count":0,"title":["RESPONSE: Benchmarking the Ability of Language Models to Undertake Commonsense Reasoning in Crisis Situation"],"prefix":"10.3233","author":[{"given":"Aissatou","family":"Diallo","sequence":"first","affiliation":[{"name":"Department of Computer Science, University College London, United Kingdom"}]},{"given":"Antonis","family":"Bikakis","sequence":"additional","affiliation":[{"name":"Department of Information Studies, University College London, United Kingdom"}]},{"given":"Luke","family":"Dickens","sequence":"additional","affiliation":[{"name":"Department of Information Studies, University College London, United Kingdom"}]},{"given":"Anthony","family":"Hunter","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University College London, United Kingdom"}]},{"given":"Rob","family":"Miller","sequence":"additional","affiliation":[{"name":"Department of Information Studies, University College London, United Kingdom"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2025"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA250904","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T09:45:33Z","timestamp":1761126333000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA250904"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,21]]},"ISBN":["9781643686318"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia250904","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,21]]}}}