{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T14:39:04Z","timestamp":1725892744459},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:p>Recent efforts within the AI community have yielded impressive results towards \u201csoft theorem proving\u201d over natural language sentences using language models. We propose a novel, generative adversarial framework for probing and improving these models\u2019 reasoning capabilities. Adversarial attacks in this domain suffer from the logical inconsistency problem, whereby perturbations to the input may alter the label. Our Logically consistent AdVersarial Attacker, LAVA, addresses this by combining a structured generative process with a symbolic solver, guaranteeing logical consistency. Our framework successfully generates adversarial attacks and identifies global weaknesses common across multiple target models. Our analyses reveal naive heuristics and vulnerabilities in these models\u2019 reasoning capabilities, exposing an incomplete grasp of logical deduction under logic programs. Finally, in addition to effective probing of these models, we show that training on the generated samples improves the target model\u2019s performance.<\/jats:p>","DOI":"10.24963\/ijcai.2022\/573","type":"proceedings-article","created":{"date-parts":[[2022,7,16]],"date-time":"2022-07-16T02:55:56Z","timestamp":1657940156000},"page":"4129-4135","source":"Crossref","is-referenced-by-count":1,"title":["Logically Consistent Adversarial Attacks for Soft Theorem Provers"],"prefix":"10.24963","author":[{"given":"Alexander","family":"Gaskell","sequence":"first","affiliation":[{"name":"Imperial College London"},{"name":"ByteDance"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yishu","family":"Miao","sequence":"additional","affiliation":[{"name":"Imperial College London"},{"name":"ByteDance"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francesca","family":"Toni","sequence":"additional","affiliation":[{"name":"Imperial College London"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lucia","family":"Specia","sequence":"additional","affiliation":[{"name":"Imperial College London"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"10584","event":{"number":"31","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"acronym":"IJCAI-2022","name":"Thirty-First International Joint Conference on Artificial Intelligence {IJCAI-22}","start":{"date-parts":[[2022,7,23]]},"theme":"Artificial Intelligence","location":"Vienna, Austria","end":{"date-parts":[[2022,7,29]]}},"container-title":["Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2022,7,18]],"date-time":"2022-07-18T11:10:27Z","timestamp":1658142627000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2022\/573"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2022,7]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2022\/573","relation":{},"subject":[],"published":{"date-parts":[[2022,7]]}}}