{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,7]],"date-time":"2025-07-07T19:45:45Z","timestamp":1751917545824},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643684369","type":"print"},{"value":"9781643684376","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>Current transformer language models (LM) are large-scale models with billions of parameters. They have been shown to provide high performances on a variety of tasks but are also prone to shortcut learning and bias. Addressing such incorrect model behavior via parameter adjustments is very costly. This is particularly problematic for updating dynamic concepts, such as moral values, which vary culturally or interpersonally. In this work, we question the current common practice of storing all information in the model parameters and propose the Revision Transformer (RiT) to facilitate easy model updating. The specific combination of a large-scale pre-trained LM that inherently but also diffusely encodes world knowledge with a clear-structured revision engine makes it possible to update the model\u2019s knowledge with little effort and the help of user interaction. We exemplify RiT on a moral dataset and simulate user feedback demonstrating strong performance in model revision even with small data. This way, users can easily design a model regarding their preferences, paving the way for more transparent AI models.<\/jats:p>","DOI":"10.3233\/faia230341","type":"book-chapter","created":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T09:09:22Z","timestamp":1695978562000},"source":"Crossref","is-referenced-by-count":3,"title":["Revision Transformers: Instructing Language Models to Change Their Values"],"prefix":"10.3233","author":[{"given":"Felix","family":"Friedrich","sequence":"first","affiliation":[{"name":"AIML lab (TU Darmstadt) and hessian.AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wolfgang","family":"Stammer","sequence":"additional","affiliation":[{"name":"AIML lab (TU Darmstadt) and hessian.AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick","family":"Schramowski","sequence":"additional","affiliation":[{"name":"AIML lab (TU Darmstadt) and hessian.AI"},{"name":"DFKI and LAION"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kristian","family":"Kersting","sequence":"additional","affiliation":[{"name":"AIML lab (TU Darmstadt) and hessian.AI"},{"name":"DFKI and Centre for Cognitive Science (TU Darmstadt)"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2023"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA230341","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T09:09:24Z","timestamp":1695978564000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA230341"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"ISBN":["9781643684369","9781643684376"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia230341","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]}}}