{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T23:36:45Z","timestamp":1761176205333,"version":"build-2065373602"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686318","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:00:00Z","timestamp":1761004800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,10,21]]},"abstract":"<jats:p>This paper introduces the Approximate Ethical Embedding Process, an algorithm for automating the design of ethical environments for learning agents. Our algorithm helps build environments wherein multiple agents learn policies that align with an ethical (moral) value while simultaneously pursuing their individual objectives. Therefore, we contribute to endowing environment designers with algorithmic tools for building ethical environments. We demonstrate the ethical design process for two different settings of an environment where agents have to adhere to beneficence to promote the collective survival of the population. Our experiments show that our approximate embedding process successfully generates environments that incentivise the learning of value-aligned policies.<\/jats:p>","DOI":"10.3233\/faia251093","type":"book-chapter","created":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T09:51:15Z","timestamp":1761126675000},"source":"Crossref","is-referenced-by-count":0,"title":["An Approximate Embedding for Designing Ethical Reinforcement Learning Environments"],"prefix":"10.3233","author":[{"given":"Arnau","family":"Mayoral-Macau","sequence":"first","affiliation":[{"name":"IIIA-CSIC, Spain"}]},{"given":"Manel","family":"Rodriguez-Soto","sequence":"additional","affiliation":[{"name":"IIIA-CSIC, Spain"}]},{"given":"Enrico","family":"Marchesini","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Boston, USA"}]},{"given":"Mart\u00ed","family":"S\u00e1nchez-Fibla","sequence":"additional","affiliation":[{"name":"IIIA-CSIC, Spain"}]},{"given":"Maite","family":"L\u00f3pez-S\u00e1nchez","sequence":"additional","affiliation":[{"name":"Universitat de Barcelona"}]},{"given":"Juan Antonio","family":"Rodr\u00edguez-Aguilar","sequence":"additional","affiliation":[{"name":"IIIA-CSIC, Spain"}]},{"given":"Alessandro","family":"Farinelli","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Verona, Verona, Italy"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2025"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA251093","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T09:51:15Z","timestamp":1761126675000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA251093"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,21]]},"ISBN":["9781643686318"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia251093","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,21]]}}}