{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T04:36:51Z","timestamp":1790483811464,"version":"4.1.0"},"publisher-location":"New York, NY, USA","reference-count":31,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T00:00:00Z","timestamp":1715385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,5,11]]},"DOI":"10.1145\/3613905.3650948","type":"proceedings-article","created":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T04:15:21Z","timestamp":1715400921000},"page":"1-6","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":29,"title":["Designing for Human-Agent Alignment: Understanding what humans want from their agents"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4666-1926","authenticated-orcid":false,"given":"Nitesh","family":"Goyal","sequence":"first","affiliation":[{"name":"Google Research, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9441-3337","authenticated-orcid":false,"given":"Minsuk","family":"Chang","sequence":"additional","affiliation":[{"name":"Google, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1941-939X","authenticated-orcid":false,"given":"Michael","family":"Terry","sequence":"additional","affiliation":[{"name":"Google, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,11]]},"reference":[{"key":"e_1_3_3_3_1_1","unstructured":"[n. d.]. AutoGPT. https:\/\/github.com\/Significant-Gravitas\/AutoGPT. Accessed: 2024-01-25."},{"key":"e_1_3_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_3_3_3_3_1","volume-title":"Constitutional ai: Harmlessness from ai feedback. arXiv preprint arXiv:2212.08073","author":"Bai Yuntao","year":"2022","unstructured":"Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, 2022. Constitutional ai: Harmlessness from ai feedback. arXiv preprint arXiv:2212.08073 (2022)."},{"key":"e_1_3_3_3_4_1","volume-title":"A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations. arXiv preprint arXiv:2401.17486","author":"Berman Glen","year":"2024","unstructured":"Glen Berman, Nitesh Goyal, and Michael Madaio. 2024. A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations. arXiv preprint arXiv:2401.17486 (2024)."},{"key":"e_1_3_3_3_5_1","unstructured":"Tom\u00a0B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel\u00a0M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. arxiv:2005.14165\u00a0[cs.CL]"},{"key":"e_1_3_3_3_6_1","volume-title":"Emergent communication through negotiation. arXiv preprint arXiv:1804.03980","author":"Cao Kris","year":"2018","unstructured":"Kris Cao, Angeliki Lazaridou, Marc Lanctot, Joel\u00a0Z Leibo, Karl Tuyls, and Stephen Clark. 2018. Emergent communication through negotiation. arXiv preprint arXiv:1804.03980 (2018)."},{"key":"e_1_3_3_3_7_1","volume-title":"The alignment problem: Machine learning and human values","author":"Christian Brian","unstructured":"Brian Christian. 2020. The alignment problem: Machine learning and human values. WW Norton & Company."},{"key":"e_1_3_3_3_8_1","unstructured":"Paul Christiano. [n. d.]. Clarifying \u201cAI Alignment\u201d. https:\/\/www.alignmentforum.org\/posts\/ZeE7EKHTFMBs8eMxn\/clarifying-ai-alignment. Accessed: 2023-08-23."},{"key":"e_1_3_3_3_9_1","volume-title":"Improving language model negotiation with self-play and in-context learning from ai feedback. arXiv preprint arXiv:2305.10142","author":"Fu Yao","year":"2023","unstructured":"Yao Fu, Hao Peng, Tushar Khot, and Mirella Lapata. 2023. Improving language model negotiation with self-play and in-context learning from ai feedback. arXiv preprint arXiv:2305.10142 (2023)."},{"key":"e_1_3_3_3_10_1","volume-title":"Artificial intelligence, values, and alignment. Minds and machines 30, 3","author":"Gabriel Iason","year":"2020","unstructured":"Iason Gabriel. 2020. Artificial intelligence, values, and alignment. Minds and machines 30, 3 (2020), 411\u2013437."},{"key":"e_1_3_3_3_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2820071"},{"key":"e_1_3_3_3_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130917"},{"key":"e_1_3_3_3_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481376"},{"key":"e_1_3_3_3_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_3_3_3_15_1","volume-title":"AI safety via debate. arXiv preprint arXiv:1805.00899","author":"Irving Geoffrey","year":"2018","unstructured":"Geoffrey Irving, Paul Christiano, and Dario Amodei. 2018. AI safety via debate. arXiv preprint arXiv:1805.00899 (2018)."},{"key":"e_1_3_3_3_16_1","volume-title":"Deal or no deal? end-to-end learning for negotiation dialogues. arXiv preprint arXiv:1706.05125","author":"Lewis Mike","year":"2017","unstructured":"Mike Lewis, Denis Yarats, Yann\u00a0N Dauphin, Devi Parikh, and Dhruv Batra. 2017. Deal or no deal? end-to-end learning for negotiation dialogues. arXiv preprint arXiv:1706.05125 (2017)."},{"key":"e_1_3_3_3_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357072"},{"key":"e_1_3_3_3_18_1","volume-title":"Emergent communication under competition. arXiv preprint arXiv:2101.10276","author":"Noukhovitch Michael","year":"2021","unstructured":"Michael Noukhovitch, Travis LaCroix, Angeliki Lazaridou, and Aaron Courville. 2021. Emergent communication under competition. arXiv preprint arXiv:2101.10276 (2021)."},{"key":"e_1_3_3_3_19_1","volume-title":"Instruction tuning with gpt-4. arXiv preprint arXiv:2304.03277","author":"Peng Baolin","year":"2023","unstructured":"Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, and Jianfeng Gao. 2023. Instruction tuning with gpt-4. arXiv preprint arXiv:2304.03277 (2023)."},{"key":"e_1_3_3_3_20_1","volume-title":"ConstitutionMaker: Interactively Critiquing Large Language Models by Converting Feedback into Principles. arXiv preprint arXiv:2310.15428","author":"Petridis Savvas","year":"2023","unstructured":"Savvas Petridis, Ben Wedin, James Wexler, Aaron Donsbach, Mahima Pushkarna, Nitesh Goyal, Carrie\u00a0J Cai, and Michael Terry. 2023. ConstitutionMaker: Interactively Critiquing Large Language Models by Converting Feedback into Principles. arXiv preprint arXiv:2310.15428 (2023)."},{"key":"e_1_3_3_3_21_1","volume-title":"Artificial Intelligence: A Modern Approach","author":"Russell Stuart","year":"2009","unstructured":"Stuart Russell and Peter Norvig. 2009. Artificial Intelligence: A Modern Approach (3rd ed.). Prentice Hall Press, USA.","edition":"3"},{"key":"e_1_3_3_3_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557189"},{"key":"e_1_3_3_3_23_1","volume-title":"Towards Dialogue Systems with Agency in Human-AI Collaboration Tasks. arXiv preprint arXiv:2305.12815","author":"Sharma Ashish","year":"2023","unstructured":"Ashish Sharma, Sudha Rao, Chris Brockett, Akanksha Malhotra, Nebojsa Jojic, and Bill Dolan. 2023. Towards Dialogue Systems with Agency in Human-AI Collaboration Tasks. arXiv preprint arXiv:2305.12815 (2023)."},{"key":"e_1_3_3_3_24_1","volume-title":"Process Alignment, and Evaluation Support. arXiv preprint arXiv:2311.00710","author":"Terry Michael","year":"2023","unstructured":"Michael Terry, Chinmay Kulkarni, Martin Wattenberg, Lucas Dixon, and Meredith\u00a0Ringel Morris. 2023. AI Alignment in the Design of Interactive AI: Specification Alignment, Process Alignment, and Evaluation Support. arXiv preprint arXiv:2311.00710 (2023)."},{"key":"e_1_3_3_3_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/0735275112457914"},{"key":"e_1_3_3_3_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580903"},{"key":"e_1_3_3_3_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581402"},{"key":"e_1_3_3_3_28_1","first-page":"24824","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume":"35","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc\u00a0V Le, Denny Zhou, 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 (2022), 24824\u201324837.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_3_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580900"},{"key":"e_1_3_3_3_30_1","doi-asserted-by":"crossref","unstructured":"JD Zamfirescu-Pereira Heather Wei Amy Xiao Kitty Gu Grace Jung Matthew\u00a0G Lee Bjoern Hartmann and Qian Yang. 2023. Herding AI Cats: Lessons from Designing a Chatbot by Prompting GPT-3. (2023).","DOI":"10.1145\/3563657.3596138"},{"key":"e_1_3_3_3_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581388"}],"event":{"name":"CHI '24: CHI Conference on Human Factors in Computing Systems","location":"Honolulu HI USA","acronym":"CHI '24","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGACCESS ACM Special Interest Group on Accessible Computing"]},"container-title":["Extended Abstracts of the CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3613905.3650948","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3613905.3650948","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:57:07Z","timestamp":1750276627000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3613905.3650948"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,11]]},"references-count":31,"alternative-id":["10.1145\/3613905.3650948","10.1145\/3613905"],"URL":"https:\/\/doi.org\/10.1145\/3613905.3650948","relation":{},"subject":[],"published":{"date-parts":[[2024,5,11]]},"assertion":[{"value":"2024-05-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}