{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T04:08:17Z","timestamp":1779422897833,"version":"3.53.1"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,5,26]],"date-time":"2026-05-26T00:00:00Z","timestamp":1779753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,5,26]]},"DOI":"10.1145\/3786335.3813144","type":"proceedings-article","created":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T03:16:22Z","timestamp":1779419782000},"page":"330-347","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["How to Steer Your Multi-Agent System: Human-LLM Collaborative Planning"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-7115-2692","authenticated-orcid":false,"given":"Zeyu","family":"He","sequence":"first","affiliation":[{"name":"Penn State University, State College, Pennsylvania, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0137-7171","authenticated-orcid":false,"given":"Hannah","family":"Kim","sequence":"additional","affiliation":[{"name":"Megagon Labs, Mountain View, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6330-0217","authenticated-orcid":false,"given":"Dan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Megagon Labs, Mountain View, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1499-2808","authenticated-orcid":false,"given":"Estevam","family":"Hruschka","sequence":"additional","affiliation":[{"name":"Megagon Labs, Mountain View, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,5,26]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"publisher","unstructured":"M. Ai-Chang J. Bresina L. Charest A. Chase J.C.-J. Hsu A. Jonsson B. Kanefsky P. Morris Kanna Rajan J. Yglesias B.G. Chafin W.C. Dias and P.F. Maldague. 2004. MAPGEN: mixed-initiative planning and scheduling for the Mars Exploration Rover mission. IEEE Intelligent Systems 19 1 (2004) 8\u201312. 10.1109\/MIS.2004.1265878","DOI":"10.1109\/MIS.2004.1265878"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASEW67777.2025.00064"},{"key":"e_1_3_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3714135"},{"key":"e_1_3_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA57147.2024.10610676"},{"key":"e_1_3_3_2_6_2","unstructured":"Karl Cobbe Vineet Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun Lukasz Kaiser Matthias Plappert Jerry Tworek Jacob Hilton Reiichiro Nakano Christopher Hesse and John Schulman. 2021. Training Verifiers to Solve Math Word Problems. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2110.14168 (2021)."},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3713581"},{"key":"e_1_3_3_2_8_2","unstructured":"K.\u00a0J.\u00a0Kevin Feng David\u00a0W. McDonald and Amy\u00a0X. Zhang. 2025. Levels of Autonomy for AI Agents. arxiv:https:\/\/arXiv.org\/abs\/2506.12469\u00a0[cs.HC] https:\/\/arxiv.org\/abs\/2506.12469"},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3772318.3791673"},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3746059.3747636"},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2024\/890"},{"key":"e_1_3_3_2_12_2","volume-title":"The Twelfth International Conference on Learning Representations","author":"Hong Sirui","year":"2024","unstructured":"Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka\u00a0Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and J\u00fcrgen Schmidhuber. 2024. MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework. In The Twelfth International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=VtmBAGCN7o"},{"key":"e_1_3_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"publisher","unstructured":"Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng Haotian Wang Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin and Ting Liu. 2025. A Survey on Hallucination in Large Language Models: Principles Taxonomy Challenges and Open Questions. ACM Trans. Inf. Syst. 43 2 Article 42 (Jan. 2025) 55\u00a0pages. 10.1145\/37031553703155\"\/>","DOI":"10.1145\/3703155"},{"key":"e_1_3_3_2_15_2","unstructured":"Xu Huang Weiwen Liu Xiaolong Chen Xingmei Wang Hao Wang Defu Lian Yasheng Wang Ruiming Tang and Enhong Chen. 2024. Understanding the planning of LLM agents: A survey. arxiv:https:\/\/arXiv.org\/abs\/2402.02716\u00a0[cs.AI] https:\/\/arxiv.org\/abs\/2402.02716"},{"key":"e_1_3_3_2_16_2","series-title":"(ICML\u201924)","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"Kambhampati Subbarao","year":"2024","unstructured":"Subbarao Kambhampati, Karthik Valmeekam, Lin Guan, Mudit Verma, Kaya Stechly, Siddhant Bhambri, Lucas Saldyt, and Anil Murthy. 2024. Position: LLMs can\u2019t plan, but can help planning in LLM-modulo frameworks. In Proceedings of the 41st International Conference on Machine Learning (Vienna, Austria) (ICML\u201924). JMLR.org, Article 921, 13\u00a0pages."},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.emnlp-demos.7"},{"key":"e_1_3_3_2_18_2","unstructured":"Joongwon Kim Bhargavi Paranjape Tushar Khot and Hannaneh Hajishirzi. 2024. Husky: A Unified Open-Source Language Agent for Multi-Step Reasoning. arxiv:https:\/\/arXiv.org\/abs\/2406.\u00a0[cs.CL]"},{"key":"e_1_3_3_2_19_2","unstructured":"Boyi Li Philipp Wu Pieter Abbeel and Jitendra Malik. 2025. Interactive Task Planning with Language Models. Transactions on Machine Learning Research (2025). https:\/\/openreview.net\/forum?id=VmfWywWuYQ"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"crossref","unstructured":"Xinyi Li Sai Wang Siqi Zeng Yu Wu and Yi Yang. 2024. A survey on LLM-based multi-agent systems: workflow infrastructure and challenges. Vicinagearth 1 1 (2024) 9.","DOI":"10.1007\/s44336-024-00009-2"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.acl-long.994"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.emnlp-main.278"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642462"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"crossref","unstructured":"David\u00a0J. Moore. 2025. A Taxonomy of Hierarchical Multi-Agent Systems: Design Patterns Coordination Mechanisms and Industrial Applications. arxiv:https:\/\/arXiv.org\/abs\/2508.12683\u00a0[cs.MA] https:\/\/arxiv.org\/abs\/2508.12683","DOI":"10.2139\/ssrn.5544755"},{"key":"e_1_3_3_2_25_2","unstructured":"Hussein Mozannar Gagan Bansal Cheng Tan Adam Fourney Victor Dibia Jingya Chen Jack Gerrits Tyler Payne Matheus\u00a0Kunzler Maldaner Madeleine Grunde-McLaughlin Eric Zhu Griffin Bassman Jacob Alber Peter Chang Ricky Loynd Friederike Niedtner Ece Kamar Maya Murad Rafah Hosn and Saleema Amershi. 2025. Magentic-UI: Towards Human-in-the-loop Agentic Systems. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2507.22358 (2025)."},{"key":"e_1_3_3_2_26_2","unstructured":"Justin Reppert Ben Rachbach Charlie George Luke Stebbing Jungwon Byun Maggie Appleton and Andreas Stuhlm\u00fcller. 2023. Iterated Decomposition: Improving Science Q&A by Supervising Reasoning Processes. arxiv:https:\/\/arXiv.org\/abs\/2301.01751\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2301.01751"},{"key":"e_1_3_3_2_27_2","volume-title":"The Fourteenth International Conference on Learning Representations","author":"Shao Yijia","year":"2026","unstructured":"Yijia Shao, Vinay Samuel, Yucheng Jiang, John Yang, and Diyi Yang. 2026. Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration. In The Fourteenth International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=GDYueXtKXT"},{"key":"e_1_3_3_2_28_2","unstructured":"Lijun Sun Yijun Yang Qiqi Duan Yuhui Shi Chao Lyu Yu-Cheng Chang Chin-Teng Lin and Yang Shen. 2025. Multi-Agent Coordination across Diverse Applications: A Survey. arxiv:https:\/\/arXiv.org\/abs\/2502.14743\u00a0[cs.MA] https:\/\/arxiv.org\/abs\/2502.14743"},{"key":"e_1_3_3_2_29_2","unstructured":"Yashar Talebirad and Amirhossein Nadiri. 2023. Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents. arxiv:https:\/\/arXiv.org\/abs\/2306.03314\u00a0[cs.AI] https:\/\/arxiv.org\/abs\/2306.03314"},{"key":"e_1_3_3_2_30_2","unstructured":"Khanh-Tung Tran Dung Dao Minh-Duong Nguyen Quoc-Viet Pham Barry O\u2019Sullivan and Hoang\u00a0D. Nguyen. 2025. Multi-Agent Collaboration Mechanisms: A Survey of LLMs. arxiv:https:\/\/arXiv.org\/abs\/2501.06322\u00a0[cs.AI] https:\/\/arxiv.org\/abs\/2501.06322"},{"key":"e_1_3_3_2_31_2","series-title":"(NIPS \u201923)","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems","author":"Valmeekam Karthik","year":"2023","unstructured":"Karthik Valmeekam, Matthew Marquez, Sarath Sreedharan, and Subbarao Kambhampati. 2023. On the planning abilities of large language models: a critical investigation. In Proceedings of the 37th International Conference on Neural Information Processing Systems (New Orleans, LA, USA) (NIPS \u201923). Curran Associates Inc., Red Hook, NY, USA, Article 3320, 13\u00a0pages."},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Lei Wang Chen Ma Xueyang Feng Zeyu Zhang Hao Yang Jingsen Zhang Zhiyuan Chen Jiakai Tang Xu Chen Yankai Lin Wayne\u00a0Xin Zhao Zhewei Wei and Ji-Rong Wen. 2024. A survey on large language model based autonomous agents. Frontiers of Computer Science 18 6 (2024) 186345.","DOI":"10.1007\/s11704-024-40231-1"},{"key":"e_1_3_3_2_33_2","unstructured":"Zexin Wang Jingjing Li Quan Zhou Haotian Si Yuanhao Liu Jianhui Li Gaogang Xie Fei Sun Dan Pei and Changhua Pei. 2025. A Survey on AgentOps: Categorization Challenges and Future Directions. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2508.02121 (2025)."},{"key":"e_1_3_3_2_34_2","series-title":"(NIPS \u201922)","volume-title":"Proceedings of the 36th International Conference on Neural Information Processing Systems","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed\u00a0H. Chi, Quoc\u00a0V. Le, and Denny Zhou. 2022. Chain-of-thought prompting elicits reasoning in large language models. In Proceedings of the 36th International Conference on Neural Information Processing Systems (New Orleans, LA, USA) (NIPS \u201922). Curran Associates Inc., Red Hook, NY, USA, Article 1800, 14\u00a0pages."},{"key":"e_1_3_3_2_35_2","volume-title":"COLM 2024","author":"Wu Qingyun","year":"2024","unstructured":"Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang\u00a0(Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen\u00a0W. White, Doug Burger, and Chi Wang. 2024. AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation. In COLM 2024. https:\/\/www.microsoft.com\/en-us\/research\/publication\/autogen-enabling-next-gen-llm-applications-via-multi-agent-conversation-framework\/"},{"key":"e_1_3_3_2_36_2","unstructured":"Henry\u00a0Peng Zou Wei-Chieh Huang Yaozu Wu Yankai Chen Chunyu Miao Hoang Nguyen Yue Zhou Weizhi Zhang Liancheng Fang Langzhou He Yangning Li Dongyuan Li Renhe Jiang Xue Liu and Philip\u00a0S Yu. 2025. A survey on large language model based human-agent systems. Authorea Preprints (2025)."}],"event":{"name":"CAIS '26: ACM Conference on AI and Agentic Systems","location":"San Jose CA USA","acronym":"CAIS '26"},"container-title":["Proceedings of the ACM Conference on AI and Agentic Systems"],"original-title":[],"deposited":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T03:33:15Z","timestamp":1779420795000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3786335.3813144"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,26]]},"references-count":35,"alternative-id":["10.1145\/3786335.3813144","10.1145\/3786335"],"URL":"https:\/\/doi.org\/10.1145\/3786335.3813144","relation":{},"subject":[],"published":{"date-parts":[[2026,5,26]]},"assertion":[{"value":"2026-05-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}