{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T19:08:28Z","timestamp":1790708908783,"version":"4.1.0"},"publisher-location":"New York, NY, USA","reference-count":63,"publisher":"ACM","funder":[{"name":"National Natural Science Foundation of China","award":["62476150"],"award-info":[{"award-number":["62476150"]}]},{"name":"Beijing Natural Science Foundation","award":["L243006"],"award-info":[{"award-number":["L243006"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,11,10]]},"DOI":"10.1145\/3746252.3761324","type":"proceedings-article","created":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T00:18:04Z","timestamp":1762561084000},"page":"2388-2398","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Constraint Back-translation Improves Complex Instruction Following of Large Language Models"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1836-8413","authenticated-orcid":false,"given":"Yunjia","family":"Qi","sequence":"first","affiliation":[{"name":"Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-7192-5790","authenticated-orcid":false,"given":"Hao","family":"Peng","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5727-143X","authenticated-orcid":false,"given":"Xiaozhi","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3040-4391","authenticated-orcid":false,"given":"Bin","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8907-3526","authenticated-orcid":false,"given":"Lei","family":"Hou","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6244-0664","authenticated-orcid":false,"given":"Juanzi","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,11,10]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Aida Amini Saadia Gabriel Peter Lin Rik Koncel-Kedziorski Yejin Choi and Hannaneh Hajishirzi. 2019. MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalisms. arXiv:1905.13319 [cs.CL]"},{"key":"e_1_3_2_1_2_1","volume-title":"Longalign: A recipe for long context alignment of large language models. arXiv preprint arXiv:2401.18058","author":"Bai Yushi","year":"2024","unstructured":"Yushi Bai, Xin Lv, Jiajie Zhang, Yuze He, Ji Qi, Lei Hou, Jie Tang, Yuxiao Dong, and Juanzi Li. 2024a. Longalign: A recipe for long context alignment of large language models. arXiv preprint arXiv:2401.18058 (2024)."},{"key":"e_1_3_2_1_3_1","volume-title":"Advances in NeurlPS","volume":"36","author":"Bai Yushi","year":"2024","unstructured":"Yushi Bai, Jiahao Ying, Yixin Cao, Xin Lv, Yuze He, Xiaozhi Wang, Jifan Yu, Kaisheng Zeng, Yijia Xiao, Haozhe Lyu, et al., 2024b. Benchmarking foundation models with language-model-as-an-examiner. Advances in NeurlPS, Vol. 36 (2024)."},{"key":"e_1_3_2_1_4_1","volume-title":"Tomasz Korbak, and Owain Evans.","author":"Berglund Lukas","year":"2023","unstructured":"Lukas Berglund, Meg Tong, Max Kaufmann, Mikita Balesni, Asa Cooper Stickland, Tomasz Korbak, and Owain Evans. 2023. The reversal curse: Llms trained on'' a is b'' fail to learn'' b is a''. arXiv preprint arXiv:2309.12288 (2023)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2019.09.013"},{"key":"e_1_3_2_1_6_1","unstructured":"Chi-Min Chan Weize Chen Yusheng Su Jianxuan Yu Wei Xue Shanghang Zhang Jie Fu and Zhiyuan Liu. 2024. ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate. In ICLR."},{"key":"e_1_3_2_1_7_1","volume-title":"The sifo benchmark: Investigating the sequential instruction following ability of large language models. arXiv preprint arXiv:2406.19999","author":"Chen Xinyi","year":"2024","unstructured":"Xinyi Chen, Baohao Liao, Jirui Qi, Panagiotis Eustratiadis, Christof Monz, Arianna Bisazza, and Maarten de Rijke. 2024b. The sifo benchmark: Investigating the sequential instruction following ability of large language models. arXiv preprint arXiv:2406.19999 (2024)."},{"key":"e_1_3_2_1_8_1","unstructured":"Zixiang Chen Yihe Deng Huizhuo Yuan Kaixuan Ji and Quanquan Gu. 2024a. Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models. In ICML."},{"key":"e_1_3_2_1_9_1","volume-title":"Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality. See https:\/\/vicuna. lmsys.org (accessed","author":"Chiang Wei-Lin","year":"2023","unstructured":"Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E Gonzalez, et al., 2023. Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality. See https:\/\/vicuna. lmsys.org (accessed 14 April 2023), Vol. 2, 3 (2023), 6."},{"key":"e_1_3_2_1_10_1","volume-title":"Think you have solved question answering? Try arc, the ai2 reasoning challenge. ArXiv preprint","author":"Clark Peter","year":"2018","unstructured":"Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018. Think you have solved question answering? Try arc, the ai2 reasoning challenge. ArXiv preprint (2018). https:\/\/arxiv.org\/abs\/1803.05457"},{"key":"e_1_3_2_1_11_1","unstructured":"Karl Cobbe Vineet Kosaraju Mohammad Bavarian Jacob Hilton Reiichiro Nakano Christopher Hesse and John Schulman. 2021. Training Verifiers to Solve Math Word Problems. arXiv:2110.14168 [cs.LG]"},{"key":"e_1_3_2_1_12_1","volume-title":"Ultrafeedback: Boosting language models with high-quality feedback. arXiv preprint arXiv:2310.01377","author":"Cui Ganqu","year":"2023","unstructured":"Ganqu Cui, Lifan Yuan, Ning Ding, Guanming Yao, Wei Zhu, Yuan Ni, Guotong Xie, Zhiyuan Liu, and Maosong Sun. 2023. Ultrafeedback: Boosting language models with high-quality feedback. arXiv preprint arXiv:2310.01377 (2023)."},{"key":"e_1_3_2_1_13_1","unstructured":"Abhimanyu Dubey Abhinav Jauhri Abhinav Pandey Abhishek Kadian Ahmad Al-Dahle Aiesha Letman Akhil Mathur Alan Schelten Amy Yang Angela Fan et al. 2024. The llama 3 herd of models. arXiv preprint arXiv:2407.21783 (2024)."},{"key":"e_1_3_2_1_14_1","volume-title":"Length-controlled alpacaeval: A simple way to debias automatic evaluators. arXiv preprint arXiv:2404.04475","author":"Dubois Yann","year":"2024","unstructured":"Yann Dubois, Bal\u00e1zs Galambosi, Percy Liang, and Tatsunori B Hashimoto. 2024. Length-controlled alpacaeval: A simple way to debias automatic evaluators. arXiv preprint arXiv:2404.04475 (2024)."},{"key":"e_1_3_2_1_15_1","volume-title":"Orca-chat: A high-quality explanation-style chat dataset.","author":"Es Shahul","year":"2023","unstructured":"Shahul Es. 2023. Orca-chat: A high-quality explanation-style chat dataset."},{"key":"e_1_3_2_1_16_1","volume-title":"Refined Direct Preference Optimization with Synthetic Data for Behavioral Alignment of LLMs. arXiv preprint arXiv:2402.08005","author":"Gallego V\u00edctor","year":"2024","unstructured":"V\u00edctor Gallego. 2024. Refined Direct Preference Optimization with Synthetic Data for Behavioral Alignment of LLMs. arXiv preprint arXiv:2402.08005 (2024)."},{"key":"e_1_3_2_1_17_1","volume-title":"Reverse training to nurse the reversal curse. arXiv preprint arXiv:2403.13799","author":"Golovneva Olga","year":"2024","unstructured":"Olga Golovneva, Zeyuan Allen-Zhu, Jason Weston, and Sainbayar Sukhbaatar. 2024. Reverse training to nurse the reversal curse. arXiv preprint arXiv:2403.13799 (2024)."},{"key":"e_1_3_2_1_18_1","unstructured":"Qianyu He Jie Zeng Qianxi He Jiaqing Liang and Yanghua Xiao. 2024. From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models. arXiv:2404.15846 [cs.CL]"},{"key":"e_1_3_2_1_19_1","volume-title":"Advances in Neural Information Processing Systems","volume":"36","author":"Hejna Joey","year":"2024","unstructured":"Joey Hejna and Dorsa Sadigh. 2024. Inverse preference learning: Preference-based rl without a reward function. Advances in Neural Information Processing Systems, Vol. 36 (2024)."},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of ICLR. https:\/\/openreview.net\/forum?id=d7KBjmI3GmQ","author":"Hendrycks Dan","year":"2021","unstructured":"Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021. Measuring Massive Multitask Language Understanding. In Proceedings of ICLR. https:\/\/openreview.net\/forum?id=d7KBjmI3GmQ"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-2703"},{"key":"e_1_3_2_1_22_1","unstructured":"Hamish Ivison Yizhong Wang Valentina Pyatkin Nathan Lambert Matthew Peters Pradeep Dasigi Joel Jang David Wadden Noah A Smith Iz Beltagy et al. 2023. Camels in a changing climate: Enhancing lm adaptation with tulu 2. arXiv preprint arXiv:2311.10702 (2023)."},{"key":"e_1_3_2_1_23_1","volume-title":"Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al.","author":"Jiang Albert Q","year":"2023","unstructured":"Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al., 2023. Mistral 7B. arXiv preprint arXiv:2310.06825 (2023)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.257"},{"key":"e_1_3_2_1_25_1","volume-title":"LongForm: Effective Instruction Tuning with Reverse Instructions. arXiv preprint arXiv:2304.08460","author":"K\u00f6ksal Abdullatif","year":"2023","unstructured":"Abdullatif K\u00f6ksal, Timo Schick, Anna Korhonen, and Hinrich Sch\u00fctze. 2023. LongForm: Effective Instruction Tuning with Reverse Instructions. arXiv preprint arXiv:2304.08460 (2023)."},{"key":"e_1_3_2_1_26_1","volume-title":"Keith Stevens, Abdullah Barhoum, Duc Nguyen, Oliver Stanley, Rich\u00e1rd Nagyfi, et al.","author":"K\u00f6pf Andreas","year":"2024","unstructured":"Andreas K\u00f6pf, Yannic Kilcher, Dimitri von R\u00fctte, Sotiris Anagnostidis, Zhi Rui Tam, Keith Stevens, Abdullah Barhoum, Duc Nguyen, Oliver Stanley, Rich\u00e1rd Nagyfi, et al., 2024. Openassistant conversations-democratizing large language model alignment. Advances in NeurlPS, Vol. 36 (2024)."},{"key":"e_1_3_2_1_27_1","volume-title":"Self-alignment with instruction backtranslation. arXiv preprint arXiv:2308.06259","author":"Li Xian","year":"2023","unstructured":"Xian Li, Ping Yu, Chunting Zhou, Timo Schick, Omer Levy, Luke Zettlemoyer, Jason Weston, and Mike Lewis. 2023a. Self-alignment with instruction backtranslation. arXiv preprint arXiv:2308.06259 (2023)."},{"key":"e_1_3_2_1_28_1","unstructured":"Xian Li Ping Yu Chunting Zhou Timo Schick Omer Levy Luke Zettlemoyer Jason E Weston and Mike Lewis. 2024. Self-Alignment with Instruction Backtranslation. In ICLR."},{"key":"e_1_3_2_1_29_1","volume-title":"Hashimoto","author":"Li Xuechen","year":"2023","unstructured":"Xuechen Li, Tianyi Zhang, Yann Dubois, Rohan Taori, Ishaan Gulrajani, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. 2023b. AlpacaEval: An Automatic Evaluator of Instruction-following Models. https:\/\/github.com\/tatsu-lab\/alpaca_eval."},{"key":"e_1_3_2_1_30_1","volume-title":"Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74-81.","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74-81."},{"key":"e_1_3_2_1_31_1","volume-title":"Aligning Teacher with Student Preferences for Tailored Training Data Generation. arXiv preprint arXiv:2406.19227","author":"Liu Yantao","year":"2024","unstructured":"Yantao Liu, Zhao Zhang, Zijun Yao, Shulin Cao, Lei Hou, and Juanzi Li. 2024. Aligning Teacher with Student Preferences for Tailored Training Data Generation. arXiv preprint arXiv:2406.19227 (2024)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.3115\/1118108.1118117"},{"key":"e_1_3_2_1_33_1","first-page":"881","article-title":"Paraphrasing revisited with neural machine translation","author":"Mallinson Jonathan","year":"2017","unstructured":"Jonathan Mallinson, Rico Sennrich, and Mirella Lapata. 2017. Paraphrasing revisited with neural machine translation. In Proceedings of ACL. 881-893.","journal-title":"Proceedings of ACL."},{"key":"e_1_3_2_1_34_1","volume-title":"Simpo: Simple preference optimization with a reference-free reward. arXiv preprint arXiv:2405.14734","author":"Meng Yu","year":"2024","unstructured":"Yu Meng, Mengzhou Xia, and Danqi Chen. 2024. Simpo: Simple preference optimization with a reference-free reward. arXiv preprint arXiv:2405.14734 (2024)."},{"key":"e_1_3_2_1_35_1","volume-title":"Orca: Progressive learning from complex explanation traces of gpt-4. arXiv preprint arXiv:2306.02707","author":"Mukherjee Subhabrata","year":"2023","unstructured":"Subhabrata Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, and Ahmed Awadallah. 2023. Orca: Progressive learning from complex explanation traces of gpt-4. arXiv preprint arXiv:2306.02707 (2023)."},{"key":"e_1_3_2_1_36_1","unstructured":"OpenAI. 2022. Introducing ChatGPT. https:\/\/openai.com\/blog\/chatgpt"},{"key":"e_1_3_2_1_37_1","unstructured":"OpenAI. 2024. GPT-4 Technical Report. arXiv:2303.08774 [cs.CL] https:\/\/arxiv.org\/abs\/2303.08774"},{"key":"e_1_3_2_1_38_1","first-page":"27730","article-title":"Training language models to follow instructions with human feedback","volume":"35","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al., 2022. Training language models to follow instructions with human feedback. Advances in NeurlPS, Vol. 35 (2022), 27730-27744.","journal-title":"Advances in NeurlPS"},{"key":"e_1_3_2_1_39_1","volume-title":"Instruction Tuning with GPT-4. arXiv preprint arXiv:2304.03277","author":"Peng Baolin","year":"2023","unstructured":"Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, and Jianfeng Gao. 2023. Instruction Tuning with GPT-4. arXiv preprint arXiv:2304.03277 (2023)."},{"key":"e_1_3_2_1_40_1","volume-title":"Pre-training Distillation for Large Language Models: A Design Space Exploration. ArXiv","author":"Peng Hao","year":"2024","unstructured":"Hao Peng, Xin Lv, Yushi Bai, Zijun Yao, Jiajie Zhang, Lei Hou, and Juanzi Li. 2024. Pre-training Distillation for Large Language Models: A Design Space Exploration. ArXiv, Vol. abs\/2410.16215 (2024). https:\/\/api.semanticscholar.org\/CorpusID:273507110"},{"key":"e_1_3_2_1_41_1","volume-title":"Suri: Multi-constraint instruction following for long-form text generation. arXiv preprint arXiv:2406.19371","author":"Pham Chau Minh","year":"2024","unstructured":"Chau Minh Pham, Simeng Sun, and Mohit Iyyer. 2024. Suri: Multi-constraint instruction following for long-form text generation. arXiv preprint arXiv:2406.19371 (2024)."},{"key":"e_1_3_2_1_42_1","volume-title":"Style transfer through back-translation. arXiv preprint arXiv:1804.09000","author":"Prabhumoye Shrimai","year":"2018","unstructured":"Shrimai Prabhumoye, Yulia Tsvetkov, Ruslan Salakhutdinov, and Alan W Black. 2018. Style transfer through back-translation. arXiv preprint arXiv:1804.09000 (2018)."},{"key":"e_1_3_2_1_43_1","volume-title":"ADELIE: Aligning Large Language Models on Information Extraction. arXiv preprint arXiv:2405.05008","author":"Qi Yunjia","year":"2024","unstructured":"Yunjia Qi, Hao Peng, Xiaozhi Wang, Bin Xu, Lei Hou, and Juanzi Li. 2024. ADELIE: Aligning Large Language Models on Information Extraction. arXiv preprint arXiv:2405.05008 (2024)."},{"key":"e_1_3_2_1_44_1","volume-title":"Infobench: Evaluating instruction following ability in large language models. arXiv preprint arXiv:2401.03601","author":"Qin Yiwei","year":"2024","unstructured":"Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, and Dong Yu. 2024. Infobench: Evaluating instruction following ability in large language models. arXiv preprint arXiv:2401.03601 (2024)."},{"key":"e_1_3_2_1_45_1","unstructured":"Rafael Rafailov Archit Sharma Eric Mitchell Christopher D. Manning Stefano Ermon and Chelsea Finn. 2023. Direct Preference Optimization: Your Language Model is Secretly a Reward Model. In Advances in NeurIPs Alice Oh Tristan Naumann Amir Globerson Kate Saenko Moritz Hardt and Sergey Levine (Eds.). http:\/\/papers.nips.cc\/paper_files\/paper\/2023\/hash\/a85b405ed65c6477a4fe8302b5e06ce7-Abstract-Conference.html"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1454"},{"key":"e_1_3_2_1_47_1","volume-title":"Improving neural machine translation models with monolingual data. arXiv preprint arXiv:1511.06709","author":"Sennrich Rico","year":"2015","unstructured":"Rico Sennrich. 2015. Improving neural machine translation models with monolingual data. arXiv preprint arXiv:1511.06709 (2015)."},{"key":"e_1_3_2_1_48_1","volume-title":"Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models. arxiv preprint arXiv:2404.02823","author":"Sun Haoran","year":"2024","unstructured":"Haoran Sun, Lixin Liu, Junjie Li, Fengyu Wang, Baohua Dong, Ran Lin, and Ruohui Huang. 2024. Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models. arxiv preprint arXiv:2404.02823 (2024). https:\/\/arxiv.org\/abs\/2404.02823"},{"key":"e_1_3_2_1_49_1","first-page":"7","article-title":"Alpaca: A strong, replicable instruction-following model","volume":"3","author":"Taori Rohan","year":"2023","unstructured":"Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, and Tatsunori B Hashimoto. 2023. Alpaca: A strong, replicable instruction-following model. Stanford Center for Research on Foundation Models., Vol. 3, 6 (2023), 7.","journal-title":"Stanford Center for Research on Foundation Models."},{"key":"e_1_3_2_1_50_1","volume-title":"Cassidy Hardin, Surya Bhupatiraju, L\u00e9onard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ram\u00e9, et al.","author":"Team Gemma","year":"2024","unstructured":"Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, L\u00e9onard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ram\u00e9, et al., 2024. Gemma 2: Improving open language models at a practical size. arXiv preprint arXiv:2408.00118 (2024)."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2021.3115992"},{"key":"e_1_3_2_1_52_1","volume-title":"Zephyr: Direct Distillation of LM Alignment. arXiv:2310.16944 [cs.LG]","author":"Tunstall Lewis","year":"2023","unstructured":"Lewis Tunstall, Edward Beeching, Nathan Lambert, Nazneen Rajani, Kashif Rasul, Younes Belkada, Shengyi Huang, Leandro von Werra, Cl\u00e9mentine Fourrier, Nathan Habib, Nathan Sarrazin, Omar Sanseviero, Alexander M. Rush, and Thomas Wolf. 2023. Zephyr: Direct Distillation of LM Alignment. arXiv:2310.16944 [cs.LG]"},{"key":"e_1_3_2_1_53_1","volume-title":"Brian Lester, Nan Du, Andrew M. Dai, and Quoc V. Le.","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, and Quoc V. Le. 2022. Finetuned Language Models are Zero-Shot Learners. In Proceedings of ICLR. https:\/\/openreview.net\/forum?id=gEZrGCozdqR"},{"key":"e_1_3_2_1_54_1","volume-title":"Learning paraphrastic sentence embeddings from back-translated bitext. arXiv preprint arXiv:1706.01847","author":"Wieting John","year":"2017","unstructured":"John Wieting, Jonathan Mallinson, and Kevin Gimpel. 2017. Learning paraphrastic sentence embeddings from back-translated bitext. arXiv preprint arXiv:1706.01847 (2017)."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Thomas Wolf Lysandre Debut Victor Sanh Julien Chaumond Clement Delangue Anthony Moi Pierric Cistac Tim Rault R\u00e9mi Louf Morgan Funtowicz et al. 2019. Huggingface's transformers: State-of-the-art natural language processing. arXiv. arXiv preprint arXiv:1910.03771 (2019).","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"e_1_3_2_1_56_1","volume-title":"Wizardlm: Empowering large language models to follow complex instructions. arXiv preprint arXiv:2304.12244","author":"Xu Can","year":"2023","unstructured":"Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, and Daxin Jiang. 2023. Wizardlm: Empowering large language models to follow complex instructions. arXiv preprint arXiv:2304.12244 (2023)."},{"key":"e_1_3_2_1_57_1","unstructured":"An Yang Baosong Yang Binyuan Hui Bo Zheng Bowen Yu Chang Zhou Chengpeng Li Chengyuan Li Dayiheng Liu Fei Huang et al. 2024. Qwen2 technical report. arXiv preprint arXiv:2407.10671 (2024)."},{"key":"e_1_3_2_1_58_1","volume-title":"Kyunghyun Cho, Xian Li, Sainbayar Sukhbaatar, Jing Xu, and Jason E Weston.","author":"Yuan Weizhe","year":"2024","unstructured":"Weizhe Yuan, Richard Yuanzhe Pang, Kyunghyun Cho, Xian Li, Sainbayar Sukhbaatar, Jing Xu, and Jason E Weston. 2024. Self-Rewarding Language Models. In ICML."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1472"},{"key":"e_1_3_2_1_60_1","unstructured":"Shengyu Zhang Linfeng Dong Xiaoya Li Sen Zhang Xiaofei Sun Shuhe Wang Jiwei Li Runyi Hu Tianwei Zhang Fei Wu et al. 2023. Instruction tuning for large language models: A survey. arXiv preprint arXiv:2308.10792 (2023)."},{"key":"e_1_3_2_1_61_1","unstructured":"Wayne Xin Zhao Kun Zhou Junyi Li Tianyi Tang Xiaolei Wang Yupeng Hou Yingqian Min Beichen Zhang Junjie Zhang Zican Dong et al. 2023. A survey of large language models. arXiv preprint arXiv:2303.18223 (2023)."},{"key":"e_1_3_2_1_62_1","volume-title":"Instruction-Following Evaluation for Large Language Models. arXiv preprint arXiv:2311.07911","author":"Zhou Jeffrey","year":"2023","unstructured":"Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou. 2023. Instruction-Following Evaluation for Large Language Models. arXiv preprint arXiv:2311.07911 (2023)."},{"key":"e_1_3_2_1_63_1","first-page":"10586","article-title":"Beyond one-preference-fits-all alignment: Multi-objective direct preference optimization","author":"Zhou Zhanhui","year":"2024","unstructured":"Zhanhui Zhou, Jie Liu, Jing Shao, Xiangyu Yue, Chao Yang, Wanli Ouyang, and Yu Qiao. 2024. Beyond one-preference-fits-all alignment: Multi-objective direct preference optimization. In Findings of ACL. 10586-10613.","journal-title":"Findings of ACL."}],"event":{"name":"CIKM '25: The 34th ACM International Conference on Information and Knowledge Management","location":"Seoul Republic of Korea","acronym":"CIKM '25","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the 34th ACM International Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3746252.3761324","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T01:40:49Z","timestamp":1765503649000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3746252.3761324"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,10]]},"references-count":63,"alternative-id":["10.1145\/3746252.3761324","10.1145\/3746252"],"URL":"https:\/\/doi.org\/10.1145\/3746252.3761324","relation":{},"subject":[],"published":{"date-parts":[[2025,11,10]]},"assertion":[{"value":"2025-11-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}