{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T05:33:09Z","timestamp":1784352789078,"version":"3.55.0"},"reference-count":198,"publisher":"Association for Computing Machinery (ACM)","issue":"6","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2026,4,30]]},"abstract":"<jats:p>Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on language tasks, but do not perform well on basic reasoning benchmarks. However, a new in-context learning approach, Chain-of-thought, has demonstrated strong multi-step reasoning abilities on these benchmarks.<\/jats:p>\n                  <jats:p>The research on LLM reasoning abilities started with the question whether LLMs can solve grade school math word problems, and has expanded to other tasks in the past few years. This article reviews the field of multi-step reasoning with LLMs. We propose a taxonomy that identifies different ways to generate, evaluate, and control multi-step reasoning. We provide an in-depth coverage of core approaches and open problems, and we propose a research agenda for the near future.<\/jats:p>\n                  <jats:p>We find that multi-step reasoning approaches have progressed beyond math word problems, and can now successfully solve challenges in logic, combinatorial games, and robotics, sometimes by first generating code that is then executed by external tools. Many studies in multi-step methods use reinforcement learning for finetuning, external optimization loops, in-context reinforcement learning, and self-reflection.<\/jats:p>\n                  <jats:p\/>","DOI":"10.1145\/3774896","type":"journal-article","created":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T11:45:03Z","timestamp":1762343103000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Multi-Step Reasoning with Large Language Models, a Survey"],"prefix":"10.1145","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7202-3322","authenticated-orcid":false,"given":"Aske","family":"Plaat","sequence":"first","affiliation":[{"name":"Computer Science, Leiden University","place":["Leiden, Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8698-974X","authenticated-orcid":false,"given":"Annie","family":"Wong","sequence":"additional","affiliation":[{"name":"Computer Science, Leiden University","place":["Leiden, Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9609-9505","authenticated-orcid":false,"given":"Suzan","family":"Verberne","sequence":"additional","affiliation":[{"name":"Computer Science, Leiden University","place":["Leiden, Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9198-898X","authenticated-orcid":false,"given":"Joost","family":"Broekens","sequence":"additional","affiliation":[{"name":"Computer Science, Leiden University","place":["Leiden, Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0013-7969","authenticated-orcid":false,"given":"Niki","family":"Van Stein","sequence":"additional","affiliation":[{"name":"Computer Science, Leiden University","place":["Leiden, Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6768-1478","authenticated-orcid":false,"given":"Thomas","family":"B\u00e4ck","sequence":"additional","affiliation":[{"name":"Computer Science, Leiden University","place":["Leiden, Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,12,9]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Janice Ahn Rishu Verma Renze Lou Di Liu Rui Zhang and Wenpeng Yin. 2024. Large language models for mathematical reasoning: Progresses and challenges. arXiv:2402.00157. Retrieved from https:\/\/arxiv.org\/abs\/2402.00157"},{"key":"e_1_3_3_3_2","unstructured":"Michael Ahn Anthony Brohan Noah Brown Yevgen Chebotar Omar Cortes Byron David Chelsea Finn Chuyuan Fu Keerthana Gopalakrishnan Karol Hausman et\u00a0al. 2022. Do as I can not as I say: Grounding language in robotic affordances. arXiv:2204.01691. Retrieved from https:\/\/arxiv.org\/abs\/2204.01691"},{"key":"e_1_3_3_4_2","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational LinguisticsarXiv preprint arXiv:1905.13319","author":"Amini Aida","year":"2019","unstructured":"Aida Amini, Saadia Gabriel, Peter Lin, Rik Koncel-Kedziorski, Yejin Choi, and Hannaneh Hajishirzi. 2019. Mathqa: Towards interpretable math word problem solving with operation-based formalisms. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics. arXiv preprint arXiv:1905.13319."},{"key":"e_1_3_3_5_2","doi-asserted-by":"crossref","unstructured":"Arian Askari Roxana Petcu Chuan Meng Mohammad Aliannejadi Amin Abolghasemi Evangelos Kanoulas and Suzan Verberne. 2024. SOLID: Self-seeding and multi-intent self-instructing LLMs for generating intent-aware information-seeking dialogs. arXiv:2402.11633. Retrieved from https:\/\/arxiv.org\/abs\/2402.11633","DOI":"10.18653\/v1\/2025.findings-naacl.357"},{"key":"e_1_3_3_6_2","article-title":"Large linguistic models: Investigating LLMs\u2019 metalinguistic abilities","author":"Begus Gasper","year":"2025","unstructured":"Gasper Begus, Maksymilian Dabkowski, and Ryan Rhodes. 2025. Large linguistic models: Investigating LLMs\u2019 metalinguistic abilities. IEEE Transactions on Artificial Intelligence (2025).","journal-title":"IEEE Transactions on Artificial Intelligence"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.153.3731.34"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445922"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553380"},{"key":"e_1_3_3_10_2","article-title":"Mechanistic interpretability for AI safety\u2013A review","author":"Bereska Leonard","year":"2024","unstructured":"Leonard Bereska and Efstratios Gavves. 2024. Mechanistic interpretability for AI safety\u2013A review. Transactions on Machine Learning Research, arXiv preprint arXiv:2404.14082 (2024).","journal-title":"Transactions on Machine Learning Research, arXiv preprint arXiv:2404.14082"},{"key":"e_1_3_3_11_2","unstructured":"Lukas Berglund Meg Tong Max Kaufmann Mikita Balesni Asa Cooper Stickland Tomasz Korbak and Owain Evans. 2024. The reversal curse: LLMs trained on A is B fail to learn B is A. arXiv:2309.12288. Retrieved from https:\/\/arxiv.org\/abs\/2309.12288"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i16.29720"},{"key":"e_1_3_3_13_2","unstructured":"Bernd Bohnet Azade Nova Aaron T. Parisi Kevin Swersky Katayoon Goshvadi Hanjun Dai Dale Schuurmans Noah Fiedel and Hanie Sedghi. 2024. Exploring and benchmarking the planning capabilities of large language models. arXiv:2406.13094. Retrieved from https:\/\/arxiv.org\/abs\/2406.13094"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_3_15_2","first-page":"1","volume-title":"Proceedings of the 2023 11th Intl Conf on Affective Computing and Intelligent Interaction (ACII)","author":"Broekens Joost","year":"2023","unstructured":"Joost Broekens, Bernhard Hilpert, Suzan Verberne, Kim Baraka, Patrick Gebhard, and Aske Plaat. 2023. Fine-grained affective processing capabilities emerging from large language models. In Proceedings of the 2023 11th Intl Conf on Affective Computing and Intelligent Interaction (ACII). IEEE, 1\u20138."},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(05)80025-9"},{"key":"e_1_3_3_17_2","first-page":"1877","article-title":"Language models are few-shot learners","volume":"33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D. Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et\u00a0al. 2020. Language models are few-shot learners. Advances in Neural Information Processing Systems 33 (2020), 1877\u20131901.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"1","key":"e_1_3_3_18_2","doi-asserted-by":"crossref","first-page":"1265","DOI":"10.1038\/s41467-022-28865-w","article-title":"Improved prediction of protein-protein interactions using AlphaFold2","volume":"13","author":"Bryant Patrick","year":"2022","unstructured":"Patrick Bryant, Gabriele Pozzati, and Arne Elofsson. 2022. Improved prediction of protein-protein interactions using AlphaFold2. Nature Communications 13, 1 (2022), 1265.","journal-title":"Nature Communications"},{"key":"e_1_3_3_19_2","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman et\u00a0al. 2021. Evaluating large language models trained on code. arXiv:2107.03374. Retrieved from https:\/\/arxiv.org\/abs\/2107.03374"},{"key":"e_1_3_3_20_2","article-title":"Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks","author":"Chen Wenhu","year":"2023","unstructured":"Wenhu Chen, Xueguang Ma, Xinyi Wang, and William W. Cohen. 2023. Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks. Transactions of Machine Learning Research. arXiv:2211.12588. Retrieved from https:\/\/arxiv.org\/abs\/2211.12588","journal-title":"Transactions of Machine Learning Research"},{"key":"e_1_3_3_21_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Chen Xinyun","year":"2019","unstructured":"Xinyun Chen, Chen Liang, Adams Wei Yu, Denny Zhou, Dawn Song, and Quoc V. Le. 2019. Neural symbolic reader: Scalable integration of distributed and symbolic representations for reading comprehension. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_3_22_2","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Chen Xinyun","year":"2024","unstructured":"Xinyun Chen, Maxwell Lin, Nathanael Sch\u00e4rli, and Denny Zhou. 2024. Teaching large language models to self-debug. In Proceedings of the 12th International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=KuPixIqPiq"},{"key":"e_1_3_3_23_2","unstructured":"Xi Chen Aske Plaat and Niki van Stein. 2025. How does chain of thought think? Mechanistic interpretability of chain-of-thought reasoning with sparse autoencoding. arXiv:2507.22928. Retrieved from https:\/\/arxiv.org\/abs\/2507.22928"},{"key":"e_1_3_3_24_2","doi-asserted-by":"crossref","unstructured":"Ting-Rui Chiang and Yun-Nung Chen. 2019. Semantically-aligned equation generation for solving and reasoning math word problems. arXiv:1811.00720. Retrieved from https:\/\/arxiv.org\/abs\/1811.00720","DOI":"10.18653\/v1\/N19-1272"},{"key":"e_1_3_3_25_2","unstructured":"Wonje Choi Woo Kyung Kim Minjong Yoo and Honguk Woo. 2024. Embodied CoT distillation from llm to off-the-shelf agents. In Forty-first International Conference on Machine Learning. 8702\u20138721."},{"issue":"240","key":"e_1_3_3_26_2","first-page":"1","article-title":"Palm: Scaling language modeling with pathways","volume":"24","author":"Chowdhery Aakanksha","year":"2023","unstructured":"Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et\u00a0al. 2023. Palm: Scaling language modeling with pathways. Journal of Machine Learning Research 24, 240 (2023), 1\u2013113.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_27_2","unstructured":"Tianzhe Chu Yuexiang Zhai Jihan Yang Shengbang Tong Saining Xie Dale Schuurmans Quoc V. Le Sergey Levine and Yi Ma. 2025. SFT memorizes RL generalizes: A comparative study of foundation model post-training. arXiv:2501.17161. Retrieved from https:\/\/arxiv.org\/abs\/2501.17161"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.65"},{"key":"e_1_3_3_29_2","unstructured":"Zheng Chu Jingchang Chen Qianglong Chen Weijiang Yu Tao He Haotian Wang Weihua Peng Ming Liu Bing Qin and Ting Liu. 2024. A survey of chain of thought reasoning: Advances frontiers and futurearXiv:2309.15402. Retrieved from https:\/\/arxiv.org\/abs\/2309.15402"},{"key":"e_1_3_3_30_2","unstructured":"Yu-Neng Chuang Guanchu Wang Chia-Yuan Chang Ruixiang Tang Fan Yang Mengnan Du Xuanting Cai and Xia Hu. 2024. FaithLM: Towards faithful explanations for large language models. arXiv:2402.04678. Retrieved from https:\/\/arxiv.org\/abs\/2402.04678"},{"key":"e_1_3_3_31_2","unstructured":"Nathan Cloos Meagan Jens Michelangelo Naim Yen-Ling Kuo Ignacio Cases Andrei Barbu and Christopher J. Cueva. 2024. Baba is AI: Break the rules to beat the benchmark. arXiv:2407.13729. Retrieved from https:\/\/arxiv.org\/abs\/2407.13729"},{"key":"e_1_3_3_32_2","unstructured":"Karl Cobbe Vineet Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun Lukasz Kaiser Matthias Plappert Jerry Tworek Jacob Hilton Reiichiro Nakano et\u00a0al. 2021. Training verifiers to solve math word problems. arXiv:2110.14168. Retrieved from https:\/\/arxiv.org\/abs\/2110.14168"},{"key":"e_1_3_3_33_2","unstructured":"MAA Codeforces. 2024. American Invitational Mathematics Examination-AIME 2024. https:\/\/maa.org"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022627411411"},{"key":"e_1_3_3_35_2","unstructured":"Zhuyun Dai Vincent Y. Zhao Ji Ma Yi Luan Jianmo Ni Jing Lu Anton Bakalov Kelvin Guu Keith B. Hall and Ming-Wei Chang. 2023. Promptagator: Few-shot dense retrieval from 8 examples. arXiv:2209.11755. Retrieved from https:\/\/arxiv.org\/abs\/2209.11755"},{"key":"e_1_3_3_36_2","unstructured":"Can Demircan Tankred Saanum Akshay K. Jagadish Marcel Binz and Eric Schulz. 2024. Sparse autoencoders reveal temporal difference learning in large language models. arXiv:2410.01280. Retrieved from https:\/\/arxiv.org\/abs\/2410.01280"},{"key":"e_1_3_3_37_2","unstructured":"Aniket Didolkar Anirudh Goyal Nan Rosemary Ke Siyuan Guo Michal Valko Timothy Lillicrap Danilo Rezende Yoshua Bengio Michael Mozer and Sanjeev Arora. 2024. Metacognitive capabilities of LLMs: An exploration in mathematical problem solving. arXiv:2405.12205. Retrieved from https:\/\/arxiv.org\/abs\/2405.12205"},{"key":"e_1_3_3_38_2","unstructured":"Qingxiu Dong Lei Li Damai Dai Ce Zheng Zhiyong Wu Baobao Chang Xu Sun Jingjing Xu and Zhifang Sui. 2023. A survey on in-context learning.arXiv:2301.00234. Retrieved from https:\/\/arxiv.org\/abs\/2301.00234"},{"key":"e_1_3_3_39_2","unstructured":"Angang Du Bofei Gao Bowei Xing Changjiu Jiang Cheng Chen Cheng Li Chenjun Xiao Chenzhuang Du Chonghua Liao et\u00a0al. 2025. Kimi k1.5: Scaling reinforcement learning with LLMs. arXiv:2501.12599. Retrieved from https:\/\/arxiv.org\/abs\/2501.12599"},{"key":"e_1_3_3_40_2","unstructured":"Benjamin Eysenbach Abhishek Gupta Julian Ibarz and Sergey Levine. 2019. Diversity is all you need: Learning skills without a reward function. arXiv:1802.06070. Retrieved from https:\/\/arxiv.org\/abs\/1802.06070"},{"key":"e_1_3_3_41_2","first-page":"18343","article-title":"Minedojo: Building open-ended embodied agents with internet-scale knowledge","volume":"35","author":"Fan Linxi","year":"2022","unstructured":"Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, et\u00a0al. 2022. Minedojo: Building open-ended embodied agents with internet-scale knowledge. Advances in Neural Information Processing Systems 35 (2022), 18343\u201318362.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(71)90010-5"},{"key":"e_1_3_3_43_2","first-page":"1126","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Finn Chelsea","year":"2017","unstructured":"Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of the International Conference on Machine Learning. PMLR, 1126\u20131135."},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511973000"},{"key":"e_1_3_3_45_2","volume-title":"Proceedings of the 11th International Conference on Learning Representations","author":"Fu Yao","year":"2022","unstructured":"Yao Fu, Hao Peng, Ashish Sabharwal, Peter Clark, and Tushar Khot. 2022. Complexity-based prompting for multi-step reasoning. In Proceedings of the 11th International Conference on Learning Representations."},{"key":"e_1_3_3_46_2","first-page":"10764","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Gao Luyu","year":"2023","unstructured":"Luyu Gao, Aman Madaan, Shuyan Zhou, Uri Alon, Pengfei Liu, Yiming Yang, Jamie Callan, and Graham Neubig. 2023. Pal: Program-aided language models. In Proceedings of the International Conference on Machine Learning. PMLR, 10764\u201310799."},{"key":"e_1_3_3_47_2","unstructured":"Peizhong Gao Ao Xie Shaoguang Mao Wenshan Wu Yan Xia Haipeng Mi and Furu Wei. 2024. Meta reasoning for large language models. arXiv:2406.11698. Retrieved from https:\/\/arxiv.org\/abs\/2406.11698"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10439-023-03272-4"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-017-9314-z"},{"key":"e_1_3_3_50_2","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Gu Yuxian","year":"2023","unstructured":"Yuxian Gu, Li Dong, Furu Wei, and Minlie Huang. 2023. MiniLLM: Knowledge distillation of large language models. In Proceedings of the 12th International Conference on Learning Representations."},{"key":"e_1_3_3_51_2","unstructured":"Daya Guo Dejian Yang Haowei Zhang Junxiao Song Ruoyu Zhang Runxin Xu Qihao Zhu Shirong Ma Peiyi Wang Xiao Bi et\u00a0al. 2025. DeepSeek-R1: Incentivizing reasoning capability in LLMs via reinforcement learning. arXiv:2501.12948. Retrieved from https:\/\/arxiv.org\/abs\/2501.12948"},{"key":"e_1_3_3_52_2","unstructured":"Simeng Han Hailey Schoelkopf Yilun Zhao Zhenting Qi Martin Riddell Wenfei Zhou James Coady David Peng Yujie Qiao Luke Benson et\u00a0al. 2022. Folio: Natural language reasoning with first-order logic. arXiv:2209.00840. Retrieved from https:\/\/arxiv.org\/abs\/2209.00840"},{"key":"e_1_3_3_53_2","doi-asserted-by":"crossref","first-page":"1519","DOI":"10.1145\/1830761.1830768","volume-title":"Proceedings of the 12th Annual Conference Companion on Genetic and Evolutionary Computation","author":"Hansen Nikolaus","year":"2010","unstructured":"Nikolaus Hansen and Raymond Ros. 2010. Black-box optimization benchmarking of NEWUOA compared to BIPOP-CMA-ES: on the BBOB noiseless testbed. In Proceedings of the 12th Annual Conference Companion on Genetic and Evolutionary Computation. 1519\u20131526."},{"key":"e_1_3_3_54_2","unstructured":"Dan Hendrycks Collin Burns Saurav Kadavath Akul Arora Steven Basart Eric Tang Dawn Song and Jacob Steinhardt. 2021. Measuring mathematical problem solving with the math dataset. arXiv:2103.03874. Retrieved from https:\/\/arxiv.org\/abs\/2103.03874"},{"key":"e_1_3_3_55_2","unstructured":"Tom Henighan Jared Kaplan Mor Katz Mark Chen Christopher Hesse Jacob Jackson Heewoo Jun Tom B. Brown Prafulla Dhariwal Scott Gray et\u00a0al. 2020. Scaling laws for autoregressive generative modeling. arXiv:2010.14701. Retrieved from https:\/\/arxiv.org\/abs\/2010.14701"},{"key":"e_1_3_3_56_2","unstructured":"Jordan Hoffmann Sebastian Borgeaud Arthur Mensch Elena Buchatskaya Trevor Cai Eliza Rutherford Diego de Las Casas Lisa Anne Hendricks Johannes Welbl Aidan Clark et\u00a0al. 2022. Training compute-optimal large language models. arXiv:2203.15556. Retrieved from https:\/\/arxiv.org\/abs\/2203.15556"},{"issue":"9","key":"e_1_3_3_57_2","first-page":"5149","article-title":"Meta-learning in neural networks: A survey","volume":"44","author":"Hospedales Timothy","year":"2021","unstructured":"Timothy Hospedales, Antreas Antoniou, Paul Micaelli, and Amos Storkey. 2021. Meta-learning in neural networks: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 9 (2021), 5149\u20135169.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_3_58_2","unstructured":"Edward J. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang and Weizhu Chen. 2022. Lora: Low-rank adaptation of large language models. arXiv:2106.09685. Retrieved from https:\/\/arxiv.org\/abs\/2106.09685"},{"key":"e_1_3_3_59_2","unstructured":"Jie Huang and Kevin Chen-Chuan Chang. 2023. Towards reasoning in large language models: A survey. . arXiv:2212.10403. Retrieved from https:\/\/arxiv.org\/abs\/2212.10403"},{"key":"e_1_3_3_60_2","doi-asserted-by":"crossref","unstructured":"Jiaxin Huang Shixiang Shane Gu Le Hou Yuexin Wu Xuezhi Wang Hongkun Yu and Jiawei Han. 2023. Large language models can self-improve. arXiv:2210.11610. Retrieved from https:\/\/arxiv.org\/abs\/2210.11610","DOI":"10.18653\/v1\/2023.emnlp-main.67"},{"key":"e_1_3_3_61_2","article-title":"A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions","author":"Huang Lei","year":"2025","unstructured":"Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, et\u00a0al. 2025. A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transaction on Information Systems 43, 2 (2025), 1\u201355.","journal-title":"ACM Transaction on Information Systems"},{"key":"e_1_3_3_62_2","unstructured":"Wenlong Huang Fei Xia Ted Xiao Harris Chan Jacky Liang Pete Florence Andy Zeng Jonathan Tompson Igor Mordatch Yevgen Chebotar et\u00a0al. 2022. Inner monologue: Embodied reasoning through planning with language models. arXiv:2207.05608. Retrieved from https:\/\/arxiv.org\/abs\/2207.05608"},{"key":"e_1_3_3_63_2","unstructured":"Zhen Huang Haoyang Zou Xuefeng Li Yixiu Liu Yuxiang Zheng Ethan Chern Shijie Xia Yiwei Qin Weizhe Yuan and Pengfei Liu. 2024. O1 replication journey\u2013part 2: Surpassing O1-preview through simple distillation big progress or bitter lesson? arXiv:2411.16489. Retrieved from https:\/\/arxiv.org\/abs\/2411.16489"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-021-10004-4"},{"key":"e_1_3_3_65_2","doi-asserted-by":"crossref","unstructured":"Shima Imani L. Du and H. Shrivastava. 2023. Mathprompter: Mathematical reasoning using large language models. arXiv:2303.05398. Retrieved from https:\/\/arxiv.org\/abs\/2303.05398","DOI":"10.18653\/v1\/2023.acl-industry.4"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00286"},{"key":"e_1_3_3_67_2","doi-asserted-by":"crossref","unstructured":"Mingyu Jin Qinkai Yu Dong Shu Haiyan Zhao Wenyue Hua Yanda Meng Yongfeng Zhang and Mengnan Du. 2024. The impact of reasoning step length on large language models. In Findings of the Association for Computational Linguistics: ACL 2024 Lun-Wei Ku Andre Martins and Vivek Srikumar (Eds.). Association for Computational Linguistics 1830\u20131842. https:\/\/aclanthology.org\/2024.findings-acl.108\/","DOI":"10.18653\/v1\/2024.findings-acl.108"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-021-03819-2"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.5555\/1622737.1622748"},{"key":"e_1_3_3_70_2","unstructured":"Subbarao Kambhampati Karthik Valmeekam Lin Guan Kaya Stechly Mudit Verma Siddhant Bhambri Lucas Saldyt and Anil Murthy. 2024. LLMs can\u2019t plan but can help planning in LLM-modulo frameworks. arXiv:2402.01817. Retrieved from https:\/\/arxiv.org\/abs\/2402.01817"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00713"},{"key":"e_1_3_3_72_2","unstructured":"Jared Kaplan Sam McCandlish Tom Henighan Tom B. Brown Benjamin Chess Rewon Child Scott Gray Alec Radford Jeffrey Wu and Dario Amodei. 2020. Scaling laws for neural language models. arXiv:2001.08361. Retrieved from https:\/\/arxiv.org\/abs\/2001.08361"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.5555\/3709347.3743629"},{"key":"e_1_3_3_74_2","unstructured":"Moo Jin Kim Karl Pertsch Siddharth Karamcheti Ted Xiao Ashwin Balakrishna Suraj Nair Rafael Rafailov Ethan Foster Grace Lam Pannag Sanketi et\u00a0al. 2024. Openvla: An open-source vision-language-action model. arXiv:2406.09246. Retrieved from https:\/\/arxiv.org\/abs\/2406.09246"},{"key":"e_1_3_3_75_2","first-page":"1","volume-title":"Proceedings of the 7th Conference on Machine Translation (WMT)","author":"Kocmi Tom","year":"2022","unstructured":"Tom Kocmi, Rachel Bawden, Ond\u0159ej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Thamme Gowda, Yvette Graham, Roman Grundkiewicz, Barry Haddow, et\u00a0al. 2022. Findings of the 2022 conference on machine translation (WMT22). In Proceedings of the 7th Conference on Machine Translation (WMT). 1\u201345."},{"key":"e_1_3_3_76_2","first-page":"22199","article-title":"Large language models are zero-shot reasoners","volume":"35","author":"Kojima Takeshi","year":"2022","unstructured":"Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. Large language models are zero-shot reasoners. Advances in Neural Information Processing Systems 35 (2022), 22199\u201322213.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1136"},{"key":"e_1_3_3_78_2","volume-title":"Algorithms and Theory of Computation Handbook, 22-17","author":"Korf Richard E.","year":"1999","unstructured":"Richard E. Korf. 1999. Artificial intelligence search algorithms. In Algorithms and Theory of Computation Handbook, 22-17. Citeseer."},{"key":"e_1_3_3_79_2","unstructured":"Akshay Krishnamurthy Keegan Harris Dylan J. Foster Cyril Zhang and Aleksandrs Slivkins. 2024. Can large language models explore in-context? arXiv:2403.15371. Retrieved from https:\/\/arxiv.org\/abs\/2403.15371"},{"key":"e_1_3_3_80_2","unstructured":"Nathan Lambert Jacob Morrison Valentina Pyatkin Shengyi Huang Hamish Ivison Faeze Brahman Lester James V Miranda Alisa Liu Nouha Dziri Shane Lyu et\u00a0al. 2024. Tulu 3: Pushing frontiers in open language model post-training. arXiv:2411.15124. Retrieved from https:\/\/arxiv.org\/abs\/2411.15124"},{"key":"e_1_3_3_81_2","unstructured":"Tamera Lanham Anna Chen Ansh Radhakrishnan Benoit Steiner Carson Denison Danny Hernandez Dustin Li Esin Durmus Evan Hubinger Jackson Kernion et\u00a0al. 2023. Measuring faithfulness in chain-of-thought reasoning. arXiv:2307.13702. Retrieved from https:\/\/arxiv.org\/abs\/2307.13702"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"key":"e_1_3_3_83_2","first-page":"43057","article-title":"Supervised pretraining can learn in-context reinforcement learning","volume":"36","author":"Lee Jonathan","year":"2023","unstructured":"Jonathan Lee, Annie Xie, Aldo Pacchiano, Yash Chandak, Chelsea Finn, Ofir Nachum, and Emma Brunskill. 2023. Supervised pretraining can learn in-context reinforcement learning. Advances in Neural Information Processing Systems 36 (2023), 43057\u201343083.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_84_2","unstructured":"Martha Lewis and Melanie Mitchell. 2024. Evaluating the robustness of analogical reasoning in large language models. arXiv:2411.14215. Retrieved from https:\/\/arxiv.org\/abs\/2411.14215"},{"key":"e_1_3_3_85_2","unstructured":"Jindong Li Yali Fu Li Fan Jiahong Liu Yao Shu Chengwei Qin Menglin Yang Irwin King and Rex Ying. 2025. Implicit reasoning in large language models: A comprehensive survey. arXiv:2509.02350. Retrieved from https:\/\/arxiv.org\/abs\/2509.02350"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3583780.3615017"},{"key":"e_1_3_3_87_2","unstructured":"Shiyang Li Jianshu Chen Yelong Shen Zhiyu Chen Xinlu Zhang Zekun Li Hong Wang Jing Qian Baolin Peng Yi Mao et\u00a0al. 2024. Explanations from large language models make small reasoners better. arXiv:2210.06726. Retrieved from https:\/\/arxiv.org\/abs\/2210.06726"},{"key":"e_1_3_3_88_2","unstructured":"Yifei Li Zeqi Lin Shizhuo Zhang Qiang Fu Bei Chen Jian-Guang Lou and Weizhu Chen. 2023. Making language models better reasoners with step-aware verifier. arXiv:2206.02336. Retrieved from https:\/\/arxiv.org\/abs\/2206.02336"},{"key":"e_1_3_3_89_2","doi-asserted-by":"crossref","unstructured":"Wang Ling Dani Yogatama Chris Dyer and Phil Blunsom. 2017. Program induction by rationale generation: Learning to solve and explain algebraic word problems. arXiv:1705.04146. Retrieved from https:\/\/arxiv.org\/abs\/1705.04146","DOI":"10.18653\/v1\/P17-1015"},{"key":"e_1_3_3_90_2","volume-title":"Algorithms for Sequential Decision-Making","author":"Littman Michael Lederman","year":"1996","unstructured":"Michael Lederman Littman. 1996. Algorithms for Sequential Decision-Making. Brown University."},{"key":"e_1_3_3_91_2","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"Liu Fei","year":"2024","unstructured":"Fei Liu, Tong Xialiang, Mingxuan Yuan, Xi Lin, Fu Luo, Zhenkun Wang, Zhichao Lu, and Qingfu Zhang. 2024. Evolution of heuristics: Towards efficient automatic algorithm design using large language model. In Proceedings of the 41st International Conference on Machine Learning."},{"key":"e_1_3_3_92_2","unstructured":"Hanmeng Liu Ruoxi Ning Zhiyang Teng Jian Liu Qiji Zhou and Yue Zhang. 2023. Evaluating the logical reasoning ability of ChatGPT and GPT-4. arXiv:2304.03439. Retrieved from https:\/\/arxiv.org\/abs\/2304.03439"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/3560815"},{"key":"e_1_3_3_94_2","unstructured":"Linhao Luo Yuan-Fang Li Gholamreza Haffari and Shirui Pan. 2024. Reasoning on graphs: Faithful and interpretable large language model reasoning. arXiv:2310.01061. Retrieved from https:\/\/arxiv.org\/abs\/2310.01061"},{"key":"e_1_3_3_95_2","doi-asserted-by":"crossref","unstructured":"Qing Lyu Shreya Havaldar Adam Stein Li Zhang Delip Rao Eric Wong Marianna Apidianaki and Chris Callison-Burch. 2023. Faithful chain-of-thought reasoning. arXiv:2301.13379. Retrieved from https:\/\/arxiv.org\/abs\/2301.13379","DOI":"10.18653\/v1\/2023.ijcnlp-main.20"},{"key":"e_1_3_3_96_2","article-title":"Self-refine: Iterative refinement with self-feedback","volume":"36","author":"Madaan Aman","year":"2023","unstructured":"Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, et\u00a0al. 2023. Self-refine: Iterative refinement with self-feedback. Advances in Neural Information Processing Systems 36 (2023).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_97_2","unstructured":"Lucie Charlotte Magister Jonathan Mallinson Jakub Adamek Eric Malmi and Aliaksei Severyn. 2023. Teaching small language models to reason. arXiv:2212.08410. Retrieved from https:\/\/arxiv.org\/abs\/2212.08410"},{"key":"e_1_3_3_98_2","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Miao Shen-Yun","year":"2020","unstructured":"Shen-Yun Miao, Chao-Chun Liang, and Keh-Yih Su. 2020. A diverse corpus for evaluating and developing english math word problem solvers. In Proceedings of the Annual Meeting of the Association for Computational Linguistics. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:220047831"},{"key":"e_1_3_3_99_2","unstructured":"Paulius Micikevicius Sharan Narang Jonah Alben Gregory Diamos Erich Elsen David Garcia Boris Ginsburg Michael Houston Oleksii Kuchaiev Ganesh Venkatesh et\u00a0al. 2018. Mixed precision training. arXiv:1710.03740. Retrieved from https:\/\/arxiv.org\/abs\/1710.03740"},{"key":"e_1_3_3_100_2","unstructured":"Shervin Minaee Tomas Mikolov Narjes Nikzad Meysam Chenaghlu Richard Socher Xavier Amatriain and Jianfeng Gao. 2024. Large language models: A survey. arXiv:2402.06196. Retrieved from https:\/\/arxiv.org\/abs\/2402.06196"},{"key":"e_1_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(90)90086-5"},{"key":"e_1_3_3_102_2","unstructured":"Amir Moeini Jiuqi Wang Jacob Beck Ethan Blaser Shimon Whiteson Rohan Chandra and Shangtong Zhang. 2025. A survey of in-context reinforcement learning. arXiv:2502.07978. Retrieved from https:\/\/arxiv.org\/abs\/2502.07978"},{"key":"e_1_3_3_103_2","unstructured":"Philipp Mondorf and Barbara Plank. 2024. Beyond accuracy: Evaluating the reasoning behavior of large language models\u2013A survey. arXiv:2404.01869. Retrieved from https:\/\/arxiv.org\/abs\/2404.01869"},{"key":"e_1_3_3_104_2","doi-asserted-by":"crossref","unstructured":"Niklas Muennighoff Zitong Yang Weijia Shi Xiang Lisa Li Li Fei-Fei Hannaneh Hajishirzi Luke Zettlemoyer Percy Liang Emmanuel Cand\u00e8s and Tatsunori Hashimoto. 2025. s1: Simple test-time scaling. arXiv:2501.19393. Retrieved from https:\/\/arxiv.org\/abs\/2501.19393","DOI":"10.18653\/v1\/2025.emnlp-main.1025"},{"key":"e_1_3_3_105_2","doi-asserted-by":"crossref","unstructured":"Shashi Narayan Shay B. Cohen and Mirella Lapata. 2018. Don\u2019t give me the details just the summary! topic-aware convolutional neural networks for extreme summarization. arXiv:1808.08745. Retrieved from https:\/\/arxiv.org\/abs\/1808.08745","DOI":"10.18653\/v1\/D18-1206"},{"issue":"3495","key":"e_1_3_3_106_2","doi-asserted-by":"crossref","first-page":"2011","DOI":"10.1126\/science.134.3495.2011","article-title":"Computer simulation of human thinking: A theory of problem solving expressed as a computer program permits simulation of thinking processes.","volume":"134","author":"Newell Allen","year":"1961","unstructured":"Allen Newell and Herbert A. Simon. 1961. Computer simulation of human thinking: A theory of problem solving expressed as a computer program permits simulation of thinking processes. Science 134, 3495 (1961), 2011\u20132017.","journal-title":"Science"},{"key":"e_1_3_3_107_2","unstructured":"Maxwell Nye Anders Johan Andreassen Guy Gur-Ari Henryk Michalewski Jacob Austin David Bieber David Dohan Aitor Lewkowycz Maarten Bosma David Luan et\u00a0al. 2022. Show your work: Scratchpads for intermediate computation with language models. arXiv:2112.00114. Retrieved from https:\/\/arxiv.org\/abs\/2112.00114"},{"key":"e_1_3_3_108_2","first-page":"27730","article-title":"Training language models to follow instructions with human feedback","volume":"35","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et\u00a0al. 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022), 27730\u201327744.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_109_2","unstructured":"Davide Paglieri Bart\u0142omiej Cupia\u0142 Samuel Coward Ulyana Piterbarg Maciej Wolczyk Akbir Khan Eduardo Pignatelli \u0141ukasz Kuci\u0144ski Lerrel Pinto Rob Fergus et\u00a0al. 2024. BALROG: Benchmarking agentic LLM and VLM reasoning on games. arXiv:2411.13543. Retrieved from https:\/\/arxiv.org\/abs\/2411.13543"},{"key":"e_1_3_3_110_2","unstructured":"Liangming Pan Alon Albalak Xinyi Wang and William Yang Wang. 2023. Logic-LM: Empowering large language models with symbolic solvers for faithful logical reasoning. arXiv:2305.12295. Retrieved from https:\/\/arxiv.org\/abs\/2305.12295"},{"key":"e_1_3_3_111_2","doi-asserted-by":"crossref","unstructured":"Denis Paperno Germ\u00e1n Kruszewski Angeliki Lazaridou Quan Ngoc Pham Raffaella Bernardi Sandro Pezzelle Marco Baroni Gemma Boleda and Raquel Fern\u00e1ndez. 2016. The LAMBADA dataset: Word prediction requiring a broad discourse context. arXiv:1606.06031. Retrieved from https:\/\/arxiv.org\/abs\/1606.06031","DOI":"10.18653\/v1\/P16-1144"},{"key":"e_1_3_3_112_2","first-page":"311","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics. 311\u2013318."},{"key":"e_1_3_3_113_2","doi-asserted-by":"crossref","unstructured":"Arkil Patel S. Bhattamishra and N. Goyal. 2021. Are NLP models really able to solve simple math word problems?. arXiv:2103.07191. Retrieved from https:\/\/arxiv.org\/abs\/2103.07191","DOI":"10.18653\/v1\/2021.naacl-main.168"},{"key":"e_1_3_3_114_2","doi-asserted-by":"crossref","unstructured":"Debjit Paul Mete Ismayilzada Maxime Peyrard Beatriz Borges Antoine Bosselut Robert West and Boi Faltings. 2024. Refiner: Reasoning feedback on intermediate representations. arXiv:2304.01904. Retrieved from https:\/\/arxiv.org\/abs\/2304.01904","DOI":"10.18653\/v1\/2024.eacl-long.67"},{"key":"e_1_3_3_115_2","doi-asserted-by":"crossref","unstructured":"Debjit Paul Robert West Antoine Bosselut and Boi Faltings. 2024. Making reasoning matter: Measuring and improving faithfulness of chain-of-thought reasoning. arXiv:2402.13950. Retrieved from https:\/\/arxiv.org\/abs\/2402.13950","DOI":"10.18653\/v1\/2024.findings-emnlp.882"},{"key":"e_1_3_3_116_2","volume-title":"Research, Re: Search & Re-search","author":"Plaat Aske","year":"1996","unstructured":"Aske Plaat. 1996. Research, Re: Search & Re-search. Ph. D. Dissertation. Erasmus University Rotterdam."},{"key":"e_1_3_3_117_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59238-7"},{"key":"e_1_3_3_118_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-19-0638-1"},{"key":"e_1_3_3_119_2","article-title":"Agentic large language models, a survey","author":"Plaat Aske","year":"2025","unstructured":"Aske Plaat, Max van Duijn, Niki van Stein, Mike Preuss, Peter van der Putten, and Kees Joost Batenburg. 2025. Agentic large language models, a survey. Journal of Artificial Intelligence Research, arXiv preprint arXiv:2503.23037 (2025).","journal-title":"Journal of Artificial Intelligence Research, arXiv preprint arXiv:2503.23037"},{"key":"e_1_3_3_120_2","doi-asserted-by":"crossref","unstructured":"Ofir Press Muru Zhang Sewon Min Ludwig Schmidt Noah A. Smith and Mike Lewis. 2023. Measuring and narrowing the compositionality gap in language models. arXiv:2210.03350. Retrieved from https:\/\/arxiv.org\/abs\/2210.03350","DOI":"10.18653\/v1\/2023.findings-emnlp.378"},{"key":"e_1_3_3_121_2","article-title":"The RL\/LLM taxonomy tree: Reviewing synergies between reinforcement learning and large language models","author":"Pternea Moschoula","year":"2024","unstructured":"Moschoula Pternea, Prerna Singh, Abir Chakraborty, Yagna Oruganti, Mirco Milletari, Sayli Bapat, and Kebei Jiang. 2024. The RL\/LLM taxonomy tree: Reviewing synergies between reinforcement learning and large language models. Journal of Artificial Intelligence Research, 80; arXiv preprint arXiv:2402.01874 (2024).","journal-title":"Journal of Artificial Intelligence Research, 80; arXiv preprint arXiv:2402.01874"},{"issue":"8","key":"e_1_3_3_122_2","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","year":"2019","unstructured":"Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.","journal-title":"OpenAI blog"},{"key":"e_1_3_3_123_2","unstructured":"Jack W. Rae Sebastian Borgeaud Trevor Cai Katie Millican Jordan Hoffmann Francis Song John Aslanides Sarah Henderson Roman Ring Susannah Young et\u00a0al. 2021. Scaling language models: Methods analysis & insights from training gopher. arXiv:2112.11446. Retrieved from https:\/\/arxiv.org\/abs\/2112.11446"},{"key":"e_1_3_3_124_2","article-title":"Direct preference optimization: Your language model is secretly a reward model","volume":"36","author":"Rafailov Rafael","year":"2024","unstructured":"Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn. 2024. Direct preference optimization: Your language model is secretly a reward model. Advances in Neural Information Processing Systems 36 (2024).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_125_2","unstructured":"Daking Rai Yilun Zhou Shi Feng Abulhair Saparov and Ziyu Yao. 2024. A practical review of mechanistic interpretability for transformer-based language models. arXiv:2407.02646. Retrieved from https:\/\/arxiv.org\/abs\/2407.02646"},{"key":"e_1_3_3_126_2","doi-asserted-by":"crossref","unstructured":"Pranav Rajpurkar Jian Zhang Konstantin Lopyrev and Percy Liang. 2016. Squad: 100 000+ questions for machine comprehension of text. arXiv:1606.05250. Retrieved from https:\/\/arxiv.org\/abs\/1606.05250","DOI":"10.18653\/v1\/D16-1264"},{"key":"e_1_3_3_127_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-023-06924-6"},{"key":"e_1_3_3_128_2","unstructured":"Subhro Roy and Dan Roth. 2015. Solving general arithmetic word problems. arXiv:1608.01413. Retrieved from https:\/\/arxiv.org\/abs\/1608.01413"},{"key":"e_1_3_3_129_2","first-page":"20601","article-title":"Unsupervised translation of programming languages","volume":"33","author":"Roziere Baptiste","year":"2020","unstructured":"Baptiste Roziere, Marie-Anne Lachaux, Lowik Chanussot, and Guillaume Lample. 2020. Unsupervised translation of programming languages. Advances in Neural Information Processing Systems 33 (2020), 20601\u201320611.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_130_2","unstructured":"Anian Ruoss Fabio Pardo Harris Chan Bonnie Li Volodymyr Mnih and Tim Genewein. 2024. LMAct: A benchmark for in-context imitation learning with long multimodal demonstrations. arXiv:2412.01441. Retrieved from https:\/\/arxiv.org\/abs\/2412.01441"},{"key":"e_1_3_3_131_2","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1249"},{"key":"e_1_3_3_132_2","unstructured":"Pranab Sahoo Ayush Kumar Singh Sriparna Saha Vinija Jain Samrat Mondal and Aman Chadha. 2024. A systematic survey of prompt engineering in large language models: Techniques and applications. arXiv:2402.07927. Retrieved from https:\/\/arxiv.org\/abs\/2402.07927"},{"key":"e_1_3_3_133_2","unstructured":"Abulhair Saparov and He He. 2023. Language models are greedy reasoners: A systematic formal analysis of chain-of-thought. arXiv:2210.01240. Retrieved from https:\/\/arxiv.org\/abs\/2210.01240"},{"key":"e_1_3_3_134_2","unstructured":"John Schultz Jakub Adamek Matej Jusup Marc Lanctot Michael Kaisers Sarah Perrin Daniel Hennes Jeremy Shar Cannada Lewis Anian Ruoss et\u00a0al. 2024. Mastering board games by external and internal planning with language models. arXiv:2412.12119. Retrieved from https:\/\/arxiv.org\/abs\/2412.12119"},{"key":"e_1_3_3_135_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature25978"},{"key":"e_1_3_3_136_2","unstructured":"Bilgehan Sel Ahmad Al-Tawaha Vanshaj Khattar Ruoxi Jia and Ming Jin. 2023. Algorithm of thoughts: Enhancing exploration of ideas in large language models. arXiv:2308.10379. Retrieved from https:\/\/arxiv.org\/abs\/2308.10379"},{"key":"e_1_3_3_137_2","doi-asserted-by":"crossref","unstructured":"Rico Sennrich Barry Haddow and Alexandra Birch. 2016. Improving neural machine translation models with monolingual data. arXiv:1511.06709. Retrieved from https:\/\/arxiv.org\/abs\/1511.06709","DOI":"10.18653\/v1\/P16-1009"},{"key":"e_1_3_3_138_2","unstructured":"Zhihong Shao Peiyi Wang Qihao Zhu Runxin Xu Junxiao Song Xiao Bi Haowei Zhang Mingchuan Zhang Y. K. Li Y. Wu et\u00a0al. 2024. Deepseekmath: Pushing the limits of mathematical reasoning in open language models. arXiv:2402.03300. Retrieved from https:\/\/arxiv.org\/abs\/2402.03300"},{"key":"e_1_3_3_139_2","doi-asserted-by":"crossref","unstructured":"Jianhao Shen Yichun Yin Lin Li Lifeng Shang Xin Jiang Ming Zhang and Qun Liu. 2021. Generate & rank: A multi-task framework for math word problems. arXiv:2109.03034. Retrieved from https:\/\/arxiv.org\/abs\/2109.03034","DOI":"10.18653\/v1\/2021.findings-emnlp.195"},{"key":"e_1_3_3_140_2","unstructured":"Zhengliang Shi Shen Gao Xiuyi Chen Yue Feng Lingyong Yan Haibo Shi Dawei Yin Zhumin Chen Suzan Verberne and Zhaochun Ren. 2024. Chain of tools: Large language model is an automatic multi-tool learner. arXiv:2405.16533. Retrieved from https:\/\/arxiv.org\/abs\/2405.16533"},{"key":"e_1_3_3_141_2","unstructured":"Zhengliang Shi Shen Gao Xiuyi Chen Lingyong Yan Haibo Shi Dawei Yin Zhumin Chen Pengjie Ren Suzan Verberne and Zhaochun Ren. 2024. Learning to use tools via cooperative and interactive agents. arXiv:2403.03031. Retrieved from https:\/\/arxiv.org\/abs\/2403.03031"},{"key":"e_1_3_3_142_2","article-title":"Reflexion: Language agents with verbal reinforcement learning","volume":"36","author":"Shinn Noah","year":"2024","unstructured":"Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2024. Reflexion: Language agents with verbal reinforcement learning. Advances in Neural Information Processing Systems 36 (2024).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_143_2","first-page":"894","volume-title":"Proceedings of the Conference on Robot Learning","author":"Shridhar Mohit","year":"2022","unstructured":"Mohit Shridhar, Lucas Manuelli, and Dieter Fox. 2022. Cliport: What and where pathways for robotic manipulation. In Proceedings of the Conference on Robot Learning. PMLR, 894\u2013906."},{"key":"e_1_3_3_144_2","unstructured":"Mohit Shridhar Xingdi Yuan Marc-Alexandre C\u00f4t\u00e9 Yonatan Bisk Adam Trischler and Matthew Hausknecht. 2021. ALFWorld: Aligning text and embodied environments for interactive learning. arXiv:2010.03768. Retrieved from https:\/\/arxiv.org\/abs\/2010.03768"},{"key":"e_1_3_3_145_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature24270"},{"key":"e_1_3_3_146_2","unstructured":"Aarohi Srivastava Abhinav Rastogi Abhishek Rao Abu Awal Md Shoeb Abubakar Abid Adam Fisch Adam R. Brown Adam Santoro Aditya Gupta Adri\u00e0 Garriga-Alonso et\u00a0al. 2022. Beyond the imitation game: Quantifying and extrapolating the capabilities of language models. arXiv:2206.04615. Retrieved from https:\/\/arxiv.org\/abs\/2206.04615"},{"key":"e_1_3_3_147_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022633531479"},{"key":"e_1_3_3_148_2","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton Richard S.","year":"2018","unstructured":"Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction. MIT Press."},{"key":"e_1_3_3_149_2","doi-asserted-by":"crossref","unstructured":"Oyvind Tafjord Bhavana Dalvi Mishra and Peter Clark. 2020. ProofWriter: Generating implications proofs and abductive statements over natural language. arXiv:2012.13048. Retrieved from https:\/\/arxiv.org\/abs\/2012.13048","DOI":"10.18653\/v1\/2021.findings-acl.317"},{"key":"e_1_3_3_150_2","unstructured":"Alon Talmor Jonathan Herzig Nicholas Lourie and Jonathan Berant. 2019. Commonsenseqa: A question answering challenge targeting commonsense knowledge. arXiv:1811.00937. Retrieved from https:\/\/arxiv.org\/abs\/1811.00937"},{"key":"e_1_3_3_151_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-47240-4_19"},{"key":"e_1_3_3_152_2","unstructured":"Yi Tay Mostafa Dehghani Vinh Q. Tran Xavier Garcia Jason Wei Xuezhi Wang Hyung Won Chung Siamak Shakeri Dara Bahri Tal Schuster et\u00a0al. 2023. Ul2: Unifying language learning paradigms. arXiv:2205.05131. Retrieved from https:\/\/arxiv.org\/abs\/2205.05131"},{"key":"e_1_3_3_153_2","doi-asserted-by":"publisher","DOI":"10.1145\/203330.203343"},{"key":"e_1_3_3_154_2","unstructured":"Romal Thoppilan Daniel De Freitas Jamie Hall Noam Shazeer Apoorv Kulshreshtha Heng-Tze Cheng Alicia Jin Taylor Bos Leslie Baker Yu Du et\u00a0al. 2022. Lamda: Language models for dialog applications. arXiv:2201.08239. Retrieved from https:\/\/arxiv.org\/abs\/2201.08239"},{"key":"e_1_3_3_155_2","unstructured":"Jason Toy Josh MacAdam and Phil Tabor. 2024. Metacognition is all you need? Using introspection in generative agents to improve goal-directed behavior. arXiv:2401.10910. Retrieved from https:\/\/arxiv.org\/abs\/2401.10910"},{"key":"e_1_3_3_156_2","article-title":"Language models don\u2019t always say what they think: Unfaithful explanations in chain-of-thought prompting","volume":"36","author":"Turpin Miles","year":"2024","unstructured":"Miles Turpin, Julian Michael, Ethan Perez, and Samuel Bowman. 2024. Language models don\u2019t always say what they think: Unfaithful explanations in chain-of-thought prompting. Advances in Neural Information Processing Systems 36 (2024).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_157_2","first-page":"75993","article-title":"On the planning abilities of large language models-a critical investigation","volume":"36","author":"Valmeekam Karthik","year":"2023","unstructured":"Karthik Valmeekam, Matthew Marquez, Sarath Sreedharan, and Subbarao Kambhampati. 2023. On the planning abilities of large language models-a critical investigation. Advances in Neural Information Processing Systems 36 (2023), 75993\u201376005.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_158_2","volume-title":"Handbook of Knowledge Representation","author":"Harmelen Frank Van","year":"2008","unstructured":"Frank Van Harmelen, Vladimir Lifschitz, and Bruce Porter. 2008. Handbook of Knowledge Representation. Elsevier."},{"key":"e_1_3_3_159_2","article-title":"LLaMEA: A large language model evolutionary algorithm for automatically generating metaheuristics","author":"Stein Niki van","year":"2024","unstructured":"Niki van Stein and Thomas B\u00e4ck. 2024. LLaMEA: A large language model evolutionary algorithm for automatically generating metaheuristics. IEEE Transactions on Evolutionary Computation; arXiv preprint arXiv:2405.20132 (2024).","journal-title":"IEEE Transactions on Evolutionary Computation; arXiv preprint arXiv:2405.20132"},{"key":"e_1_3_3_160_2","unstructured":"Fien van Wetten Aske Plaat and Max van Duijn. 2025. Baba is LLM: Reasoning in a game with dynamic rules. arXiv:2506.19095. Retrieved from https:\/\/arxiv.org\/abs\/2506.19095"},{"key":"e_1_3_3_161_2","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_162_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11409-006-6893-0"},{"key":"e_1_3_3_163_2","volume-title":"Is the Search Engine of the Future a Chatbot?","author":"Verberne Suzan","year":"2024","unstructured":"Suzan Verberne. 2024. Is the Search Engine of the Future a Chatbot?Inaugural lecture, Leiden University."},{"key":"e_1_3_3_164_2","article-title":"Superglue: A stickier benchmark for general-purpose language understanding systems","volume":"32","author":"Wang Alex","year":"2019","unstructured":"Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. 2019. Superglue: A stickier benchmark for general-purpose language understanding systems. Advances in Neural Information Processing Systems 32 (2019).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_165_2","doi-asserted-by":"crossref","unstructured":"Alex Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy and Samuel R. Bowman. 2018. GLUE: A multi-task benchmark and analysis platform for natural language understanding. arXiv:1804.07461. Retrieved from https:\/\/arxiv.org\/abs\/1804.07461","DOI":"10.18653\/v1\/W18-5446"},{"key":"e_1_3_3_166_2","doi-asserted-by":"crossref","unstructured":"Boshi Wang Sewon Min Xiang Deng Jiaming Shen You Wu Luke Zettlemoyer and Huan Sun. 2023. Towards understanding chain-of-thought prompting: An empirical study of what matters. arXiv:2212.10001. Retrieved from https:\/\/arxiv.org\/abs\/2212.10001","DOI":"10.18653\/v1\/2023.acl-long.153"},{"key":"e_1_3_3_167_2","article-title":"Voyager: An open-ended embodied agent with large language models","author":"Wang Guanzhi","year":"2024","unstructured":"Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. 2024. Voyager: An open-ended embodied agent with large language models. Transactions of Machine Learning Research; arXiv preprint arXiv:2305.16291 (2024).","journal-title":"Transactions of Machine Learning Research; arXiv preprint arXiv:2305.16291"},{"key":"e_1_3_3_168_2","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622022500547"},{"key":"e_1_3_3_169_2","unstructured":"Huaijie Wang Shibo Hao Hanze Dong Shenao Zhang Yilin Bao Ziran Yang and Yi Wu. 2024. Offline reinforcement learning for LLM multi-step reasoning. arXiv:2412.16145. Retrieved from https:\/\/arxiv.org\/abs\/2412.16145"},{"key":"e_1_3_3_170_2","unstructured":"Jiuqi Wang Ethan Blaser Hadi Daneshmand and Shangtong Zhang. 2024. Transformers learn temporal difference methods for in-context reinforcement learning. arXiv:2405.13861. Retrieved from https:\/\/arxiv.org\/abs\/2405.13861"},{"key":"e_1_3_3_171_2","unstructured":"Xuezhi Wang Jason Wei Dale Schuurmans Quoc Le Ed Chi Sharan Narang Aakanksha Chowdhery and Denny Zhou. 2023. Self-consistency improves chain of thought reasoning in language models. arXiv:2203.11171. Retrieved from https:\/\/arxiv.org\/abs\/2203.11171"},{"key":"e_1_3_3_172_2","unstructured":"Yuqing Wang and Yun Zhao. 2024. Metacognitive prompting improves understanding in large language models. arXiv:2308.05342. Retrieved from https:\/\/arxiv.org\/abs\/2308.05342"},{"key":"e_1_3_3_173_2","article-title":"Emergent abilities of large language models","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et\u00a0al. 2022. Emergent abilities of large language models. Transactions of Machine Learning Research; arXiv preprint arXiv:2206.07682 (2022).","journal-title":"Transactions of Machine Learning Research; arXiv preprint arXiv:2206.07682"},{"key":"e_1_3_3_174_2","first-page":"24824","volume":"35","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V. Le, and Denny Zhou. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 (2022), 24824\u201324837.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_175_2","unstructured":"Sean Welleck Ximing Lu Peter West Faeze Brahman Tianxiao Shen Daniel Khashabi and Yejin Choi. 2023. Generating sequences by learning to self-correct. arXiv:2211.00053. Retrieved from https:\/\/arxiv.org\/abs\/2211.00053"},{"key":"e_1_3_3_176_2","unstructured":"Pengcheng Wen Jiaming Ji Chi-Min Chan Juntao Dai Donghai Hong Yaodong Yang Sirui Han and Yike Guo. 2025. Thinkpatterns-21k: A systematic study on the impact of thinking patterns in LLMs. arXiv:2503.12918. Retrieved from https:\/\/arxiv.org\/abs\/2503.12918"},{"key":"e_1_3_3_177_2","doi-asserted-by":"crossref","unstructured":"Yixuan Weng Minjun Zhu Fei Xia Bin Li Shizhu He Shengping Liu Bin Sun Kang Liu and Jun Zhao. 2023. Large language models are better reasoners with self-verification. arXiv:2212.09561. Retrieved from https:\/\/arxiv.org\/abs\/2212.09561","DOI":"10.18653\/v1\/2023.findings-emnlp.167"},{"key":"e_1_3_3_178_2","unstructured":"Siwei Wu Zhongyuan Peng Xinrun Du Tuney Zheng Minghao Liu Jialong Wu Jiachen Ma Yizhi Li Jian Yang Wangchunshu Zhou et\u00a0al. 2024. A comparative study on reasoning patterns of OpenAI\u2019s o1 model. arXiv:2410.13639. Retrieved from https:\/\/arxiv.org\/abs\/2410.13639"},{"key":"e_1_3_3_179_2","first-page":"1819","volume-title":"Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)","author":"Wu Zhaofeng","year":"2024","unstructured":"Zhaofeng Wu, Linlu Qiu, Alexis Ross, Ekin Aky\u00fcrek, Boyuan Chen, Bailin Wang, Najoung Kim, Jacob Andreas, and Yoon Kim. 2024. Reasoning or reciting? Exploring the capabilities and limitations of language models through counterfactual tasks. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 1819\u20131862."},{"key":"e_1_3_3_180_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2023.3277122"},{"key":"e_1_3_3_181_2","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Xiao Ziyang","year":"2023","unstructured":"Ziyang Xiao, Dongxiang Zhang, Yangjun Wu, Lilin Xu, Yuan Jessica Wang, Xiongwei Han, Xiaojin Fu, Tao Zhong, Jia Zeng, Mingli Song, et\u00a0al. 2023. Chain-of-experts: When LLMs meet complex operations research problems. In Proceedings of the 12th International Conference on Learning Representations."},{"key":"e_1_3_3_182_2","article-title":"Self-evaluation guided beam search for reasoning","volume":"36","author":"Xie Yuxi","year":"2024","unstructured":"Yuxi Xie, Kenji Kawaguchi, Yiran Zhao, James Xu Zhao, Min-Yen Kan, Junxian He, and Michael Xie. 2024. Self-evaluation guided beam search for reasoning. Advances in Neural Information Processing Systems 36 (2024).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_183_2","unstructured":"Fengli Xu Qianyue Hao Zefang Zong Jingwei Wang Yunke Zhang Jingyi Wang Xiaochong Lan Jiahui Gong Tianjian Ouyang Fanjin Meng et\u00a0al. 2025. Towards large reasoning models: A survey on scaling LLM reasoning capabilities. arXiv:2501.09686. Retrieved from https:\/\/arxiv.org\/abs\/2501.09686"},{"key":"e_1_3_3_184_2","unstructured":"Jundong Xu Hao Fei Liangming Pan Qian Liu Mong-Li Lee and Wynne Hsu. 2024. Faithful logical reasoning via symbolic chain-of-thought. arXiv:2405.18357. Retrieved from https:\/\/arxiv.org\/abs\/2405.18357"},{"key":"e_1_3_3_185_2","unstructured":"Xiaohan Xu Ming Li Chongyang Tao Tao Shen Reynold Cheng Jinyang Li Can Xu Dacheng Tao and Tianyi Zhou. 2024. A survey on knowledge distillation of large language models. arXiv:2402.13116. Retrieved from https:\/\/arxiv.org\/abs\/2402.13116"},{"key":"e_1_3_3_186_2","unstructured":"Ling Yang Zhaochen Yu Tianjun Zhang Shiyi Cao Minkai Xu Wentao Zhang Joseph E. Gonzalez and Bin Cui. 2024. Buffer of thoughts: Thought-augmented reasoning with large language models. arXiv:2406.04271. Retrieved from https:\/\/arxiv.org\/abs\/2406.04271"},{"key":"e_1_3_3_187_2","first-page":"20744","article-title":"Webshop: Towards scalable real-world web interaction with grounded language agents","volume":"35","author":"Yao Shunyu","year":"2022","unstructured":"Shunyu Yao, Howard Chen, John Yang, and Karthik Narasimhan. 2022. Webshop: Towards scalable real-world web interaction with grounded language agents. Advances in Neural Information Processing Systems 35 (2022), 20744\u201320757.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_188_2","article-title":"Tree of thoughts: Deliberate problem solving with large language models","volume":"36","author":"Yao Shunyu","year":"2024","unstructured":"Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Tom Griffiths, Yuan Cao, and Karthik Narasimhan. 2024. Tree of thoughts: Deliberate problem solving with large language models. Advances in Neural Information Processing Systems 36 (2024).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_189_2","unstructured":"Shunyu Yao Jeffrey Zhao Dian Yu Nan Du Izhak Shafran Karthik Narasimhan and Yuan Cao. 2023. React: Synergizing reasoning and acting in language models. arXiv:2210.03629. Retrieved from https:\/\/arxiv.org\/abs\/2210.03629"},{"key":"e_1_3_3_190_2","article-title":"Natural language reasoning, a survey","author":"Yu Fei","year":"2023","unstructured":"Fei Yu, Hongbo Zhang, Prayag Tiwari, and Benyou Wang. 2023. Natural language reasoning, a survey. Comput. Surveys (2023).","journal-title":"Comput. Surveys"},{"key":"e_1_3_3_191_2","doi-asserted-by":"crossref","unstructured":"Tao Yu Rui Zhang Kai Yang Michihiro Yasunaga Dongxu Wang Zifan Li James Ma Irene Li Qingning Yao et\u00a0al. 2018. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv:1809.08887. Retrieved from https:\/\/arxiv.org\/abs\/1809.08887","DOI":"10.18653\/v1\/D18-1425"},{"key":"e_1_3_3_192_2","article-title":"Star: Self-taught reasoner bootstrapping reasoning with reasoning","author":"Zelikman Eric","year":"2022","unstructured":"Eric Zelikman, Jesse Mu, Noah D. Goodman, and Yuhuai Tony Wu. 2022. Star: Self-taught reasoner bootstrapping reasoning with reasoning. Advances in Neural Information Processing Systems (NeurIPS) (2022).","journal-title":"Advances in Neural Information Processing Systems (NeurIPS)"},{"key":"e_1_3_3_193_2","doi-asserted-by":"crossref","unstructured":"Yizhuo Zhang Heng Wang Shangbin Feng Zhaoxuan Tan Xiaochuang Han Tianxing He and Yulia Tsvetkov. 2024. Can LLM graph reasoning generalize beyond pattern memorization?arXiv:2406.15992. Retrieved from https:\/\/arxiv.org\/abs\/2406.15992","DOI":"10.18653\/v1\/2024.findings-emnlp.127"},{"key":"e_1_3_3_194_2","unstructured":"Zhuosheng Zhang Aston Zhang Mu Li and Alex Smola. 2023. Automatic chain of thought prompting in large language models. arXiv:2210.03493. Retrieved from https:\/\/arxiv.org\/abs\/2210.03493"},{"key":"e_1_3_3_195_2","unstructured":"Wayne Xin Zhao Kun Zhou Junyi Li Tianyi Tang Xiaolei Wang Yupeng Hou Yingqian Min Beichen Zhang Junjie Zhang Zican Dong et\u00a0al. 2023. A survey of large language models. arXiv:2303.18223. Retrieved from https:\/\/arxiv.org\/abs\/2303.18223"},{"key":"e_1_3_3_196_2","unstructured":"Chuanyang Zheng Zhengying Liu Enze Xie Zhenguo Li and Yu Li. 2023. Progressive-hint prompting improves reasoning in large language models. arXiv:2304.09797. Retrieved from https:\/\/arxiv.org\/abs\/2304.09797"},{"key":"e_1_3_3_197_2","article-title":"Judging LLM-as-a-judge with MT-bench and chatbot arena","volume":"36","author":"Zheng Lianmin","year":"2024","unstructured":"Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et\u00a0al. 2024. Judging LLM-as-a-judge with MT-bench and chatbot arena. Advances in Neural Information Processing Systems 36 (2024).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_198_2","doi-asserted-by":"crossref","first-page":"2306","DOI":"10.18653\/v1\/2022.findings-naacl.177","volume-title":"Findings of the Association for Computational Linguistics: NAACL 2022","author":"Zhong Wanjun","year":"2022","unstructured":"Wanjun Zhong, Siyuan Wang, Duyu Tang, Zenan Xu, Daya Guo, Yining Chen, Jiahai Wang, Jian Yin, Ming Zhou, and Nan Duan. 2022. Analytical reasoning of text. In Findings of the Association for Computational Linguistics: NAACL 2022. 2306\u20132319."},{"key":"e_1_3_3_199_2","unstructured":"Denny Zhou Nathanael Sch\u00e4rli Le Hou Jason Wei Nathan Scales Xuezhi Wang Dale Schuurmans Claire Cui Olivier Bousquet Quoc Le et\u00a0al. 2023. Least-to-most prompting enables complex reasoning in large language models. arXiv:2205.10625. Retrieved from https:\/\/arxiv.org\/abs\/2205.10625"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3774896","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T15:22:17Z","timestamp":1765293737000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3774896"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,9]]},"references-count":198,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2026,4,30]]}},"alternative-id":["10.1145\/3774896"],"URL":"https:\/\/doi.org\/10.1145\/3774896","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,9]]},"assertion":[{"value":"2024-07-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-02","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-12-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}