{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T19:06:14Z","timestamp":1779131174927,"version":"3.51.4"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2026,5,18]]},"abstract":"<jats:p>Recent advances in large language models (LLMs) trained with reinforcement learning (RL) have improved Text-to-SQL performance. However, RL-based approaches still struggle with complex queries due to two key limitations: insufficient stepwise execution-aware reasoning grounded in database feedback, and the lack of process-level rewards for guiding reasoning optimization. To address these issues, we propose CoCTE, a divide-and-conquer and execution-aware reasoning framework that progressively composes SQL queries through intermediate view validation and structured Common Table Expressions (CTEs), improving both accuracy and interpretability. To realize a CoCTE reasoning process, we develop Reward-SQL, a unified approach with three stages: (1) model initialization, which equips LLMs with structured CoCTE reasoning capabilities; (2) process reward design, which delivers fine-grained, execution-aware supervision; and (3) process-supervised RL and inference, which integrates process rewards into training and guides the inference stage by process rewards. This paper addresses the core challenges in Reward-SQL and makes the following contributions. We introduce a process reward model (PRM) that combines execution-aware trajectory scoring with entropy-based step weighting, providing dense and interpretable supervision across reasoning steps. We integrate PRM into both RL training and inference stages, stabilizing optimization and improving trajectory exploration with process-level signals. Experiments show that Reward-SQL significantly outperforms baselines with comparable model sizes, and exhibits strong cross-domain generalization.<\/jats:p>","DOI":"10.1145\/3802105","type":"journal-article","created":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T18:19:16Z","timestamp":1779128356000},"page":"1-27","source":"Crossref","is-referenced-by-count":0,"title":["Reward-SQL: Boosting Text-to-SQL via Stepwise Execution-Aware Reasoning and Process-Supervised Rewards"],"prefix":"10.1145","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-3083-1101","authenticated-orcid":false,"given":"Yuxin","family":"Zhang","sequence":"first","affiliation":[{"name":"Renmin University of China, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7597-5599","authenticated-orcid":false,"given":"Meihao","family":"Fan","sequence":"additional","affiliation":[{"name":"Renmin University of China, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4729-9903","authenticated-orcid":false,"given":"Ju","family":"Fan","sequence":"additional","affiliation":[{"name":"Renmin University of China, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-2336-0687","authenticated-orcid":false,"given":"Mingyang","family":"Yi","sequence":"additional","affiliation":[{"name":"Renmin University of China, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9530-3327","authenticated-orcid":false,"given":"Yuyu","family":"Luo","sequence":"additional","affiliation":[{"name":"HKUST (GZ), Guangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1398-0621","authenticated-orcid":false,"given":"Guoliang","family":"Li","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4743-1006","authenticated-orcid":false,"given":"Bin","family":"Wu","sequence":"additional","affiliation":[{"name":"Alibaba Cloud Computing, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2689-6020","authenticated-orcid":false,"given":"Wenchao","family":"Zhou","sequence":"additional","affiliation":[{"name":"Alibaba Cloud Computing, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,5,18]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Airbyte. 2024. Common Table Expressions (CTEs): Syntax Types & Benefits. https:\/\/airbyte.com\/data-engineering-resources\/common-table-expression. Accessed: 2025-09-22."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2505.12768"},{"key":"e_1_2_1_3_1","unstructured":"DataForgeLabs. 2023. Advanced SQL Concepts for Data Engineers. https:\/\/www.dataforgelabs.com\/advanced-sql-concepts. Accessed: 2025-09-22."},{"key":"e_1_2_1_4_1","unstructured":"DeepSeek-AI Daya Guo Dejian Yang Haowei Zhang Junxiao Song Ruoyu Zhang Runxin Xu Qihao Zhu Shirong Ma Peiyi Wang Xiao Bi Xiaokang Zhang Xingkai Yu Yu Wu Z. F. Wu Zhibin Gou Zhihong Shao Zhuoshu Li Ziyi Gao Aixin Liu Bing Xue Bingxuan Wang Bochao Wu Bei Feng Chengda Lu Chenggang Zhao Chengqi Deng Chenyu Zhang Chong Ruan Damai Dai Deli Chen Dongjie Ji Erhang Li Fangyun Lin Fucong Dai Fuli Luo Guangbo Hao Guanting Chen Guowei Li H. Zhang Han Bao Hanwei Xu Haocheng Wang Honghui Ding Huajian Xin Huazuo Gao Hui Qu Hui Li Jianzhong Guo Jiashi Li Jiawei Wang Jingchang Chen Jingyang Yuan Junjie Qiu Junlong Li J. L. Cai Jiaqi Ni Jian Liang Jin Chen Kai Dong Kai Hu Kaige Gao Kang Guan Kexin Huang Kuai Yu Lean Wang Lecong Zhang Liang Zhao Litong Wang Liyue Zhang Lei Xu Leyi Xia Mingchuan Zhang Minghua Zhang Minghui Tang Meng Li Miaojun Wang Mingming Li Ning Tian Panpan Huang Peng Zhang Qiancheng Wang Qinyu Chen Qiushi Du Ruiqi Ge Ruisong Zhang Ruizhe Pan Runji Wang R. J. Chen R. L. Jin Ruyi Chen Shanghao Lu Shangyan Zhou Shanhuang Chen Shengfeng Ye Shiyu Wang Shuiping Yu Shunfeng Zhou Shuting Pan and S. S. Li. 2025. DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning. Preprint arXiv:2501.12948."},{"key":"e_1_2_1_5_1","volume-title":"Consensus Enforcement, and Column Exploration. arXiv preprint arXiv:2502.00675","author":"Deng Minghang","year":"2025","unstructured":"Minghang Deng, Ashwin Ramachandran, Canwen Xu, Lanxiang Hu, Zhewei Yao, Anupam Datta, and Hao Zhang. 2025. ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Consensus Enforcement, and Column Exploration. arXiv preprint arXiv:2502.00675 (2025)."},{"key":"e_1_2_1_6_1","volume-title":"Christopher Meek, Oleksandr Polozov, Huan Sun, and Matthew Richardson.","author":"Deng Xiang","year":"2020","unstructured":"Xiang Deng, Ahmed Hassan Awadallah, Christopher Meek, Oleksandr Polozov, Huan Sun, and Matthew Richardson. 2020. Structure-grounded pretraining for text-to-sql. arXiv preprint arXiv:2010.12773 (2020)."},{"key":"e_1_2_1_7_1","unstructured":"Xuemei Dong Chao Zhang Yuhang Ge Yuren Mao Yunjun Gao Jinshu Lin Dongfang Lou et al. 2023. C3: Zero-shot text-to-sql with chatgpt. arXiv preprint arXiv:2307.07306 (2023)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.14778\/3681954.3681960"},{"key":"e_1_2_1_9_1","volume-title":"Autoprep: Natural language question-aware data preparation with a multi-agent framework. arXiv preprint arXiv:2412.10422","author":"Fan Meihao","year":"2024","unstructured":"Meihao Fan, Ju Fan, Nan Tang, Lei Cao, Guoliang Li, and Xiaoyong Du. 2024a. Autoprep: Natural language question-aware data preparation with a multi-agent framework. arXiv preprint arXiv:2412.10422 (2024)."},{"key":"e_1_2_1_10_1","volume-title":"DeepPrep: An LLM-Powered Agentic System for Autonomous Data Preparation. arXiv preprint arXiv:2602.07371","author":"Fan Meihao","year":"2026","unstructured":"Meihao Fan, Ju Fan, Yuxin Zhang, Shaolei Zhang, Xiaoyong Du, Jie Song, Peng Li, Fuxin Jiang, Tieying Zhang, and Jianjun Chen. 2026. DeepPrep: An LLM-Powered Agentic System for Autonomous Data Preparation. arXiv preprint arXiv:2602.07371 (2026)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE60146.2024.00284"},{"key":"e_1_2_1_12_1","volume-title":"Towards robustness of text-to-SQL models against synonym substitution. arXiv preprint arXiv:2106.01065","author":"Gan Yujian","year":"2021","unstructured":"Yujian Gan, Xinyun Chen, Qiuping Huang, Matthew Purver, John R Woodward, Jinxia Xie, and Pengsheng Huang. 2021b. Towards robustness of text-to-SQL models against synonym substitution. arXiv preprint arXiv:2106.01065 (2021)."},{"key":"e_1_2_1_13_1","volume-title":"Exploring underexplored limitations of cross-domain text-to-sql generalization. arXiv preprint arXiv:2109.05157","author":"Gan Yujian","year":"2021","unstructured":"Yujian Gan, Xinyun Chen, and Matthew Purver. 2021a. Exploring underexplored limitations of cross-domain text-to-sql generalization. arXiv preprint arXiv:2109.05157 (2021)."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.14778\/3641204.3641221"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3589292"},{"key":"e_1_2_1_16_1","volume-title":"STaR-SQL: Self-Taught Reasoner for Text-to-SQL. arXiv:2502.13550","author":"He Mingqian","year":"2025","unstructured":"Mingqian He, Yongliang Shen, Wenqi Zhang, Qiuying Peng, Jun Wang, and Weiming Lu. 2025. STaR-SQL: Self-Taught Reasoner for Text-to-SQL. arXiv:2502.13550 (2025)."},{"key":"e_1_2_1_17_1","volume-title":"Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning. arXiv preprint arXiv:2507.00432","author":"Huan Maggie","year":"2025","unstructured":"Maggie Huan, Yuetai Li, Tuney Zheng, Xiaoyu Xu, Seungone Kim, Minxin Du, Radha Poovendran, Graham Neubig, and Xiang Yue. 2025. Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning. arXiv preprint arXiv:2507.00432 (2025)."},{"key":"e_1_2_1_18_1","unstructured":"Aaron Jaech Adam Kalai Adam Lerer Adam Richardson Ahmed El-Kishky Aiden Low Alec Helyar Aleksander Madry Alex Beutel Alex Carney et al. 2024. Openai o1 system card. arXiv preprint arXiv:2412.16720 (2024)."},{"key":"e_1_2_1_19_1","first-page":"15589","article-title":"Ehrsql: A practical text-to-sql benchmark for electronic health records","volume":"35","author":"Lee Gyubok","year":"2022","unstructured":"Gyubok Lee, Hyeonji Hwang, Seongsu Bae, Yeonsu Kwon, Woncheol Shin, Seongjun Yang, Minjoon Seo, Jong-Yeup Kim, and Edward Choi. 2022. Ehrsql: A practical text-to-sql benchmark for electronic health records. Advances in Neural Information Processing Systems, Vol. 35 (2022), 15589-15601.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_20_1","unstructured":"Fangyu Lei Jixuan Chen Yuxiao Ye Ruisheng Cao Dongchan Shin Hongjin Su Zhaoqing Suo Hongcheng Gao Wenjing Hu Pengcheng Yin et al. 2024. Spider 2.0: Evaluating language models on real-world enterprise text-to-sql workflows. arXiv preprint arXiv:2411.07763 (2024)."},{"key":"e_1_2_1_21_1","volume-title":"Forty-Second International Conference on Machine Learning, ICML 2025","author":"Li Boyan","year":"2025","unstructured":"Boyan Li, Jiayi Zhang, Ju Fan, Yanwei Xu, Chong Chen, Nan Tang, and Yuyu Luo. 2025d. Alpha-SQL: Zero-Shot Text-to-SQL using Monte Carlo Tree Search. In Forty-Second International Conference on Machine Learning, ICML 2025, Vancouver, Canada, July 13-19, 2025. OpenReview.net."},{"key":"e_1_2_1_22_1","unstructured":"Haoyang Li Shang Wu Xiaokang Zhang Xinmei Huang Jing Zhang Fuxin Jiang Shuai Wang Tieying Zhang Jianjun Chen Rui Shi Hong Chen and Cuiping Li. 2025c. OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale. Preprint arXiv:2503.02240."},{"key":"e_1_2_1_23_1","volume-title":"RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL. In Thirty-Seventh AAAI Conference on Artificial Intelligence, Brian Williams, Yiling Chen, and Jennifer Neville (Eds.).","author":"Li Haoyang","year":"2023","unstructured":"Haoyang Li, Jing Zhang, Cuiping Li, and Hong Chen. 2023b. RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL. In Thirty-Seventh AAAI Conference on Artificial Intelligence, Brian Williams, Yiling Chen, and Jennifer Neville (Eds.)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3654930"},{"key":"e_1_2_1_25_1","volume-title":"Fei Huang, Reynold Cheng, and Yongbin Li.","author":"Li Jinyang","year":"2023","unstructured":"Jinyang Li, Binyuan Hui, Ge Qu, Jiaxi Yang, Binhua Li, Bowen Li, Bailin Wang, Bowen Qin, Ruiying Geng, Nan Huo, Xuanhe Zhou, Chenhao Ma, Guoliang Li, Kevin Chen-Chuan Chang, Fei Huang, Reynold Cheng, and Yongbin Li. 2023a. Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLs. In Advances in Neural Information Processing Systems 36."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.findings-acl.428"},{"key":"e_1_2_1_27_1","volume-title":"Reasoning and Tool-use Compete in Agentic RL: From Quantifying Interference to Disentangled Tuning. arXiv preprint arXiv:2602.00994","author":"Li Yu","year":"2026","unstructured":"Yu Li, Mingyang Yi, Xiuyu Li, Ju Fan, Fuxin Jiang, Binbin Chen, Peng Li, Jie Song, and Tieying Zhang. 2026. Reasoning and Tool-use Compete in Agentic RL: From Quantifying Interference to Disentangled Tuning. arXiv preprint arXiv:2602.00994 (2026)."},{"key":"e_1_2_1_28_1","unstructured":"Ziming Li Youhuan Li Yuyu Luo Guoliang Li and Chuxu Zhang. 2025b. Graph Neural Networks for Databases: A Survey. Preprint arXiv:2502.12908."},{"key":"e_1_2_1_29_1","volume-title":"The Twelfth International Conference on Learning Representations.","author":"Lightman Hunter","year":"2023","unstructured":"Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. 2023. Let's verify step by step. In The Twelfth International Conference on Learning Representations."},{"key":"e_1_2_1_30_1","unstructured":"Hanbing Liu Haoyang Li Xiaokang Zhang Ruotong Chen Haiyong Xu Tian Tian Qi Qi and Jing Zhang. 2025a. Uncovering the Impact of Chain-of-Thought Reasoning for Direct Preference Optimization: Lessons from Text-to-SQL. Preprint."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2025.3592032"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Xinyu Liu Shuyu Shen Boyan Li Nan Tang and Yuyu Luo. 2025c. NL2SQL-BUGs: A Benchmark for Detecting Semantic Errors in NL2SQL Translation. Preprint arXiv:2503.11984.","DOI":"10.1145\/3711896.3737427"},{"key":"e_1_2_1_33_1","unstructured":"Liangchen Luo Yinxiao Liu Rosanne Liu Samrat Phatale Meiqi Guo Harsh Lara Yunxuan Li Lei Shu Yun Zhu Lei Meng et al. 2024. Improve mathematical reasoning in language models by automated process supervision. Preprint arXiv:2406.06592."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.14778\/3750601.3750696"},{"key":"e_1_2_1_35_1","unstructured":"Shuai Lyu Haoran Luo Zhonghong Ou Yifan Zhu Xiaoran Shang Yang Qin and Meina Song. 2025. SQL-o1: A Self-Reward Heuristic Dynamic Search Method for Text-to-SQL. Preprint arXiv:2502.11741."},{"key":"e_1_2_1_36_1","unstructured":"Peixian Ma Xialie Zhuang Chengjin Xu Xuhui Jiang Ran Chen and Jian Guo. 2025a. SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learning. Preprint arXiv:2504.08600."},{"key":"e_1_2_1_37_1","volume-title":"Sql-r1: Training natural language to sql reasoning model by reinforcement learning. arXiv preprint arXiv:2504.08600","author":"Ma Peixian","year":"2025","unstructured":"Peixian Ma, Xialie Zhuang, Chengjin Xu, Xuhui Jiang, Ran Chen, and Jian Guo. 2025b. Sql-r1: Training natural language to sql reasoning model by reinforcement learning. arXiv preprint arXiv:2504.08600 (2025)."},{"key":"e_1_2_1_38_1","volume-title":"Yu Gan, Amin Saberi, Fatma Ozcan, and Sercan \u00d6. Arik.","author":"Pourreza Mohammadreza","year":"2024","unstructured":"Mohammadreza Pourreza, Hailong Li, Ruoxi Sun, Yeounoh Chung, Shayan Talaei, Gaurav Tarlok Kakkar, Yu Gan, Amin Saberi, Fatma Ozcan, and Sercan \u00d6. Arik. 2024. CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQL. Preprint arXiv:2410.01943."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Mohammadreza Pourreza and Davood Rafiei. 2023. DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction. In Advances in Neural Information Processing Systems 36.","DOI":"10.52202\/075280-1577"},{"key":"e_1_2_1_40_1","volume-title":"DTS-SQL: Decomposed Text-to-SQL with Small Large Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2024","author":"Pourreza Mohammadreza","year":"2024","unstructured":"Mohammadreza Pourreza and Davood Rafiei. 2024. DTS-SQL: Decomposed Text-to-SQL with Small Large Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, Florida, USA, November 12-16, 2024. Association for Computational Linguistics, 8212-8220."},{"key":"e_1_2_1_41_1","unstructured":"Mohammadreza Pourreza Shayan Talaei Ruoxi Sun Xingchen Wan Hailong Li Azalia Mirhoseini Amin Saberi and Sercan. 2025. Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQL. Preprint arXiv:2503.23157."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the Workshop on Optimization Foundations for Reinforcement Learning (OptRL).","author":"Preiss James","year":"2019","unstructured":"James Preiss, Tom Erez, and Yuval Tassa. 2019. Analyzing the Variance of Policy Gradient Estimators for the REINFORCE Algorithm in Linear Quadratic Regulator Problems. In Proceedings of the Workshop on Optimization Foundations for Reinforcement Learning (OptRL)."},{"key":"e_1_2_1_43_1","unstructured":"Rafael Rafailov Archit Sharma Eric Mitchell Christopher D. Manning Stefano Ermon and Chelsea Finn. 2023. Direct Preference Optimization: Your Language Model is Secretly a Reward Model. In Advances in Neural Information Processing Systems 36."},{"key":"e_1_2_1_44_1","volume-title":"Deepseekmath: Pushing the limits of mathematical reasoning in open language models. Preprint arXiv:2402.03300.","author":"Shao Zhihong","year":"2024","unstructured":"Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, YK Li, Y Wu, et al., 2024. Deepseekmath: Pushing the limits of mathematical reasoning in open language models. Preprint arXiv:2402.03300."},{"key":"e_1_2_1_45_1","volume-title":"MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL. In International Conference on Computational Linguistics.","author":"Wang Bing","year":"2025","unstructured":"Bing Wang, Changyu Ren, Jian Yang, Xinnian Liang, Jiaqi Bai, Linzheng Chai, Zhao Yan, Qian-Wen Zhang, Di Yin, Xing Sun, and Zhoujun Li. 2025. MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL. In International Conference on Computational Linguistics."},{"key":"e_1_2_1_46_1","volume-title":"Rat-sql: Relation-aware schema encoding and linking for text-to-sql parsers. arXiv preprint arXiv:1911.04942","author":"Wang Bailin","year":"2019","unstructured":"Bailin Wang, Richard Shin, Xiaodong Liu, Oleksandr Polozov, and Matthew Richardson. 2019. Rat-sql: Relation-aware schema encoding and linking for text-to-sql parsers. arXiv preprint arXiv:1911.04942 (2019)."},{"key":"e_1_2_1_47_1","volume-title":"Robust text-to-sql generation with execution-guided decoding. arXiv preprint arXiv:1807.03100","author":"Wang Chenglong","year":"2018","unstructured":"Chenglong Wang, Kedar Tatwawadi, Marc Brockschmidt, Po-Sen Huang, Yi Mao, Oleksandr Polozov, and Rishabh Singh. 2018. Robust text-to-sql generation with execution-guided decoding. arXiv preprint arXiv:1807.03100 (2018)."},{"key":"e_1_2_1_48_1","volume-title":"Math-shepherd: Verify and reinforce llms step-by-step without human annotations. Preprint arXiv:2312.08935.","author":"Wang Peiyi","year":"2023","unstructured":"Peiyi Wang, Lei Li, Zhihong Shao, RX Xu, Damai Dai, Yifei Li, Deli Chen, Yu Wu, and Zhifang Sui. 2023. Math-shepherd: Verify and reinforce llms step-by-step without human annotations. Preprint arXiv:2312.08935."},{"key":"e_1_2_1_49_1","volume-title":"Denny Zhou, et al.","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al., 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, Vol. 35 (2022)."},{"key":"e_1_2_1_50_1","volume-title":"Variance Reduction for Policy Gradient with Action-Dependent Factorized Baselines. arXiv preprint arXiv:1803.07246","author":"Wu Yuhuai","year":"2018","unstructured":"Yuhuai Wu, George Tucker, and Ofir Nachum. 2018. Variance Reduction for Policy Gradient with Action-Dependent Factorized Baselines. arXiv preprint arXiv:1803.07246 (2018)."},{"key":"e_1_2_1_51_1","volume-title":"Strong Reasoning in Text-to-SQL. arXiv preprint arXiv:2505.20315","author":"Yao Zhewei","year":"2025","unstructured":"Zhewei Yao, Guoheng Sun, Lukasz Borchmann, Zheyu Shen, Minghang Deng, Bohan Zhai, Hao Zhang, Ang Li, and Yuxiong He. 2025. Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL. arXiv preprint arXiv:2505.20315 (2025)."},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 3911-3921","author":"Yu Tao","unstructured":"Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, Qingning Yao, Shanelle Roman, Zilin Zhang, and Dragomir R. Radev. 2018. Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 3911-3921."},{"key":"e_1_2_1_53_1","volume-title":"ExCoT: Optimizing reasoning for text-to-SQL with execution feedback. arXiv preprint arXiv:2503.19988","author":"Zhai Bohan","year":"2025","unstructured":"Bohan Zhai, Canwen Xu, Yuxiong He, and Zhewei Yao. 2025. ExCoT: Optimizing reasoning for text-to-SQL with execution feedback. arXiv preprint arXiv:2503.19988 (2025)."},{"key":"e_1_2_1_54_1","volume-title":"TAIJI: MCP-based Multi-Modal Data Analytics on Data Lakes. arXiv preprint arXiv:2505.11270","author":"Zhang Chao","year":"2025","unstructured":"Chao Zhang, Shaolei Zhang, Quehuan Liu, Sibei Chen, Tong Li, and Ju Fan. 2025b. TAIJI: MCP-based Multi-Modal Data Analytics on Data Lakes. arXiv preprint arXiv:2505.11270 (2025)."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-020-00636-3"},{"key":"e_1_2_1_56_1","volume-title":"Deepanalyze: Agentic large language models for autonomous data science. arXiv preprint arXiv:2510.16872","author":"Zhang Shaolei","year":"2025","unstructured":"Shaolei Zhang, Ju Fan, Meihao Fan, Guoliang Li, and Xiaoyong Du. 2025a. Deepanalyze: Agentic large language models for autonomous data science. arXiv preprint arXiv:2510.16872 (2025)."},{"key":"e_1_2_1_57_1","volume-title":"Sciencebenchmark: A complex real-world benchmark for evaluating natural language to sql systems. arXiv preprint arXiv:2306.04743","author":"Zhang Yi","year":"2023","unstructured":"Yi Zhang, Jan Deriu, George Katsogiannis-Meimarakis, Catherine Kosten, Georgia Koutrika, and Kurt Stockinger. 2023. Sciencebenchmark: A complex real-world benchmark for evaluating natural language to sql systems. arXiv preprint arXiv:2306.04743 (2023)."},{"key":"e_1_2_1_58_1","unstructured":"Yizhang Zhu Runzhi Jiang Boyan Li Nan Tang and Yuyu Luo. 2025. EllieSQL: Cost-Efficient Text-to-SQL with Complexity-Aware Routing. Preprint arXiv:2503.22402."}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3802105","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T18:19:56Z","timestamp":1779128396000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3802105"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,18]]},"references-count":58,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,5,18]]}},"alternative-id":["10.1145\/3802105"],"URL":"https:\/\/doi.org\/10.1145\/3802105","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,18]]}}}