PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 20, 2026Proceedings of the ACM on Management of Data0 citations

Reward-SQL: Boosting Text-to-SQL via Stepwise Execution-Aware Reasoning and Process-Supervised Rewards

View Full Paper
YZYuxin ZhangMFMeihao FanJFJu Fan

Key Points

  • This research aims to enhance Text-to-SQL performance by addressing limitations in reasoning and reward mechanisms.
  • Developed Reward-SQL framework utilizing three stages: model initialization, process reward design, and process-supervised reinforcement learning.
  • Implemented a process reward model that combines trajectory scoring with step weighting.
  • Conducted experiments to evaluate performance across different domains.
  • Reward-SQL significantly outperforms baseline models while maintaining similar model sizes (specific figures not provided).
  • Shows strong cross-domain generalization performance indicating wider applicability.
  • Enhances query accuracy and interpretability through better reasoning processes.

Abstract

Recent advances in large language models (LLMs) trained with reinforcement learning (RL) have improved Text-to-SQL performance. However, RL-based approaches still struggle with complex queries due to two key limitations: insufficient stepwise execution-aware reasoning grounded in database feedback, and the lack of process-level rewards for guiding reasoning optimization. To address these issues, we propose CoCTE, a divide-and-conquer and execution-aware reasoning framework that progressively composes SQL queries through intermediate view validation and structured Common Table Expressions (CTEs), improving both accuracy and interpretability. To realize a CoCTE reasoning process, we develop Reward-SQL, a unified approach with three stages: (1) model initialization, which equips LLMs with structured CoCTE reasoning capabilities; (2) process reward design, which delivers fine-grained, execution-aware supervision; and (3) process-supervised RL and inference, which integrates process rewards into training and guides the inference stage by process rewards. This paper addresses the core challenges in Reward-SQL and makes the following contributions. We introduce a process reward model (PRM) that combines execution-aware trajectory scoring with entropy-based step weighting, providing dense and interpretable supervision across reasoning steps. We integrate PRM into both RL training and inference stages, stabilizing optimization and improving trajectory exploration with process-level signals. Experiments show that Reward-SQL significantly outperforms baselines with comparable model sizes, and exhibits strong cross-domain generalization.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Zhang et al. (2026) studied this question.

synapsesocial.com/papers/6a0d5040f03e14405aa9bf49https://doi.org/10.1145/3802105
Ask AI
Helpful
Bookmark
Share
View Full Paper