Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Table-R1: Inference-Time Scaling for Table Reasoning

About

In this work, we present the first study to explore inference-time scaling on table reasoning tasks. We develop and evaluate two post-training strategies to enable inference-time scaling: distillation from frontier model reasoning traces and reinforcement learning with verifiable rewards (RLVR). For distillation, we introduce a large-scale dataset of reasoning traces generated by DeepSeek-R1, which we use to fine-tune LLMs into the Table-R1-SFT model. For RLVR, we propose task-specific verifiable reward functions and apply the GRPO algorithm to obtain the Table-R1-Zero model. We evaluate our Table-R1-series models across diverse table reasoning tasks, including short-form QA, fact verification, and free-form QA. Notably, the Table-R1-Zero model matches or exceeds the performance of GPT-4.1 and DeepSeek-R1, while using only a 7B-parameter LLM. It also demonstrates strong generalization to out-of-domain datasets. Extensive ablation and qualitative analyses reveal the benefits of instruction tuning, model architecture choices, and cross-task generalization, as well as emergence of essential table reasoning skills during RL training.

Zheyuan Yang, Lyuhao Chen, Arman Cohan, Yilun Zhao• 2025

Related benchmarks

TaskDatasetResultRank
Table Fact VerificationTabFact (test)
Accuracy87.17
136
Table Question AnsweringWikiTQ (test)
Accuracy81.7
130
Structure ComprehendingRealHitBench
Exact Match (EM)28.5
94
Fact CheckingRealHitBench
Exact Match0.00e+0
94
Text-to-SQLSpider--
91
Numerical ReasoningRealHitBench
Exact Match (EM)0.00e+0
66
Text-to-SQLBird
Total Execution Accuracy50.98
64
Chart GenerationRealHitBench
ECR16
60
Data AnalysisRealHitBench
GPT Score36.24
60
Financial Question AnsweringFinQA (test)
Accuracy41.27
57
Showing 10 of 20 rows

Other info

Follow for update