Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Legal$\Delta$: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gain

About

Legal Artificial Intelligence (LegalAI) has achieved notable advances in automating judicial decision-making with the support of Large Language Models (LLMs). However, existing legal LLMs still struggle to generate reliable and interpretable reasoning processes. They often default to fast-thinking behavior by producing direct answers without explicit multi-step reasoning, limiting their effectiveness in complex legal scenarios that demand rigorous justification. To address this challenge, we propose Legal$\Delta$, a reinforcement learning framework designed to enhance legal reasoning through chain-of-thought guided information gain. During training, Legal$\Delta$ employs a dual-mode input setup-comprising direct answer and reasoning-augmented modes-and maximizes the information gain between them. This encourages the model to acquire meaningful reasoning patterns rather than generating superficial or redundant explanations. Legal$\Delta$ follows a two-stage approach: (1) distilling latent reasoning capabilities from a powerful Large Reasoning Model (LRM), DeepSeek-R1, and (2) refining reasoning quality via differential comparisons, combined with a multidimensional reward mechanism that assesses both structural coherence and legal-domain specificity. Experimental results on multiple legal reasoning tasks demonstrate that Legal$\Delta$ outperforms strong baselines in both accuracy and interpretability. It consistently produces more robust and trustworthy legal judgments without relying on labeled preference data. All code and data will be released at https://github.com/NEUIR/LegalDelta.

Xin Dai, Buqiang Xu, Zhenghao Liu, Yukun Yan, Huiyuan Xie, Xiaoyuan Yi, Shuo Wang, Ge Yu• 2025

Related benchmarks

TaskDatasetResultRank
Legal Research and ReasoningLegalSearch In-domain
LAR (Rouge-L)52.31
18
Legal Examinationlegal examination tasks Out-of-domain
CPA59.38
18
Legal Judgment PredictionCAIL 2018
Public Safety Accuracy40.8
15
Legal Judgment PredictionCMDL
Public Safety Accuracy58.3
15
Legal Judgment PredictionCAIL & CMDL Average
Average Score42.4
15
Term-of-Penalty PredictionCAIL
Public Safety ACC11.9
13
Article PredictionCAIL
Public Safety Accuracy33
13
Showing 7 of 7 rows

Other info

Follow for update