Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction

About

Legal judgment prediction is essential for enhancing judicial efficiency. In this work, we identify that existing large language models (LLMs) underperform in this domain due to challenges in understanding case complexities and distinguishing between similar charges. To adapt LLMs for effective legal judgment prediction, we introduce the Ask-Discriminate-Predict (ADAPT) reasoning framework inspired by human judicial reasoning. ADAPT involves decomposing case facts, discriminating among potential charges, and predicting the final judgment. We further enhance LLMs through fine-tuning with multi-task synthetic trajectories to improve legal judgment prediction accuracy and efficiency under our ADAPT framework. Extensive experiments conducted on two widely-used datasets demonstrate the superior performance of our framework in legal judgment prediction, particularly when dealing with complex and confusing charges.

Chenlong Deng, Kelong Mao, Yuyao Zhang, Zhicheng Dou• 2024

Related benchmarks

TaskDatasetResultRank
Legal Judgment PredictionCMDL
Public Safety Accuracy54.5
15
Legal Judgment PredictionCAIL 2018
Public Safety Accuracy38.7
15
Legal Judgment PredictionCAIL & CMDL Average
Average Score42.8
15
Article PredictionCAIL
Public Safety Accuracy40.1
13
Term-of-Penalty PredictionCAIL
Public Safety ACC8.3
13
Showing 5 of 5 rows

Other info

Follow for update