Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Law

Benchmarks

Task NameDataset NameSOTA ResultTrend
Law reasoningLaw
Accuracy70.25
27
Legal ReasoningLaw
Score26.52
13
Machine TranslationLaw (test)
BLEU61.55
9
Multi-class ClassificationLaw
Accuracy69.1
8
Machine TranslationLaw (Ko-En) (test)
BLEU53.8
8
Machine TranslationLaw De-En (test)
BLEU75.44
8
Counterfactual ExplanationsLaw
Coverage100
6
Machine TranslationLaw All-domain datastore (test)
BLEU61.22
6
Legal ReasoningLaw (test)
Score45.29
5
Machine TranslationLaw En-De out-of-domain WMT14 (test)
BLEU Score41.5
5
Machine TranslationLaw multi-domain (test)
Decoding Speed (Tok/Sec)3,690.85
2
Showing 11 of 11 rows