Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Lemma Judging on NaturalProofs (test)

93.2Exact Match Accuracy

Llama-3.1 (RULES)

59.50468.2527785.748Feb 1, 2026
Updated 3mo ago

Evaluation Results

MethodLinks
2026.02
93.2
2026.02
88.6
2026.02
88.5
2026.02
88.2
2026.02
85.2
2026.02
84.9
2026.02
77.6
2026.02
77.5
2026.02
76.5
2026.02
63.9
2026.02
61.3
2026.02
60.8