Share your thoughts, 1 month free Claude Pro on usSee more

Fact Verification on FEVER held-out (test)

95.1Accuracy

Direct

Updated 1mo ago

Evaluation Results

Method	Links
Direct 2026.06		95.1	55.3	-	-	-
Design B 2026.06		94.7	79.6	0.5	63.4	0.4
Design A rescue 2026.06		94.4	79.3	0.2	63.3	0.3
Design A 2-sided 2026.06		94.4	79.3	0.2	63.3	0.3
SIFT 2026.06		94	79.1	-	63	-
NLI-as-judge (DeBERTa) 2026.06		91.7	-	-	-	-
Design A rescue 2026.06		88.8	75.1	-0.4	61.5	-1.1
Design A 2-sided 2026.06		88.8	75.1	-0.4	61.5	-1.1
Design B 2026.06		88.8	75.1	-0.4	61.5	-1
Direct 2026.06		88.5	71.5	-	61.1	-
Direct 2026.06		88.1	49.6	-	41	-
SIFT 2026.06		85.3	75.5	-	62.5	-
Design B 2026.06		83	67	2.6	54.6	1.6
Direct 2026.06		82.3	50.8	-	45.5	-
Design A rescue 2026.06		79.2	64.6	0.2	53	0
Design A 2-sided 2026.06		79.2	64.6	0.2	53	0
SIFT 2026.06		78.2	60.2	-	48.3	-
Design A rescue 2026.06		78.2	60.2	0	48.3	0
Design A 2-sided 2026.06		78.2	60.2	0	48.3	0
Design B 2026.06		78.2	60.2	0	48.3	0
SIFT 2026.06		74.9	64.4	-	53	-