Share your thoughts, 1 month free Claude Pro on usSee more

Long-Paragraph Factuality on FACTOR (test)

78.12Factual Accuracy

SLED

Updated 3mo ago

Evaluation Results

Method	Links
SLED 2024.11		78.12
SLED 2024.11		74.25
SLED 2024.11		73.75
Gemma-3-27B-PT (Greedy) 2024.11		72.04
SLED 2024.11		70.81
SLED 2024.11		69.94
Gemma-3-12B-PT (Greedy) 2024.11		66.67
SLED 2024.11		66.15
Gemma-3-27B-IT (Greedy) 2024.11		66
SLED 2024.11		63.29
Gemma-3-12B-IT (Greedy) 2024.11		59.12
Gemma-3-4B-PT (Greedy) 2024.11		58.78
DoLa 2024.11		55.88
SLED 2024.11		55.04
Gemma-3-4B-IT (Greedy) 2024.11		50.17
Gemma-3-1B-PT (Greedy) 2024.11		47.83
DoLa 2024.11		47.43
Gemma-3-1B-IT (Greedy) 2024.11		37.17
DoLa 2024.11		16.5
DoLa 2024.11		12.63
DoLa 2024.11		11.06
DoLa 2024.11		10.79
DoLa 2024.11		9.25
DoLa 2024.11		7.28