Story Reasoning on XStoryCloze

58.5Accuracy

Gemma 2

Updated 1mo ago

Evaluation Results

Method	Links
Gemma 2 2024.08		58.5
FT 2023.11		57.6
FT 2023.11		57.2
LoRA 2023.11		57
LoRA 2023.11		57
DMoE 2025.06		56.6
BLOOM + Continued Pre-training 2025.06		56.4
Branch-Train-Mix 2025.06		56.4
Branch-Train-Mix 2025.06		56.2
XGLM 2024.08		56.2
DMoE 2025.06		56.1
Parrot-7B 2023.11		56.1
BLOOM 2025.06		56
BLOOM + Continued Pre-training 2025.06		56
Embed FT 2023.11		55.9
Embed FT 2023.11		55.9
LoRA 2023.11		55.9
Embed FT 2023.11		55.9
FT 2023.11		55.6
BLOOM 2025.06		55.5
LLaMA-7B 2023.11		55.5
LLaMA 3 2024.08		55.1
DMoE 2025.06		54.1
BLOOM + Continued Pre-training 2025.06		53.8
Branch-Train-Mix 2025.06		53.8
BLOOM 2025.06		53.5
DMoE 2025.06		53.4
Branch-Train-Mix 2025.06		53.1
XGLM 2024.08		53.1
BLOOM + Continued Pre-training 2025.06		52.7
Gemma 2 2024.08		52.7
BLOOM 2025.06		52.6
BLOOM 2024.08		52.6
Goldfish 2024.08		52.3
Chance 2024.08		50