Story Reasoning on XStoryCloze

71Accuracy

BETR

Updated 20d ago

Evaluation Results

Method	Links
BETR 2026.04		71
NAG_Llama-3.2-3B 2026.04		70.8
NAG_SmolLM3-3B 2026.04		70.5
NAG_Qwen3-1.7B 2026.04		70
NAG_Llama-3.2-3B 2026.04		69.8
BETR 2026.04		69.5
NAG_Qwen3-1.7B 2026.04		69.3
NAG_SmolLM3-3B 2026.04		69.2
Random 2026.04		67.1
FineWeb-Edu 2026.04		65.9
Ours-SFT 2025.07		61.86
Ours-Base 2025.07		60.8
Ours-Base-32k 2025.07		60.6
Gemma 2 2024.08		58.5
FT 2023.11		57.6
FT 2023.11		57.2
LoRA 2023.11		57
LoRA 2023.11		57
DMoE 2025.06		56.6
BLOOM + Continued Pre-training 2025.06		56.4
Branch-Train-Mix 2025.06		56.4
Branch-Train-Mix 2025.06		56.2
XGLM 2024.08		56.2
DMoE 2025.06		56.1
Parrot-7B 2023.11		56.1
BLOOM 2025.06		56
BLOOM + Continued Pre-training 2025.06		56
Embed FT 2023.11		55.9
Embed FT 2023.11		55.9
LoRA 2023.11		55.9
Embed FT 2023.11		55.9
FT 2023.11		55.6
BLOOM 2025.06		55.5
LLaMA-7B 2023.11		55.5
LLaMA 3 2024.08		55.1
DMoE 2025.06		54.1
BLOOM + Continued Pre-training 2025.06		53.8
Branch-Train-Mix 2025.06		53.8
BLOOM 2025.06		53.5
DMoE 2025.06		53.4
Branch-Train-Mix 2025.06		53.1
XGLM 2024.08		53.1
BLOOM + Continued Pre-training 2025.06		52.7
Gemma 2 2024.08		52.7
BLOOM 2025.06		52.6
BLOOM 2024.08		52.6
Goldfish 2024.08		52.3
Chance 2024.08		50
Tibetan-Alpaca-7B 2025.07		49.97
Tibetan-Llama2-7B 2025.07		49.37
Yak-Llama2-7B 2025.07		48.37