Commonsense Reasoning on HellaSwag (val)

95.3Accuracy

GPT-4

Updated 3d ago

Evaluation Results

Method	Links
GPT-4 2023.03		95.3
D2-LoRA 2026.02		91
LoRA 2026.02		90.2
DoRA 2026.02		90
ALUM 2023.03		85.6
GPT-3.5 2023.03		85.5
LLaMA 2023.03		84.2
D2-LoRA 2026.02		82.4
DoRA 2026.02		81.8
LoRA 2026.02		77.6
DeepSeekMoE 2024.01		54.8
Mistral (Full-Attention) 2024.07		50.7
GShard 2024.01		50.5
Switch 2024.01		49.1
BMoJo (Fading + Eidetic) 2024.07		46.8
Hash Layer 2024.01		46.2
BMoJo (Fading) 2024.07		46
Mamba (SSM) 2024.07		45
Dense 2024.01		38.8
Hybrid (Sliding Attention + SSM) 2024.07		38.8
Mistral (Full-Attention) 2024.07		33.8
Mamba (SSM) 2024.07		33.4
BMoJo (Fading + Eidetic) 2024.07		33.3
BMoJo (Fading) 2024.07		33.2
Hybrid (Sliding Attention + SSM) 2024.07		31.3