Our new X account is live! Follow @wizwand_team for updates

Question Answering on OpenBookQA (Normalized Accuracy)

45Normalized Accuracy

Llama 3-8B

Updated 3d ago

Evaluation Results

Method	Links
Llama 3-8B 2024.12		45
Llama 3-8B E8T2 2024.12		44.8
GlobalGC 2025.02		33.6
ClipByValue 2025.02		33.2
GlobalGC 2025.02		33
AGC 2025.02		32.8
AdaGC 2025.02		32.8
Clippy 2025.02		32.4
AdaGC 2025.02		32.2
EFLA 2025.12		31.6
EFLA + Loose β 2025.12		30.8
GatedFWA-NSA 2025.12		30.8
ClipByValue 2025.02		30.4
AdaGC 2025.02		30.4
GlobalGC 2025.02		30.2
Transformer (LLaMA) + SWA + NSA 2025.12		30.18
HGRN2 2025.12		30
Clippy 2025.02		30
GatedFWA 2025.12		29.93
DeltaNet 2025.12		29.8
Transformer (LLaMA) 2025.12		29.4
Transformer (LLaMA) + SWA 2025.12		29.22
GLA 2025.12		29.2
DeltaNet 2025.12		29
RetNet 2025.12		28.4
Mamba 2025.12		28
DeltaNet 2025.12		27
EFLA + Adaptive Decay 2025.12		27
EFLA 2025.12		26.6
Dual 2025.12		17.6
Dual 2025.12		14.4
Autoregressive 2025.12		13.6
Autoregressive 2025.12		9.9
Dual 2025.12		8.5
Autoregressive 2025.12		-0.5